Elasticsearch From the Bottom Up
10 j'aime
vues
Elasticsearch From the Bottom Up
10 j'aime
vues
The talk covers how Elasticsearch, Lucene and to some extent search engines in general actually work under the hood. We'll start at the "bottom" (or close enough!) of the many abstraction levels, and gradually move upwards towards the user-visible layers, studying the various internal data structures and behaviors as we ascend. Elasticsearch provides APIs that are very easy to use, and it will get you started and take you far without much effort. However, to get the most of it, it helps to have some knowledge about the underlying algorithms and data structures. This understanding enables you to make full use of its substantial set of features such that you can improve your users search experiences, while at the same time keep your systems performant, reliable and updated in (near) real time.
Elasticsearch From the Bottom Up
- Elasticsearch from the Bottom Up Njal Karevoll njal@found.no @nkvoll
- Elasticsearch from the Bottom Up Njal Karevoll njal@found.no @nkvoll
- Who? Co-founder of Found AS - Hosted Elasticsearch: found.no 8+ years search, 3+ Elasticsearch Herding hundreds of Elasticsearch clusters
- Motivation • Why isn't my search for *foo-bar* matching “foo-bar"? • Why can adding more documents shrink the index? • Why is Elasticsearch using so much memory?
- Segments are immutable
- Deletes?
- Compress all the things!
- Cache all the things!
- Search by index terms Text analysis gives us terms
- Search by segment Uses several data structures
- Immutable segments
- Shard == Lucene Index
- Elasticsearch Index abstracts Lucene Indexes
- … across nodes in a cluster
- Learn More! found.no/foundation Follow @foundsays