Elastic search meetup 20/9/2012
•
1 like•748 views
Presentation given by me on the first ElasticSearch NL meetup.
Recommended
Recommended
More Related Content
Recently uploaded
Recently uploaded (20)
Featured
Featured (20)
Elastic search meetup 20/9/2012
- 1. ElasticSearch NL 20/9/2012
- 2. Tonight • Pizza & Beer • Deep dive into faceting ( me :) ) • ElasticSearch.com introduction ( Uri/Shay ) • More drinks..
- 3. Deep Dive into Faceting Boaz Leskes CTO Buzzcapture @bleskes
- 4. ?
- 5. The lazy dog jumps over a quick brown fox
- 6. The lazy dog jumps over a quick brown fox
- 7. q = fox The lazy dog jumps over a quick brown fox 5 times a
- 8. The quick brown fox The quick brown fox jumps quick the lazy fox The over brown dog jumps over the lazy dog jumps over the lazy dog The quick brown fox The quickdog jumps q = fox The lazy brown fox jumps over the lazy dog jumps the brown foxdog over over the lazy The quick brown fox The quick brown fox jumps quick the lazy fox The over brown dog jumps over the lazy dog jumps over the lazy dog
- 9. The quick brown fox The quick brown fox jumps quick the lazy fox The over brown dog jumps over the lazy dog 5a jumps over the lazy dog The quick brown fox The quickdog jumps The lazy brown fox jumps over the lazy dog jumps the brown foxdog over over the lazy 3a 10 a The quick brown fox The quick brown fox jumps quick the lazy fox The over brown dog jumps over the lazy dog 2a jumps over the lazy dog
- 10. "facets": { "o_count": { The quick brown fox "lettercount": { The quick brown fox jumps quick the lazy fox The over brown dog jumps over the lazy dog 5a "letter": "o", jumps over the lazy dog "field": "doc" } } } The quick brown fox The quickdog jumps The lazy brown fox jumps over the lazy dog jumps the brown foxdog over over the lazy 3a 10 a "facets": { The quick brown fox "o_count": { The quick brown fox jumps quick the lazy fox The over brown dog jumps over the lazy dog 2a "type ": "lettercount" jumps over the lazy dog "count": 12 } }
- 11. Intermezzo A plugin to register your facet
- 12. The quick brown fox The quick brown fox jumps quick the lazy fox The over brown dog jumps over the lazy dog jumps over the lazy dog The quick brown fox The quickdog jumps q = fox The lazy brown fox jumps over the lazy dog jumps the brown foxdog over over the lazy The quick brown fox The quick brown fox jumps quick the lazy fox The over brown dog jumps over the lazy dog jumps over the lazy dog
- 13. Facet Processor parse creates per shard doc ids Facet Collector Facet doc ids doc values Field Cache
- 14. brown 2 5 10 12 dog fox 5 6 12 13 quick
- 15. brown 2 5 10 12 dog fox 5 6 12 13 quick 2 5 brown 6 dog 10 fox quick 12 13
- 16. The quick brown fox The quick brown fox jumps quick the lazy fox The over brown dog jumps over the lazy dog 5a jumps over the lazy dog The quick brown fox The quickdog jumps The lazy brown fox jumps over the lazy dog jumps the brown foxdog over over the lazy 3a 10 a The quick brown fox The quick brown fox jumps quick the lazy fox The over brown dog jumps over the lazy dog 2a jumps over the lazy dog
- 17. Facet Facet Processor Facet Facet Facet reduce internal stream
- 18. James 3 Charlie 2 Adam 2 Eve 1 Brown 2 Remco 2 Adam 2 Eve 1 David 3 James 2 Jan 2 Eve 1
- 19. James 3 James 3 Charlie 2 Charlie 2 Adam 2 Adam 2 Eve 1 Brown 2 Brown 2 Remco 2 Remco 2 Adam 2 Adam 2 Eve 1 David 3 David 3 James 2 James 2 Jan 2 Jan 2 Eve 1
- 20. James 3 James 3 Charlie 2 Charlie 2 Adam 2 Adam 2 Eve 1 Brown 2 Brown 2 James 5 Remco 2 Remco 2 Adam 4 Adam 2 Adam 2 Remco 2 Eve 1 David 3 David 3 James 2 James 2 Jan 2 Jan 2 Eve 1
- 21. Facet Processor parse Facet Collector Facet internal stream Facet Processor reduce output multi threaded single thread
- 24. Facet Processor parse Facet Collector Facet internal stream Facet Processor reduce output multi threaded single thread
- 25. Facet Processor parse Date Facet Collector Value Processor 10 sept. 17 sept. Value Facet Collector Value Facet Collector Value Facet Value Facet Value Facet Reduce Value Facet Reduce
- 26. Thanks! Code is available on github: Letter Count Facet: https://github.com/bleskes/es_nl_meetup_2012_9_20 Faceted Date Histogram: https://github.com/bleskes/elasticfacets
Editor's Notes
- \n
- \n
- \n
- Survey\n- How many people wrote an ES plugin?\n- How many people are familiar with the ES Faceting code?\n- How many people wrote an ES facet?\n
- \n
- \n
- \n
- \n
- \n
- remember the process, input sent to shards where the search is made. Then faceting kicks in.\n
- hmm - \nvalues are really tokens (potentially show the A example)\nmemory !!\n
- \n
- \n
- remember - this may lose data. Facets like top X terms may get wrong results\n
- \n
- \n
- \n
- \n
- - Date histogram is cool, but only gives you numerical stats\n- We needed to be able to know the top influentials in our data on a week by week basis (or month or what have you)\n-> Faceted Date Histogram was born -> What is it?\n
- \n
- \n
- \n