7. q = fox
The lazy dog jumps over a quick brown fox
5 times a
8. The quick brown fox
The quick brown fox
jumps quick the lazy fox
The over brown dog
jumps over the lazy dog
jumps over the lazy dog
The quick brown fox
The quickdog jumps
q = fox The lazy brown fox
jumps over the lazy dog
jumps the brown foxdog
over over the lazy
The quick brown fox
The quick brown fox
jumps quick the lazy fox
The over brown dog
jumps over the lazy dog
jumps over the lazy dog
9. The quick brown fox
The quick brown fox
jumps quick the lazy fox
The over brown dog
jumps over the lazy dog 5a
jumps over the lazy dog
The quick brown fox
The quickdog jumps
The lazy brown fox
jumps over the lazy dog
jumps the brown foxdog
over over the lazy 3a 10 a
The quick brown fox
The quick brown fox
jumps quick the lazy fox
The over brown dog
jumps over the lazy dog 2a
jumps over the lazy dog
10. "facets": {
"o_count": {
The quick brown fox "lettercount": {
The quick brown fox
jumps quick the lazy fox
The over brown dog
jumps over the lazy dog 5a "letter": "o",
jumps over the lazy dog "field": "doc"
}
}
}
The quick brown fox
The quickdog jumps
The lazy brown fox
jumps over the lazy dog
jumps the brown foxdog
over over the lazy 3a 10 a
"facets": {
The quick brown fox "o_count": {
The quick brown fox
jumps quick the lazy fox
The over brown dog
jumps over the lazy dog 2a "type ": "lettercount"
jumps over the lazy dog "count": 12
}
}
12. The quick brown fox
The quick brown fox
jumps quick the lazy fox
The over brown dog
jumps over the lazy dog
jumps over the lazy dog
The quick brown fox
The quickdog jumps
q = fox The lazy brown fox
jumps over the lazy dog
jumps the brown foxdog
over over the lazy
The quick brown fox
The quick brown fox
jumps quick the lazy fox
The over brown dog
jumps over the lazy dog
jumps over the lazy dog
13. Facet Processor
parse
creates per shard
doc ids Facet Collector Facet
doc ids doc values
Field Cache
15. brown 2 5 10 12
dog
fox 5 6 12 13
quick
2
5
brown
6 dog
10 fox
quick
12
13
16. The quick brown fox
The quick brown fox
jumps quick the lazy fox
The over brown dog
jumps over the lazy dog 5a
jumps over the lazy dog
The quick brown fox
The quickdog jumps
The lazy brown fox
jumps over the lazy dog
jumps the brown foxdog
over over the lazy 3a 10 a
The quick brown fox
The quick brown fox
jumps quick the lazy fox
The over brown dog
jumps over the lazy dog 2a
jumps over the lazy dog
18. James 3
Charlie 2
Adam 2
Eve 1
Brown 2
Remco 2
Adam 2
Eve 1
David 3
James 2
Jan 2
Eve 1
19. James 3 James 3
Charlie 2
Charlie 2
Adam 2
Adam 2
Eve 1
Brown 2
Brown 2
Remco 2
Remco 2
Adam 2
Adam 2
Eve 1
David 3
David 3
James 2
James 2
Jan 2
Jan 2
Eve 1
20. James 3 James 3
Charlie 2
Charlie 2
Adam 2
Adam 2
Eve 1
Brown 2
Brown 2 James 5
Remco 2
Remco 2 Adam 4
Adam 2
Adam 2 Remco 2
Eve 1
David 3
David 3
James 2
James 2
Jan 2
Jan 2
Eve 1
21. Facet Processor
parse
Facet Collector
Facet
internal stream
Facet Processor
reduce
output
multi threaded
single thread
24. Facet Processor
parse
Facet Collector
Facet
internal stream
Facet Processor
reduce
output
multi threaded
single thread
25. Facet Processor
parse
Date Facet Collector
Value Processor
10 sept. 17 sept.
Value Facet Collector Value Facet Collector
Value Facet Value Facet
Value Facet Reduce Value Facet Reduce
26. Thanks!
Code is available on github:
Letter Count Facet: https://github.com/bleskes/es_nl_meetup_2012_9_20
Faceted Date Histogram: https://github.com/bleskes/elasticfacets
Notes de l'éditeur
\n
\n
\n
Survey\n- How many people wrote an ES plugin?\n- How many people are familiar with the ES Faceting code?\n- How many people wrote an ES facet?\n
\n
\n
\n
\n
\n
remember the process, input sent to shards where the search is made. Then faceting kicks in.\n
hmm - \nvalues are really tokens (potentially show the A example)\nmemory !!\n
\n
\n
remember - this may lose data. Facets like top X terms may get wrong results\n
\n
\n
\n
\n
- Date histogram is cool, but only gives you numerical stats\n- We needed to be able to know the top influentials in our data on a week by week basis (or month or what have you)\n-> Faceted Date Histogram was born -> What is it?\n