This presentation is a non-technical overview of what kind of tool a search solution is. Elasticsearch is used to explain the concepts as well as provide a number of jobs that can be performed with a search solution. This presentation is given at the nosqlmatters road show conference in Amsterdam in oktober 2013

1. Search: the right tool ...
... but what is the job?
Jettro Coenradie
jco@trifork.nl
@gridshore

2. The right tool ...

3. ... but what is the job?

4. The right tool
Search
and the job is

5. Two people to help me

6. Meet
the
customer
!
Marc

7. Meet our
software
developer
!
John

8. What is a Search Solution?

9. Search
=
finding stuff

10. Search Solution
=
Services for finding stuff

11. SELECT * FROM jobs
WHERE title like ‘%elasticsearch%’
OR description like ‘%elasticsearch%’
OR ...

12. Not optimized for
free text search

13. Inverted index
For this job you need
thorough knowledge
of elasticsearch.
We are looking for
Elasticsearch
trainees
Terms
job
1
knowledge
1
elasticsearch
1,2
trainees
2

14. Analysis
• Tokenizing
• Filters
• Analyzers

15. Searching/Querying
• Stemming
• Synonyms
• Sounds like

16. Open source
Search solutions
elasticsearch

17. Design overview
Application
Java
Groovy
Php
Perl
Python
+
uses
Driver
calls

18. Design overview
Application
calls
REST/HTTP

19. What can you tell about
Security?

20. There is no security
• Do not expose your search solution to the
public
• Use a proxy (guides are available)

21. Becoming successful
A lot of vacancies
A lot of job seekers

22. Being successful
Scalability
Availability

23. Storing more content

24. Storing more content

25. Prevent data loss

26. Keep copies

27. The right tool ...

28. Github

29. Facets

30. Highlighting

31. Recommendation

32. Geospatial search

33. Log analysis

34. Data analysis
http://www.kibana.org

35. Log analysis
Ralph Meijer
using elasticsearch and logstash to
serve billions of searchable events
http://www.elasticsearch.org/blog/using-elasticsearch-and-logstash-to-serve-billions-of-searchableevents-for-customers/

36. Percolator

37. Percolator
https://github.com/abronner/elasticsearch-monitoring

38. Percolator

39. NoSQL
Beeld en Geluid
Store the meta-data of all image, audio and video material

40. The right tool
The job
Jettro Coenradie jco@trifork.nl

41. Questions?