A hands on training about Elasticsearch I gave at TechFinancials IL

1. Elasticsearch
From Zero to Hero
Daniel Ziv

2. Whatiselasticsearch?
ElasticSearch is a text-search software created by Shay Banon
(An Israeli guy!).
Under the hood it uses Lucene for it’s fest and intelligent
text abilities.

3. Itchangedalotovertheyears!

4. Andcollectedmanyfriendsalongtheway

5. Keyfeatures
Elasticsearch has a lot to offer, here’s just some of the
stuff:
● RESTful API for querying and inserting data
● Massive aggregations abilities
● Custom and pre-made “analyzers” / ”tokenizers”
● It’s easy to scale and cluster
● “Discovery” and “Transport”
● It uses “Sharding” and “Voting” for better performance

6. architecture
Only masters get to “Vote” (and hold data).
Data nodes are just keeping your data safe.
Load balancers are nodes that holds no data and don’t get to
vote.
So… How many “Masters” do I need?
OUR PORTS:
9200-9299 for HTTP Access
9300-9400 for Discovery
& Transport Protocol

7. Replicaaass!!

8. Thecrud!
C - Create
R - Retrieve
U - Update
D - Delete
* CURD

9. FromIndexestodocuments
Indexes are like databases, each index holds multiple types
(tables) and each type define the documents in it (records).
A document is the JSON implementation of each entity, and has
many fields with different attributes.

10. Itlookssomethinglikethis

11. Let’srecap

12. Handson!

13. Installing
● Java 7 is strongly preferred over Java 6. Either Oracle
or OpenJDK are acceptable.
● Download and Install
● Run curl -X GET http://localhost:9200 (Or browse with Chrome)
● Add this collection to your Postman

15. Createindexes
Create a new index for “posts”:
curl -XPUT 'localhost:9200/my_index’
{
"acknowledged" : true
}
Try to create it again and it throws exception.

16. Indexes“metadata”
From now on, we call it “Mapping” (oohhh… fancy!)
Each index has one or more mapping types, which are used to divide the documents in an
index into logical groups. User documents might be stored in a user type, and blog posts
in a blogpost type.
So Let’s create an Index with Mapping (postman)

17. Workingwithdocuments
Now open your postman and:
1.Create your first tweet
2.Create a formatted tweet
3.Update your tweet
4.Request a specific version
5.Delete your tweet
6.Delete your Index

18. Querying
Download and run some test data
To query Elasticsearch we use QueryDSL, and we send the query JSON to the
server via POST method.
QueryDSL is consisting of two types of clauses:
1. Leaf query clauses: looks for a particular value in a particular field
(Match/Term/Range)
2. Compound query clauses: Compound query clauses wrap other leaf or compound
queries

19. Leafqueries

20. SELECT*FROMTWEETS
{
"query":
{
"match_all": {}
}
}

21. Where
{
"query":
{
"match" : {
"title" : "hi"
}
}
}
Advanced

22. Where
{
"query":
{
"multi_match" : {
"query": "hi",
"fields": [ "subject", "title" ]
}
}
}

23. Range
{
"query":
{
"range" : {
"likes" : {
"gte" : 1,
"lte" : 20
}
}
}
}
gte Greater-than or
equal to
gt Greater-than
lte Less-than or
equal to
lt Less-than

24. Exists
{
"query":
{
"exists" : { "field" : "title" }
}
}
(And “missing” is the opposite operation)

25. PREFIX
{
"query":
{
"prefix" : { "title" : "h" }
}
}

26. Compoundqueries

27. BinaryOperators -AND
{
"query" :
{
"filtered" : {
"query" : {
"match" : { "title" : "Hi" }
},
"filter" : {
"and" : [
{
"range" : {
"likes" : {
"gte" : 10,
"lte" : 20
}
}
}
]
}
}
}
}

28. BinaryOperators -or
{
"query" :
{
"filtered" : {
"query" : {
"match" : { "title" : "Hi" }
},
"filter" : {
"or" : [
{
"range" : {
"likes" : {
"lte" : 20
}
}
}
,
{
"match" : { "likes" : "25" }
}
]
}
}
}
}

29. BinaryOperators -not
{
"query" :
{
"bool" : {
"must" : {
"match" : { "title" : "Hi" }
},
"filter" : {
"not" : {
"range" : {
"likes" : {
"gte" : 10,
"lte" : 20
}
}
}
}
}
}
}

30. Limit(pershard)
{
"query" :
{
"filtered" : {
"filter" : {
"limit" : {"value" : 2}
},
"query" : {
"match_all": {}
}
}
}
}

31. AdvancedClass

32. Advancedqueries
● Joining queries
● Geo queries
● Specialized queries
● Span queries

33. Advancedtopics
● Heap Sizing - DevOps Must
● Elasticsearch and NginX
● Transport Protocol
● Elasticsearch Head
● Plugins and Analyzers
● Aggregations Docs - Dev & PM Must
● Bulk API - Dev Must

34. Thankyou!