A quick introduction to ElasticSearch basics, how to create mapping of indexes and how to write searching queries.

1. Introduction to
ElasticSearch
Ashish
@ashish_fagna

2. Elasticsearch
real time,
search and
analytics engine

3. Elasticsearch
real time,
search and
analytics engine
distributed

4. real time,
search and
analytics engine
distributed
scales
massively Elasticsearch

5. Elasticsearch
real time,
search and
analytics engine
distributed
scales
massively
high
availability

6. Elasticsearch
real time,
search and
analytics engine
distributed
scales
massively
high
availability
RESTful API

7. Elasticsearch
real time,
search and
analytics engine
distributed
scales
massively
high
availability
RESTful
API
JSON
over HTTP

8. Elasticsearch
real time,
search and distributed
scales
massively
high
availability
RESTful
API
JSON
over HTTP
schema
analytics enginefree

9. Elasticsearch
real time,
search and
analytics engine
distributed
scales
massively
RESTful
API
JSON
over HTTP
high
availability
schema
free
multi
tenancy

10. Elasticsearch
real time,
search and
analytics engine
distributed
open-source
scales
massively
RESTful
API
JSON
over HTTP
high
availability
schema
free
multi
tenancy

11. Elasticsearch
real time,
search and
analytics engine
Lucene
based
distributed
open-source
scales
massively
RESTful
API
JSON
over HTTP
high
availability
schema
free
multi
tenancy

12. > ./bin/elasticsearch
> _

13. Usage

14. > curl -XGET localhost:9200/?pretty

15. > curl -XGET localhost:9200/?pretty
verb

16. > curl -XGET localhost:9200/?pretty
node

17. > curl -XGET localhost:9200/?pretty
HTTP port

18. > curl -XGET localhost:9200/?pretty
path

19. > curl -XGET localhost:9200/?pretty
query string

20. > curl -XGET localhost:9200/?pretty

21. GET /

22. GET /
{
Man",
for Search",
: "Exploding
: "You Know,
: true,
: 200,
: {
"name"
"tagline"
"ok"
"status"
"version"
"number"
"snapshot_build"
: "0.90.1",
: false
}
}

23. Where do we start?

24. With data

25. {
is AWESOME","tweet":
"nick":
"name":
"date":
"rt" :
"loc":
"lat":
"lon":
"I think #elasticsearch
"@ashish",
"Ashish K",
"2016-01-01",
5,
{
13.4,
52.5
}

26. Saving in ElasticSearch

27. PUT /index/type/id

28. PUT /index/type/id
where?

29. PUT /myapp/type/id

30. PUT /myapp/type/id
what?

31. PUT /myapp/tweet/id

32. PUT /myapp/tweet/id
which?

33. PUT /myapp/tweet/1

34. PUT /myapp/tweet/1 -d '
{
is AWESOME","I think #elasticsearch
"@ashish",
"Ashish Kumar",
"2013-06-03",
5,
{
77,
13.5
"tweet":
"nick":
"name":
"date":
"rt":
"loc":
"lat":
"lon":
}
}
'

35. {
"_index":
"_type":
"_id":
"_version":
"ok":
"myapp",
"tweet",
"1",
1,
true
}
# 201 CREATED

36. Get

37. GET /myapp/tweet/1

38. {
"_index":
"_type":
"_id":
"_version":
"exists":
"_source":
"myapp",
"tweet",
"1",
1,
true,
{ ...OUR TWEET... }
}
# 200 OK

39. Update

40. PUT /myapp/tweet/1 -d '
{
is AWESOME","I know #elasticsearch
"@ashish",
"Ashish Kumar",
"2016-01-01",
5,
{
77,
13.5
"tweet":
"nick":
"name":
"date":
"rt":
"loc":
"lat":
"lon":
}
}
'

41. {
"_index":
"_type":
"_id":
"_version":
"ok":
"myapp",
"tweet",
"1",
2,
true
}
# 200 OK

42. Delete

43. DELETE /myapp/tweet/1

44. {
"_index": "myapp",
"_type": "tweet",
"_id": "1",
"_version": 3,
"ok": true,
"found": true
}
# 200 OK

45. Cheaper in bulk

46. Any
datastore
Elasticsearch
Client
Mirror external DB

47. Any
datastore
Elasticsearch
Client
Standalone

48. "Empty" Search

49. GET /_search

50. GET /_search
{
"took" : 2,
}

51. GET /_search
{
"took" :
"timed_out" :
2,
false,
}

52. GET /_search
{
2,
false,
"took" :
"timed_out" :
"_shards" : {
"total" : 10,
"successful" : 10,
"failed" : 0
},
}

53. GET /_search
{
2,
false,
"took" :
"timed_out" :
"_shards" : {
"total" : 10,
"successful" : 10,
"failed" : 0
14,
: 1.0,
[ { ... }]
},
"hits" : {
"total" :
"max_score"
"hits" :
}
}

54. GET /_search
"de",
"tweet",
"4",
: { ... },
1.0,
"hits" : [
{
"_index" :
"_type" :
"_id" :
"_source"
"_score" :
},
...
]

55. Multi-index
Multi-type

56. GET /index/_search

57. GET /index/_search
GET /index1,index2/_search

58. GET /index/_search
GET /index1,index2/_search
GET /ind*/_search

59. GET /index/_search
GET /index1,index2/_search
GET /ind*/_search
GET /index/type/_search

60. GET /index/_search
GET /index1,index2/_search
GET /ind*/_search
GET /index/type/_search
GET /index/type1,type2/_search

61. GET /index/_search
GET /index1,index2/_search
GET /ind*/_search
GET /index/type/_search
GET /index/type1,type2/_search
GET /index/type*/_search

62. GET /index/_search
GET /index1,index2/_search
GET /ind*/_search
GET /index/type/_search
GET /index/type1,type2/_search
GET /index/type*/_search
GET /_all/type*/_search

63. Pagination

64. Pagination
size = num of results

65. Pagination
size = num of results
from = results to skip

66. GET /_search?size=5&from=0
GET /_search?size=5&from=5
GET /_search?size=5&from=10

67. Search Lite

68. Search Lite
GET /_search?q=name:john

69. +tweet:foo +name:john +date:>2013-05-01

70. +tweet:foo +name:john +date:>2013-05-01
→ percent encoding →

71. +tweet:foo +name:john +date:>2013-05-01
?q=%2Btweet%3Afoo+%2Bname%3Ajohn+
%2Bdate%3A%3E2013-05-01
→ percent encoding →

72. GET /_search?q=mary

73. → user named "Mary"
→ tweets by "Mary"
→ tweet mentioning "@mary"
GET /_search?q=mary

74. GET /_search?q=_all:mary
→ user named "Mary"
→ tweets by "Mary"
→ tweet mentioning "@mary"

75. _all field
string values from
all other fields

76. GET /_search?q=2016

77. GET /_search?q=2016
GET /_search?q=2016-01-01

78. GET /_search?q=2016
GET /_search?q=2016-01-03
GET /_search?q=date:2016-01-03
GET /_search?q=date:2016

79. datatype differences?

80. check "mapping"
(field definitions)

81. GET /myapp/tweet/_mapping

82. GET /myapp/tweet/_mapping
{
"tweet" : {
"properties" : {
"tweet" : { "type" : "string" },
"name" : { "type" : "string" },
"nick" : { "type" : "string" },
"date" : { "type" : "date" },
"rt" : { "type" : "long" },
: "double" },
: "double" }
"loc" : {
"type": "object",
"properties" : {
"lat" : { "type"
"lon" : { "type"
}
}
}}}

83. date = type:date
_all = type:string

84. normalize terms

85. "Analysis"

86. "Analysis"
tokenization + normalization

87. "Analysers"
tokenizer + token filters

88. standard analyzer
"The Quick Brown Fox jumped
over the Lazy Dog!"

89. standard analyzer
→ standard tokenizer
"The Quick Brown Fox jumped
over the Lazy Dog!"

90. standard analyzer
→ standard tokenizer
The,Quick,Brown,Fox,jumped,
over,the,Lazy,Dog

91. standard analyzer
→ standard tokenizer
→ lowercase filter
The,Quick,Brown,Fox,jumped,
over,the,Lazy,Dog

92. standard analyzer
→ standard tokenizer
→ lowercase filter
the,quick,brown,fox,jumped,
over,the,lazy,dog

93. standard analyzer
→ standard tokenizer
→ lowercase filter
→ stopwords filter
the,quick,brown,fox,jumped,
over,the,lazy,dog

94. standard analyzer
→ standard tokenizer
→ lowercase filter
→ stopwords filter
,quick,brown,fox,jumped,
over, ,lazy,dog

95. english analyzer
→ standard tokenizer
→ lowercase filter
the,quick,brown,fox,jumped,
over,the,lazy,dog

96. Analyzer

97. {
"type" : "string"
"type" : "string"
},
},
"string",
"not_analyzed"
{ "type"
{ "type"
{ "type"
: "date" },
: "long" },
: "geo_point" }
"tweet" : {
"properties" : {
"tweet" : {
"name" : {
"nick" : {
"type" :
"index" :
},
"date" :
"rt" :
"loc" :
}}}

98. {
"tweet" : {
"properties" : {
"tweet" : {
"type" : "string",
"analyzer" : "english"
},
},
"name" :
"nick" :
"type"
"index"
{ "type" : "string"
{
:
:
"string",
"not_analyzed"
},
"date" :
"rt" :
{
{
"type" :
"type" :
"date"
"long"
},
},
}}}
"loc" : { "type" : "geo_point" }

99. Thank You