Ce diaporama a bien été signalé.
Nous utilisons votre profil LinkedIn et vos données d’activité pour vous proposer des publicités personnalisées et pertinentes. Vous pouvez changer vos préférences de publicités à tout moment.
Elasticsearch sur Azure
 Make sense of your (BIG) data ! David Pilato / Thomas Conté! Développeurs - Evangélistes Elastic...
Donnez votre avis ! Depuis votre smartphone sur : http://notes.mstechdays.fr ! De nombreux lots à gagner toute les heures...
WINDOWS AZURE Rappels #mstechdays #elasticsearch StartUp
Windows Azure Plateforme Ouverte Back-ends Android, iOS & Node.js via Azure Mobile Services Devices Languages SDKs pour...
Windows Azure : rappels Identity Cloud Services Table Storage Blob Storage 3rd Party
 Services Big Data Integration...
ELASTICSEARCH Overview #mstechdays #elasticsearch StartUp
search = like % ? #mstechdays #elasticsearch StartUp
search = like % ? SELECT doc.*, pays.* FROM doc, pays WHERE doc.pays_code = pays.code AND doc.date_doc > t...
Moteur de recherche ? #mstechdays #elasticsearch StartUp
Moteur de recherche ? #mstechdays #elasticsearch StartUp
elasticsearch ? #mstechdays #elasticsearch StartUp
elasticsearch ? Lucene #mstechdays #elasticsearch StartUp
elasticsearch ? REST/JSON #mstechdays #elasticsearch Lucene StartUp
scalable elasticsearch ? REST/JSON #mstechdays #elasticsearch Lucene StartUp
plug & play scalable elasticsearch ? REST/JSON #mstechdays #elasticsearch Lucene StartUp
plug & play scalable elasticsearch Apache 2 license REST/JSON #mstechdays #elasticsearch Lucene StartUp
Start… $ wget https://download.elasticsearch.org/elasticsearch/ elasticsearch/elasticsearch-1.0.0.tar.gz! $ tar -xf elast...
… and play! $ curl -XPUT localhost:9200/sessions/session/1 -d '{! "title" : "Elasticsearch sur Azure",! "subtitle" : "Make...
Search! $ curl -XPOST http://localhost:9200/sessions/session/_search -d' { "query": { "multi_match": { "query": "elasticse...
Compute? #mstechdays #elasticsearch StartUp
Compute! $ curl -XPOST http://localhost:9200/sessions/session/_search -d' { "query": { ... }, "aggs": { "by_date": { "date...
Compute! $ curl -XPOST http://localhost:9200/sessions/session/_search -d' { "query": { ... }, "aggs": { "by_date": { "date...
Compute! $ curl -XPOST http://localhost:9200/sessions/session/_search -d' { "query": { ... }, "aggs": { "by_date": { "date...
démo MAKE SENSE OF YOUR (BIG) DATA! let’s inject some marketing documents… #mstechdays #elasticsearch StartUp
ELASTICSEARCH Elastique ? Distribué ? #mstechdays #elasticsearch StartUp
Distributed indices node 1 #mstechdays #elasticsearch StartUp
Distributed indices node 1 $ curl -XPUT localhost:9200/orders -d '{! "settings.index.number_of_shards" : 4,! "settings.ind...
Distributed indices node 1 orders $ curl -XPUT localhost:9200/orders -d '{! "settings.index.number_of_shards" : 4,! "sett...
Distributed indices node 1 orders 1 2 3 4 #mstechdays #elasticsearch $ curl -XPUT localhost:9200/orders -d '{! "setti...
Distributed indices node 1 orders 1 2 3 4 $ curl -XPUT localhost:9200/orders -d '{! "settings.index.number_of_shards" ...
Distributed indices node 1 orders 1 2 3 4 products 1 2 #mstechdays #elasticsearch $ curl -XPUT localhost:9200/order...
Start new nodes $ ./elasticsearch-1.0.0/bin/elasticsearch! [INFO ][node ][Armageddon] {1.0.0}[5645]: initializing
 [INFO ]...
Start new nodes $ ./elasticsearch-1.0.0/bin/elasticsearch! [INFO ][node ][Armageddon] {1.0.0}[5645]: initializing
 [INFO ]...
Start new nodes $ ./elasticsearch-1.0.0/bin/elasticsearch! [INFO ][node ][Armageddon] {1.0.0}[5645]: initializing
 [INFO ]...
Distributed indices node 1 orders 1 2 3 4 products 1 2 #mstechdays #elasticsearch StartUp
Distributed indices node 1 orders 1 2 3 4 products 1 2 #mstechdays #elasticsearch $ ./elasticsearch-1.0.0/bin/elast...
Distributed indices node 1 node 2 orders 1 2 3 4 products 1 2 #mstechdays #elasticsearch $ ./elasticsearch-1.0.0/...
Distributed indices node 1 node 2 orders orders 1 2 3 4 products 1 products 2 #mstechdays #elasticsearch StartU...
Distributed indices node 1 node 2 orders orders 1 2 1 2 3 4 3 4 products 1 products 2 #mstechdays #elasticse...
Distributed indices node 1 node 2 orders orders 1 2 1 2 3 4 3 4 products 1 #mstechdays #elasticsearch produc...
Distributed indices node 1 node 2 orders orders 1 2 1 2 3 4 3 4 products 1 #mstechdays #elasticsearch produc...
Distributed indices node 1 node 2 orders node 3 orders 1 2 1 2 3 4 3 4 products 1 #mstechdays #elasticsearch...
Distributed indices node 1 node 2 orders node 3 orders orders 1 2 1 2 3 4 3 4 products 1 #mstechdays #elast...
Distributed indices node 1 node 2 orders 1 node 3 orders 2 4 products 1 #mstechdays #elasticsearch orders 2 1 3 ...
ELASTICSEARCH SUR AZURE Discovery ? #mstechdays #elasticsearch StartUp
Deploying on Azure (unicast) Cloud service: your-es.cloudapp.net VM node 1 private IP1 VM node 2 private IP2 d...
Deploying on Azure (unicast) Cloud service: your-es.cloudapp.net VM node 1 private IP1 VM node 2 private IP2 V...
Deploying on Azure (cloud plugin) Cloud service: your-es.cloudapp.net VM node 1 private IP1 VM node 2 private I...
Deploying on Azure (cloud plugin) Cloud service: your-es.cloudapp.net VM node 1 private IP1 Azure REST API VM ...
https://github.com/elasticsearch/elasticsearch-cloud-azure #mstechdays #elasticsearch StartUp
démo ELASTICSEARCH ON AZURE Scale out! #mstechdays #elasticsearch StartUp
Digital is business QUESTIONS ? @dadoonet / @tomconte © 2014 Microsoft Corporation. All rights reserved. Microsoft, Windo...
Digital is business QUESTIONS ? @dadoonet / @tomconte © 2014 Microsoft Corporation. All rights reserved. Microsoft, Windo...
Elasticsearch sur Azure : Make sense of your (BIG) data !
Prochain SlideShare
Chargement dans…5
×

Elasticsearch sur Azure : Make sense of your (BIG) data !

3 247 vues

Publié le

Sous licence Apache2, elasticsearch est un moteur de recherche puissant, distribué et scalable. Il fournit également des agrégations en temps réel en fonction de vos besoins. Couplé à Kibana, dashboard générique et hautement personnalisable, il vous permet de donner immédiatement du sens à vos données. En forte progression au niveau de son adhésion par les entreprises et les sites publics, découvrez ce que sont elasticsearch et Kibana et à quel point il est simple de les déployer facilement sur la plate-forme Windows Azure. Thomas et David illustreront à l'aide de cas clients les bénéfices obtenus à travers ces solutions.

Speakers : Thomas Conté (Microsoft), David Pilato (Elasticsearch)

Publié dans : Technologie
no profile picture user

  • Soyez le premier à commenter

  • Soyez le premier à aimer ceci

Elasticsearch sur Azure : Make sense of your (BIG) data !

  1. 1. Elasticsearch sur Azure
 Make sense of your (BIG) data ! David Pilato / Thomas Conté! Développeurs - Evangélistes Elasticsearch / Microsoft @dadoonet / @tomconte StartUp
  2. 2. Donnez votre avis ! Depuis votre smartphone sur : http://notes.mstechdays.fr ! De nombreux lots à gagner toute les heures !!! Claviers, souris et jeux Microsoft… ! Merci de nous aider à améliorer les Techdays ! #mstechdays #elasticsearch StartUp
  3. 3. WINDOWS AZURE Rappels #mstechdays #elasticsearch StartUp
  4. 4. Windows Azure Plateforme Ouverte Back-ends Android, iOS & Node.js via Azure Mobile Services Devices Languages SDKs pour Java, Python, PHP, Ruby, Node.js WebSites pour PHP, Node.js, Python & App Gallery Apps MySQL via ClearDB, MongoDB via MongoLab, Hadoop via HDInsight Operating Systems Linux VMs via Image Gallery & VMDepot #mstechdays #elasticsearch Data StartUp
  5. 5. Windows Azure : rappels Identity Cloud Services Table Storage Blob Storage 3rd Party
 Services Big Data Integration “Plateforme Ouverte” Virtual Machines Web Sites Caching Service Bus #mstechdays #elasticsearch SQL 
 Azure Analytics Mobile Services Media Services StartUp CDN
  6. 6. ELASTICSEARCH Overview #mstechdays #elasticsearch StartUp
  7. 7. search = like % ? #mstechdays #elasticsearch StartUp
  8. 8. search = like % ? SELECT doc.*, pays.* FROM doc, pays WHERE doc.pays_code = pays.code AND doc.date_doc > to_date('2011-12', 'yyyy-mm') AND doc.date_doc < to_date('2012-01', 'yyyy-mm') AND lower(pays.libelle) = 'france' AND lower(doc.commentaire) LIKE ‘%produit%' AND lower(doc.commentaire) LIKE ‘%david%'; #mstechdays #elasticsearch StartUp
  9. 9. Moteur de recherche ? #mstechdays #elasticsearch StartUp
  10. 10. Moteur de recherche ? #mstechdays #elasticsearch StartUp
  11. 11. elasticsearch ? #mstechdays #elasticsearch StartUp
  12. 12. elasticsearch ? Lucene #mstechdays #elasticsearch StartUp
  13. 13. elasticsearch ? REST/JSON #mstechdays #elasticsearch Lucene StartUp
  14. 14. scalable elasticsearch ? REST/JSON #mstechdays #elasticsearch Lucene StartUp
  15. 15. plug & play scalable elasticsearch ? REST/JSON #mstechdays #elasticsearch Lucene StartUp
  16. 16. plug & play scalable elasticsearch Apache 2 license REST/JSON #mstechdays #elasticsearch Lucene StartUp
  17. 17. Start… $ wget https://download.elasticsearch.org/elasticsearch/ elasticsearch/elasticsearch-1.0.0.tar.gz! $ tar -xf elasticsearch-1.0.0.tar.gz! $ ./elasticsearch-1.0.0/bin/elasticsearch! [INFO ][node ][Ghost Maker] {1.0.0}[5645]: initializing #mstechdays #elasticsearch StartUp
  18. 18. … and play! $ curl -XPUT localhost:9200/sessions/session/1 -d '{! "title" : "Elasticsearch sur Azure",! "subtitle" : "Make sense of your (BIG) data !",! "date" : "2014-02-13T16:30:00",! "tags" : [ "elasticsearch", "azure", "cloud" ],! "speaker" : [ {! "first_name" : "Thomas", ! "last_name" : "Conté" ! }, {! "first_name" : "David", ! "last_name" : "Pilato" ! }]! }' #mstechdays #elasticsearch StartUp
  19. 19. Search! $ curl -XPOST http://localhost:9200/sessions/session/_search -d' { "query": { "multi_match": { "query": "elasticsearch azure thomas", "fields": [ "title^2", "speaker.first_name" ] } }, "post_filter": { "range": { "date": { "from": "2014-02-13", "to": "2014-02-14" } } } }' #mstechdays #elasticsearch StartUp
  20. 20. Compute? #mstechdays #elasticsearch StartUp
  21. 21. Compute! $ curl -XPOST http://localhost:9200/sessions/session/_search -d' { "query": { ... }, "aggs": { "by_date": { "date_histogram": { "field": "date", "interval": "day", "format" : "dd/MM/yyyy" } } } }' #mstechdays #elasticsearch StartUp
  22. 22. Compute! $ curl -XPOST http://localhost:9200/sessions/session/_search -d' { "query": { ... }, "aggs": { "by_date": { "date_histogram": { "field": "date", "interval": "day", "format" : "dd/MM/yyyy" } } "by_date": [ } { "key_as_string": "11/02/2014", "doc_count": 1 }, }' { "key_as_string": "12/02/2014", "doc_count": 2 }, { "key_as_string": "13/02/2014", "doc_count": 3 } ] #mstechdays #elasticsearch StartUp
  23. 23. Compute! $ curl -XPOST http://localhost:9200/sessions/session/_search -d' { "query": { ... }, "aggs": { "by_date": { "date_histogram": { "field": "date", "interval": "day", "format" : "dd/MM/yyyy" } } "by_date": [ } { "key_as_string": "11/02/2014", "doc_count": 1 }, }' { "key_as_string": "12/02/2014", "doc_count": 2 }, { "key_as_string": "13/02/2014", "doc_count": 3 } ] #mstechdays #elasticsearch StartUp
  24. 24. démo MAKE SENSE OF YOUR (BIG) DATA! let’s inject some marketing documents… #mstechdays #elasticsearch StartUp
  25. 25. ELASTICSEARCH Elastique ? Distribué ? #mstechdays #elasticsearch StartUp
  26. 26. Distributed indices node 1 #mstechdays #elasticsearch StartUp
  27. 27. Distributed indices node 1 $ curl -XPUT localhost:9200/orders -d '{! "settings.index.number_of_shards" : 4,! "settings.index.number_of_replicas" : 1! }' #mstechdays #elasticsearch StartUp
  28. 28. Distributed indices node 1 orders $ curl -XPUT localhost:9200/orders -d '{! "settings.index.number_of_shards" : 4,! "settings.index.number_of_replicas" : 1! }' #mstechdays #elasticsearch StartUp
  29. 29. Distributed indices node 1 orders 1 2 3 4 #mstechdays #elasticsearch $ curl -XPUT localhost:9200/orders -d '{! "settings.index.number_of_shards" : 4,! "settings.index.number_of_replicas" : 1! }' StartUp
  30. 30. Distributed indices node 1 orders 1 2 3 4 $ curl -XPUT localhost:9200/orders -d '{! "settings.index.number_of_shards" : 4,! "settings.index.number_of_replicas" : 1! }' $ curl -XPUT localhost:9200/products -d '{! "settings.index.number_of_shards" : 2,! "settings.index.number_of_replicas" : 0! }' #mstechdays #elasticsearch StartUp
  31. 31. Distributed indices node 1 orders 1 2 3 4 products 1 2 #mstechdays #elasticsearch $ curl -XPUT localhost:9200/orders -d '{! "settings.index.number_of_shards" : 4,! "settings.index.number_of_replicas" : 1! }' $ curl -XPUT localhost:9200/products -d '{! "settings.index.number_of_shards" : 2,! "settings.index.number_of_replicas" : 0! }' StartUp
  32. 32. Start new nodes $ ./elasticsearch-1.0.0/bin/elasticsearch! [INFO ][node ][Armageddon] {1.0.0}[5645]: initializing
 [INFO ][cluster.service][Armageddon] detected_master [Ghost Maker] #mstechdays #elasticsearch StartUp
  33. 33. Start new nodes $ ./elasticsearch-1.0.0/bin/elasticsearch! [INFO ][node ][Armageddon] {1.0.0}[5645]: initializing
 [INFO ][cluster.service][Armageddon] detected_master [Ghost Maker] $ ./elasticsearch-1.0.0/bin/elasticsearch! [INFO ][node ][Cyclops] {1.0.0}[5645]: initializing
 [INFO ][cluster.service][Cyclops] detected_master [Ghost Maker] #mstechdays #elasticsearch StartUp
  34. 34. Start new nodes $ ./elasticsearch-1.0.0/bin/elasticsearch! [INFO ][node ][Armageddon] {1.0.0}[5645]: initializing
 [INFO ][cluster.service][Armageddon] detected_master [Ghost Maker] $ ./elasticsearch-1.0.0/bin/elasticsearch! [INFO ][node ][Cyclops] {1.0.0}[5645]: initializing
 [INFO ][cluster.service][Cyclops] detected_master [Ghost Maker] $ ./elasticsearch-1.0.0/bin/elasticsearch! [INFO ][node ][Karnak] {1.0.0}[5645]: initializing
 [INFO ][cluster.service][Karnak] detected_master [Ghost Maker] #mstechdays #elasticsearch StartUp
  35. 35. Distributed indices node 1 orders 1 2 3 4 products 1 2 #mstechdays #elasticsearch StartUp
  36. 36. Distributed indices node 1 orders 1 2 3 4 products 1 2 #mstechdays #elasticsearch $ ./elasticsearch-1.0.0/bin/elasticsearch! [INFO ][node ][Armageddon] {1.0.0}[5645]: initializing
 [INFO ][cluster.service][Armageddon] detected_master [Ghost Maker] StartUp
  37. 37. Distributed indices node 1 node 2 orders 1 2 3 4 products 1 2 #mstechdays #elasticsearch $ ./elasticsearch-1.0.0/bin/elasticsearch! [INFO ][node ][Armageddon] {1.0.0}[5645]: initializing
 [INFO ][cluster.service][Armageddon] detected_master [Ghost Maker] StartUp
  38. 38. Distributed indices node 1 node 2 orders orders 1 2 3 4 products 1 products 2 #mstechdays #elasticsearch StartUp
  39. 39. Distributed indices node 1 node 2 orders orders 1 2 1 2 3 4 3 4 products 1 products 2 #mstechdays #elasticsearch StartUp
  40. 40. Distributed indices node 1 node 2 orders orders 1 2 1 2 3 4 3 4 products 1 #mstechdays #elasticsearch products 2 StartUp
  41. 41. Distributed indices node 1 node 2 orders orders 1 2 1 2 3 4 3 4 products 1 #mstechdays #elasticsearch products $ ./elasticsearch-1.0.0/bin/elasticsearch! 2 [INFO ][node ][Karnak] {1.0.0}[5645]: initializing
 [INFO ][cluster.service][Karnak] detected_master [Ghost Maker] StartUp
  42. 42. Distributed indices node 1 node 2 orders node 3 orders 1 2 1 2 3 4 3 4 products 1 #mstechdays #elasticsearch products $ ./elasticsearch-1.0.0/bin/elasticsearch! 2 [INFO ][node ][Karnak] {1.0.0}[5645]: initializing
 [INFO ][cluster.service][Karnak] detected_master [Ghost Maker] StartUp
  43. 43. Distributed indices node 1 node 2 orders node 3 orders orders 1 2 1 2 3 4 3 4 products 1 #mstechdays #elasticsearch products products 2 StartUp
  44. 44. Distributed indices node 1 node 2 orders 1 node 3 orders 2 4 products 1 #mstechdays #elasticsearch orders 2 1 3 3 products products 2 StartUp 4
  45. 45. ELASTICSEARCH SUR AZURE Discovery ? #mstechdays #elasticsearch StartUp
  46. 46. Deploying on Azure (unicast) Cloud service: your-es.cloudapp.net VM node 1 private IP1 VM node 2 private IP2 discovery.zen.ping.multicast.enabled: false! discovery.zen.ping.unicast.hosts: ["ip1", "ip2"] #mstechdays #elasticsearch StartUp
  47. 47. Deploying on Azure (unicast) Cloud service: your-es.cloudapp.net VM node 1 private IP1 VM node 2 private IP2 VM node 3 private IP3 discovery.zen.ping.multicast.enabled: false! discovery.zen.ping.unicast.hosts: ["ip1", "ip2", "ip3"] #mstechdays #elasticsearch StartUp
  48. 48. Deploying on Azure (cloud plugin) Cloud service: your-es.cloudapp.net VM node 1 private IP1 VM node 2 private IP2 Azure REST API #mstechdays #elasticsearch StartUp VM node 3 private IP3
  49. 49. Deploying on Azure (cloud plugin) Cloud service: your-es.cloudapp.net VM node 1 private IP1 Azure REST API VM node 2 private IP2 cloud:! azure:! keystore: /path/to/keystore! password: your_password_for_keystore! subscription_id: your_azure_subscription_id! service_name: your-es! discovery:! type: azure #mstechdays #elasticsearch StartUp VM node 3 private IP3
  50. 50. https://github.com/elasticsearch/elasticsearch-cloud-azure #mstechdays #elasticsearch StartUp
  51. 51. démo ELASTICSEARCH ON AZURE Scale out! #mstechdays #elasticsearch StartUp
  52. 52. Digital is business QUESTIONS ? @dadoonet / @tomconte © 2014 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
  53. 53. Digital is business QUESTIONS ? @dadoonet / @tomconte © 2014 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

×