Ce diaporama a bien été signalé.
Nous utilisons votre profil LinkedIn et vos données d’activité pour vous proposer des publicités personnalisées et pertinentes. Vous pouvez changer vos préférences de publicités à tout moment.
Interactively search and 
visualize your data 
Romain Rigaux
Goals 
Hue: make Solr / Hadoop easier to use 
+ 
Build a Web app 
Quickly explore data 
… with Solr
Architecture 
“Just a view” on top of the standard Solr API 
REST
History: v1 User
History: v1 Admin
Architecture: Next! 
Lot of learning, UX Boost needed 
Simple, don’t know it is Solr
History: v2 User
History: v2 Admin
Architecture 
REST AJAX 
/select 
/admin/collections 
/get 
/luke... 
/add_widget 
/zoom_in 
/select_facet 
/select_range....
Architecture: UI for Facets 
Layout 
Collection 
Query 
All the 2D positioning (cell ids), visual, drag&drop 
Dashboard, f...
Adding a widget life cycle 
Load the initial page 
Edit mode and Drag&Drop 
/solr/zookeeper/clusterstate.json 
/solr/admin...
Adding a widget life cycle 
Select the field 
Guess ranges (number or dates) 
Rounding (number or dates) 
/solr/select?sta...
Adding a widget life cycle 
Query part 1 
facet.range={!ex=bytes}bytes&f.bytes.facet.range.start=0&f.bytes.facet.range.end...
JSON to Widget 
{ ! 
"field":"rate_code",! 
"counts":[ ! 
{ ! 
"count":97797,! 
"exclude":true,! 
"selected":false,! 
"val...
Repeat…
Enterprise features 
- Access to Search App configurable, LDAP/SAML auths 
- Share by link 
- Solr Cloud (or non Cloud) 
-...
Demo 
Index and Visualize Taxi data 
http://chriswhong.com/open-data/foil_nyc_taxi/ 
https://archive.org/details/nycTaxiTr...
Missed it? 
http://demo.gethue.com/search
What’s next? 
- Map Pivot Facets 
- Autocomplete 
- Analytics range facets 
- Easier Indexing 
- … ?
Thank you! 
http://gethue.com/blog/search 
https://github.com/cloudera/hue
Interactively Search and Visualize Your Data: Presented by Romain Rigaux, Cloudera
Prochain SlideShare
Chargement dans…5
×
Prochain SlideShare
Building a real time big data analytics platform with solr
Suivant
Télécharger pour lire hors ligne et voir en mode plein écran

0

Partager

Télécharger pour lire hors ligne

Interactively Search and Visualize Your Data: Presented by Romain Rigaux, Cloudera

Télécharger pour lire hors ligne

Presented at Lucene/Solr Revolution 2014

Livres associés

Gratuit avec un essai de 30 jours de Scribd

Tout voir
  • Soyez le premier à aimer ceci

Interactively Search and Visualize Your Data: Presented by Romain Rigaux, Cloudera

  1. 1. Interactively search and visualize your data Romain Rigaux
  2. 2. Goals Hue: make Solr / Hadoop easier to use + Build a Web app Quickly explore data … with Solr
  3. 3. Architecture “Just a view” on top of the standard Solr API REST
  4. 4. History: v1 User
  5. 5. History: v1 Admin
  6. 6. Architecture: Next! Lot of learning, UX Boost needed Simple, don’t know it is Solr
  7. 7. History: v2 User
  8. 8. History: v2 Admin
  9. 9. Architecture REST AJAX /select /admin/collections /get /luke... /add_widget /zoom_in /select_facet /select_range... www…. Templates + JS Model
  10. 10. Architecture: UI for Facets Layout Collection Query All the 2D positioning (cell ids), visual, drag&drop Dashboard, fields, template, widgets (ids) Search terms, selected facets (q, fqs)
  11. 11. Adding a widget life cycle Load the initial page Edit mode and Drag&Drop /solr/zookeeper/clusterstate.json /solr/admin/luke… /get_collection
  12. 12. Adding a widget life cycle Select the field Guess ranges (number or dates) Rounding (number or dates) /solr/select?stats=true /new_facet
  13. 13. Adding a widget life cycle Query part 1 facet.range={!ex=bytes}bytes&f.bytes.facet.range.start=0&f.bytes.facet.range.end=9000000& f.bytes.facet.range.gap=900000&f.bytes.facet.mincount=0&f.bytes.facet.limit=10 Query Part 2 q=Chrome&fq={!tag=bytes}bytes:[900000+TO+1800000] Augment Solr response { ! 'facet_counts':{ ! 'facet_ranges':{ ! 'bytes':{ ! 'start':10000,! 'counts':[ ! '900000',! 3423,! '1800000',! 339,! ! ! ...! ]! }! }! }! {! ...,! 'normalized_facets':[ ! { ! 'extraSeries':[ ! ! ],! 'label':'bytes',! 'field':'bytes',! 'counts':[ ! { ! 'from’:'900000',! 'to':'1800000',! 'selected':True,! 'value':3423,! 'field’:'bytes',! 'exclude':False! }! ], ...! }! }! }!
  14. 14. JSON to Widget { ! "field":"rate_code",! "counts":[ ! { ! "count":97797,! "exclude":true,! "selected":false,! "value":"1",! "cat":"rate_code"! } ...! { ! "field":"medallion",! "counts":[ ! { ! "count":159,! "exclude":true,! "selected":false,! "value":"6CA28FC49A4C49A9A96",! "cat":"medallion"! } ….! { ! "extraSeries":[ ! ! ],! "label":"trip_time_in_secs",! "field":"trip_time_in_secs",! "counts":[ ! { ! "from":"0",! "to":"10",! "selected":false,! "value":527,! "field":"trip_time_in_secs",! "exclude":true! } ...! { ! "field":"passenger_count",! "counts":[ ! { ! "count":74766,! "exclude":true,! "selected":false,! "value":"1",! "cat":"passenger_count"! } ...!
  15. 15. Repeat…
  16. 16. Enterprise features - Access to Search App configurable, LDAP/SAML auths - Share by link - Solr Cloud (or non Cloud) - Proxy user /solr/jobs_demo/select?user.name=hue&doAs=romain&q= - Security Kerberos - Sentry Collection level, Solr calls like /admin, /query, Solr UI, ZooKeeper
  17. 17. Demo Index and Visualize Taxi data http://chriswhong.com/open-data/foil_nyc_taxi/ https://archive.org/details/nycTaxiTripData2013 [torrent better]
  18. 18. Missed it? http://demo.gethue.com/search
  19. 19. What’s next? - Map Pivot Facets - Autocomplete - Analytics range facets - Easier Indexing - … ?
  20. 20. Thank you! http://gethue.com/blog/search https://github.com/cloudera/hue

Presented at Lucene/Solr Revolution 2014

Vues

Nombre de vues

1 806

Sur Slideshare

0

À partir des intégrations

0

Nombre d'intégrations

851

Actions

Téléchargements

21

Partages

0

Commentaires

0

Mentions J'aime

0

×