SlideShare une entreprise Scribd logo
1  sur  24
Télécharger pour lire hors ligne
HUE+SDK




HOW TO GET STARTED






Romain Rigaux

Cloudera - Feb 20, 2014
What is Hue?

HUE 1

Desktop-­‐like	
  in	
  a	
  browser,	
  did	
  its	
  
job	
  but	
  pretty	
  slow,	
  memory	
  leaks	
  
and	
  not	
  very	
  IE	
  friendly	
  but	
  
definitely	
  advanced	
  for	
  its	
  time	
  
(2009-­‐2010).
HISTORY

HUE 2

The	
  first	
  flat	
  structure	
  port,	
  with	
  
Twitter	
  Bootstrap	
  all	
  over	
  the	
  
place.
HISTORY

HUE 2.5

New	
  apps,	
  improved	
  the	
  UX	
  
adding	
  new	
  nice	
  functionalities	
  
like	
  autocomplete	
  and	
  drag	
  &	
  
drop.
HISTORY

HUE 3 ALPHA

Proposed	
  design,	
  didn’t	
  make	
  it.
HISTORY

HUE 3

Transition	
  to	
  the	
  new	
  UI,	
  major	
  
improvements	
  and	
  new	
  apps.
HISTORY
HUE 3.5+
RE

TO

ET
AS

M

BR

ER

R

...

O
SQ
W
SE
O
ZO
O
R
P
O
KE
EP
ER
U
SE
R
AD
M
DB IN
Q
U
ER
Y
SP
AR
K
H
O
M
E

SE

BA

H

C

AR

SE

H

E

PA
LA
BR
O
W
SE
R

IM

E

IV

H

N

SE

R

W

O

BR
G

SI

DE

O
ZI

O

JO
B

G

PI

SE

O
W

BR

JO
B

LE

FI

APPS
APPS

Hue Plugins
YARN

JobTracker

Pig
Oozie

Cloudera	

Impala

HiveServer2
HDFS

Hive	

Metastore

HBase
Solr

Zookeeper
Sqoop2

LDAP	

SAML
FAST PACE
LAST MONTH

91	
  issues	
  created	
  and	
  90	
  resolved.	
  
Core	
  team	
  +	
  Community
STACK
BACKEND


Python	
  +	
  Django	
  (with	
  tiny	
  bits	
  in	
  
Java)

FRONTEND


jQuery

Bootstrap

Knockout.js

Love
WHY SDK?
EXTEND HUE AND GET

-­‐	
  Other	
  type	
  of	
  visualizations	
  
-­‐	
  Export	
  in	
  another	
  format	
  
-­‐	
  Simpler	
  API	
  than	
  Hadoop	
  
-­‐	
  Custom	
  dashboards	
  
-­‐	
  YOUR_COMPANY	
  app
SDK

HUE
http://gethue.com/docs-­‐3.5.0/
sdk/sdk.html

Django
https://docs.djangoproject.com/
en/1.6/intro/reusable-­‐apps/
Hue Architecture
2 PARTS

https://github.com/cloudera/hue

/desktop	
  
	
  	
  /core	
  
	
  	
  	
  	
  /app	
  framework	
  
	
  	
  	
  	
  /documents	
  
	
  	
  	
  	
  /REST/Thrift	
  libs	
  
	
  	
  	
  	
  /...	
  
	
  	
  /libs	
  
	
  	
  	
  	
  /hadoop	
  
	
  	
  	
  	
  /liboauth	
  
	
  	
  	
  	
  /liboozie	
  
	
  	
  	
  	
  /...	
  

/apps	
  
	
  	
  /impala	
  
	
  	
  /filebrowser	
  
	
  	
  /jobbrowser	
  
	
  	
  /oozie	
  
	
  	
  /hbase	
  
	
  	
  /...	
  
	
  	
  /your_app	
  
	
  	
  /...	
  
Proxy App
PROXY APP

Put	
  anything	
  inside	
  Hue!	
  
!

Integrate	
  external	
  apps
New community Apps
PLUGGABLE APPS

-­‐	
  Hue	
  Hannibal	
  
-­‐	
  Hue	
  Chrome	
  notifier	
  
YARN Apps
HUE FRONTEND?

-­‐	
  Build	
  a	
  new	
  Yarn	
  
-­‐	
  Embedded	
  REST	
  API	
  
-­‐	
  Get	
  it	
  in	
  Job	
  Browser	
  or	
  custom	
  app	
  
	
  	
  (inherit	
  login/security/other	
  API)
HADOOP INTERFACES
REST & THRIFT

Many	
  Hadoop	
  interfaces	
  used	
  

WebHDFS	
  
YARN	
  API	
  (RM,	
  NM,	
  MR...)	
  
HiveServer2	
  
Impala	
  
HBase	
  
Oozie	
  
Sqoop2	
  
ZooKeeper	
  
...	
  









DEMO 

TIME

Missed something?
GET STARTED

Basic	
  usage	
  of	
  the	
  Hue/Django	
  shell	
  
Basic	
  access	
  to	
  the	
  Hue/Django	
  DB	
  
!

Execute	
  Hive	
  or	
  Impala	
  queries	
  
A	
  new	
  set	
  of	
  icons	
  for	
  file	
  types	
  
!

Pluggable	
  authentication	
  backends	
  (OAuth	
  1.0/1.1,	
  
LDAP,	
  SAML,	
  OpenId...)
What's next?
HUE 3+

Document	
  Model	
  
Unification	
  of	
  internal	
  API	
  (blueprint)	
  
External	
  API?	
  
Pluggable	
  widgets?	
  (aka	
  within	
  app	
  SDK)	
  
GET HUE

CLOUDERA’S CDH

TARBALL

CLOUDERA’S DEMO VM

Stable	
  and	
  highly	
  tested	
  
releases	
  perfectly	
  integrated	
  
with	
  the	
  Hadoop	
  ecosystem,	
  
automagically	
  configured	
  by	
  
Cloudera	
  Manager.

Try	
  in	
  advance	
  the	
  latest	
  and	
  
greatest	
  but	
  you’ll	
  have	
  to	
  
configure	
  everything	
  on	
  your	
  
own.

Get	
  to	
  play	
  with	
  Hue	
  and	
  
various	
  Hadoop	
  components	
  
in	
  5	
  minutes.	
  It’s	
  a	
  self	
  
contained	
  CDH	
  environment	
  
ready	
  to	
  use.

HORTONWORKS*

MAPR*

HP CLOUD*

In	
  HDP	
  there’s	
  an	
  old	
  forked	
  
version	
  of	
  Hue	
  2.3.

Newer	
  version	
  than	
  HDP,	
  close	
  
to	
  the	
  original	
  2.5	
  minus	
  apps	
  
like	
  HBase,	
  Impala,	
  Sqoop,	
  
Search.

The	
  newest	
  addition,	
  ships	
  
Hue	
  3.0	
  through	
  the	
  
GreenButton	
  products.	
  

BIGTOP

EMBEDDED/DEMO IN IND. COMPANIES

* YOUR MILEAGE MAY VARY.
LINKS

WEBSITE

http://gethue.com
BLOG

http://blog.gethue.com
TWITTER

@gethue
USER GROUP

hue-­‐user@
THANKS.

QUESTIONS?

gethue.com

Contenu connexe

Similaire à SF Dev Meetup - Hue SDK

Hadoop trainer's profile
Hadoop trainer's profileHadoop trainer's profile
Hadoop trainer's profile
hadooptraining
 
Federico Feroldi: PHP in Yahoo!
Federico Feroldi: PHP in Yahoo!Federico Feroldi: PHP in Yahoo!
Federico Feroldi: PHP in Yahoo!
Francesco Fullone
 

Similaire à SF Dev Meetup - Hue SDK (20)

Hue: The Hadoop UI - Hadoop Singapore
Hue: The Hadoop UI - Hadoop SingaporeHue: The Hadoop UI - Hadoop Singapore
Hue: The Hadoop UI - Hadoop Singapore
 
Hue: The Hadoop UI - HUG France
Hue: The Hadoop UI - HUG FranceHue: The Hadoop UI - HUG France
Hue: The Hadoop UI - HUG France
 
April 2014 HUG : Integrating HUE with Multi-tenant cluster
April 2014 HUG : Integrating HUE with Multi-tenant clusterApril 2014 HUG : Integrating HUE with Multi-tenant cluster
April 2014 HUG : Integrating HUE with Multi-tenant cluster
 
Y! HUG Hue: the Hadoop UI
Y! HUG   Hue: the Hadoop UIY! HUG   Hue: the Hadoop UI
Y! HUG Hue: the Hadoop UI
 
August 2013 HUG: Hue: the UI for Apache Hadoop
August 2013 HUG: Hue: the UI for Apache HadoopAugust 2013 HUG: Hue: the UI for Apache Hadoop
August 2013 HUG: Hue: the UI for Apache Hadoop
 
Beeswax Hive editor in Hue
Beeswax Hive editor in HueBeeswax Hive editor in Hue
Beeswax Hive editor in Hue
 
[drupalday2017] - Decoupled frontend con Drupal 8 e OpenUI 5
[drupalday2017] - Decoupled frontend con Drupal 8 e OpenUI 5[drupalday2017] - Decoupled frontend con Drupal 8 e OpenUI 5
[drupalday2017] - Decoupled frontend con Drupal 8 e OpenUI 5
 
Big Data Training in Ludhiana
Big Data Training in LudhianaBig Data Training in Ludhiana
Big Data Training in Ludhiana
 
Big Data Training in Mohali
Big Data Training in MohaliBig Data Training in Mohali
Big Data Training in Mohali
 
Big Data Training in Amritsar
Big Data Training in AmritsarBig Data Training in Amritsar
Big Data Training in Amritsar
 
Developing eXtensions for HUE
Developing eXtensions for HUEDeveloping eXtensions for HUE
Developing eXtensions for HUE
 
Hadoop online training
Hadoop online training Hadoop online training
Hadoop online training
 
Hadoop trainer's profile
Hadoop trainer's profileHadoop trainer's profile
Hadoop trainer's profile
 
Uyuni: the solution to manage your Linux infrastructure (OpenFest 2020)
Uyuni: the solution to manage your Linux infrastructure (OpenFest 2020)Uyuni: the solution to manage your Linux infrastructure (OpenFest 2020)
Uyuni: the solution to manage your Linux infrastructure (OpenFest 2020)
 
Federico Feroldi: PHP in Yahoo!
Federico Feroldi: PHP in Yahoo!Federico Feroldi: PHP in Yahoo!
Federico Feroldi: PHP in Yahoo!
 
Federico Feroldi Php In Yahoo
Federico Feroldi Php In YahooFederico Feroldi Php In Yahoo
Federico Feroldi Php In Yahoo
 
Poitou-Charentes JUG 2016 Eclipse Che: The Next-Gen Eclipse IDE
Poitou-Charentes JUG 2016 Eclipse Che: The Next-Gen Eclipse IDEPoitou-Charentes JUG 2016 Eclipse Che: The Next-Gen Eclipse IDE
Poitou-Charentes JUG 2016 Eclipse Che: The Next-Gen Eclipse IDE
 
Hue: Big Data Web applications for Interactive Hadoop at Big Data Spain 2014
Hue: Big Data Web applications for Interactive Hadoop at Big Data Spain 2014Hue: Big Data Web applications for Interactive Hadoop at Big Data Spain 2014
Hue: Big Data Web applications for Interactive Hadoop at Big Data Spain 2014
 
Eclipse SCADA Release 0.1.0
Eclipse SCADA Release 0.1.0Eclipse SCADA Release 0.1.0
Eclipse SCADA Release 0.1.0
 
Hadoop in adtech
Hadoop in adtechHadoop in adtech
Hadoop in adtech
 

Plus de gethue

Spark Summit Europe: Building a REST Job Server for interactive Spark as a se...
Spark Summit Europe: Building a REST Job Server for interactive Spark as a se...Spark Summit Europe: Building a REST Job Server for interactive Spark as a se...
Spark Summit Europe: Building a REST Job Server for interactive Spark as a se...
gethue
 

Plus de gethue (11)

Spark Summit Europe: Building a REST Job Server for interactive Spark as a se...
Spark Summit Europe: Building a REST Job Server for interactive Spark as a se...Spark Summit Europe: Building a REST Job Server for interactive Spark as a se...
Spark Summit Europe: Building a REST Job Server for interactive Spark as a se...
 
SF Solr Meetup - Interactively Search and Visualize Your Big Data
SF Solr Meetup - Interactively Search and Visualize Your Big DataSF Solr Meetup - Interactively Search and Visualize Your Big Data
SF Solr Meetup - Interactively Search and Visualize Your Big Data
 
Big Data Scala by the Bay: Interactive Spark in your Browser
Big Data Scala by the Bay: Interactive Spark in your BrowserBig Data Scala by the Bay: Interactive Spark in your Browser
Big Data Scala by the Bay: Interactive Spark in your Browser
 
20150627 bigdatala
20150627 bigdatala20150627 bigdatala
20150627 bigdatala
 
Hadoop Summit - Interactive Big Data Analysis with Solr, Spark and Hue
Hadoop Summit - Interactive Big Data Analysis with Solr, Spark and HueHadoop Summit - Interactive Big Data Analysis with Solr, Spark and Hue
Hadoop Summit - Interactive Big Data Analysis with Solr, Spark and Hue
 
Harness the power of Spark and Solr in Hue: Big Data Amsterdam v.2.0
Harness the power of Spark and Solr in Hue: Big Data Amsterdam v.2.0Harness the power of Spark and Solr in Hue: Big Data Amsterdam v.2.0
Harness the power of Spark and Solr in Hue: Big Data Amsterdam v.2.0
 
Interactively Search and Visualize Your Big Data
Interactively Search and Visualize Your Big DataInteractively Search and Visualize Your Big Data
Interactively Search and Visualize Your Big Data
 
Sqoop2 refactoring for generic data transfer - NYC Sqoop Meetup
Sqoop2 refactoring for generic data transfer - NYC Sqoop MeetupSqoop2 refactoring for generic data transfer - NYC Sqoop Meetup
Sqoop2 refactoring for generic data transfer - NYC Sqoop Meetup
 
LDAP, SAML and Hue
LDAP, SAML and HueLDAP, SAML and Hue
LDAP, SAML and Hue
 
Hadoop Israel - HBase Browser in Hue
Hadoop Israel - HBase Browser in HueHadoop Israel - HBase Browser in Hue
Hadoop Israel - HBase Browser in Hue
 
HBase + Hue - LA HBase User Group
HBase + Hue - LA HBase User GroupHBase + Hue - LA HBase User Group
HBase + Hue - LA HBase User Group
 

Dernier

Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 

Dernier (20)

Developing An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of BrazilDeveloping An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of Brazil
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfTech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdf
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 

SF Dev Meetup - Hue SDK