Hue: The Hadoop UI - Stockholm HUG

•

1 j'aime•3,288 vues

Learn about Hue, the UI for Apache Hadoop. Presented by Enrico Berti at the HUG Stockholm meetup. Find out everything you need about Hue at http://gethue.com

Technologie Sports

HÅLLÖ
Enrico Berti - Cloudera - Stockholm HUG @ Spotify - Oct 2013

All trademarks and registered trademarks are the property of their respective owners.
1

WHAT IS HUE?

Web Interface for making Hadoop easier to use
Suite of apps for each Hadoop component
e.g. Hive, Pig, Impala, Oozie, Solr, Sqoop, HBase...

3

VIEW FROM 30K FEET

Hadoop

Web Server

Browser

4

ECOSYSTEM

Hue Plugins
YARN

JobTracker

Pig
Oozie

HiveServer2
HDFS

Hive
Metastore

Cloudera
Impala

HBase
Solr

Zookeeper
Sqoop2

LDAP
SAML

5

TARGET
Getting started with Hadoop
Getting familiar with and exploring different
angles of the platform
Let “any user” focus on big data processing

6

HUE IS OPEN SOURCE

2400+ commits 31 contributors 416 stars 132 forks
github.com/cloudera/hue
7

GROWING COMMUNITY
Nov

Dec

Jan

Feb

Mar

Apr

May

500

17,5

0

0

Sept

35

125

Aug

52,5

250

Jul

70

375

Jun

Posts

Topics

hue-user@
8

WHAT’S COMING?
HUE 3.0+
UI redesign
Doc model (like Google docs)
YARN
ZooKeeper app
Sqoop2 app
October

19

NEW DOC MODEL

Home a-la-GDrive
Sharing
Projects

20

EMBEDDED TOURS

Videos
Articles
Step by step guides

21

WHAT’S COMING?
HUE 3.5
Inter app integration
Charts
YOUR_REQUEST_HERE
~February 2014

22

GET HUE
Tarball
Demo VM
Bigtop
*
CDH
*

* Your mileage may vary.
26

FEEDBACK
What are your use cases?
Which Hadoop components do you use?

team@gethue.com
What would you like in Hue?
Interested in contributing?

27

Contenu connexe

Tendances

LDAP, SAML and Hue

gethue

HBase + Hue - LA HBase User Group

gethue

Hadoop Israel - HBase Browser in Hue

gethue

SF Dev Meetup - Hue SDK

gethue

Integrate Hue with your Hadoop cluster - Yahoo! Hadoop Meetup

gethue

Browser

MoisesAlves36

Open Atrium (DrupalCon Paris 2009, Day 3)

Cameron Eagans

Tendances (7)

LDAP, SAML and Hue

HBase + Hue - LA HBase User Group

Hadoop Israel - HBase Browser in Hue

SF Dev Meetup - Hue SDK

Integrate Hue with your Hadoop cluster - Yahoo! Hadoop Meetup

Browser

Open Atrium (DrupalCon Paris 2009, Day 3)

Similaire à Hue: The Hadoop UI - Stockholm HUG

April 2014 HUG : Integrating HUE with Multi-tenant cluster

Yahoo Developer Network

Apache Hadoop at 10

Cloudera, Inc.

E2Matrix Jalandhar provides Best Big Data training based on current industry standards that helps attendees to secure placements in their dream jobs at MNCs. E2Matrix Provides Best Big Data Training in Jalandhar Amritsar Ludhiana Phagwara Mohali Chandigarh. E2Matrix is one of the best Big Data training institute offering hands on practical knowledge. At E2Matrix Big Data training is conducted by subject specialist corporate professionals best experience in managing real-time Big Data projects. E2Matrix implements a blend of academic learning and practical sessions to give the student optimum exposure. At E2Matrix’s well-equipped Big Data training Institute aspirants learn the skills for Big Data Overview, Use Cases, Data Analytics Process, Data Preparation, Tools for Data Preparation, Hands on Exercise : Using SQL and NoSql DB's, Hands on Exercise : Usage of Tools, Data Analysis Introduction, Classification, Data Visualization using R, Automation Testing Training on real time projects.

Big Data Training in Mohali

E2MATRIX

Big Data Training in Amritsar

E2MATRIX

Big Data Training in Ludhiana

E2MATRIX

The Evolution and Future of Hadoop Storage （Hadoop Conference Japan 2016キーノート...

Hadoop / Spark Conference Japan

Hadoop Training is cover Hadoop Administration training and Hadoop developer by Keylabs. we provide best Hadoop classroom & online-training in Hyderabad&Bangalore. http://www.keylabstraining.com/hadoop-online-training-hyderabad-bangalore Hadoop is a free, Java-based programming framework that supports the processing of large data sets in a distributed computing environment. hadoop training, hadoop online training, hadoop training in bangalore, hadoop training in hyderabad, best hadoop training institutes, hadoop online training in chicago, hadoop training in mumbai, hadoop training in pune, hadoop training institutes ameerpet

Hadoop online training

Keylabs

Speeding up I/O for Machine Learning ft Apple Case Study using TensorFlow, N...

Alluxio, Inc.

The Enterprise Data Lake has become the defacto repository of both structured and unstructured data within an enterprise. Being able to discover information across both structured and unstructured data using search is a key capability of enterprise data lake. In this workshop, we will provide an in-depth overview of HDP Search with focus on configuration, sizing and tuning. We will also deliver a working example to showcase the usage of HDP Search along with the rest of platform capabilities to deliver real world solution.

Hortonworks Technical Workshop - HDP Search

Hortonworks

field_guide_to_hadoop_pentaho

Hadoop ecosystem

Big data or big deal

Hive paris

Webinar: Productionizing Hadoop: Lessons Learned - 20101208

Cloudera, Inc.

Александр Козлов, Cloudera Inc. Александр Козлов, старший архитектор в Cloudera Inc., работает с большими компаниями, многие из которых находятся в рейтинге Fortune 500, над проектами по созданию систем анализа большого количества данных. Закончил аспирантуру физического факультета Московского государственного университета, после чего также получил степень Ph.D. в Стэнфорде. До Cloudera и после окончания учебы работал над статистическим анализом данных и соответствующими компьютерными технологиями в SGI, Hewlett-Packard, а также стартапе Turn. Тема доклада Контроль зверей: инструменты для управления и мониторинга распределенных систем от Cloudera. Тезисы Поддержание распределенных систем, состоящих из тысяч компьютеров, является сложной задачей. Компания Cloudera, которая специализируется на создании распределенных технологий, разработала набор средств для централизованного управления распределенных Hadoop/HBase кластеров. Hadoop и HBase являются проектами Apache Software Foundation, и их применение для анализа частично структурированных данных ускоряется во всем мире. В этом докладе будет рассказано о SCM, системе для конфигурации, настройки, и управления Hadoop/HBase и Activity Monitor, системе для мониторинга ряда ОС и Hadoop/HBase метрик, а также об особенностях подхода Cloudera в отличие от существующих решений для мониторинга (Tivoli, xCat, Ganglia, Nagios и т.д.).

Контроль зверей: инструменты для управления и мониторинга распределенных сист...

yaevents

Big Data and advanced analytics are critical topics for executives today. But many still aren't sure how to turn that promise into value. This presentation provides an overview of 16 examples and use cases that lay out the different ways companies have approached the issue and found value: everything from pricing flexibility to customer preference management to credit risk analysis to fraud protection and discount targeting. For the latest on Big Data & Advanced Analytics: http://mckinseyonmarketingandsales.com/topics/big-data

Overview of Big data, Hadoop and Microsoft BI - version1

Thanh Nguyen

Overview of Big data, Hadoop and Microsoft BI - version1 Big Data and Hadoop are emerging topics in data warehousing for many executives, BI practices and technologists today. However, many people still aren't sure how Big Data and existing Data warehouse can be married and turn that promise into value. This presentation provides an overview of Big Data technology and how Big Data can fit to the current BI/data warehousing context. http://www.quantumit.com.au http://www.evisional.com

Overview of big data & hadoop version 1 - Tony Nguyen

Thanh Nguyen

sql on hadoop

Jianwei Li

Cloudera - Amr Awadallah - Hadoop World 2010

Cloudera, Inc.

Building a Cloud Native Stack with EMR Spark, Alluxio, and S3

Alluxio, Inc.

Similaire à Hue: The Hadoop UI - Stockholm HUG (20)

April 2014 HUG : Integrating HUE with Multi-tenant cluster

Apache Hadoop at 10

Big Data Training in Mohali

Big Data Training in Amritsar

Big Data Training in Ludhiana

The Evolution and Future of Hadoop Storage （Hadoop Conference Japan 2016キーノート...

Hadoop online training

Speeding up I/O for Machine Learning ft Apple Case Study using TensorFlow, N...

Hortonworks Technical Workshop - HDP Search

field_guide_to_hadoop_pentaho

Hadoop ecosystem

Big data or big deal

Hive paris

Webinar: Productionizing Hadoop: Lessons Learned - 20101208

Контроль зверей: инструменты для управления и мониторинга распределенных сист...

Overview of Big data, Hadoop and Microsoft BI - version1

Overview of big data & hadoop version 1 - Tony Nguyen

sql on hadoop

Cloudera - Amr Awadallah - Hadoop World 2010

Building a Cloud Native Stack with EMR Spark, Alluxio, and S3

Plus de gethue

Livy is a new open source Spark REST Server for submitting and interacting with your Spark jobs from anywhere. Livy is conceptually based on the incredibly popular IPython/Jupyter, but implemented to better integrate into the Hadoop ecosystem with multi users. Spark can now be offered as a service to anyone in a simple way: Spark shells in Python or Scala can be ran by Livy in the cluster while the end user is manipulating them at his own convenience through a REST api. Regular non-interactive applications can also be submitted. The output of the jobs can be introspected and returned in a tabular format, which makes it visualizable in charts. Livy can point to a unique Spark cluster and create several contexts by users. With YARN impersonation, jobs will be executed with the actual permissions of the users submitting them. Livy also enables the development of Spark Notebook applications. Those are ideal for quickly doing interactive Spark visualizations and collaboration from a Web browser! This talk is technical and details the architecture and design decisions taken for developing this server, as well as its internals. It also describes the alternatives we tried and the challenges that were faced. The capabilities of Livy will then be lived demo in Hue’s Notebook Application through a real life scenario. https://spark-summit.org/eu-2015/events/building-a-rest-job-server-for-interactive-spark-as-a-service/

Spark Summit Europe: Building a REST Job Server for interactive Spark as a se...

gethue

Open up your user base to the data! Contrary to programming and SQL, almost everybody knows how to search. This talk describes through an interactive demo based on open source Hue how users can graphically search their data in Hadoop. The underlying technical details of the application and its interaction with Apache Solr will be clarified. The session will detail how to get started with data indexing in just a few clicks as well as explore several data analysis scenarios with the latest Solr Analytics Facets and Spark Streaming. Through a Web browser, attendees will be shown how to explore and visualize data for quick answers. The search dashboard in Hue, with its draggable charts and dynamic interface, lets any non-technical user look for documents or patterns. Attendees of this talk will learn how to get started with interactive search visualization in their Solr cluster.

SF Solr Meetup - Interactively Search and Visualize Your Big Data

gethue

Supporting running Spark scripts directly from a browser would bring the user experience up. Indeed, everybody has a Web navigator, the command line can be avoided, built-in graphing and visualization make it easy to explore and understand data with just a few clicks. This also simplifies the administration as now everything becomes centralized in a service and is accessible by non native clients. For this purpose, an open source Spark Job Server was developed in order to provide Scala, SQL and Python in a Web shell. The main Hadoop components of the platform are also integrated in the same interface. This talk describes the architecture of the Spark Server and its main features: # Scala, Python, SQL submissions # Impersonation # Security # Job progress / canceling # YARN / HDFS / Hive integration The server also ships with a friendly user interface built as a Hue app. We will focus on explaining how they were built, how to use the API and which lessons were learned. The final end user interaction will be live demoed.

Big Data Scala by the Bay: Interactive Spark in your Browser

gethue

Apache Solr makes it so easy to interactively visualize and explore your data. Create a dashboard, add some facets, select some values, cross it with the time and just look at the results. Apache Spark is the growing framework for performing streaming computations, which makes it ideal for real time indexing. Solr also comes with new Analytics Facets which are a major weapon added to the arsenal of the data explorer. They bring another dimension: calculations. We can now do the equivalent of SQL, just in a much simpler and faster way. These calculations can operate over buckets of data.

20150627 bigdatala

gethue

Open up your user base to the data! Almost everybody knows how to search. This talk describes through an interactive demo based on open source Hue how users can graphically search their data in Hadoop with Apache Solr. The session will detail how to get started with data indexing in just a few clicks and then explore several data analysis scenarios. The open source Hue search dashboard builder, with its draggable charts and dynamic interface lets any non-technical user look for documents or patterns. Attendees of this talk will learn how to get started with interactive search visualization in their Hadoop cluster.

Hadoop Summit - Interactive Big Data Analysis with Solr, Spark and Hue

gethue

Harness the power of Spark and Solr in Hue: Big Data Amsterdam v.2.0

gethue

This talk describes how open source Hue was built in order to provide a better Hadoop User Experience. The underlying technical details of its architecture, the lessons learned and how it integrates with Impala, Search and Spark under the cover will be explained. The presentation continues with real life analytics business use cases. It will show how data can be easily imported into the cluster and then queried interactively with SQL or through a visual search dashboard. All through your Web Browser or your own custom Web application! This talk aims at organizations trying to put a friendly “face” on Hadoop and get productive. Anybody looking at being more effective with Hadoop will also learn best practices and how to quickly get ramped up on the main data scenarios. Hue can be integrated with existing Hadoop deployments with minimal changes/disturbances. We cover details on how Hue interacts with the ecosystem and leverages the existing authentication and security model of your company. To sum-up, attendees of this talk will learn how Hadoop can be made more accessible and why Hue is the ideal gateway for using it more efficiently or being the starting point of your own Big Data Web application.

Hue: Big Data Web applications for Interactive Hadoop at Big Data Spain 2014

gethue

Open up your user base to the data! Contrary to programming and SQL, almost everybody knows how to search. This talk describes through an interactive demo based on open source Hue how users can graphically search their data in Hadoop. The underlying technical details of the application and its interaction with Apache Solr will be clarified. The session will detail how to get started with data indexing in just a few clicks as well as explore several data analysis scenarios. Through a web browser, attendees will be shown how to explore and visualize data for quick answers. The new search dashboard in Hue, with its draggable charts and dynamic interface, lets any non-technical user look for documents or patterns. Attendees of this talk will learn how to get started with interactive search visualization in their Hadoop cluster.

Interactively Search and Visualize Your Big Data

gethue

Sqoop2 refactoring for generic data transfer - NYC Sqoop Meetup

gethue

Plus de gethue (9)

Spark Summit Europe: Building a REST Job Server for interactive Spark as a se...

SF Solr Meetup - Interactively Search and Visualize Your Big Data

Big Data Scala by the Bay: Interactive Spark in your Browser

20150627 bigdatala

Hadoop Summit - Interactive Big Data Analysis with Solr, Spark and Hue

Harness the power of Spark and Solr in Hue: Big Data Amsterdam v.2.0

Hue: Big Data Web applications for Interactive Hadoop at Big Data Spain 2014

Interactively Search and Visualize Your Big Data

Sqoop2 refactoring for generic data transfer - NYC Sqoop Meetup

Dernier

How to Troubleshoot Apps for the Modern Connected Worker

ThousandEyes

Retrieval augmented generation (RAG) is the most popular style of large language model application to emerge from 2023. The most basic style of RAG works by vectorizing your data and injecting it into a vector database like Milvus for retrieval to augment the text output generated by an LLM. This is just the beginning. One of the ways that we can extend RAG, and extend AI, is through multilingual use cases. Typical RAG is done in English using embedding models that are trained in English. In this talk, we’ll explore how RAG could work in languages other than English. We’ll explore French, Chinese, and Polish.

Introduction to Multilingual Retrieval Augmented Generation (RAG)

Zilliz

Corporate and higher education. Two industries that, in the past, have had a clear divide with very little crossover. The difference in goals, learning styles and objectives paved the way for differing learning technologies platforms to evolve. Now, those stark lines are blurring as both sides are discovering they have content that’s relevant to the other. Join Tammy Rutherford as she walks through the pros and cons of corporate and higher ed collaborating. And the challenges of these different technology platforms working together for a brighter future.

Corporate and higher education May webinar.pptx

Rustici Software

Architecting Cloud Native Applications

WSO2

Following the popularity of “Cloud Revolution: Exploring the New Wave of Serverless Spatial Data,” we’re thrilled to announce this much-anticipated encore webinar. In this sequel, we’ll dive deeper into the Cloud-Native realm by uncovering practical applications and FME support for these new formats, including COGs, COPC, FlatGeoBuf, GeoParquet, STAC, and ZARR. Building on the foundation laid by industry leaders Michelle Roby of Radiant Earth and Chris Holmes of Planet in the first webinar, this second part offers an in-depth look at the real-world application and behind-the-scenes dynamics of these cutting-edge formats. We will spotlight specific use-cases and workflows, showcasing their efficiency and relevance in practical scenarios. Discover the vast possibilities each format holds, highlighted through detailed discussions and demonstrations. Our expert speakers will dissect the key aspects and provide critical takeaways for effective use, ensuring attendees leave with a thorough understanding of how to apply these formats in their own projects. Elevate your understanding of how FME supports these cutting-edge technologies, enhancing your ability to manage, share, and analyze spatial data. Whether you’re building on knowledge from our initial session or are new to the serverless spatial data landscape, this webinar is your gateway to mastering cloud-native formats in your workflows.

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Safe Software

DBX First Quarter 2024 Investor Presentation

Dropbox

MINDCTI Revenue Release Quarter One 2024

MIND CTI

💥 You’re lucky! We’ve found two different (lead) developers that are willing to share their valuable lessons learned about using UiPath Document Understanding! Based on recent implementations in appealing use cases at Partou and SPIE. Don’t expect fancy videos or slide decks, but real and practical experiences that will help you with your own implementations. 📕 Topics that will be addressed: • Training the ML-model by humans: do or don't? • Rule-based versus AI extractors • Tips for finding use cases • How to start 👨‍🏫👨‍💻 Speakers: o Dion Morskieft, RPA Product Owner @Partou o Jack Klein-Schiphorst, Automation Developer @Tacstone Technology

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam

UiPathCommunity

presentation ICT roal in 21st century education

jfdjdjcjdnsjd

Artificial Intelligence Chap.5 : Uncertainty

Khushali Kathiriya

AWS Community Day CPH - Three problems of Terraform

Andrey Devyatkin

Understanding the FAA Part 107 License ..

Christopher Logan Kennedy

Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows. We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases. This video focuses on the deployment of external web forms using Jotform for Bonterra Impact Management. This solution can be customized to your organization’s needs and deployed to support the common use cases below: - Intake and consent - Assessments - Surveys - Applications - Program registration Interested in deploying web form automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...

Jeffrey Haguewood

Strategies for Landing an Oracle DBA Job as a Fresher

Remote DBA Services

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood

Juan lago vázquez

Scaling API-first – The story of a global engineering organization Ian Reasor, Senior Computer Scientist - Adobe Radu Cotescu, Senior Computer Scientist - Adobe Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

apidays

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

Zilliz

Accelerating FinTech Innovation: Unleashing API Economy and GenAI Vasa Krishnan, Chief Technology Officer - FinResults Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...

apidays

The presentation was made in “Web3 Fusion: Embracing AI and Beyond” is more than a conference; it's a journey into the heart of digital transformation. The conference a provided a platform where the future of technology meets practical application. This three-day hybrid event, set in the heart of innovation, served as a gateway to the latest trends and transformative discussions in AI, Blockchain, IoT, AR/VR, and their collective impact on the information space.

AI in Action: Real World Use Cases by Anitaraj

AnitaRaj43

Join our latest Connector Corner webinar to discover how UiPath Integration Service revolutionizes API-centric automation in a 'Quote to Cash' process—and how that automation empowers businesses to accelerate revenue generation. A comprehensive demo will explore connecting systems, GenAI, and people, through powerful pre-built connectors designed to speed process cycle times. Speakers: James Dickson, Senior Software Engineer Charlie Greenberg, Host, Product Marketing Manager

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

DianaGray10

Dernier (20)

How to Troubleshoot Apps for the Modern Connected Worker

Introduction to Multilingual Retrieval Augmented Generation (RAG)

Corporate and higher education May webinar.pptx

Architecting Cloud Native Applications

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

DBX First Quarter 2024 Investor Presentation

MINDCTI Revenue Release Quarter One 2024

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam

presentation ICT roal in 21st century education

Artificial Intelligence Chap.5 : Uncertainty

AWS Community Day CPH - Three problems of Terraform

Understanding the FAA Part 107 License ..

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...

Strategies for Landing an Oracle DBA Job as a Fresher

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...

AI in Action: Real World Use Cases by Anitaraj

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

Hue: The Hadoop UI - Stockholm HUG

1. HÅLLÖ Enrico Berti - Cloudera - Stockholm HUG @ Spotify - Oct 2013 All trademarks and registered trademarks are the property of their respective owners. 1

2. HUE 2

3. WHAT IS HUE? Web Interface for making Hadoop easier to use Suite of apps for each Hadoop component e.g. Hive, Pig, Impala, Oozie, Solr, Sqoop, HBase... 3

4. VIEW FROM 30K FEET Hadoop Web Server Browser 4

5. ECOSYSTEM Hue Plugins YARN JobTracker Pig Oozie HiveServer2 HDFS Hive Metastore Cloudera Impala HBase Solr Zookeeper Sqoop2 LDAP SAML 5

6. TARGET Getting started with Hadoop Getting familiar with and exploring different angles of the platform Let “any user” focus on big data processing 6

7. HUE IS OPEN SOURCE 2400+ commits 31 contributors 416 stars 132 forks github.com/cloudera/hue 7

8. GROWING COMMUNITY Nov Dec Jan Feb Mar Apr May 500 17,5 0 0 Sept 35 125 Aug 52,5 250 Jul 70 375 Jun Posts Topics hue-user@ 8

9. HUE 1 9

10. HUE 2 10

11. HUE 2.5 11

12. PROPOSED HUE 3 12

13. HUE 3 13

14. HUE 3.0+ 14

15. DEMO TIME 15

16. ZOOKEEPER 16

17. IMPALA 17

18. LEARN MORE learn.gethue.com 18