Soumettre la recherche
Mettre en ligne
Apache Ambari: Past, Present, Future
•
Télécharger en tant que PPTX, PDF
•
10 j'aime
•
3,230 vues
Hortonworks
Suivre
Future of Data Meetup @ Philly October 11, 2016
Lire moins
Lire la suite
Technologie
Signaler
Partager
Signaler
Partager
1 sur 97
Télécharger maintenant
Recommandé
An Overview of Ambari
An Overview of Ambari
Chicago Hadoop Users Group
Managing 2000 Node Cluster with Ambari
Managing 2000 Node Cluster with Ambari
DataWorks Summit
Ambari: Agent Registration Flow
Ambari: Agent Registration Flow
Hortonworks
Hadoop Oozie
Hadoop Oozie
Madhur Nawandar
Building Data Pipelines for Solr with Apache NiFi
Building Data Pipelines for Solr with Apache NiFi
Bryan Bende
MySQL Monitoring using Prometheus & Grafana
MySQL Monitoring using Prometheus & Grafana
YoungHeon (Roy) Kim
How to understand and analyze Apache Hive query execution plan for performanc...
How to understand and analyze Apache Hive query execution plan for performanc...
DataWorks Summit/Hadoop Summit
Apache NiFi Crash Course Intro
Apache NiFi Crash Course Intro
DataWorks Summit/Hadoop Summit
Recommandé
An Overview of Ambari
An Overview of Ambari
Chicago Hadoop Users Group
Managing 2000 Node Cluster with Ambari
Managing 2000 Node Cluster with Ambari
DataWorks Summit
Ambari: Agent Registration Flow
Ambari: Agent Registration Flow
Hortonworks
Hadoop Oozie
Hadoop Oozie
Madhur Nawandar
Building Data Pipelines for Solr with Apache NiFi
Building Data Pipelines for Solr with Apache NiFi
Bryan Bende
MySQL Monitoring using Prometheus & Grafana
MySQL Monitoring using Prometheus & Grafana
YoungHeon (Roy) Kim
How to understand and analyze Apache Hive query execution plan for performanc...
How to understand and analyze Apache Hive query execution plan for performanc...
DataWorks Summit/Hadoop Summit
Apache NiFi Crash Course Intro
Apache NiFi Crash Course Intro
DataWorks Summit/Hadoop Summit
Manage Add-On Services with Apache Ambari
Manage Add-On Services with Apache Ambari
DataWorks Summit
PromQL Deep Dive - The Prometheus Query Language
PromQL Deep Dive - The Prometheus Query Language
Weaveworks
Grafana optimization for Prometheus
Grafana optimization for Prometheus
Mitsuhiro Tanda
Tomcat
Tomcat
Venkat Pinagadi
ORC File - Optimizing Your Big Data
ORC File - Optimizing Your Big Data
DataWorks Summit
ASP.NET Web API and HTTP Fundamentals
ASP.NET Web API and HTTP Fundamentals
Ido Flatow
Kibana overview
Kibana overview
Rinat Tainov
LLAP: long-lived execution in Hive
LLAP: long-lived execution in Hive
DataWorks Summit
Terraform -- Infrastructure as Code
Terraform -- Infrastructure as Code
Martin Schütte
Introduction to Apache NiFi 1.11.4
Introduction to Apache NiFi 1.11.4
Timothy Spann
File Format Benchmarks - Avro, JSON, ORC, & Parquet
File Format Benchmarks - Avro, JSON, ORC, & Parquet
Owen O'Malley
Monitoring with prometheus
Monitoring with prometheus
Kasper Nissen
Practical Elasticsearch - real world use cases
Practical Elasticsearch - real world use cases
Itamar
Apache NiFi User Guide
Apache NiFi User Guide
Deon Huang
Hadoop REST API Security with Apache Knox Gateway
Hadoop REST API Security with Apache Knox Gateway
DataWorks Summit
Building infrastructure as code using Terraform - DevOps Krakow
Building infrastructure as code using Terraform - DevOps Krakow
Anton Babenko
Managing your Hadoop Clusters with Apache Ambari
Managing your Hadoop Clusters with Apache Ambari
DataWorks Summit
Kibana Tutorial | Kibana Dashboard Tutorial | Kibana Elasticsearch | ELK Stac...
Kibana Tutorial | Kibana Dashboard Tutorial | Kibana Elasticsearch | ELK Stac...
Edureka!
Lambda Expressions in C# From Beginner To Expert - Jaliya Udagedara
Lambda Expressions in C# From Beginner To Expert - Jaliya Udagedara
Jaliya Udagedara
NiFi Developer Guide
NiFi Developer Guide
Deon Huang
Apache Ambari - What's New in 2.4
Apache Ambari - What's New in 2.4
Hortonworks
Managing Enterprise Hadoop Clusters with Apache Ambari
Managing Enterprise Hadoop Clusters with Apache Ambari
Hortonworks
Contenu connexe
Tendances
Manage Add-On Services with Apache Ambari
Manage Add-On Services with Apache Ambari
DataWorks Summit
PromQL Deep Dive - The Prometheus Query Language
PromQL Deep Dive - The Prometheus Query Language
Weaveworks
Grafana optimization for Prometheus
Grafana optimization for Prometheus
Mitsuhiro Tanda
Tomcat
Tomcat
Venkat Pinagadi
ORC File - Optimizing Your Big Data
ORC File - Optimizing Your Big Data
DataWorks Summit
ASP.NET Web API and HTTP Fundamentals
ASP.NET Web API and HTTP Fundamentals
Ido Flatow
Kibana overview
Kibana overview
Rinat Tainov
LLAP: long-lived execution in Hive
LLAP: long-lived execution in Hive
DataWorks Summit
Terraform -- Infrastructure as Code
Terraform -- Infrastructure as Code
Martin Schütte
Introduction to Apache NiFi 1.11.4
Introduction to Apache NiFi 1.11.4
Timothy Spann
File Format Benchmarks - Avro, JSON, ORC, & Parquet
File Format Benchmarks - Avro, JSON, ORC, & Parquet
Owen O'Malley
Monitoring with prometheus
Monitoring with prometheus
Kasper Nissen
Practical Elasticsearch - real world use cases
Practical Elasticsearch - real world use cases
Itamar
Apache NiFi User Guide
Apache NiFi User Guide
Deon Huang
Hadoop REST API Security with Apache Knox Gateway
Hadoop REST API Security with Apache Knox Gateway
DataWorks Summit
Building infrastructure as code using Terraform - DevOps Krakow
Building infrastructure as code using Terraform - DevOps Krakow
Anton Babenko
Managing your Hadoop Clusters with Apache Ambari
Managing your Hadoop Clusters with Apache Ambari
DataWorks Summit
Kibana Tutorial | Kibana Dashboard Tutorial | Kibana Elasticsearch | ELK Stac...
Kibana Tutorial | Kibana Dashboard Tutorial | Kibana Elasticsearch | ELK Stac...
Edureka!
Lambda Expressions in C# From Beginner To Expert - Jaliya Udagedara
Lambda Expressions in C# From Beginner To Expert - Jaliya Udagedara
Jaliya Udagedara
NiFi Developer Guide
NiFi Developer Guide
Deon Huang
Tendances
(20)
Manage Add-On Services with Apache Ambari
Manage Add-On Services with Apache Ambari
PromQL Deep Dive - The Prometheus Query Language
PromQL Deep Dive - The Prometheus Query Language
Grafana optimization for Prometheus
Grafana optimization for Prometheus
Tomcat
Tomcat
ORC File - Optimizing Your Big Data
ORC File - Optimizing Your Big Data
ASP.NET Web API and HTTP Fundamentals
ASP.NET Web API and HTTP Fundamentals
Kibana overview
Kibana overview
LLAP: long-lived execution in Hive
LLAP: long-lived execution in Hive
Terraform -- Infrastructure as Code
Terraform -- Infrastructure as Code
Introduction to Apache NiFi 1.11.4
Introduction to Apache NiFi 1.11.4
File Format Benchmarks - Avro, JSON, ORC, & Parquet
File Format Benchmarks - Avro, JSON, ORC, & Parquet
Monitoring with prometheus
Monitoring with prometheus
Practical Elasticsearch - real world use cases
Practical Elasticsearch - real world use cases
Apache NiFi User Guide
Apache NiFi User Guide
Hadoop REST API Security with Apache Knox Gateway
Hadoop REST API Security with Apache Knox Gateway
Building infrastructure as code using Terraform - DevOps Krakow
Building infrastructure as code using Terraform - DevOps Krakow
Managing your Hadoop Clusters with Apache Ambari
Managing your Hadoop Clusters with Apache Ambari
Kibana Tutorial | Kibana Dashboard Tutorial | Kibana Elasticsearch | ELK Stac...
Kibana Tutorial | Kibana Dashboard Tutorial | Kibana Elasticsearch | ELK Stac...
Lambda Expressions in C# From Beginner To Expert - Jaliya Udagedara
Lambda Expressions in C# From Beginner To Expert - Jaliya Udagedara
NiFi Developer Guide
NiFi Developer Guide
En vedette
Apache Ambari - What's New in 2.4
Apache Ambari - What's New in 2.4
Hortonworks
Managing Enterprise Hadoop Clusters with Apache Ambari
Managing Enterprise Hadoop Clusters with Apache Ambari
Hortonworks
S3Guard: What's in your consistency model?
S3Guard: What's in your consistency model?
Hortonworks
Dynamic Column Masking and Row-Level Filtering in HDP
Dynamic Column Masking and Row-Level Filtering in HDP
Hortonworks
The Power of your Data Achieved - Next Gen Modernization
The Power of your Data Achieved - Next Gen Modernization
Hortonworks
Hortonworks Data Cloud for AWS
Hortonworks Data Cloud for AWS
Hortonworks
Webinar Series Part 5 New Features of HDF 5
Webinar Series Part 5 New Features of HDF 5
Hortonworks
How to Use Apache Zeppelin with HWX HDB
How to Use Apache Zeppelin with HWX HDB
Hortonworks
Top 5 Strategies for Retail Data Analytics
Top 5 Strategies for Retail Data Analytics
Hortonworks
Hortonworks Data in Motion Webinar Series Part 7 Apache Kafka Nifi Better Tog...
Hortonworks Data in Motion Webinar Series Part 7 Apache Kafka Nifi Better Tog...
Hortonworks
The path to a Modern Data Architecture in Financial Services
The path to a Modern Data Architecture in Financial Services
Hortonworks
Past, Present and Future of Apache Ambari
Past, Present and Future of Apache Ambari
Artem Ervits
Apache Ambari: Managing Hadoop and YARN
Apache Ambari: Managing Hadoop and YARN
Hortonworks
Hortonworks Technical Workshop: Apache Ambari
Hortonworks Technical Workshop: Apache Ambari
Hortonworks
Deploying and Managing Hadoop Clusters with AMBARI
Deploying and Managing Hadoop Clusters with AMBARI
DataWorks Summit
How to manage Hortonworks HDB Resources with YARN
How to manage Hortonworks HDB Resources with YARN
Hortonworks
Getting involved with Open Source at the ASF
Getting involved with Open Source at the ASF
Hortonworks
How Universities Use Big Data to Transform Education
How Universities Use Big Data to Transform Education
Hortonworks
Hive - 1455: Cloud Storage
Hive - 1455: Cloud Storage
Hortonworks
Scaling real time streaming architectures with HDF and Dell EMC Isilon
Scaling real time streaming architectures with HDF and Dell EMC Isilon
Hortonworks
En vedette
(20)
Apache Ambari - What's New in 2.4
Apache Ambari - What's New in 2.4
Managing Enterprise Hadoop Clusters with Apache Ambari
Managing Enterprise Hadoop Clusters with Apache Ambari
S3Guard: What's in your consistency model?
S3Guard: What's in your consistency model?
Dynamic Column Masking and Row-Level Filtering in HDP
Dynamic Column Masking and Row-Level Filtering in HDP
The Power of your Data Achieved - Next Gen Modernization
The Power of your Data Achieved - Next Gen Modernization
Hortonworks Data Cloud for AWS
Hortonworks Data Cloud for AWS
Webinar Series Part 5 New Features of HDF 5
Webinar Series Part 5 New Features of HDF 5
How to Use Apache Zeppelin with HWX HDB
How to Use Apache Zeppelin with HWX HDB
Top 5 Strategies for Retail Data Analytics
Top 5 Strategies for Retail Data Analytics
Hortonworks Data in Motion Webinar Series Part 7 Apache Kafka Nifi Better Tog...
Hortonworks Data in Motion Webinar Series Part 7 Apache Kafka Nifi Better Tog...
The path to a Modern Data Architecture in Financial Services
The path to a Modern Data Architecture in Financial Services
Past, Present and Future of Apache Ambari
Past, Present and Future of Apache Ambari
Apache Ambari: Managing Hadoop and YARN
Apache Ambari: Managing Hadoop and YARN
Hortonworks Technical Workshop: Apache Ambari
Hortonworks Technical Workshop: Apache Ambari
Deploying and Managing Hadoop Clusters with AMBARI
Deploying and Managing Hadoop Clusters with AMBARI
How to manage Hortonworks HDB Resources with YARN
How to manage Hortonworks HDB Resources with YARN
Getting involved with Open Source at the ASF
Getting involved with Open Source at the ASF
How Universities Use Big Data to Transform Education
How Universities Use Big Data to Transform Education
Hive - 1455: Cloud Storage
Hive - 1455: Cloud Storage
Scaling real time streaming architectures with HDF and Dell EMC Isilon
Scaling real time streaming architectures with HDF and Dell EMC Isilon
Similaire à Apache Ambari: Past, Present, Future
Hortonworks technical workshop operations with ambari
Hortonworks technical workshop operations with ambari
Hortonworks
Managing Enterprise Hadoop Clusters with Apache Ambari
Managing Enterprise Hadoop Clusters with Apache Ambari
Jayush Luniya
What's new in Ambari
What's new in Ambari
DataWorks Summit
Streamline Hadoop DevOps with Apache Ambari
Streamline Hadoop DevOps with Apache Ambari
DataWorks Summit/Hadoop Summit
Hadoop Operations - Past, Present, and Future
Hadoop Operations - Past, Present, and Future
DataWorks Summit
Apache Ambari - What's New in 2.1
Apache Ambari - What's New in 2.1
Hortonworks
Big Data Day LA 2016/ Hadoop/ Spark/ Kafka track - Why is my Hadoop cluster s...
Big Data Day LA 2016/ Hadoop/ Spark/ Kafka track - Why is my Hadoop cluster s...
Data Con LA
Manage Add-on Services in Apache Ambari
Manage Add-on Services in Apache Ambari
Jayush Luniya
Ambari metrics system - Apache ambari meetup (DataWorks Summit 2017)
Ambari metrics system - Apache ambari meetup (DataWorks Summit 2017)
Aravindan Vijayan
Why is my Hadoop* job slow?
Why is my Hadoop* job slow?
DataWorks Summit/Hadoop Summit
Running Cloudbreak on Kubernetes
Running Cloudbreak on Kubernetes
Krisztián Horváth
Running Cloudbreak on Kubernetes
Running Cloudbreak on Kubernetes
Future of Data Meetup
Why is My Hadoop Job Slow?
Why is My Hadoop Job Slow?
Bikas Saha
Why is my Hadoop cluster slow?
Why is my Hadoop cluster slow?
DataWorks Summit/Hadoop Summit
Why is My Hadoop Job Slow?
Why is My Hadoop Job Slow?
Bikas Saha
Hadoop Operations - Past, Present, and Future
Hadoop Operations - Past, Present, and Future
DataWorks Summit
Hadoop Operations – Past, Present, and Future
Hadoop Operations – Past, Present, and Future
DataWorks Summit
Hive acid and_2.x new_features
Hive acid and_2.x new_features
Alberto Romero
Running Enterprise Workloads in the Cloud
Running Enterprise Workloads in the Cloud
DataWorks Summit
Apache Hadoop YARN: Past, Present and Future
Apache Hadoop YARN: Past, Present and Future
DataWorks Summit/Hadoop Summit
Similaire à Apache Ambari: Past, Present, Future
(20)
Hortonworks technical workshop operations with ambari
Hortonworks technical workshop operations with ambari
Managing Enterprise Hadoop Clusters with Apache Ambari
Managing Enterprise Hadoop Clusters with Apache Ambari
What's new in Ambari
What's new in Ambari
Streamline Hadoop DevOps with Apache Ambari
Streamline Hadoop DevOps with Apache Ambari
Hadoop Operations - Past, Present, and Future
Hadoop Operations - Past, Present, and Future
Apache Ambari - What's New in 2.1
Apache Ambari - What's New in 2.1
Big Data Day LA 2016/ Hadoop/ Spark/ Kafka track - Why is my Hadoop cluster s...
Big Data Day LA 2016/ Hadoop/ Spark/ Kafka track - Why is my Hadoop cluster s...
Manage Add-on Services in Apache Ambari
Manage Add-on Services in Apache Ambari
Ambari metrics system - Apache ambari meetup (DataWorks Summit 2017)
Ambari metrics system - Apache ambari meetup (DataWorks Summit 2017)
Why is my Hadoop* job slow?
Why is my Hadoop* job slow?
Running Cloudbreak on Kubernetes
Running Cloudbreak on Kubernetes
Running Cloudbreak on Kubernetes
Running Cloudbreak on Kubernetes
Why is My Hadoop Job Slow?
Why is My Hadoop Job Slow?
Why is my Hadoop cluster slow?
Why is my Hadoop cluster slow?
Why is My Hadoop Job Slow?
Why is My Hadoop Job Slow?
Hadoop Operations - Past, Present, and Future
Hadoop Operations - Past, Present, and Future
Hadoop Operations – Past, Present, and Future
Hadoop Operations – Past, Present, and Future
Hive acid and_2.x new_features
Hive acid and_2.x new_features
Running Enterprise Workloads in the Cloud
Running Enterprise Workloads in the Cloud
Apache Hadoop YARN: Past, Present and Future
Apache Hadoop YARN: Past, Present and Future
Plus de Hortonworks
Hortonworks DataFlow (HDF) 3.3 - Taking Stream Processing to the Next Level
Hortonworks DataFlow (HDF) 3.3 - Taking Stream Processing to the Next Level
Hortonworks
IoT Predictions for 2019 and Beyond: Data at the Heart of Your IoT Strategy
IoT Predictions for 2019 and Beyond: Data at the Heart of Your IoT Strategy
Hortonworks
Getting the Most Out of Your Data in the Cloud with Cloudbreak
Getting the Most Out of Your Data in the Cloud with Cloudbreak
Hortonworks
Johns Hopkins - Using Hadoop to Secure Access Log Events
Johns Hopkins - Using Hadoop to Secure Access Log Events
Hortonworks
Catch a Hacker in Real-Time: Live Visuals of Bots and Bad Guys
Catch a Hacker in Real-Time: Live Visuals of Bots and Bad Guys
Hortonworks
HDF 3.2 - What's New
HDF 3.2 - What's New
Hortonworks
Curing Kafka Blindness with Hortonworks Streams Messaging Manager
Curing Kafka Blindness with Hortonworks Streams Messaging Manager
Hortonworks
Interpretation Tool for Genomic Sequencing Data in Clinical Environments
Interpretation Tool for Genomic Sequencing Data in Clinical Environments
Hortonworks
IBM+Hortonworks = Transformation of the Big Data Landscape
IBM+Hortonworks = Transformation of the Big Data Landscape
Hortonworks
Premier Inside-Out: Apache Druid
Premier Inside-Out: Apache Druid
Hortonworks
Accelerating Data Science and Real Time Analytics at Scale
Accelerating Data Science and Real Time Analytics at Scale
Hortonworks
TIME SERIES: APPLYING ADVANCED ANALYTICS TO INDUSTRIAL PROCESS DATA
TIME SERIES: APPLYING ADVANCED ANALYTICS TO INDUSTRIAL PROCESS DATA
Hortonworks
Blockchain with Machine Learning Powered by Big Data: Trimble Transportation ...
Blockchain with Machine Learning Powered by Big Data: Trimble Transportation ...
Hortonworks
Delivering Real-Time Streaming Data for Healthcare Customers: Clearsense
Delivering Real-Time Streaming Data for Healthcare Customers: Clearsense
Hortonworks
Making Enterprise Big Data Small with Ease
Making Enterprise Big Data Small with Ease
Hortonworks
Webinewbie to Webinerd in 30 Days - Webinar World Presentation
Webinewbie to Webinerd in 30 Days - Webinar World Presentation
Hortonworks
Driving Digital Transformation Through Global Data Management
Driving Digital Transformation Through Global Data Management
Hortonworks
HDF 3.1 pt. 2: A Technical Deep-Dive on New Streaming Features
HDF 3.1 pt. 2: A Technical Deep-Dive on New Streaming Features
Hortonworks
Hortonworks DataFlow (HDF) 3.1 - Redefining Data-In-Motion with Modern Data A...
Hortonworks DataFlow (HDF) 3.1 - Redefining Data-In-Motion with Modern Data A...
Hortonworks
Unlock Value from Big Data with Apache NiFi and Streaming CDC
Unlock Value from Big Data with Apache NiFi and Streaming CDC
Hortonworks
Plus de Hortonworks
(20)
Hortonworks DataFlow (HDF) 3.3 - Taking Stream Processing to the Next Level
Hortonworks DataFlow (HDF) 3.3 - Taking Stream Processing to the Next Level
IoT Predictions for 2019 and Beyond: Data at the Heart of Your IoT Strategy
IoT Predictions for 2019 and Beyond: Data at the Heart of Your IoT Strategy
Getting the Most Out of Your Data in the Cloud with Cloudbreak
Getting the Most Out of Your Data in the Cloud with Cloudbreak
Johns Hopkins - Using Hadoop to Secure Access Log Events
Johns Hopkins - Using Hadoop to Secure Access Log Events
Catch a Hacker in Real-Time: Live Visuals of Bots and Bad Guys
Catch a Hacker in Real-Time: Live Visuals of Bots and Bad Guys
HDF 3.2 - What's New
HDF 3.2 - What's New
Curing Kafka Blindness with Hortonworks Streams Messaging Manager
Curing Kafka Blindness with Hortonworks Streams Messaging Manager
Interpretation Tool for Genomic Sequencing Data in Clinical Environments
Interpretation Tool for Genomic Sequencing Data in Clinical Environments
IBM+Hortonworks = Transformation of the Big Data Landscape
IBM+Hortonworks = Transformation of the Big Data Landscape
Premier Inside-Out: Apache Druid
Premier Inside-Out: Apache Druid
Accelerating Data Science and Real Time Analytics at Scale
Accelerating Data Science and Real Time Analytics at Scale
TIME SERIES: APPLYING ADVANCED ANALYTICS TO INDUSTRIAL PROCESS DATA
TIME SERIES: APPLYING ADVANCED ANALYTICS TO INDUSTRIAL PROCESS DATA
Blockchain with Machine Learning Powered by Big Data: Trimble Transportation ...
Blockchain with Machine Learning Powered by Big Data: Trimble Transportation ...
Delivering Real-Time Streaming Data for Healthcare Customers: Clearsense
Delivering Real-Time Streaming Data for Healthcare Customers: Clearsense
Making Enterprise Big Data Small with Ease
Making Enterprise Big Data Small with Ease
Webinewbie to Webinerd in 30 Days - Webinar World Presentation
Webinewbie to Webinerd in 30 Days - Webinar World Presentation
Driving Digital Transformation Through Global Data Management
Driving Digital Transformation Through Global Data Management
HDF 3.1 pt. 2: A Technical Deep-Dive on New Streaming Features
HDF 3.1 pt. 2: A Technical Deep-Dive on New Streaming Features
Hortonworks DataFlow (HDF) 3.1 - Redefining Data-In-Motion with Modern Data A...
Hortonworks DataFlow (HDF) 3.1 - Redefining Data-In-Motion with Modern Data A...
Unlock Value from Big Data with Apache NiFi and Streaming CDC
Unlock Value from Big Data with Apache NiFi and Streaming CDC
Dernier
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easy
Alfredo García Lavilla
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.
Curtis Poe
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio Web
UiPathCommunity
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
Sri Ambati
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering Tips
Miki Katsuragi
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level piece
charlottematthew16
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?
Mattias Andersson
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):
comworks
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
null - The Open Security Community
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdf
Addepto
SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptx
NavinnSomaal
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
Scott Keck-Warren
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
Fwdays
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Precisely
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!
Manik S Magar
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .
Alan Dix
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
BookNet Canada
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An Introduction
Dilum Bandara
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Mark Simos
Powerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time Clash
charlottematthew16
Dernier
(20)
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easy
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio Web
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering Tips
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level piece
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdf
SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptx
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An Introduction
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Powerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time Clash
Apache Ambari: Past, Present, Future
1.
1 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Apache Ambari Past, Present and Future October 2016
2.
2 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Who Am I Jeff Sposetti Product Management, Cloud & Operations @ Hortonworks Apache Ambari Committer https://www.linkedin.com/in/jsposetti @jsposetti
3.
3 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Agenda Background, Release History and Demo Ambari Alerts and Metrics Ambari Blueprints Security Setup (Kerberos, RBAC) Log Search (Technical Preview) Automated Cluster Upgrade Extensibility: Stacks and Views What’s New and Next
4.
4 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved What is Apache Ambari? A completely open source management platform for provisioning, managing, monitoring and securing Apache Hadoop clusters. Apache Ambari takes the guesswork out of operating Hadoop.
5.
5 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Ambari Recent Releases Ambari 2.2.0 Dec 2015 Ambari 2.2.2 Apr 2016 Ambari 2.4.0 GA Aug 2016
6.
6 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Ambari Alerts
7.
7 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Full Visibility into Cluster Health • Centralized management of Health Alerts • Pre-defined alerts, configured by default on cluster install
8.
8 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Customizing Alerts • Control thresholds, check intervals and response text
9.
9 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Alert Notifications • What: Create and manage multiple notification targets • Control who gets notified when • Why: Filter by severity • Send only certain notifications to certain targets based on severity • How: Control dispatch method • Support for EMAIL + SNMP
10.
10 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Alert Groups • Create and manage groups of alerts • Group alerts further controls what alerts are dispatched which notifications • Assign group to notifications • Only dispatch to interested parties
11.
11 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Alert Check Counts Customize the number of times an alert is checked before dispatching a notification Avoid dispatching an alert notification (email, snmp) in case of transient issues
12.
12 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Configuring the Check Count Set globally for all alerts, or override for a specific alert Global Setting Alert Override
13.
13 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved State Change Types SOFT state changes do not perform a dispatch HARD state changes (to non-OK) perform dispatch Regardless of change: – The Ambari Web UI will show the current state (OK/WARN/CRIT) – The state change is written to ambari-alerts.log 2016-05-31 13:20:52,294 [CRITICAL] [SOFT] [AMBARI_METRICS] [grafana_webui] (Grafana Web UI) Connection failed to http://c6401.ambari.apache.org:3000 (<urlopen error [Errno 111] Connection refused>) 2016-05-31 13:22:52,290 [CRITICAL] [HARD] [AMBARI_METRICS] [grafana_webui] (Grafana Web UI) Connection failed to http://c6401.ambari.apache.org:3000 (<urlopen error [Errno 111] Connection refused>) Note: check counts are not configurable for AGGREGATE alert types. All state changes are considered HARD.
14.
14 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Example: Check Count = 3 Check 1/3 State: OK Change: n/a Check 1/3 State: OK Change: n/a Check 1/3 State: CRIT Change: SOFT Check 2/3 State: CRIT Change: n/a Check 3/3 State: CRIT Change: HARD Check 1/3 State: OK Change: HARD DISPATCH Check Interval Check Interval Check Interval Check Interval Check Interval no state change state changes to CRIT performing multiple checks back to OK
15.
15 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Other Items Alerts Log (AMBARI-10249) • Alert state changes are written to /var/log/ambari-server/ambari-alerts.log Script-based Alert Notifications (AMBARI-9919) • Define a custom script-based notification dispatcher • Executed on alert state changes 2015-07-13 14:58:03,744 [OK] [ZOOKEEPER] [zookeeper_server_process] (ZooKeeper Server Process) TCP OK - 0.000s response on port 2181 2015-07-13 14:58:03,768 [OK] [HDFS] [datanode_process_percent] (Percent DataNodes Available) affected: [0], total: [1]
16.
16 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Ambari Alerting System 1. User creates or modifies cluster 2. Ambari reads alert definitions from Stack 3. Ambari sends alert definitions to Agents and Agent schedules instance checks 4. Agents reports alert instance status in the heartbeat 5. Ambari responds to alert instance status changes and dispatches notifications (if applicable) Ambari Server 1 2 4 Stack definition alerts.json 5 Ambari Agent(s) 3 email snmp
17.
17 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Alert REST APIs REST Endpoint Description /api/v1/clusters/:clusterName/alert_definitions The list of alert definitions for the cluster. /api/v1/clusters/:clusterName/alerts The list of alert instances for the cluster. Use partial response syntax to filter. Example: find all alert instances that are CRITITAL /api/v1/clusters/c1/alerts?Alert/state.in(CRITICAL) Example: find all alert instances for “ZooKeeper Process” alert def /api/v1/clusters/c1/alerts?Alert/definition_name=zookeeper_server_pr ocess /api/v1/clusters/:clusterName/alert_groups The list of alert groups. /api/v1/clusters/:clusterName/alert_history The list of alert instance status changes. /api/v1/alert_targets/ The list of configured alert notification targets for Ambari.
18.
18 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Ambari Metrics
19.
19 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Ambari Metrics Built using Hadoop technologies Three components: Metrics Collector, Metrics Monitors, Grafana Local Filesystem or HDFS HBase ATS Phoenix
20.
20 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Metrics Collection 1. Metric Monitors send system-level metrics to Collector 2. Sinks send Hadoop-level metrics to Collector 3. Metrics Collector service stores and aggregates metrics 4. Ambari exposes REST API for metrics retrieval Ambari Server Metrics Monitor Metrics Collector Host1 Sink(s) 3 Metrics Monitor Host1 Sink(s)Metrics Monitor Hosts Sink(s) 1 2 4
21.
21 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Ambari Metrics + Grafana: Introduced with Ambari 2.2 Including Grafana as a “Native UI” for Ambari Metrics Including pre-build Dashboards Supports configuring for HTTPS System Home, Servers HDFS Home, NameNodes, DataNodes YARN Home, Applications, Job History Server HBase Home, Performance, Misc Highlights List of Dashboards
22.
22 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Grafana includes pre-built dashboards for visualizing the most important cluster metrics.
23.
23 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Ambari Blueprints
24.
24 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Ambari Blueprints Two primary goals of Ambari Blueprints: • Provide API-driven deployments based on self-contained cluster description • Ability to export a complete cluster description of a running cluster Blueprints contain cluster topology and configuration information Enables interesting use cases between physical and virtual environments
25.
25 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Ambari Stacks + Blueprints Together Stack Definition Component Layout & Configuration BLUEPRINT BLUEPRINT INSTANTIATE CLUSTERHOSTS
26.
26 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Blueprints API BLUEPRINT POST /blueprints/my-blueprint POST /clusters/MyCluster 1 2 CLUSTER CREATION TEMPLATE
27.
27 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Example: Single-Node Cluster { "configurations" : [ { ”hdfs-site" : { "dfs.namenode.name.dir" : ”/hadoop/nn" } } ], "host_groups" : [ { "name" : ”uber-host", "components" : [ { "name" : "NAMENODE” }, { "name" : "SECONDARY_NAMENODE” }, { "name" : "DATANODE” }, { "name" : "HDFS_CLIENT” }, { "name" : "RESOURCEMANAGER” }, { "name" : "NODEMANAGER” }, { "name" : "YARN_CLIENT” }, { "name" : "HISTORYSERVER” }, { "name" : "MAPREDUCE2_CLIENT” } ], "cardinality" : "1" } ], "Blueprints" : { "blueprint_name" : "single-node-hdfs-yarn", "stack_name" : "HDP", "stack_version" : "2.2" } } { "blueprint" : "single-node-hdfs-yarn", "host_groups" :[ { "name" : ”uber-host", "hosts" : [ { "fqdn" : "c6401.ambari.apache.org” } ] } ] } BLUEPRINT CLUSTER CREATION TEMPLATE Description • Single-node cluster • Use HDP 2.2 Stack • HDFS + YARN + MR2 • Everything on c6401
28.
28 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Blueprints Add Host • Add hosts to a cluster based on a host group from a Blueprint • Add one or more hosts with a single call POST /api/v1/clusters/MyCluster/hosts { "blueprint" : "myblueprint", "host_group" : "workers", "host_name" : "c6403.ambari.apache.org" } POST /api/v1/clusters/MyCluster/hosts [ { "blueprint" : "myblueprint", "host_group" : "workers", "host_name" : "c6403.ambari.apache.org" }, { "blueprint" : "myblueprint", "host_group" : ”edge", "host_name" : "c6404.ambari.apache.org" } ] https://issues.apache.org/jira/browse/AMBARI-8458
29.
29 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Blueprints Host Discovery (AMBARI-10750) Ambari POST /api/v1/clusters/MyCluster/hosts [ { "blueprint" : "single-node-hdfs-test2", "host_groups" :[ { "host_group" : "slave", "host_count" : 3, "host_predicate" : "Hosts/cpu_count>1” } ] } ]
30.
30 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Where Can I Learn More About Blueprints? https://cwiki.apache.org/confluence/display/AMBARI/Blueprints
31.
31 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Kerberos Setup
32.
32 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Background: Hadoop + Kerberos Strongly authenticating and establishing a user’s identity is the basis for secure access in Hadoop. Users need to be able to reliably “identify” themselves and then have that identity propagated throughout the Hadoop cluster. Once this is done, those users can access resources (such as files or directories) or interact with the cluster (like running MapReduce jobs). Besides users, Hadoop cluster resources themselves (such as Hosts and Services) need to authenticate with each other to avoid potential malicious systems or daemon’s “posing as” trusted components of the cluster to gain access to data.
33.
33 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Background: Hadoop + Kerberos Service Component A Service Component B Hadoop Cluster KDC keytabkeytab Service Component C keytab Service Component D keytab Service Component X Service Component X keytabkeytab Service Component X keytab Service Component X keytab Kerberos is used to secure the Components in the cluster. Kerberos identities are managed via “keytabs” on the Component hosts. Principals for the cluster are managed in the KDC.
34.
34 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Automated Kerberos Security Setup Wizard Driven Simplify the experience of enabling and managing Kerberos security Automated and Manual Options Critical for today’s enterprise Works with Existing Kerberos Infrastructure Such as Active Directory and MIT KDC
35.
35 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Automated vs. Manual Kerberos Options Automated Manual KDC Infrastructure MIT, Active Directory MIT, Active Directory, FreeIPA Requires KDC administrative credentials Yes No Installation of Kerberos clients Yes, optional No Management of Kerberos client krb5.conf Yes, optional No Creation of principals Yes No Creation of keytabs Yes No Distribution of keytabs Yes No Cluster configuration Yes Yes
36.
36 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Automated: Principals and Keytabs 1. User provides KDC Admin Account credentials to Ambari 2. Ambari connects to KDC, creates principals (Service and Ambari) needed for cluster 3. Ambari generates keytabs for the principals 4. Ambari distributes keytabs to Ambari Server and cluster hosts 5. Ambari discards the KDC Admin Account credentials Ambari Server KDC 1 2 4 3 5 Cluster
37.
37 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Automated: Customizable Principal Attributes • Customize the directory principal attributes for your environment • Particularly useful when using Active Directory for Kerberos
38.
38 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Automated: Kerberos Clients • Option to manage krb5.conf • Option to install clients OS Client RHEL/CentOS/OEL krb5-workstation SLES 11 krb5-client Ubuntu 12 krb5-user, krb5- config
39.
39 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Automated: Kerberos Operations Once enabled, Ambari works directly with the Kerberos infrastructure to automate these common tasks, removing the burden from the operator: • Add/Delete Host • Add Service • Add/Delete Component • Regenerate Keytabs • Disable Kerberos
40.
40 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Manual: Specify Realm, Client Utilities Path
41.
41 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Manual: Principals and Keytabs Configure Identities Download CSV
42.
42 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Role-Based Access Control
43.
43 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Role-Based Access Control Use “roles” for more granular division of control for cluster operations Old Permission New Role Notable Permissions Operator Cluster Administrator Full operational control, including upgrades. Ambari Admins are implicitly granted this Role. Cluster Operator Adding and removing hosts. Service Administrator Manage configurations, move components. Service Operator Service stop and start and service-specific operations such as HDFS Rebalance. Read-Only Cluster User View cluster service and host information. Note: Users flagged as “Ambari Admins” are implicitly granted Cluster Administrator permission.
44.
44 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Managing Cluster Roles Assign roles to users or groups Manage roles in Block or List View layouts
45.
45 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Managing Cluster Roles View users or groups Change current role assignment
46.
46 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Log Search TECH PREVIEW
47.
47 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Log Search Solr A M B A R I Log Search Search cluster Component Logs from within Ambari! Goal: When issues arise, be able to quickly find issues across all cluster components ⬢ Capabilities – Rapid Search of all cluster component logs – Search across time ranges, log levels, and for keywords ⬢ Core Technologies: – Apache Ambari – Apache Solr – Apache Ambari Log Search
48.
48 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Log Search Architecture A M B A R I L O G F E E D E R L O G F E E D E R L O G F E E D E R L O G F E E D E R L O G F E E D E R L O G F E E D E R WO R K E R N O D E WO R K E R N O D E WO R K E R N O D E WO R K E R N O D E WO R K E R N O D E WO R K E R N O D E Solr LO G S E A R C H U I
49.
49 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Log Search Details WO R K E R N O D E L O G F E E D E R Solr LO G S E A R C H U I Solr Solr A M B A R I Java Process Multi-output Support Grok Solr Cloud Local Disk Storage TTL
50.
50 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Automated Cluster Upgrade
51.
51 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Automated Cluster Upgrade Terminology Rolling Upgrade Orchestrates the cluster upgrade in an order that is meant to preserve cluster operation and minimize service impact. The tradeoff is more stringent prerequisites and a longer upgrade time. Express Upgrade Orchestrates the cluster upgrade in an order that will incur cluster downtime. This method has less stringent prerequisites but completes in a faster upgrade time.
52.
52 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Automated Upgrade: Rolling or Express Choice Check Prerequisites Prepare Register + Install Perform Upgrade Perform the upgrade. The steps depend on upgrade method: Rolling or Express. Finalize Finalize the upgrade, making the target version the current version. Perform the preparation steps, which include making backups of critical cluster metadata. Review the prerequisites to confirm your cluster configuration is ready for upgrade Register the software repository and install the target version on the cluster.
53.
53 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Automated Upgrade Choice: Rolling or Express
54.
54 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Automated Upgrade: High-Level Process Register Install Perform Upgrade Finalize
55.
55 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Register New Version • Register new version with Ambari • Provide the Repository Base URLs for new version Register Install Perform Upgrade Finalize
56.
56 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Install Packages Click “Install Packages” to start the install of the version across hosts Register Install Perform Upgrade Finalize
57.
57 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Upgrade Choice Upgrade Options dialog gives you a choice of method: Rolling or Express Register Install Perform Upgrade Finalize
58.
58 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Upgrade Choice: Rolling or Express Checks indicate if an option is available Register Install Perform Upgrade Finalize
59.
59 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Upgrade Choice: Rolling or Express New options to handle failures Register Install Perform Upgrade Finalize
60.
60 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Upgrade Tolerance Options Tolerance Option Description Skip all Service Check failures Ambari will automatically skip any Service Check failures and complete the task without requiring user intervention to continue. After all the Service Checks have run in a task, you will be presented with summary of the failures and an option to continue the upgrade or pause. Skip all Slave Component failures Ambari will automatically skip any Slave Component failures and complete the task of upgrading Slave components without requiring user intervention to continue. After all Slave Components have been upgraded, you will be presented with a summary of the failures and an option to continue the upgrade or pause. Register Install Perform Upgrade Finalize
61.
61 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Wizard Driven Experience With verification and validation Register Install Perform Upgrade Finalize
62.
62 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Rolling Upgrade – Success! Register Install Perform Upgrade Finalize
63.
63 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Ambari Extensibility
64.
64 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Extensibility Features • To add new Services (ISV or otherwise) beyond Stack • To customize a Stack for customer specific environments • To extend and customize the Ambari Web UI • Add new capabilities, customize existing capabilities Stacks Views
65.
65 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Anatomy of Ambari Extension Points Ambari Server Ambari AgentAmbari AgentAmbari Agent Ambari Web Stacks Stacks Stacks javajs python Ambari Views Ambari Stacks
66.
66 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Ambari Stacks
67.
67 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Ambari Stacks Defines a consistent Stack lifecycle interface that can be extended Encapsulates Stack Versions, Services, Components, Dependencies, Cardinality, Configurations, Commands Dynamically add Stack + Service definitions AMBARI {rest} <ambari-web> Stacks HDFS YARN MR2 Hive Pig OozieHBase StormFalcon
68.
68 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Stack Terminology Term Definition Examples STACK Defines a set of Services, where to obtain the software packages and how to manage the lifecycle. HDP-2.4, HDP-2.5 SERVICE Defines the Components that make-up the Service. HDFS, YARN, HIVE, SPARK COMPONENT The building-blocks of a Service, that adhere to a certain lifecycle. NAMENODE, DATANODE, OOZIE_SERVER CATEGORY The category of Component. MASTER, SLAVE, CLIENT
69.
69 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Stack Mechanics Stacks define Services + Repos – What is in the Stack, and where to get the bits Each Service has a definition – What Components are part of the Service Each Service has defined lifecycle commands – start, stop, status, install, configure Lifecycle is controlled via command scripts Ability to define “custom” commands AMBARI SERVER Stack Command Scripts Service Definitions AMBARI AGENT/S AMBARI AGENT/S AMBARI AGENT/S pythonxml Repos
70.
70 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Stacks Support Inheritance HDP 2.0 Stack HDP 2.4 Stack • Defines a set of Service definitions • Default service configurations and command scripts • Overrides any Service definitions, commands and configurations • Adds new Services specific to this Stack
71.
71 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Where Can I Learn More About Stacks? https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=38571133 https://github.com/apache/ambari/tree/trunk/ambari- server/src/main/resources/stacks/HDP/
72.
72 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Guided Configs
73.
73 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Guided Configurations Take the guesswork out of cluster configuration Intuitive layout and grouping of configurations Smart UI controls to make it easier to set values Recommendations and cross-service dependency checks Take the guesswork out of cluster configuration Driven by Stack definition
74.
74 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Layout and Grouping
75.
75 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved UI Controls Recommended Bounds Recommended Value Set Recommended Escape Hatch
76.
76 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Control “Escape Hatch”
77.
77 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Dependency Checking
78.
78 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Driven By Stack Definition: Themes
79.
79 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Tabs Tab1 Tab2
80.
80 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Sections Section1 Section2
81.
81 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved SubSections SubSection1 SubSection2 SubSection1
82.
82 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved UI Controls and Placement Control + Placement Control + Placement Control + Placement Control + Placement Control + Placement
83.
83 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Ambari Views
84.
84 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Ambari Views Framework Developers can extend the Ambari Web interface • Views expose custom UI features for Hadoop Services Ambari Admins can entitle Views to Ambari Web users • Entitlements framework for controlling access to Views
85.
85 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Views Framework Views Framework vs. Views Views Core to Ambari Built by Hortonworks, Community, Partners
86.
86 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Views Framework Views Framework vs. Views Views Core to Ambari Built by Hortonworks, Community, Partners
87.
87 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Example Views Capacity Scheduler “Queue Manager” View Tez “Jobs” View
88.
88 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved View Components Serve client-side assets (such as HTML + JavaScript) Expose server-side resources (such as REST endpoints) VIEW Client-side assets (.js, html) AMBARI WEB VIEW Server-side resources (java) AMBARI SERVER {rest} Hadoop and other systems
89.
89 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved View Delivery 1. Develop the View (just like you would for a Web App) 2. Package as a View (basically a WAR) 3. Deploy the View into Ambari 4. Ambari Admins create + configuration view instance(s) and give access to users + groups Develop DeployPackage Create Instance(s )
90.
90 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Versions and Instances Deploy multiple versions and create multiple instances of a view Manage accessibility and usage
91.
91 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Choice of Deployment Model For Hadoop Operators: – Deploy Views in an Ambari Server that is managing a Hadoop cluster For Data Workers: – Run Views in a “standalone” Ambari Server Ambari Server HADOOP Store & Process Ambari Server Operators manage the cluster, may have Views deployed Data Workers use the cluster and use a “standalone ” Ambari Server for Views
92.
92 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Where Can I Learn More about Views? https://cwiki.apache.org/confluence/display/AMBARI/Views https://github.com/apache/ambari/blob/trunk/ambari-views/docs/index.md https://github.com/apache/ambari/tree/trunk/ambari-views/examples https://github.com/apache/ambari/tree/trunk/contrib/views
93.
93 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved What’s New and Next
94.
94 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved What’s New in Ambari 2.4 Alerts: Retry tolerance (AMBARI-15686) Alerts: Customizable SCRIPT Parameters (AMBARI-14898) Alerts: New HDFS Alerts (AMBARI-14800) New Host Page Filtering (AMBARI-15210) Remove Service (AMBARI-14759) Support for SLES 12 Technical Preview (AMBARI-16007) Stability: Database Consistency Checking (AMBARI-16258) Customizable Ambari Log + PID Dirs (AMBARI-15300) New Version Registration Experience (AMBARI-15724) Log Search Technical Preview (AMBARI-14927) Operational Audit Logging (AMBARI-15241) Role-Based Access Control (AMBARI-13977) Automated Setup of Ambari Kerberos (AMBARI-15561) Automated Setup of Ambari Proxy User (AMBARI-15561) Customizable Host Reg. SSH Port (AMBARI-13450) Core Features Security Features View URLs (AMBARI-15821), View Refresh (AMBARI-15682) Inherit Cluster Permissions (AMBARI-16177) Remote Cluster Registration (AMBARI-16274) Views Framework Features
95.
95 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved What’s Next Log Search GA (AMBARI-14927) Service and Component “auto-start” (AMBARI-2330) Ambari Server HA (Active-Passive + Load Balancer) (AMBARI-17126) Multi-service instances & versions (AMBARI-14714)
96.
96 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Learn More About Apache Ambari Resource Location Apache Ambari Project Page http://ambari.apache.org Ambari Project Wiki https://cwiki.apache.org/confluence/display/AMBARI Ambari Project JIRA https://issues.apache.org/jira/browse/AMBARI Stacks https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=38571133 Blueprints https://cwiki.apache.org/confluence/display/AMBARI/Blueprints Views https://cwiki.apache.org/confluence/display/AMBARI/Views
97.
97 © Hortonworks
Inc. 2011 – 2016. All Rights Reserved Thank You
Notes de l'éditeur
Dynamic availablity
Télécharger maintenant