SlideShare une entreprise Scribd logo
1  sur  6
Télécharger pour lire hors ligne
Lead Online Training www.leadonlinetraining.com
Email:contact@leadonlinetraining.com Ph.No: +91-9949566322, +1-347-606-2716
www.Lead Online Training.com Email Us: contact@leadonlinetraining.com
Contact US: India- +91-9949566322, USA-+1-347-606-2716
Hadoop Online Training by Real Time and certified faculty:
Hadoop Online Training Course Content:
Basics of Hadoop:
 Motivation for Hadoop
 Large scale system training
 Survey of data storage literature
 Literature survey of data processing
 Networking constraints
 New approach requirements
Basic concepts of Hadoop
 What is Hadoop?
 Distributed file system of Hadoop
 Map reduction of Hadoop works
 Hadoop cluster and its anatomy
 Hadoop demons
 Master demons
 Name node
 Tracking of job
 Secondary node detection
 Slave daemons
 Tracking of task
 HDFS(Hadoop Distributed File System)
 Spilts and blocks
 Input Spilts
 HDFS spilts
 Replication of data
 Awareness of Hadoop racking
 High availably of data
 Block placement and cluster architecture
 CASE STUDIES
 Practices & Tuning of performances
Lead Online Training www.leadonlinetraining.com
Email:contact@leadonlinetraining.com Ph.No: +91-9949566322, +1-347-606-2716
www.Lead Online Training.com Email Us: contact@leadonlinetraining.com
Contact US: India- +91-9949566322, USA-+1-347-606-2716
 Development of mass reduce programs
 Local mode
 Running without HDFS
 Pseudo-distributed mode
 All daemons running in a single mode
 Fully distributed mode
 Dedicated nodes and daemon running
Hadoop administration
 Setup of Hadoop cluster of Cloud era, Apache, Green plum, Horton works
 On a single desktop, make a full cluster of a Hadoop setup.
 Configure and Install Apache Hadoop on a multi node cluster.
 In a distributed mode, configure and install Cloud era distribution.
 In a fully distributed mode, configure and install Hortom works distribution
 In a fully distributed mode, configure the Green Plum distribution.
 Monitor the cluster
 Get used to the management console of Horton works and Cloud era.
 Name the node in a safe mode
 Data backup.
 Case studies
 Monitoring of clusters
Hadoop Development :
 Writing a MapReduce Program
 Sample the mapreduce program.
 API concepts and their basics
 Driver code
 Mapper
 Reducer
 Hadoop AVI streaming
 Performing several Hadoop jobs
 Configuring close methods
 Sequencing of files
 Record reading
Lead Online Training www.leadonlinetraining.com
Email:contact@leadonlinetraining.com Ph.No: +91-9949566322, +1-347-606-2716
www.Lead Online Training.com Email Us: contact@leadonlinetraining.com
Contact US: India- +91-9949566322, USA-+1-347-606-2716
 Record writer
 Reporter and its role
 Counters
 Output collection
 Assessing HDFS
 Tool runner
 Use of distributed CACHE
 Several MapReduce jobs (In Detailed)
 1.MOST EFFECTIVE SEARCH USING MAPREDUCE
 2.GENERATING THE RECOMMENDATIONS USING MAPREDUCE
 3.PROCESSING THE LOG FILES USING MAPREDUCE
 Identification of mapper
 Identification of reducer
 Exploring the problems using this application
 Debugging the MapReduce Programs
 MR unit testing
 Logging
 Debugging strategies
 Advanced MapReduce Programming
 Secondary sort
 Output and input format customization
 Mapreduce joins
 Monitoring & debugging on a Production Cluster
 Counters
 Skipping Bad Records
 Running the local mode
 MapReduce performance tuning
 Reduction network traffic by combiner
 Partitioners
 Reducing of input data
 Using Compression
 Reusing the JVM
Lead Online Training www.leadonlinetraining.com
Email:contact@leadonlinetraining.com Ph.No: +91-9949566322, +1-347-606-2716
www.Lead Online Training.com Email Us: contact@leadonlinetraining.com
Contact US: India- +91-9949566322, USA-+1-347-606-2716
 Running speculative execution
 Performance Aspects
 CASE STUDIES
CDH4 Enhancements :
1. Name Node – Availability
2. Name Node federation
3. Fencing
4. MapReduce – 2
HADOOP ANALYST
1.Concepts of Hive
2. Hive and its architecture
3. Install and configure hive on cluster
4. Type of tables in hive
5. Functions of Hive library
6. Buckets
7. Partitions
8. Joins
1. Inner joins
2. Outer Joins
9. Hive UDF
PIG
1.Pig basics
2. Install and configure PIG
3. Functions of PIG Library
4. Pig Vs Hive
5. Writing of sample Pig Latin scripts
6. Modes of running
1. Grunt shell
2. Java program
7. PIG UDFs
8. Macros of Pig
9. Debugging the PIG
Lead Online Training www.leadonlinetraining.com
Email:contact@leadonlinetraining.com Ph.No: +91-9949566322, +1-347-606-2716
www.Lead Online Training.com Email Us: contact@leadonlinetraining.com
Contact US: India- +91-9949566322, USA-+1-347-606-2716
IMPALA
1. Difference between Pig and Impala Hive
2. Does Impala give good performance?
3. Exclusive features
4. Impala and its Challenges
5. Use cases
NOSQL
1. HBase
2. HBase concepts
3. HBase architecture
4. Basics of HBase
5. Server architecture
6. File storage architecture
7. Column access
8. Scans
9. HBase cases
10. Installation and configuration of HBase on a multi node
11. Create database, Develop and run sample applications
12. Access data stored in HBase using clients like Python, Java and Pearl
13. Map Reduce client
14. HBase and Hive Integration
15. HBase administration tasks
16. Defining Schema and its basic operations.
17. Cassandra Basics
18. MongoDB Basics
Ecosystem Components
1. Sqoop
2. Configure and Install Sqoop
3. Connecting RDBMS
4. Installation of Mysql
5. Importing the data from Oracle/Mysql to hive
6. Exporting the data to Oracle/Mysql
Lead Online Training www.leadonlinetraining.com
Email:contact@leadonlinetraining.com Ph.No: +91-9949566322, +1-347-606-2716
www.Lead Online Training.com Email Us: contact@leadonlinetraining.com
Contact US: India- +91-9949566322, USA-+1-347-606-2716
7. Internal mechanism
Oozie
1. Oozie and its architecture
2. XML file
3. Install and configuring Apache
4. Specifying the Work flow
5. Action nodes
6. Control nodes
7. Job coordinator
Avro, Scribe, Flume, Chukwa, Thrift
1. Concepts of Flume and Chukwa
2. Use cases of Scribe, Thrift and Avro
3. Installation and configuration of flume
4. Creation of a sample application

Contenu connexe

Dernier

The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
heathfieldcps1
 

Dernier (20)

How to Add New Custom Addons Path in Odoo 17
How to Add New Custom Addons Path in Odoo 17How to Add New Custom Addons Path in Odoo 17
How to Add New Custom Addons Path in Odoo 17
 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
 
Sociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning ExhibitSociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning Exhibit
 
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
 
Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdf
 
Kodo Millet PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
Kodo Millet  PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...Kodo Millet  PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
Kodo Millet PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
 
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
 
Single or Multiple melodic lines structure
Single or Multiple melodic lines structureSingle or Multiple melodic lines structure
Single or Multiple melodic lines structure
 
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
 
On National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan FellowsOn National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan Fellows
 
Exploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptx
Exploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptxExploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptx
Exploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptx
 
The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
 
ICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptx
 
On_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptx
On_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptxOn_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptx
On_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptx
 
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
 
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdfUnit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdf
 
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdfUGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
 
Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)
 
Fostering Friendships - Enhancing Social Bonds in the Classroom
Fostering Friendships - Enhancing Social Bonds  in the ClassroomFostering Friendships - Enhancing Social Bonds  in the Classroom
Fostering Friendships - Enhancing Social Bonds in the Classroom
 
FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024
 

En vedette

Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
Kurio // The Social Media Age(ncy)
 
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them wellGood Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
Saba Software
 

En vedette (20)

Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search Intent
 
How to have difficult conversations
How to have difficult conversations How to have difficult conversations
How to have difficult conversations
 
Introduction to Data Science
Introduction to Data ScienceIntroduction to Data Science
Introduction to Data Science
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best Practices
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project management
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
 
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
 
12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work
 
ChatGPT webinar slides
ChatGPT webinar slidesChatGPT webinar slides
ChatGPT webinar slides
 
More than Just Lines on a Map: Best Practices for U.S Bike Routes
More than Just Lines on a Map: Best Practices for U.S Bike RoutesMore than Just Lines on a Map: Best Practices for U.S Bike Routes
More than Just Lines on a Map: Best Practices for U.S Bike Routes
 
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
 
Barbie - Brand Strategy Presentation
Barbie - Brand Strategy PresentationBarbie - Brand Strategy Presentation
Barbie - Brand Strategy Presentation
 
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them wellGood Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
 

Hadoop Online Training Course Content

  • 1. Lead Online Training www.leadonlinetraining.com Email:contact@leadonlinetraining.com Ph.No: +91-9949566322, +1-347-606-2716 www.Lead Online Training.com Email Us: contact@leadonlinetraining.com Contact US: India- +91-9949566322, USA-+1-347-606-2716 Hadoop Online Training by Real Time and certified faculty: Hadoop Online Training Course Content: Basics of Hadoop:  Motivation for Hadoop  Large scale system training  Survey of data storage literature  Literature survey of data processing  Networking constraints  New approach requirements Basic concepts of Hadoop  What is Hadoop?  Distributed file system of Hadoop  Map reduction of Hadoop works  Hadoop cluster and its anatomy  Hadoop demons  Master demons  Name node  Tracking of job  Secondary node detection  Slave daemons  Tracking of task  HDFS(Hadoop Distributed File System)  Spilts and blocks  Input Spilts  HDFS spilts  Replication of data  Awareness of Hadoop racking  High availably of data  Block placement and cluster architecture  CASE STUDIES  Practices & Tuning of performances
  • 2. Lead Online Training www.leadonlinetraining.com Email:contact@leadonlinetraining.com Ph.No: +91-9949566322, +1-347-606-2716 www.Lead Online Training.com Email Us: contact@leadonlinetraining.com Contact US: India- +91-9949566322, USA-+1-347-606-2716  Development of mass reduce programs  Local mode  Running without HDFS  Pseudo-distributed mode  All daemons running in a single mode  Fully distributed mode  Dedicated nodes and daemon running Hadoop administration  Setup of Hadoop cluster of Cloud era, Apache, Green plum, Horton works  On a single desktop, make a full cluster of a Hadoop setup.  Configure and Install Apache Hadoop on a multi node cluster.  In a distributed mode, configure and install Cloud era distribution.  In a fully distributed mode, configure and install Hortom works distribution  In a fully distributed mode, configure the Green Plum distribution.  Monitor the cluster  Get used to the management console of Horton works and Cloud era.  Name the node in a safe mode  Data backup.  Case studies  Monitoring of clusters Hadoop Development :  Writing a MapReduce Program  Sample the mapreduce program.  API concepts and their basics  Driver code  Mapper  Reducer  Hadoop AVI streaming  Performing several Hadoop jobs  Configuring close methods  Sequencing of files  Record reading
  • 3. Lead Online Training www.leadonlinetraining.com Email:contact@leadonlinetraining.com Ph.No: +91-9949566322, +1-347-606-2716 www.Lead Online Training.com Email Us: contact@leadonlinetraining.com Contact US: India- +91-9949566322, USA-+1-347-606-2716  Record writer  Reporter and its role  Counters  Output collection  Assessing HDFS  Tool runner  Use of distributed CACHE  Several MapReduce jobs (In Detailed)  1.MOST EFFECTIVE SEARCH USING MAPREDUCE  2.GENERATING THE RECOMMENDATIONS USING MAPREDUCE  3.PROCESSING THE LOG FILES USING MAPREDUCE  Identification of mapper  Identification of reducer  Exploring the problems using this application  Debugging the MapReduce Programs  MR unit testing  Logging  Debugging strategies  Advanced MapReduce Programming  Secondary sort  Output and input format customization  Mapreduce joins  Monitoring & debugging on a Production Cluster  Counters  Skipping Bad Records  Running the local mode  MapReduce performance tuning  Reduction network traffic by combiner  Partitioners  Reducing of input data  Using Compression  Reusing the JVM
  • 4. Lead Online Training www.leadonlinetraining.com Email:contact@leadonlinetraining.com Ph.No: +91-9949566322, +1-347-606-2716 www.Lead Online Training.com Email Us: contact@leadonlinetraining.com Contact US: India- +91-9949566322, USA-+1-347-606-2716  Running speculative execution  Performance Aspects  CASE STUDIES CDH4 Enhancements : 1. Name Node – Availability 2. Name Node federation 3. Fencing 4. MapReduce – 2 HADOOP ANALYST 1.Concepts of Hive 2. Hive and its architecture 3. Install and configure hive on cluster 4. Type of tables in hive 5. Functions of Hive library 6. Buckets 7. Partitions 8. Joins 1. Inner joins 2. Outer Joins 9. Hive UDF PIG 1.Pig basics 2. Install and configure PIG 3. Functions of PIG Library 4. Pig Vs Hive 5. Writing of sample Pig Latin scripts 6. Modes of running 1. Grunt shell 2. Java program 7. PIG UDFs 8. Macros of Pig 9. Debugging the PIG
  • 5. Lead Online Training www.leadonlinetraining.com Email:contact@leadonlinetraining.com Ph.No: +91-9949566322, +1-347-606-2716 www.Lead Online Training.com Email Us: contact@leadonlinetraining.com Contact US: India- +91-9949566322, USA-+1-347-606-2716 IMPALA 1. Difference between Pig and Impala Hive 2. Does Impala give good performance? 3. Exclusive features 4. Impala and its Challenges 5. Use cases NOSQL 1. HBase 2. HBase concepts 3. HBase architecture 4. Basics of HBase 5. Server architecture 6. File storage architecture 7. Column access 8. Scans 9. HBase cases 10. Installation and configuration of HBase on a multi node 11. Create database, Develop and run sample applications 12. Access data stored in HBase using clients like Python, Java and Pearl 13. Map Reduce client 14. HBase and Hive Integration 15. HBase administration tasks 16. Defining Schema and its basic operations. 17. Cassandra Basics 18. MongoDB Basics Ecosystem Components 1. Sqoop 2. Configure and Install Sqoop 3. Connecting RDBMS 4. Installation of Mysql 5. Importing the data from Oracle/Mysql to hive 6. Exporting the data to Oracle/Mysql
  • 6. Lead Online Training www.leadonlinetraining.com Email:contact@leadonlinetraining.com Ph.No: +91-9949566322, +1-347-606-2716 www.Lead Online Training.com Email Us: contact@leadonlinetraining.com Contact US: India- +91-9949566322, USA-+1-347-606-2716 7. Internal mechanism Oozie 1. Oozie and its architecture 2. XML file 3. Install and configuring Apache 4. Specifying the Work flow 5. Action nodes 6. Control nodes 7. Job coordinator Avro, Scribe, Flume, Chukwa, Thrift 1. Concepts of Flume and Chukwa 2. Use cases of Scribe, Thrift and Avro 3. Installation and configuration of flume 4. Creation of a sample application