SlideShare une entreprise Scribd logo
1  sur  12
Télécharger pour lire hors ligne
INTRODUCTION TO
HADOOP
Presented by
Quang Nguyen & Hoang Le
CONTENT
• Introduction to Hadoop
• Scalability on AWS / Azure
• Reality
• First 100-hour Award
• Second 100-hour Overview
• Career Path
• Q & A
INTRODUCTION TO HADOOP
SCALABILITY ON AWS / AZURE
DISTRIBUTED SYSTEMS
MPI vs Hadoop
DRIVERIGHT PROJECT
• Target: collect driving experience by mobile application for
analyzing driving habits
• Purposes:
• Improve driving ability
• Supply driver’s information to
needed companies
• Market: China
• Scale-out Problem:
• Millions of users with rich data resources (records in
milliseconds)
• MySQL database is not efficient for Big Data Analytics
R - Python
Tableau
Mobile Apps
Mobile Platform
DRIVE-RIGHT
ARCHITECTURE
REALITY
FIRST 100-HOUR AWARD
SECOND 100-HOUR OVERVIEW
#101 – Java & IntelliJ setup
#102 – Java programming
part 1
#103 – Java programming
part 2
#104 – Java programming
part 3
#105 – Java programming
part 4
#106 – Single-node Hadoop
#107 – Multi-node Hadoop
#108 – Map Reduce basis
#109 – Intro to Map Reduce
programming
#110 – Map Reduce Design
Pattern part 1
#111 – Map Reduce Design
Pattern part 2
#112 – Apache Mahout 1 – Setting
Up
#113 – Apache Mahout 2 –
Building Recommenders
#114 – Apache Mahout 3 –
Building Clustering Systems
#115 – Final Project II
PLAN FOR THE YEAR
Internship
Program
Club
Sponsorship
Capable & young
data scientists
$$$
Effort
Smart
students
Q & A

Contenu connexe

En vedette

Big data internship plan at Contemi Vietnam
Big data internship plan at Contemi VietnamBig data internship plan at Contemi Vietnam
Big data internship plan at Contemi VietnamQuang Nguyen
 
Big Data Internship Program @Natural Science University
Big Data Internship Program @Natural Science UniversityBig Data Internship Program @Natural Science University
Big Data Internship Program @Natural Science UniversityQuang Nguyen
 
Intro To Hadoop
Intro To HadoopIntro To Hadoop
Intro To HadoopAl Chin
 
Intro to Apache Hadoop
Intro to Apache HadoopIntro to Apache Hadoop
Intro to Apache HadoopSufi Nawaz
 
Hồ sơ mời tài trợ - ĐI MÔ FC
Hồ sơ mời tài trợ - ĐI MÔ FCHồ sơ mời tài trợ - ĐI MÔ FC
Hồ sơ mời tài trợ - ĐI MÔ FCQuang Nguyen
 
Keep the eyes beyond competition
Keep the eyes beyond competitionKeep the eyes beyond competition
Keep the eyes beyond competitionQuang Nguyen
 
An Introduction to Hadoop and Cloudera: Nashville Cloudera User Group, 10/23/14
An Introduction to Hadoop and Cloudera: Nashville Cloudera User Group, 10/23/14An Introduction to Hadoop and Cloudera: Nashville Cloudera User Group, 10/23/14
An Introduction to Hadoop and Cloudera: Nashville Cloudera User Group, 10/23/14iwrigley
 
Hadoop & Cloudera Workshop
Hadoop & Cloudera WorkshopHadoop & Cloudera Workshop
Hadoop & Cloudera WorkshopSerkan Sakınmaz
 
Introduction to Hadoop and Cloudera, Louisville BI & Big Data Analytics Meetup
Introduction to Hadoop and Cloudera, Louisville BI & Big Data Analytics MeetupIntroduction to Hadoop and Cloudera, Louisville BI & Big Data Analytics Meetup
Introduction to Hadoop and Cloudera, Louisville BI & Big Data Analytics Meetupiwrigley
 

En vedette (13)

Big data internship plan at Contemi Vietnam
Big data internship plan at Contemi VietnamBig data internship plan at Contemi Vietnam
Big data internship plan at Contemi Vietnam
 
Intro to Big Data
Intro to Big DataIntro to Big Data
Intro to Big Data
 
Europe
EuropeEurope
Europe
 
Big Data Internship Program @Natural Science University
Big Data Internship Program @Natural Science UniversityBig Data Internship Program @Natural Science University
Big Data Internship Program @Natural Science University
 
Intro To Hadoop
Intro To HadoopIntro To Hadoop
Intro To Hadoop
 
Intro to Hadoop
Intro to HadoopIntro to Hadoop
Intro to Hadoop
 
Intro to Apache Hadoop
Intro to Apache HadoopIntro to Apache Hadoop
Intro to Apache Hadoop
 
Hồ sơ mời tài trợ - ĐI MÔ FC
Hồ sơ mời tài trợ - ĐI MÔ FCHồ sơ mời tài trợ - ĐI MÔ FC
Hồ sơ mời tài trợ - ĐI MÔ FC
 
Keep the eyes beyond competition
Keep the eyes beyond competitionKeep the eyes beyond competition
Keep the eyes beyond competition
 
An Introduction to Hadoop and Cloudera: Nashville Cloudera User Group, 10/23/14
An Introduction to Hadoop and Cloudera: Nashville Cloudera User Group, 10/23/14An Introduction to Hadoop and Cloudera: Nashville Cloudera User Group, 10/23/14
An Introduction to Hadoop and Cloudera: Nashville Cloudera User Group, 10/23/14
 
Hadoop & Cloudera Workshop
Hadoop & Cloudera WorkshopHadoop & Cloudera Workshop
Hadoop & Cloudera Workshop
 
Introduction to Hadoop and Cloudera, Louisville BI & Big Data Analytics Meetup
Introduction to Hadoop and Cloudera, Louisville BI & Big Data Analytics MeetupIntroduction to Hadoop and Cloudera, Louisville BI & Big Data Analytics Meetup
Introduction to Hadoop and Cloudera, Louisville BI & Big Data Analytics Meetup
 
Intro To Hadoop
Intro To HadoopIntro To Hadoop
Intro To Hadoop
 

Similaire à Intro to Hadoop

AWS Partner Webcast - Hadoop in the Cloud: Unlocking the Potential of Big Dat...
AWS Partner Webcast - Hadoop in the Cloud: Unlocking the Potential of Big Dat...AWS Partner Webcast - Hadoop in the Cloud: Unlocking the Potential of Big Dat...
AWS Partner Webcast - Hadoop in the Cloud: Unlocking the Potential of Big Dat...Amazon Web Services
 
Dynatrace: New Approach to Digital Performance Management - Gartner Symposium...
Dynatrace: New Approach to Digital Performance Management - Gartner Symposium...Dynatrace: New Approach to Digital Performance Management - Gartner Symposium...
Dynatrace: New Approach to Digital Performance Management - Gartner Symposium...Michael Allen
 
3 Steps to Accelerate to Cloud
3 Steps to Accelerate to Cloud3 Steps to Accelerate to Cloud
3 Steps to Accelerate to CloudRightScale
 
Whither the Hadoop Developer Experience, June Hadoop Meetup, Nitin Motgi
Whither the Hadoop Developer Experience, June Hadoop Meetup, Nitin MotgiWhither the Hadoop Developer Experience, June Hadoop Meetup, Nitin Motgi
Whither the Hadoop Developer Experience, June Hadoop Meetup, Nitin MotgiFelicia Haggarty
 
Advanced Strategies for Leveraging AWS for Disaster Recovery
Advanced Strategies for Leveraging AWS for Disaster Recovery   Advanced Strategies for Leveraging AWS for Disaster Recovery
Advanced Strategies for Leveraging AWS for Disaster Recovery Amazon Web Services
 
Scale with a smile with Google Cloud Platform At DevConTLV (June 2014)
Scale with a smile with Google Cloud Platform At DevConTLV (June 2014)Scale with a smile with Google Cloud Platform At DevConTLV (June 2014)
Scale with a smile with Google Cloud Platform At DevConTLV (June 2014)Ido Green
 
3 Steps to Accelerate to Cloud
3 Steps to Accelerate to Cloud3 Steps to Accelerate to Cloud
3 Steps to Accelerate to CloudRightScale
 
RightScale Roadtrip Atlanta - Accelerate to Cloud
RightScale Roadtrip Atlanta - Accelerate to CloudRightScale Roadtrip Atlanta - Accelerate to Cloud
RightScale Roadtrip Atlanta - Accelerate to CloudRightScale
 
cloud-migrations.pptx
cloud-migrations.pptxcloud-migrations.pptx
cloud-migrations.pptxJohn Mulhall
 
It summit 2014_migrating_applications_to_the_cloud-5
It summit 2014_migrating_applications_to_the_cloud-5It summit 2014_migrating_applications_to_the_cloud-5
It summit 2014_migrating_applications_to_the_cloud-5margaret_ronald
 
Webinar: Burst ANSYS Workloads to the Cloud with Univa & UberCloud
Webinar: Burst ANSYS Workloads to the Cloud with Univa & UberCloudWebinar: Burst ANSYS Workloads to the Cloud with Univa & UberCloud
Webinar: Burst ANSYS Workloads to the Cloud with Univa & UberCloudThomas Francis
 
implanting DevOps at scale using dynamic test environments
implanting DevOps at scale using dynamic test environmentsimplanting DevOps at scale using dynamic test environments
implanting DevOps at scale using dynamic test environmentsQualiQuali
 
Implementing DevOps at Scale Using Dynamic Environments
Implementing DevOps at Scale Using Dynamic EnvironmentsImplementing DevOps at Scale Using Dynamic Environments
Implementing DevOps at Scale Using Dynamic EnvironmentsSauce Labs
 
The Hadoop Guarantee: Keeping Analytics Running On Time
The Hadoop Guarantee: Keeping Analytics Running On TimeThe Hadoop Guarantee: Keeping Analytics Running On Time
The Hadoop Guarantee: Keeping Analytics Running On TimeInside Analysis
 
OneAPI Series 2 Webinar - 9th, Dec-20
OneAPI Series 2 Webinar - 9th, Dec-20OneAPI Series 2 Webinar - 9th, Dec-20
OneAPI Series 2 Webinar - 9th, Dec-20Tyrone Systems
 
Deepankar Sehdev- Resume2015
Deepankar Sehdev- Resume2015Deepankar Sehdev- Resume2015
Deepankar Sehdev- Resume2015Deepankar Sehdev
 
Snaplogic Tableau Cloud Integration Analytics 11052013
Snaplogic Tableau Cloud Integration Analytics 11052013Snaplogic Tableau Cloud Integration Analytics 11052013
Snaplogic Tableau Cloud Integration Analytics 11052013Mark Ames
 
apidays LIVE New York 2021 - API for multi-cloud management platform by Pawel...
apidays LIVE New York 2021 - API for multi-cloud management platform by Pawel...apidays LIVE New York 2021 - API for multi-cloud management platform by Pawel...
apidays LIVE New York 2021 - API for multi-cloud management platform by Pawel...apidays
 
Solutions for IT Organizations on The Journey to The Digital Enterprise
Solutions for IT Organizations on The Journey to The Digital EnterpriseSolutions for IT Organizations on The Journey to The Digital Enterprise
Solutions for IT Organizations on The Journey to The Digital Enterpriseandreas kuncoro
 

Similaire à Intro to Hadoop (20)

AWS Partner Webcast - Hadoop in the Cloud: Unlocking the Potential of Big Dat...
AWS Partner Webcast - Hadoop in the Cloud: Unlocking the Potential of Big Dat...AWS Partner Webcast - Hadoop in the Cloud: Unlocking the Potential of Big Dat...
AWS Partner Webcast - Hadoop in the Cloud: Unlocking the Potential of Big Dat...
 
Dynatrace: New Approach to Digital Performance Management - Gartner Symposium...
Dynatrace: New Approach to Digital Performance Management - Gartner Symposium...Dynatrace: New Approach to Digital Performance Management - Gartner Symposium...
Dynatrace: New Approach to Digital Performance Management - Gartner Symposium...
 
3 Steps to Accelerate to Cloud
3 Steps to Accelerate to Cloud3 Steps to Accelerate to Cloud
3 Steps to Accelerate to Cloud
 
Whither the Hadoop Developer Experience, June Hadoop Meetup, Nitin Motgi
Whither the Hadoop Developer Experience, June Hadoop Meetup, Nitin MotgiWhither the Hadoop Developer Experience, June Hadoop Meetup, Nitin Motgi
Whither the Hadoop Developer Experience, June Hadoop Meetup, Nitin Motgi
 
Advanced Strategies for Leveraging AWS for Disaster Recovery
Advanced Strategies for Leveraging AWS for Disaster Recovery   Advanced Strategies for Leveraging AWS for Disaster Recovery
Advanced Strategies for Leveraging AWS for Disaster Recovery
 
Scale with a smile with Google Cloud Platform At DevConTLV (June 2014)
Scale with a smile with Google Cloud Platform At DevConTLV (June 2014)Scale with a smile with Google Cloud Platform At DevConTLV (June 2014)
Scale with a smile with Google Cloud Platform At DevConTLV (June 2014)
 
3 Steps to Accelerate to Cloud
3 Steps to Accelerate to Cloud3 Steps to Accelerate to Cloud
3 Steps to Accelerate to Cloud
 
RightScale Roadtrip Atlanta - Accelerate to Cloud
RightScale Roadtrip Atlanta - Accelerate to CloudRightScale Roadtrip Atlanta - Accelerate to Cloud
RightScale Roadtrip Atlanta - Accelerate to Cloud
 
cloud-migrations.pptx
cloud-migrations.pptxcloud-migrations.pptx
cloud-migrations.pptx
 
It summit 2014_migrating_applications_to_the_cloud-5
It summit 2014_migrating_applications_to_the_cloud-5It summit 2014_migrating_applications_to_the_cloud-5
It summit 2014_migrating_applications_to_the_cloud-5
 
Webinar: Burst ANSYS Workloads to the Cloud with Univa & UberCloud
Webinar: Burst ANSYS Workloads to the Cloud with Univa & UberCloudWebinar: Burst ANSYS Workloads to the Cloud with Univa & UberCloud
Webinar: Burst ANSYS Workloads to the Cloud with Univa & UberCloud
 
implanting DevOps at scale using dynamic test environments
implanting DevOps at scale using dynamic test environmentsimplanting DevOps at scale using dynamic test environments
implanting DevOps at scale using dynamic test environments
 
Implementing DevOps at Scale Using Dynamic Environments
Implementing DevOps at Scale Using Dynamic EnvironmentsImplementing DevOps at Scale Using Dynamic Environments
Implementing DevOps at Scale Using Dynamic Environments
 
The Hadoop Guarantee: Keeping Analytics Running On Time
The Hadoop Guarantee: Keeping Analytics Running On TimeThe Hadoop Guarantee: Keeping Analytics Running On Time
The Hadoop Guarantee: Keeping Analytics Running On Time
 
OneAPI Series 2 Webinar - 9th, Dec-20
OneAPI Series 2 Webinar - 9th, Dec-20OneAPI Series 2 Webinar - 9th, Dec-20
OneAPI Series 2 Webinar - 9th, Dec-20
 
Deepankar Sehdev- Resume2015
Deepankar Sehdev- Resume2015Deepankar Sehdev- Resume2015
Deepankar Sehdev- Resume2015
 
Resume
ResumeResume
Resume
 
Snaplogic Tableau Cloud Integration Analytics 11052013
Snaplogic Tableau Cloud Integration Analytics 11052013Snaplogic Tableau Cloud Integration Analytics 11052013
Snaplogic Tableau Cloud Integration Analytics 11052013
 
apidays LIVE New York 2021 - API for multi-cloud management platform by Pawel...
apidays LIVE New York 2021 - API for multi-cloud management platform by Pawel...apidays LIVE New York 2021 - API for multi-cloud management platform by Pawel...
apidays LIVE New York 2021 - API for multi-cloud management platform by Pawel...
 
Solutions for IT Organizations on The Journey to The Digital Enterprise
Solutions for IT Organizations on The Journey to The Digital EnterpriseSolutions for IT Organizations on The Journey to The Digital Enterprise
Solutions for IT Organizations on The Journey to The Digital Enterprise
 

Plus de Quang Nguyen

Ho so xin tai tro giai bong da dong hanh den giang duong 2013
Ho so xin tai tro giai bong da dong hanh den giang duong 2013Ho so xin tai tro giai bong da dong hanh den giang duong 2013
Ho so xin tai tro giai bong da dong hanh den giang duong 2013Quang Nguyen
 
Gioi thieu du an dong hanh den giang duong 2013 vn
Gioi thieu du an dong hanh den giang duong 2013 vnGioi thieu du an dong hanh den giang duong 2013 vn
Gioi thieu du an dong hanh den giang duong 2013 vnQuang Nguyen
 
[Giaibongda.com] fi 7 min slides
[Giaibongda.com] fi 7 min slides[Giaibongda.com] fi 7 min slides
[Giaibongda.com] fi 7 min slidesQuang Nguyen
 
[Echelon 2012 vietnam satellite] giaibongda.com pitch deck
[Echelon 2012 vietnam satellite] giaibongda.com pitch deck[Echelon 2012 vietnam satellite] giaibongda.com pitch deck
[Echelon 2012 vietnam satellite] giaibongda.com pitch deckQuang Nguyen
 
[Giaibongda.com] FI 3-min pitch
[Giaibongda.com] FI 3-min pitch[Giaibongda.com] FI 3-min pitch
[Giaibongda.com] FI 3-min pitchQuang Nguyen
 
giaibongda.com pitch deck
giaibongda.com pitch deckgiaibongda.com pitch deck
giaibongda.com pitch deckQuang Nguyen
 
Agile development @open consultant offline
Agile development @open consultant offlineAgile development @open consultant offline
Agile development @open consultant offlineQuang Nguyen
 
[4interns.vn] hành trang thực tập
[4interns.vn] hành trang thực tập[4interns.vn] hành trang thực tập
[4interns.vn] hành trang thực tậpQuang Nguyen
 
Lean startup overview @ipl offline
Lean startup overview @ipl offlineLean startup overview @ipl offline
Lean startup overview @ipl offlineQuang Nguyen
 

Plus de Quang Nguyen (10)

Ho so xin tai tro giai bong da dong hanh den giang duong 2013
Ho so xin tai tro giai bong da dong hanh den giang duong 2013Ho so xin tai tro giai bong da dong hanh den giang duong 2013
Ho so xin tai tro giai bong da dong hanh den giang duong 2013
 
Gioi thieu du an dong hanh den giang duong 2013 vn
Gioi thieu du an dong hanh den giang duong 2013 vnGioi thieu du an dong hanh den giang duong 2013 vn
Gioi thieu du an dong hanh den giang duong 2013 vn
 
[Giaibongda.com] fi 7 min slides
[Giaibongda.com] fi 7 min slides[Giaibongda.com] fi 7 min slides
[Giaibongda.com] fi 7 min slides
 
[Echelon 2012 vietnam satellite] giaibongda.com pitch deck
[Echelon 2012 vietnam satellite] giaibongda.com pitch deck[Echelon 2012 vietnam satellite] giaibongda.com pitch deck
[Echelon 2012 vietnam satellite] giaibongda.com pitch deck
 
[Giaibongda.com] FI 3-min pitch
[Giaibongda.com] FI 3-min pitch[Giaibongda.com] FI 3-min pitch
[Giaibongda.com] FI 3-min pitch
 
giaibongda.com pitch deck
giaibongda.com pitch deckgiaibongda.com pitch deck
giaibongda.com pitch deck
 
Agile development @open consultant offline
Agile development @open consultant offlineAgile development @open consultant offline
Agile development @open consultant offline
 
[4interns.vn] hành trang thực tập
[4interns.vn] hành trang thực tập[4interns.vn] hành trang thực tập
[4interns.vn] hành trang thực tập
 
Lean startup overview @ipl offline
Lean startup overview @ipl offlineLean startup overview @ipl offline
Lean startup overview @ipl offline
 
Lean startup
Lean startupLean startup
Lean startup
 

Dernier

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...Zilliz
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Jeffrey Haguewood
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxRustici Software
 
Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024The Digital Insurer
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherRemote DBA Services
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfOrbitshub
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDropbox
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...apidays
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Orbitshub
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024The Digital Insurer
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingEdi Saputra
 
AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024The Digital Insurer
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProduct Anonymous
 
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Angeliki Cooney
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...DianaGray10
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MIND CTI
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMESafe Software
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Zilliz
 

Dernier (20)

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
 

Intro to Hadoop

  • 2. CONTENT • Introduction to Hadoop • Scalability on AWS / Azure • Reality • First 100-hour Award • Second 100-hour Overview • Career Path • Q & A
  • 6. DRIVERIGHT PROJECT • Target: collect driving experience by mobile application for analyzing driving habits • Purposes: • Improve driving ability • Supply driver’s information to needed companies • Market: China • Scale-out Problem: • Millions of users with rich data resources (records in milliseconds) • MySQL database is not efficient for Big Data Analytics
  • 7. R - Python Tableau Mobile Apps Mobile Platform DRIVE-RIGHT ARCHITECTURE
  • 10. SECOND 100-HOUR OVERVIEW #101 – Java & IntelliJ setup #102 – Java programming part 1 #103 – Java programming part 2 #104 – Java programming part 3 #105 – Java programming part 4 #106 – Single-node Hadoop #107 – Multi-node Hadoop #108 – Map Reduce basis #109 – Intro to Map Reduce programming #110 – Map Reduce Design Pattern part 1 #111 – Map Reduce Design Pattern part 2 #112 – Apache Mahout 1 – Setting Up #113 – Apache Mahout 2 – Building Recommenders #114 – Apache Mahout 3 – Building Clustering Systems #115 – Final Project II
  • 11. PLAN FOR THE YEAR Internship Program Club Sponsorship Capable & young data scientists $$$ Effort Smart students
  • 12. Q & A