SlideShare une entreprise Scribd logo
1  sur  28
Télécharger pour lire hors ligne
Big data
Big data
Big data
Big data
Big data
Big data
Terabytes
(10E12)

Click Stream
Mobile

Volume

Petabytes
(10E15)

Internet of things
Wikis / Blogs
Sensors / RFID / Devices

Social Sentiment

Exabytes
(10E18)

Audio / Video

WEB 2.0

Advertising eCommerce

ERP / CRM

Log Files
Collaboration

Spatial & GPS Coordinates

Digital Marketing

Data Market Feeds

Payables

Search Marketing

Payroll

Deal Tracking

Web Logs

Inventory

Gigabytes
(10E9)

Contacts

Sales Pipeline

Recommendations

eGov Feeds
Weather
Text/Image

Velocity - Variety - variability
ERP / CRM
1980
190,000$

Storage/GB

1990
9,000$

WEB
2.0

Internet of things
2000
15$

2010
0.07$
Big Data, BIG OPPORTUNITY

Billions $

Software Growth
5
0

1.8

2.5

3.4

4.6

2012 2013 2014 2015

34%

compound
annual growth
rate

49% CEOs and CIOs
are planning big
data projects

Billions $

Services Growth
10
5
0

2.7

3.9

5.1

6.5

2012 2013 2014 2015

1. McKinsey&Company, McKinsey Global Survey Results, Minding Your Digital Business, 2012
2. IDC Market Analysis, Worldwide Big Data Technology and Services 2012–2015 Forecast , 2012

39%

compound
annual growth
rate
Big data
Big data
Big data
Big data
Big data
Big data
Big data
Big data
Big data
Big data
Big data
Big data
Distributed Processing
(MapReduce)
Distributed Storage
(HDFS)

ODBC

Query
(Hive)

Legend
Red = Core
Hadoop
Blue = Data
processing
Purple =
Microsoft
integration
points and
value adds
Orange = Data
Movement
Green =
Packages
Big data
HDFS API
Name Node

Azure Blob Storage

de

Front
Front
end
Frontend
end
Data Node

Data Node

…
DFS (1 Data Node per Worker Role)
and Compute Cluster

Partition
Layer

Stream
Layer

Azure Storage (ASV)
Big data
Big data
Hive, Pig, Mahout, Cascading, Scalding, Scoobi, P
egasus…
C#, F# Map/Reduce, LINQ to Hive, .NET
management clients
JavaScript Map/Reduce, Browser hosted
console, Node.js management clients
PowerShell, Cross Platform CLI tools
Big data
Big data

Contenu connexe

Tendances

comScore Webit Big Data_OWest Nov 13 (Final)pptx
comScore Webit Big Data_OWest Nov 13 (Final)pptxcomScore Webit Big Data_OWest Nov 13 (Final)pptx
comScore Webit Big Data_OWest Nov 13 (Final)pptxOwen West
 
Internet of things: Accelerate Innovation and Opportunity on top The 3rd Plat...
Internet of things: Accelerate Innovation and Opportunity on top The 3rd Plat...Internet of things: Accelerate Innovation and Opportunity on top The 3rd Plat...
Internet of things: Accelerate Innovation and Opportunity on top The 3rd Plat...Son Phan
 
Impact of Coronavirus on Software and Services: Top Figures to Look at
Impact of Coronavirus on Software and Services: Top Figures to Look atImpact of Coronavirus on Software and Services: Top Figures to Look at
Impact of Coronavirus on Software and Services: Top Figures to Look atVivek Mishra
 
Big Data, Big Deal
Big Data,  Big DealBig Data,  Big Deal
Big Data, Big DealPiyush Malik
 
Selected Digital Technology Trends and their Impact on Talent Supply and Dema...
Selected Digital Technology Trends and their Impact on Talent Supply and Dema...Selected Digital Technology Trends and their Impact on Talent Supply and Dema...
Selected Digital Technology Trends and their Impact on Talent Supply and Dema...Margaret Gernert
 
Evolving Enterprise Networks for Future Initiatives - The Importance of a Lif...
Evolving Enterprise Networks for Future Initiatives - The Importance of a Lif...Evolving Enterprise Networks for Future Initiatives - The Importance of a Lif...
Evolving Enterprise Networks for Future Initiatives - The Importance of a Lif...DImension Data
 
Maybe tech stocks are not overvalued at all
Maybe tech stocks are not overvalued at allMaybe tech stocks are not overvalued at all
Maybe tech stocks are not overvalued at allAlpesh Patel
 
Driving Big Insight from Big Data - T3 Summit TED Talk - Kevin Foreman
Driving Big Insight from Big Data - T3 Summit TED Talk - Kevin ForemanDriving Big Insight from Big Data - T3 Summit TED Talk - Kevin Foreman
Driving Big Insight from Big Data - T3 Summit TED Talk - Kevin ForemanKevin Foreman
 
Digital predictions for 2015 2025- linkedin
Digital predictions for 2015 2025- linkedinDigital predictions for 2015 2025- linkedin
Digital predictions for 2015 2025- linkedinVidya S Nath
 
next-generation-cdn-infographic
next-generation-cdn-infographicnext-generation-cdn-infographic
next-generation-cdn-infographicErica E. Boyd
 
KGCInsights 15-3 Vehicle Computing Platform
KGCInsights 15-3 Vehicle Computing PlatformKGCInsights 15-3 Vehicle Computing Platform
KGCInsights 15-3 Vehicle Computing PlatformKGC Insights
 
Top digital predictions for 2017 & beyond
Top digital predictions for 2017 & beyondTop digital predictions for 2017 & beyond
Top digital predictions for 2017 & beyondAmit Ashwini
 
Top 4 Emerging Technologies To Look Out For
Top 4 Emerging Technologies To Look Out ForTop 4 Emerging Technologies To Look Out For
Top 4 Emerging Technologies To Look Out ForIan Yun
 
Top 4 Emerging Technologies to Look Out For In 2019 and Beyond.
Top 4 Emerging Technologies to Look Out For In 2019 and Beyond.Top 4 Emerging Technologies to Look Out For In 2019 and Beyond.
Top 4 Emerging Technologies to Look Out For In 2019 and Beyond.Mo Works
 
MMRS panel book 2020 consumer panel
MMRS panel book 2020   consumer panelMMRS panel book 2020   consumer panel
MMRS panel book 2020 consumer panelABHISEKH SINGH
 
Distil Network Sponsor Presentation at the Property Portal Watch Conference -...
Distil Network Sponsor Presentation at the Property Portal Watch Conference -...Distil Network Sponsor Presentation at the Property Portal Watch Conference -...
Distil Network Sponsor Presentation at the Property Portal Watch Conference -...Property Portal Watch
 
The Biggest Technology Trends to Watch in 2018
The Biggest Technology Trends to Watch in 2018The Biggest Technology Trends to Watch in 2018
The Biggest Technology Trends to Watch in 2018ThrottleNet, Inc
 
Philip carnelley predictions big data
Philip carnelley predictions big dataPhilip carnelley predictions big data
Philip carnelley predictions big dataLaura Torrejón
 
Mapping your transformation into a digital economy with GCI 2018
Mapping your transformation into a digital economy with GCI 2018Mapping your transformation into a digital economy with GCI 2018
Mapping your transformation into a digital economy with GCI 2018Huawei Technologies
 

Tendances (20)

comScore Webit Big Data_OWest Nov 13 (Final)pptx
comScore Webit Big Data_OWest Nov 13 (Final)pptxcomScore Webit Big Data_OWest Nov 13 (Final)pptx
comScore Webit Big Data_OWest Nov 13 (Final)pptx
 
Internet of things: Accelerate Innovation and Opportunity on top The 3rd Plat...
Internet of things: Accelerate Innovation and Opportunity on top The 3rd Plat...Internet of things: Accelerate Innovation and Opportunity on top The 3rd Plat...
Internet of things: Accelerate Innovation and Opportunity on top The 3rd Plat...
 
Impact of Coronavirus on Software and Services: Top Figures to Look at
Impact of Coronavirus on Software and Services: Top Figures to Look atImpact of Coronavirus on Software and Services: Top Figures to Look at
Impact of Coronavirus on Software and Services: Top Figures to Look at
 
Big Data, Big Deal
Big Data,  Big DealBig Data,  Big Deal
Big Data, Big Deal
 
Selected Digital Technology Trends and their Impact on Talent Supply and Dema...
Selected Digital Technology Trends and their Impact on Talent Supply and Dema...Selected Digital Technology Trends and their Impact on Talent Supply and Dema...
Selected Digital Technology Trends and their Impact on Talent Supply and Dema...
 
Evolving Enterprise Networks for Future Initiatives - The Importance of a Lif...
Evolving Enterprise Networks for Future Initiatives - The Importance of a Lif...Evolving Enterprise Networks for Future Initiatives - The Importance of a Lif...
Evolving Enterprise Networks for Future Initiatives - The Importance of a Lif...
 
Maybe tech stocks are not overvalued at all
Maybe tech stocks are not overvalued at allMaybe tech stocks are not overvalued at all
Maybe tech stocks are not overvalued at all
 
Driving Big Insight from Big Data - T3 Summit TED Talk - Kevin Foreman
Driving Big Insight from Big Data - T3 Summit TED Talk - Kevin ForemanDriving Big Insight from Big Data - T3 Summit TED Talk - Kevin Foreman
Driving Big Insight from Big Data - T3 Summit TED Talk - Kevin Foreman
 
Digital predictions for 2015 2025- linkedin
Digital predictions for 2015 2025- linkedinDigital predictions for 2015 2025- linkedin
Digital predictions for 2015 2025- linkedin
 
next-generation-cdn-infographic
next-generation-cdn-infographicnext-generation-cdn-infographic
next-generation-cdn-infographic
 
KGCInsights 15-3 Vehicle Computing Platform
KGCInsights 15-3 Vehicle Computing PlatformKGCInsights 15-3 Vehicle Computing Platform
KGCInsights 15-3 Vehicle Computing Platform
 
Top digital predictions for 2017 & beyond
Top digital predictions for 2017 & beyondTop digital predictions for 2017 & beyond
Top digital predictions for 2017 & beyond
 
Top 4 Emerging Technologies To Look Out For
Top 4 Emerging Technologies To Look Out ForTop 4 Emerging Technologies To Look Out For
Top 4 Emerging Technologies To Look Out For
 
Top 4 Emerging Technologies to Look Out For In 2019 and Beyond.
Top 4 Emerging Technologies to Look Out For In 2019 and Beyond.Top 4 Emerging Technologies to Look Out For In 2019 and Beyond.
Top 4 Emerging Technologies to Look Out For In 2019 and Beyond.
 
MMRS panel book 2020 consumer panel
MMRS panel book 2020   consumer panelMMRS panel book 2020   consumer panel
MMRS panel book 2020 consumer panel
 
Distil Network Sponsor Presentation at the Property Portal Watch Conference -...
Distil Network Sponsor Presentation at the Property Portal Watch Conference -...Distil Network Sponsor Presentation at the Property Portal Watch Conference -...
Distil Network Sponsor Presentation at the Property Portal Watch Conference -...
 
The Biggest Technology Trends to Watch in 2018
The Biggest Technology Trends to Watch in 2018The Biggest Technology Trends to Watch in 2018
The Biggest Technology Trends to Watch in 2018
 
Philip carnelley predictions big data
Philip carnelley predictions big dataPhilip carnelley predictions big data
Philip carnelley predictions big data
 
Wanderbook Intro Short
Wanderbook Intro ShortWanderbook Intro Short
Wanderbook Intro Short
 
Mapping your transformation into a digital economy with GCI 2018
Mapping your transformation into a digital economy with GCI 2018Mapping your transformation into a digital economy with GCI 2018
Mapping your transformation into a digital economy with GCI 2018
 

Similaire à Big data

Building the TAD ecosystem
Building the TAD ecosystemBuilding the TAD ecosystem
Building the TAD ecosystemAlan Quayle
 
Twilio_Segment Pitch - Liraz Rubinstein - Data Guild event.pdf
Twilio_Segment Pitch - Liraz Rubinstein - Data Guild event.pdfTwilio_Segment Pitch - Liraz Rubinstein - Data Guild event.pdf
Twilio_Segment Pitch - Liraz Rubinstein - Data Guild event.pdfShavitBenitzhak
 
Towards 2020 - IT Planning for SMEs
Towards 2020 - IT Planning for SMEsTowards 2020 - IT Planning for SMEs
Towards 2020 - IT Planning for SMEsBua Consulting
 
5 Tips to Breaking Digital Performance Barriers and Building Business Success
5 Tips to Breaking Digital Performance Barriers and Building Business Success5 Tips to Breaking Digital Performance Barriers and Building Business Success
5 Tips to Breaking Digital Performance Barriers and Building Business SuccessKeynote Mobile Testing
 
Are you ready for Hosting 3.0?
Are you ready for Hosting 3.0?Are you ready for Hosting 3.0?
Are you ready for Hosting 3.0?shawnnewman
 
Web4.0 Technology & 4Disruptions for Companies !!
Web4.0 Technology & 4Disruptions for Companies !!Web4.0 Technology & 4Disruptions for Companies !!
Web4.0 Technology & 4Disruptions for Companies !!Subhakar Rao Surapaneni
 
Big data competitive landscape overview
Big data competitive landscape overviewBig data competitive landscape overview
Big data competitive landscape overviewBisakha Praharaj
 
Digital Transformation trends - 2018
Digital Transformation trends - 2018Digital Transformation trends - 2018
Digital Transformation trends - 2018Khalid Rahiel
 
The Rise of Big Data and the Chief Data Officer (CDO)
The Rise of Big Data and the Chief Data Officer (CDO)The Rise of Big Data and the Chief Data Officer (CDO)
The Rise of Big Data and the Chief Data Officer (CDO)gcharlesj
 
Chicago User Group - Relationship One
Chicago User Group - Relationship OneChicago User Group - Relationship One
Chicago User Group - Relationship OneRon Corbisier
 
IBM Big Data Views for corporate & Startups
IBM Big Data  Views for corporate & StartupsIBM Big Data  Views for corporate & Startups
IBM Big Data Views for corporate & StartupsMarco Laucelli
 
Turning data from insights into value
Turning data from insights into valueTurning data from insights into value
Turning data from insights into valueKoray Kocabas
 
Unicaseed Demo Days - Alleantia
Unicaseed Demo Days - AlleantiaUnicaseed Demo Days - Alleantia
Unicaseed Demo Days - AlleantiaUnicaseed
 
Bill Barney's Key Note at the Wan Summit
Bill Barney's Key Note at the Wan Summit Bill Barney's Key Note at the Wan Summit
Bill Barney's Key Note at the Wan Summit William Barney
 
2014 Key trends
2014 Key trends2014 Key trends
2014 Key trendsSean Cho
 
Integration of Big Data Analytics with IoT and OT Systems to Turn Insights in...
Integration of Big Data Analytics with IoT and OT Systems to Turn Insights in...Integration of Big Data Analytics with IoT and OT Systems to Turn Insights in...
Integration of Big Data Analytics with IoT and OT Systems to Turn Insights in...Alaa Mahjoub
 
THE INTERNET OF THINGS IS GETTING REAL
THE INTERNET OF THINGS IS GETTING REALTHE INTERNET OF THINGS IS GETTING REAL
THE INTERNET OF THINGS IS GETTING REALDrupalCamp Kyiv
 
Maximize Your MarTech Stack
Maximize Your MarTech StackMaximize Your MarTech Stack
Maximize Your MarTech StackRon Corbisier
 
IOT Paris Seminar 2015 - Enabling Transformation to the IOT
IOT Paris Seminar 2015 - Enabling Transformation to the IOTIOT Paris Seminar 2015 - Enabling Transformation to the IOT
IOT Paris Seminar 2015 - Enabling Transformation to the IOTMongoDB
 

Similaire à Big data (20)

ICT Outlook 2016
ICT Outlook 2016ICT Outlook 2016
ICT Outlook 2016
 
Building the TAD ecosystem
Building the TAD ecosystemBuilding the TAD ecosystem
Building the TAD ecosystem
 
Twilio_Segment Pitch - Liraz Rubinstein - Data Guild event.pdf
Twilio_Segment Pitch - Liraz Rubinstein - Data Guild event.pdfTwilio_Segment Pitch - Liraz Rubinstein - Data Guild event.pdf
Twilio_Segment Pitch - Liraz Rubinstein - Data Guild event.pdf
 
Towards 2020 - IT Planning for SMEs
Towards 2020 - IT Planning for SMEsTowards 2020 - IT Planning for SMEs
Towards 2020 - IT Planning for SMEs
 
5 Tips to Breaking Digital Performance Barriers and Building Business Success
5 Tips to Breaking Digital Performance Barriers and Building Business Success5 Tips to Breaking Digital Performance Barriers and Building Business Success
5 Tips to Breaking Digital Performance Barriers and Building Business Success
 
Are you ready for Hosting 3.0?
Are you ready for Hosting 3.0?Are you ready for Hosting 3.0?
Are you ready for Hosting 3.0?
 
Web4.0 Technology & 4Disruptions for Companies !!
Web4.0 Technology & 4Disruptions for Companies !!Web4.0 Technology & 4Disruptions for Companies !!
Web4.0 Technology & 4Disruptions for Companies !!
 
Big data competitive landscape overview
Big data competitive landscape overviewBig data competitive landscape overview
Big data competitive landscape overview
 
Digital Transformation trends - 2018
Digital Transformation trends - 2018Digital Transformation trends - 2018
Digital Transformation trends - 2018
 
The Rise of Big Data and the Chief Data Officer (CDO)
The Rise of Big Data and the Chief Data Officer (CDO)The Rise of Big Data and the Chief Data Officer (CDO)
The Rise of Big Data and the Chief Data Officer (CDO)
 
Chicago User Group - Relationship One
Chicago User Group - Relationship OneChicago User Group - Relationship One
Chicago User Group - Relationship One
 
IBM Big Data Views for corporate & Startups
IBM Big Data  Views for corporate & StartupsIBM Big Data  Views for corporate & Startups
IBM Big Data Views for corporate & Startups
 
Turning data from insights into value
Turning data from insights into valueTurning data from insights into value
Turning data from insights into value
 
Unicaseed Demo Days - Alleantia
Unicaseed Demo Days - AlleantiaUnicaseed Demo Days - Alleantia
Unicaseed Demo Days - Alleantia
 
Bill Barney's Key Note at the Wan Summit
Bill Barney's Key Note at the Wan Summit Bill Barney's Key Note at the Wan Summit
Bill Barney's Key Note at the Wan Summit
 
2014 Key trends
2014 Key trends2014 Key trends
2014 Key trends
 
Integration of Big Data Analytics with IoT and OT Systems to Turn Insights in...
Integration of Big Data Analytics with IoT and OT Systems to Turn Insights in...Integration of Big Data Analytics with IoT and OT Systems to Turn Insights in...
Integration of Big Data Analytics with IoT and OT Systems to Turn Insights in...
 
THE INTERNET OF THINGS IS GETTING REAL
THE INTERNET OF THINGS IS GETTING REALTHE INTERNET OF THINGS IS GETTING REAL
THE INTERNET OF THINGS IS GETTING REAL
 
Maximize Your MarTech Stack
Maximize Your MarTech StackMaximize Your MarTech Stack
Maximize Your MarTech Stack
 
IOT Paris Seminar 2015 - Enabling Transformation to the IOT
IOT Paris Seminar 2015 - Enabling Transformation to the IOTIOT Paris Seminar 2015 - Enabling Transformation to the IOT
IOT Paris Seminar 2015 - Enabling Transformation to the IOT
 

Dernier

COMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a WebsiteCOMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a Websitedgelyza
 
99.99% of Your Traces Are (Probably) Trash (SRECon NA 2024).pdf
99.99% of Your Traces  Are (Probably) Trash (SRECon NA 2024).pdf99.99% of Your Traces  Are (Probably) Trash (SRECon NA 2024).pdf
99.99% of Your Traces Are (Probably) Trash (SRECon NA 2024).pdfPaige Cruz
 
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfJamie (Taka) Wang
 
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1DianaGray10
 
All in AI: LLM Landscape & RAG in 2024 with Mark Ryan (Google) & Jerry Liu (L...
All in AI: LLM Landscape & RAG in 2024 with Mark Ryan (Google) & Jerry Liu (L...All in AI: LLM Landscape & RAG in 2024 with Mark Ryan (Google) & Jerry Liu (L...
All in AI: LLM Landscape & RAG in 2024 with Mark Ryan (Google) & Jerry Liu (L...Daniel Zivkovic
 
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesAI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesMd Hossain Ali
 
UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7DianaGray10
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioChristian Posta
 
Nanopower In Semiconductor Industry.pdf
Nanopower  In Semiconductor Industry.pdfNanopower  In Semiconductor Industry.pdf
Nanopower In Semiconductor Industry.pdfPedro Manuel
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostMatt Ray
 
Empowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintEmpowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintMahmoud Rabie
 
Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1DianaGray10
 
9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding TeamAdam Moalla
 
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDEADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDELiveplex
 
IEEE Computer Society’s Strategic Activities and Products including SWEBOK Guide
IEEE Computer Society’s Strategic Activities and Products including SWEBOK GuideIEEE Computer Society’s Strategic Activities and Products including SWEBOK Guide
IEEE Computer Society’s Strategic Activities and Products including SWEBOK GuideHironori Washizaki
 
100+ ChatGPT Prompts for SEO Optimization
100+ ChatGPT Prompts for SEO Optimization100+ ChatGPT Prompts for SEO Optimization
100+ ChatGPT Prompts for SEO Optimizationarrow10202532yuvraj
 
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationUsing IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationIES VE
 
UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8DianaGray10
 

Dernier (20)

COMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a WebsiteCOMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a Website
 
99.99% of Your Traces Are (Probably) Trash (SRECon NA 2024).pdf
99.99% of Your Traces  Are (Probably) Trash (SRECon NA 2024).pdf99.99% of Your Traces  Are (Probably) Trash (SRECon NA 2024).pdf
99.99% of Your Traces Are (Probably) Trash (SRECon NA 2024).pdf
 
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
 
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
 
All in AI: LLM Landscape & RAG in 2024 with Mark Ryan (Google) & Jerry Liu (L...
All in AI: LLM Landscape & RAG in 2024 with Mark Ryan (Google) & Jerry Liu (L...All in AI: LLM Landscape & RAG in 2024 with Mark Ryan (Google) & Jerry Liu (L...
All in AI: LLM Landscape & RAG in 2024 with Mark Ryan (Google) & Jerry Liu (L...
 
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesAI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
 
UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and Istio
 
20230104 - machine vision
20230104 - machine vision20230104 - machine vision
20230104 - machine vision
 
Nanopower In Semiconductor Industry.pdf
Nanopower  In Semiconductor Industry.pdfNanopower  In Semiconductor Industry.pdf
Nanopower In Semiconductor Industry.pdf
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
 
Empowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintEmpowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership Blueprint
 
Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1
 
9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team
 
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDEADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
 
201610817 - edge part1
201610817 - edge part1201610817 - edge part1
201610817 - edge part1
 
IEEE Computer Society’s Strategic Activities and Products including SWEBOK Guide
IEEE Computer Society’s Strategic Activities and Products including SWEBOK GuideIEEE Computer Society’s Strategic Activities and Products including SWEBOK Guide
IEEE Computer Society’s Strategic Activities and Products including SWEBOK Guide
 
100+ ChatGPT Prompts for SEO Optimization
100+ ChatGPT Prompts for SEO Optimization100+ ChatGPT Prompts for SEO Optimization
100+ ChatGPT Prompts for SEO Optimization
 
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationUsing IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
 
UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8
 

Big data

  • 7. Terabytes (10E12) Click Stream Mobile Volume Petabytes (10E15) Internet of things Wikis / Blogs Sensors / RFID / Devices Social Sentiment Exabytes (10E18) Audio / Video WEB 2.0 Advertising eCommerce ERP / CRM Log Files Collaboration Spatial & GPS Coordinates Digital Marketing Data Market Feeds Payables Search Marketing Payroll Deal Tracking Web Logs Inventory Gigabytes (10E9) Contacts Sales Pipeline Recommendations eGov Feeds Weather Text/Image Velocity - Variety - variability ERP / CRM 1980 190,000$ Storage/GB 1990 9,000$ WEB 2.0 Internet of things 2000 15$ 2010 0.07$
  • 8. Big Data, BIG OPPORTUNITY Billions $ Software Growth 5 0 1.8 2.5 3.4 4.6 2012 2013 2014 2015 34% compound annual growth rate 49% CEOs and CIOs are planning big data projects Billions $ Services Growth 10 5 0 2.7 3.9 5.1 6.5 2012 2013 2014 2015 1. McKinsey&Company, McKinsey Global Survey Results, Minding Your Digital Business, 2012 2. IDC Market Analysis, Worldwide Big Data Technology and Services 2012–2015 Forecast , 2012 39% compound annual growth rate
  • 21. Distributed Processing (MapReduce) Distributed Storage (HDFS) ODBC Query (Hive) Legend Red = Core Hadoop Blue = Data processing Purple = Microsoft integration points and value adds Orange = Data Movement Green = Packages
  • 23. HDFS API Name Node Azure Blob Storage de Front Front end Frontend end Data Node Data Node … DFS (1 Data Node per Worker Role) and Compute Cluster Partition Layer Stream Layer Azure Storage (ASV)
  • 26. Hive, Pig, Mahout, Cascading, Scalding, Scoobi, P egasus… C#, F# Map/Reduce, LINQ to Hive, .NET management clients JavaScript Map/Reduce, Browser hosted console, Node.js management clients PowerShell, Cross Platform CLI tools

Notes de l'éditeur

  1. Difference of IOT and Internet IPV6 – MDSN this month … Slide Objectives:Huge opportunities in internet of thingsTransition:Transition statement(s) to setup the slideSpeaking Points:Internet of things can help us monitor our environment and help optimize our physical world.The tremendous amount of data needs to be stored and analyzed in real time, interactively and batch processing.Notes:Any notes go here
  2. Slide Objectives:Talk from the bottom layer up to discuss the Microsoft big data solution.Transition:Transition statement(s) to setup the slideSpeaking Points:BI Platform: Sql server analysis service and reporting service.Self service BI: powerview, powerpivot, predictive analysis and embedded BI.Taking in unstructured data and strutted data sources through Hadoop, or PDWNotes:Any notes go here
  3. Slide Objectives:Vision slideTransition:Transition statement(s) to setup the slideSpeaking Points:Broaden access to Hadoop on the windows platformEnterprise ready through AD, System center (to come).BI integration and Self service BINotes:Any notes go here
  4. Slide Objectives:Architecture of hadoopTransition:Transition statement(s) to setup the slideSpeaking Points:Map reduce is the programming layer where it resembles the primitives of parallel programming. At the file system layer, the distributed Hadoop file system takes care of availability redundancy and reliability of the storage layer.Each block of your data is copied 3 times for safe keeping, and the map reduce layer can schedule work onto the node that contains the actual data blockNotes:Any notes go here
  5. Slide Objectives:Objective #1Transition:Transition statement(s) to setup the slideSpeaking Points:Map reduce is about minimizing the movement of data inside your cluster.The job tracker understands where all the data blocks are, and will send the operation code to the node that contains the data.Notes:Any notes go here
  6. Slide Objectives:Objective #1Transition:Transition statement(s) to setup the slideSpeaking Points:Speaking Point #1Speaking Point #2Notes:Any notes go here
  7. Slide Objectives:Objective #1Transition:Transition statement(s) to setup the slideSpeaking Points:Speaking Point #1Speaking Point #2Notes:Any notes go here
  8. Slide Objectives:Understand the HDInsight eco-systemTransition:Transition statement(s) to setup the slideSpeaking Points:Biggest buzzword in Big Data right now is HadoopIt can mean many things, but always includes HDFS and MapReduceHDInsightRed = in product nowBlue = planned for productGreen = ecosystem can connect nowPurple = Samples availableOrange = ecosystem plannedFlume, HBase are not available in the first release of HDInsight ServiceAs of 3/15, we don’t have an on-premise solution, thus AD integration is not yet available. System center integration will come later as well.The Green boxes are packages in the ecosystem that have not been included in the service, but should work out of the box by downloading them.Notes:Any notes go here
  9. Slide Objectives:Provides 1 layer to access both attached/local storage on each node and the remote Windows Azure Blog storage which is the default.Transition:Transition statement(s) to setup the slideSpeaking Points:One interface to rule both DFS and Azure blob storageBlob storage:Front End: Security/Auth and scaled out request handlerPartition Layer: Object Layer, Mapping of objects such as Tables, Blobs, Queues to streams (cached in Front End), CCStream Layer: 3-Node HA, Scale-out stream storePlease see details from windows azure storage paper. IN some ways ASV changes things again, we are now moving data to the compute, since data is now remote. Blob storage allows you to persist your data even when you tear down your cluster.Notes:Any notes go here
  10. Slide Objectives:Understand the details of ASVTransition:Transition statement(s) to setup the slideSpeaking Points:You will need to create an Azure storage account, you will need your acct name and key.You should create a cluster close to where your data is. (storage in west should create a cluster in the west data center).Notes:Any notes go here
  11. Slide Objectives:Best of both world in terms of programming flexibilityTransition:Transition statement(s) to setup the slideSpeaking Points:We offer everything the Hadoop distribution offers.In addition, we have made available javascript, browser hosted console, f#, c# linq2Hive to make life easier for .net /enterprise developers.In addition, devops can use powershell and node.js based CLI to control and manage the cluster.Notes:Any notes go here
  12. Innovate across the stack in terms of developer tools for better experience.