SlideShare une entreprise Scribd logo
1  sur  16
DATA SCIENCE
as a new professional career
What we will talk about
• Data Science:
• What is Data Science?
• What kind of work to Data Scientists do?
• Employment demand for Data Science jobs
• What kind education is required?
• What is Data Engineering, and how does it differ from
Data Science?
• What is the difference between Data Science and
Business Intelligence?
Who am I?
• David Rostcheck
• I’m a consulting Data Scientist
• I have worked in various software
roles (software engineer, enterprise
architect, etc.)
• My degree is in Physics
• I write articles on Data Science on
http://linkedin.com/in/davidrostcheck
What is Data Science?
• Data Science is industrial research on a company’s own
data
• Goal: produce advanced algorithms that produce a
competitive advantage
• Often work with unstructured data, may be large
• “The qualifications for the job include the strength to
tunnel through mountains of information and the vision to
discern patterns where others see none”
- Bloomberg Businessweek
Is Data Science really science?
Academic Science Industrial Research
Teams PhDs, graduate students PhDs, technologists
Setting University Company
Publication Formal (academic
publications, conferences)
Less formal (blogs, white papers,
open source)
Funding Public grants Corporate
Goal Advance human knowledge Create competitive advantage
- Data Science is industrial science
- It shares some attributes with academic
science, but has other differences
What kind of work do Data Scientists do?
• Create Artificially Intelligent systems (“narrow AI”)
• Examples:
• Recommender systems
• Self-driving cars
• AI agents
• Smart energy management
• Medical diagnosis
• Machine vision
Data Science is in Demand
• “The hot job of the decade… Data scientists today are
akin to Wall Street “quants” of the 1980s and 1990s”
- Harvard Business Review
• “18.7% projected growth 2010-2020”
- VentureBeat
• “McKinsey projects […] ‘50 percent to 60 percent gap
between supply and requisite demand’”
- Bloomberg Businessweek
On the other hand…
• Some people believe Data Science itself will be
automated
• “New Teradata Platform Reduces Demand For Data
Scientists”
- Forbes
• “Automating the Data Scientist”
- MIT Technology Review
What do I think?
• Yes, advanced tools will automate some data exploration
• But: research and communication (the fundamental skills),
are always in demand when the world is changing
• Data will continue to explode (Internet of Things)
• We will see more change and faster change
What is Data Engineering?
• Specialized type of software engineering
• Requires additional training in:
• Data (SQL, NoSQL, data visualization) and Big Data
(Hadoop, Apache Spark/Storm/Flink, cloud)
• Machine Learning algorithms and platforms (ex. Dato)
• Predictive APIs (ex. Watson)
• Linear Algebra & Calculus really help to understand
Machine Learning
Data Engineering vs. Data Science
Data Science Data Engineering
Approach Scientific (Exploration) Engineering (Development)
Problems Unbounded Bounded
Path to
Solution
Iterative, exploratory,
nonlinear
Mostly linear
Education More is better (PhD’s
common)
BS and/or self-trained
Presentation
Skills
Important Not as important
Research
experience
Important Not as important
Programming
skills
Not as important Important
Data skills Important Important
Data Science vs. Business Intelligence
Business Intelligence (BI) Data Science
Data analysis Yes Yes
Statistics Yes Yes
Visualization Yes Yes
Data Sources Usually SQL, often Data
Warehouse
Less structured (logs, cloud data,
SQL, noSQL, text)
Tools Statistics, Visualization Statistics, Machine Learning,
Graph Analysis, NLP
Focus Present and past Future
Approach Analytic Scientific
Goal Better strategic decisions Advanced functionality
The two fields are closely related. In some ways Data Science is an
evolution of BI.
What industries use Data Science?
• Now: Technology (employ over 50%), Education, Finance,
Consulting, Health Care
• But: “Technology” companies like Uber, Amazon, AirBnB
compete in other industries (transportation, retail, hotels)
• “Software is eating the world” – Andreessen Horowitz
• What industries will AI change? Ultimately, all of them.
• Incorporating AI == large business opportunity
Education for Data Science/Engineering
• Academic programs
• Boot camps
• Online classes (Coursera & Udacity)
• For Data Engineering:
• Documentation and webinars (self-education)
• Focus on data manipulation tools and Machine Learning
• For Data Science:
• The more academic science and research expertise, the better
• Focus on projects that solve unknown problems
• Work with more experienced Data Scientists
Questions?
Contact me: drostcheck@leopardllc.com, twitter: @davidrostcheck
Articles: http://linkedin.com/in/davidrostcheck
“Big Data”
• Specialized technologies and techniques for working with very
large data sets
• Often too big to process with one computer – need clusters
and/or cloud computing
• Data may change rapidly
• Specialized tools: Map/Reduce, Apache
Hadoop/Spark/Storm/Flink, Elastic, etc.
• Large demand, but keep perspective:
• Big Data tools can be more awkward
• It is often easier to solve problems at small scale, then scale up, if
possible

Contenu connexe

Tendances

How to build a data science team 20115.03.13v6
How to build a data science team 20115.03.13v6How to build a data science team 20115.03.13v6
How to build a data science team 20115.03.13v6
Zhihao Lin
 

Tendances (20)

Ai2020 ai and or final
Ai2020 ai and or finalAi2020 ai and or final
Ai2020 ai and or final
 
Road Map for Careers in Big Data
Road Map for Careers in Big DataRoad Map for Careers in Big Data
Road Map for Careers in Big Data
 
Future of datascience
Future of datascienceFuture of datascience
Future of datascience
 
Data Scientist: The Sexiest Job in the 21st Century
Data Scientist: The Sexiest Job in the 21st CenturyData Scientist: The Sexiest Job in the 21st Century
Data Scientist: The Sexiest Job in the 21st Century
 
data scientist the sexiest job of the 21st century
data scientist the sexiest job of the 21st centurydata scientist the sexiest job of the 21st century
data scientist the sexiest job of the 21st century
 
Getstarteddssd12717sd
Getstarteddssd12717sdGetstarteddssd12717sd
Getstarteddssd12717sd
 
Building up a Data Science Team from Scratch
Building up a Data Science Team from ScratchBuilding up a Data Science Team from Scratch
Building up a Data Science Team from Scratch
 
Data science vs. Data scientist by Jothi Periasamy
Data science vs. Data scientist by Jothi PeriasamyData science vs. Data scientist by Jothi Periasamy
Data science vs. Data scientist by Jothi Periasamy
 
Introduction to Data Science
Introduction to Data ScienceIntroduction to Data Science
Introduction to Data Science
 
Smart Data Slides: Data Science and Business Analysis - A Look at Best Practi...
Smart Data Slides: Data Science and Business Analysis - A Look at Best Practi...Smart Data Slides: Data Science and Business Analysis - A Look at Best Practi...
Smart Data Slides: Data Science and Business Analysis - A Look at Best Practi...
 
Datascienceindia article
Datascienceindia articleDatascienceindia article
Datascienceindia article
 
How to build a data science team 20115.03.13v6
How to build a data science team 20115.03.13v6How to build a data science team 20115.03.13v6
How to build a data science team 20115.03.13v6
 
Data science team, a practice to setup
Data science team, a practice to setupData science team, a practice to setup
Data science team, a practice to setup
 
Loras College 2016 Business Analytics Symposium Keynote
Loras College 2016 Business Analytics Symposium KeynoteLoras College 2016 Business Analytics Symposium Keynote
Loras College 2016 Business Analytics Symposium Keynote
 
Data Science - An emerging Stream of Science with its Spreading Reach & Impact
Data Science - An emerging Stream of Science with its Spreading Reach & ImpactData Science - An emerging Stream of Science with its Spreading Reach & Impact
Data Science - An emerging Stream of Science with its Spreading Reach & Impact
 
Big Data, Data Visualization, Machine Learning & Artificial Intelligence by...
Big Data, Data Visualization, Machine Learning  &  Artificial Intelligence by...Big Data, Data Visualization, Machine Learning  &  Artificial Intelligence by...
Big Data, Data Visualization, Machine Learning & Artificial Intelligence by...
 
Data sci sd-11.6.17
Data sci sd-11.6.17Data sci sd-11.6.17
Data sci sd-11.6.17
 
8 minute intro to data science
8 minute intro to data science 8 minute intro to data science
8 minute intro to data science
 
Demystifying Data Science with an introduction to Machine Learning
Demystifying Data Science with an introduction to Machine LearningDemystifying Data Science with an introduction to Machine Learning
Demystifying Data Science with an introduction to Machine Learning
 
System Dynamics, Analytics & Big Data (16th Conference of the UK Chapter of t...
System Dynamics, Analytics & Big Data (16th Conference of the UK Chapter of t...System Dynamics, Analytics & Big Data (16th Conference of the UK Chapter of t...
System Dynamics, Analytics & Big Data (16th Conference of the UK Chapter of t...
 

Similaire à Data science as a professional career

2017 06-14-getting started with data science
2017 06-14-getting started with data science2017 06-14-getting started with data science
2017 06-14-getting started with data science
Thinkful
 

Similaire à Data science as a professional career (20)

How to crack Big Data and Data Science roles
How to crack Big Data and Data Science rolesHow to crack Big Data and Data Science roles
How to crack Big Data and Data Science roles
 
intro to data science Clustering and visualization of data science subfields ...
intro to data science Clustering and visualization of data science subfields ...intro to data science Clustering and visualization of data science subfields ...
intro to data science Clustering and visualization of data science subfields ...
 
Data Science.pptx
Data Science.pptxData Science.pptx
Data Science.pptx
 
Datascience
DatascienceDatascience
Datascience
 
Data science
Data scienceData science
Data science
 
NDC Oslo : A Practical Introduction to Data Science
NDC Oslo : A Practical Introduction to Data ScienceNDC Oslo : A Practical Introduction to Data Science
NDC Oslo : A Practical Introduction to Data Science
 
From Rocket Science to Data Science
From Rocket Science to Data ScienceFrom Rocket Science to Data Science
From Rocket Science to Data Science
 
Data Scientists
 Data Scientists Data Scientists
Data Scientists
 
Data Science Overview
Data Science OverviewData Science Overview
Data Science Overview
 
Semantics and Machine Learning
Semantics and Machine LearningSemantics and Machine Learning
Semantics and Machine Learning
 
Intro to Data Science
Intro to Data ScienceIntro to Data Science
Intro to Data Science
 
Thinkful DC - Intro to Data Science
Thinkful DC - Intro to Data Science Thinkful DC - Intro to Data Science
Thinkful DC - Intro to Data Science
 
JavaZone 2018 - A Practical(ish) Introduction to Data Science
JavaZone 2018 - A Practical(ish) Introduction to Data ScienceJavaZone 2018 - A Practical(ish) Introduction to Data Science
JavaZone 2018 - A Practical(ish) Introduction to Data Science
 
Intro to Data Science for Non-Data Scientists
Intro to Data Science for Non-Data ScientistsIntro to Data Science for Non-Data Scientists
Intro to Data Science for Non-Data Scientists
 
A Practical-ish Introduction to Data Science
A Practical-ish Introduction to Data ScienceA Practical-ish Introduction to Data Science
A Practical-ish Introduction to Data Science
 
2017 06-14-getting started with data science
2017 06-14-getting started with data science2017 06-14-getting started with data science
2017 06-14-getting started with data science
 
Data science and Artificial Intelligence
Data science and Artificial IntelligenceData science and Artificial Intelligence
Data science and Artificial Intelligence
 
1 data science with python
1 data science with python1 data science with python
1 data science with python
 
Data science fin_tech_2016
Data science fin_tech_2016Data science fin_tech_2016
Data science fin_tech_2016
 
Data Scientist Enablement roadmap 1.0
Data Scientist Enablement roadmap 1.0Data Scientist Enablement roadmap 1.0
Data Scientist Enablement roadmap 1.0
 

Plus de David Rostcheck

Plus de David Rostcheck (6)

Active-Active Multi-Region Architectures.pdf
Active-Active Multi-Region Architectures.pdfActive-Active Multi-Region Architectures.pdf
Active-Active Multi-Region Architectures.pdf
 
Large Language Models - Chat AI.pdf
Large Language Models - Chat AI.pdfLarge Language Models - Chat AI.pdf
Large Language Models - Chat AI.pdf
 
NLP and personality analysis
NLP and personality analysisNLP and personality analysis
NLP and personality analysis
 
An introduction to Deep Learning
An introduction to Deep LearningAn introduction to Deep Learning
An introduction to Deep Learning
 
Introduction to Natural Language Processing
Introduction to Natural Language ProcessingIntroduction to Natural Language Processing
Introduction to Natural Language Processing
 
Breaking New Ground - David Rostcheck
Breaking New Ground - David RostcheckBreaking New Ground - David Rostcheck
Breaking New Ground - David Rostcheck
 

Dernier

Top profile Call Girls In Tumkur [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Tumkur [ 7014168258 ] Call Me For Genuine Models We...Top profile Call Girls In Tumkur [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Tumkur [ 7014168258 ] Call Me For Genuine Models We...
nirzagarg
 
Gartner's Data Analytics Maturity Model.pptx
Gartner's Data Analytics Maturity Model.pptxGartner's Data Analytics Maturity Model.pptx
Gartner's Data Analytics Maturity Model.pptx
chadhar227
 
Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...
Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...
Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...
gajnagarg
 
Sonagachi * best call girls in Kolkata | ₹,9500 Pay Cash 8005736733 Free Home...
Sonagachi * best call girls in Kolkata | ₹,9500 Pay Cash 8005736733 Free Home...Sonagachi * best call girls in Kolkata | ₹,9500 Pay Cash 8005736733 Free Home...
Sonagachi * best call girls in Kolkata | ₹,9500 Pay Cash 8005736733 Free Home...
HyderabadDolls
 
Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...
Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...
Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...
gajnagarg
 
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
ZurliaSoop
 
Top profile Call Girls In Indore [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Indore [ 7014168258 ] Call Me For Genuine Models We...Top profile Call Girls In Indore [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Indore [ 7014168258 ] Call Me For Genuine Models We...
gajnagarg
 
怎样办理圣地亚哥州立大学毕业证(SDSU毕业证书)成绩单学校原版复制
怎样办理圣地亚哥州立大学毕业证(SDSU毕业证书)成绩单学校原版复制怎样办理圣地亚哥州立大学毕业证(SDSU毕业证书)成绩单学校原版复制
怎样办理圣地亚哥州立大学毕业证(SDSU毕业证书)成绩单学校原版复制
vexqp
 
Top profile Call Girls In Hapur [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Hapur [ 7014168258 ] Call Me For Genuine Models We ...Top profile Call Girls In Hapur [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Hapur [ 7014168258 ] Call Me For Genuine Models We ...
nirzagarg
 
Top profile Call Girls In Bihar Sharif [ 7014168258 ] Call Me For Genuine Mod...
Top profile Call Girls In Bihar Sharif [ 7014168258 ] Call Me For Genuine Mod...Top profile Call Girls In Bihar Sharif [ 7014168258 ] Call Me For Genuine Mod...
Top profile Call Girls In Bihar Sharif [ 7014168258 ] Call Me For Genuine Mod...
nirzagarg
 
Top profile Call Girls In Satna [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Satna [ 7014168258 ] Call Me For Genuine Models We ...Top profile Call Girls In Satna [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Satna [ 7014168258 ] Call Me For Genuine Models We ...
nirzagarg
 

Dernier (20)

Top profile Call Girls In Tumkur [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Tumkur [ 7014168258 ] Call Me For Genuine Models We...Top profile Call Girls In Tumkur [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Tumkur [ 7014168258 ] Call Me For Genuine Models We...
 
Gartner's Data Analytics Maturity Model.pptx
Gartner's Data Analytics Maturity Model.pptxGartner's Data Analytics Maturity Model.pptx
Gartner's Data Analytics Maturity Model.pptx
 
DATA SUMMIT 24 Building Real-Time Pipelines With FLaNK
DATA SUMMIT 24  Building Real-Time Pipelines With FLaNKDATA SUMMIT 24  Building Real-Time Pipelines With FLaNK
DATA SUMMIT 24 Building Real-Time Pipelines With FLaNK
 
Predicting HDB Resale Prices - Conducting Linear Regression Analysis With Orange
Predicting HDB Resale Prices - Conducting Linear Regression Analysis With OrangePredicting HDB Resale Prices - Conducting Linear Regression Analysis With Orange
Predicting HDB Resale Prices - Conducting Linear Regression Analysis With Orange
 
Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...
Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...
Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...
 
Sonagachi * best call girls in Kolkata | ₹,9500 Pay Cash 8005736733 Free Home...
Sonagachi * best call girls in Kolkata | ₹,9500 Pay Cash 8005736733 Free Home...Sonagachi * best call girls in Kolkata | ₹,9500 Pay Cash 8005736733 Free Home...
Sonagachi * best call girls in Kolkata | ₹,9500 Pay Cash 8005736733 Free Home...
 
Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...
Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...
Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...
 
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
 
Fun all Day Call Girls in Jaipur 9332606886 High Profile Call Girls You Ca...
Fun all Day Call Girls in Jaipur   9332606886  High Profile Call Girls You Ca...Fun all Day Call Girls in Jaipur   9332606886  High Profile Call Girls You Ca...
Fun all Day Call Girls in Jaipur 9332606886 High Profile Call Girls You Ca...
 
Top profile Call Girls In Indore [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Indore [ 7014168258 ] Call Me For Genuine Models We...Top profile Call Girls In Indore [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Indore [ 7014168258 ] Call Me For Genuine Models We...
 
RESEARCH-FINAL-DEFENSE-PPT-TEMPLATE.pptx
RESEARCH-FINAL-DEFENSE-PPT-TEMPLATE.pptxRESEARCH-FINAL-DEFENSE-PPT-TEMPLATE.pptx
RESEARCH-FINAL-DEFENSE-PPT-TEMPLATE.pptx
 
怎样办理圣地亚哥州立大学毕业证(SDSU毕业证书)成绩单学校原版复制
怎样办理圣地亚哥州立大学毕业证(SDSU毕业证书)成绩单学校原版复制怎样办理圣地亚哥州立大学毕业证(SDSU毕业证书)成绩单学校原版复制
怎样办理圣地亚哥州立大学毕业证(SDSU毕业证书)成绩单学校原版复制
 
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
 
Top profile Call Girls In Hapur [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Hapur [ 7014168258 ] Call Me For Genuine Models We ...Top profile Call Girls In Hapur [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Hapur [ 7014168258 ] Call Me For Genuine Models We ...
 
Top profile Call Girls In Bihar Sharif [ 7014168258 ] Call Me For Genuine Mod...
Top profile Call Girls In Bihar Sharif [ 7014168258 ] Call Me For Genuine Mod...Top profile Call Girls In Bihar Sharif [ 7014168258 ] Call Me For Genuine Mod...
Top profile Call Girls In Bihar Sharif [ 7014168258 ] Call Me For Genuine Mod...
 
Top profile Call Girls In Satna [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Satna [ 7014168258 ] Call Me For Genuine Models We ...Top profile Call Girls In Satna [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Satna [ 7014168258 ] Call Me For Genuine Models We ...
 
Vadodara 💋 Call Girl 7737669865 Call Girls in Vadodara Escort service book now
Vadodara 💋 Call Girl 7737669865 Call Girls in Vadodara Escort service book nowVadodara 💋 Call Girl 7737669865 Call Girls in Vadodara Escort service book now
Vadodara 💋 Call Girl 7737669865 Call Girls in Vadodara Escort service book now
 
5CL-ADBA,5cladba, Chinese supplier, safety is guaranteed
5CL-ADBA,5cladba, Chinese supplier, safety is guaranteed5CL-ADBA,5cladba, Chinese supplier, safety is guaranteed
5CL-ADBA,5cladba, Chinese supplier, safety is guaranteed
 
Aspirational Block Program Block Syaldey District - Almora
Aspirational Block Program Block Syaldey District - AlmoraAspirational Block Program Block Syaldey District - Almora
Aspirational Block Program Block Syaldey District - Almora
 
TrafficWave Generator Will Instantly drive targeted and engaging traffic back...
TrafficWave Generator Will Instantly drive targeted and engaging traffic back...TrafficWave Generator Will Instantly drive targeted and engaging traffic back...
TrafficWave Generator Will Instantly drive targeted and engaging traffic back...
 

Data science as a professional career

  • 1. DATA SCIENCE as a new professional career
  • 2. What we will talk about • Data Science: • What is Data Science? • What kind of work to Data Scientists do? • Employment demand for Data Science jobs • What kind education is required? • What is Data Engineering, and how does it differ from Data Science? • What is the difference between Data Science and Business Intelligence?
  • 3. Who am I? • David Rostcheck • I’m a consulting Data Scientist • I have worked in various software roles (software engineer, enterprise architect, etc.) • My degree is in Physics • I write articles on Data Science on http://linkedin.com/in/davidrostcheck
  • 4. What is Data Science? • Data Science is industrial research on a company’s own data • Goal: produce advanced algorithms that produce a competitive advantage • Often work with unstructured data, may be large • “The qualifications for the job include the strength to tunnel through mountains of information and the vision to discern patterns where others see none” - Bloomberg Businessweek
  • 5. Is Data Science really science? Academic Science Industrial Research Teams PhDs, graduate students PhDs, technologists Setting University Company Publication Formal (academic publications, conferences) Less formal (blogs, white papers, open source) Funding Public grants Corporate Goal Advance human knowledge Create competitive advantage - Data Science is industrial science - It shares some attributes with academic science, but has other differences
  • 6. What kind of work do Data Scientists do? • Create Artificially Intelligent systems (“narrow AI”) • Examples: • Recommender systems • Self-driving cars • AI agents • Smart energy management • Medical diagnosis • Machine vision
  • 7. Data Science is in Demand • “The hot job of the decade… Data scientists today are akin to Wall Street “quants” of the 1980s and 1990s” - Harvard Business Review • “18.7% projected growth 2010-2020” - VentureBeat • “McKinsey projects […] ‘50 percent to 60 percent gap between supply and requisite demand’” - Bloomberg Businessweek
  • 8. On the other hand… • Some people believe Data Science itself will be automated • “New Teradata Platform Reduces Demand For Data Scientists” - Forbes • “Automating the Data Scientist” - MIT Technology Review
  • 9. What do I think? • Yes, advanced tools will automate some data exploration • But: research and communication (the fundamental skills), are always in demand when the world is changing • Data will continue to explode (Internet of Things) • We will see more change and faster change
  • 10. What is Data Engineering? • Specialized type of software engineering • Requires additional training in: • Data (SQL, NoSQL, data visualization) and Big Data (Hadoop, Apache Spark/Storm/Flink, cloud) • Machine Learning algorithms and platforms (ex. Dato) • Predictive APIs (ex. Watson) • Linear Algebra & Calculus really help to understand Machine Learning
  • 11. Data Engineering vs. Data Science Data Science Data Engineering Approach Scientific (Exploration) Engineering (Development) Problems Unbounded Bounded Path to Solution Iterative, exploratory, nonlinear Mostly linear Education More is better (PhD’s common) BS and/or self-trained Presentation Skills Important Not as important Research experience Important Not as important Programming skills Not as important Important Data skills Important Important
  • 12. Data Science vs. Business Intelligence Business Intelligence (BI) Data Science Data analysis Yes Yes Statistics Yes Yes Visualization Yes Yes Data Sources Usually SQL, often Data Warehouse Less structured (logs, cloud data, SQL, noSQL, text) Tools Statistics, Visualization Statistics, Machine Learning, Graph Analysis, NLP Focus Present and past Future Approach Analytic Scientific Goal Better strategic decisions Advanced functionality The two fields are closely related. In some ways Data Science is an evolution of BI.
  • 13. What industries use Data Science? • Now: Technology (employ over 50%), Education, Finance, Consulting, Health Care • But: “Technology” companies like Uber, Amazon, AirBnB compete in other industries (transportation, retail, hotels) • “Software is eating the world” – Andreessen Horowitz • What industries will AI change? Ultimately, all of them. • Incorporating AI == large business opportunity
  • 14. Education for Data Science/Engineering • Academic programs • Boot camps • Online classes (Coursera & Udacity) • For Data Engineering: • Documentation and webinars (self-education) • Focus on data manipulation tools and Machine Learning • For Data Science: • The more academic science and research expertise, the better • Focus on projects that solve unknown problems • Work with more experienced Data Scientists
  • 15. Questions? Contact me: drostcheck@leopardllc.com, twitter: @davidrostcheck Articles: http://linkedin.com/in/davidrostcheck
  • 16. “Big Data” • Specialized technologies and techniques for working with very large data sets • Often too big to process with one computer – need clusters and/or cloud computing • Data may change rapidly • Specialized tools: Map/Reduce, Apache Hadoop/Spark/Storm/Flink, Elastic, etc. • Large demand, but keep perspective: • Big Data tools can be more awkward • It is often easier to solve problems at small scale, then scale up, if possible

Notes de l'éditeur

  1. Statistically model human behavior Predict and respond to humans Understand natural language and the natural world Understand subtle patterns in big data
  2. - Machine Learning is here to stay
  3. On a large team, Data Science and Data Engineering are separate roles On a small team, a Data Scientist must do (at least some) of his/her own Data Engineering The roles are new and not strictly defined. Today, often one role is called by the other’s name.