SlideShare une entreprise Scribd logo
1  sur  46
Télécharger pour lire hors ligne
GTC 2016 — China
THE DEEP LEARNING
AI REVOLUTION
2
GPU DEEP LEARNING BIG BANG
Deep Learning NVIDIA GPU
NIPS (2012)
ImageNet Classification with Deep Convolutional
Neural Networks
Alex Krizhevsky
University of Toronto
Ilya Sutskever
University of Toronto
Geoffrey e. Hinton
University of Toronto
3
74%
96%
2010 2011 2012 2013 2014 2015
DL
GPU DEEP LEARNING ACHIEVES
“SUPERHUMAN” RESULTS
2012: Deep Learning researchers
worldwide discover GPUs
2015: DNN achieves
superhuman image recognition
2015: Deep Speech 2 achieves
superhuman voice recognition
ImageNet — Accuracy %
Human
Hand-coded CV
Microsoft,
Google
3.5% error rate
4
NVIDIA — “THE AI COMPUTING COMPANY”
GPU Computing Computer Graphics Artificial Intelligence
5
ANNOUNCING NEW GRAPHICS SDKS
Funhouse VR
Open Source
360 Video 1.0
Real-Time Panoramic VR
Iray VR
Photorealistic
VR Ray Tracing
GVDB
Sparse Volumes for
Special Effects
Remote Rendering
Video Compositing
Ansel
In-game Photography
Volumetric
Physical Light Models
OptiX 4.0
Multi-GPU Ray-Tracing
MDL 1.0
Physically Based Materials
Mental Ray
Now GPU-Accelerated!
6
7
NVIDIA VR FUNHOUSE
8
NVIDIA SILICON VALLEY HEADQUARTERS
9
GTC — 25X GROWTH IN GPU DL DEVELOPERS
4X Attendees 3X GPU Developers 25x Deep Learning Developers
2014
55,000400,00016,000
2,200
120,000
3,700
• Australia
• China
• Europe
• India
• Japan
• Korea
• United States
(Silicon Valley, D.C.)
20162014 2016
• Japan
• United States
• Higher Ed 35%
• Software 19%
• Internet 15%
• Auto 10%
• Government 5%
• Medical 4%
• Finance 4%
• Manufacturing 4%
2014 2016
10
WHY DID AI RESEARCHERS
ADOPT GPUs FOR DEEP LEARNING?
11
BRAIN IS LIKE A GPU
BRAIN CREATES MENTAL IMAGES WHEN WE THINK
12
GPU IS LIKE A BRAIN
13
GPU DEEP LEARNING
IS A NEW COMPUTING MODEL
Training
Device
Datacenter
14
GPU DEEP LEARNING
IS A NEW COMPUTING MODEL
Training
Device
Datacenter
TRAINING
Billions of Trillions of Operations
GPU train larger models,
accelerate time to market
15
GPU DEEP LEARNING
IS A NEW COMPUTING MODEL
Training
Device
Datacenter
DATACENTER INFERENCING
10s of billions of image, voice, video
queries per day
GPU inference for fast response,
maximize datacenter throughput
16
GPU DEEP LEARNING
IS A NEW COMPUTING MODEL
Training
Device
Datacenter
DEVICE INFERENCING
Billions of intelligent devices
GPU for real-time accurate response
17
AI — THE ULTIMATE
COMPUTING CHALLENGE
IMAGE RECOGNITION SPEECH RECOGNITION
Important Property of Neural Networks
Results get better with
more data +
bigger models +
more computation
(Better algorithms, new insights and
improved techniques always help, too!)
2012
AlexNet
2015
ResNet
152 layers
22.6 GFLOP/image
~3.5% error
8 layers
1.4 GFLOP/image
~16% Error
16X
Model
2014
Deep Speech 1
2015
Deep Speech 2
2 ExaFLOPS
25M | 7,000 Hours
~8% Error
10X
Training Ops
20 ExaFLOPS
100M | 12,000 Hours
~5% Error
18
PASCAL “5 MIRACLES”
BOOST DEEP LEARNING 65X
Pascal — 5 Miracles NVIDIA DGX-1 Supercomputer 65X in 4 yrs Accelerate Every Framework
PaddlePaddle
Baidu Deep Learning
Pascal
16nm FinFET
CoWoS HBM2
NVLink
cuDNN
Chart: Relative speed-up of images/sec vs K40 in 2013. AlexNet training throughput based on 20 iterations. CPU: 1x E5-2680v3 12 Core 2.5GHz. 128GB System Memory, Ubuntu 14.04. M40 datapoint: 8x M40 GPUs in a node P100: 8x P100 NVLink-enabled.
Kepler
Maxwell
Pascal
X
10X
20X
30X
40X
50X
60X
70X
2013 2014 2015 2016
19
ANNOUNCING
NEW IBM SERVER
POWER8 + NVIDIA TESLA P100
FOR THE AI ENTERPRISE
“ Putting NVIDIA’s technology into the IBM system will speed
up performance for such emerging workloads as AI, deep
learning and data analytics.” — eWeek
20
Andrew Ng, Chief Scientist
21
Training
Device
Datacenter
22
ANNOUNCING
TESLA P4 & P40
INFERENCING ACCELERATORS
Pascal Architecture | INT8
P40: 250W | 40X Energy Efficient versus CPU
P40: 250W | 40X Performance versus CPU
23
ANNOUNCING
TensorRT
PERFORMANCE OPTIMIZING
INFERENCING ENGINE
FP32, FP16, INT8 | Vertical & Horizontal Fusion | Auto-Tuning
VGG, GoogLeNet, ResNet, AlexNet & Custom Layers
Available Today: developer.nvidia.com/tensorrt
24
25
26
NVIDIA GPU
DEEP LEARNING EVERYWHERE
Alibaba/Aliyun
iQIYI
Shazam
Amazon
JD.com
Skype
Facebook
Orange
Twitter
Flickr
Periscope
Yahoo Supermarket
Google
Pinterest
Yandex
iFLYTEK
Qihoo 360
Yelp
eBay
Tencent
Netflix
Baidu
Sogou
Microsoft
27
>1,500 AI STARTUPS AROUND THE WORLD
Deep Learning
for Cybersecurity
Deep Learning
for Genomics
Deep Learning
for Self-Driving Cars
Deep Learning
for Art
28
AI STARTUPS IN CHINA
Weather & Environment
Forecast
Eye-tracking for Human-
machine Interaction
Medical
Imaging
Face
Recognition
Product Recognition,
Detection, Search
Personal
Concierge App
29
Training
Device
Datacenter
30
“BILLIONS OF INTELLIGENT DEVICES”
“Billions of intelligent devices will take advantage of DNNs
to provide personalization and localization as GPUs
become faster and faster over the next several years.”
— Tractica
31
AI CITY — 1B CAMERAS BY 2020
~1 billion cameras worldwide by 2020
 30 billion inferences/sec
Tesla P40: 2,500 inferences/sec @ 720P
 AI City needs ~10M P40 servers
DATA: 1B cameras, IHS “Video Surveillance Intelligence Service, Aug. 2016”
32
1/20TH
THE SPACE,
1/10TH
THE POWER
Hikvision Blade
16 Jetson TX1s
NVIDIA DGX-1 Traditional Server Hikvision Blade
~21 1U Servers
42 CPUs
~4,000 W
1 Hikvision Blade
16 TX1 + 1 CPU
>8 1080 streams
~300 W
33
ANNOUNCING NVIDIA AI CITY PARTNERS
34
AI TRANSPORTATION — $10T INDUSTRY
PERCEPTION AI PERCEPTION AI LOCALIZATION DRIVING AI
DEEP LEARNING
35
FREE SPACE DETECTION CAR 3D DETECTION
36
NVIDIA BB8 AI CAR
37
NVIDIA DRIVE PX 2
AutoCruise to Full Autonomy — One Architecture
Full Autonomy
AutoChauffeur
AutoCruise
AUTONOMOUS DRIVING
Perception, Reasoning, Driving
AI Supercomputing, AI Algorithms, Software
Scalable Architecture
38
NVIDIA DRIVE PX 2
AUTOCRUISE
10W AI Car Computer | Passive Cooling | Automotive IO
AI Highway Driving | Localization & Mapping
39
NVIDIA & BAIDU
PARTNER ON AI SELF-DRIVING CARS
40
NVIDIA AI SELF-DRIVING CARS
IN DEVELOPMENT
Baidu nuTonomy Volvo WEpods NVIDIA
41
NVIDIA END-TO-END
DEEP LEARNING PLATFORM
TRAINING
PaddlePaddle
Baidu Deep Learning
DGX-1TESLA P100
42
NVIDIA END-TO-END
DEEP LEARNING PLATFORM
TRAINING
PaddlePaddle
Baidu Deep Learning
DGX-1TESLA P100
DATACENTER INFERENCING
ANNOUNCING TESLA P4 & P40
ANNOUNCING
TensorRT
43
NVIDIA END-TO-END
DEEP LEARNING PLATFORM
TRAINING
PaddlePaddle
Baidu Deep Learning
DGX-1TESLA P100
DATACENTER INFERENCING
ANNOUNCING TESLA P4 & P40
ANNOUNCING
TensorRT
CUDA
JETPACK DRIVEWORKS
JETSON TX1
ANNOUNCING
DRIVE PX 2 AUTOCRUISE
INTELLIGENT DEVICES
44
NVIDIA DEEP LEARNING
PLATFORM PARTNERS
AI ENTERPRISE AI CITY AI CAR
45
AI FOR EVERYONE
AI will Revolutionize Transportation AI will Revolutionize Healthcare AI will Revolutionize Society
GTC China 2016

Contenu connexe

Tendances

Nvidia CES 2013 Highlights
Nvidia CES 2013 HighlightsNvidia CES 2013 Highlights
Nvidia CES 2013 Highlights
Brian Caulfield
 

Tendances (20)

2016 06 nvidia-isc_supercomputing_car_v02
2016 06 nvidia-isc_supercomputing_car_v022016 06 nvidia-isc_supercomputing_car_v02
2016 06 nvidia-isc_supercomputing_car_v02
 
GTC 2012 Jen-Hsun Huang Keynote
GTC 2012 Jen-Hsun Huang KeynoteGTC 2012 Jen-Hsun Huang Keynote
GTC 2012 Jen-Hsun Huang Keynote
 
Visual Computing: The Road Ahead, NVIDIA CEO Jen-Hsun Huang at CES 2015
Visual Computing: The Road Ahead, NVIDIA CEO Jen-Hsun Huang at CES 2015 Visual Computing: The Road Ahead, NVIDIA CEO Jen-Hsun Huang at CES 2015
Visual Computing: The Road Ahead, NVIDIA CEO Jen-Hsun Huang at CES 2015
 
GTC 2013 Jen-Hsun Huang Keynote
GTC 2013 Jen-Hsun Huang KeynoteGTC 2013 Jen-Hsun Huang Keynote
GTC 2013 Jen-Hsun Huang Keynote
 
NVIDIA CES 2016 Highlights
NVIDIA CES 2016 HighlightsNVIDIA CES 2016 Highlights
NVIDIA CES 2016 Highlights
 
NVIDIA Deep Learning Institute 2017 基調講演
NVIDIA Deep Learning Institute 2017 基調講演NVIDIA Deep Learning Institute 2017 基調講演
NVIDIA Deep Learning Institute 2017 基調講演
 
Enabling Artificial Intelligence - Alison B. Lowndes
Enabling Artificial Intelligence - Alison B. LowndesEnabling Artificial Intelligence - Alison B. Lowndes
Enabling Artificial Intelligence - Alison B. Lowndes
 
NVIDIA press conference at CES 2014
NVIDIA press conference at CES 2014NVIDIA press conference at CES 2014
NVIDIA press conference at CES 2014
 
Shattering AI Performance Records
Shattering AI Performance RecordsShattering AI Performance Records
Shattering AI Performance Records
 
GTC 2018: A New AI Era Dawns
GTC 2018: A New AI Era DawnsGTC 2018: A New AI Era Dawns
GTC 2018: A New AI Era Dawns
 
AI For Enterprise
AI For EnterpriseAI For Enterprise
AI For Enterprise
 
NVIDIA Is Revolutionizing Computing - June 2017
NVIDIA Is Revolutionizing Computing - June 2017 NVIDIA Is Revolutionizing Computing - June 2017
NVIDIA Is Revolutionizing Computing - June 2017
 
Nvidia CES 2013 Highlights
Nvidia CES 2013 HighlightsNvidia CES 2013 Highlights
Nvidia CES 2013 Highlights
 
Simplifying AI Infrastructure: Lessons in Scaling on DGX Systems
Simplifying AI Infrastructure: Lessons in Scaling on DGX SystemsSimplifying AI Infrastructure: Lessons in Scaling on DGX Systems
Simplifying AI Infrastructure: Lessons in Scaling on DGX Systems
 
NVIDIA Keynote #GTC21
NVIDIA Keynote #GTC21 NVIDIA Keynote #GTC21
NVIDIA Keynote #GTC21
 
GTC 2017 オートモーティブ最新情報
GTC 2017 オートモーティブ最新情報GTC 2017 オートモーティブ最新情報
GTC 2017 オートモーティブ最新情報
 
NVIDIA Corporation Brochure: Who We Are
NVIDIA Corporation Brochure: Who We AreNVIDIA Corporation Brochure: Who We Are
NVIDIA Corporation Brochure: Who We Are
 
Innovation Roundtable
Innovation RoundtableInnovation Roundtable
Innovation Roundtable
 
The What, Who & Why of NVIDIA
The What, Who & Why of NVIDIAThe What, Who & Why of NVIDIA
The What, Who & Why of NVIDIA
 
Top 5 Stories in Design and Visualization - Nov. 20, 2017
Top 5 Stories in Design and Visualization - Nov. 20, 2017Top 5 Stories in Design and Visualization - Nov. 20, 2017
Top 5 Stories in Design and Visualization - Nov. 20, 2017
 

En vedette

Affordable AI Connects To A Better Life
Affordable AI Connects To A Better LifeAffordable AI Connects To A Better Life
Affordable AI Connects To A Better Life
NVIDIA Taiwan
 
Google In China
Google In ChinaGoogle In China
Google In China
Arup Ghosh
 
ECCV2010: feature learning for image classification, part 4
ECCV2010: feature learning for image classification, part 4ECCV2010: feature learning for image classification, part 4
ECCV2010: feature learning for image classification, part 4
zukun
 

En vedette (20)

The AI Era Ignited by GPU Deep Learning
The AI Era Ignited by GPU Deep Learning The AI Era Ignited by GPU Deep Learning
The AI Era Ignited by GPU Deep Learning
 
CES 2017 Top 5 Stories
CES 2017 Top 5 StoriesCES 2017 Top 5 Stories
CES 2017 Top 5 Stories
 
CES 2017: NVIDIA Highlights
CES 2017: NVIDIA HighlightsCES 2017: NVIDIA Highlights
CES 2017: NVIDIA Highlights
 
NVIDIA – Inventor of the GPU
NVIDIA – Inventor of the GPUNVIDIA – Inventor of the GPU
NVIDIA – Inventor of the GPU
 
Introduction to multi gpu deep learning with DIGITS 2 - Mike Wang
Introduction to multi gpu deep learning with DIGITS 2 - Mike WangIntroduction to multi gpu deep learning with DIGITS 2 - Mike Wang
Introduction to multi gpu deep learning with DIGITS 2 - Mike Wang
 
Baidu World 2016 With NVIDIA CEO Jen-Hsun Huang
Baidu World 2016 With NVIDIA CEO Jen-Hsun HuangBaidu World 2016 With NVIDIA CEO Jen-Hsun Huang
Baidu World 2016 With NVIDIA CEO Jen-Hsun Huang
 
Nvidia SC16: The Greatest Challenges Can't Wait
Nvidia SC16: The Greatest Challenges Can't WaitNvidia SC16: The Greatest Challenges Can't Wait
Nvidia SC16: The Greatest Challenges Can't Wait
 
NVIDIA DGX-1 超級電腦與人工智慧及深度學習
NVIDIA DGX-1 超級電腦與人工智慧及深度學習NVIDIA DGX-1 超級電腦與人工智慧及深度學習
NVIDIA DGX-1 超級電腦與人工智慧及深度學習
 
A Year of Innovation Using the DGX-1 AI Supercomputer
A Year of Innovation Using the DGX-1 AI SupercomputerA Year of Innovation Using the DGX-1 AI Supercomputer
A Year of Innovation Using the DGX-1 AI Supercomputer
 
Affordable AI Connects To A Better Life
Affordable AI Connects To A Better LifeAffordable AI Connects To A Better Life
Affordable AI Connects To A Better Life
 
NVIDIA GPU ディープラーニング最新情報
NVIDIA GPU ディープラーニング最新情報NVIDIA GPU ディープラーニング最新情報
NVIDIA GPU ディープラーニング最新情報
 
Artificial Intelligence: Predictions for 2017
Artificial Intelligence: Predictions for 2017Artificial Intelligence: Predictions for 2017
Artificial Intelligence: Predictions for 2017
 
GTC 2016 基調講演からディープラーニング関連情報のご紹介
GTC 2016 基調講演からディープラーニング関連情報のご紹介GTC 2016 基調講演からディープラーニング関連情報のご紹介
GTC 2016 基調講演からディープラーニング関連情報のご紹介
 
DIGITS による物体検出入門
DIGITS による物体検出入門DIGITS による物体検出入門
DIGITS による物体検出入門
 
中国の最新 GPU ディープラーニング事例のご紹介
中国の最新 GPU ディープラーニング事例のご紹介中国の最新 GPU ディープラーニング事例のご紹介
中国の最新 GPU ディープラーニング事例のご紹介
 
人工知能に関する 2017 年のトレンド予測
人工知能に関する 2017 年のトレンド予測人工知能に関する 2017 年のトレンド予測
人工知能に関する 2017 年のトレンド予測
 
What is Deep Learning?
What is Deep Learning?What is Deep Learning?
What is Deep Learning?
 
Google In China
Google In ChinaGoogle In China
Google In China
 
ECCV2010: feature learning for image classification, part 4
ECCV2010: feature learning for image classification, part 4ECCV2010: feature learning for image classification, part 4
ECCV2010: feature learning for image classification, part 4
 
Deep learning tutorial (i)
Deep learning tutorial (i)Deep learning tutorial (i)
Deep learning tutorial (i)
 

Similaire à GTC China 2016

abelbrownnvidiarakuten2016-170208065814 (1).pptx
abelbrownnvidiarakuten2016-170208065814 (1).pptxabelbrownnvidiarakuten2016-170208065814 (1).pptx
abelbrownnvidiarakuten2016-170208065814 (1).pptx
gopikahari7
 

Similaire à GTC China 2016 (20)

Introduction to Deep Learning (NVIDIA)
Introduction to Deep Learning (NVIDIA)Introduction to Deep Learning (NVIDIA)
Introduction to Deep Learning (NVIDIA)
 
abelbrownnvidiarakuten2016-170208065814 (1).pptx
abelbrownnvidiarakuten2016-170208065814 (1).pptxabelbrownnvidiarakuten2016-170208065814 (1).pptx
abelbrownnvidiarakuten2016-170208065814 (1).pptx
 
BAT40 NVIDIA Stampfli Künstliche Intelligenz, Roboter und autonome Fahrzeuge ...
BAT40 NVIDIA Stampfli Künstliche Intelligenz, Roboter und autonome Fahrzeuge ...BAT40 NVIDIA Stampfli Künstliche Intelligenz, Roboter und autonome Fahrzeuge ...
BAT40 NVIDIA Stampfli Künstliche Intelligenz, Roboter und autonome Fahrzeuge ...
 
Aplicações Potenciais de Deep Learning à Indústria do Petróleo
Aplicações Potenciais de Deep Learning à Indústria do PetróleoAplicações Potenciais de Deep Learning à Indústria do Petróleo
Aplicações Potenciais de Deep Learning à Indústria do Petróleo
 
nVidia Presentation in OpenPOWER workshop Brazil
nVidia Presentation in OpenPOWER workshop BrazilnVidia Presentation in OpenPOWER workshop Brazil
nVidia Presentation in OpenPOWER workshop Brazil
 
JETSON : AI at the EDGE
JETSON : AI at the EDGEJETSON : AI at the EDGE
JETSON : AI at the EDGE
 
Fuelling the AI Revolution with Gaming
Fuelling the AI Revolution with GamingFuelling the AI Revolution with Gaming
Fuelling the AI Revolution with Gaming
 
Hardware in Space
Hardware in SpaceHardware in Space
Hardware in Space
 
Fueling the AI Revolution with Gaming
Fueling the AI Revolution with GamingFueling the AI Revolution with Gaming
Fueling the AI Revolution with Gaming
 
Alison B Lowndes - Fueling the Artificial Intelligence Revolution with Gaming...
Alison B Lowndes - Fueling the Artificial Intelligence Revolution with Gaming...Alison B Lowndes - Fueling the Artificial Intelligence Revolution with Gaming...
Alison B Lowndes - Fueling the Artificial Intelligence Revolution with Gaming...
 
Tales of AI agents saving the human race!
Tales of AI agents saving the human race!Tales of AI agents saving the human race!
Tales of AI agents saving the human race!
 
Nvidia why every industry should be thinking about AI today
Nvidia why every industry should be thinking about AI todayNvidia why every industry should be thinking about AI today
Nvidia why every industry should be thinking about AI today
 
Fuelling the AI Revolution with Gaming
Fuelling the AI Revolution with GamingFuelling the AI Revolution with Gaming
Fuelling the AI Revolution with Gaming
 
Harnessing the virtual realm for successful real world artificial intelligence
Harnessing the virtual realm for successful real world artificial intelligenceHarnessing the virtual realm for successful real world artificial intelligence
Harnessing the virtual realm for successful real world artificial intelligence
 
GTC World Tour 2017 highlights
GTC World Tour 2017 highlightsGTC World Tour 2017 highlights
GTC World Tour 2017 highlights
 
Accelerate AI w/ Synthetic Data using GANs
Accelerate AI w/ Synthetic Data using GANsAccelerate AI w/ Synthetic Data using GANs
Accelerate AI w/ Synthetic Data using GANs
 
AI, A New Computing Model
AI, A New Computing ModelAI, A New Computing Model
AI, A New Computing Model
 
DataArt
DataArtDataArt
DataArt
 
"The Vision AI Start-ups That Matter Most," a Presentation from Cognite Ventures
"The Vision AI Start-ups That Matter Most," a Presentation from Cognite Ventures"The Vision AI Start-ups That Matter Most," a Presentation from Cognite Ventures
"The Vision AI Start-ups That Matter Most," a Presentation from Cognite Ventures
 
AI + E-commerce
AI + E-commerceAI + E-commerce
AI + E-commerce
 

Plus de NVIDIA

NVIDIA GTC 2020 October Summary
NVIDIA GTC 2020 October SummaryNVIDIA GTC 2020 October Summary
NVIDIA GTC 2020 October Summary
NVIDIA
 

Plus de NVIDIA (20)

NVIDIA Story 2023.pdf
NVIDIA Story 2023.pdfNVIDIA Story 2023.pdf
NVIDIA Story 2023.pdf
 
NVIDIA GTC2022 Spring Highlights
NVIDIA GTC2022 Spring HighlightsNVIDIA GTC2022 Spring Highlights
NVIDIA GTC2022 Spring Highlights
 
NVIDIA Brochure 2021 Company Overview
NVIDIA Brochure 2021 Company OverviewNVIDIA Brochure 2021 Company Overview
NVIDIA Brochure 2021 Company Overview
 
NVIDIA GTC 2020 October Summary
NVIDIA GTC 2020 October SummaryNVIDIA GTC 2020 October Summary
NVIDIA GTC 2020 October Summary
 
The Best of AI and HPC in Healthcare and Life Sciences
The Best of AI and HPC in Healthcare and Life SciencesThe Best of AI and HPC in Healthcare and Life Sciences
The Best of AI and HPC in Healthcare and Life Sciences
 
NVIDIA CEO Jensen Huang Presentation at Supercomputing 2019
NVIDIA CEO Jensen Huang Presentation at Supercomputing 2019NVIDIA CEO Jensen Huang Presentation at Supercomputing 2019
NVIDIA CEO Jensen Huang Presentation at Supercomputing 2019
 
NLP for Biomedical Applications
NLP for Biomedical ApplicationsNLP for Biomedical Applications
NLP for Biomedical Applications
 
Top 5 Deep Learning and AI Stories - August 30, 2019
Top 5 Deep Learning and AI Stories - August 30, 2019Top 5 Deep Learning and AI Stories - August 30, 2019
Top 5 Deep Learning and AI Stories - August 30, 2019
 
Seven Ways to Boost Artificial Intelligence Research
Seven Ways to Boost Artificial Intelligence ResearchSeven Ways to Boost Artificial Intelligence Research
Seven Ways to Boost Artificial Intelligence Research
 
NVIDIA Developer Program Overview
NVIDIA Developer Program OverviewNVIDIA Developer Program Overview
NVIDIA Developer Program Overview
 
NVIDIA at Computex 2019
NVIDIA at Computex 2019 NVIDIA at Computex 2019
NVIDIA at Computex 2019
 
Top 5 DGX Sessions From GTC 2019
Top 5 DGX Sessions From GTC 2019Top 5 DGX Sessions From GTC 2019
Top 5 DGX Sessions From GTC 2019
 
DGX POD Top 4 Sessions From GTC 2019
DGX POD Top 4 Sessions From GTC 2019DGX POD Top 4 Sessions From GTC 2019
DGX POD Top 4 Sessions From GTC 2019
 
Top 5 Data Science Sessions from GTC 2019
Top 5 Data Science Sessions from GTC 2019Top 5 Data Science Sessions from GTC 2019
Top 5 Data Science Sessions from GTC 2019
 
This Week in Data Science - Top 5 News - April 26, 2019
This Week in Data Science - Top 5 News - April 26, 2019This Week in Data Science - Top 5 News - April 26, 2019
This Week in Data Science - Top 5 News - April 26, 2019
 
GTC 2019 Keynote in Silicon Valley
GTC 2019 Keynote in Silicon ValleyGTC 2019 Keynote in Silicon Valley
GTC 2019 Keynote in Silicon Valley
 
CUDA DLI Training Courses at GTC 2019
CUDA DLI Training Courses at GTC 2019CUDA DLI Training Courses at GTC 2019
CUDA DLI Training Courses at GTC 2019
 
DGX Sessions You Won't Want to Miss at GTC 2019
DGX Sessions You Won't Want to Miss at GTC 2019DGX Sessions You Won't Want to Miss at GTC 2019
DGX Sessions You Won't Want to Miss at GTC 2019
 
Transforming Healthcare at GTC Silicon Valley
Transforming Healthcare at GTC Silicon ValleyTransforming Healthcare at GTC Silicon Valley
Transforming Healthcare at GTC Silicon Valley
 
OpenACC Monthly Highlights February 2019
OpenACC Monthly Highlights February 2019OpenACC Monthly Highlights February 2019
OpenACC Monthly Highlights February 2019
 

Dernier

Dernier (20)

A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
HTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation StrategiesHTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation Strategies
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024
 
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live StreamsTop 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 

GTC China 2016

  • 1. GTC 2016 — China THE DEEP LEARNING AI REVOLUTION
  • 2. 2 GPU DEEP LEARNING BIG BANG Deep Learning NVIDIA GPU NIPS (2012) ImageNet Classification with Deep Convolutional Neural Networks Alex Krizhevsky University of Toronto Ilya Sutskever University of Toronto Geoffrey e. Hinton University of Toronto
  • 3. 3 74% 96% 2010 2011 2012 2013 2014 2015 DL GPU DEEP LEARNING ACHIEVES “SUPERHUMAN” RESULTS 2012: Deep Learning researchers worldwide discover GPUs 2015: DNN achieves superhuman image recognition 2015: Deep Speech 2 achieves superhuman voice recognition ImageNet — Accuracy % Human Hand-coded CV Microsoft, Google 3.5% error rate
  • 4. 4 NVIDIA — “THE AI COMPUTING COMPANY” GPU Computing Computer Graphics Artificial Intelligence
  • 5. 5 ANNOUNCING NEW GRAPHICS SDKS Funhouse VR Open Source 360 Video 1.0 Real-Time Panoramic VR Iray VR Photorealistic VR Ray Tracing GVDB Sparse Volumes for Special Effects Remote Rendering Video Compositing Ansel In-game Photography Volumetric Physical Light Models OptiX 4.0 Multi-GPU Ray-Tracing MDL 1.0 Physically Based Materials Mental Ray Now GPU-Accelerated!
  • 6. 6
  • 8. 8 NVIDIA SILICON VALLEY HEADQUARTERS
  • 9. 9 GTC — 25X GROWTH IN GPU DL DEVELOPERS 4X Attendees 3X GPU Developers 25x Deep Learning Developers 2014 55,000400,00016,000 2,200 120,000 3,700 • Australia • China • Europe • India • Japan • Korea • United States (Silicon Valley, D.C.) 20162014 2016 • Japan • United States • Higher Ed 35% • Software 19% • Internet 15% • Auto 10% • Government 5% • Medical 4% • Finance 4% • Manufacturing 4% 2014 2016
  • 10. 10 WHY DID AI RESEARCHERS ADOPT GPUs FOR DEEP LEARNING?
  • 11. 11 BRAIN IS LIKE A GPU BRAIN CREATES MENTAL IMAGES WHEN WE THINK
  • 12. 12 GPU IS LIKE A BRAIN
  • 13. 13 GPU DEEP LEARNING IS A NEW COMPUTING MODEL Training Device Datacenter
  • 14. 14 GPU DEEP LEARNING IS A NEW COMPUTING MODEL Training Device Datacenter TRAINING Billions of Trillions of Operations GPU train larger models, accelerate time to market
  • 15. 15 GPU DEEP LEARNING IS A NEW COMPUTING MODEL Training Device Datacenter DATACENTER INFERENCING 10s of billions of image, voice, video queries per day GPU inference for fast response, maximize datacenter throughput
  • 16. 16 GPU DEEP LEARNING IS A NEW COMPUTING MODEL Training Device Datacenter DEVICE INFERENCING Billions of intelligent devices GPU for real-time accurate response
  • 17. 17 AI — THE ULTIMATE COMPUTING CHALLENGE IMAGE RECOGNITION SPEECH RECOGNITION Important Property of Neural Networks Results get better with more data + bigger models + more computation (Better algorithms, new insights and improved techniques always help, too!) 2012 AlexNet 2015 ResNet 152 layers 22.6 GFLOP/image ~3.5% error 8 layers 1.4 GFLOP/image ~16% Error 16X Model 2014 Deep Speech 1 2015 Deep Speech 2 2 ExaFLOPS 25M | 7,000 Hours ~8% Error 10X Training Ops 20 ExaFLOPS 100M | 12,000 Hours ~5% Error
  • 18. 18 PASCAL “5 MIRACLES” BOOST DEEP LEARNING 65X Pascal — 5 Miracles NVIDIA DGX-1 Supercomputer 65X in 4 yrs Accelerate Every Framework PaddlePaddle Baidu Deep Learning Pascal 16nm FinFET CoWoS HBM2 NVLink cuDNN Chart: Relative speed-up of images/sec vs K40 in 2013. AlexNet training throughput based on 20 iterations. CPU: 1x E5-2680v3 12 Core 2.5GHz. 128GB System Memory, Ubuntu 14.04. M40 datapoint: 8x M40 GPUs in a node P100: 8x P100 NVLink-enabled. Kepler Maxwell Pascal X 10X 20X 30X 40X 50X 60X 70X 2013 2014 2015 2016
  • 19. 19 ANNOUNCING NEW IBM SERVER POWER8 + NVIDIA TESLA P100 FOR THE AI ENTERPRISE “ Putting NVIDIA’s technology into the IBM system will speed up performance for such emerging workloads as AI, deep learning and data analytics.” — eWeek
  • 20. 20 Andrew Ng, Chief Scientist
  • 22. 22 ANNOUNCING TESLA P4 & P40 INFERENCING ACCELERATORS Pascal Architecture | INT8 P40: 250W | 40X Energy Efficient versus CPU P40: 250W | 40X Performance versus CPU
  • 23. 23 ANNOUNCING TensorRT PERFORMANCE OPTIMIZING INFERENCING ENGINE FP32, FP16, INT8 | Vertical & Horizontal Fusion | Auto-Tuning VGG, GoogLeNet, ResNet, AlexNet & Custom Layers Available Today: developer.nvidia.com/tensorrt
  • 24. 24
  • 25. 25
  • 26. 26 NVIDIA GPU DEEP LEARNING EVERYWHERE Alibaba/Aliyun iQIYI Shazam Amazon JD.com Skype Facebook Orange Twitter Flickr Periscope Yahoo Supermarket Google Pinterest Yandex iFLYTEK Qihoo 360 Yelp eBay Tencent Netflix Baidu Sogou Microsoft
  • 27. 27 >1,500 AI STARTUPS AROUND THE WORLD Deep Learning for Cybersecurity Deep Learning for Genomics Deep Learning for Self-Driving Cars Deep Learning for Art
  • 28. 28 AI STARTUPS IN CHINA Weather & Environment Forecast Eye-tracking for Human- machine Interaction Medical Imaging Face Recognition Product Recognition, Detection, Search Personal Concierge App
  • 30. 30 “BILLIONS OF INTELLIGENT DEVICES” “Billions of intelligent devices will take advantage of DNNs to provide personalization and localization as GPUs become faster and faster over the next several years.” — Tractica
  • 31. 31 AI CITY — 1B CAMERAS BY 2020 ~1 billion cameras worldwide by 2020  30 billion inferences/sec Tesla P40: 2,500 inferences/sec @ 720P  AI City needs ~10M P40 servers DATA: 1B cameras, IHS “Video Surveillance Intelligence Service, Aug. 2016”
  • 32. 32 1/20TH THE SPACE, 1/10TH THE POWER Hikvision Blade 16 Jetson TX1s NVIDIA DGX-1 Traditional Server Hikvision Blade ~21 1U Servers 42 CPUs ~4,000 W 1 Hikvision Blade 16 TX1 + 1 CPU >8 1080 streams ~300 W
  • 33. 33 ANNOUNCING NVIDIA AI CITY PARTNERS
  • 34. 34 AI TRANSPORTATION — $10T INDUSTRY PERCEPTION AI PERCEPTION AI LOCALIZATION DRIVING AI DEEP LEARNING
  • 35. 35 FREE SPACE DETECTION CAR 3D DETECTION
  • 37. 37 NVIDIA DRIVE PX 2 AutoCruise to Full Autonomy — One Architecture Full Autonomy AutoChauffeur AutoCruise AUTONOMOUS DRIVING Perception, Reasoning, Driving AI Supercomputing, AI Algorithms, Software Scalable Architecture
  • 38. 38 NVIDIA DRIVE PX 2 AUTOCRUISE 10W AI Car Computer | Passive Cooling | Automotive IO AI Highway Driving | Localization & Mapping
  • 39. 39 NVIDIA & BAIDU PARTNER ON AI SELF-DRIVING CARS
  • 40. 40 NVIDIA AI SELF-DRIVING CARS IN DEVELOPMENT Baidu nuTonomy Volvo WEpods NVIDIA
  • 41. 41 NVIDIA END-TO-END DEEP LEARNING PLATFORM TRAINING PaddlePaddle Baidu Deep Learning DGX-1TESLA P100
  • 42. 42 NVIDIA END-TO-END DEEP LEARNING PLATFORM TRAINING PaddlePaddle Baidu Deep Learning DGX-1TESLA P100 DATACENTER INFERENCING ANNOUNCING TESLA P4 & P40 ANNOUNCING TensorRT
  • 43. 43 NVIDIA END-TO-END DEEP LEARNING PLATFORM TRAINING PaddlePaddle Baidu Deep Learning DGX-1TESLA P100 DATACENTER INFERENCING ANNOUNCING TESLA P4 & P40 ANNOUNCING TensorRT CUDA JETPACK DRIVEWORKS JETSON TX1 ANNOUNCING DRIVE PX 2 AUTOCRUISE INTELLIGENT DEVICES
  • 44. 44 NVIDIA DEEP LEARNING PLATFORM PARTNERS AI ENTERPRISE AI CITY AI CAR
  • 45. 45 AI FOR EVERYONE AI will Revolutionize Transportation AI will Revolutionize Healthcare AI will Revolutionize Society