SlideShare une entreprise Scribd logo
1  sur  19
EdgeAI
The future of edge computing
Mentor
Mentor
Serena
DAYAL
95 total interviews
Day One:
Offering a custom silicon chip with
new embedded memories and a
custom Machine Learning
accelerator targeting low-power,
high-throughput, and low-latency
applications.
Today:
Enable AI vision applications
on next generation battery
powered surveillance
cameras.
Massimo
GIORDANO
Kartik
PRABHU
Jo
ZHU
Weier
WAN
Alon
DROR
Picker
PhD, EE
Hacker
PhD, EE
Hustler
MBA, M.Ed
Designer
PhD, EE
Hustler
MBA
Dave
NEWMAN
EDGE AI - THE FIRST ALL-IN-ONE AI CHIP
● In the lab, we:
○ 2 years of research and development
○ Collaboration with a foundry that offers the new memory
○ Built the first all-in-one AI chip prototype
Our already
fabricated AI chip
Possible use cases
We envisioned
● Objective: Enabling new AI applications at the edge, with a
faster and lower power DNN accelerator enabled by new
memory technology (Resistive RAM).
Unclear purpose statement
?What does it mean?
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1
WEEK 1 - EdgeAI was:
● A silicon AI accelerator with new
memories for low power and high
performance inference on edge
devices
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1
EdgeAI
Security
Cameras
WEEK 1 - EdgeAI was:
● A silicon AI accelerator with new
memories for low power and high
performance inference on edge
devices
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1
EdgeAI
Security
Cameras
No need for AI accelerator (Not compute
intensive)
Wrong power target (0.1 mW instead of
100mW)
WEEK 1 - EdgeAI was:
● A silicon AI accelerator with new
memories for low power and high
performance inference on edge
devices
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1
EdgeAI
Security
Cameras
Computation power much smaller than
propulsion power
WEEK 1 - EdgeAI was:
● A silicon AI accelerator with new
memories for low power and high
performance inference on edge
devices
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1
EdgeAI
Security
Cameras
High-end products can afford expensive
hardware (GPUs)
Needs high compute power (4k images at
60fps) - hard to compete with NVIDIA
GPUs
Battery life is not critical
By WEEK 2 we got confused
Other embedded non-volatile memories offer similar performance
Competitors already use eFLASH and MRAM
eFLASH won’t
scale, but TODAY
has the same
performance of
RRAM.
MRAM offers
the same
benefits of
RRAM
We FORGOT why
RRAM was great...
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1
“Lost in Space”: How we reached market fit!
● Radiation resilient & affordable alternative to FPGAs for AI applications in space
almost
Huge interest from NASA engineers:
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1
Market:
● Big satellites (NASA & ESA)
● Nano satellites
“A huge
opportunity!
We can help you
make this happen.
Let’s write a grant
together”
“Lost in Space”: How we reached market fit!
almost
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1
● Big satellites (NASA & ESA)
○ RRAM is resistant to radiation, but is still not space graded
● Nano satellites
○ Small-market, 1000 satellite/year less than 10k whole mission
“I just launched into space an Intel’s Myriad
vision processor” - AI expert, ESA
Commercial products already sent in space
Users Customers
Focusing on the value proposition
AHA moment:
“Who cares about RRAM?!
What matter is what we do with it!”
Heidi Roizen
Threshold Ventures
Focus on
the value
proposition!
What is unique to RRAM,
that is otherwise NOT possible?
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1
Customers Need AI!
“Something that consumes 10mWh/day
would be amazing”
- Ring
“Currently I need a GPU card for
every camera and most of the time
nothing is happening”
“AI would solve a lot of problems,
but it consumes too much power”
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1
Searching for Optimal Product/Market Fit
● Low-power solutions can not run large complex DNNs
● High-performance compute consumes a lot of power
Low-power…
but can’t do much!
Prius
High performance…
but high power!
vs.
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1
Aha! RRAM Enables No Idle Power. Search for these customers!
● Great specs for AI
● No power to retain memory
● Fast wake-up
Edge AI
High-performance
when needed
10ms 1 second
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1
It goes FAST!
But no power when
stopped.
We Find Product/Market Fit!
● Edge AI supports 50MB DNN models, capable of waking-up and
performing 1 inference in just 1 mJ
Solar panel
provides
only
5 mW*h/day
We enable AI vision
on solar-powered
security camera
Not possible today!
Higher security,
Fewer false alarms
No need to change batteries
Happier
customers!
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1
MVP: smart security cameras w/o changing batteries
We are really efficient in doing this
1 frame / second
No person
Person
10 MB model
1mJ
30 frame / second
higher resolution
0.3%
Face recognition
40 MB model
5 mJ
Owner Unknown
Less Efficient but infrequent
10%
Unsafe
1000 MB model
200 mJ
safe
Above memory
available on-chip
Limited power
budget
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1
Aha! Software is Key! Use Existing AI IP
● Custom ML accelerator needs complex software stack (hard to accomplish)
● Instead, use an existing AI IP that offers the full software stack (Expedera)
“We’ve spent a lot of time
writing software for our current
chip, and can’t afford to redo
everything for a new chip” -
Embedded systems startup
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1
Quick wake-up powerful
AI acceleration that
consume no power
when idle
IP providers
Only chips: OEM
TSMC
already
collaborating
IC Design Tools
Software
Run infrequent
complex AI tasks
preserving battery life.
Engineering,
Development
Customer
Customization
Work with
customers to enable
their applications
Supply Chain
IP protection
Provide custom features
based on customer need
Physical: System
Integrator
Radiation resistant,
space-graded AI ASIC
accelerators
NASA, ESA
Sell custom-designed silicon
chips
Development: MPW runs, EDA tools, IP licenses,
Packagings, mask costs
Develop custom silicon
Contracts for AI expert
consulting for co-designing
specific applications
Develop custom
DNN accelerators
AI IP with full
software support
Enable new AI applications
on their device Product Managers
Offering new AI features
EE/CS Engineers
Development and design
Smart AI
battery
powered
Cameras
Lower-power
compute
Ease of
integration
and use
What’s Next:
● More product validation:
○ Further potential customers interviews
● Run pilots:
○ With various security cameras and doorbells companies
● Fabricate 2nd silicon chip:
○ Scheduled for October 2021
● Raise first seed investment in Q3-Q4 ‘21
○ Development of end-to-end prototype
Contact us: Massimo Giordano - mgiordan@stanford.edu
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1

Contenu connexe

Tendances

2425 file 090408_mc_kinsey_presentation_ifc
2425 file 090408_mc_kinsey_presentation_ifc2425 file 090408_mc_kinsey_presentation_ifc
2425 file 090408_mc_kinsey_presentation_ifc
naman8181
 

Tendances (20)

Datastax - The Architect's guide to customer experience (CX)
Datastax - The Architect's guide to customer experience (CX)Datastax - The Architect's guide to customer experience (CX)
Datastax - The Architect's guide to customer experience (CX)
 
How AstraZeneca is Applying AI, Imaging & Data Analytics (AI-Driven Drug Deve...
How AstraZeneca is Applying AI, Imaging & Data Analytics (AI-Driven Drug Deve...How AstraZeneca is Applying AI, Imaging & Data Analytics (AI-Driven Drug Deve...
How AstraZeneca is Applying AI, Imaging & Data Analytics (AI-Driven Drug Deve...
 
Federal Technology Vision 2021: Full U.S. Federal Survey Findings | Accenture
Federal Technology Vision 2021: Full U.S. Federal Survey Findings | AccentureFederal Technology Vision 2021: Full U.S. Federal Survey Findings | Accenture
Federal Technology Vision 2021: Full U.S. Federal Survey Findings | Accenture
 
20200629 covid 19-global auto consumer insights_wave3_vf_web
20200629 covid 19-global auto consumer insights_wave3_vf_web20200629 covid 19-global auto consumer insights_wave3_vf_web
20200629 covid 19-global auto consumer insights_wave3_vf_web
 
EY Power transactions and trends: Q3 2018
EY Power transactions and trends: Q3 2018EY Power transactions and trends: Q3 2018
EY Power transactions and trends: Q3 2018
 
Team LiOn Batteries - 2022 Technology, Innovation & Great Power Competition
Team LiOn Batteries  - 2022 Technology, Innovation & Great Power CompetitionTeam LiOn Batteries  - 2022 Technology, Innovation & Great Power Competition
Team LiOn Batteries - 2022 Technology, Innovation & Great Power Competition
 
Data Architecture Strategies: Building an Enterprise Data Strategy – Where to...
Data Architecture Strategies: Building an Enterprise Data Strategy – Where to...Data Architecture Strategies: Building an Enterprise Data Strategy – Where to...
Data Architecture Strategies: Building an Enterprise Data Strategy – Where to...
 
2425 file 090408_mc_kinsey_presentation_ifc
2425 file 090408_mc_kinsey_presentation_ifc2425 file 090408_mc_kinsey_presentation_ifc
2425 file 090408_mc_kinsey_presentation_ifc
 
Right Cloud Mindset: Survey Results Hospitality | Accenture
Right Cloud Mindset: Survey Results Hospitality | AccentureRight Cloud Mindset: Survey Results Hospitality | Accenture
Right Cloud Mindset: Survey Results Hospitality | Accenture
 
Semiconductor Industry Tutorial
Semiconductor Industry TutorialSemiconductor Industry Tutorial
Semiconductor Industry Tutorial
 
New horizons in transportation: mobility, innovation, economic development an...
New horizons in transportation: mobility, innovation, economic development an...New horizons in transportation: mobility, innovation, economic development an...
New horizons in transportation: mobility, innovation, economic development an...
 
矽智財產業報告.pdf
矽智財產業報告.pdf矽智財產業報告.pdf
矽智財產業報告.pdf
 
The FDA and industry: A recipe for collaborating in the New Health Economy
The FDA and industry:  A recipe for collaborating in the New Health EconomyThe FDA and industry:  A recipe for collaborating in the New Health Economy
The FDA and industry: A recipe for collaborating in the New Health Economy
 
Dark Side of AI in Healthcare
Dark Side of AI in HealthcareDark Side of AI in Healthcare
Dark Side of AI in Healthcare
 
Team Army venture capital - 2021 Technology, Innovation & Great Power Competi...
Team Army venture capital - 2021 Technology, Innovation & Great Power Competi...Team Army venture capital - 2021 Technology, Innovation & Great Power Competi...
Team Army venture capital - 2021 Technology, Innovation & Great Power Competi...
 
2019 Media and Entertainment Study
2019 Media and Entertainment Study2019 Media and Entertainment Study
2019 Media and Entertainment Study
 
Pursuing Customer Inspired Growth
Pursuing Customer Inspired GrowthPursuing Customer Inspired Growth
Pursuing Customer Inspired Growth
 
Guide to Data Monetization
Guide to Data MonetizationGuide to Data Monetization
Guide to Data Monetization
 
Cloud value in cash management
Cloud value in cash managementCloud value in cash management
Cloud value in cash management
 
Tracxn - Top Business Models - Energy Tech - Mar 2022
Tracxn  - Top Business Models - Energy Tech - Mar 2022Tracxn  - Top Business Models - Energy Tech - Mar 2022
Tracxn - Top Business Models - Energy Tech - Mar 2022
 

Similaire à Edgeai Engr245 2021 Lessons Learned

A Tale of Two Systems - Insights from Software Architecture
A Tale of Two Systems - Insights from Software ArchitectureA Tale of Two Systems - Insights from Software Architecture
A Tale of Two Systems - Insights from Software Architecture
David Max
 
"Processor Options for Edge Inference: Options and Trade-offs," a Presentatio...
"Processor Options for Edge Inference: Options and Trade-offs," a Presentatio..."Processor Options for Edge Inference: Options and Trade-offs," a Presentatio...
"Processor Options for Edge Inference: Options and Trade-offs," a Presentatio...
Edge AI and Vision Alliance
 
"Enabling Ubiquitous Visual Intelligence Through Deep Learning," a Keynote Pr...
"Enabling Ubiquitous Visual Intelligence Through Deep Learning," a Keynote Pr..."Enabling Ubiquitous Visual Intelligence Through Deep Learning," a Keynote Pr...
"Enabling Ubiquitous Visual Intelligence Through Deep Learning," a Keynote Pr...
Edge AI and Vision Alliance
 

Similaire à Edgeai Engr245 2021 Lessons Learned (20)

Lean Startup, Hardware Edition
Lean Startup, Hardware EditionLean Startup, Hardware Edition
Lean Startup, Hardware Edition
 
Microcontrollers for Artificial Intelligence and Machine Learning
Microcontrollers for Artificial Intelligence and Machine LearningMicrocontrollers for Artificial Intelligence and Machine Learning
Microcontrollers for Artificial Intelligence and Machine Learning
 
Artificial Intelligence in practice - Gerbert Kaandorp - Codemotion Amsterdam...
Artificial Intelligence in practice - Gerbert Kaandorp - Codemotion Amsterdam...Artificial Intelligence in practice - Gerbert Kaandorp - Codemotion Amsterdam...
Artificial Intelligence in practice - Gerbert Kaandorp - Codemotion Amsterdam...
 
David Max: A Tale of Two Systems | Nowhere Developers 2018
David Max: A Tale of Two Systems | Nowhere Developers 2018David Max: A Tale of Two Systems | Nowhere Developers 2018
David Max: A Tale of Two Systems | Nowhere Developers 2018
 
Live Data: For When Data is Greater than Memory
Live Data: For When Data is Greater than MemoryLive Data: For When Data is Greater than Memory
Live Data: For When Data is Greater than Memory
 
Weebit nano presentation at Leti Memory Workshop
Weebit nano presentation at Leti Memory WorkshopWeebit nano presentation at Leti Memory Workshop
Weebit nano presentation at Leti Memory Workshop
 
A Tale of Two Systems - Insights from Software Architecture
A Tale of Two Systems - Insights from Software ArchitectureA Tale of Two Systems - Insights from Software Architecture
A Tale of Two Systems - Insights from Software Architecture
 
Artificial Intelligence in Small Embedded System
Artificial Intelligence in Small Embedded SystemArtificial Intelligence in Small Embedded System
Artificial Intelligence in Small Embedded System
 
Deep Learning on Everyday Devices
Deep Learning on Everyday DevicesDeep Learning on Everyday Devices
Deep Learning on Everyday Devices
 
"Processor Options for Edge Inference: Options and Trade-offs," a Presentatio...
"Processor Options for Edge Inference: Options and Trade-offs," a Presentatio..."Processor Options for Edge Inference: Options and Trade-offs," a Presentatio...
"Processor Options for Edge Inference: Options and Trade-offs," a Presentatio...
 
Neuromophic device for Automotive
Neuromophic device for AutomotiveNeuromophic device for Automotive
Neuromophic device for Automotive
 
Application Optimized Performance: Choosing the Right Instance (CPN212) | AWS...
Application Optimized Performance: Choosing the Right Instance (CPN212) | AWS...Application Optimized Performance: Choosing the Right Instance (CPN212) | AWS...
Application Optimized Performance: Choosing the Right Instance (CPN212) | AWS...
 
"Enabling Ubiquitous Visual Intelligence Through Deep Learning," a Keynote Pr...
"Enabling Ubiquitous Visual Intelligence Through Deep Learning," a Keynote Pr..."Enabling Ubiquitous Visual Intelligence Through Deep Learning," a Keynote Pr...
"Enabling Ubiquitous Visual Intelligence Through Deep Learning," a Keynote Pr...
 
E3MV - Embedded Vision - Sundance
E3MV - Embedded Vision - SundanceE3MV - Embedded Vision - Sundance
E3MV - Embedded Vision - Sundance
 
Inspur: Open Hardware in Hyperscale Datacenters
Inspur: Open Hardware in Hyperscale Datacenters Inspur: Open Hardware in Hyperscale Datacenters
Inspur: Open Hardware in Hyperscale Datacenters
 
2016-JAN-28 -- High Performance Production Databases on Ceph
2016-JAN-28 -- High Performance Production Databases on Ceph2016-JAN-28 -- High Performance Production Databases on Ceph
2016-JAN-28 -- High Performance Production Databases on Ceph
 
Accelerating algorithmic and hardware advancements for power efficient on-dev...
Accelerating algorithmic and hardware advancements for power efficient on-dev...Accelerating algorithmic and hardware advancements for power efficient on-dev...
Accelerating algorithmic and hardware advancements for power efficient on-dev...
 
Childhood Dream to Pi World Record by Emma Haruka, Developer Advocate @Google
Childhood Dream to Pi World Record by Emma Haruka, Developer Advocate @GoogleChildhood Dream to Pi World Record by Emma Haruka, Developer Advocate @Google
Childhood Dream to Pi World Record by Emma Haruka, Developer Advocate @Google
 
How flash responds to different AIoT needs -- C&T RF Antennas Inc
How flash responds to different AIoT needs -- C&T RF Antennas IncHow flash responds to different AIoT needs -- C&T RF Antennas Inc
How flash responds to different AIoT needs -- C&T RF Antennas Inc
 
Think Silicon at Open Coffee Athens XCIV
Think Silicon at Open Coffee Athens XCIVThink Silicon at Open Coffee Athens XCIV
Think Silicon at Open Coffee Athens XCIV
 

Plus de Stanford University

Plus de Stanford University (20)

Team Networks - 2022 Technology, Innovation & Great Power Competition
Team Networks  - 2022 Technology, Innovation & Great Power CompetitionTeam Networks  - 2022 Technology, Innovation & Great Power Competition
Team Networks - 2022 Technology, Innovation & Great Power Competition
 
Team Quantum - 2022 Technology, Innovation & Great Power Competition
Team Quantum  - 2022 Technology, Innovation & Great Power CompetitionTeam Quantum  - 2022 Technology, Innovation & Great Power Competition
Team Quantum - 2022 Technology, Innovation & Great Power Competition
 
Team Disinformation - 2022 Technology, Innovation & Great Power Competition
Team Disinformation  - 2022 Technology, Innovation & Great Power CompetitionTeam Disinformation  - 2022 Technology, Innovation & Great Power Competition
Team Disinformation - 2022 Technology, Innovation & Great Power Competition
 
Team Wargames - 2022 Technology, Innovation & Great Power Competition
Team Wargames  - 2022 Technology, Innovation & Great Power CompetitionTeam Wargames  - 2022 Technology, Innovation & Great Power Competition
Team Wargames - 2022 Technology, Innovation & Great Power Competition
 
Team Acquistion - 2022 Technology, Innovation & Great Power Competition
Team Acquistion  - 2022 Technology, Innovation & Great Power Competition Team Acquistion  - 2022 Technology, Innovation & Great Power Competition
Team Acquistion - 2022 Technology, Innovation & Great Power Competition
 
Team Climate Change - 2022 Technology, Innovation & Great Power Competition
Team Climate Change - 2022 Technology, Innovation & Great Power Competition Team Climate Change - 2022 Technology, Innovation & Great Power Competition
Team Climate Change - 2022 Technology, Innovation & Great Power Competition
 
Altuna Engr245 2022 Lessons Learned
Altuna Engr245 2022 Lessons LearnedAltuna Engr245 2022 Lessons Learned
Altuna Engr245 2022 Lessons Learned
 
Invisa Engr245 2022 Lessons Learned
Invisa Engr245 2022 Lessons LearnedInvisa Engr245 2022 Lessons Learned
Invisa Engr245 2022 Lessons Learned
 
ānanda Engr245 2022 Lessons Learned
ānanda Engr245 2022 Lessons Learnedānanda Engr245 2022 Lessons Learned
ānanda Engr245 2022 Lessons Learned
 
Gordian Knot Center Roundtable w/Depty SecDef
Gordian Knot Center Roundtable w/Depty SecDef Gordian Knot Center Roundtable w/Depty SecDef
Gordian Knot Center Roundtable w/Depty SecDef
 
Team Army venture capital - 2021 Technology, Innovation & Great Power Competi...
Team Army venture capital - 2021 Technology, Innovation & Great Power Competi...Team Army venture capital - 2021 Technology, Innovation & Great Power Competi...
Team Army venture capital - 2021 Technology, Innovation & Great Power Competi...
 
Team Catena - 2021 Technology, Innovation & Great Power Competition
Team Catena - 2021 Technology, Innovation & Great Power CompetitionTeam Catena - 2021 Technology, Innovation & Great Power Competition
Team Catena - 2021 Technology, Innovation & Great Power Competition
 
Team Apollo - 2021 Technology, Innovation & Great Power Competition
Team Apollo - 2021 Technology, Innovation & Great Power CompetitionTeam Apollo - 2021 Technology, Innovation & Great Power Competition
Team Apollo - 2021 Technology, Innovation & Great Power Competition
 
Team Drone - 2021 Technology, Innovation & Great Power Competition
Team Drone - 2021 Technology, Innovation & Great Power CompetitionTeam Drone - 2021 Technology, Innovation & Great Power Competition
Team Drone - 2021 Technology, Innovation & Great Power Competition
 
Team Short Circuit - 2021 Technology, Innovation & Great Power Competition
Team Short Circuit - 2021 Technology, Innovation & Great Power CompetitionTeam Short Circuit - 2021 Technology, Innovation & Great Power Competition
Team Short Circuit - 2021 Technology, Innovation & Great Power Competition
 
Team Aurora - 2021 Technology, Innovation & Great Power Competition
Team Aurora - 2021 Technology, Innovation & Great Power CompetitionTeam Aurora - 2021 Technology, Innovation & Great Power Competition
Team Aurora - 2021 Technology, Innovation & Great Power Competition
 
Team Conflicted Capital Team - 2021 Technology, Innovation & Great Power Comp...
Team Conflicted Capital Team - 2021 Technology, Innovation & Great Power Comp...Team Conflicted Capital Team - 2021 Technology, Innovation & Great Power Comp...
Team Conflicted Capital Team - 2021 Technology, Innovation & Great Power Comp...
 
Lecture 8 - Technology, Innovation and Great Power Competition - Cyber
Lecture 8 - Technology, Innovation and Great Power Competition - CyberLecture 8 - Technology, Innovation and Great Power Competition - Cyber
Lecture 8 - Technology, Innovation and Great Power Competition - Cyber
 
Lecture 7 - Technology, Innovation and Great Power Competition - Space
Lecture 7 - Technology, Innovation and Great Power Competition - SpaceLecture 7 - Technology, Innovation and Great Power Competition - Space
Lecture 7 - Technology, Innovation and Great Power Competition - Space
 
Lecture 6 - Technology, Innovation and Great Power Competition - Autonomy and...
Lecture 6 - Technology, Innovation and Great Power Competition - Autonomy and...Lecture 6 - Technology, Innovation and Great Power Competition - Autonomy and...
Lecture 6 - Technology, Innovation and Great Power Competition - Autonomy and...
 

Dernier

Salient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functionsSalient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functions
KarakKing
 
Vishram Singh - Textbook of Anatomy Upper Limb and Thorax.. Volume 1 (1).pdf
Vishram Singh - Textbook of Anatomy  Upper Limb and Thorax.. Volume 1 (1).pdfVishram Singh - Textbook of Anatomy  Upper Limb and Thorax.. Volume 1 (1).pdf
Vishram Singh - Textbook of Anatomy Upper Limb and Thorax.. Volume 1 (1).pdf
ssuserdda66b
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
QucHHunhnh
 

Dernier (20)

Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdf
 
ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.
 
Salient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functionsSalient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functions
 
Towards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptxTowards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptx
 
SOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning PresentationSOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning Presentation
 
Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)
 
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17  How to Extend Models Using Mixin ClassesMixin Classes in Odoo 17  How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
 
Graduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - EnglishGraduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - English
 
Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024
 
Understanding Accommodations and Modifications
Understanding  Accommodations and ModificationsUnderstanding  Accommodations and Modifications
Understanding Accommodations and Modifications
 
ICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptx
 
Google Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptxGoogle Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptx
 
On National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan FellowsOn National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan Fellows
 
Vishram Singh - Textbook of Anatomy Upper Limb and Thorax.. Volume 1 (1).pdf
Vishram Singh - Textbook of Anatomy  Upper Limb and Thorax.. Volume 1 (1).pdfVishram Singh - Textbook of Anatomy  Upper Limb and Thorax.. Volume 1 (1).pdf
Vishram Singh - Textbook of Anatomy Upper Limb and Thorax.. Volume 1 (1).pdf
 
Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptx
 
Kodo Millet PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
Kodo Millet  PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...Kodo Millet  PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
Kodo Millet PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
 
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
 
Single or Multiple melodic lines structure
Single or Multiple melodic lines structureSingle or Multiple melodic lines structure
Single or Multiple melodic lines structure
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
 
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptxSKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
 

Edgeai Engr245 2021 Lessons Learned

  • 1. EdgeAI The future of edge computing Mentor Mentor Serena DAYAL 95 total interviews Day One: Offering a custom silicon chip with new embedded memories and a custom Machine Learning accelerator targeting low-power, high-throughput, and low-latency applications. Today: Enable AI vision applications on next generation battery powered surveillance cameras. Massimo GIORDANO Kartik PRABHU Jo ZHU Weier WAN Alon DROR Picker PhD, EE Hacker PhD, EE Hustler MBA, M.Ed Designer PhD, EE Hustler MBA Dave NEWMAN
  • 2. EDGE AI - THE FIRST ALL-IN-ONE AI CHIP ● In the lab, we: ○ 2 years of research and development ○ Collaboration with a foundry that offers the new memory ○ Built the first all-in-one AI chip prototype Our already fabricated AI chip Possible use cases We envisioned ● Objective: Enabling new AI applications at the edge, with a faster and lower power DNN accelerator enabled by new memory technology (Resistive RAM). Unclear purpose statement ?What does it mean? Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1
  • 3. WEEK 1 - EdgeAI was: ● A silicon AI accelerator with new memories for low power and high performance inference on edge devices Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1 EdgeAI Security Cameras
  • 4. WEEK 1 - EdgeAI was: ● A silicon AI accelerator with new memories for low power and high performance inference on edge devices Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1 EdgeAI Security Cameras No need for AI accelerator (Not compute intensive) Wrong power target (0.1 mW instead of 100mW)
  • 5. WEEK 1 - EdgeAI was: ● A silicon AI accelerator with new memories for low power and high performance inference on edge devices Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1 EdgeAI Security Cameras Computation power much smaller than propulsion power
  • 6. WEEK 1 - EdgeAI was: ● A silicon AI accelerator with new memories for low power and high performance inference on edge devices Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1 EdgeAI Security Cameras High-end products can afford expensive hardware (GPUs) Needs high compute power (4k images at 60fps) - hard to compete with NVIDIA GPUs Battery life is not critical
  • 7. By WEEK 2 we got confused Other embedded non-volatile memories offer similar performance Competitors already use eFLASH and MRAM eFLASH won’t scale, but TODAY has the same performance of RRAM. MRAM offers the same benefits of RRAM We FORGOT why RRAM was great... Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1
  • 8. Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1
  • 9. “Lost in Space”: How we reached market fit! ● Radiation resilient & affordable alternative to FPGAs for AI applications in space almost Huge interest from NASA engineers: Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1 Market: ● Big satellites (NASA & ESA) ● Nano satellites “A huge opportunity! We can help you make this happen. Let’s write a grant together”
  • 10. “Lost in Space”: How we reached market fit! almost Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1 ● Big satellites (NASA & ESA) ○ RRAM is resistant to radiation, but is still not space graded ● Nano satellites ○ Small-market, 1000 satellite/year less than 10k whole mission “I just launched into space an Intel’s Myriad vision processor” - AI expert, ESA Commercial products already sent in space Users Customers
  • 11. Focusing on the value proposition AHA moment: “Who cares about RRAM?! What matter is what we do with it!” Heidi Roizen Threshold Ventures Focus on the value proposition! What is unique to RRAM, that is otherwise NOT possible? Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1
  • 12. Customers Need AI! “Something that consumes 10mWh/day would be amazing” - Ring “Currently I need a GPU card for every camera and most of the time nothing is happening” “AI would solve a lot of problems, but it consumes too much power” Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1
  • 13. Searching for Optimal Product/Market Fit ● Low-power solutions can not run large complex DNNs ● High-performance compute consumes a lot of power Low-power… but can’t do much! Prius High performance… but high power! vs. Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1
  • 14. Aha! RRAM Enables No Idle Power. Search for these customers! ● Great specs for AI ● No power to retain memory ● Fast wake-up Edge AI High-performance when needed 10ms 1 second Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1 It goes FAST! But no power when stopped.
  • 15. We Find Product/Market Fit! ● Edge AI supports 50MB DNN models, capable of waking-up and performing 1 inference in just 1 mJ Solar panel provides only 5 mW*h/day We enable AI vision on solar-powered security camera Not possible today! Higher security, Fewer false alarms No need to change batteries Happier customers! Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1
  • 16. MVP: smart security cameras w/o changing batteries We are really efficient in doing this 1 frame / second No person Person 10 MB model 1mJ 30 frame / second higher resolution 0.3% Face recognition 40 MB model 5 mJ Owner Unknown Less Efficient but infrequent 10% Unsafe 1000 MB model 200 mJ safe Above memory available on-chip Limited power budget Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1
  • 17. Aha! Software is Key! Use Existing AI IP ● Custom ML accelerator needs complex software stack (hard to accomplish) ● Instead, use an existing AI IP that offers the full software stack (Expedera) “We’ve spent a lot of time writing software for our current chip, and can’t afford to redo everything for a new chip” - Embedded systems startup Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1
  • 18. Quick wake-up powerful AI acceleration that consume no power when idle IP providers Only chips: OEM TSMC already collaborating IC Design Tools Software Run infrequent complex AI tasks preserving battery life. Engineering, Development Customer Customization Work with customers to enable their applications Supply Chain IP protection Provide custom features based on customer need Physical: System Integrator Radiation resistant, space-graded AI ASIC accelerators NASA, ESA Sell custom-designed silicon chips Development: MPW runs, EDA tools, IP licenses, Packagings, mask costs Develop custom silicon Contracts for AI expert consulting for co-designing specific applications Develop custom DNN accelerators AI IP with full software support Enable new AI applications on their device Product Managers Offering new AI features EE/CS Engineers Development and design Smart AI battery powered Cameras Lower-power compute Ease of integration and use
  • 19. What’s Next: ● More product validation: ○ Further potential customers interviews ● Run pilots: ○ With various security cameras and doorbells companies ● Fabricate 2nd silicon chip: ○ Scheduled for October 2021 ● Raise first seed investment in Q3-Q4 ‘21 ○ Development of end-to-end prototype Contact us: Massimo Giordano - mgiordan@stanford.edu Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1