SlideShare une entreprise Scribd logo
1  sur  19
EdgeAI
The future of edge computing
Mentor
Mentor
Serena
DAYAL
95 total interviews
Day One:
Offering a custom silicon chip with
new embedded memories and a
custom Machine Learning
accelerator targeting low-power,
high-throughput, and low-latency
applications.
Today:
Enable AI vision applications
on next generation battery
powered surveillance
cameras.
Massimo
GIORDANO
Kartik
PRABHU
Jo
ZHU
Weier
WAN
Alon
DROR
Picker
PhD, EE
Hacker
PhD, EE
Hustler
MBA, M.Ed
Designer
PhD, EE
Hustler
MBA
Dave
NEWMAN
EDGE AI - THE FIRST ALL-IN-ONE AI CHIP
● In the lab, we:
○ 2 years of research and development
○ Collaboration with a foundry that offers the new memory
○ Built the first all-in-one AI chip prototype
Our already
fabricated AI chip
Possible use cases
We envisioned
● Objective: Enabling new AI applications at the edge, with a
faster and lower power DNN accelerator enabled by new
memory technology (Resistive RAM).
Unclear purpose statement
?What does it mean?
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1
WEEK 1 - EdgeAI was:
● A silicon AI accelerator with new
memories for low power and high
performance inference on edge
devices
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1
EdgeAI
Security
Cameras
WEEK 1 - EdgeAI was:
● A silicon AI accelerator with new
memories for low power and high
performance inference on edge
devices
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1
EdgeAI
Security
Cameras
No need for AI accelerator (Not compute
intensive)
Wrong power target (0.1 mW instead of
100mW)
WEEK 1 - EdgeAI was:
● A silicon AI accelerator with new
memories for low power and high
performance inference on edge
devices
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1
EdgeAI
Security
Cameras
Computation power much smaller than
propulsion power
WEEK 1 - EdgeAI was:
● A silicon AI accelerator with new
memories for low power and high
performance inference on edge
devices
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1
EdgeAI
Security
Cameras
High-end products can afford expensive
hardware (GPUs)
Needs high compute power (4k images at
60fps) - hard to compete with NVIDIA
GPUs
Battery life is not critical
By WEEK 2 we got confused
Other embedded non-volatile memories offer similar performance
Competitors already use eFLASH and MRAM
eFLASH won’t
scale, but TODAY
has the same
performance of
RRAM.
MRAM offers
the same
benefits of
RRAM
We FORGOT why
RRAM was great...
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1
“Lost in Space”: How we reached market fit!
● Radiation resilient & affordable alternative to FPGAs for AI applications in space
almost
Huge interest from NASA engineers:
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1
Market:
● Big satellites (NASA & ESA)
● Nano satellites
“A huge
opportunity!
We can help you
make this happen.
Let’s write a grant
together”
“Lost in Space”: How we reached market fit!
almost
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1
● Big satellites (NASA & ESA)
○ RRAM is resistant to radiation, but is still not space graded
● Nano satellites
○ Small-market, 1000 satellite/year less than 10k whole mission
“I just launched into space an Intel’s Myriad
vision processor” - AI expert, ESA
Commercial products already sent in space
Users Customers
Focusing on the value proposition
AHA moment:
“Who cares about RRAM?!
What matter is what we do with it!”
Heidi Roizen
Threshold Ventures
Focus on
the value
proposition!
What is unique to RRAM,
that is otherwise NOT possible?
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1
Customers Need AI!
“Something that consumes 10mWh/day
would be amazing”
- Ring
“Currently I need a GPU card for
every camera and most of the time
nothing is happening”
“AI would solve a lot of problems,
but it consumes too much power”
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1
Searching for Optimal Product/Market Fit
● Low-power solutions can not run large complex DNNs
● High-performance compute consumes a lot of power
Low-power…
but can’t do much!
Prius
High performance…
but high power!
vs.
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1
Aha! RRAM Enables No Idle Power. Search for these customers!
● Great specs for AI
● No power to retain memory
● Fast wake-up
Edge AI
High-performance
when needed
10ms 1 second
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1
It goes FAST!
But no power when
stopped.
We Find Product/Market Fit!
● Edge AI supports 50MB DNN models, capable of waking-up and
performing 1 inference in just 1 mJ
Solar panel
provides
only
5 mW*h/day
We enable AI vision
on solar-powered
security camera
Not possible today!
Higher security,
Fewer false alarms
No need to change batteries
Happier
customers!
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1
MVP: smart security cameras w/o changing batteries
We are really efficient in doing this
1 frame / second
No person
Person
10 MB model
1mJ
30 frame / second
higher resolution
0.3%
Face recognition
40 MB model
5 mJ
Owner Unknown
Less Efficient but infrequent
10%
Unsafe
1000 MB model
200 mJ
safe
Above memory
available on-chip
Limited power
budget
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1
Aha! Software is Key! Use Existing AI IP
● Custom ML accelerator needs complex software stack (hard to accomplish)
● Instead, use an existing AI IP that offers the full software stack (Expedera)
“We’ve spent a lot of time
writing software for our current
chip, and can’t afford to redo
everything for a new chip” -
Embedded systems startup
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1
Quick wake-up powerful
AI acceleration that
consume no power
when idle
IP providers
Only chips: OEM
TSMC
already
collaborating
IC Design Tools
Software
Run infrequent
complex AI tasks
preserving battery life.
Engineering,
Development
Customer
Customization
Work with
customers to enable
their applications
Supply Chain
IP protection
Provide custom features
based on customer need
Physical: System
Integrator
Radiation resistant,
space-graded AI ASIC
accelerators
NASA, ESA
Sell custom-designed silicon
chips
Development: MPW runs, EDA tools, IP licenses,
Packagings, mask costs
Develop custom silicon
Contracts for AI expert
consulting for co-designing
specific applications
Develop custom
DNN accelerators
AI IP with full
software support
Enable new AI applications
on their device Product Managers
Offering new AI features
EE/CS Engineers
Development and design
Smart AI
battery
powered
Cameras
Lower-power
compute
Ease of
integration
and use
What’s Next:
● More product validation:
○ Further potential customers interviews
● Run pilots:
○ With various security cameras and doorbells companies
● Fabricate 2nd silicon chip:
○ Scheduled for October 2021
● Raise first seed investment in Q3-Q4 ‘21
○ Development of end-to-end prototype
Contact us: Massimo Giordano - mgiordan@stanford.edu
Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future
Week 1

Contenu connexe

Tendances

RCI Case Studies
RCI Case StudiesRCI Case Studies
RCI Case Studies
nsegura85
 
Veeam back up and replication presentation
Veeam back up and replication presentation Veeam back up and replication presentation
Veeam back up and replication presentation
BlueChipICT
 

Tendances (20)

RCI Case Studies
RCI Case StudiesRCI Case Studies
RCI Case Studies
 
curled-metal case study analysis
curled-metal case study analysiscurled-metal case study analysis
curled-metal case study analysis
 
CII BCG big picture summit report 2021
CII BCG big picture summit report 2021CII BCG big picture summit report 2021
CII BCG big picture summit report 2021
 
Veeam back up and replication presentation
Veeam back up and replication presentation Veeam back up and replication presentation
Veeam back up and replication presentation
 
Downtime is Not an Option: Integrating IBM Z into ServiceNow and Splunk
Downtime is Not an Option: Integrating IBM Z into ServiceNow and SplunkDowntime is Not an Option: Integrating IBM Z into ServiceNow and Splunk
Downtime is Not an Option: Integrating IBM Z into ServiceNow and Splunk
 
Dropbox it just works-case study solution
Dropbox  it just works-case study solutionDropbox  it just works-case study solution
Dropbox it just works-case study solution
 
Trouble at tessei
Trouble at tesseiTrouble at tessei
Trouble at tessei
 
How to win Cesim: Business Simulation Games
How to win  Cesim: Business Simulation Games How to win  Cesim: Business Simulation Games
How to win Cesim: Business Simulation Games
 
Pich Deck for Pepper Bio, for TechCruch's Pitch Deck Teardown series
Pich Deck for Pepper Bio, for TechCruch's Pitch Deck Teardown seriesPich Deck for Pepper Bio, for TechCruch's Pitch Deck Teardown series
Pich Deck for Pepper Bio, for TechCruch's Pitch Deck Teardown series
 
20200629 covid 19-global auto consumer insights_wave3_vf_web
20200629 covid 19-global auto consumer insights_wave3_vf_web20200629 covid 19-global auto consumer insights_wave3_vf_web
20200629 covid 19-global auto consumer insights_wave3_vf_web
 
Airbyte - Seed deck
Airbyte  - Seed deckAirbyte  - Seed deck
Airbyte - Seed deck
 
Server Virtualization using Hyper-V
Server Virtualization using Hyper-VServer Virtualization using Hyper-V
Server Virtualization using Hyper-V
 
TechCrunch Pitch Deck Teardown 83 - $30M - Series A - Xyte
TechCrunch Pitch Deck Teardown 83 - $30M  - Series A - XyteTechCrunch Pitch Deck Teardown 83 - $30M  - Series A - Xyte
TechCrunch Pitch Deck Teardown 83 - $30M - Series A - Xyte
 
Colgate vs P&G
Colgate vs P&GColgate vs P&G
Colgate vs P&G
 
Newell ajal
Newell ajalNewell ajal
Newell ajal
 
Y Combinator Pitch Deck Template For Startup Founders
Y Combinator Pitch Deck Template For Startup FoundersY Combinator Pitch Deck Template For Startup Founders
Y Combinator Pitch Deck Template For Startup Founders
 
Hadoop project design and a usecase
Hadoop project design and  a usecaseHadoop project design and  a usecase
Hadoop project design and a usecase
 
Volkswagen of America
Volkswagen of AmericaVolkswagen of America
Volkswagen of America
 
Front App 10Million Series-A Funding
Front App 10Million Series-A FundingFront App 10Million Series-A Funding
Front App 10Million Series-A Funding
 
Clique Pens - Case Study Solution by Kamal Allazov (Essay type)
Clique Pens - Case Study Solution by Kamal Allazov (Essay type)Clique Pens - Case Study Solution by Kamal Allazov (Essay type)
Clique Pens - Case Study Solution by Kamal Allazov (Essay type)
 

Similaire à Edgeai Engr245 2021 Lessons Learned

A Tale of Two Systems - Insights from Software Architecture
A Tale of Two Systems - Insights from Software ArchitectureA Tale of Two Systems - Insights from Software Architecture
A Tale of Two Systems - Insights from Software Architecture
David Max
 
"Processor Options for Edge Inference: Options and Trade-offs," a Presentatio...
"Processor Options for Edge Inference: Options and Trade-offs," a Presentatio..."Processor Options for Edge Inference: Options and Trade-offs," a Presentatio...
"Processor Options for Edge Inference: Options and Trade-offs," a Presentatio...
Edge AI and Vision Alliance
 
"Enabling Ubiquitous Visual Intelligence Through Deep Learning," a Keynote Pr...
"Enabling Ubiquitous Visual Intelligence Through Deep Learning," a Keynote Pr..."Enabling Ubiquitous Visual Intelligence Through Deep Learning," a Keynote Pr...
"Enabling Ubiquitous Visual Intelligence Through Deep Learning," a Keynote Pr...
Edge AI and Vision Alliance
 

Similaire à Edgeai Engr245 2021 Lessons Learned (20)

Lean Startup, Hardware Edition
Lean Startup, Hardware EditionLean Startup, Hardware Edition
Lean Startup, Hardware Edition
 
Microcontrollers for Artificial Intelligence and Machine Learning
Microcontrollers for Artificial Intelligence and Machine LearningMicrocontrollers for Artificial Intelligence and Machine Learning
Microcontrollers for Artificial Intelligence and Machine Learning
 
Artificial Intelligence in practice - Gerbert Kaandorp - Codemotion Amsterdam...
Artificial Intelligence in practice - Gerbert Kaandorp - Codemotion Amsterdam...Artificial Intelligence in practice - Gerbert Kaandorp - Codemotion Amsterdam...
Artificial Intelligence in practice - Gerbert Kaandorp - Codemotion Amsterdam...
 
David Max: A Tale of Two Systems | Nowhere Developers 2018
David Max: A Tale of Two Systems | Nowhere Developers 2018David Max: A Tale of Two Systems | Nowhere Developers 2018
David Max: A Tale of Two Systems | Nowhere Developers 2018
 
Live Data: For When Data is Greater than Memory
Live Data: For When Data is Greater than MemoryLive Data: For When Data is Greater than Memory
Live Data: For When Data is Greater than Memory
 
Weebit nano presentation at Leti Memory Workshop
Weebit nano presentation at Leti Memory WorkshopWeebit nano presentation at Leti Memory Workshop
Weebit nano presentation at Leti Memory Workshop
 
A Tale of Two Systems - Insights from Software Architecture
A Tale of Two Systems - Insights from Software ArchitectureA Tale of Two Systems - Insights from Software Architecture
A Tale of Two Systems - Insights from Software Architecture
 
Artificial Intelligence in Small Embedded System
Artificial Intelligence in Small Embedded SystemArtificial Intelligence in Small Embedded System
Artificial Intelligence in Small Embedded System
 
Deep Learning on Everyday Devices
Deep Learning on Everyday DevicesDeep Learning on Everyday Devices
Deep Learning on Everyday Devices
 
"Processor Options for Edge Inference: Options and Trade-offs," a Presentatio...
"Processor Options for Edge Inference: Options and Trade-offs," a Presentatio..."Processor Options for Edge Inference: Options and Trade-offs," a Presentatio...
"Processor Options for Edge Inference: Options and Trade-offs," a Presentatio...
 
Neuromophic device for Automotive
Neuromophic device for AutomotiveNeuromophic device for Automotive
Neuromophic device for Automotive
 
Application Optimized Performance: Choosing the Right Instance (CPN212) | AWS...
Application Optimized Performance: Choosing the Right Instance (CPN212) | AWS...Application Optimized Performance: Choosing the Right Instance (CPN212) | AWS...
Application Optimized Performance: Choosing the Right Instance (CPN212) | AWS...
 
"Enabling Ubiquitous Visual Intelligence Through Deep Learning," a Keynote Pr...
"Enabling Ubiquitous Visual Intelligence Through Deep Learning," a Keynote Pr..."Enabling Ubiquitous Visual Intelligence Through Deep Learning," a Keynote Pr...
"Enabling Ubiquitous Visual Intelligence Through Deep Learning," a Keynote Pr...
 
E3MV - Embedded Vision - Sundance
E3MV - Embedded Vision - SundanceE3MV - Embedded Vision - Sundance
E3MV - Embedded Vision - Sundance
 
Inspur: Open Hardware in Hyperscale Datacenters
Inspur: Open Hardware in Hyperscale Datacenters Inspur: Open Hardware in Hyperscale Datacenters
Inspur: Open Hardware in Hyperscale Datacenters
 
2016-JAN-28 -- High Performance Production Databases on Ceph
2016-JAN-28 -- High Performance Production Databases on Ceph2016-JAN-28 -- High Performance Production Databases on Ceph
2016-JAN-28 -- High Performance Production Databases on Ceph
 
Accelerating algorithmic and hardware advancements for power efficient on-dev...
Accelerating algorithmic and hardware advancements for power efficient on-dev...Accelerating algorithmic and hardware advancements for power efficient on-dev...
Accelerating algorithmic and hardware advancements for power efficient on-dev...
 
Childhood Dream to Pi World Record by Emma Haruka, Developer Advocate @Google
Childhood Dream to Pi World Record by Emma Haruka, Developer Advocate @GoogleChildhood Dream to Pi World Record by Emma Haruka, Developer Advocate @Google
Childhood Dream to Pi World Record by Emma Haruka, Developer Advocate @Google
 
How flash responds to different AIoT needs -- C&T RF Antennas Inc
How flash responds to different AIoT needs -- C&T RF Antennas IncHow flash responds to different AIoT needs -- C&T RF Antennas Inc
How flash responds to different AIoT needs -- C&T RF Antennas Inc
 
Think Silicon at Open Coffee Athens XCIV
Think Silicon at Open Coffee Athens XCIVThink Silicon at Open Coffee Athens XCIV
Think Silicon at Open Coffee Athens XCIV
 

Plus de Stanford University

Plus de Stanford University (20)

Team Networks - 2022 Technology, Innovation & Great Power Competition
Team Networks  - 2022 Technology, Innovation & Great Power CompetitionTeam Networks  - 2022 Technology, Innovation & Great Power Competition
Team Networks - 2022 Technology, Innovation & Great Power Competition
 
Team LiOn Batteries - 2022 Technology, Innovation & Great Power Competition
Team LiOn Batteries  - 2022 Technology, Innovation & Great Power CompetitionTeam LiOn Batteries  - 2022 Technology, Innovation & Great Power Competition
Team LiOn Batteries - 2022 Technology, Innovation & Great Power Competition
 
Team Quantum - 2022 Technology, Innovation & Great Power Competition
Team Quantum  - 2022 Technology, Innovation & Great Power CompetitionTeam Quantum  - 2022 Technology, Innovation & Great Power Competition
Team Quantum - 2022 Technology, Innovation & Great Power Competition
 
Team Disinformation - 2022 Technology, Innovation & Great Power Competition
Team Disinformation  - 2022 Technology, Innovation & Great Power CompetitionTeam Disinformation  - 2022 Technology, Innovation & Great Power Competition
Team Disinformation - 2022 Technology, Innovation & Great Power Competition
 
Team Wargames - 2022 Technology, Innovation & Great Power Competition
Team Wargames  - 2022 Technology, Innovation & Great Power CompetitionTeam Wargames  - 2022 Technology, Innovation & Great Power Competition
Team Wargames - 2022 Technology, Innovation & Great Power Competition
 
Team Acquistion - 2022 Technology, Innovation & Great Power Competition
Team Acquistion  - 2022 Technology, Innovation & Great Power Competition Team Acquistion  - 2022 Technology, Innovation & Great Power Competition
Team Acquistion - 2022 Technology, Innovation & Great Power Competition
 
Team Climate Change - 2022 Technology, Innovation & Great Power Competition
Team Climate Change - 2022 Technology, Innovation & Great Power Competition Team Climate Change - 2022 Technology, Innovation & Great Power Competition
Team Climate Change - 2022 Technology, Innovation & Great Power Competition
 
Altuna Engr245 2022 Lessons Learned
Altuna Engr245 2022 Lessons LearnedAltuna Engr245 2022 Lessons Learned
Altuna Engr245 2022 Lessons Learned
 
Invisa Engr245 2022 Lessons Learned
Invisa Engr245 2022 Lessons LearnedInvisa Engr245 2022 Lessons Learned
Invisa Engr245 2022 Lessons Learned
 
ānanda Engr245 2022 Lessons Learned
ānanda Engr245 2022 Lessons Learnedānanda Engr245 2022 Lessons Learned
ānanda Engr245 2022 Lessons Learned
 
Gordian Knot Center Roundtable w/Depty SecDef
Gordian Knot Center Roundtable w/Depty SecDef Gordian Knot Center Roundtable w/Depty SecDef
Gordian Knot Center Roundtable w/Depty SecDef
 
Team Army venture capital - 2021 Technology, Innovation & Great Power Competi...
Team Army venture capital - 2021 Technology, Innovation & Great Power Competi...Team Army venture capital - 2021 Technology, Innovation & Great Power Competi...
Team Army venture capital - 2021 Technology, Innovation & Great Power Competi...
 
Team Army venture capital - 2021 Technology, Innovation & Great Power Competi...
Team Army venture capital - 2021 Technology, Innovation & Great Power Competi...Team Army venture capital - 2021 Technology, Innovation & Great Power Competi...
Team Army venture capital - 2021 Technology, Innovation & Great Power Competi...
 
Team Catena - 2021 Technology, Innovation & Great Power Competition
Team Catena - 2021 Technology, Innovation & Great Power CompetitionTeam Catena - 2021 Technology, Innovation & Great Power Competition
Team Catena - 2021 Technology, Innovation & Great Power Competition
 
Team Apollo - 2021 Technology, Innovation & Great Power Competition
Team Apollo - 2021 Technology, Innovation & Great Power CompetitionTeam Apollo - 2021 Technology, Innovation & Great Power Competition
Team Apollo - 2021 Technology, Innovation & Great Power Competition
 
Team Drone - 2021 Technology, Innovation & Great Power Competition
Team Drone - 2021 Technology, Innovation & Great Power CompetitionTeam Drone - 2021 Technology, Innovation & Great Power Competition
Team Drone - 2021 Technology, Innovation & Great Power Competition
 
Team Short Circuit - 2021 Technology, Innovation & Great Power Competition
Team Short Circuit - 2021 Technology, Innovation & Great Power CompetitionTeam Short Circuit - 2021 Technology, Innovation & Great Power Competition
Team Short Circuit - 2021 Technology, Innovation & Great Power Competition
 
Team Aurora - 2021 Technology, Innovation & Great Power Competition
Team Aurora - 2021 Technology, Innovation & Great Power CompetitionTeam Aurora - 2021 Technology, Innovation & Great Power Competition
Team Aurora - 2021 Technology, Innovation & Great Power Competition
 
Team Conflicted Capital Team - 2021 Technology, Innovation & Great Power Comp...
Team Conflicted Capital Team - 2021 Technology, Innovation & Great Power Comp...Team Conflicted Capital Team - 2021 Technology, Innovation & Great Power Comp...
Team Conflicted Capital Team - 2021 Technology, Innovation & Great Power Comp...
 
Lecture 8 - Technology, Innovation and Great Power Competition - Cyber
Lecture 8 - Technology, Innovation and Great Power Competition - CyberLecture 8 - Technology, Innovation and Great Power Competition - Cyber
Lecture 8 - Technology, Innovation and Great Power Competition - Cyber
 

Dernier

Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global Impact
PECB
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
heathfieldcps1
 
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Krashi Coaching
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
QucHHunhnh
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
ciinovamais
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
kauryashika82
 

Dernier (20)

Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global Impact
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
 
social pharmacy d-pharm 1st year by Pragati K. Mahajan
social pharmacy d-pharm 1st year by Pragati K. Mahajansocial pharmacy d-pharm 1st year by Pragati K. Mahajan
social pharmacy d-pharm 1st year by Pragati K. Mahajan
 
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
 
fourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writingfourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writing
 
9548086042 for call girls in Indira Nagar with room service
9548086042  for call girls in Indira Nagar  with room service9548086042  for call girls in Indira Nagar  with room service
9548086042 for call girls in Indira Nagar with room service
 
Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..
 
Advance Mobile Application Development class 07
Advance Mobile Application Development class 07Advance Mobile Application Development class 07
Advance Mobile Application Development class 07
 
Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptx
 
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
 
Student login on Anyboli platform.helpin
Student login on Anyboli platform.helpinStudent login on Anyboli platform.helpin
Student login on Anyboli platform.helpin
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
 
APM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAPM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across Sectors
 
Z Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphZ Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot Graph
 
Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
 
Class 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdfClass 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdf
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
 
Measures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDMeasures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SD
 

Edgeai Engr245 2021 Lessons Learned

  • 1. EdgeAI The future of edge computing Mentor Mentor Serena DAYAL 95 total interviews Day One: Offering a custom silicon chip with new embedded memories and a custom Machine Learning accelerator targeting low-power, high-throughput, and low-latency applications. Today: Enable AI vision applications on next generation battery powered surveillance cameras. Massimo GIORDANO Kartik PRABHU Jo ZHU Weier WAN Alon DROR Picker PhD, EE Hacker PhD, EE Hustler MBA, M.Ed Designer PhD, EE Hustler MBA Dave NEWMAN
  • 2. EDGE AI - THE FIRST ALL-IN-ONE AI CHIP ● In the lab, we: ○ 2 years of research and development ○ Collaboration with a foundry that offers the new memory ○ Built the first all-in-one AI chip prototype Our already fabricated AI chip Possible use cases We envisioned ● Objective: Enabling new AI applications at the edge, with a faster and lower power DNN accelerator enabled by new memory technology (Resistive RAM). Unclear purpose statement ?What does it mean? Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1
  • 3. WEEK 1 - EdgeAI was: ● A silicon AI accelerator with new memories for low power and high performance inference on edge devices Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1 EdgeAI Security Cameras
  • 4. WEEK 1 - EdgeAI was: ● A silicon AI accelerator with new memories for low power and high performance inference on edge devices Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1 EdgeAI Security Cameras No need for AI accelerator (Not compute intensive) Wrong power target (0.1 mW instead of 100mW)
  • 5. WEEK 1 - EdgeAI was: ● A silicon AI accelerator with new memories for low power and high performance inference on edge devices Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1 EdgeAI Security Cameras Computation power much smaller than propulsion power
  • 6. WEEK 1 - EdgeAI was: ● A silicon AI accelerator with new memories for low power and high performance inference on edge devices Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1 EdgeAI Security Cameras High-end products can afford expensive hardware (GPUs) Needs high compute power (4k images at 60fps) - hard to compete with NVIDIA GPUs Battery life is not critical
  • 7. By WEEK 2 we got confused Other embedded non-volatile memories offer similar performance Competitors already use eFLASH and MRAM eFLASH won’t scale, but TODAY has the same performance of RRAM. MRAM offers the same benefits of RRAM We FORGOT why RRAM was great... Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1
  • 8. Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1
  • 9. “Lost in Space”: How we reached market fit! ● Radiation resilient & affordable alternative to FPGAs for AI applications in space almost Huge interest from NASA engineers: Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1 Market: ● Big satellites (NASA & ESA) ● Nano satellites “A huge opportunity! We can help you make this happen. Let’s write a grant together”
  • 10. “Lost in Space”: How we reached market fit! almost Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1 ● Big satellites (NASA & ESA) ○ RRAM is resistant to radiation, but is still not space graded ● Nano satellites ○ Small-market, 1000 satellite/year less than 10k whole mission “I just launched into space an Intel’s Myriad vision processor” - AI expert, ESA Commercial products already sent in space Users Customers
  • 11. Focusing on the value proposition AHA moment: “Who cares about RRAM?! What matter is what we do with it!” Heidi Roizen Threshold Ventures Focus on the value proposition! What is unique to RRAM, that is otherwise NOT possible? Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1
  • 12. Customers Need AI! “Something that consumes 10mWh/day would be amazing” - Ring “Currently I need a GPU card for every camera and most of the time nothing is happening” “AI would solve a lot of problems, but it consumes too much power” Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1
  • 13. Searching for Optimal Product/Market Fit ● Low-power solutions can not run large complex DNNs ● High-performance compute consumes a lot of power Low-power… but can’t do much! Prius High performance… but high power! vs. Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1
  • 14. Aha! RRAM Enables No Idle Power. Search for these customers! ● Great specs for AI ● No power to retain memory ● Fast wake-up Edge AI High-performance when needed 10ms 1 second Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1 It goes FAST! But no power when stopped.
  • 15. We Find Product/Market Fit! ● Edge AI supports 50MB DNN models, capable of waking-up and performing 1 inference in just 1 mJ Solar panel provides only 5 mW*h/day We enable AI vision on solar-powered security camera Not possible today! Higher security, Fewer false alarms No need to change batteries Happier customers! Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1
  • 16. MVP: smart security cameras w/o changing batteries We are really efficient in doing this 1 frame / second No person Person 10 MB model 1mJ 30 frame / second higher resolution 0.3% Face recognition 40 MB model 5 mJ Owner Unknown Less Efficient but infrequent 10% Unsafe 1000 MB model 200 mJ safe Above memory available on-chip Limited power budget Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1
  • 17. Aha! Software is Key! Use Existing AI IP ● Custom ML accelerator needs complex software stack (hard to accomplish) ● Instead, use an existing AI IP that offers the full software stack (Expedera) “We’ve spent a lot of time writing software for our current chip, and can’t afford to redo everything for a new chip” - Embedded systems startup Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1
  • 18. Quick wake-up powerful AI acceleration that consume no power when idle IP providers Only chips: OEM TSMC already collaborating IC Design Tools Software Run infrequent complex AI tasks preserving battery life. Engineering, Development Customer Customization Work with customers to enable their applications Supply Chain IP protection Provide custom features based on customer need Physical: System Integrator Radiation resistant, space-graded AI ASIC accelerators NASA, ESA Sell custom-designed silicon chips Development: MPW runs, EDA tools, IP licenses, Packagings, mask costs Develop custom silicon Contracts for AI expert consulting for co-designing specific applications Develop custom DNN accelerators AI IP with full software support Enable new AI applications on their device Product Managers Offering new AI features EE/CS Engineers Development and design Smart AI battery powered Cameras Lower-power compute Ease of integration and use
  • 19. What’s Next: ● More product validation: ○ Further potential customers interviews ● Run pilots: ○ With various security cameras and doorbells companies ● Fabricate 2nd silicon chip: ○ Scheduled for October 2021 ● Raise first seed investment in Q3-Q4 ‘21 ○ Development of end-to-end prototype Contact us: Massimo Giordano - mgiordan@stanford.edu Week 0 Week 2 Week 3 Week 4 Week 5 Week 6 Week 7 Week 8 Week 9 The Future Week 1