Ce diaporama a bien été signalé.
Nous utilisons votre profil LinkedIn et vos données d’activité pour vous proposer des publicités personnalisées et pertinentes. Vous pouvez changer vos préférences de publicités à tout moment.
Intel® Movidius™ Neural Compute Stick Program
BringIntelligencetotheEdgewithIntel®
Movidius™NeuralComputeStick
Darren Crew...
InfoQ.com: News & Community Site
• Over 1,000,000 software developers, architects and CTOs read the site world-
wide every...
Purpose of QCon
- to empower software development by facilitating the spread of
knowledge and innovation
Strategy
- practi...
Intel® Movidius™ Neural Compute Stick Program 2
LegalDisclaimer
INFORMATION IN THIS DOCUMENT IS PROVIDED IN CONNECTION WIT...
Intel® Movidius™ Neural Compute Stick Program
Agenda
• Motiviation to move intelligence to the edge
• Edge compute use cas...
Intel® Movidius™ Neural Compute Stick Program
1 Source: http://www.gartner.com/newsroom/id/3598917
20 billion connected de...
Intel® Movidius™ Neural Compute Stick Program
What are you? I am asking
the cloud if I should
vacuum you, too.
I'll scratc...
Intel® Movidius™ Neural Compute Stick Program
Computer vision and AI at the edge
Intel® Movidius™ Neural Compute Stick Program
But what about Developers?
+
NC SDK
Free download @ developer.movidius.com
C...
Intel® Movidius™ Neural Compute Stick Program
Use Case with the Neural Compute Stick
Little Ripper Lifesaver* UAV
https://...
Intel® Movidius™ Neural Compute Stick Program
Key Capabilities
Typical use cases could be:
• Robot
• Security camera
• Sma...
Intel® Movidius™ Neural Compute Stick Program
Barriers to Moving Compute to the Edge
Move compute from the cloud to the ed...
Intel® Movidius™ Neural Compute Stick Program
Image Classification: Getting more accurate and every year
Intel® Movidius™ Neural Compute Stick Program
Efficiency Key for Edge Devices
Alfredo Canziani, Eugenio Culurciello, Adam ...
Intel® Movidius™ Neural Compute Stick Program
MobileNet performance on NCS
Real time image classification on NCS
https://g...
Intel® Movidius™ Neural Compute Stick Program
Object Detection Benchmarks
Deep neural networks win in object detection in ...
Intel® Movidius™ Neural Compute Stick Program
Object Detectors – Speed matters!
Significant improvements in Object Detecto...
Intel® Movidius™ Neural Compute Stick Program
Object Detectors – lots of choices, choose wisely
Jonathan Huang, et al, Spe...
Intel® Movidius™ Neural Compute Stick Program
Machine Translation
Intel® Movidius™ Neural Compute Stick Program
Intel® Movidius™ Neural Compute Stick
Redefining the AI developer kit
• Neur...
Intel® Movidius™ Neural Compute Stick Program
Demo: Scaling inference performance with multiple sticks
Intel® Movidius™ Neural Compute Stick Program
Object Detection and Classification
https://github.com/movidius/ncappzoo/tre...
Intel® Movidius™ Neural Compute Stick Program
Architecture
Intel Movidius NCS contains the Intel® Movidius™
Myriad™ 2 visi...
Intel® Movidius™ Neural Compute Stick Program
NC SDK Workflow
Intel® Movidius™ Neural Compute Stick Program
NC SDK Workflow
Intel® Movidius™ Neural Compute Stick Program
Development Flow
Step 1: Convert the model
4Gbit LPDDR
DDR
Shave Shave Shave...
Intel® Movidius™ Neural Compute Stick Program
Trained model can be profiled on NCS for performance:
Intel® Movidius™ Neural Compute Stick Program
NC SDK Workflow
Intel® Movidius™ Neural Compute Stick Program
Development Flow
Step 2: Load the model and the FW
4Gbit LPDDR
DDR
Shave Sha...
Intel® Movidius™ Neural Compute Stick Program
Development Flow
Step 3: Perform inference
• Load the image
• Run the model
...
Intel® Movidius™ Neural Compute Stick Program
Demo
Intel® Movidius™ Neural Compute Stick Program
Let’s Review
• Moving AI to the edge is important for a number of reasons (l...
Intel® Movidius™ Neural Compute Stick Program
Explore developer.movidius.com
Try out the following pages:
• Main page
• Ge...
Intel® Movidius™ Neural Compute Stick Program
Questions?
Intel® Movidius™ Neural Compute Program
Watch the video with slide
synchronization on InfoQ.com!
https://www.infoq.com/presentations/
neural-compute-stick
Prochain SlideShare
Chargement dans…5
×

Rethinking Deep Learning: Neural Compute Stick

229 vues

Publié le

Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/2FYT53N.

Darren Crews talks about the The Movidius Neural Compute Stick (NCS) - a tiny fanless deep learning device that one can use to learn AI programming at the edge. Filmed at qconsf.com.

Darren Crews is a Principal Engineer at Intel focusing on Deep Learning for embedded and client devices. In his current role, he is working on projects including the Intel Movidius Neural Compute Stick where he is the lead system architect.

Publié dans : Technologie
  • Soyez le premier à commenter

  • Soyez le premier à aimer ceci

Rethinking Deep Learning: Neural Compute Stick

  1. 1. Intel® Movidius™ Neural Compute Stick Program BringIntelligencetotheEdgewithIntel® Movidius™NeuralComputeStick Darren Crews Principal Engineer, Lead System Architect, Intel NTG
  2. 2. InfoQ.com: News & Community Site • Over 1,000,000 software developers, architects and CTOs read the site world- wide every month • 250,000 senior developers subscribe to our weekly newsletter • Published in 4 languages (English, Chinese, Japanese and Brazilian Portuguese) • Post content from our QCon conferences • 2 dedicated podcast channels: The InfoQ Podcast, with a focus on Architecture and The Engineering Culture Podcast, with a focus on building • 96 deep dives on innovative topics packed as downloadable emags and minibooks • Over 40 new content items per week Watch the video with slide synchronization on InfoQ.com! https://www.infoq.com/presentations/ neural-compute-stick
  3. 3. Purpose of QCon - to empower software development by facilitating the spread of knowledge and innovation Strategy - practitioner-driven conference designed for YOU: influencers of change and innovation in your teams - speakers and topics driving the evolution and innovation - connecting and catalyzing the influencers and innovators Highlights - attended by more than 12,000 delegates since 2007 - held in 9 cities worldwide Presented at QCon San Francisco www.qconsf.com
  4. 4. Intel® Movidius™ Neural Compute Stick Program 2 LegalDisclaimer INFORMATION IN THIS DOCUMENT IS PROVIDED IN CONNECTION WITH INTEL PRODUCTS. NO LICENSE, EXPRESS OR IMPLIED, BY ESTOPPEL OR OTHERWISE, TO ANY INTELLECTUAL PROPERTY RIGHTS IS GRANTED BY THIS DOCUMENT. EXCEPT AS PROVIDED IN INTEL'S TERMS AND CONDITIONS OF SALE FOR SUCH PRODUCTS, INTEL ASSUMES NO LIABILITY WHATSOEVER AND INTEL DISCLAIMS ANY EXPRESS OR IMPLIED WARRANTY, RELATING TO SALE AND/OR USE OF INTEL PRODUCTS INCLUDING LIABILITY OR WARRANTIES RELATING TO FITNESS FOR A PARTICULAR PURPOSE, MERCHANTABILITY, OR INFRINGEMENT OF ANY PATENT, COPYRIGHT OR OTHER INTELLECTUAL PROPERTY RIGHT. A "Mission Critical Application" is any application in which failure of the Intel Product could result, directly or indirectly, in personal injury or death. SHOULD YOU PURCHASE OR USE INTEL'S PRODUCTS FOR ANY SUCH MISSION CRITICAL APPLICATION, YOU SHALL INDEMNIFY AND HOLD INTEL AND ITS SUBSIDIARIES, SUBCONTRACTORS AND AFFILIATES, AND THE DIRECTORS, OFFICERS, AND EMPLOYEES OF EACH, HARMLESS AGAINST ALL CLAIMS COSTS, DAMAGES, AND EXPENSES AND REASONABLE ATTORNEYS' FEES ARISING OUT OF, DIRECTLY OR INDIRECTLY, ANY CLAIM OF PRODUCT LIABILITY, PERSONAL INJURY, OR DEATH ARISING IN ANY WAY OUT OF SUCH MISSION CRITICAL APPLICATION, WHETHER OR NOT INTEL OR ITS SUBCONTRACTOR WAS NEGLIGENT IN THE DESIGN, MANUFACTURE, OR WARNING OF THE INTEL PRODUCT OR ANY OF ITS PARTS. Intel may make changes to specifications and product descriptions at any time, without notice. Designers must not rely on the absence or characteristics of any features or instructions marked "reserved" or "undefined". Intel reserves these for future definition and shall have no responsibility whatsoever for conflicts or incompatibilities arising from future changes to them. The information here is subject to change without notice. Do not finalize a design with this information. The products described in this document may contain design defects or errors known as errata which may cause the product to deviate from published specifications. Current characterized errata are available on request. Contact your local Intel sales office or your distributor to obtain the latest specifications and before placing your product order. Code names featured are used internally within Intel to identify products that are in development and not yet publicly announced for release. Customers, licensees and other third parties are not authorized by Intel to use code names in advertising, promotion or marketing of any product or services and any such use of Intel's internal code names is at the sole risk of the user. *Other names and brands may be claimed as the property of others. Copyright © 2017, Intel Corporation. All rights reserved.
  5. 5. Intel® Movidius™ Neural Compute Stick Program Agenda • Motiviation to move intelligence to the edge • Edge compute use cases • Barriers to moving intelligence to the edge • Deep learning algorithms – can they run on an edge device? • Movidius Neural Compute Stick (arch,usage, etc) • Code walkthrough and demo
  6. 6. Intel® Movidius™ Neural Compute Stick Program 1 Source: http://www.gartner.com/newsroom/id/3598917 20 billion connected devices by 2020¹ ... generating billions of petabytes of datatraffic between devices & the cloud Let’s look at a larger scale…
  7. 7. Intel® Movidius™ Neural Compute Stick Program What are you? I am asking the cloud if I should vacuum you, too. I'll scratch you down to your motors if you come any closer! Reduce BW Reduce Latency Privacy Why move intelligence from the cloud to the edge?
  8. 8. Intel® Movidius™ Neural Compute Stick Program Computer vision and AI at the edge
  9. 9. Intel® Movidius™ Neural Compute Stick Program But what about Developers? + NC SDK Free download @ developer.movidius.com Complete HW + SW solution for developing Deep Learning application on the edge
  10. 10. Intel® Movidius™ Neural Compute Stick Program Use Case with the Neural Compute Stick Little Ripper Lifesaver* UAV https://www.youtube.com/watch?v=QJOMfDyhUyo https://newsroom.intel.com/editorials/data-most-important-force-society-today/
  11. 11. Intel® Movidius™ Neural Compute Stick Program Key Capabilities Typical use cases could be: • Robot • Security camera • Smart-home assistant Key capabilities: • Object detection • Object classification • Facial recognition • Natural language processing
  12. 12. Intel® Movidius™ Neural Compute Stick Program Barriers to Moving Compute to the Edge Move compute from the cloud to the edge: • Accuracy • Available compute • Model efficiency • Model size
  13. 13. Intel® Movidius™ Neural Compute Stick Program Image Classification: Getting more accurate and every year
  14. 14. Intel® Movidius™ Neural Compute Stick Program Efficiency Key for Edge Devices Alfredo Canziani, Eugenio Culurciello, Adam Paszke “AN ANALYSIS OF DEEP NEURAL NETWORK MODELS FOR PRACTICAL APPLICATIONS”
  15. 15. Intel® Movidius™ Neural Compute Stick Program MobileNet performance on NCS Real time image classification on NCS https://github.com/tensorflow/models/blob/master/research/slim/nets/mobilenet_v1.md
  16. 16. Intel® Movidius™ Neural Compute Stick Program Object Detection Benchmarks Deep neural networks win in object detection in 2013. Ross Girshick, IEEE International Conference on Computer Vision (ICCV), 2015
  17. 17. Intel® Movidius™ Neural Compute Stick Program Object Detectors – Speed matters! Significant improvements in Object Detectors in the last two years enable Object Detection on edge devices like Intel Movidius NCS. Pascal 2007 MaP Speed R-CNN 66.0 .05FPS Fast R-CNN 70.0 0.5FPS Faster R-CNN 73.2 7FPS YOLO 69.0 45FPS SSD-Mobilenet 72.7 11FPS GPU NCS Jonathan Huang, et al, Speed/accuracy trade-offs for modern convolutional object detectors
  18. 18. Intel® Movidius™ Neural Compute Stick Program Object Detectors – lots of choices, choose wisely Jonathan Huang, et al, Speed/accuracy trade-offs for modern convolutional object detectors
  19. 19. Intel® Movidius™ Neural Compute Stick Program Machine Translation
  20. 20. Intel® Movidius™ Neural Compute Stick Program Intel® Movidius™ Neural Compute Stick Redefining the AI developer kit • Neural network accelerator in USB stick form factor • TensorFlow™ and Caffe frameworks supported, along with many popular networks • Source is available for the SDK, which allows you to compile for other platforms • Features the same Intel Movidius vision processing unit (Intel Movidius VPU) used in drones, surveillance cameras, VR headsets, and other low- power intelligent and autonomous products
  21. 21. Intel® Movidius™ Neural Compute Stick Program Demo: Scaling inference performance with multiple sticks
  22. 22. Intel® Movidius™ Neural Compute Stick Program Object Detection and Classification https://github.com/movidius/ncappzoo/tree/master/apps/birds Downscale Object detection Crop Bird classification AP NCS1 NCS2 Draw box and class
  23. 23. Intel® Movidius™ Neural Compute Stick Program Architecture Intel Movidius NCS contains the Intel® Movidius™ Myriad™ 2 vision processing unit, including 4 Gbit of LPDDR. Intel Movidius NCS is connected to an application processor (AP), such as a Raspberry Pi or UP Squared board. Execution is controlled by the LEON microprocessor, and the calculations are done on the SHAVE processors. 4Gbit LPDDR DDR Shave Shave Shave Shave Shave Shave Shave Shave Shave Shave Shave Shave Leon Microprocessor Programmable deep learning engines Compiler NCAPI NCS NCSDK Application Processor USB
  24. 24. Intel® Movidius™ Neural Compute Stick Program NC SDK Workflow
  25. 25. Intel® Movidius™ Neural Compute Stick Program NC SDK Workflow
  26. 26. Intel® Movidius™ Neural Compute Stick Program Development Flow Step 1: Convert the model 4Gbit LPDDR DDR Shave Shave Shave Shave Shave Shave Shave Shave Shave Shave Shave Shave Leon Microprocessor Programmable deep learning engines Compiler NCAPI NCS NCSDK Application Processor USB TensorFlow or Caffemodel NCS graph
  27. 27. Intel® Movidius™ Neural Compute Stick Program Trained model can be profiled on NCS for performance:
  28. 28. Intel® Movidius™ Neural Compute Stick Program NC SDK Workflow
  29. 29. Intel® Movidius™ Neural Compute Stick Program Development Flow Step 2: Load the model and the FW 4Gbit LPDDR DDR Shave Shave Shave Shave Shave Shave Shave Shave Shave Shave Shave Shave Leon Microprocessor Programmable deep learning engines Compiler NCAPI NCS NCSDK Application Processor USB NCS graph NCS FW
  30. 30. Intel® Movidius™ Neural Compute Stick Program Development Flow Step 3: Perform inference • Load the image • Run the model • Return the results 4Gbit LPDDR DDR Shave Shave Shave Shave Shave Shave Shave Shave Shave Shave Shave Shave Leon Microprocessor Programmable deep learning engines Compiler NCAPI NCS NCSDK Application Processor USB
  31. 31. Intel® Movidius™ Neural Compute Stick Program Demo
  32. 32. Intel® Movidius™ Neural Compute Stick Program Let’s Review • Moving AI to the edge is important for a number of reasons (lots of data, latency, and privacy) • Deep Learning has progressed in many areas where these use cases can be run on the edge (object detection, classification, etc.) • Intel Movidius NCS is an easy-to-use prototyping vehicle for developing your edge devices
  33. 33. Intel® Movidius™ Neural Compute Stick Program Explore developer.movidius.com Try out the following pages: • Main page • Getting started • Downloads • Docs • Forums • Where to buy
  34. 34. Intel® Movidius™ Neural Compute Stick Program Questions?
  35. 35. Intel® Movidius™ Neural Compute Program
  36. 36. Watch the video with slide synchronization on InfoQ.com! https://www.infoq.com/presentations/ neural-compute-stick

×