Présentation au Global Azure Boot Camp 2017 IoT et Robotique. Tous les services Azure utiles pour ajouter de l'intelligence à votre Robot humanoïde

1. Azure IoT
Aymeric Weinbach

2. www.azug.fr
© 2017 AZUG FR. All Rights Reserved.
2
Meet the Team
Aymeric Weinbach
@aymericw

3. www.azug.fr
© 2017 AZUG FR. All Rights Reserved.
14
Au programme
■L’IoT ?
■Prototypez vos objets connectés
■Les services Azure IoT
■AI

4. www.azug.fr
© 2017 AZUG FR. All Rights Reserved.
15
L’IoT ?

5. www.azug.fr
© 2017 AZUG FR. All Rights Reserved.
16
Harnessing the IoT Revolution
What if I could tell when it’s the best time for my things to _______ ?
What if my things could tell me when they go someplace they
shouldn’t?
What if I simply knew where my things were?
What if I knew when my things were going to break before they did?
What if I could use device telemetry to improve next generation devices?
What insights could I find from all of my devices?
It all starts with a great idea…

6. www.azug.fr
© 2017 AZUG FR. All Rights Reserved.
Prototyping

7. www.azug.fr
© 2017 AZUG FR. All Rights Reserved.
18
La nécessité de prototyper
Cout d’un oubli ou d’un bug coté cloud :
corriger le bug , commit, push, build, deploy ( cout : 3 clics et un café)
Cout d’un oubli ou d’un bug coté device :
Hardware : refaire tous les devices
Software : Mise à jour de firmware (est ce que c’est prévu)
Dans les 2 cas trés cher $$$

8. www.azug.fr
© 2017 AZUG FR. All Rights Reserved.
19
Choisir une plateforme de prototypage

9. www.azug.fr
© 2017 AZUG FR. All Rights Reserved.
20Azure IoT Starter Kits
Get started quickly
http://azure.com/iotstarterkits

10. www.azug.fr
© 2017 AZUG FR. All Rights Reserved.
21
imprimante 3D

11. www.azug.fr
© 2017 AZUG FR. All Rights Reserved.
22
Objectif Robot connecté et intelligent

12. www.azug.fr
© 2017 AZUG FR. All Rights Reserved.
23

13. www.azug.fr
© 2017 AZUG FR. All Rights Reserved.
24
Social Robot

14. www.azug.fr
© 2017 AZUG FR. All Rights Reserved.
AzureIoT

15. www.azug.fr
© 2017 AZUG FR. All Rights Reserved.
26
Microsoft Cloud offer for IoT
Predictive
maintenance
Asset
management
Azure IoT SuiteAzure services (IoT and others)

16. www.azug.fr
© 2017 AZUG FR. All Rights Reserved.
Azure Services for IoT

17. www.azug.fr
© 2017 AZUG FR. All Rights Reserved.
Platform Services
Infrastructure Services
Web Apps
Mobile
Apps
API
Management
API Apps
Logic Apps
Notification
Hubs
Content
Delivery
Network (CDN)
Media
Services
BizTalk
Services
Hybrid
Connections
Service Bus
Storage
Queues
Hybrid
Operations
Backup
StorSimple
Azure Site
Recovery
Import/Export
SQL
Database
DocumentDB
Redis
Cache
Azure
Search
Storage
Tables
Data
Warehouse
Azure AD
Health Monitoring
AD Privileged
Identity
Management
Operational
Analytics
Cloud
Services
Batch
RemoteApp
Service
Fabric
Visual Studio
App
Insights
Azure
SDK
VS Online
Domain Services
HDInsight Machine
Learning
Stream
Analytics
Data
Factory
Event
Hubs
Mobile
Engagement
Data
Lake
IoT Hub
Data
Catalog
Security &
Management
Azure Active
Directory
Multi-Factor
Authentication
Automation
Portal
Key Vault
Store/
Marketplace
VM Image Gallery
& VM Depot
Azure AD
B2C
Scheduler

18. www.azug.fr
© 2017 AZUG FR. All Rights Reserved.
29
Azure IoT Suite
Business
Process
ERP/CRMEvent Hub
Storage Blobs DocumentDB
Web App
Stream Analytics Logic Apps
Azure
Active Directory
IoT Hub Web Jobs
Devices
Azure IoT SDK (OSS)
Linux, RTOS, mBed, Windows,
Android, iOS
Power BI

19. www.azug.fr
© 2017 AZUG FR. All Rights Reserved.
30
Architecture Lambda

20. www.azug.fr
© 2017 AZUG FR. All Rights Reserved.
31
Azure IoT Hub
Designed for IoT
• Connectivity, Security & Management for billions of
devices
Service Assisted Communications
• Devices are not servers
• Use IoT Hub to enable secure bi-directional
communications
Cloud Scale Messaging
• Device-to-cloud and Cloud-to-device
• Durable message inbox/outbox per device
Monitor Devices
• Delivery receipts, expired messages
• Device communication errors

21. www.azug.fr
© 2017 AZUG FR. All Rights Reserved.
32
Stream Analytics
Data Source Collect Process ConsumeDeliver
Event Inputs
- Event Hub
- Azure Blob
Transform
- Temporal joins
- Filter
- Aggregates
- Projections
- Windows
- Etc.
Enrich
Correlate
Outputs
- SQL Azure
- Azure Blobs
- Event Hub
Azure
Storage
• TemporalSemantics
• Guaranteeddelivery
• Guaranteeduptime
Azure Stream Analytics
Reference Data
- Azure Blob

22. www.azug.fr
© 2017 AZUG FR. All Rights Reserved.
Artificial Intelligence

23. www.azug.fr
© 2017 AZUG FR. All Rights Reserved.

24. www.azug.fr
© 2017 AZUG FR. All Rights Reserved.
35
Cortana Intelligence Suite
Action
People
Automated
Systems
Apps
Web
Mobile
Bots
Intelligence
Dashboards &
Visualizations
Cortana
Bot
Framework
Cognitive
Services
Power BI
Information
Management
Event Hubs
Data Catalog
Data Factory
Machine Learning
and Analytics
HDInsight
(Hadoop and
Spark)
Stream Analytics
Intelligence
Data Lake
Analytics
Machine
Learning
Big Data Stores
SQL Data
Warehouse
Data Lake Store
Data
Sources
Apps
Sensors
and
devices
Data
http://www.microsoft.com/en-us/server-cloud/cortana-intelligence-suite

25. www.azug.fr
© 2017 AZUG FR. All Rights Reserved.
Machine Learning services in the cloud

26. www.azug.fr
© 2017 AZUG FR. All Rights Reserved.
37
Machine Learning services in the cloud

27. www.azug.fr
© 2017 AZUG FR. All Rights Reserved.
Cognitive
Services
Give your solutions
a human side

28. www.azug.fr
© 2017 AZUG FR. All Rights Reserved.
Smarter robots with Cognitive Services

29. www.azug.fr
© 2017 AZUG FR. All Rights Reserved.
Emotion
Speaker
Recognition
Speech
Custom
Recognition
Computer Vision
Face
Video
microsoft.com/cognitive
Linguistic Analysis
Language
Understanding
Bing Spell Check
Entity Linking
Knowledge
Exploration
Academic
Knowledge
Bing
Image Search
Bing
Video Search
Bing
Web Search
WebLM
Text Analytics Recommendations
Bing
Autosuggest
Bing
News Search
Translator
Content
Moderator
QnA Maker

30. www.azug.fr
© 2017 AZUG FR. All Rights Reserved.
Roll your own with REST APIs
Simple to add: just a few lines of code
required
Integrate into the language and platform
of your choice
Breadth of offerings helps you find the
right API for your app
Built by experts in their field from
Microsoft Research, Bing, and Azure
Machine Learning
Quality documentation, sample code,
and community support
Easy Flexible Tested
GET A
KEY

31. www.azug.fr
© 2017 AZUG FR. All Rights Reserved.
• Analyze an Image – Understand
content and features within an
image for a growing set of
categorization
• Wide range of concepts from
cat to fireworks
• OCR – Detect and recognize words
within photos or scanned
documents
• Generate Thumbnail – Scale and
crop an image, while retaining key
content
• Powers Bing Image search and
OneDrive.com Photos
Vision APIs
Recognized text:
A GOAL WITHOUT
A PLAN IS
JUST A WISH
Analyze image
OCR
Smart thumbnail
Category People; 1 face found
Adult / Racy? False / True
Black & White? No
Dominant colors
Accent color

32. www.azug.fr
© 2017 AZUG FR. All Rights Reserved.
• Face Detection – Detects faces and
their attributes within an image
• Face Verification – Check if two
faces belong to the same person
• Similar Face Searching – Find
similar faces within a set of images
• Face Grouping – Organize many
faces into groups
• Face Identification – Search which
person a face belongs to
• Models used to power Microsoft
Skype & Windows Hello
Face APIs Face Rectangle – width; height; left; top
Attributes:
• Age – 31
• Gender – Male
Face Landmarks –pupil, nose, mouth
Detection Result
Grouping
He is Chao Wang…
Identity

33. www.azug.fr
© 2017 AZUG FR. All Rights Reserved.
• Identifies emotions based on
expressions that psychologic research
identifies as universal: Happiness,
Surprise, Sadness, Anger, Fear, and
Disgust
• Has been trained to identify emotions
in-the-wild.
• A solution for analyzing individual
responses to media and products, to
crowd analytics, and to enhanced
personalization
• Get insights into how your users react
to content and experiences
• Track facial expressions for multiple
users over time.
Emotion APIs

34. www.azug.fr
© 2017 AZUG FR. All Rights Reserved.
• Stabilization – Smooth and stabilize
shaky video
• Face Detection and Tracking – Detect
and track faces in videos
• Motion Detection – Detect when
motion occurs
Video APIs

35. www.azug.fr
© 2017 AZUG FR. All Rights Reserved.
Speech Intent
Recognition
Text to Speech
Conversion
Convert text to spoken audio
Speech
Recognition
Convert spoken audio to text
450 6th St.
San Francisco
Convert audio to intent
"450 sixth St in San
Francisco."
"For 50 six St San
Francisco."
"456th St San Francisco."
• State of the art algorithms to
process spoken language
• Voice Recognition – Converts
spoken audio to text
• Support for 18 languages
(28 locales)
• Voice Output – Synthesize audio
from Text
• Support for 9 languages (17
locales)
• Powered by Bing, which is the
same backend for Xbox and
Cortana on Windows Phone 8.1
and Windows 10
Speech
APIs

36. www.azug.fr
© 2017 AZUG FR. All Rights Reserved.
• Language models from the web
• Capturing distinct expression styles
• Text body
• Titles
• Search queries
• Essential component for
• New lexicon discovery
• Key phrase extraction
• Auto completion
• Word/phrase breaking
• Speech/Handwriting
recognition
• OCR
• Spelling correction
Web Language
ModelAPI
New York times square report
?

37. www.azug.fr
© 2017 AZUG FR. All Rights Reserved.
• Read text document and identify
mentions of people, locations, events
and things (“entities”)
• Disambiguate mentions in context and
link them to a give knowledge base
• Backend API powering
• Edge browser: “Ask Cortana”
• Android: “Bing Snapshot”
• Available
• Now: Wikipedia
• Later: Bing Satori Knowledge
• Adaptable to enterprise data
Entity Linking Service

38. www.azug.fr
© 2017 AZUG FR. All Rights Reserved.
• Draw insights from your data
• Search and Browse
• Rank and Recommend
• Showcase: Academic Knowledge API =
KES + academic graph
• What are top publications for a
subject?
• Who are the experts?
• Where are the activities taking
place?
• Who are working with whom on
what?
• When was the work done?
• What are the new trends?
Knowledge Exploration
Service (KES)

39. www.azug.fr
© 2017 AZUG FR. All Rights Reserved.

40. www.azug.fr
© 2017 AZUG FR. All Rights Reserved.

41. www.azug.fr
© 2017 AZUG FR. All Rights Reserved.
59
Merci à nos sponsors
PLATINUM
LOCAUX
PARTENAIRES MEDIA

42. www.azug.fr
© 2017 AZUG FR. All Rights Reserved.
60
Sponsors internationaux

43. www.azug.fr
© 2017 AZUG FR. All Rights Reserved.
61
Nous suivre
Facebook
facebook.com/groups/azugfr/
Twitter
twitter.com/AZUGFR
Meetup
meetup.com/AZUG-FR/
LinkedIn
Linkedin.com/inspirasign
Web
www.azug.fr

44. Merci
d’être venus
A bientôt !