Office365 Cognitive Services Azure IoT SharePoint Community

1. Integrate the 21st Century Lunch Bell into your Modern
Workplace
Thomas Gölles - @thomyg
Stephan Bisser - @cloudguy_pro
SharePoint Saturday Zurich 26.5.2018

2. Thanks to our Sponsors <3

3. Thomy
Head of Modern Workplace Solutions
Co-Organizer of SharePoint Saturday Vienna (#SPSVIE), Office
365 Meetup Graz, Office 365 Meetup Vienna
http://www.modernworkplacesolutions.rocks/
@thomyg

4. Stephan
• Consultant @SOLVION (O365 & Azure)
• Microsoft AI MVP
• P-TSP @Microsoft for Azure
• AI (Cognitive Services & Bots)
• Azure & O365
• Soccer
@cloudguy_pro
AskCloudguy
www.cloudguy.pro
stephan@cloudguy.pro

5. Agenda
1 Little bit of background 2 “Bussiness Problem”
3 Tech geek out 4 DEMO

6. Our Office in Graz, Austria

7. This was
Thomy‘s view
before he
switched
rooms

8. Lunchtime at our office (around 10:45)

9. Yummy

10. This is
Thomy‘s view
after he
switched
rooms (now)

11. Possible solutions
• Create a recurrent event in Outlook
• “Ping” a colleague everyday
• Stand up and have a look
• Use technology to solve the problem

12. MOCADESYMO was born
• Penny: Well, you know, it’s the Cheesecake Factory. People order
cheesecake, and I bring it to them.
• Leonard: So, you sort of act as a Carbohydrate Delivery System.
• Penny: Yeah, call it whatever you want, I get minimum wage.
Mobile
Monitor

13. MOCADESYMO

14. MOCADESYMO‘s view

15. 1. Raspberry PI camera takes photo of food truck, after it has arrived
2. Paspberry PI uploads the taken image into an Azure Blob Storage
3. Raspberry PI triggers an Azure Function after the image has been uploaded successfully
4. Azure Function calls the Custom Vision API in order to check wether the food truck is present or not
5. If the Custom Vision API responds with a high probability that the food truck has arrived, the Azure Function sends a notification to Teams
6. Users can ask the Lunchbell Bot in Teams wether the food truck has arrived or not or if it is still present
7. Azure Bot Service checks the entries in an Azure Table Storage where the arrival and departure time is stored
Architecture of the 21st century lunchbell

16. Bots & Cognitive Services

17. Chatbots 101
“a computer program designed to have a
conversation with a human being, especially over
the internet” *
* https://dictionary.cambridge.org/dictionary/english/chatbot

18. Microsoft Bot Framework

19. Microsoft Cognitive
Services

20. Custom Vision Service
• Upload images
• Upload your own labeled images, or
use Custom Vision Service to quickly tag
any unlabeled images
• Train
• Use your labeled images to teach
Custom Vision Service the concepts you
want it to learn
• Evaluate
• Use simple REST API calls to quickly tag
images
with your new custom computer vision
model
• Active learning
• Images evaluated through your custom
vision model become part of a
feedback loop you can
use to keep improving your classifier
Normal State98,53 % True100 % True99,9 % True

21. Language Understanding
[ $LunchBell.Object ] [ $LunchBell.Operation ]
„Has the food truck arrived?“
www.luis.ai
Has the food truck arrived?
Intent = CheckArrivalState

22. LUIS

23. SharePoint Portal

26. Demo Case

27. Evaluation Form
http://mvp.ms/SPSZurich2018
This survey is anonymous, but you can voluntarily enter your
name and email address for a chance to win a license of Nintex
Workflow Cloud.
Consent is necessary to participate to the lottery.

28. Thank you for attending!