1. Ok, Computer: understanding me in
the Internet of Things
Darren Harris, CTO

2. Natural Language

3. 2011
2012
2013
2014
2015

4. 55%
Teens
41%
Adults
Commissioned by Google (US)
Source: Northstar Research, October 2014

5. Speech Recognition:
Primary UI of the future?
0% 23% 45% 68% 90%
2015 2020
Eye Tracking
Touchless / 3D Touch
Voice Recognition
Gesture Recognition
Localised Haptics
Speech Recognition
Source: Tractica, 2015
32B?2015
16B2014
8B
2013
4B
2012
1,6B
2011
0,8B
2010
Source: Nuance, 2015

6. “The keyboard….how quaint”

7. 1760s-1840s 1850s-1940s 1950s-?
1 2 3

8. 1980s 1990s2000s
Industrial Internet
(Internet of Things)

9. YEAR
2011 2013 2015 2017 20192012 2014 2016 2018
Global
Smartphone
Penetration
Source: Statista 2015
UK / NL
20%
44%
53%
60%
67%
72%
77%
81%
10%
16%
20%
25%
28%
31%
34%
37%
72%
2015
>90%
UK
By
2020
>40%
Global
>3B
Phones

10. PCs & Laptops
Smartphones
Tablets
Internet Media
Smart TV
Smart Home Devices
Wearables
Internet of Things
YEAR
BILLIONSOFDEVICES
0
10
20
30
2007 2010 2013 2016 20192008 2009 2011 2012 2014 2015 2017 2018 2020
5
15
25
35
Source: Strategy Analytics, October 2014
>33B
devices
>15B
IoT
>4B
Home
By
2020

11. Connected World
IoT

12. “They don’t deu Sco’ish accents”

13. The Perfect Storm

14. What time is the next train
from Brighton to London?
1
2
3
5
1
4
Which platform for
the 7:49 this evening?
2
3
4
>90%
>99%
CapitoController *controller = [CapitoController getInstance];
[controller setupWithID:appKey host:testHost port:[NSNumber numberWithInt:443] useSSL:YES];
[[CapitoController getInstance] connect];

15. More Data
Better Accuracy
Wider
Adoption
Virtuous Circle
Model
inform(domain=“TrainTicketing")&
inform(limit=“1")&
inform(task=“NavigateTimes")&
inform(to=“London”)&
inform(from=“Brighton”)
=
What time is the next train from Brighton to London?
x
inform(domain=“TrainTicketing")&
inform(limit=“1")&
inform(task=“NavigateTimes")&
inform(to=“London”)&
inform(from=“Brighton”)
=
Shiomi next train from Brighton to London?

16. <T>
Voice
Model
What time is the next train from Brighton to London?
Lang
Domain
Entities
Time
Which platform for the 7:49 this evening to Victoria?
Text
Model
en_GB
TrainTicketing
Brighton
London
Now
en_GB
TrainTicketing19h49m
Pre-processingSemantic Output
{
"limit": "1",
"task": "NavigateTimes",
"domain": "TrainTicketing",
"from": “Brighton”,
"to": "London",
}
{
"task": "NavigatePlatform",
"domain": "TrainTicketing",
"start_datetime": {
"day": 14,
"month": 10,
"year": 2015,
"hour": 19,
"minute": 49
},
"to": "Victoria"
} Pre-processingSemantic Output
{
"limit": "1",
"task": "NavigateTimes",
"domain": "TrainTicketing",
"from": "Brighton",
"to": "London"
}
+
{
"task": "NavigatePlatform",
"domain": "TrainTicketing",
"start_datetime": {
"day": 14,
"month": 10,
"year": 2015,
"hour": 19,
"minute": 49
},
"from": "Brighton",
"to": "London Victoria"
"limit": "1"
}
Victoria
Post-ProcessingPost-Processing

17. {
"task": "NavigatePlatform",
"domain": "TrainTicketing",
"start_datetime": {
"day": 14,
"month": 10,
"year": 2015,
"hour": 19,
"minute": 49
},
"from": "Brighton",
"to": “London Victoria"
"limit": "1"
}

18. “Show me Nike Jordan’s in blue and grey size 9”
<T>

19. Show me Nike Air Force 1
shoes in size 43 in red

20. Take me to checkout

21. How much did I spend
last monthDid I get any interest on my
current account last month
Transfer €100 to my
savings account each month on
the 15th
Cancel my direct debit with
Vodafone
How much have I spent at
Zalando’s this year

22. Thank You
@CapitoSystems @darren_lh
darren.harris@capitosystems.com
www.capitosystems.com