This document summarizes a presentation about future television and the NoTube project. The presentation discusses how television is becoming more interactive with the rise of second screens and social media. NoTube is developing open web standards and APIs to link social web data to television metadata and user profiles to power personalized and social recommendations. This will allow features like watching TV simultaneously with friends on different devices and getting recommendations from friends. The presentation outlines the technical approach taken in NoTube including linking different data sources, analyzing user preferences, and developing prototypes like an N-screen app for recommendations and sharing. Challenges in realizing this vision of social TV are also acknowledged.

1. This is future TV.
http://notube.tv
@notubeproject
Lora Aroyo
VU University Amsterdam
Web & Media Group
Thursday, May 24, 12

2. Thank you
for their slides to:
•
Dan Brickley, Vicky Buser, Valentina
Maccatrozzo, Libby Miller, Davide
Palmisano, and the whole NoTube
team
•
•
•
Ericsson user study report
RedBee Media
Ugli building wall posters
Thursday, May 24, 12

3. Thursday, May 24, 12

4. Scenario
Thursday, May 24, 12

5. TV & the People
Thursday, May 24, 12

6. choices, choices ...
Thursday, May 24, 12

7. lost in space
Thursday, May 24, 12

8. always missing
Thursday, May 24, 12

9. demand for experience
Thursday, May 24, 12

10. Web vs. TV
TV & the Web
Thursday, May 24, 12

11. simultaneously
Thursday, May 24, 12

12. 42% of UK adults
who use Internet
while watching TV
also discuss or
comment on
programs they are
watching
TV getting active
Thursday, May 24, 12

13. competition for attention
Thursday, May 24, 12

14. TV & the Devices
Thursday, May 24, 12

15. multitude of devices
Thursday, May 24, 12

16. multitude of access
Thursday, May 24, 12

17. Thursday, May 24, 12

18. Social & Personalized TV
Thursday, May 24, 12

19. not a single TV-viewer
activity any more
Thursday, May 24, 12

20. Thursday, May 24, 12

21. Recommendations need
Thursday, May 24, 12

22. I usually find NEW programmes to watch by:
RESULTS OF NOTUBE SOCIAL WEB & TV SURVEY 2012
Social Recommendations
Thursday, May 24, 12

23. I usually find NEW programmes to watch by:
Social TV
RESULTS OF NOTUBE SOCIAL WEB & TV SURVEY 2012
RESULTS OF NOTUBE SOCIAL WEB & TV SURVEY 2012
Social Recommendations
Thursday, May 24, 12

24. Social Recommendations
Thursday, May 24, 12

25. Thursday, May 24, 12

26. So, ...
what does this
all mean?
Thursday, May 24, 12

27. passive vs. active
what’s on vs. what’s there
group vs. individual
single vs. multiple devices
rich source for entertainment
vs. rich source of data
competition for attention
demand for social recommendations
Thursday, May 24, 12

28. What is NoTube?
a project about (future) TV and ...
• the Web
• personalization
• social media
• second screens
Thursday, May 24, 12

29. NoTube User
Perspective
... the role of social recommendations
how do people watch TV together?
how do devices influence watching?
privacy vs. personalization: perceived trade-offs ...
Thursday, May 24, 12

30. NoTube Technology
Perspective
... role of metadata in TV & Apps?
... a good way to share information in real time?
... a good way to sync TV & other metadata?
... an easy way for devices to find & talk to each other?
Thursday, May 24, 12

31. What did we do?
APIs & prototypes to link the Social Web
with broadcast and on-demand
television as open source services
Thursday, May 24, 12

32. How did we do it?
•
•
Open Web Standards
•
•
•
XMPP to pair devices with TV & group interaction
OAuth for trusted connection
Web APIs
Open Web Data
•
•
•
Open Graph API; standardized Activity Streams
Linked Data Cloud
Program metadata enriched with Web URLs
Key Point: Linking Web Data to User Profiles
Thursday, May 24, 12

33. Scenario
Thursday, May 24, 12

34. EPG Metadata
(BBC)
TV Program
Enrichment
Semantic Content
Patterns for
TV Programs
RDF Graph
TV
Programs
User Ratings &
Demographics
(BBC EPG
Data)
User Data
Analysis
Similarity
Clusters
of Programs
Semantic
Pattern-based
Recommendation
Strategy
Statistical
Recommendation
Service
Similarity-based
Recommendation
Strategy
Hybrid
Recommendation
Strategy
End End-Users
Users
Thursday, May 24, 12

35. NoTube’s Beancounter
aggregate, analyze & profile
Thursday, May 24, 12

36. TV Preference Data Sparse
•
•
Thursday, May 24, 12
Even for a single service (e.g. Netflix)
NoTube’s open systems: challenges multiply
•
•
•
•
often no global view, only per-user data
many ways of identifying same content item
many ways of identifying same user
many ways of identifying entities e.g. actors,
directors, ...

37. Fragmentation by Site
Thursday, May 24, 12

38. TV Preferences in NoTube
•
•
Inferred from the Social Web
tweets, FB likes, last.fm listened, etc.
weighted interests
•
•
Represented using Linked Data web identifiers
dbpedia.org/
record-linkage: facebook.com/pages/
•
•
NLP:
#littlebritain
http://dbpedia.org/resource/Matt_Lucas
http://dbpedia.org/resource/David_Walliams
Thursday, May 24, 12

39. TV Preferences in NoTube
•
•
Inferred from the Social Web
tweets, FB likes, last.fm listened, etc.
weighted interests
•
•
Represented using Linked Data web identifiers
dbpedia.org/
record-linkage: facebook.com/pages/
•
•
NLP:
#littlebritain Brilliant british humor by Matt Lucas & David
Walliams - whole range of facinating characters
portraying diversity of british society
http://dbpedia.org/resource/Matt_Lucas
http://dbpedia.org/resource/David_Walliams
Thursday, May 24, 12

40. Beancounter
key
analysis
value
{
crawler
activities
{
profiles
{
analysis
engine
REST platform
Thursday, May 24, 12
profiler

41. Thursday, May 24, 12

42. Thursday, May 24, 12

43. Thursday, May 24, 12

44. Thursday, May 24, 12

45. Thursday, May 24, 12

46. NoTube’s N-Screen
drag & drop, sharing & TV control
N-Screen
drag & drop, sharing & TV control
Thursday, May 24, 12

47. Suggestions for You
N-Screen
drag & drop, sharing & TV control
Thursday, May 24, 12

48. Recommendations
COLD
START
combine in a
complementary way
statistical & semantic
approaches
surface interesting, new &
relevant programs to
individual and group users
PRIVACY
LOD
METADATA
ENRICHMENT
CONTENT
PATTERNS
DEMOGRAPHICS
find the balance
between serendipity
& diversity of
recommendations
INTRUSIVENESS
Thursday, May 24, 12

49. Analysis of LOD Sources
Dataset LinkedMDB
DBpedia
Freebase
#triples
6,147,978
385,000,000 337,203,427
#props
221
1643
n.a.
#types
53
3,640,000
12,000,000
Dataset
Enriched
BBC
#triples
240,630
#props
41
#types
17,029
Type
Pattern
People
person - co_participation - person
62162
512,944
People
person - actor - person
24843
http://purl.org/dc/terms/date
74,111
Format
program - has_format - format
13108
foaf:made
53,180
Genre
program - has_genre - genre
12767
linkedmdb:actor_actorid
50,603
People
person - influencedBy - person
10053
dbprop:hasPhotoCollection
30,354
People
person - partner - person
10053
Award
program - award_won - award
Properties
foaf:page
Thursday, May 24, 12
#triples
#
782

50. From Predictability to
Serendipity
Thursday, May 24, 12

51. From Predictability to
Serendipity
Paul Merton
looks at
Alfred Hitchcock
Thursday, May 24, 12
Secret
Gardens
Make ‘em
laugh

52. From Predictability to
Serendipity
Paul Merton
looks at
Alfred Hitchcock
Thursday, May 24, 12
at
form
documentary
format
form
at
Secret
Gardens
Make ‘em
laugh

53. From Predictability to
Serendipity
Paul Merton
looks at
Alfred Hitchcock
at
form
genre
aw
ard
documentary
art culture
and the media
Grammy Awards
Thursday, May 24, 12
format
form
at
genre
award
Basic patterns
Secret
Gardens
ge
Make ‘em
laugh
nr
e
homes and
gardens

54. From Predictability to
Serendipity
Paul Merton
looks at
Alfred Hitchcock
aw
an
ch
format
documentary
at
form
genre
form
at
art culture
and the media
ard
genre
award
Grammy Awards
or
Paul
Merton
pa
rtn
er
Caroline
Quentin
ac
to
r
Life of
Riley
ge
nr
e
comedy
Thursday, May 24, 12
Basic patterns
Homogeneous patterns
Secret
Gardens
ge
Make ‘em
laugh
nr
e
homes and
gardens

55. From Predictability to
Serendipity
an
ch
ard
genre
award
Grammy Awards
or
Paul
Merton
pa
rtn
ge
Make ‘em
laugh
infl
uen
ce
er
Spike
Milligan
Caroline
Quentin
ac
to
r
ge
nr
or
The adventures
of Barry
McKenzie
e
at
form
Life of
Riley
act
nre
aw
form
at
art culture
and the media
comedy
film
Thursday, May 24, 12
Basic patterns
Homogeneous patterns
Secret
Gardens
ge
Paul Merton
looks at
Alfred Hitchcock
format
documentary
at
form
genre
nr
e
homes and
gardens

56. From Predictability to
Serendipity
ch
award
Grammy Awards
or
influence
infl
uen
ce
Paul
Merton
pa
rtn
er
Spike
Milligan
or
synopsis
enrichment
The adventures
of Barry
McKenzie
homes and
gardens
Shanghai
Knights
gen
re
r
r
ge
nr
e
at
form
Life of
Riley
Jackie
Chan
comedy
film
Thursday, May 24, 12
e
to
to
act
Make ‘em
laugh
nr
ac
Caroline
Quentin
ac
Charlie
Chaplin
ge
form
at
an
ard
genre
nre
aw
art culture
and the media
Basic patterns
Homogeneous patterns
Heterogeneous patterns
Secret
Gardens
form
at
ge
Paul Merton
looks at
Alfred Hitchcock
format
documentary
at
form
genre
action and
adventure

57. From Predictability to
Serendipity
synopsis
enrichment
ch
Grammy Awards
or
influence
infl
uen
ce
Paul
Merton
pa
Alfred
Hitchcock
rtn
er
ar
d
nre
aw
ge
Thursday, May 24, 12
Thriller
Shanghai
Knights
gen
re
ge
nr
e
at
form
Life of
Riley
form
at
The adventures
of Barry
McKenzie
homes and
gardens
r
r
Suspicion
or
synopsis
enrichment
e
to
to
act
Make ‘em
laugh
nr
ac
ac
Charlie
Chaplin
Spike
Milligan
Caroline
Quentin
director
Academy
Awards
award
ge
form
at
an
ard
genre
nre
aw
art culture
and the media
Basic patterns
Homogeneous patterns
Heterogeneous patterns
Secret
Gardens
form
at
ge
Paul Merton
looks at
Alfred Hitchcock
format
documentary
at
form
genre
Jackie
Chan
comedy
film
action and
adventure

58. Weak Semantics &
Statistical Support
Thursday, May 24, 12

59. Weak Semantics &
Statistical Support
Paul Merton
looks at
Alfred Hitchcock
Paul
Merton
partner
Caroline
Quentin
act
ge
nre
form
at
or
anchor
Life of
Riley
documentary
art culture
and the media
Thursday, May 24, 12

60. Weak Semantics &
Statistical Support
Paul Merton
looks at
Alfred Hitchcock
Paul
Merton
partner
Caroline
Quentin
act
ge
nre
form
at
or
anchor
Life of
Riley
documentary
art culture
and the media
Thursday, May 24, 12
User
profile
woman
25 years old
1 child

61. Weak Semantics &
Statistical Support
Paul Merton
looks at
Alfred Hitchcock
Paul
Merton
partner
Caroline
Quentin
User
profile
act
ge
nre
form
at
or
anchor
Life of
Riley
documentary
art culture
and the media
Thursday, May 24, 12
25 years old
women with
1 child
woman
25 years old
1 child

62. Weak Semantics &
Statistical Support
Paul Merton
looks at
Alfred Hitchcock
Paul
Merton
partner
Caroline
Quentin
User
profile
act
ge
nre
form
at
or
anchor
Life of
Riley
Similar users
documentary
art culture
and the media
Thursday, May 24, 12
25 years old
women with
1 child
woman
25 years old
1 child

63. Shuffle
N-Screen
drag & drop, sharing & TV control
Thursday, May 24, 12

64. Real-time Sharing
N-Screen
drag & drop, sharing & TV control
Thursday, May 24, 12

65. Suggestions from Friends
N-Screen
drag & drop, sharing & TV control
Thursday, May 24, 12

66. Explanations
Thursday, May 24, 12

67. Changing Program on TV
N-Screen
drag & drop, sharing & TV control
Thursday, May 24, 12

68. Surveys
Thursday, May 24, 12

69. Focus Groups
Thursday, May 24, 12

70. Thursday, May 24, 12

71. finding
INTERESTING
PROGRAMMES
sharing them
based on
♥ suggestions activities your past
'Social Web'
♥
suggestions based on programmes
others have watched
✔
linking programmes by guests, actors,
presenters etc.
✔
♥ drag & drop
♥
'shuffle' option for programme selection
♥ swapping suggestions with specific friends
?
sharing suggestions with others in the same room
?
?
explaining recommendations
sharing to watch immediately
controlling the TV
♥
drag & drop to change what's playing on TV
watching with friends
✔ watching 'together apart' in different locations
✘ changing programmes on someone else's TV
Thursday, May 24, 12

72. Challenges
Thursday, May 24, 12

73. More from NoTube ...
http://notube.tv
Thursday, May 24, 12

74. Second Screen
TEA & TEAPlayer
video annotation & second screen
Shaker
Randomizing program chooser
Thursday, May 24, 12

75. Second Screen
Thursday, May 24, 12

76. Second Screen
Thursday, May 24, 12

77. Second Screen
Thursday, May 24, 12

78. Main TV Screen
Thursday, May 24, 12

79. Personal
Ads
Low%interest%in%this%corner%
Best%moment%
Thursday, May 24, 12

80. Thank you
for their slides to:
•
Dan Brickley, Vicky Buser, Valentina
Maccatrozzo, Libby Miller, Davide
Palmisano, and the whole NoTube
team
•
•
•
Ericsson user study report
RedBee Media
Ugli building wall posters
Thursday, May 24, 12

81. Thursday, May 24, 12

82. http://notube.tv
mailing list: public-notube@few.vu.nl
twitter: @notube, #notube
videos: https://vimeo.com/user3487770
videos: http://youtu.be/0QUPKQLvOHU
http://www.slideshare.net/NoTubeProject
Thursday, May 24, 12