What's on this evening? Designing User Support for Event-based Annotation and Exploration of Media - Talk given at the 1st International Workshop "EVENTS 2010 - Recognising and tracking events on the Web and in real life", Athens, Greece, May 4th 2010

1. What's on this evening?
Designing User Support for Event-based
Annotation and Exploration of Media
http://eventmedia.cwi.nl
<andre.fialho@cwi.nl>
<lynda.hardman@cwi.nl>
<raphael.troncy@eurecom.fr>
<scherp@uni-koblenz.de>
<saathoff@uni-koblenz.de>

2. Events and Media
Events are observable occurrences grouping
People Places Time
Experiences documented by Media
04/05/2010 - What's on this evening? Designing User Support for Event-based Annotation and Exploration of Media - EVENTS 2010, Athens, Greece 2

3. Goal
1. Discover PAST, PRESENT and FUTURE events
2. Live, relive and predict experiences through shared media
3. Identify meaningful and/or interesting relationships
between events/media/people
04/05/2010 - What's on this evening? Designing User Support for Event-based Annotation and Exploration of Media - EVENTS 2010, Athens, Greece 3

4. Outline
1. User-centered design
2. Datasets
3. Interface aspects
4. Conclusion
04/05/2010 - What's on this evening? Designing User Support for Event-based Annotation and Exploration of Media - EVENTS 2010, Athens, Greece 4

5. Exploratory Study
Online Survey (n=28), 2 group discussions (n=35)
Past Experiences
(Memorable Events) Existing Technologies
• Discovery • Opinions Scenarios
• Decision making • Interests Requirements
• Registering & sharing • Suggestions 1st Design Concept
• Meaningful relationships • Benefits/drawbacks
04/05/2010 - What's on this evening? Designing User Support for Event-based Annotation and Exploration of Media - EVENTS 2010, Athens, Greece 5

6. Discovery
• Invitations and recommendations
• Rely on traditional media
• Social networks (facebook - students)
• Previously attended events or venues
Decision Making
• Who’s Joining?
• Where, When, How Much?(constraints)
• What? (e.g. type, performer, topic)
• Subjective factors (fun, atmosphere)
04/05/2010 - What's on this evening? Designing User Support for Event-based Annotation and Exploration of Media - EVENTS 2010, Athens, Greece 6

7. Registering and Sharing
• Communicating their experience
• Pictures and short videos (for sharing)
• Media directories and social networks
Meaningful Relationships
• Similar categories, attributes and content
• User attendance (similar interests, behaviors)
• Repeated events (e.g. annual festivals)
04/05/2010 - What's on this evening? Designing User Support for Event-based Annotation and Exploration of Media - EVENTS 2010, Athens, Greece 7

8. Event Directories
• Single source event overview & information.
• Allows opportunistic/serendipitous discovery
• Limited exploration/browsing features
• Information overload (cluttered, difficult)
• Information incompleteness (coverage, decision)
Media Directories
• Aids decision making, remembering and sharing experiences.
Social Networks
• Allows communication, sharing and event attendance
04/05/2010 - What's on this evening? Designing User Support for Event-based Annotation and Exploration of Media - EVENTS 2010, Athens, Greece 8

9. Outline
1. User-centered design
2. Datasets
3. Interface aspects
4. Conclusion
04/05/2010 - What's on this evening? Designing User Support for Event-based Annotation and Exploration of Media - EVENTS 2010, Athens, Greece 9

10. Services
• Existing services to explore, share and discover event
• Aggregate these heterogeneous data sources
• Enrich with media and social data
04/05/2010 - What's on this evening? Designing User Support for Event-based Annotation and Exploration of Media - EVENTS 2010, Athens, Greece 10

11. Semantization of Data
SEARCH
1,438,128 results
Machine tags
“lastfm:events”
Lastfm + flickr APIs
...Events[ event_id, ...medias[photo_id, user_id, url_t, url_o, title, description]]
LastFM events 2 LODE Upcoming + Flickr (363,137)
Eventful, Dailymotion, Youtube?
04/05/2010 - What's on this evening? Designing User Support for Event-based Annotation and Exploration of Media - EVENTS 2010, Athens, Greece 11

12. LODE Example
Jack recorded a video with his mobile phone camera while he was
attending the Haiti Relief concert from Radiohead given on January 24th, 2010 in
LA. He thinks it was a really nice experience and wants to share it on-line. He would
also like to see how other people experienced the show
04/05/2010 - What's on this evening? Designing User Support for Event-based Annotation and Exploration of Media - EVENTS 2010, Athens, Greece 12

13. What does it mean?
04/05/2010 - What's on this evening? Designing User Support for Event-based Annotation and Exploration of Media - EVENTS 2010, Athens, Greece 13

14. F-Model Example
04/05/2010 - What's on this evening? Designing User Support for Event-based Annotation and Exploration of Media - EVENTS 2010, Athens, Greece 14

15. Outline
1. User-centered Design
2. Datasets
3. Interface Aspects
4. Conclusion
04/05/2010 - What's on this evening? Designing User Support for Event-based Annotation and Exploration of Media - EVENTS 2010, Athens, Greece 15

16. Interface elements
Facets Search Timeline
Events
Media
Attendance ME
Content and Background
Location (Map)
Actions Sorting
04/05/2010 - What's on this evening? Designing User Support for Event-based Annotation and Exploration of Media - EVENTS 2010, Athens, Greece 16

17. Facet ed br ow sin g + Sem an t ic A ut ocom plet ion
A m st er d am Fest ivals, Con cer t s Cat egor y? Ra
Add + +
Rock (5 5 ), Pop (3 0 ), Jazz (2 2 ), Elect r on ic (1 2 ), Techn o (1r1 ), Dan ce
Gen e:
(9 ), M or e...
Rap
A r t ist :
Or d er : Relvan ce
Rad io Head
Ram m st ein
Ray Char les
...
Ven ue:
Rad io House
Rat t le Sn ake
- +
01/ 03/ 10
M ar ch 28/ 03/ 10
04/05/2010 - What's on this evening? Designing User Support for Event-based Annotation and Exploration of Media - EVENTS 2010, Athens, Greece 17

18. Per spect ive: WHA T?
A m st er d am Fest ivals Cat egor y? Add +
Rock (5 5 ), Pop (3 0 ), Jazz (2 2 ), Elect r on ic (1 2 ), Techn o (1 1 ), Dan ce (9 ), M or e...
Or d er : Relvan ce
Even t s
Rad iohead
Dali Exhibit ion
Beer fest ival
...
Pr ev Next
- +
01/ 03/ 10
M ar ch 28/ 03/ 10
04/05/2010 - What's on this evening? Designing User Support for Event-based Annotation and Exploration of Media - EVENTS 2010, Athens, Greece 18

19. Per spect ive: WHEN?
A m st er d am Fest ivals Cat egor y? Add +
Rock (5 5 ), Pop (3 0 ), Jazz (2 2 ), Elect r on ic (1 2 ), Techn o (1 1 ), Dan ce (9 ), M or e...
Or d er : When
Even t s
Rad iohead
Dali Exhibit ion
Beer fest ival
...
Pr ev Next
- +
01/ 03/ 10
M ar ch 28/ 03/ 10
04/05/2010 - What's on this evening? Designing User Support for Event-based Annotation and Exploration of Media - EVENTS 2010, Athens, Greece 19

20. Per spect ive: WHERE?
A m st er d am Fest ivals Cat egor y? Add +
Rock (5 5 ), Pop (3 0 ), Jazz (2 2 ), Elect r on ic (1 2 ), Techn o (1 1 ), Dan ce (9 ), M or e...
Or d er : Relvan ce
Even t s
Rad iohead
Dali Exhibit ion
Beer fest ival
...
Pr ev Next
- +
01/ 03/ 10
M ar ch 28/ 03/ 10
04/05/2010 - What's on this evening? Designing User Support for Event-based Annotation and Exploration of Media - EVENTS 2010, Athens, Greece 20

21. Conclusions
• Opinions seem support the development of an
environment that merges the three technologies
(information enrichment)
• There is a need to support different visualizations
and better browsing
– Common concern about information overload
– Lack of event coverage and information completeness
supports combining multiple information sources
04/05/2010 - What's on this evening? Designing User Support for Event-based Annotation and Exploration of Media - EVENTS 2010, Athens, Greece 21

22. Data Challenges
• Semantization of Data (events, media, users)
• Association
– Linking media and events (#) + Heuristics
– Linking events to people, identifying interests
– Finding relationships between events
04/05/2010 - What's on this evening? Designing User Support for Event-based Annotation and Exploration of Media - EVENTS 2010, Athens, Greece 22

23. Second User Study
• Scenario based study (2 sessions, n=15)
– Identify Interaction patterns, information seeking strategies
and information sources through reenactment of scenarios
and self-reported (post-it) actions.
04/05/2010 - What's on this evening? Designing User Support for Event-based Annotation and Exploration of Media - EVENTS 2010, Athens, Greece 23

24. Icons from http://dryicons.com/
04/05/2010 - What's on this evening? Designing User Support for Event-based Annotation and Exploration of Media - EVENTS 2010, Athens, Greece 24