The document describes ECSTASYS, a system that captures social media content related to live events and enriches it to provide more context and value for event attendees. ECSTASYS retrieves tweets about an event, filters irrelevant ones, identifies event-related entities, associates tweets with specific event sub-topics, and visualizes the information organized by event. It uses a knowledge base derived from event schedules and ontologies to link tweets to the correct event components to provide a more holistic view of the complex live event through social media.
Augmented Participation to Live Events through Social Network Content Enrichment with ECSTASYS
1. Dipartimento di
Elettronica, Informazione e
Bioingegneria
Augmented Participation to Live Events
through Social Network Content
Enrichment with ECSTASYS
Marco Brambilla, Daniele Dell’Aglio, Emanuele Della Valle,
Andrea Mauri and Riccardo Volonterio
2. Dipartimento di Elettronica, Informazione
e Bioingegneria
Problem
Conferences (but also exhibitions, sports or
fashion happenings) are complex events
– They are composed by parallel and dislocated sub-
events (talks, workshops, tutorials)
27 May 2014 - AI Mashup Challenge @ESWC2014
DanieleDell'Aglio-ECSTASYS
2
3. Dipartimento di Elettronica, Informazione
e Bioingegneria
Problem
Conferences (but also exhibitions, sports or
fashion happenings) are complex events
– They are composed by parallel and dislocated sub-
events (talks, workshops, tutorials)
Participants, organisers and interested people
are interested in having an holistic view on the
event
27 May 2014 - AI Mashup Challenge @ESWC2014
DanieleDell'Aglio-ECSTASYS
2
4. Dipartimento di Elettronica, Informazione
e Bioingegneria
Problem
Conferences (but also exhibitions, sports or
fashion happenings) are complex events
– They are composed by parallel and dislocated sub-
events (talks, workshops, tutorials)
Participants, organisers and interested people
are interested in having an holistic view on the
event
It is hard to have a clear vision of what is
happening
– Attendees have a partial view of the event (they know
what happens in the place where they are)
27 May 2014 - AI Mashup Challenge @ESWC2014
DanieleDell'Aglio-ECSTASYS
2
5. Dipartimento di Elettronica, Informazione
e Bioingegneria
The solution
Attendees share opinions, recommendations,
materials, and reports of the happening through
social media
Let’s capture them!
27 May 2014 - AI Mashup Challenge @ESWC2014
DanieleDell'Aglio-ECSTASYS
3
6. Dipartimento di Elettronica, Informazione
e Bioingegneria
The solution
Attendees share opinions, recommendations,
materials, and reports of the happening through
social media
Let’s capture them!
Event-Centered STream Analysis SYStem
(ECSTASYS)
– It caputes the the social media contents related to a
live event
– It enriches them in a way that makes it valuable for
(local or remote) attendees.
27 May 2014 - AI Mashup Challenge @ESWC2014
DanieleDell'Aglio-ECSTASYS
3
7. Dipartimento di Elettronica, Informazione
e Bioingegneria
ECSTASYS as a whole
27 May 2014 - AI Mashup Challenge @ESWC2014
DanieleDell'Aglio-ECSTASYS
4
Retrieve the tweets
8. Dipartimento di Elettronica, Informazione
e Bioingegneria
ECSTASYS as a whole
27 May 2014 - AI Mashup Challenge @ESWC2014
DanieleDell'Aglio-ECSTASYS
4
Retrieve the tweets
Filter the non-relevant ones
9. Dipartimento di Elettronica, Informazione
e Bioingegneria
ECSTASYS as a whole
27 May 2014 - AI Mashup Challenge @ESWC2014
DanieleDell'Aglio-ECSTASYS
4
Retrieve the tweets
Filter the non-relevant ones
Identify the conference-related
entities
10. Dipartimento di Elettronica, Informazione
e Bioingegneria
ECSTASYS as a whole
27 May 2014 - AI Mashup Challenge @ESWC2014
DanieleDell'Aglio-ECSTASYS
4
Retrieve the tweets
Filter the non-relevant ones
Identify the conference-related
entities
Associate each tweet to the
event it discusses
11. Dipartimento di Elettronica, Informazione
e Bioingegneria
ECSTASYS as a whole
27 May 2014 - AI Mashup Challenge @ESWC2014
DanieleDell'Aglio-ECSTASYS
4
Retrieve the tweets
Filter the non-relevant ones
Identify the conference-related
entities
Associate each tweet to the
event it discusses
Visualise them by event
12. Dipartimento di Elettronica, Informazione
e Bioingegneria
ECSTASYS KB
Deriving the knowledge base
27 May 2014 - AI Mashup Challenge @ESWC2014
DanieleDell'Aglio-ECSTASYS
5
13. Dipartimento di Elettronica, Informazione
e Bioingegneria
ECSTASYS KB
Deriving the knowledge base
27 May 2014 - AI Mashup Challenge @ESWC2014
DanieleDell'Aglio-ECSTASYS
5
DBLP
SW dog food
Conference
schedule
14. Dipartimento di Elettronica, Informazione
e Bioingegneria
ECSTASYS KB
Deriving the knowledge base
27 May 2014 - AI Mashup Challenge @ESWC2014
DanieleDell'Aglio-ECSTASYS
5
DBLP
SW dog food
Conference
schedule
• Authors
• Paper at the
conference
• Recent papers
• Schedule
15. Dipartimento di Elettronica, Informazione
e Bioingegneria
ECSTASYS KB
Deriving the knowledge base
27 May 2014 - AI Mashup Challenge @ESWC2014
DanieleDell'Aglio-ECSTASYS
5
DBLP
SW dog food
Conference
schedule
SeWeb Conference
Ontology
SKOS
ECSTASYS
vocabulary
• Authors
• Paper at the
conference
• Recent papers
• Schedule
16. Dipartimento di Elettronica, Informazione
e Bioingegneria
ECSTASYS KB
Deriving the knowledge base
27 May 2014 - AI Mashup Challenge @ESWC2014
DanieleDell'Aglio-ECSTASYS
5
DBLP
SW dog food
Conference
schedule
SeWeb Conference
Ontology
SKOS
ECSTASYS
vocabulary
OWLIM
Lite-RL
• Authors
• Paper at the
conference
• Recent papers
• Schedule
17. Dipartimento di Elettronica, Informazione
e Bioingegneria
Retrieve the data
27 May 2014 - AI Mashup Challenge @ESWC2014
DanieleDell'Aglio-ECSTASYS
6
Twitter
Streaming API
“Ingenious way to learn
languages: duolingo
#www2013”
18. Dipartimento di Elettronica, Informazione
e Bioingegneria
Retrieve the data
27 May 2014 - AI Mashup Challenge @ESWC2014
DanieleDell'Aglio-ECSTASYS
6
Twitter
Streaming API
By keyword
#vonahn
#www2013
“Ingenious way to learn
languages: duolingo
#www2013”
19. Dipartimento di Elettronica, Informazione
e Bioingegneria
Retrieve the data
27 May 2014 - AI Mashup Challenge @ESWC2014
DanieleDell'Aglio-ECSTASYS
6
Twitter
Streaming API
By keyword
#vonahn
#www2013
By geo
“Ingenious way to learn
languages: duolingo
#www2013”
20. Dipartimento di Elettronica, Informazione
e Bioingegneria
By user
Retrieve the data
27 May 2014 - AI Mashup Challenge @ESWC2014
DanieleDell'Aglio-ECSTASYS
6
Twitter
Streaming API
By keyword
#vonahn
#www2013
By geo
“Ingenious way to learn
languages: duolingo
#www2013”
21. Dipartimento di Elettronica, Informazione
e Bioingegneria
Filter the non-relevant data
27 May 2014 - AI Mashup Challenge @ESWC2014
DanieleDell'Aglio-ECSTASYS
7
Relevance
Filter
Previous conf.
tweets
CRF
Model
22. Dipartimento di Elettronica, Informazione
e Bioingegneria
Filter the non-relevant data
27 May 2014 - AI Mashup Challenge @ESWC2014
DanieleDell'Aglio-ECSTASYS
7
Relevance
Filter
Previous conf.
tweets
CRF
Model
CRF filter over a
model derived by
previous
conference tweets
23. Dipartimento di Elettronica, Informazione
e Bioingegneria
Filter the non-relevant data
27 May 2014 - AI Mashup Challenge @ESWC2014
DanieleDell'Aglio-ECSTASYS
7
Relevance
Filter
Previous conf.
tweets
CRF
Model
CRF filter over a
model derived by
previous
conference tweets
Tweets with
non-English text
24. Dipartimento di Elettronica, Informazione
e Bioingegneria
Filter the non-relevant data
27 May 2014 - AI Mashup Challenge @ESWC2014
DanieleDell'Aglio-ECSTASYS
7
Relevance
Filter
Previous conf.
tweets
CRF
Model
CRF filter over a
model derived by
previous
conference tweets
Tweets with
non-English text
Tweets not related
to the conference
25. Dipartimento di Elettronica, Informazione
e Bioingegneria
Identify the relevant entities
27 May 2014 - AI Mashup Challenge @ESWC2014
DanieleDell'Aglio-ECSTASYS
8
Entity
annotator
AIDA DB
AIDA
26. Dipartimento di Elettronica, Informazione
e Bioingegneria
Identify the relevant entities
27 May 2014 - AI Mashup Challenge @ESWC2014
DanieleDell'Aglio-ECSTASYS
8
Entity
annotator
AIDA DB
AIDAAIDA identifies only
the conference-
related entities
27. Dipartimento di Elettronica, Informazione
e Bioingegneria
Identify the relevant entities
27 May 2014 - AI Mashup Challenge @ESWC2014
DanieleDell'Aglio-ECSTASYS
8
Entity
annotator
ECSTASYS KBAIDA DB
AIDA
A custom dataset
for AIDA is derived
by the EKB
AIDA identifies only
the conference-
related entities
28. Dipartimento di Elettronica, Informazione
e Bioingegneria
Identify the relevant entities
27 May 2014 - AI Mashup Challenge @ESWC2014
DanieleDell'Aglio-ECSTASYS
8
Entity
annotator
ECSTASYS KBAIDA DB
AIDA
A custom dataset
for AIDA is derived
by the EKB
AIDA identifies only
the conference-
related entities
“Ingenious way to learn
languages: duolingo
#www2013”
29. Dipartimento di Elettronica, Informazione
e Bioingegneria
Identify the relevant entities
27 May 2014 - AI Mashup Challenge @ESWC2014
DanieleDell'Aglio-ECSTASYS
8
Entity
annotator
ECSTASYS KBAIDA DB
AIDA
A custom dataset
for AIDA is derived
by the EKB
AIDA identifies only
the conference-
related entities
30. Dipartimento di Elettronica, Informazione
e Bioingegneria
Identify the associated event
27 May 2014 - AI Mashup Challenge @ESWC2014
DanieleDell'Aglio-ECSTASYS
9
Domain
content linker
ECSTASYS KB
31. Dipartimento di Elettronica, Informazione
e Bioingegneria
Identify the associated event
27 May 2014 - AI Mashup Challenge @ESWC2014
DanieleDell'Aglio-ECSTASYS
9
Domain
content linker
ECSTASYS KB
32. Dipartimento di Elettronica, Informazione
e Bioingegneria
Identify the associated event
27 May 2014 - AI Mashup Challenge @ESWC2014
DanieleDell'Aglio-ECSTASYS
9
Domain
content linker
Keynote
ECSTASYS KB
33. Dipartimento di Elettronica, Informazione
e Bioingegneria
Identify the associated event
27 May 2014 - AI Mashup Challenge @ESWC2014
DanieleDell'Aglio-ECSTASYS
9
Domain
content linker
Keynote
ECSTASYS KB
34. Dipartimento di Elettronica, Informazione
e Bioingegneria
Validation and disambiguation
27 May 2014 - AI Mashup Challenge @ESWC2014
DanieleDell'Aglio-ECSTASYS
10
Validator and
disambiguator
35. Dipartimento di Elettronica, Informazione
e Bioingegneria
Validation and disambiguation
27 May 2014 - AI Mashup Challenge @ESWC2014
DanieleDell'Aglio-ECSTASYS
10
Validator and
disambiguator
Expert crowd
36. Dipartimento di Elettronica, Informazione
e Bioingegneria
Validation and disambiguation
27 May 2014 - AI Mashup Challenge @ESWC2014
DanieleDell'Aglio-ECSTASYS
10
Validator and
disambiguator
Expert crowd
Resolve the
linkage
when more
options are
available
37. Dipartimento di Elettronica, Informazione
e Bioingegneria
Validation and disambiguation
27 May 2014 - AI Mashup Challenge @ESWC2014
DanieleDell'Aglio-ECSTASYS
10
Validator and
disambiguator
Expert crowd
Resolve the
linkage
when more
options are
available
38. Dipartimento di Elettronica, Informazione
e Bioingegneria
Validation and disambiguation
27 May 2014 - AI Mashup Challenge @ESWC2014
DanieleDell'Aglio-ECSTASYS
10
Validator and
disambiguator
Expert crowd
39. Dipartimento di Elettronica, Informazione
e Bioingegneria
Validation and disambiguation
27 May 2014 - AI Mashup Challenge @ESWC2014
DanieleDell'Aglio-ECSTASYS
10
Validator and
disambiguator
Expert crowd
Validate links
40. Dipartimento di Elettronica, Informazione
e Bioingegneria
Validation and disambiguation
27 May 2014 - AI Mashup Challenge @ESWC2014
DanieleDell'Aglio-ECSTASYS
10
Validator and
disambiguator
Expert crowd
Validate links
41. Dipartimento di Elettronica, Informazione
e Bioingegneria
Validation and disambiguation
27 May 2014 - AI Mashup Challenge @ESWC2014
DanieleDell'Aglio-ECSTASYS
10
Validator and
disambiguator
Expert crowd
42. Dipartimento di Elettronica, Informazione
e Bioingegneria
Visualisation
27 May 2014 - AI Mashup Challenge @ESWC2014
DanieleDell'Aglio-ECSTASYS
11
43. Dipartimento di Elettronica, Informazione
e Bioingegneria
Visualisation
27 May 2014 - AI Mashup Challenge @ESWC2014
DanieleDell'Aglio-ECSTASYS
11
Wall view
44. Dipartimento di Elettronica, Informazione
e Bioingegneria
Visualisation
27 May 2014 - AI Mashup Challenge @ESWC2014
DanieleDell'Aglio-ECSTASYS
11
Wall view
Wall view
45. Dipartimento di Elettronica, Informazione
e Bioingegneria
Conclusions
Is it a mashup? Yes! It puts together data from
Twitter (current and past tweets)
DBLP
Semantic Web Dog Food
Conference schedule
Is it intelligent? Yes! It uses:
AI to filter the non-relevant tweets
NLP for identifying the entities in the text
Semantic Web technologies to integrate data and query it
Crowdsource to validate the results and solve the ambiguous
results
27 May 2014 - AI Mashup Challenge @ESWC2014
DanieleDell'Aglio-ECSTASYS
12
46. Dipartimento di Elettronica, Informazione
e Bioingegneria
Thank you! Questions?
Augmented Participation to Live Events
through Social Network Content Enrichment
with ECSTASYS
http://demo.search-computing.com/aimc-2014/home
Marco Brambilla, Daniele Dell’Aglio, Emanuele Della Valle,
Andrea Mauri, Riccardo Volonterio
(DEIB, Politecnico di Milano)
daniele.dellaglio@polimi.it
27 May 2014 - AI Mashup Challenge @ESWC2014
DanieleDell'Aglio-ECSTASYS
13