The Italian Hate Map: semantic content analytics for social good

The Italian Hate Map:
semantic content analytics for social good
Cataldo Musto, Giovanni Semeraro, Pasquale Lops, Marco de Gemmis
(Università degli Studi di Bari ‘Aldo Moro’, Italy - SWAP Research Group)
I-CiTies 2015
2015 CINI Annual Workshop on ICT
for Smart Cities and Communities
Palermo (Italy) - October 29-30, 2015

2Cataldo Musto, Giovanni Semeraro, Pasquale Lops, Marco de Gemmis
The Italian Hate Map: semantic content analytics for social good. iCities 2015 Workshop, Palermo (Italy) 30.10.2015

3
The Italian HateMap
http://users.humboldt.edu/mstephens/hate/hate_map.html
Inspired by the
Hate Map built by
the Humboldt
University
joint research with a
psychologists team of
Rome University and a
no-proﬁt agency
focused on human
rights

4
http://users.humboldt.edu/mstephens/hate/hate_map.html
Insight:
To aggregate rough
people-based data
in order to analyze
complex
phenomena.
The Italian HateMap

5
(Not a new idea) Map of cholera in London, 1854
red = cholera cases
blue = water
The Italian HateMap

6
Research Question:
Is it possible to extract and process social media
to detect intolerant content posted on social
networks and identify the most at-risk areas of the
Italian country?
The Italian HateMap

7
A framework for real-time
Semantic Analysis of Social Streams
CrowdPulse

8
CrowdPulse
Social Data Extraction
features
Semantic Tagging
Sentiment Analysis Processing & Visualization

9
workﬂow
CrowdPulse

10
Step 1: Social Data Extraction
CrowdPulse

11
Extraction
Source
Heuristics
CrowdPulse

12
Extraction
Source
Heuristics
CrowdPulse

13
Extraction
Source
Heuristics
Content
User
Geo
Content+Geo
#icities2015
#democrats
#trafﬁc
@barack_obama
@comunepalermo
#earthquake
Page
Group
CrowdPulse

14
Extraction
Source
Heuristics
Content
User
Geo
Content+Geo
#www2015
#democrats
#trafﬁc
@barack_obama
@comuneﬁ
#earthquake
Page
Group
We only extract public content
CrowdPulse

15
Use Case
Heuristics: Twitter content
- 76 intolerant seed terms, deﬁned by the psychologists teams
- 5 intolerance dimensions: violence (against women), racism,
homophobia, disability, anti-semitism
CROWDPULSE SETTINGS
The Italian Hate Map

16
Use Case
Extracted content (seed term: nano/midget)
Tweet about an Italian ministry
CROWDPULSE SETTINGS
Tweet about iPod nano
Tweet about an Italian football player

17
Use Case
Tweet about an Italian ministry
CROWDPULSE SETTINGS
Tweet about iPod nano
Tweet about an Italian football player
Many non-intolerant Tweets are extracted!
X
X

18
Use Case
Sentiment Analysis and Semantic Tagging of the content
CROWDPULSE SETTINGS

Keyword-based representation introduces
a lot of noise in the analysis
nano
?
(midget)
(ipod nano)
Semantic Tagging
Motivations
The Italian Hate Map: semantic content analytics for social good. iCities 2015 Workshop, Palermo (Italy) 30.10.2015 19

“E’inutile, il mio nano non segnerà mai”
?
Semantic Tagging
Motivations
INTOLERANT
NOT INTOLERANT
?
20

• Entity Linking Algorithms
• Input: textual content
• Output: identiﬁcation and
disambiguation of the
entities mentioned in the text.
(1) http://tagme.di.unipi.it
(2) http://spotlight.dbpedia.org
21
Step 2: Semantic Tagging
Solution: semantic processing of extracted content
Algorithms
CrowdPulse

22
Use Case
Non-intolerant Tweets are detected and ﬁltered out.
CROWDPULSE SETTINGS

23
CrowdPulse
Step 3: Sentiment Analysis

24
Sentiment Analysis
Motivations
Is this content conveying any opinion?

25
Sentiment Analysis
Motivations
Is this content conveying any opinion?
This is a crucial issue if people-based ﬁndings have to be generated

26
Sentiment Analysis
Deﬁnition
“It is the ﬁeld of study that
analyzes people’s
opinions, sentiments,
evaluations, appraisals,
attitudes, and emotions
towards entities such as
products, services,
organizations, individuals,
issues, events, topics, and
their attributes “ (*)
(Pang, Bo, and Lillian Lee. "Opinion mining and sentiment analysis." Foundations and trends in information retrieval, 2008)
We concentrated on the polarity detection task

27
Use Case
Tweets with positive or neutral sentiment are detected and ﬁltered out.
CROWDPULSE SETTINGS

28
Use Case
CROWDPULSE SETTINGS

29
CrowdPulse
Step 4: Processing

30
Use Case
We have to build a map, so we
only need geotagged content
CROWDPULSE SETTINGS

31
Use Case
CROWDPULSE SETTINGS
Deﬁnition of heuristics to increase the
number of geotagged Tweets

32
Use Case
Dimension #Tweets #Geo %Geo
Homophobia 110,774 8,501 7,66%
Racism 154,170 1,940 1,24%
Violence 1,102,494 28,886 2,62%
Disability 479,654 3,410 0,75%
Anti-Semitism 6,000 1,150 18,03%

33
CrowdPulse
Step 4: Data Visualization

34
Use Case
CROWDPULSE OUTPUT
Violence against women Disability
based on OpenStreetMap

35
Use Case
CROWDPULSE OUTPUT
Racism Homophobia
based on OpenStreetMap

Conclusions
36
Crowdsourcing-based approach
Social content
containing the seed terms is
extracted and processed in
real-time
Semantic Processing
exploited to delete non-intolerant
Tweets
Sentiment Analysis
used to ﬁlter out Tweet
with irony
1. 2.
3. 4. Analytics Console used
to build real-time hate
maps
Almost 2,000,000 social content extracted and analyzed.

Lessons Learned
37

38
Lessons Learned
Given the maps and given the output of the linguistic
analysis of intolerant Tweets (co-occurrences between terms,
time lapse, etc.), the psychologists team deﬁned some
guidelines to tackle and prevent intolerant behaviors.
These guidelines have been freely distributed to public
administration on early 2015.

Lessons Learned
39
Pipeline of state of the art techniques
Semantic Processing, Sentiment Analysis, Machine Learning, Data Visualization
Use Case: The Italian Hate Map
DEFINITION OF A FRAMEWORK FOR
REAL-TIME SEMANTIC CONTENT ANALYSIS
Thanks to the huge availability of
textual data very complex
phenomena can be analyzed in a
totally new way

questions?
Cataldo Musto, PhD
cataldo.musto@uniba.it
@cataldomusto
http://www.di.uniba.it/~swap

The Italian Hate Map: semantic content analytics for social good

Recommended

Recommended

More Related Content

What's hot

What's hot (15)

Viewers also liked

Viewers also liked (9)

Similar to The Italian Hate Map: semantic content analytics for social good

Similar to The Italian Hate Map: semantic content analytics for social good (20)

More from Cataldo Musto

More from Cataldo Musto (20)

Recently uploaded

Recently uploaded (20)

The Italian Hate Map: semantic content analytics for social good