SlideShare a Scribd company logo
1 of 34
Download to read offline
The #WorldBot 2014
The #Good, the #Bad and the #Ugly
Tommaso Elli ~ tommaso.elli@gmail.com
Carlo De Gaetano ~ carlo.dgtn@gmail.com
Christoph Lutz ~ christoph.lutz@unisg.ch
Myrthe Bil ~ myrthebil@gmail.com
Iris Beerepoot ~ imbeerepoot@gmail.com
Claudio Coletta ~ claudio.coletta@gmail.com
Introduction
➔ WorldCup 2014: event with huge Twitter activity
➔ Much of the Twitter stream is structured along
#hashtags
➔ Bots are represented with interesting possibilities of
outreach and attention
Research Questions
➔ Can we categorize the bots surrounding the World Cup?
➔ Can we identify any behaviour pattern in the accounts
we identify as bots?
➔ (Do different games’ nationality attract bots in
different ways?)
Methods of Data Collection
➔ 1% of Twitter sample in TCAT
➔ All teams represented at least once
Methods for Bot Detection
➔ User account name and user description analysis
➔ Device/source analysis
➔ FF ratio (Zhu et al., 2012)
➔ User Co-Hashtag Analysis
➔ Close Reading
Results
Interactive Viz
Bot Detection (pt. 1)
➔ User account name and user description detected bots
➔ Sample of ~2500 supposed users
Bot Detection (pt. 1)
Bot Detection (pt. 1)
Bot Detection (pt. 1)
➔ If you’re out of the mass, you deserve some attention
➔ If you have thousands of friends/followers, but just
few tweets, you’re probably a bot
➔ It’s interesting to analyze the friends/followers ratio
Bot Detection (pt. 2)
➔ Users who declare to be a bot
➔ X Axis: Friends/Followers Proportion
➔ Y Axis: Total number of used #tags
Bot Detection (pt. 2)
➔ We consider declared bots as good bots
➔ Their metrics put them in the left-bottom corner
➔ Is that the good bots corner?
The #Good
Detecting the #Bads?
Users in these clusters have normal FF ratios and don’t carry special bot
attributes in their bios or usernames… still they are bots.
The #Bad
➔ The “ugly” works as a residual category, often half
“human” half “non-human” (Cyborg)
➔ They engage followers through specific hashtags (i.e.
“potato”) and tend to have more followers than friends
➔ Their content involves the emotional sphere
➔ Seems very promising for further qualitative analysis
Detecting the #Ugly?
- Une_Patate
- iinokinji
- iAnnaBottle
- Tiret_Tiret
The #Ugly
RT @orsolawa: Oh c'est chaud patate dès le début !!! #ESPCHI @
The Pope Could Be a Bot (A Bad One)
Bot Detection (pt. 2)
Bot Detection (pt. 2)
➔ Maybe yes, we have a good corner.
➔ Let’s run some bigger analysis, within our ~2500
sample!
Conclusion
(and have a happy Comic Sans Day!)
❏ World cup tweeting is not very botted
❏ World cup bots are very diverse, it’s not all #good
and #bad
❏ Large #ugly category in the middle that’s hard to
categorize and make sense of
❏ Boundaries between #ugly and #good are blurry and
more difficult to draw than between #good and
#bad

More Related Content

Viewers also liked

Connected for Success: How Network Centrality on ResearchGate Relates to Bibl...
Connected for Success: How Network Centrality on ResearchGate Relates to Bibl...Connected for Success: How Network Centrality on ResearchGate Relates to Bibl...
Connected for Success: How Network Centrality on ResearchGate Relates to Bibl...
Christoph Lutz
 
Content Creation on the Internet and the Participation Divide in Germany
Content Creation on the Internet and the Participation Divide in GermanyContent Creation on the Internet and the Participation Divide in Germany
Content Creation on the Internet and the Participation Divide in Germany
Christoph Lutz
 
Beyond Citation Counts - The Potential of Academic Social Network Sites for S...
Beyond Citation Counts - The Potential of Academic Social Network Sites for S...Beyond Citation Counts - The Potential of Academic Social Network Sites for S...
Beyond Citation Counts - The Potential of Academic Social Network Sites for S...
Christoph Lutz
 

Viewers also liked (7)

Connected for Success: How Network Centrality on ResearchGate Relates to Bibl...
Connected for Success: How Network Centrality on ResearchGate Relates to Bibl...Connected for Success: How Network Centrality on ResearchGate Relates to Bibl...
Connected for Success: How Network Centrality on ResearchGate Relates to Bibl...
 
Nordic Centre for Internet & Society - An Introduction
Nordic Centre for Internet & Society - An IntroductionNordic Centre for Internet & Society - An Introduction
Nordic Centre for Internet & Society - An Introduction
 
Content Creation on the Internet and the Participation Divide in Germany
Content Creation on the Internet and the Participation Divide in GermanyContent Creation on the Internet and the Participation Divide in Germany
Content Creation on the Internet and the Participation Divide in Germany
 
Acm sig comm_robocode-ethicists
Acm sig comm_robocode-ethicistsAcm sig comm_robocode-ethicists
Acm sig comm_robocode-ethicists
 
Beyond Citation Counts - The Potential of Academic Social Network Sites for S...
Beyond Citation Counts - The Potential of Academic Social Network Sites for S...Beyond Citation Counts - The Potential of Academic Social Network Sites for S...
Beyond Citation Counts - The Potential of Academic Social Network Sites for S...
 
Social Media in Science and Altmetrics - New Ways of Measuring Research Impact
Social Media in Science and Altmetrics - New Ways of Measuring Research Impact Social Media in Science and Altmetrics - New Ways of Measuring Research Impact
Social Media in Science and Altmetrics - New Ways of Measuring Research Impact
 
Privacy Concerns and Social Robots
Privacy Concerns and Social Robots Privacy Concerns and Social Robots
Privacy Concerns and Social Robots
 

Similar to The WorldBot 2014

Heidi Young - The Future of Search: How Measuring Satisfaction Will Enhance O...
Heidi Young - The Future of Search: How Measuring Satisfaction Will Enhance O...Heidi Young - The Future of Search: How Measuring Satisfaction Will Enhance O...
Heidi Young - The Future of Search: How Measuring Satisfaction Will Enhance O...
Seattle Interactive Conference
 
Chat Bots Presentation 8.9.16
Chat Bots Presentation 8.9.16Chat Bots Presentation 8.9.16
Chat Bots Presentation 8.9.16
Samuel Adams, MBA
 

Similar to The WorldBot 2014 (20)

Let's talk about GPT: A crash course in Generative AI for researchers
Let's talk about GPT: A crash course in Generative AI for researchersLet's talk about GPT: A crash course in Generative AI for researchers
Let's talk about GPT: A crash course in Generative AI for researchers
 
Profiling Bolsobots Networks
Profiling Bolsobots NetworksProfiling Bolsobots Networks
Profiling Bolsobots Networks
 
Heidi Young - The Future of Search: How Measuring Satisfaction Will Enhance O...
Heidi Young - The Future of Search: How Measuring Satisfaction Will Enhance O...Heidi Young - The Future of Search: How Measuring Satisfaction Will Enhance O...
Heidi Young - The Future of Search: How Measuring Satisfaction Will Enhance O...
 
The Future of Search: How Measuring Satisfaction Will Enhance Our Personal ...
The Future of Search:  How Measuring Satisfaction Will  Enhance Our Personal ...The Future of Search:  How Measuring Satisfaction Will  Enhance Our Personal ...
The Future of Search: How Measuring Satisfaction Will Enhance Our Personal ...
 
Heidi Young, Ozlo VP of Engineering, Seattle Interactive 2016
Heidi Young, Ozlo VP of Engineering, Seattle Interactive 2016Heidi Young, Ozlo VP of Engineering, Seattle Interactive 2016
Heidi Young, Ozlo VP of Engineering, Seattle Interactive 2016
 
Autumn Leaf Shape Poem Template, Leaf Template -
Autumn Leaf Shape Poem Template, Leaf Template -Autumn Leaf Shape Poem Template, Leaf Template -
Autumn Leaf Shape Poem Template, Leaf Template -
 
Chatbots are so last decade
Chatbots are so last decadeChatbots are so last decade
Chatbots are so last decade
 
Social Media Essay Outline. Online assignment writing service.
Social Media Essay Outline. Online assignment writing service.Social Media Essay Outline. Online assignment writing service.
Social Media Essay Outline. Online assignment writing service.
 
Сергей Поплавский "DeepDive в Bot платформу Microsoft. Технические аспекты ра...
Сергей Поплавский "DeepDive в Bot платформу Microsoft. Технические аспекты ра...Сергей Поплавский "DeepDive в Bot платформу Microsoft. Технические аспекты ра...
Сергей Поплавский "DeepDive в Bot платформу Microsoft. Технические аспекты ра...
 
A Bird Eye View of Dialogue Machines
A Bird Eye View of Dialogue MachinesA Bird Eye View of Dialogue Machines
A Bird Eye View of Dialogue Machines
 
Rise of the Autobots: Into the Underground of Social Network Bots
Rise of the Autobots: Into the Underground of Social Network BotsRise of the Autobots: Into the Underground of Social Network Bots
Rise of the Autobots: Into the Underground of Social Network Bots
 
Chat Bots Presentation 8.9.16
Chat Bots Presentation 8.9.16Chat Bots Presentation 8.9.16
Chat Bots Presentation 8.9.16
 
Hate Speech, Polarization and Online Data
Hate Speech, Polarization and Online DataHate Speech, Polarization and Online Data
Hate Speech, Polarization and Online Data
 
The Science Behind NFTs & Utility Types | Ben Plomion (Dibbs) x NFT.NYC 2023
The Science Behind NFTs & Utility Types | Ben Plomion (Dibbs) x NFT.NYC 2023The Science Behind NFTs & Utility Types | Ben Plomion (Dibbs) x NFT.NYC 2023
The Science Behind NFTs & Utility Types | Ben Plomion (Dibbs) x NFT.NYC 2023
 
Case Study Design In Research Pdf
Case Study Design In Research PdfCase Study Design In Research Pdf
Case Study Design In Research Pdf
 
Designing Conversations: How I learned to stop worrying and embraced our new ...
Designing Conversations: How I learned to stop worrying and embraced our new ...Designing Conversations: How I learned to stop worrying and embraced our new ...
Designing Conversations: How I learned to stop worrying and embraced our new ...
 
The Emergence Of Social Bots In Social Media- WiDS Talk
The Emergence Of Social Bots In Social Media- WiDS TalkThe Emergence Of Social Bots In Social Media- WiDS Talk
The Emergence Of Social Bots In Social Media- WiDS Talk
 
Chatbot
ChatbotChatbot
Chatbot
 
Doonish
DoonishDoonish
Doonish
 
Doonish
DoonishDoonish
Doonish
 

Recently uploaded

In Riyadh ((+919101817206)) Cytotec kit @ Abortion Pills Saudi Arabia
In Riyadh ((+919101817206)) Cytotec kit @ Abortion Pills Saudi ArabiaIn Riyadh ((+919101817206)) Cytotec kit @ Abortion Pills Saudi Arabia
In Riyadh ((+919101817206)) Cytotec kit @ Abortion Pills Saudi Arabia
ahmedjiabur940
 
怎样办理旧金山城市学院毕业证(CCSF毕业证书)成绩单学校原版复制
怎样办理旧金山城市学院毕业证(CCSF毕业证书)成绩单学校原版复制怎样办理旧金山城市学院毕业证(CCSF毕业证书)成绩单学校原版复制
怎样办理旧金山城市学院毕业证(CCSF毕业证书)成绩单学校原版复制
vexqp
 
Abortion pills in Jeddah | +966572737505 | Get Cytotec
Abortion pills in Jeddah | +966572737505 | Get CytotecAbortion pills in Jeddah | +966572737505 | Get Cytotec
Abortion pills in Jeddah | +966572737505 | Get Cytotec
Abortion pills in Riyadh +966572737505 get cytotec
 
怎样办理伦敦大学城市学院毕业证(CITY毕业证书)成绩单学校原版复制
怎样办理伦敦大学城市学院毕业证(CITY毕业证书)成绩单学校原版复制怎样办理伦敦大学城市学院毕业证(CITY毕业证书)成绩单学校原版复制
怎样办理伦敦大学城市学院毕业证(CITY毕业证书)成绩单学校原版复制
vexqp
 
Top profile Call Girls In Satna [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Satna [ 7014168258 ] Call Me For Genuine Models We ...Top profile Call Girls In Satna [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Satna [ 7014168258 ] Call Me For Genuine Models We ...
nirzagarg
 
Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...
Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...
Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...
gajnagarg
 
怎样办理伦敦大学毕业证(UoL毕业证书)成绩单学校原版复制
怎样办理伦敦大学毕业证(UoL毕业证书)成绩单学校原版复制怎样办理伦敦大学毕业证(UoL毕业证书)成绩单学校原版复制
怎样办理伦敦大学毕业证(UoL毕业证书)成绩单学校原版复制
vexqp
 
Jual Cytotec Asli Obat Aborsi No. 1 Paling Manjur
Jual Cytotec Asli Obat Aborsi No. 1 Paling ManjurJual Cytotec Asli Obat Aborsi No. 1 Paling Manjur
Jual Cytotec Asli Obat Aborsi No. 1 Paling Manjur
ptikerjasaptiker
 
+97470301568>>weed for sale in qatar ,weed for sale in dubai,weed for sale in...
+97470301568>>weed for sale in qatar ,weed for sale in dubai,weed for sale in...+97470301568>>weed for sale in qatar ,weed for sale in dubai,weed for sale in...
+97470301568>>weed for sale in qatar ,weed for sale in dubai,weed for sale in...
Health
 
Top profile Call Girls In Tumkur [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Tumkur [ 7014168258 ] Call Me For Genuine Models We...Top profile Call Girls In Tumkur [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Tumkur [ 7014168258 ] Call Me For Genuine Models We...
nirzagarg
 
Gartner's Data Analytics Maturity Model.pptx
Gartner's Data Analytics Maturity Model.pptxGartner's Data Analytics Maturity Model.pptx
Gartner's Data Analytics Maturity Model.pptx
chadhar227
 
Abortion pills in Doha Qatar (+966572737505 ! Get Cytotec
Abortion pills in Doha Qatar (+966572737505 ! Get CytotecAbortion pills in Doha Qatar (+966572737505 ! Get Cytotec
Abortion pills in Doha Qatar (+966572737505 ! Get Cytotec
Abortion pills in Riyadh +966572737505 get cytotec
 

Recently uploaded (20)

SR-101-01012024-EN.docx Federal Constitution of the Swiss Confederation
SR-101-01012024-EN.docx  Federal Constitution  of the Swiss ConfederationSR-101-01012024-EN.docx  Federal Constitution  of the Swiss Confederation
SR-101-01012024-EN.docx Federal Constitution of the Swiss Confederation
 
In Riyadh ((+919101817206)) Cytotec kit @ Abortion Pills Saudi Arabia
In Riyadh ((+919101817206)) Cytotec kit @ Abortion Pills Saudi ArabiaIn Riyadh ((+919101817206)) Cytotec kit @ Abortion Pills Saudi Arabia
In Riyadh ((+919101817206)) Cytotec kit @ Abortion Pills Saudi Arabia
 
怎样办理旧金山城市学院毕业证(CCSF毕业证书)成绩单学校原版复制
怎样办理旧金山城市学院毕业证(CCSF毕业证书)成绩单学校原版复制怎样办理旧金山城市学院毕业证(CCSF毕业证书)成绩单学校原版复制
怎样办理旧金山城市学院毕业证(CCSF毕业证书)成绩单学校原版复制
 
SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...
SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...
SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...
 
Digital Transformation Playbook by Graham Ware
Digital Transformation Playbook by Graham WareDigital Transformation Playbook by Graham Ware
Digital Transformation Playbook by Graham Ware
 
Abortion pills in Jeddah | +966572737505 | Get Cytotec
Abortion pills in Jeddah | +966572737505 | Get CytotecAbortion pills in Jeddah | +966572737505 | Get Cytotec
Abortion pills in Jeddah | +966572737505 | Get Cytotec
 
怎样办理伦敦大学城市学院毕业证(CITY毕业证书)成绩单学校原版复制
怎样办理伦敦大学城市学院毕业证(CITY毕业证书)成绩单学校原版复制怎样办理伦敦大学城市学院毕业证(CITY毕业证书)成绩单学校原版复制
怎样办理伦敦大学城市学院毕业证(CITY毕业证书)成绩单学校原版复制
 
Top profile Call Girls In Satna [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Satna [ 7014168258 ] Call Me For Genuine Models We ...Top profile Call Girls In Satna [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Satna [ 7014168258 ] Call Me For Genuine Models We ...
 
Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...
Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...
Top profile Call Girls In Vadodara [ 7014168258 ] Call Me For Genuine Models ...
 
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
 
Discover Why Less is More in B2B Research
Discover Why Less is More in B2B ResearchDiscover Why Less is More in B2B Research
Discover Why Less is More in B2B Research
 
怎样办理伦敦大学毕业证(UoL毕业证书)成绩单学校原版复制
怎样办理伦敦大学毕业证(UoL毕业证书)成绩单学校原版复制怎样办理伦敦大学毕业证(UoL毕业证书)成绩单学校原版复制
怎样办理伦敦大学毕业证(UoL毕业证书)成绩单学校原版复制
 
Jual Cytotec Asli Obat Aborsi No. 1 Paling Manjur
Jual Cytotec Asli Obat Aborsi No. 1 Paling ManjurJual Cytotec Asli Obat Aborsi No. 1 Paling Manjur
Jual Cytotec Asli Obat Aborsi No. 1 Paling Manjur
 
+97470301568>>weed for sale in qatar ,weed for sale in dubai,weed for sale in...
+97470301568>>weed for sale in qatar ,weed for sale in dubai,weed for sale in...+97470301568>>weed for sale in qatar ,weed for sale in dubai,weed for sale in...
+97470301568>>weed for sale in qatar ,weed for sale in dubai,weed for sale in...
 
Ranking and Scoring Exercises for Research
Ranking and Scoring Exercises for ResearchRanking and Scoring Exercises for Research
Ranking and Scoring Exercises for Research
 
Predicting HDB Resale Prices - Conducting Linear Regression Analysis With Orange
Predicting HDB Resale Prices - Conducting Linear Regression Analysis With OrangePredicting HDB Resale Prices - Conducting Linear Regression Analysis With Orange
Predicting HDB Resale Prices - Conducting Linear Regression Analysis With Orange
 
Top profile Call Girls In Tumkur [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Tumkur [ 7014168258 ] Call Me For Genuine Models We...Top profile Call Girls In Tumkur [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Tumkur [ 7014168258 ] Call Me For Genuine Models We...
 
Vadodara 💋 Call Girl 7737669865 Call Girls in Vadodara Escort service book now
Vadodara 💋 Call Girl 7737669865 Call Girls in Vadodara Escort service book nowVadodara 💋 Call Girl 7737669865 Call Girls in Vadodara Escort service book now
Vadodara 💋 Call Girl 7737669865 Call Girls in Vadodara Escort service book now
 
Gartner's Data Analytics Maturity Model.pptx
Gartner's Data Analytics Maturity Model.pptxGartner's Data Analytics Maturity Model.pptx
Gartner's Data Analytics Maturity Model.pptx
 
Abortion pills in Doha Qatar (+966572737505 ! Get Cytotec
Abortion pills in Doha Qatar (+966572737505 ! Get CytotecAbortion pills in Doha Qatar (+966572737505 ! Get Cytotec
Abortion pills in Doha Qatar (+966572737505 ! Get Cytotec
 

The WorldBot 2014

  • 1. The #WorldBot 2014 The #Good, the #Bad and the #Ugly Tommaso Elli ~ tommaso.elli@gmail.com Carlo De Gaetano ~ carlo.dgtn@gmail.com Christoph Lutz ~ christoph.lutz@unisg.ch Myrthe Bil ~ myrthebil@gmail.com Iris Beerepoot ~ imbeerepoot@gmail.com Claudio Coletta ~ claudio.coletta@gmail.com
  • 2.
  • 3. Introduction ➔ WorldCup 2014: event with huge Twitter activity ➔ Much of the Twitter stream is structured along #hashtags ➔ Bots are represented with interesting possibilities of outreach and attention
  • 4.
  • 5. Research Questions ➔ Can we categorize the bots surrounding the World Cup? ➔ Can we identify any behaviour pattern in the accounts we identify as bots? ➔ (Do different games’ nationality attract bots in different ways?)
  • 6. Methods of Data Collection ➔ 1% of Twitter sample in TCAT ➔ All teams represented at least once
  • 7. Methods for Bot Detection ➔ User account name and user description analysis ➔ Device/source analysis ➔ FF ratio (Zhu et al., 2012) ➔ User Co-Hashtag Analysis ➔ Close Reading
  • 10.
  • 11. Bot Detection (pt. 1) ➔ User account name and user description detected bots ➔ Sample of ~2500 supposed users
  • 14.
  • 15.
  • 16.
  • 17.
  • 18. Bot Detection (pt. 1) ➔ If you’re out of the mass, you deserve some attention ➔ If you have thousands of friends/followers, but just few tweets, you’re probably a bot ➔ It’s interesting to analyze the friends/followers ratio
  • 19. Bot Detection (pt. 2) ➔ Users who declare to be a bot ➔ X Axis: Friends/Followers Proportion ➔ Y Axis: Total number of used #tags
  • 20.
  • 21. Bot Detection (pt. 2) ➔ We consider declared bots as good bots ➔ Their metrics put them in the left-bottom corner ➔ Is that the good bots corner?
  • 23. Detecting the #Bads? Users in these clusters have normal FF ratios and don’t carry special bot attributes in their bios or usernames… still they are bots.
  • 25. ➔ The “ugly” works as a residual category, often half “human” half “non-human” (Cyborg) ➔ They engage followers through specific hashtags (i.e. “potato”) and tend to have more followers than friends ➔ Their content involves the emotional sphere ➔ Seems very promising for further qualitative analysis Detecting the #Ugly?
  • 26. - Une_Patate - iinokinji - iAnnaBottle - Tiret_Tiret The #Ugly RT @orsolawa: Oh c'est chaud patate dès le début !!! #ESPCHI @
  • 27. The Pope Could Be a Bot (A Bad One)
  • 29. Bot Detection (pt. 2) ➔ Maybe yes, we have a good corner. ➔ Let’s run some bigger analysis, within our ~2500 sample!
  • 30.
  • 31.
  • 32.
  • 33.
  • 34. Conclusion (and have a happy Comic Sans Day!) ❏ World cup tweeting is not very botted ❏ World cup bots are very diverse, it’s not all #good and #bad ❏ Large #ugly category in the middle that’s hard to categorize and make sense of ❏ Boundaries between #ugly and #good are blurry and more difficult to draw than between #good and #bad