SlideShare une entreprise Scribd logo
1  sur  22
Télécharger pour lire hors ligne
The Wikipedia
Adventure
Experiment in gamified onboarding
7-mission interactive journey
Editing, social, and policy skills
Automatic edit API
Guided tours with event logging
Userspace template tracking
1 year script writing
5 months design and usability dev
1 month alpha bugfixing
1 month beta test
Qualitative survey
players invited to Qualtrics, 600
responses, 42
age median, 25
women, 11 %
US and UK, 2/3
Overall satisfaction
Satisfaction breakdown
●

89%, TWA made me more confident as an editor

●

89%, TWA helped me understand Wikipedia better

●

77%, TWA made me want to edit more

●

79% TWA made me feel welcomed and supported

●

71% , TWA helped me know what to do next

●

80% , TWA prepared me to be a successful contributor to Wikipedia

●

75% , I enjoyed playing it

●

89% , The game is a good way to introduce new editors to Wikipedia

●

89% , Lots of users should be invited to play TWA
"I enjoyed the idea of editing a fake article for practice - in fact, when I first saw the game, I
immediately hoped it would incorporate some sort of actual editing rather than just theory or
questions or something."
"TWA was very informative and helped pull back the curtain on some of the fundamentals of
editing."
"I didn't know there was talk and discussion among users until I played the game...I just thought you
could make comments and report on individual pages."
"I've seen and heard companies, including my own, talk about learning through 'gamification'. I
found TWA to be the best example of gamification I have witnessed to date."
"I think TWA at the moment is a great stepping stone for new users such as myself. I would love to
see it expand to include more 'advanced' topics that can be optionally covered by the user."
“I wish it gave the impression that editors were expected to be mature and intelligent, rather than
idiots who could be entertained and educated with this kind of drivel."
Gamification elements
Design preference
Target demographic
Quantitative data
10,000 invited using hostbot
600 started the game
45% finished the game
2 control groups: not invited, invited no-play
TWA players made more edits
● 20% more edits than a control group of similar but
non-invited new editors

● 90% more edits than those who were invited but did
not play the game
Player group had more 20+ editors
● TWA players were 1.2 - 1.7x more likely to make 20+
edits than either control group

● TWA players were also more likely to make 0 edits
than the control groups, however.
TWA finishers made the most edits
● Players who completed the game made 3.2x more
edits than those who only started the first level of
the game

● Players who completed the game were 2.9x more
likely to make 20+ edits.
Explanation: off and on ramp
1) make test edits within game, leave
2) grow confidence, get highly active
Phase 2
More invitees, more players, more time
Statistical significance, confounds, stage model
Edit persistence and editor retention
Mesh w/ GettingStarted, Teahouse, Mentorship
Questions?
by Jake Orlowitz, Heather Walls, and Siko Bouterse
With help from Jonathan Morgan, Matt Flaschen, and Nischay Nahata
through a WMF Individual Engagement Grant
User:Ocaasi
jorlowitz@gmail.com
@JakeOrlowitz
@WikiAdventure
http://en.wikipedia.org/wiki/WP:TWA
All text and images CC-BY-SA 3.0

Contenu connexe

En vedette

Wikipedia and Medicine: Keys to Success
Wikipedia and Medicine: Keys to SuccessWikipedia and Medicine: Keys to Success
Wikipedia and Medicine: Keys to SuccessJake Orlowitz
 
الاجتماع الشهري مايو 2015 لمبادرة قرين presentation
الاجتماع الشهري مايو 2015 لمبادرة قرين presentationالاجتماع الشهري مايو 2015 لمبادرة قرين presentation
الاجتماع الشهري مايو 2015 لمبادرة قرين presentationMohamed Hassan
 
Tussen Vrijheid en Geluk
Tussen Vrijheid en GelukTussen Vrijheid en Geluk
Tussen Vrijheid en GelukLienSantermans
 
FirstWorkshopOnWikipediaResearch
FirstWorkshopOnWikipediaResearchFirstWorkshopOnWikipediaResearch
FirstWorkshopOnWikipediaResearchwebuploader
 
The Future of Wikipedia in Education
The Future of Wikipedia in EducationThe Future of Wikipedia in Education
The Future of Wikipedia in EducationJake Orlowitz
 
Hype vs. Reality: The AI Explainer
Hype vs. Reality: The AI ExplainerHype vs. Reality: The AI Explainer
Hype vs. Reality: The AI ExplainerLuminary Labs
 

En vedette (8)

Wikipedia and Medicine: Keys to Success
Wikipedia and Medicine: Keys to SuccessWikipedia and Medicine: Keys to Success
Wikipedia and Medicine: Keys to Success
 
الاجتماع الشهري مايو 2015 لمبادرة قرين presentation
الاجتماع الشهري مايو 2015 لمبادرة قرين presentationالاجتماع الشهري مايو 2015 لمبادرة قرين presentation
الاجتماع الشهري مايو 2015 لمبادرة قرين presentation
 
Tussen Vrijheid en Geluk
Tussen Vrijheid en GelukTussen Vrijheid en Geluk
Tussen Vrijheid en Geluk
 
FirstWorkshopOnWikipediaResearch
FirstWorkshopOnWikipediaResearchFirstWorkshopOnWikipediaResearch
FirstWorkshopOnWikipediaResearch
 
The Future of Wikipedia in Education
The Future of Wikipedia in EducationThe Future of Wikipedia in Education
The Future of Wikipedia in Education
 
Snigdha
Snigdha Snigdha
Snigdha
 
Build Features, Not Apps
Build Features, Not AppsBuild Features, Not Apps
Build Features, Not Apps
 
Hype vs. Reality: The AI Explainer
Hype vs. Reality: The AI ExplainerHype vs. Reality: The AI Explainer
Hype vs. Reality: The AI Explainer
 

Plus de Jake Orlowitz

Wikipedia and Libraries: Increasing your Library’s Visibilityi
Wikipedia and Libraries: Increasing your Library’s VisibilityiWikipedia and Libraries: Increasing your Library’s Visibilityi
Wikipedia and Libraries: Increasing your Library’s VisibilityiJake Orlowitz
 
Future libraries london
Future libraries londonFuture libraries london
Future libraries londonJake Orlowitz
 
WikiOpen: Encyclopedia, health, research, education, & community
WikiOpen: Encyclopedia, health, research, education, & communityWikiOpen: Encyclopedia, health, research, education, & community
WikiOpen: Encyclopedia, health, research, education, & communityJake Orlowitz
 
The Future of Wikipedia in Education
The Future of Wikipedia in Education The Future of Wikipedia in Education
The Future of Wikipedia in Education Jake Orlowitz
 
The Future of Libraries and Wikipedia
The Future of Libraries and WikipediaThe Future of Libraries and Wikipedia
The Future of Libraries and WikipediaJake Orlowitz
 
Can help be fun wikipedia experiments with social help
Can help be fun   wikipedia experiments with social helpCan help be fun   wikipedia experiments with social help
Can help be fun wikipedia experiments with social helpJake Orlowitz
 
Wikipedia and Medicine
Wikipedia and MedicineWikipedia and Medicine
Wikipedia and MedicineJake Orlowitz
 
Learning to Speak in Wikipedia's Language: Public Relations and the Free Enc...
Learning to Speak in Wikipedia's Language:  Public Relations and the Free Enc...Learning to Speak in Wikipedia's Language:  Public Relations and the Free Enc...
Learning to Speak in Wikipedia's Language: Public Relations and the Free Enc...Jake Orlowitz
 

Plus de Jake Orlowitz (10)

Wikipedia and Libraries: Increasing your Library’s Visibilityi
Wikipedia and Libraries: Increasing your Library’s VisibilityiWikipedia and Libraries: Increasing your Library’s Visibilityi
Wikipedia and Libraries: Increasing your Library’s Visibilityi
 
Future libraries london
Future libraries londonFuture libraries london
Future libraries london
 
WikiOpen: Encyclopedia, health, research, education, & community
WikiOpen: Encyclopedia, health, research, education, & communityWikiOpen: Encyclopedia, health, research, education, & community
WikiOpen: Encyclopedia, health, research, education, & community
 
The Future of Wikipedia in Education
The Future of Wikipedia in Education The Future of Wikipedia in Education
The Future of Wikipedia in Education
 
Inviting diversity
Inviting diversityInviting diversity
Inviting diversity
 
The Future of Libraries and Wikipedia
The Future of Libraries and WikipediaThe Future of Libraries and Wikipedia
The Future of Libraries and Wikipedia
 
Fun is srs bznss
Fun is srs bznssFun is srs bznss
Fun is srs bznss
 
Can help be fun wikipedia experiments with social help
Can help be fun   wikipedia experiments with social helpCan help be fun   wikipedia experiments with social help
Can help be fun wikipedia experiments with social help
 
Wikipedia and Medicine
Wikipedia and MedicineWikipedia and Medicine
Wikipedia and Medicine
 
Learning to Speak in Wikipedia's Language: Public Relations and the Free Enc...
Learning to Speak in Wikipedia's Language:  Public Relations and the Free Enc...Learning to Speak in Wikipedia's Language:  Public Relations and the Free Enc...
Learning to Speak in Wikipedia's Language: Public Relations and the Free Enc...
 

Dernier

Interdisciplinary_Insights_Data_Collection_Methods.pptx
Interdisciplinary_Insights_Data_Collection_Methods.pptxInterdisciplinary_Insights_Data_Collection_Methods.pptx
Interdisciplinary_Insights_Data_Collection_Methods.pptxPooja Bhuva
 
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdfUnit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdfDr Vijay Vishwakarma
 
Towards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptxTowards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptxJisc
 
How to Add New Custom Addons Path in Odoo 17
How to Add New Custom Addons Path in Odoo 17How to Add New Custom Addons Path in Odoo 17
How to Add New Custom Addons Path in Odoo 17Celine George
 
Wellbeing inclusion and digital dystopias.pptx
Wellbeing inclusion and digital dystopias.pptxWellbeing inclusion and digital dystopias.pptx
Wellbeing inclusion and digital dystopias.pptxJisc
 
Google Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptxGoogle Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptxDr. Sarita Anand
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17Celine George
 
Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)Jisc
 
On National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan FellowsOn National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan FellowsMebane Rash
 
The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxheathfieldcps1
 
How to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptxHow to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptxCeline George
 
SOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning PresentationSOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning Presentationcamerronhm
 
Single or Multiple melodic lines structure
Single or Multiple melodic lines structureSingle or Multiple melodic lines structure
Single or Multiple melodic lines structuredhanjurrannsibayan2
 
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...Amil baba
 
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptxHMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptxmarlenawright1
 
80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...
80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...
80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...Nguyen Thanh Tu Collection
 
Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)Jisc
 
Understanding Accommodations and Modifications
Understanding  Accommodations and ModificationsUnderstanding  Accommodations and Modifications
Understanding Accommodations and ModificationsMJDuyan
 
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdfUGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdfNirmal Dwivedi
 
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptxMaritesTamaniVerdade
 

Dernier (20)

Interdisciplinary_Insights_Data_Collection_Methods.pptx
Interdisciplinary_Insights_Data_Collection_Methods.pptxInterdisciplinary_Insights_Data_Collection_Methods.pptx
Interdisciplinary_Insights_Data_Collection_Methods.pptx
 
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdfUnit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdf
 
Towards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptxTowards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptx
 
How to Add New Custom Addons Path in Odoo 17
How to Add New Custom Addons Path in Odoo 17How to Add New Custom Addons Path in Odoo 17
How to Add New Custom Addons Path in Odoo 17
 
Wellbeing inclusion and digital dystopias.pptx
Wellbeing inclusion and digital dystopias.pptxWellbeing inclusion and digital dystopias.pptx
Wellbeing inclusion and digital dystopias.pptx
 
Google Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptxGoogle Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptx
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17
 
Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)
 
On National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan FellowsOn National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan Fellows
 
The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
 
How to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptxHow to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptx
 
SOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning PresentationSOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning Presentation
 
Single or Multiple melodic lines structure
Single or Multiple melodic lines structureSingle or Multiple melodic lines structure
Single or Multiple melodic lines structure
 
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
 
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptxHMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
 
80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...
80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...
80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...
 
Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)
 
Understanding Accommodations and Modifications
Understanding  Accommodations and ModificationsUnderstanding  Accommodations and Modifications
Understanding Accommodations and Modifications
 
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdfUGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
 
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
 

The Wikipedia Adventure: Designing for Impact

  • 2. Experiment in gamified onboarding 7-mission interactive journey Editing, social, and policy skills
  • 3.
  • 4.
  • 5.
  • 6. Automatic edit API Guided tours with event logging Userspace template tracking
  • 7. 1 year script writing 5 months design and usability dev 1 month alpha bugfixing 1 month beta test
  • 8.
  • 9. Qualitative survey players invited to Qualtrics, 600 responses, 42 age median, 25 women, 11 % US and UK, 2/3
  • 11. Satisfaction breakdown ● 89%, TWA made me more confident as an editor ● 89%, TWA helped me understand Wikipedia better ● 77%, TWA made me want to edit more ● 79% TWA made me feel welcomed and supported ● 71% , TWA helped me know what to do next ● 80% , TWA prepared me to be a successful contributor to Wikipedia ● 75% , I enjoyed playing it ● 89% , The game is a good way to introduce new editors to Wikipedia ● 89% , Lots of users should be invited to play TWA
  • 12. "I enjoyed the idea of editing a fake article for practice - in fact, when I first saw the game, I immediately hoped it would incorporate some sort of actual editing rather than just theory or questions or something." "TWA was very informative and helped pull back the curtain on some of the fundamentals of editing." "I didn't know there was talk and discussion among users until I played the game...I just thought you could make comments and report on individual pages." "I've seen and heard companies, including my own, talk about learning through 'gamification'. I found TWA to be the best example of gamification I have witnessed to date." "I think TWA at the moment is a great stepping stone for new users such as myself. I would love to see it expand to include more 'advanced' topics that can be optionally covered by the user." “I wish it gave the impression that editors were expected to be mature and intelligent, rather than idiots who could be entertained and educated with this kind of drivel."
  • 16. Quantitative data 10,000 invited using hostbot 600 started the game 45% finished the game 2 control groups: not invited, invited no-play
  • 17. TWA players made more edits ● 20% more edits than a control group of similar but non-invited new editors ● 90% more edits than those who were invited but did not play the game
  • 18. Player group had more 20+ editors ● TWA players were 1.2 - 1.7x more likely to make 20+ edits than either control group ● TWA players were also more likely to make 0 edits than the control groups, however.
  • 19. TWA finishers made the most edits ● Players who completed the game made 3.2x more edits than those who only started the first level of the game ● Players who completed the game were 2.9x more likely to make 20+ edits.
  • 20. Explanation: off and on ramp 1) make test edits within game, leave 2) grow confidence, get highly active
  • 21. Phase 2 More invitees, more players, more time Statistical significance, confounds, stage model Edit persistence and editor retention Mesh w/ GettingStarted, Teahouse, Mentorship
  • 22. Questions? by Jake Orlowitz, Heather Walls, and Siko Bouterse With help from Jonathan Morgan, Matt Flaschen, and Nischay Nahata through a WMF Individual Engagement Grant User:Ocaasi jorlowitz@gmail.com @JakeOrlowitz @WikiAdventure http://en.wikipedia.org/wiki/WP:TWA All text and images CC-BY-SA 3.0