This presentation is a topic about what I learned from the summer school at Tsinghua University : human computation.

1. Agent-based Game Design for Human Computation Speaker: Azrael Cheng Advisor: Hsing Mei Web Computing Laboratory Computer Science and Information Engineering Department Fu Jen Catholic University August 17, 2010

2. Outline Introduction to Human Computation What is Human Computation? Human Computation CAPTCHA and reCAPTCHA CAPTCHA reCAPTCHA Game with a Purpose Motivation Image Search Audio and Vedio Labels Improvement of Text Search Conclusion 2

3. Introduction to Human Computation 3

4. Human vs. Computer The main idea: If we treat human brain as processors in a distributed system, each can perform a small part of a massive computation. 4

5. What is Human Computation? Human-based computation is a computer science technique in which a computational process performs its function by outsourcing certain steps to humans. This approach leverages differences in abilities and alternative costs between humans and computer agents to achieve symbiotic human-computer interaction. 5

6. What is Human Computation? 6 Question Answer

7. Human Computation In 2005, the term “human computation” was first shown in Luis Von Ahn's Ph.D. thesis. Success stories CAPTCHA and reCAPTCHA GWAPs 7

8. CAPTCHA and reCAPTCHA 8

9. CAPTCHA The term "CAPTCHA" was coined in 2000 by Luis von Ahn, Manuel Blum, Nicholas J. Hopper, and John Langford. Using high levels of warping on the text to avoid cracking by OCR. 9

10. CAPTCHA 10

11. CAPTCHA Roughly 200 million CAPTCHAs are typed every day. 10s of human time per CAPTCHA 11 Can we use this human effort for good?

12. reCAPTCHA To use the CAPTCHA to help digitize the text of books. On September 16, 2009, Google acquired reCAPTCHA. 12

13. Digitizing Books 13 Scan

14. Digitizing Books 14 Word that OCR can’t read

15. reCAPTCHA Where do the words come from? Years 1851-1980 completed in 2009. The 110 other years done by the end of 2010. Books from Google Books 15

16. Games with A Purpose 16

17. Motivation Each year, people around the world spend billions of hours playing computer games. What if people playing computer games could, without consciously doing so, simultaneously solve large-scale problems? What if people produce useful information while playing games? 17

18. GWAP Games Image Search ESP Game Squigl Matchin FlipIt Audio and Video Labels Tag a Tune PopVideo Improvement in Text Search Verbosity 18

19. Desiderata How to label all images on the web fast and cheap? Using human cleverly: ESP Game 19

20. Image Search Image search on the web uses the filenames and html texts. Labeling Images with words is still an open problem. 20

21. The ESP Game ….. The player and his/her partner see the same image. Each of the player must guess what words his/her partner is typing. 21

22. The ESP Game ….. 22

23. Google Image Labeler 23

24. Audio ESP: Tag a Tune .… The player and a partner hear a tune and must describe it. Based on the descriptions, the player has to figure out if both the player an his/her partner listening to the same tune! There are several other bonus rounds which are self descriptive. Enjoy! 24

25. Audio ESP: Tag a Tune .… 25

26. Video ESP: PopVideo .… The player and his/her partner see the same video clip. Each of them enters words describing what he/she sees and hears. 26

27. Video ESP: PopVideo .… 27

28. Verbosity … The player and his/her partner alternaste between being Describer and Guesser. As Describe, the player must help his/her partner guess the secret word by giving clues. As Guesser, he must type the secret word that his/her partner is describing 28

29. Verbosity … 29

30. Conclusion A new domain about the combination of humain brain and computers. Solve the problem of shortage of computer. The lunch box they ordered was unsavory.  30

31. Reference [1] Wiki, Human Computation, http://en.wikipedia.org/wiki/Human-based_computation [2] Luis von Ahn, , http://video.google.com/videoplay?docid=-8246463980976635143# , Google Tech talk, July 26, 2006. [3] Luis’ Website, http://www.cs.cmu.edu/~biglou/ [4] Wiki, reCAPTCHA, http://zh.wikipedia.org/zh-tw/ReCAPTCHA [5] Wiki, CAPTCHA, http://zh.wikipedia.org/zh-tw/CAPTCHA [6] UIUI, Luis von Ahn: 人腦運算 , http://uiui.mmdays.com/2008/07/07/human-computation/ [7] 阿榮遊樂場, Human Computation, http://jkuangpan.blogspot.com/2008/07/human-computation.html [8] Wiki, Luis Von Ahn, http://en.wikipedia.org/wiki/Luis_von_Ahn [9] Luis von Ahn, Ben Maurer, Colin McMillen, David Abraham and Manuel Blum.reCAPTCHA: Human-Based Character Recognition via Web Security Measures.Science, September 12, 2008. pp 1465-1468. 31

32. Reference [10] Luis von Ahn and Laura Dabbish. General Techniques for Designing Games with a Purpose. Communications of the ACM, August 2008. pp 58-67. [11] Luis von Ahn. Games With A Purpose. IEEE Computer Magazine, June 2006. pp 96-98. [12] Luis von Ahn. http://www.gwap.com/gwap/ [13] Mr./Ms. Days (MMDays) – 網路, 資訊, 觀察, 生活, 玩遊戲，做研究, http://mmdays.com/2007/02/05/game-research/ [14] The Next New Thing , http://www.ait.org.tw/infousa/zhtw/E-JOURNAL/EJ_Next/ahn.html, SMITHSONIAN, October 2007. 32

33. 33 Thanks for your listening Q & A