Overview of the coverging trends of huge data sets, crowdsourcing, and human computation.

1. Systems ScienceTackling Complexity in the 21st Century Jeffrey P. Bigham ROC HCI Group Computer Science University of Rochester

2. DATA! 90s and Today

3. Examples onebusaway.org data.gov

4. CLOUD OF DATA Terabytes of memory 2000s 512kb of memory 1970s

5. Data + Algorithms Google (machine learning) Facebook NetFlix Pandora Yelp eHarmony GMail

6. Where is my bus?

7. NetFlix

8. NetFlix Prize!

9. Linking IMDB and NetFlix Arvind Narayanan and VitalyShmatikov “Robust De-anonymization of Large Sparse Datasets.” 2008.

10. When Good Recommendations Go Bad Wall Street Journal. November 26, 2002 USA Today. January 5, 2006

11. “…a team at Google couldn’t decide between two blues, so they’re testing 41 shades between each blue to see which one performs better. I had a recent debate over whether a border should be 3, 4 or 5 pixels wide, and was asked to prove my case. I can’t operate in an environment like that. I’ve grown tired of debating such miniscule design decisions. There are more exciting design problems in this world to tackle.” Doug Bowman Former Google Designer http://stopdesign.com

13. NetFlix Prize Winners $1 Million to the best team Teams collaborated, mixed, and joined Winner used “meta-learning” Combined multiple virtual “experts”

14. THE CROWD

15. Wikipedia Barnstar

16. http://www.cs.cornell.edu/~crandall/photomap/

17. The Anatomy of a Social Search Engine vark.com

18. Foursquare “Congratulations! You just became the mayor of your house!”

19. Please don’tRob Me?

20. HUMAN COMPUTATION

21. Google Image Labeler (ESP Game)

22. Make Big Money! Mturk.com

23. Middle Management

24. Why wouldn’t a tenured professor want a virtual farm?

25. 400 m … … 80 m 20 m

26. Summary Data (LOTS OFDATA) Algorithms leverage data Humans use computers Can computers use humans? Social context and privacy These change quickly!

28. END Jeffrey P. Bigham jbigham@cs.rochester.edu