Big Data    Stupid DecisionsThe Importance Of MeasuringWhat We Should Be Measuring              Panos @IpeirotisStern Scho...
Shopping for a camera
Multiple merchants sell the same camera
Consumers do not always buy the cheapest
Willoughby’s enjoys a 7.5% price premium (= $140)
Price Premium Percentages, Amazon.com                                     Transaction price compared to competition       ...
Customers care about reputation!
The price of Willoughby’s reputation : $140                                    (*)                                        ...
What is reputation? Factors affecting pricing power  Number of stars  Number of past transactions  …  Text!My reputati...
How text affects reputation?
The value of text
The value of text   Misspellings…
good packaging       -0.56%Positive? Negative?
Recommendation Letters: “He is a good student”    “He works hard”   Decision: Reject
AAA++++ seller       -2.93%Positive? Negative?
People interpret things differently,    according to the context
Lesson #1Adapt to the environmentOne size does not fit all!
Same idea, different focus:How reviews (text) affect product sales?
Best camera!        -0.20%Positive?  Negative?
Tell me something specific, you shill!
Positive ?   Negative?
“If this is the worst that can happen…”
What product features do customers want?
Point-and-Shoot: Lenses, zoom, …                                              % DiscussionZoom      Lenses   Megapixel   B...
Point-and-Shoot: Lenses, zoom, …                                             % Discussion                                 ...
Lesson #2Not sufficient to know what people say     Measure what people DO
Reviews, Grammar, and Hotel Bookings
Bad Grammar → Bad Sales
Zappos takes action! Examined and fixed grammar for  millions of reviews on Zappos.com! Used Amazon Mechanical Turk,  pa...
But… is it ethical?“Would you correct a friend’s tweet orFacebook post?…Nitpick a colleague for using shorthand inemails s...
Experiment: Fixed 1000 reviews Emailed authors: “Do you approve of the changes?” Gift card for replying Result: 978 rep...
Experiment: Fixed 1000 reviews Emailed readers: “Do you approve of the changes?”   Version 1: Only new version posted  ...
“Can you do the same for YouTube comments?   My eyes hurt every time that I read them”
Lesson #3Check your gut instinct at the entrance    Measure and then talk!
Lessons1. Measure in context: one size does not fit all2. Measure what people do, not what they say                 3. Mea...
Big Data, Stupid Decisions / Strata Jumpstart 2011 / Panos Ipeirotis / http://www.youtube.com/watch?v=LXDFwphuwCs
Prochain SlideShare
Chargement dans…5
×

Big Data, Stupid Decisions / Strata Jumpstart 2011 / Panos Ipeirotis / http://www.youtube.com/watch?v=LXDFwphuwCs

40 233 vues

Publié le

Strata Jumpstart, New York, September 19 2011

Big Data , Stupid Decisions: The Importance Of Measuring What We Should Be Measuring

Video at http://www.youtube.com/watch?v=LXDFwphuwCs

Publié dans : Technologie, Formation, Business
1 commentaire
22 j’aime
Statistiques
Remarques
Aucun téléchargement
Vues
Nombre de vues
40 233
Sur SlideShare
0
Issues des intégrations
0
Intégrations
17 587
Actions
Partages
0
Téléchargements
169
Commentaires
1
J’aime
22
Intégrations 0
Aucune incorporation

Aucune remarque pour cette diapositive

Big Data, Stupid Decisions / Strata Jumpstart 2011 / Panos Ipeirotis / http://www.youtube.com/watch?v=LXDFwphuwCs

  1. Big Data Stupid DecisionsThe Importance Of MeasuringWhat We Should Be Measuring Panos @IpeirotisStern School of Business, New York University “A Computer Scientist in a Business School” http://behind-the-enemy-lines.com
  2. Shopping for a camera
  3. Multiple merchants sell the same camera
  4. Consumers do not always buy the cheapest
  5. Willoughby’s enjoys a 7.5% price premium (= $140)
  6. Price Premium Percentages, Amazon.com Transaction price compared to competition 20000 18000Number of Transactions 16000 14000 12000 10000 8000 6000 4000 2000 0 -100% 0% +30% +100%
  7. Customers care about reputation!
  8. The price of Willoughby’s reputation : $140 (*) (*) vs 17th street photo
  9. What is reputation? Factors affecting pricing power  Number of stars  Number of past transactions  …  Text!My reputation, Iago, my reputation! -Shakespeare, Othello
  10. How text affects reputation?
  11. The value of text
  12. The value of text Misspellings…
  13. good packaging -0.56%Positive? Negative?
  14. Recommendation Letters: “He is a good student” “He works hard” Decision: Reject
  15. AAA++++ seller -2.93%Positive? Negative?
  16. People interpret things differently, according to the context
  17. Lesson #1Adapt to the environmentOne size does not fit all!
  18. Same idea, different focus:How reviews (text) affect product sales?
  19. Best camera! -0.20%Positive? Negative?
  20. Tell me something specific, you shill!
  21. Positive ? Negative?
  22. “If this is the worst that can happen…”
  23. What product features do customers want?
  24. Point-and-Shoot: Lenses, zoom, … % DiscussionZoom Lenses Megapixel Battery Life
  25. Point-and-Shoot: Lenses, zoom, … % Discussion Effect on SalesZoom Lenses Megapixel Battery Life
  26. Lesson #2Not sufficient to know what people say Measure what people DO
  27. Reviews, Grammar, and Hotel Bookings
  28. Bad Grammar → Bad Sales
  29. Zappos takes action! Examined and fixed grammar for millions of reviews on Zappos.com! Used Amazon Mechanical Turk, paying ~$0.10 per review Improved product sales!
  30. But… is it ethical?“Would you correct a friend’s tweet orFacebook post?…Nitpick a colleague for using shorthand inemails sent from his iPhone?…This level of social intrusion is almostunthinkable.”
  31. Experiment: Fixed 1000 reviews Emailed authors: “Do you approve of the changes?” Gift card for replying Result: 978 replies, not a single negative evaluation! “Thank you! I almost feel that I am ‘stoopid’ when I leave such reviews!” “Hey, the review is not updated online! When will it be fixed?”
  32. Experiment: Fixed 1000 reviews Emailed readers: “Do you approve of the changes?”  Version 1: Only new version posted  Version 2: Disclaimer (“Review has been edited…”)  Version 3: Disclaimer + mouseover to see old review Result: For version 3, unanimously positive replies!
  33. “Can you do the same for YouTube comments? My eyes hurt every time that I read them”
  34. Lesson #3Check your gut instinct at the entrance Measure and then talk!
  35. Lessons1. Measure in context: one size does not fit all2. Measure what people do, not what they say 3. Measure! Thank you!

×