Analyze Data Like a Street Fighter
•
5 j'aime•2,426 vues
This document discusses applying a "street fighter" approach to data science. It advocates analyzing raw data closely to find insights, improvising solutions to emerging problems, anticipating issues, and being willing to adapt models or strategies based on what the data reveals. The document provides examples of how this approach could have helped avoid issues like a pricing model reducing profits due to not analyzing customer data thoroughly enough beforehand.
Recommandé
Recommandé
Contenu connexe
Plus de Peter Skomoroch
Plus de Peter Skomoroch (13)
Analyze Data Like a Street Fighter
- 1. Street Fighting Data Science Pete Skomoroch @peteskomoroch O’Reilly Strata Conference February 28, 2012
- 4. To solve hard problems:
- 5. Think like a street fighter
- 7. How does this apply to Data Science?
- 10. Pricing model decreases profit in test stores by 30%
- 11. What went wrong?
- 12. • Ran complex “black box” model • Didn’t analyze the data first • Didn’t anticipate elasticity errors
- 13. How could this have been avoided?
- 16. The Men Who Stare at Charts
- 17. Look at your data
- 23. Raw Data: FEC Contributions
- 24. not employed 118672 retired 32938 self employed 92973 self-employed 25454 information requested 17627 information requested per best efforts 1313 refused 728 homemaker 4992 unemployed 1493 the bank of new york 65 self-employed 5919 john mccain 2008 57 university of california 825 u.s. government 121 microsoft 915 idt corp. 54 university of chicago 616 merrill lynch 273 harvard university 848 blank rome l.l.p. 51 google 662 department of defense 100 stanford university 716 u.s. army 90 university of washington 614 us army 141 ibm 1016 none 642 columbia university 782 greenberg traurig 118 university of michigan 514 northrop grumman 105 freelance 372 at&t 141 sa 150 citigroup 134 sidley austin llp 509 bridgewater associates 44 na 999 univision communications inc. 36
- 25. not employed 118672 retired 32938 self employed 92973 self-employed 25454 information requested 17627 information requested per best efforts 1313 refused 728 homemaker 4992 unemployed 1493 the bank of new york 65 self-employed 5919 john mccain 2008 57 university of california 825 u.s. government 121 microsoft 915 idt corp. 54 university of chicago 616 merrill lynch 273 harvard university 848 blank rome l.l.p. 51 google 662 department of defense 100 stanford university 716 u.s. army 90 university of washington 614 us army 141 ibm 1016 none 642 columbia university 782 greenberg traurig 118 university of michigan 514 northrop grumman 105 freelance 372 at&t 141 sa 150 citigroup 134 sidley austin llp 509 bridgewater associates 44 na 999 univision communications inc. 36
- 33. “Don't indulge in any unnecessary, sophisticated moves. You'll get clobbered if you do, and in a street fight you'll have your shirt zipped off you.” - Bruce Lee
- 43. Look at your errors
- 44. • Sanity check row counts • Track errors over time • Find patterns in the error data • Add missing features to models • Replace models entirely
- 47. Think like a street fighter