SlideShare une entreprise Scribd logo
1  sur  17
When Too Much Data is Barely Enough  Bob Buckley Chris Barnes
When Too Much Data is Barely Enough  ,[object Object]
Workshop – Part #1: Overview ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Data sources ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
data source formats  ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
[object Object],[object Object],[object Object],Simple example Result history AAA Comp 100m 12/5/2009 100m, Name: YYY pos name time 1 XXX 9.85 2 YYY 10.02 3 ZZZ 10.15 4 … … date time pos comp 12/5/2009 10.02 2 AAA 3/2/2009 10.45 3 AUS 09 21/11/2008 10.44 2 Asia 08 … … … …
Data Normalisation ,[object Object],[object Object],AAA Comp 100m 12/5/2009 pos name time 1 XXX 9.85 2 YYY 10.02 3 ZZZ 10.15 4 … … pos name time Event ID 1 XXX 9.85 2009475 2 YYY 10.02 2009475 3 ZZZ 10.15 2009475 4 … … 2009475 Event ID Comp Event  type date 2009475 AAA Comp 2009 M 100m final 12/5/2009 2009476 AAA Comp 2009 W 100m final 12/5/2009 … … … …
Tips for Names ,[object Object],[object Object],[object Object],[object Object],[object Object],Non-standard Standard Nova Perris Nova Perris Perris, Nova Nova Perris Nova Perris-Kneebone Nova Perris
Simple data issues ,[object Object],[object Object],[object Object],[object Object],[object Object]
Tips for dates & times ,[object Object],[object Object],[object Object],[object Object],[object Object]
Overview of Analysis ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Link data for analysis ,[object Object],[object Object],[object Object],[object Object],[object Object],ID Date Time pos 435 3/5/2008 10.3 3 512 3/5/2008 10.2 2 512 21/3/2008 10.1 4 607 3/5/2008 11.6 7 ID DoB 435 24/2/1987 512 17/5/1989 ID Date Time pos DoB 435 3/5/2008 10.3 3 24/2/1987 512 3/5/2008 10.2 2 17/5/1989 512 21/3/2008 10.1 4 17/5/1989 607 3/5/2008 11.6 7 ?
Preparation: add history ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Preparation: history (cont.) ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Preparation: history (cont.) ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Preparation: history (cont.) ,[object Object],ID Date Time pos DoB Time2 pos2 Time3 pos3 435 3/5/2008 10.3 3 24/2/1987 ? ? ? ? 512 21/3/2008 10.1 4 17/5/1989 ? ? ? ? 512 3/5/2008 10.2 2 17/5/1989 10.1 4 ? ? 607 3/5/2008 11.6 7 ? ? ? ? ?
Over to Chris

Contenu connexe

Similaire à When Too Much Data is Barely Enough

Slides
SlidesSlides
Slides
butest
 
Optim test data management for IMS 2011
Optim test data management for IMS 2011Optim test data management for IMS 2011
Optim test data management for IMS 2011
evgeni77
 
IS CH2 Database Management (p1)
IS CH2 Database Management (p1)IS CH2 Database Management (p1)
IS CH2 Database Management (p1)
Jan Wong
 

Similaire à When Too Much Data is Barely Enough (20)

Delta from a Data Engineer's Perspective
Delta from a Data Engineer's PerspectiveDelta from a Data Engineer's Perspective
Delta from a Data Engineer's Perspective
 
Don't Repeat Yourself, and Automated Code Reviews
Don't Repeat Yourself, and Automated Code ReviewsDon't Repeat Yourself, and Automated Code Reviews
Don't Repeat Yourself, and Automated Code Reviews
 
Bringing OpenClinica Data into SAS
Bringing OpenClinica Data into SASBringing OpenClinica Data into SAS
Bringing OpenClinica Data into SAS
 
Ecdl v5 module 5 print
Ecdl v5 module 5 printEcdl v5 module 5 print
Ecdl v5 module 5 print
 
e_lumley.pdf
e_lumley.pdfe_lumley.pdf
e_lumley.pdf
 
4 preprocess
4 preprocess4 preprocess
4 preprocess
 
Odp
OdpOdp
Odp
 
Data science training in hyderabad
Data science training in hyderabadData science training in hyderabad
Data science training in hyderabad
 
Slides
SlidesSlides
Slides
 
System calls operating system ppt by rohit malav
System calls operating system  ppt by rohit malavSystem calls operating system  ppt by rohit malav
System calls operating system ppt by rohit malav
 
Introduction to Stata
Introduction to Stata Introduction to Stata
Introduction to Stata
 
Introduction to Data Science With R Notes
Introduction to Data Science With R NotesIntroduction to Data Science With R Notes
Introduction to Data Science With R Notes
 
Data Science Academy Student Demo day--Michael blecher,the importance of clea...
Data Science Academy Student Demo day--Michael blecher,the importance of clea...Data Science Academy Student Demo day--Michael blecher,the importance of clea...
Data Science Academy Student Demo day--Michael blecher,the importance of clea...
 
Training MS Access 2007
Training MS Access 2007Training MS Access 2007
Training MS Access 2007
 
Orbit global services
Orbit global servicesOrbit global services
Orbit global services
 
SAS cheat sheet
SAS cheat sheetSAS cheat sheet
SAS cheat sheet
 
What's new with Apache Spark's Structured Streaming?
What's new with Apache Spark's Structured Streaming?What's new with Apache Spark's Structured Streaming?
What's new with Apache Spark's Structured Streaming?
 
Optim test data management for IMS 2011
Optim test data management for IMS 2011Optim test data management for IMS 2011
Optim test data management for IMS 2011
 
Basics Of SAS Programming Language
Basics Of SAS Programming LanguageBasics Of SAS Programming Language
Basics Of SAS Programming Language
 
IS CH2 Database Management (p1)
IS CH2 Database Management (p1)IS CH2 Database Management (p1)
IS CH2 Database Management (p1)
 

Plus de Keith Lyons

Sharing and Presenting Information 1
Sharing and Presenting Information 1Sharing and Presenting Information 1
Sharing and Presenting Information 1
Keith Lyons
 

Plus de Keith Lyons (20)

Thinking about analytics
Thinking about analytics Thinking about analytics
Thinking about analytics
 
#UCSIA15 Sport informatics and Analytics: An Introduction
#UCSIA15 Sport informatics and Analytics: An Introduction#UCSIA15 Sport informatics and Analytics: An Introduction
#UCSIA15 Sport informatics and Analytics: An Introduction
 
Open for Learning
Open for LearningOpen for Learning
Open for Learning
 
Students as Produsers
Students as ProdusersStudents as Produsers
Students as Produsers
 
Writing Lives
Writing LivesWriting Lives
Writing Lives
 
Produsing Historical Narratives
Produsing Historical NarrativesProdusing Historical Narratives
Produsing Historical Narratives
 
130626 ASTN Sydney
130626 ASTN Sydney130626 ASTN Sydney
130626 ASTN Sydney
 
IACSS 2013 SOOC Presentation
IACSS 2013 SOOC PresentationIACSS 2013 SOOC Presentation
IACSS 2013 SOOC Presentation
 
Reflecting on Coaching as a Vocation
Reflecting on Coaching as a VocationReflecting on Coaching as a Vocation
Reflecting on Coaching as a Vocation
 
Long Term Athlete Development
Long Term Athlete DevelopmentLong Term Athlete Development
Long Term Athlete Development
 
Mentoring 2
Mentoring 2Mentoring 2
Mentoring 2
 
Managing Data
Managing DataManaging Data
Managing Data
 
#SpCP13: Expert Pedagogue
#SpCP13: Expert Pedagogue#SpCP13: Expert Pedagogue
#SpCP13: Expert Pedagogue
 
130319 cSOOC
130319 cSOOC130319 cSOOC
130319 cSOOC
 
#SpCP13 Week 7: Produsing Resources
#SpCP13 Week 7: Produsing Resources#SpCP13 Week 7: Produsing Resources
#SpCP13 Week 7: Produsing Resources
 
130319 #UCSAFFIRE
130319 #UCSAFFIRE130319 #UCSAFFIRE
130319 #UCSAFFIRE
 
130314 SAFFIRE Pitch
130314 SAFFIRE Pitch130314 SAFFIRE Pitch
130314 SAFFIRE Pitch
 
Mentoring 1
Mentoring 1Mentoring 1
Mentoring 1
 
Sharing and Presenting Information 1
Sharing and Presenting Information 1Sharing and Presenting Information 1
Sharing and Presenting Information 1
 
Observation
ObservationObservation
Observation
 

Dernier

Goads on NYT: Unraveling the Intricacies of Goads
Goads on NYT: Unraveling the Intricacies of GoadsGoads on NYT: Unraveling the Intricacies of Goads
Goads on NYT: Unraveling the Intricacies of Goads
greendigital
 

Dernier (20)

Czechia vs Turkiye The impact of 2008 still felt to this day as Turkiye eyes ...
Czechia vs Turkiye The impact of 2008 still felt to this day as Turkiye eyes ...Czechia vs Turkiye The impact of 2008 still felt to this day as Turkiye eyes ...
Czechia vs Turkiye The impact of 2008 still felt to this day as Turkiye eyes ...
 
JORNADA 7 LIGA MURO 2024BASQUETBOL12.pdf
JORNADA 7 LIGA MURO 2024BASQUETBOL12.pdfJORNADA 7 LIGA MURO 2024BASQUETBOL12.pdf
JORNADA 7 LIGA MURO 2024BASQUETBOL12.pdf
 
Goads on NYT: Unraveling the Intricacies of Goads
Goads on NYT: Unraveling the Intricacies of GoadsGoads on NYT: Unraveling the Intricacies of Goads
Goads on NYT: Unraveling the Intricacies of Goads
 
Turkiye vs Portugal Turkey's Quest for Redemption in the Euro 2024.pdf
Turkiye vs Portugal Turkey's Quest for Redemption in the Euro 2024.pdfTurkiye vs Portugal Turkey's Quest for Redemption in the Euro 2024.pdf
Turkiye vs Portugal Turkey's Quest for Redemption in the Euro 2024.pdf
 
Optimum Performance Training Model Overview
Optimum Performance Training Model OverviewOptimum Performance Training Model Overview
Optimum Performance Training Model Overview
 
Turkey vs Georgia Tickets: Turkey's Redemption Mission at UEFA Euro 2024
Turkey vs Georgia Tickets: Turkey's Redemption Mission at UEFA Euro 2024Turkey vs Georgia Tickets: Turkey's Redemption Mission at UEFA Euro 2024
Turkey vs Georgia Tickets: Turkey's Redemption Mission at UEFA Euro 2024
 
Slovakia Vs Ukraine Slovakia Euro Cup 2024 squad Who is Francesco Calzona bri...
Slovakia Vs Ukraine Slovakia Euro Cup 2024 squad Who is Francesco Calzona bri...Slovakia Vs Ukraine Slovakia Euro Cup 2024 squad Who is Francesco Calzona bri...
Slovakia Vs Ukraine Slovakia Euro Cup 2024 squad Who is Francesco Calzona bri...
 
NFL SOAP BOX WEEKLY REPORTS- 2024 NFL Schedules
NFL SOAP BOX WEEKLY REPORTS- 2024 NFL SchedulesNFL SOAP BOX WEEKLY REPORTS- 2024 NFL Schedules
NFL SOAP BOX WEEKLY REPORTS- 2024 NFL Schedules
 
Italy and Spain’s Euro Cup 2024 Squad Selection Battle.docx
Italy and Spain’s Euro Cup 2024 Squad Selection Battle.docxItaly and Spain’s Euro Cup 2024 Squad Selection Battle.docx
Italy and Spain’s Euro Cup 2024 Squad Selection Battle.docx
 
Albania Vs Spain Euro Cup 2024 Italy vs Albania Prediction, Stats & Team News...
Albania Vs Spain Euro Cup 2024 Italy vs Albania Prediction, Stats & Team News...Albania Vs Spain Euro Cup 2024 Italy vs Albania Prediction, Stats & Team News...
Albania Vs Spain Euro Cup 2024 Italy vs Albania Prediction, Stats & Team News...
 
Germany Vs Hungary- Marco Rossi to Remain Head Coach after the Euro Cup 2024....
Germany Vs Hungary- Marco Rossi to Remain Head Coach after the Euro Cup 2024....Germany Vs Hungary- Marco Rossi to Remain Head Coach after the Euro Cup 2024....
Germany Vs Hungary- Marco Rossi to Remain Head Coach after the Euro Cup 2024....
 
Spain's Euro 2024 Hopes Dampened by Injuries.docx
Spain's Euro 2024 Hopes Dampened by Injuries.docxSpain's Euro 2024 Hopes Dampened by Injuries.docx
Spain's Euro 2024 Hopes Dampened by Injuries.docx
 
Poland vs Netherlands Euro Cup Prediction, Stats and Team News.docx
Poland vs Netherlands Euro Cup Prediction, Stats and Team News.docxPoland vs Netherlands Euro Cup Prediction, Stats and Team News.docx
Poland vs Netherlands Euro Cup Prediction, Stats and Team News.docx
 
Romania Vs Ukraine Ukraine announces preliminary squad for Euro 2024 Mudryk, ...
Romania Vs Ukraine Ukraine announces preliminary squad for Euro 2024 Mudryk, ...Romania Vs Ukraine Ukraine announces preliminary squad for Euro 2024 Mudryk, ...
Romania Vs Ukraine Ukraine announces preliminary squad for Euro 2024 Mudryk, ...
 
IPL Betting ID: The best cricket ID provider | The best beting ID
IPL Betting ID: The best cricket ID provider | The best beting IDIPL Betting ID: The best cricket ID provider | The best beting ID
IPL Betting ID: The best cricket ID provider | The best beting ID
 
virat kohli presentation in life jurney
virat kohli presentation in life  jurneyvirat kohli presentation in life  jurney
virat kohli presentation in life jurney
 
Belgium Vs Romania First look at Romania UEFA at the start of EURO 2024.docx
Belgium Vs Romania First look at Romania UEFA at the start of EURO 2024.docxBelgium Vs Romania First look at Romania UEFA at the start of EURO 2024.docx
Belgium Vs Romania First look at Romania UEFA at the start of EURO 2024.docx
 
Top 10 French Footballers for Euro Cup 2024.docx
Top 10 French Footballers for Euro Cup 2024.docxTop 10 French Footballers for Euro Cup 2024.docx
Top 10 French Footballers for Euro Cup 2024.docx
 
Ozan Tufan Eyes Turkey Return and Portugal Finalizes Euro 2024 Squad.docx
Ozan Tufan Eyes Turkey Return and Portugal Finalizes Euro 2024 Squad.docxOzan Tufan Eyes Turkey Return and Portugal Finalizes Euro 2024 Squad.docx
Ozan Tufan Eyes Turkey Return and Portugal Finalizes Euro 2024 Squad.docx
 
Techniques for those who create fantasy sports Developers
Techniques for those who create fantasy sports DevelopersTechniques for those who create fantasy sports Developers
Techniques for those who create fantasy sports Developers
 

When Too Much Data is Barely Enough