Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Unsw reproducibility workshop
1. Reproducibility workshop 26 Nov
http://bizlab.unsw.edu.au/website/conference-2015.php
A new era of
large-scale replication and collaboration?
Alex.Holcombe@sydney.edu.au
@ceptional
http://www.slideshare.net/holcombea/
2. Reproducibility workshop 26 Nov
http://bizlab.unsw.edu.au/website/conference-2015.php
False positives zone
Look for areas wherein victory declared whenever
null hypothesis is rejected, where size of effect,
plausibility considered unimportant.
Where science is not self-correcting
3. Reproducibility workshop 26 Nov
http://bizlab.unsw.edu.au/website/conference-2015.php
"This one's Psych Science. 1998. Put
your money on ‘will replicate’?”
"What, you think I was born
yesterday?”
"Fine," muttered the bookie.
#AcademicNoir
4. Reproducibility workshop 26 Nov
http://bizlab.unsw.edu.au/website/conference-2015.php
Well, Mr. P. Hacker, your luck is about to run out…
down at the journals, they’re running a new game.
They call it ‘preregistration’.
5. Reproducibility workshop 26 Nov
http://bizlab.unsw.edu.au/website/conference-2015.php
5
https://osf.io/tvyxz/wiki/home/
6. Reproducibility workshop 26 Nov
http://bizlab.unsw.edu.au/website/conference-2015.php
6
https://osf.io/tvyxz/wiki/home/
7. Reproducibility workshop 26 Nov
http://bizlab.unsw.edu.au/website/conference-2015.php
7
https://osf.io/tvyxz/wiki/home/
100% P-hacking Free
Here, check our
numbers.
Here’s how you
can replicate our
result.
8. Reproducibility workshop 26 Nov
http://bizlab.unsw.edu.au/website/conference-2015.php
"This one's Psych Science. 1998. Put
your money on ‘will replicate’?”
"What, you think I was born
yesterday?”
"Fine," muttered the bookie.
10. Reproducibility workshop 26 Nov
http://bizlab.unsw.edu.au/website/conference-2015.php 10
Failed to replicate my result?
Have you
considered
the unknown
moderators?
11. Reproducibility workshop 26 Nov
http://bizlab.unsw.edu.au/website/conference-2015.php 11
Any one of us alone, he’ll say we messed up.
But if we all run the replication together, we
can show the big guy we’re right.
12. Reproducibility workshop 26 Nov
http://bizlab.unsw.edu.au/website/conference-2015.php
Meta-analysis forest plot
13. Reproducibility workshop 26 Nov
http://bizlab.unsw.edu.au/website/conference-2015.php
Meta-analysis forest plot
Failed to replicate my
result?
Have you considered
the unknown
moderators?
You messed
up!
17. Reproducibility workshop 26 Nov
http://bizlab.unsw.edu.au/website/conference-2015.php
Preregistration
Large-scale replication
Open data
Open protocol and code
A new era of
large-scale replication
and collaboration?
Can we do this bottom-up?
