The document discusses the need for disruption in science. It notes that up to 70% of academic research cannot be reproduced, representing a waste of money and effort. Additionally, existing research systems are hindering progress by locking scientists into old mechanisms and traditions that persist due to influential people resisting change. However, the document expresses hope that systems can be improved by rethinking how knowledge is defined, produced and shared in order to increase reproducibility and openness in scientific research.

1. the need for
disruption in science
kaitlin thaney
@kaythaney ; @mozillascience
envisioning the future

2. doing good is part of our code

3. traditions last not because they are
excellent, but because influential
people are averse to change and
because of the sheer burdens of
transition to a better state ...
“
“
Cass Sunstein

4. we’re battling inertia and
flawed assumptions.

8. we’re locked in old mechanisms.

9. “... up to 70% of research from academic labs
cannot be reproduced, representing an enormous
waste of money and effort.”
- Elizabeth Iorns, Science Exchange

11. traditions last not because they are
excellent, but because influential
people are averse to change and
because of the sheer burdens of
transition to a better state ...
“
“
Cass Sunstein

12. our definition of
“knowledge” is evolving.
as are the containers ...

13. research cycle
idea
experiment
lit review
materials
publish
share results
retest
analyze
collect data

14. blocking points
idea
experiment
access
attaining
materials
publish
share results
retest
analyze
collect data
(to name a few ...)

15. types of information
hypothesis/query
protocols
parameters
content
non-digital “stuff”
articles
proceedings
negative results
analysis
code
datasets
models
(added complexity)
prof activities
mentorship
teaching activities

17. 3 Gb/year

18. how much made available?
* roughly

19. Source: Michener, 2006 Ecoinformatics.

20. wasted ...
$$$
time
resource

21. Source: Wolkovich et al. GCB 2012.

23. our systems
are hindering us.
(but there’s hope.)

24. existing system is imperfect
we can/need to do better.

25. “Altmetrics” generally refers to tracking
online attention (esp. social media) data
to try and get an idea of the wider
impact of scholarly research.

26. ?
changing models of
authority, community

27. rethink how we reward
“digital research”
idea
protocols
parameters
content
non-digital “stuff”
articles
proceedings
negative results
analysis
code
datasets
models
prof activities
mentorship
teaching activities

28. What Des-Cartes did was a good step.
You have added much several ways, &
especially in taking ye colours of thin
plates into philosophical consideration.
If I have seen further it is by standing on
ye shoulders of Giants.
- Isaac Newton, 1676
“
“

29. Source: Piwowar, et al. PLOS.

30. core competencies of
21st century research

32. think before you (re)invent.
design for network effects.
coordination is key.

33. design (/teach) for reuse of
data / content / code.
learn from open source,
where reproducibility is
key.

34. questions?
kaitlin@mozillafoundation.org
@kaythaney ; @mozillascience