Talk at the 39th Annual Meeting of the Society for Scholarly Publishing (https://www.sspnet.org/events/annual-meeting-2017/event-home/).

1. Practical implementation
of research data policies:
Solutions using Dataverse
Mercè Crosas, Institute for Quantitative Social Science, Harvard University
mercecrosas.com @mercecrosas
SSP 39th Annual Meeting, Boston, June 1, 2017

2. Data Policies and
Incentives for Data Sharing

3. The scientific community is establishing best
practices for data publishing and replication

4. Data policies adoption vary across disciplines
Genetics
Biomedical
Computational
Science
Economics
Ecology
“weak”= recommend
“strong” = require
Castro, Crosas, Garnett, Sheridan, Altman, 2017, Journal of Scholarly Publishing, Forthcoming

5. Authors comply with strong data policies
0
10
20
30
40
50
60
70
80
90
100
Percentage of articles with available replication material
Data Sharing in Top Political Science Journals (Key 2016)*
Mandatory Replication Material
or Verification
Replication Material
Expected
No Requirement
Key, 2016, Political Science & Politics; via: Sebastian Karcher
Recently, 27 political science journals adopted the
Journals Editors’Transparency Statement

6. Journal guidelines encourage open data practices
NHST = null hypothesis significance testing;
CI = confidence intervals;
MA = meta-analysis;
CI_interp = confidence intervals interpretation;
ES_interp = effect size interpretation;
Data_excl = exclusion criteria reported;
Material = additional materials availability;
Prereg = preregistered study.
In Psychology Science:
•use of confidence
intervals grows from
28% in 2013 to 70%
in 2015
•availability to open
data, grows from
3% to 39%
Giofrè D, Cumming G, Fresc L, Boedker I, Tressoldi P (2017) The influence of journal submission guidelines on authors' reporting
of statistics and use of open research practices. PLOS ONE 12(4): e0175583. https://doi.org/10.1371/journal.pone.0175583

7. Useful recommendations in “data citation
roadmap for publishers”
• Recommendations for
publishers to support
data policies, through
pre-submission,
submission, production,
and publication phase.
• Preference: Add data
citation in Reference
list
Results from BioCaddie Data Citation
Implementation Pilot and Force11 Joint
Declaration of Data Citation Principles

8. Who are the data authors? Who gets credit?
Bierer, Crosas, Pierce, 2017, Data Authorship as an Incentive to Data Sharing,
The New England Journal of Medicine, DOI: 10.1056/NEJMsb1616595

9. Solutions with
Dataverse

10. Dataverse repositories are
used around the world to
publish research data
(dataverse.org)
Harvard Dataverse
is a public data
repository open to
any journal and
data author to
deposit their data
(dataverse.harvard.edu)

11. Dataverse supports multiple options for data
submission from Journals
• Recommend Harvard Dataverse as one of the data
repositories your journal supports
• Create a journal dataverse, and manage data submissions
associated with your journal (there are ~160 journal
dataverses in Harvard Dateverse repository)
• Integrate your journal system with Dataverse using the
data deposit API

12. Dataverse also provides options for data review
• Grant access to data reviewers in your journal
dataverse
• Allow anonymous data review using a private URL
for each dataset
• Set up extensive data and replication review with a
third party (ODUM Institute at UNC)

13. From
Journal
Article
To Data
Example:
AJPS journal
dataverse

14. For AJPS: Replication review becomes part
of the submission workflow
+ +
0 Resubmits
1 Resubmit
2 Resubmits
3 Resubmits
4 Resubmits
0 10 20 30 40
3
17
31
37
8
Total: 95 completed verifications
via Thu-Mai Lewis Christian, Data Archives, ODUM Institute

15. Thanks!
Mercè Crosas, Institute for Quantitative Social Science, Harvard University
mercecrosas.com @mercecrosas
•At least, recommend
•If you can, require
•If you dare, review and replicate