LIBRARY
MEASURING THE IMPACT OF
PIRACY AND OPEN ACCESS
ON THE ACADEMIC LIBRARY
SERVICES
Pablo Iriarte
Floriane Muller
ILDS conference, Paris,
October 4th, 2017
Pablo.Iriarte@unige.ch
Floriane.Muler@unige.ch

LIBRARY
AGENDA
1. Context
2. Methods: Data Analysis
3. Results & Discussion
4. Conclusions

LIBRARY
CONTEXT
ILL/DD Trends
Shift from paper to e-resources
Open Access
Piracy

4
ILL/DD TRENDS
IN SWISS UNIVERSITY LIBRARIES

5
ILL/DD TRENDS
IN SWISS MEDICAL LIBRARIES

6
ILL/DD TRENDS

7
PORTION OF ACQUISITION BUDGET
DEVOTED TO E-RESOURCES

8
YET, FOR THE FIRST TIME IN 2016
1 679 037
1 713 114
1 935 068
1 900 846
1 550 000
1 600 000
1 650 000
1 700 000
1 750 000
1 800 000
1 850 000
1 900 000
1 950 000
2 000 000
2013 2014 2015 2016
Full-text article requests at University of
Geneva Library

9
THE STATE OF OPEN ACCESS
On october 3rd, 2017
https://doi.org/10.7287/peerj.preprints.3119v1
DOI: 10.1038/nature.2017.22418

10
PIRACY
Bohannon J. Who’s downloading pirated papers? Everyone. Science [Internet]. 28 avr 2016 [cité 3 oct 2017]; Disponible sur:
http://www.sciencemag.org/news/2016/04/whos-downloading-pirated-papers-everyone

11
SO…
When it comes to obtaining the full-text of an
article…
…To what resources and services
can/do our scholars turn ?

LIBRARY
DATA ANALYSIS
Our data sources
Data cleaning, processing & merge

13
OUR DATA SOURCES
WOS SCI ed.
(articles cited
by UNIGE
members in
2015-6)
E-journals
Serial
collection
ILL/DD
Insitutional
Repository
oaDOI
SciHub

DATA
CLEANING,
PROCESSING
&
ENRICHMENT
WOS SCI
CITATIONS
Web of Science
SCI edition
n2015 = 3'833
n2016 = 3'989
DOI included in the reference ?
Use Crossref API
to retrieve detailed
metadata
Use Crossref
OpenURL web
service to find the
DOI from the
available metadata
Dataset used for data
analysis and merging
NDOI=223'283
No
Ndoi=48'521
(18%)
Yes
Ndoi=228'092
(82%)
Retrieve all
citation data for
those works
On March 3rd, 2017, extract all works
published in 2015 and 2016,
Affiliation enhanced = University of Geneva
cit2015 =171'267
cit2016 =193'178
CitTotal = 364'445
223'283 Valid DOIs
32 duplicates
18'542 Bad DOIs
13'765 DOI found (28%)
34'756 Not found (72%)
DOI found
N=13'765
No DOI
N=34'756
Excluded references
(missing data)
N=53'330
Valid DOIs
Bad DOIs or duplicates
N=18'574
UniqueRef2015 =143'142
UniqueRef2016 =158'563
UniqueRefTotal =276'613
Deduplicate

DATA
CLEANING,
PROCESSING
&
ENRICHMENT
ILL/DD
OpenILLink
(ILL Tool used at Medical &
Science library at UNIGE)
Orders2015-2016 = 7'509
Requested doc has DOI or PMID ?
Use NLM E-
utilities service to
obtain equivalent
DOI
Use Crossref
OpenURL web
service to find the
DOI from the
available metadata
Dataset used for data
analysis and merging
N=3'728 (50%)
No
N=2'772
(27%)
Yes
N=4'737
(63%)
Export all anonymised orders meeting following
criteria
- Request date: 2015 & 2016
- user requesting doc is affiliated to UNIGE or
Univ. Hospital (HUG)
1'523 DOI found
3'781 No DOI found
No DOI
N=3'781
DOI obtained = ?
No DOI obtained = ?
Excluded references
(missing data)
N=3'781 (50%)
Which one ?
DOI
N=9
PMID
N=4'728
No DOI
N=2'532
(54%)
DOI
N=2'196
(46%)
DOIs
N=1'523
Very small
because our
OpenILLink
Tool had a DOI
problem

16
OUR PROCESS TO VERIFY
ACCESSIBILITY / USAGE
For each article
(with a valid DOI and
corresponding metadata)
cited in UNIGE 2015-6
publications in WOS SCI,
check if
ISSN is amongst print / online suscription
resources and corresponding year match ?
Query DOI in OaDOI API and get answer
regarding status: OA or closed ?
DOI is present in SciHub requests from
Switzerland IP address (2015-16 partial data)
DOI is present in 2015-2016 ILL/DD requests
DOI is amongst our insitutional repository
and if yes, what is full-text status (Green OA)
Usable dataset
N=3'728 (50%)
Usable dataset
N=33'876
Nprint= 9'671
Nonline=79'758
Dataset usable for data
analysis and merging
NDOI=223'283 (80%)
Cleaned dataset
N=33'993Keep only articles:
220’527

17
FINAL MATRIX

18
SOME LIMITATIONS
• Imperfect data sources
o Sci-hub data is partial and we don’t know all about it

19
SOME LIMITATIONS
• Imperfect data sources
o Sci-hub data is partial and we don’t know all about it

20
SOME LIMITATIONS
• Imperfect data sources
o Sci-hub data is partial and we don’t know all about it
o SFX / catalog data : one-time 2017 snapshots.
o Not all UNIGE papers are in WOS
o WOS citations data are not so clean (missing metadata, no DOI or DOI
not valid)
o Half of ILL requests could not be analysed
• Imperfect Unique identifiers
o No PMID to DOI easy reliable conversion tool
o Undeclared DOI ?
• Short time-frame
o Publication takes time. Researchers may cite articles they have gotten
long ago (so not in our 2015-6 radar)
• Other factors
o Eg. Free ILL/DD may have a role is trends
o Researcher may resort to many other article providing « sources »
o Do they cite unread articles ?
• Only journal articles

LIBRARY
RESULTS & DISCUSSION

22
CITED IN 2015 ARTICLES AVAILABILITY
WITHIN DATA SOURCES

23
CITED IN 2016 ARTICLES AVAILABILITY
WITHIN DATA SOURCES

24
THE HIDDEN FIGURES
2015: 18’595
2016: 14’412
???

25
DISTRIBUTION OF CITED ARTICLE BY
YEAR PUBLISHED
Distribution of the 115’045 different articles
cited in 2015 publications
Distribution of the 127’738 different articles
cited in 2016 publications

26
SHIFT BETWEEN 2015 & 2016 ?

27
CONCLUSIONS
• Need for articles should still be present as our
researchers cite more and more
• Confirmed some feelings we had:
✓ OA is growing faster than the rest
✓ The library offers nice coverage.
✓ Piracy is not so high in Switzerland
✓ We don’t know all sources (and practices)
• But : we can’t explain the slight 2016 usage decrease of
our e-journals.
• More research needed (survey ? direct observation ? …)
• Repeat for all resources provided by university and
develop as a promotion tool for library services incl.
ILL/DD?

28
SELECTED REFERENCES
• Bohannon, John. 2016. « Who’s downloading pirated papers? Everyone ». Science, avril.
doi:10.1126/science.aaf5664.
• DOAJ. 2017. « Directory of Open Access Journals ». Consulté le octobre 3. https://doaj.org .
• « DOCLINE® Presentations ». 2017. Staff Presentations. Consulté le octobre 3.
https://www.nlm.nih.gov/docline/doclinepresentations.html .
• « Jahresberichte der Universitätsbibliothek Bern & Libernensis ». 2017. DigiBern. Consulté le octobre 3.
http://www.digibern.ch/katalog/jahresberichte-der-universitaetsbibliothek-bern-libernensis.
• OFS Office fédéral de la statistique. 2017a. Proportion des frais d’acquisition de documents sur supports
électroniques par rapport aux frais totaux d’acquisition de documents. Consulté le octobre 3.
https://www.bfs.admin.ch/bfs/fr/home/statistiques/culture-medias-societe-information-
sport/culture/bibliotheques.assetdetail.3104351.html .
• ———. 2017b. « Statistique suisse des bibliothèques su-f-16.02.02.02 & su-f-16.02.02.04 ». Consulté le
octobre 3. https://www.bfs.admin.ch/bfs/fr/home/statistiques/culture-medias-societe-information-
sport/culture/bibliotheques.html .
• Piwowar, Heather, Jason Priem, Vincent Larivière, Juan Pablo Alperin, Lisa Matthias, Bree Norlander,
Ashley Farley, Jevin West, et Stefanie Haustein. 2017. « The State of OA: A Large-Scale Analysis of the
Prevalence and Impact of Open Access Articles ». e3119v1. PeerJ Preprints.
doi:10.7287/peerj.preprints.3119v1.
• Singh Chawla, Dalmeet. 2017. « Half of papers searched for online are free to read ». Nature, août.
doi:10.1038/nature.2017.22418.
• « Universitätsbibliothek Basel: UB Hauptbibliothek: Jahresberichte der UB ». 2017. Consulté le octobre 3.
http://www.ub.unibas.ch/ub-hauptbibliothek/wir-ueber-uns/weiteres/jahresberichte-der-ub/ .

LIBRARY
THANK YOU VERY MUCH!
Pablo.Iriarte@unige.ch
Floriane.Muller@unige.ch