This document analyzes the accuracy of citation data in Web of Science (WoS) and Scopus by comparing reference data from Elsevier journal publications to the reference data in WoS and Scopus. The analysis found inaccuracies in about 1% of references in both WoS and Scopus. For WoS, there were issues with missing and incorrect references. For Scopus, problems included duplicate publications and citation matching errors. There were also large discrepancies in citation counts between the two databases and over time for some highly-cited publications. The document concludes that citation data in both WoS and Scopus suffers from significant inaccuracies.
Stunning ➥8448380779▻ Call Girls In Panchshil Enclave Delhi NCR
Accuracy of citation data in Web of Science and Scopus
1. Accuracy of citation data in Web of
Science and Scopus
Nees Jan van Eck and Ludo Waltman
Centre for Science and Technology Studies, Leiden University, Leiden (The Netherlands)
16th International Conference on Scientometrics & Informetrics
Wuhan, China, October 19, 2017
2. Introduction
• Question: Can we trust citation counts in WoS and
Scopus?
• Aim: To determine accuracy of citation data in WoS
and Scopus
– Accuracy of reference data
– Accuracy of citation matching
• Approach: Comparison of references in full text of
Elsevier publications with references in WoS and
Scopus
1
3. …
References
[1] Hirsch, JE (2005)
PNAS, 102, p.16569
[2] Egghe, L (2006)
Scientist, 20, p.15
…
Approach
2
…
References
[1] Hirsch, JE (2005)
PNAS, 102, p.16569
[2] Egghe, L (2006)
Scientist, 20, p.15
…
Original
(Elsevier) publication
WoS
…
References
[1] Hirsch, JE (2005)
PNAS, 102, p.16569
[2] Egghe, L (2006)
Scientist, 20, p.15
…
Scopus
…
References
[1] Hirsch, JE (2005)
PNAS, 102, p.16569
[2] Egghe, L (2006)
Scientist, 20, p.15
…
4. Elsevier data
• Elsevier ScienceDirect Article Retrieval API
• Subscription-based journal publications in period
1987-2016
• Publication and reference data in XML format
3
5. Linking Elsevier data with WoS and
Scopus
4
WoS Scopus
Time period 1987–2016 1996–2015
Document types article, review article, review,
conference paper
No. of linked publications 6M 5M
No. of references in Elsevier data 207M 172M
No. of references in WoS/Scopus 203M 170M
No. of linked references 136M 84M
8. Linked publications classified based
on number of references
7
WoS Scopus
Equal no. of references 77.2% 96.4%
More references 2.7% 1.2%
Fewer references 19.3% 1.2%
No references 0.8% 1.2%
20. Incorrect references in WoS (2)
19
Original reference in publication WoS reference
J. Wang, J.K. Carson, M.F. North, D.J. Cleland, Int.
J. Heat Mass Transfer 49 (17) (2006) 3075–3083.
WANG J, 2006, CHINESE
CHEM LETT, V17, P49
Kanber B, Hartshorne TC, Horsfield MA, Naylor AR,
Robinson TG, Ramnarine KV. Dynamic variations in the
ultrasound gray-scale median of carotid artery
plaques. Cardiovasc Ultrasound 2013a;11:21.
KANBER B, 2013,
CEREBROVASC DIS S2, V35,
P21
Evans PD, Chowdhury MJA. Photoprotection of wood
using polyester-type UVabsorbers derived from the
reaction of 2 hydroxy-4(2,3-epoxypropoxy)-
benzophenone with dicarboxylic acid anhydrides. J
Wood Chem Technol 2010;30:186e204.
EVANS P, 2010, TLS-TIMES
LIT S 0326, P30
X. Li, S. Wang, Y. Chen, G. Liu, X. Yang,
Overexpression of CD40 in sacral chordomas and its
correlation with low tumor recurrence, Onkologie 36
(10) (2013) 567–571
LI XY, 2013, NANJING
NONGYE DAXUE, V36, P36
K. Zhang, H. Chen, G. Wu, K. Chen, H. Yang, High
expression of SPHK1 in sacral chordoma and
association with patients’ poor prognosis, Med.
Oncol. 31 (11) (2014) 247.
ZHANG K, 2014, IEEE T
PATTERN ANAL, V1, P1
32. Differences in citation counts
between two versions of WoS
31
WoS
Dec 2016
WoS
Jun 2017
Newman, M.E.J., & Girvan, M. (2004). Finding
and evaluating community structure in
networks. Physical Review E, 69(2), 026113.
2,073 139
Newman, M.E.J. (2004). Fast algorithm for
detecting community structure in networks.
Physical Review E, 69(6), 066133.
436 1,070
Clauset, A., Newman, M.E.J., & Moore, C.
(2004). Finding community structure in very
large networks. Physical Review E, 70(6),
066111.
1,156 2,627
33. Conclusions
• Citation data suffers from significant inaccuracies
both in WoS and in Scopus
• WoS
– Incorrect references
– Missing references
• Scopus
– Duplicate publications
– Citation matching problems
• Both WoS and Scopus have inaccuracies in about 1%
of references
32