Clarivate was selected as the citation provider for the 2018 Excellence in Research for Australia (ERA) evaluation. The role involved preparing, submitting, and checking citation data from Clarivate's databases to support the ERA evaluation. Clarivate mapped institutional publication records to citations in the Web of Science and provided tagging portals and APIs to help with this process. They also offered seminars and support to help universities understand the citation data and benchmarks. Moving forward, Clarivate wants to leverage feedback to better support the quality of Australian research.
1. Clarivate as the Citation
Provider for ERA
Research Support Community Day
February 2018
Jean-Francois Desvignes,
solutions consultant, Australasia
2. 2
Overview
Research Support Community Day 2018
• Background of ERA
• What does the role of citation provider for ERA covers?
• Mapping institutional data to Web of Science records
• Supporting HEPs with citation data
• What’s next?
3. 3
Objective of ERA: evolution of research impact in Australia, not (yet) another league table
Research Support Community Day 2018
Source: InCites dataset updated Oct 14, 2017. Includes Web of Science™
content indexed through Aug 31, 2017. 1980-2016 publications
Australia
Australia
4. 4
What does the role of citation provider for ERA covers?
• In 2017, the Australian Research Council selected Clarivate
Analytics to provide citation data in preparation of ERA 2018.
• Citations information is used for specific disciplines (natural
sciences).
• #1 Clarivate involvement: Preparation (Sept – Nov 2017) >
Submission (Mar - Apr 2018) > Data Integrity Checking (April
– May 2018) > Certification (May 2018).
• #2 Clarivate involvement: support ARC evaluation of citation
based Units of Evaluation by providing global citation data to
the ARC.
Research Support Community Day 2018
5. 5
Mapping institutional data to Web of Science records
Research Support Community Day 2018
Tagging portal opens from September to November
(https://www.era2018tagging.com/).
Availability of all the indexes covered by ERA
during the tagging:
•Web of Science core collection (all indexes)*
•Zoological record
•Biosis*
•Medline
•* indexes generating citations
Open to 42 institutions who submitted a total of
1.5M records to be matched.
New API developed to enable the mapping of
submitted records that included:
•Article title
•Publication year
•Authors (all and 1st author)
•ISSN
•Volume, issue, pages
•DOI, article No, UT (accession number)
•Journal title
An example of the dashboard made
available to ERA liaison teams on the
tagging portal
6. 6
Supporting Universities
• ERA @ Clarivate is a global collaboration, a
partnership with the ARC, a local team
• arcera@clarivate.com
• Anthony.dona@clarivate.com
• Web of Science data accuracy (improve
document details, document type, missing
records, incorrect citations)
• Understanding of the citations capture and
benchmarking: we have given over 20
seminars
Research Support Community Day 2018
Anthony Dona
Jean-Francois
Desvignes
Laura Matthews
Geeho Liu
Simon Betts
7. 7
Understand citation data
Citations from the Web of Science are coming from
different databases. They can be extracted directly
from the Web of Science.
Research Support Community Day 2018
Benchmarks for tagged publications
can be evaluated through InCites
InCites’ research areas explorer or from
an ad hoc InCites dataset, enable the
calculation of estimated* benchmarks.
The Web of Science
platform’s citation
report enables the
retrieval of the latest
citation counts
estmates*.
* Values calculated for a part of the ERA datasets only, ERA census date not available.
8. 8
What’s next?
What can we do to better support the quality of research in Australia? Clarivate Analytics is keen to
leverage the feedback from ERA 2018:
University #1– “We have been much happier with the higher proportion of coverage in most research
areas, and found that the data is in general much more accurate.”
University #1 – “We have run a coverage analysis of the ERA Journal list compared to the round in 2015
(Covered by Scopus) and this round is more comprehensive”
University #3– “We have recently bought the raw XML data and derived a world of value for the ERA
round”
University #4– “We are simply happy that the citation provider is not Elsevier this time around”
University #5 – “The focus is, as expected, on content from the United States – however our specific
institution seems to have a very good coverage compared to other Australian Institutions.”
Research Support Community Day 2018
Background of ERA
What does the role of citation provider for ERA covers?
Mapping institutional data to Web of Science records
Supporting HEPs with citation data
What’s next?
Research impact as a measure of excellence did not increase as much as it was observed for other countries (eg Italy)
Australian % in top 10% stagnated over the last 35 years
Anthony has lead the support during tagging: Anthony.dona@clarivate.com
