1. Assessing the value of open
access agreements
Researcher to Reader
Wednesday 22 February 2023
Laura Wong, Jisc
Essential metrics, metadata, and infrastructure to support consortial
evaluation of open access agreements

2. Open Access agreements at Jisc
Assessing the value of open access agreements - Researcher to Research
2023
2

3. How do we assess value?
•What do we mean by value?
•When do we want to assess value?
•Where do usage statistics fit in?
Assessing the value of open access agreements - Researcher to Research
2023
3

4. How can usage statistics support value questions?

5. Negotiation
•Which titles in the publisher’s portfolio are most
important in the UK context? Which are “high value”?
•To what extent are UK needs being met by OA content?
•How are patterns of use changing over time? Are we
seeing more usage of open compared to closed content?
Assessing the value of open access agreements - Researcher to Research
2023
5

6. Flipped journals
•What’s the global impact of flipped journals?
•What are the usage trends over the last couple of years
at journal and portfolio level? UK vs. global? Open vs.
closed content?
•Where does the UK sit in the international landscape?
What is its contribution to flipping titles to open access?
Assessing the value of open access agreements - Researcher to Research
2023
6

7. Institutional budgets and justifying spend
•What happens when we can no longer use the
subscriptions budget to fund these deals and initiatives?
•How do we secure budget and justify spend? How do we
continue demonstrating value for money and return on
investment?
•What benefits are we seeing from OA initiatives?
•What is the reach of our publication output?
Assessing the value of open access agreements - Researcher to Research
2023
7

8. Impact of policies
•How does the usage of funded research outputs
compare to non-funded outputs?
Assessing the value of open access agreements - Researcher to Research
2023
8

9. What does this mean for how we work with usage data?
Assessing the value of open access agreements - Researcher to Research
2023
9
•There’s still interest in…
•Paywalled usage
•Usage aggregated by title or journal
•Usage aggregated by publisher
•Usage attributed to institutions
•Annual trends
•But also interest in…
•Global usage of both open and paywalled
content
•Total usage of open content in the UK (not
just attributed to the institution)
•Global reach and country of use
Based on those key questions

10. A different approach
Holistic view
Indirect
value
Beyond the
publisher
platform
Slicing item
and global
data
Assessing the value of open access agreements - Researcher to Research
2023
10

11. Why item level reporting is important
Assessing the value of open access agreements - Researcher to Research
2023
11
Huge
Item
Report
COUNTER filters
• Articles published under
agreement
• Articles published by
associated authors
• Funded articles
• License type
• Articles on a platform
• Year of publication
Total usage
by…
• Single item

12. Supporting data
Assessing the value of open access agreements - Researcher to Research
2023
12
We need details
about:
• What has been
published
• Where was it
published
• Author affiliation
• Who funded it
• Under what licence
• Publication type
From places such as:
• Publisher systems
• Crossref
• Open Alex
• Open Access
Switchboard
• Databases such as
Scopus, WoS and
Dimensions
Matching on identifiers
such as:
• ISSN/ISBN
• DOI
• OCRID
• Funder ID
• Organisational IDs

13. 13
OA
agreements
analytics
and
evaluation
Data management
Automate processes to collect, collate,
clean and verify the required data
Shared understanding
Share approaches monitoring and
evaluation and build an evidence
base to support conversations
Data analysis
Data expertise of the team to work with
the dataset to find insights
Additional datasets
Supplement and enhance data with
Crossref, Unpaywall and Dimensions
Presentation
Provide robust and comparable
metrics with contextual information
in a digestible format
Accessible and re-usable
datasets
Provide datasets in an easy and
interoperable format
Assessing the value of open access agreements - Researcher to Research
2023

14. What are Jisc doing with global and item usage stats?
COUNTER item
reports through
JUSP, our
collection service
Prototype data
visualisations
using publisher
supplied global
usage reports
Global usage of
items in
repositories
through IRUS
Case study
using IRUS stats
in analysis of an
agreement with
self-archiving
element
Assessing the value of open access agreements - Researcher to Research
2023
14

15. And OA monographs…

16. Global and granular: COUNTER for OA
RESEARCHER TO READER, FEBRUARY 2023 | TASHA MELLINS-COHEN

17. Release 5
accommodates
OA
Release 5.1
optimised for
OA
The standard
since 2003

18. Global
All usage
Non-attributed
Pay
walle
d
Free
to
read
OA
Attributed
Pay
walle
d
Free
to
read
OA

19. Granular
Item Report
Title and
Database
Reports
Platform
Report

20. Global AND
Granular
All
usage
Per
article
Global
Item
Report

21. Impact metrics
METRICS: HANDLE WITH CARE