Slides from the INORMS 2018 (Edinburgh, June) Impact Special Interest Group session. Presented by Dr David Phipps (York University, Canada) and Dr Julie Bayley (University of Lincoln, UK)

1. Training Seminar
The Professional Association of Research Managers and Administrators
IMPACT SPECIAL
INTEREST GROUP
Dr Julie Bayley, University of Lincoln, UK
Dr David Phipps, York University, Toronto, Canada
Tuesday June 5th 2018

2. Training Seminar
The Professional Association of Research Managers and Administrators
Impact Special Interest Group
• Professional impact community
• Champion – Julie Bayley (University of Lincoln):
• Networking
• Website & mailing list (updates, queries, job alerts etc.)
• Identify learning and professional development needs,
link to wider ARMA community
• Act as voice e.g:
• REF consultation
• New Zealand Impact of Science consultation
• GDPR and impact testimonials
• REF, Impact and concerning practices

3. Training Seminar
The Professional Association of Research Managers and Administrators
Part 1: Context and current practices
• Part 1: Context and current practice
• Impact in the UK context
• Assessment led
• Impact internationally
• Non assessment led
• Part 2: Working together
• Discussions
• Aims: to reflect on challenges, share good
practice across institutions and build networks to
strengthen impact

4. Training Seminar
The Professional Association of Research Managers and Administrators
THE UK CONTEXT

5. Training Seminar
The Professional Association of Research Managers and Administrators
Research context
http://cdbu.org.uk/the-higher-education-and-research-bill/

6. Training Seminar
The Professional Association of Research Managers and Administrators
What is REF?
• Research Excellence Framework
• 7(ish) yearly assessment of research quality + impact
• UK Dual funding structure:
• Competitive bids (Research Councils)
• Quality Related (QR) funding – via REF
• See http://www.hefce.ac.uk/rsrch/funding/mainstream/
• Research submitted under Units of Assessment
• Broad subject areas (eg. Engineering, Allied Health)
• ͛2001/8 Research Assessment Exercise (RAE)
• Outputs (eg. research papers) and environment (eg. research
degrees awarded)
• 2014 REF
• + Impact introduced in 2011 (see http://impact.ref.ac.uk/CaseStudies/)

7. Training Seminar
The Professional Association of Research Managers and Administrators
REF 2021
• 2021 as per REF 2014, except:
• ALL research staff submitted
• Weighting up from 20 to 25%
• Case study quota: 2 for first 20 staff + 1 per 15 until 110 (1:50)
• Impact template moved to Environment
• Impact occurring Aug 2013-Jul 2020, of research conducted at institution
Jan 2000-Dec 2020
• Awaiting guidance on
• Continuing case studies
• Public Engagement
• Broadening of ‘underpinning research’
• General Data Protection Regulation (GDPR) compliance

8. Training Seminar
The Professional Association of Research Managers and Administrators
Good practice
• Responsible metrics: www.responsiblemetrics.co.uk
• Open Access: unpaywall.org
• CASRAI (information standards) https://casrai.org/
• Considerable research and exploration eg.
• Analysing REF case studies:
https://www.kcl.ac.uk/sspp/policy-
institute/publications/Analysis-of-REF-impact.pdf
• London School of Economics blog
http://blogs.lse.ac.uk/impactofsocialsciences/
• Evidence and Policy
https://policypress.co.uk/journals/evidence-and-policy
• Research Evaluation https://academic.oup.com/rev/

9. Training Seminar
The Professional Association of Research Managers and Administrators
THE
INTERNATIONAL
CONTEXT

10. Training Seminar
The Professional Association of Research Managers and Administrators
?
• Funders
• Donors
• Projects
• Networks
• Commercialization
• Entrepreneurship
• Bibliometrics
Where in the world is impact?

11. Training Seminar
The Professional Association of Research Managers and Administrators
Some impact systems

12. Training Seminar
The Professional Association of Research Managers and Administrators
CREATING IMPACTS ASSESSING IMPACTS
(“how”) (“what”)
DOING IMPACT
(“who”)

13. Training Seminar
The Professional Association of Research Managers and Administrators
Working together

14. Training Seminar
The Professional Association of Research Managers and Administrators
Part 2: Discussions
1. Impact Literacy and Skills
2. Evidencing impact
3. Building an institutional impact
culture

15. Training Seminar
The Professional Association of Research Managers and Administrators
Impact Literacy
Bayley, J.E. and Phipps, D. (2017) Building the concept of research impact literacy. Published on line in
Evidence & Policy http://www.ingentaconnect.com/content/tpp/ep

16. Training Seminar
The Professional Association of Research Managers and Administrators
Knowledge broker competencies
Bayley, J.E, Phipps, D., Batac, M. and
Stevens, E. (2017) Development and
synthesis of a Knowledge Broker
Competency Framework. Evidence and
Policy (available online)
https://doi.org/10.1332/174426417X14945
838375124

17. Training Seminar
The Professional Association of Research Managers and Administrators
Discussion 1:
Improving impact
literacy and skills
What are the challenges
and opportunities for
improving how impact is
understood and the skills
needed to deliver it?
(Topic)
Challenges Opportunities

18. Training Seminar
The Professional Association of Research Managers and Administrators
Evidencing impact
http://www.vertigoventures.com/research-
impact-evidence/
Key: Demonstrability and
audit
1. What changes?
2. How will you know?
3. How can you prove it?
4. How will you record it?

19. Training Seminar
The Professional Association of Research Managers and Administrators
Discussion 2:
Evidencing impact
What are the challenges and
opportunities for evidencing
impact?
(Topic)
Challenges Opportunities

20. Training Seminar
The Professional Association of Research Managers and Administrators
Developing an impact literate
culture
Bayley, J.E. and Phipps, D. (2017) Building the concept of research impact literacy. Published on line in
Evidence & Policy http://www.ingentaconnect.com/content/tpp/ep

21. Training Seminar
The Professional Association of Research Managers and Administrators
Focus on institutional
practices
Respond to unique
contexts
Common:
engagement
(students,
teaching/learning,
research),
dissemination,
events, grant support
(research office)
Qualities: reciprocity,
meaningful partner,
trust, sharing,
multiplier effect,
central coordination
(central and local
delivery)

22. Training Seminar
The Professional Association of Research Managers and Administrators
https://www.lfhe.ac.uk/en/research-
resources/publications-hub/research-leaders-
impact-toolkit-publications.cfm
See the Emerald stand at INORMS

23. Training Seminar
The Professional Association of Research Managers and Administrators
Discussion 3:
Building an
institutional culture
What are the challenges and
opportunities for embedding
impact positively in an
organisation?
(Topic)
Challenges Opportunities

24. Training Seminar
The Professional Association of Research Managers and Administrators
Concluding thoughts
David Phipps
York University &
Research Impact Canada
www.researchimpact.ca
@researchimpact
Julie Bayley
University of Lincoln
www.juliebayley.blog
@JulieEBayley