Teresa Sorde's presentation from the ORCID and Casrai joint conference, Barcelona, May 2015

1. SIOR: recognition of the social
impact of research through
open access resources

2. IMPACT-EV
Evaluating the impact and
outcomes of European SSH
research (2014-2017)

3. Research Team
Director:
CREA – University of Barcelona, Spain,
Members:
MTAK KIK-TTO, Hungary (András Schubert, Editor of Scientometrics)
Trinity College Dublin, Ireland. (Paul Holm, the President of the European
Consortium for Humanities Institutes and Centres (ECHIC)
DANS-KNAW, The Netherlands, Center for Organisational Research
(CORe), Università della Svizzera Italiana, Switzerland, Institute for
Economic Research on Firms and Growth (CERIS–CNR), Italy,
Trinity Long Room Hub, Population and Social Policy Consultants (PSPC),
Belgium, Health Economics Research Group (HERG), Brunel University,
United Kingdom.
IMPACT-EV

4. Some of the research activities the European
Commission are requesting us to conduct:
1.The criteria and quantification of the social impact
(ex ante and ex-post) of projects from all scientific
areas.
2.To explain the evaluators how to use these criteria
3.The ex-post evaluation of all SSH projects of the
PF7 (2007-2013) and last call FP6 (2006).
4.The creation of an open repository on research
social impact.

5. Some of the research activities the European
Commission are requesting us to conduct:
1.The criteria and quantification of the social impact
(ex ante and ex-post) of projects from all scientific
areas.
2.To explain the evaluators how to use these criteria
3.The ex-post evaluation of all SSH projects of the
PF7 (2007-2013) and last call FP6 (2006).
4.The creation of an open repository
on research social impact:SIOR

6. Social Impact
- Researchers are not used to think about
their work as generating social impact…
- Not a tradition of gathering evidences of
our research social impact
- Social Impact occurs beyond the research
projects lifespan
- Problems of attribution
- How to measure social impact
…

7. “It is a bad idea to
keep repacking one's
bags for a trip that
one never takes”
Talcott Parsons
Olin Wright, E. Class Counts: comparative studies in class analysis
(Cambridge University Press, 1997), p.15.

8. Here during these two days
at the #ORCIDCASRAI15,
we are all starting the trip…

9. What is SIOR?

10. SIOR is a non-profit initiative
launched by the IMPACT-EV
consortium (European
Commission).
http://www.ub.edu/sior/index.php

11. SIOR is an open source repository to store evidence of
social impact.
Any researcher or research group around the world can
freely upload evidence of their research social impact
through registering to SIOR with an ORCID id.
Any institution or citizen around the world can freely see the
evidences of the studies, researchers and research groups
with social impact factor through registering to SIOR with an
ORCID id.
http://www.ub.edu/sior/index.php
SOCIAL IMPACT OPEN REPOSITORY
http://www.ub.edu/sior/sior.php
sior@ub.edu

12. Why ?
To respond to the open demand of measurable
parameters of social improvements generated by
scientific projects, promoting a necessary alternative
to the stagnation of scientific results and enabling real
social impact.

13. What is contributing to?
Enhance SSH research with social impact
Allow researchers and research institutions make
clear contributions to science, to the societies
and to their own work (linked to ORCID)
Increase the visibility of this research worldwide
Widening the concern about social impact across
the esearch community

14. How does SIOR work?

18. SOCIAL IMPACT CRITERIA
• Connection to United Nations Millennium Goals, EU2020
target or other similar official targets
• Percentage of improvement achieved in relation to the starting
situation.
• Transferability of the impact, the actions developed based on
the project’s findings have been transferred to other contexts
besides the original one
• Publication in scientific journals (with a recognized impact),
governmental or non-governmental official bodies, and
• Sustainability, the impact achieved by the action developed
based on the project’s findings has showed to be sustainable
throughout time

19. SOCIAL IMPACT CRITERIA
• Connection to United Nations
Millennium Goals, EU2020 target or
other similar official targets
• Percentage of improvement achieved in relation to the starting
situation.
• Transferability of the impact, the actions developed based on
the project’s findings have been transferred to other contexts
besides the original one
• Publication in scientific journals (with a recognized impact),
governmental or non-governmental official bodies, and
• Sustainability, the impact achieved by the action developed
based on the project’s findings has showed to be sustainable
throughout time

20. SIOR takes those targets already defined by
citizens through their democratically
elected representatives as a reference to
define what is considered social impact.
Font: http://ec.europa.eu/archives/commission_2010-
2014/president/news/documents/pdf/20100303_1_en.pd
f

21. SOCIAL IMPACT CRITERIA
• Connection to United Nations Millennium Goals, EU2020
target or other similar official targets
• Percentage of improvement achieved in relation to the starting
situation.
• Transferability of the impact, the actions developed based on
the project’s findings have been transferred to other contexts
besides the original one
• Publication in scientific journals (with a recognized impact),
governmental or non-governmental official bodies, and
• Sustainability, the impact achieved by the action developed
based on the project’s findings has showed to be sustainable
throughout time

22. SOCIAL IMPACT CRITERIA
• Connection to United Nations Millennium Goals, EU2020
target or other similar official targets
• Percentage of improvement achieved in
relation to the starting situation.
• Transferability of the impact, the actions developed based on
the project’s findings have been transferred to other contexts
besides the original one
• Publication in scientific journals (with a recognized impact),
governmental or non-governmental official bodies, and
• Sustainability, the impact achieved by the action developed
based on the project’s findings has showed to be sustainable
throughout time
Score Criteria
10 30% of improvement
9 20-29% of improvement
8 10-19% of improvement
7 Some improvement

23. SOCIAL IMPACT CRITERIA
• Connection to United Nations Millennium Goals, EU2020
target or other similar official targets
• Percentage of improvement achieved in relation to the starting
situation.
• Transferability of the impact, the actions developed based on
the project’s findings have been transferred to other contexts
besides the original one
• Publication in scientific journals (with a recognized impact),
governmental or non-governmental official bodies, and
• Sustainability, the impact achieved by the action developed
based on the project’s findings has showed to be sustainable
throughout time

24. SOCIAL IMPACT CRITERIA
• In this repository only the researchers and studies that
have had social impact appear.
• Even if their value is 1 it means a good result, because
many others do not even achieve enough social impact​ ​
to be in this repository.
Example: This situation is similar to journal rankings; for​ ​
instance, to be in the 4th quartile in JCR means to have a​ ​
scientific impact that most journals do not reach.

25. Examples

26. 27
SOCIAL IMPACT OPEN REPOSITORY
http://www.ub.edu/sior/sior.php
sior@ub.edu
SOCIAL IMPACT PROJECTS
INCLUSIVE CITIES PROJECT
Harvard Kennedy School
Reducing urban poverty from the organizational
capacities of the working poor

27. Restoring
Fukushima
University of
Tokyo
Strict control of
agricultural
products after
nuclear disaster.
Decontamination
with agricultural
procedures.

28. Social impact: Increase in school performance (performance rates)
Connection to UN Millennium
Goals, EU2020 target or other
similar official social targets
Europe 2020 Target on Education: Reducing the rates of
early school leaving below 10%
Has achieved more than 30% of
improvement
- La Paz Primary School (highly deprived area): Increase of
a 68% in the % of students who pass the official exam on
reading skills (from 17% to 85% in 5 years , 2001-2006).
- Primary school with Roma population: Increase of a
58,95% in the percentage of students who achieve read
and write skills in pre-primary education (5 years old) in
2012-2013.
Transferability: at least
implemented in 2 different
contexts
- 172 Schools in Latin America (Argentina, Brazil, Chile,
Colombia, México, Perú)
- 6 schools in UK (Cambridge, Norwich)
Social impact published on
scientific journals with recognized
impact (at least 1 article),
governmental or non-
governmental official bodies
- Scientific papers: Flecha, R., & Soler. M. (2013). Turning
difficulties into possibilities: engaging Roma families and
students in school through dialogic learning. Cambridge
Journal of Education, 3(44), 451.465.
Sustainability of the impact
throughout time
Increase in educational attainment continues in above
mentioned schools
Total score: 10

29. Social impact: Creation of employment in locations of extreme poverty
Connection to UN
Millennium Goals, EU2020
target or other similar
official social targets
Europe 2020 Target on Employment: 75% of the 20-64
year-olds to be employed
Has achieved more than
30% of improvement
- One of the poorest neighborhoods in southern Europe:
39% of employment increase (586 new jobs , Miquel
Fenollera Cooperative)
Transferability: at least
implemented in 2 different
contexts
- Catalan neighbourhood. Social initiative launched in
2013 consisting on a sewing women group.
- Primary school: school volunteers have been
employed by the city council
Social impact published on
scientific journals with
recognized impact (at least
1 article), governmental or
non-governmental official
bodies
- Scientific articles . Burgués, A., Martin, S. & Santa
Cruz, I. (2013). La relación entre cooperativas
transformadoras y desigualdades sociales en los
territorios . Scripta Nova, 427(XVII).
- Reports from City council services
Sustainability of the impact
throughout time
Employment in the cooperative is sustained
Total score: 10

30. Before publishing the project, the SIOR
team revises all the information uploaded
(peer review), and if everything is correct,
the project is published.

31. To End…

32. • SIOR is an ongoing process, directed by academics and
counting with the support of the technical team.
• SIOR working with the funding and evaluation
agencies to have access to this information (ex ante, ex
post)
• SIOR is already transforming the scientific community:
– Researchers who do not know whether their work has
achieved social impact, start to consider it and seek for
evidences (even in finished projects)
– Researchers whose work does not have achieved social
impact, start to consider so.

33. We cannot change the past, but we
can change the present and the
future, and SIOR, among other
initiatives, is already contributing
to do so.

35. Social impact are the evidence
based improvements experienced
by individuals and societies
(according to societal objectives),
resulting from the transference of
excellent research.

36. Economic and societal impact is the
demonstrable contribution that
excellent social and economic
research makes to society and the
economy, of benefit to individuals,
organizations and nations.
Social impact are the evidence
based improvements experienced by
individuals and societies, according to
societal objectives, resulting form the
transference of excellent research.

37. Economic and societal impact is the
demonstrable contribution that excellent
social and economic research makes to
society and the economy, of benefit to
individuals, organizations and nations