Cobiss.net regional network for supporting knowledge and evaluating research performance

COBISS.Net Regional Network for
Supporting Knowledge and Evaluating
Research Performance

Slovenian Research Agency (ARRS)
Dr. Franci Demšar, Director

Institute of Information Science
Mag. Tomaž Seljak, Director

South Eastern European Expert Meeting
21th of May 2010
Tirana

INSTITUTE OF INFORMATION SCIENCE

Ever-Relevant Questions

• How much does each country contribute to the world
treasury of knowledge?
• How much does each country invest into research
and development (R&D)?
• How to record and promote country's research
potential?
- Role of transparency
- Role of evaluation procedures
• How to implement transparency and boost regional
cooperation in the area of R&D?


Web of Science


Publications in Web of Science
(2005 - 2010)
70.000 69.353

60.000

50.000

40.000

30.000

20.000 16.075 16.063 16.026
12.505
10.000
2.990 1.676 1.632 474
0

Montenegro

Macedonia
Herzegovina
Austria

Albania
Slovenia
Serbia

Croatia

Bulgaria

Bosnia and

Publications in Web of Science
(per 1000 inhabitants)
9,00
8,32
7,93
8,00

7,00

6,00
4,82
5,00

4,00 3,63

3,00
2,17
2,00 1,57

1,00
0,80
0,44
0,15
0,00

Montenegro

Herzegovina

Macedonia
Austria

Slovenia

Albania
Serbia

Croatia

Bulgaria

Bosnia and

R&D as Percentage of GDP

Source: Eurostat, http://epp.eurostat.ec.europa.eu/portal/page/portal/science_technology_innovation/introduction


Annual Budget of the
Slovenian Research Agency (ARRS)

Mio. €

200
180
160
140
120
100
80
60
40
20
0
2004 2005 2006 2007 2008 2009 2010


Institutional Design and Position of ARRS

Strategic
Government of
Science & level
the RS
technology council

Other Policy level
Ministry of MHEST
Defence ministries

Operational
level
TIA ARRS

Executive
level
Scientific
Community


ARRS’s Main Areas of Operation

Promotion of
excellent
and applicative
research

Monitoring and
analysing Objective
evaluation

Funding of
research


ARRS's Information Infrastructure
for
Transparency of Research Results

• ARRS’s Web Portal
• SICRIS information system
• COBISS.SI bibliographic system
• WoS international citation indexes
• Videolectures.com portal
• Digital Library of Slovenia


ARRS’s Web Portal


Monthly Financial Overview


SICRIS
SlovenIan Current Research Information System

• Developed and maintained by the Institute of Information
Science (IZUM) and ARRS

• Currently presented entities (databases):
800 research organisations
1300 research groups
13600 researchers
5200 research projects
300 research programs

• Direct link to the COBISS bibliographic system through
researcher's codes


SICRIS: Presentation of a Researcher

Personal bibliography
Quantitative evaluation of bibliographic units
Citations in WoS by year
Data for ARRS’s tenders


COBISS.SI
Co-operative Online Bibliographic System and Services


Bibliographic Records in the
Union Bibliographic Database COBIB.SI

Total number of bibliographic records 3,671,033 100%

Monographs and other completed works 60%

Serials 3%

Articles and other component parts 35%

Performed works 2%

Number of records with at least one author
1,035,697 28%
with the researcher's code

Registering of bibliographies within COBISS.SI is mandatory for Slovenian researchers!


Classification of Bibliographic Units in COBIB.SI

• Classification of bibliographic units is based on the unique
typology (definition) of documents/works:
– Articles and other component parts (1.xx) 21 types
– Monographs and other completed works (2.xx) 28 types
– Performed works – events (3.xx) 7 types

Examples: 1.01 Original Scientific Article, 1.02 Review Article,
1.04 Professional Article, 2.01 Scientific Monograph, etc.

• Classification of units is done by authors or experts on the
subject, whereas the classification is verified by specialised
information centres for individual science disciplines


Portal Videolectures.net


Digital Library of Slovenia


Funding of Research: Two-Step Evaluation Process
ENTRANCE
BIBLIOMETRIC CRITERIA
DRAFT APPLICATIONS
(Outline Proposals)

PRE-SELECTION
BIBLIOMETRIC CRITERIA A B
~ 100 % PROJECTS ON THE
REJECTED PROJECTS
BASIS OF PROJECT
QUALITY
~ 100 %
PHASE 1

PHASE 2 CALL FOR SUBMISSION OF
FULL PROPOSALS

Only selected Assessments are
projects are invited sent to applicants

EVALUATION MADE BY THE
PANEL ON THE BASIS OF PEER REVIEW
(international peers)
– 2 per project

FINAL LIST OF APPROVED PROJECTS
Panel: scientific body & international peers
Scientific Council of the Agency


Quantitative Evaluation of
Bibliographic Indicators in Slovenia

• Bibliographies are evaluated when researchers apply for
tenders issued by the Slovenian Research Agency and
when they are elected to university titles
• Methodology for the evaluation of bibliographic indicators of
research performance (categorisation and rating by points)
is defined by the regulations of ARRS and universities
• Procedures related to the bibliographic unit categorisation
and rating by points are automated, and are based on the
interlinking of the SICRIS, COBISS.SI and WoS systems
• Evaluation results are available to the public within the
SICRIS system through researchers' and program/project
groups' web pages


Categorisation of Bibliographic Units
in Terms of Quantitative Evaluation

• Articles are categorised based on the journal impact factor, on
whether they are indexed in different databases, on the number of
citations, etc.
• Monographs are categorised based on the publisher, scope, etc.
• Conference proceedings are categorised based on the type and
the importance of the conference
• Patents are categorised based on the country granting a patent
and/or the type of testing
• …


Publications in Scientific Journals with
ISI Index
20000

18000

16000

14000

12000

10000

8000

6000

4000

2000

0
3

94

95

96

97

98

99

00

01

02

03

04

05
99

19

19

19

19

19

19

20

20

20

20

20

20
1
ar

ar

ar

ar

ar

ar

ar

ar

ar

ar

ar

ar

ar
ye

ye

ye

ye

ye

ye

ye

ye

ye

ye

ye

ye

ye


Ever-Relevant Questions

• How much does each country contribute to the world
treasury of knowledge?
• How much does each country invest into research
and development (R&D)?
• How to record and promote country's research
potential ?
- Role of transparency
- Role of evaluation procedures
• How to implement transparency and boost regional
cooperation in the area of R&D?


COBISS.Net

Regional network of
national library information systems and
current research information systems

Information infrastructure for science, education and culture

Support to knowledge and intercultural dialogue

Project of international development cooperation


From the COBISS System Concept to the
Regional Library Network
• The COBISS system was conceived in 1987 when the then
Association of the Yugoslav National Libraries accepted the concept
of shared cataloguing as the common basis of the library
information system and the system of scientific and technological
information of Yugoslavia; the role of the information and
bibliographic utility was taken over by the Institute of Information
Science (IZUM) from Maribor
• After the breakup of Yugoslavia, libraries (55) outside Slovenia
stopped participating in the shared cataloguing system, but almost all
of them have gradually renewed the cooperation with IZUM
• In 2003, the Agreement on the establishment of the COBISS.Net
network and the free exchange of bibliographic records, created in
autonomous library information systems of the participating countries,
was signed between IZUM and the national libraries from Bosnia and
Herzegovina, Macedonia, Montenegro, Serbia and Slovenia; in 2006,
the aforementioned Agreement was also signed by the Bulgarian
national library


COBISS.Net

Number of participating libraries
Slovenia 393
Serbia 117
Macedonia 43
Bosnia and Herzegovina 40
Montenegro 26
Bulgaria 1
Total (30 April 2010) 620


Exchange of bibliographic records
11 November 2004 – 10 May 2010

Downloaded Downloaded Downloaded Downloaded Downloaded
COBISS.Net from from from from from Total
COBIB.SI COBIB.SR COBIB.MK COBIB.CG COBIB.BH

COBISS.SI - 6,946 688 175 371 8,180

COBISS.SR 22,225 - 2,053 2,787 5,292 32,357

COBISS.MK 11,083 21,855 - 51 290 33,279

COBISS.CG 3,860 95,743 164 - 1,028 100,795

COBISS.BH 5,560 28,065 139 277 - 34,041

Total 42,728 152,609 3,044 3,290 6,981 208,652

Total saving: 100,000 working hours of cataloguers


UNESCO Workshop on
Organizing Information on Research Potentials and
Research Results
Maribor (Slovenia), 17 – 18 March 2006

Conclusions and Recommendations:
• (1) The transparency of the results of scientific work is a starting point
for organising information on research potentials and research
results. This is a prerequisite for it to positively affect not only the
state of mind and use of new knowledge but also the image of the
South Eastern European countries. Without it, it is impossible to
provide a thorough on-going evaluation of research results that
constitute the basis of an effective research policy.
• (4) The participating countries were offered the possibility to use
E-CRIS application developed by IZUM with the aim of setting up
national CRIS systems. In this regard, a special emphasis was laid on
the appropriateness of being linked to national library systems.


Current Research Information Systems
(10 May 2010)

Slovenia Serbia Macedonia Montenegro B&H Albania
No. of entities
SICRIS E-CRIS.SR E-CRIS.MK E-CRIS.CG E-CRIS.BH E-CRIS.AL

Research
818 150 78 24 78 8
organisations

Researchers 13,638 8,075 2,010 942 1,677 667

The E-CRIS systems in Serbia, Macedonia, Montenegro, Bosnia and Herzegovina
and Albania are still in a pilot stage.


www.cobiss.net


What Does IZUM Offer
within COBISS.Net?

• Proven organisational solutions and software support to set up
the national library information system and to automate library
functions

• Proven methodology and software to set up the national research
information system and to evaluate researchers' bibliographies

• Assistance in obtaining funds for development projects
(international support to development)


Development Aid of Slovenia
to Albanian Libraries in 2009

• Purchase of computer equipment for and setup of local area
networks in 10 public libraries, the Scientific Library of the
Polytechnic University of Tirana and one faculty library
• Purchase of literature for 10 public libraries and one faculty
library
• Financing of post-graduate study of librarianship at the
University in Ljubljana (17 students)
• Financing of travel costs for 50 participants of the COBISS
2009 Conference

EUR 372,700


Incentives for Further Cooperation

• To persuade the National Library of Albania to organise the
inclusion of Albanian libraries in COBISS.Net and to take over
the role of the National COBISS Centre

• To upgrade the Agreement on Cooperation in Developing the
Information Infrastructure to Support Research and Educational
Activities in Albania, signed in 2007 by the Ministry of Education
and Science of the Republic of Albania and IZUM

• To help the new Agency of Research, Technology and
Innovation upgrade the national research information system
E-CRIS.AL and implement the transparent evaluation system


Thank you for your attention!

SICRIS
&
E-CRIS

COBISS Web of Science


Cobiss.net regional network for supporting knowledge and evaluating research performance

Recommended

Recommended

More Related Content

More from UNESCO Venice Office

More from UNESCO Venice Office (20)

Recently uploaded

Recently uploaded (20)

Cobiss.net regional network for supporting knowledge and evaluating research performance