The document summarizes the evaluation process of open access resources at Middle East Technical University Library. It discusses determining evaluation criteria, which involved analyzing current practices, reviewing literature, and contacting other institutions. General criteria include supporting research areas and usability. More specific criteria evaluate presentation, relevance, objectivity, sources, timeliness, and editorial boards. The goals are to finalize an evaluation report and obtain feedback to develop a process for selecting and providing access to quality open access resources.

1. Evaluation of Open Access (OA) Resources:
METU Case Study
Dr. Burcu Bulut, Middle East Technical University Library
Emre Hasan Akbayrak, Middle East Technical University Library
4th Annual Meeting of COAR May 7-8, 2013, Özyeğin University Library, Istanbul, Turkey

2. Overview
 OA Trend Topics
 Goals
 Focuses
 Evaluation of OA Resources
4th Annual Meeting of COAR May 7-8, 2013, Özyeğin University Library, Istanbul, Turkey

3. OA Trend Topics
 Linking publications to data and funding
schemes
 Big Data
 Interoperability
 Semantic Web
 Complementary platforms
 Open educational resources
 Open data management,…
4th Annual Meeting of COAR May 7-8, 2013, Özyeğin University Library, Istanbul, Turkey

4. Goals of The Presentation
 To share the METU experiences on
process of adding to the collection
development policy of the open access
resources
 To obtain the views and
recommendations of the participants with
feedback during/after the presentation in
order to finalize the OA resource
evaluation/selection criteria report
4th Annual Meeting of COAR May 7-8, 2013, Özyeğin University Library, Istanbul, Turkey

5. Why we prefer collection
development issues ?
4th Annual Meeting of COAR May 7-8, 2013, Özyeğin University Library, Istanbul, Turkey

6. Because, we need to think
as a whole and get
connected
4th Annual Meeting of COAR May 7-8, 2013, Özyeğin University Library, Istanbul, Turkey

7. Therefore We Focused On
 Thinking multi-directional
 Reviewing the scholarly communication
process
 Restructuring services offered to
information users
…as well as infrastructural and technical
issues.
4th Annual Meeting of COAR May 7-8, 2013, Özyeğin University Library, Istanbul, Turkey

8. It Is Necessary
 To determine and apply methods to
ensure OA to the scientific production of
institutions and related data sets without
limitation
but also,
 To consider in detail the OA resources
provided to information users within the
scope of collection development policies
4th Annual Meeting of COAR May 7-8, 2013, Özyeğin University Library, Istanbul, Turkey

9. Why It Is Necessary?
 Increasing number of OA resources
 OA collections of multiple formats
 Various data sharing services, policies,
regulations,…
4th Annual Meeting of COAR May 7-8, 2013, Özyeğin University Library, Istanbul, Turkey

10. Evaluation Process of OA
Resources
1. Current situation analysis
2. Determination of evaluation/selection
criteria
3. Deciding the form of OA resource sharing
on the web
4. Evaluation of the existing and new OA
resources and creation of resource
recommendation lists
5. Sharing identified resources on the web as
decided on
4th Annual Meeting of COAR May 7-8, 2013, Özyeğin University Library, Istanbul, Turkey

11. Determination of
Evaluation/Selection Criteria 1
 The longest period has been allocated
to the this stage
 There are no current report or guides
prepared by institutions/organizations
that are well-known in the area
4th Annual Meeting of COAR May 7-8, 2013, Özyeğin University Library, Istanbul, Turkey

12.  University web pages have been
examined
 Literature reviews have been accessed
as much as possible
 Contact has been made with groups and
individuals working on OA
4th Annual Meeting of COAR May 7-8, 2013, Özyeğin University Library, Istanbul, Turkey
Determination of
Evaluation/Selection Criteria 2

13. Determination of
Evaluation/Selection Criteria 3
 The general definition and policies
regarding OA
 Resources, general and detailed evaluation
sections
 After completion of the preliminary study,
we intend to group the criteria as relates to
the resource type, publishers and then
expand them.
4th Annual Meeting of COAR May 7-8, 2013, Özyeğin University Library, Istanbul, Turkey

14. OA Resource Definition
 These are resources presented to the
access of the users without any financial
or legal barriers (some resources may
only have opened some content as in
journals or may require registration)
…details will be listed at the final report
4th Annual Meeting of COAR May 7-8, 2013, Özyeğin University Library, Istanbul, Turkey

15. Policies 1
 Scientific OA resources (e.g. peer-
reviewed journals) are suitable for
evaluation
 Proposals made by the librarians take
priority regarding the resources to be
evaluated
 Suggestions can also be collected from
users but approval of the librarians is
required
4th Annual Meeting of COAR May 7-8, 2013, Özyeğin University Library, Istanbul, Turkey

16. Policies 2
 The journals to be evaluated should be
part of the main topic indexes.
 OA resources other than journals
(databases, collections of monographs,
websites, maps, image collections, etc.)
are also suitable for the evaluation
4th Annual Meeting of COAR May 7-8, 2013, Özyeğin University Library, Istanbul, Turkey

17. Evaluation Criteria (General)
 Does the resource support university's
research and educational areas?
 Is the resource being produced or
supported by respected authorities or
organizations in their field?
 Is the resource being published on a
regular basis and reliable?
4th Annual Meeting of COAR May 7-8, 2013, Özyeğin University Library, Istanbul, Turkey

18. Evaluation Criteria (General)
 Is the resource's interface easy to use?
 Does the use of the resource require a
special technology (a special application,
a custom font, etc.)?
4th Annual Meeting of COAR May 7-8, 2013, Özyeğin University Library, Istanbul, Turkey

19. Evaluation Criteria (Detailed)
Performed under the headings of:
 Presentation
 Relevance
 Objectivity
 Method
 Source
 Timeliness
 Editor and editorial board
4th Annual Meeting of COAR May 7-8, 2013, Özyeğin University Library, Istanbul, Turkey

20. Evaluation Criteria (Detailed)
Presentation:
 Language and writing style
 Structure
 Layout
 Integrity…
4th Annual Meeting of COAR May 7-8, 2013, Özyeğin University Library, Istanbul, Turkey

21. Evaluation Criteria (Detailed)
Relevance:
 Academic
 Topical
 Geographical
 Project based
4th Annual Meeting of COAR May 7-8, 2013, Özyeğin University Library, Istanbul, Turkey

22. Evaluation Criteria (Detailed)
Objectivity:
 Perspective
 Opinion
 Sponsorhip…
4th Annual Meeting of COAR May 7-8, 2013, Özyeğin University Library, Istanbul, Turkey

23. Evaluation Criteria (Detailed)
Method:
 The way of information produced:
 Research Reports
 How was the study carried out?
 Literature Reviews
 Is the review covering all known literature?
4th Annual Meeting of COAR May 7-8, 2013, Özyeğin University Library, Istanbul, Turkey

24. Evaluation Criteria (Detailed)
Source:
 Author details
 Organisations
 Publications…
4th Annual Meeting of COAR May 7-8, 2013, Özyeğin University Library, Istanbul, Turkey

25. Evaluation Criteria (Detailed)
Timeliness:
 Date
 Currency
4th Annual Meeting of COAR May 7-8, 2013, Özyeğin University Library, Istanbul, Turkey

26. Evaluation Criteria (Detailed)
Editor and editorial board
 Formal editorial/review board
 Academic information regarding to the
editor and editorial board
 Sufficient number of board members…
4th Annual Meeting of COAR May 7-8, 2013, Özyeğin University Library, Istanbul, Turkey

27. Questions in Mind
 How to manage open access budget?
 Where to evaluate OA resources within a
catalog or e-resource management tools?
4th Annual Meeting of COAR May 7-8, 2013, Özyeğin University Library, Istanbul, Turkey

28. References (Selected List)
 Open Access Resources at the UC Libraries:
http://www.cdlib.org/services/collections/openaccess.html
 Open Access Information Resources: How We Evaluate
Sites for Inclusion:
http://www.open.ac.uk/libraryservices/pages/oair/?id=20
 Open Access Scholarly Publishers Association, Code of
Conduct http://oaspa.org/membership/code-of-conduct/
 Scholarly Open Access: Critical Analysis of Scholarly
Open-Access Publishing:
http://scholarlyoa.com/2012/11/30/criteria-for-
determining-predatory-open-access-publishers-2nd-
edition/
4th Annual Meeting of COAR May 7-8, 2013, Özyeğin University Library, Istanbul, Turkey

29. References (Selected List)
 Mullen, L. B. (2010). Open access and its practical impact
on the work of academic librarians : collection
development, public services, and the library and
information science literature . Oxford: Chandos Pub.
 Mullen, L. B. (2011). Open access and collection
develpment in academic libraries; digitization to
discovery. IFLA Satellite Conference: Acquisition and
Collection Develeopment Section. University of the Virgin
Islands.
 DOAJ Selection Criteria:
http://www.doaj.org/doaj?func=loadTempl&templ=about
#criteria
 Open Access Scholarly Publishers Association, Code of
Counduct: http://oaspa.org/membership/code-of-
conduct/
4th Annual Meeting of COAR May 7-8, 2013, Özyeğin University Library, Istanbul, Turkey

30. Thank you for your attention!
Please share your feedback
and opinions!
Dr. Burcu Bulut
bketen@metu.edu.tr
Emre Hasan Akbayrak
akbayrak@metu.edu.tr
4th Annual Meeting of COAR May 7-8, 2013, Özyeğin University Library, Istanbul, Turkey