A Discussion of Research Metrics - June 2016
Kim Powel, Life Sciences Informationist Emory University
Holly Miller, Associate Dean Scholarly Content and Faculty Engagement, Florida International University
Joey Figueroa, Solutions Specialist Thomson Reuters
The Evolving Role of the Library in Institutional and Faculty Assessment
1. ALA ANNUAL MEETING
June 2016
The Evolving Role of the
Library in Institutional and
Faculty Assessment
A Discussion of Research
Metrics
Kim Powel, Life Sciences Informationist Emory University
Holly Miller, Associate Dean Scholarly Content and Faculty Engagement, Florida International
University
Joey Figueroa, Solutions Specialist Thomson Reuters
2. 2
—
THE ROLE OF THE LIBRARY HAS BEEN CHANGING…FOR
OVER 50 YEARS, NOW.
—
2005
Library 2.0
“Next Gen” OPACs
Make library
resources more
like Google
1970-80’s
Card catalogs
come online
2000
Google
Institutional
repositories
2008
NIH Public
Access Policy
Requires
scientists to
submit final peer-
reviewed journal
manuscripts
to PubMed
Central
2011
NSF Data
Management
Plan
Proposals
submitted to
NSF must
include a DMP
2002-3
Rise of
Open
Access
1994
Digital Library
Initiative (NSF)
Digital Library
Federation
Data repositories
2010
ACRL’s Value
of Academic
Libraries Initiative
2013
3. 3
—
A NEED TO PROVE LIBRARY VALUE AS ACADEMIA
BECOMES INCREASINGLY CORPORATIZED
Academic libraries
need to explain their
“value proposition.”
Public support for
Higher Education is
DECLINING
Funding pressures &
cost concerns are
RISING
+ =
—
4. 4
—
INDUSTRY TRENDS ACROSS ACADEMIA
Funding pressures
Efforts at objective approaches to allocation of credit
Reputation management & demonstration of achievement
Global competition in the Sciences – BIG SCIENCE
Changing nature of scholarly journal publishing
5. —
“Bibliometrics is an ideal field for academic librarians to
develop and provide innovative services for both academic
and administrative university staff. In so doing, librarians
make sure to take an active part in the development of new
strategies and in fostering innovation. Qualitative
processes like peer-review need to be validated and are
therefore increasingly complemented by quantitative
methods like bibliometrics. Librarians are predestined to
fill this role and strengthen their on-campus position.”
Gumpenberger, C., Wieland, M. & Gorraiz, J. (2012). Bibliometric practices and activities at the University
of Vienna. Library Management, 33(3), 174 – 183.
10. Impact of Fellowship Publications
• Identify Publications in Web of Science
• Send to InCites
• 106 Publications, 1981-Present
11. Top Journals
By Number Documents
• Am J Obstet Gynecol
• Obstet Gynecol
• J Reprod Med
By Journal Impact Factor
• JAMA
• Blood
• Obstet Gynecol
12. Top Journals
By Journal Normalized Citation Impact
• J Assist Reprod Gen
• Southern Medical Journal
• PLOS ONE
• J Reprod Med
• Matern Child Health J
13. Top Research Areas
By Number of Web of Science
Documents
• Obstetrics & Gynecology
• Reproductive Biology
By Category Normalized Citation
Impact
• Genetics & Heredity
• Public, Environmental &
Occupational Health
17. LIBRARY’S ROLE IN ASSESSMENT
AT FLORIDA TECH
Holly Miller
Asst. Dean Scholarly Content & Faculty Engagement
Florida Institute of Technology
18. ABOUT ME
Biochemist - Curious about Information
Librarian
Library Director
Associate Director Center for Library
and Informatics
Assistant Dean for Scholarly Content &
Faculty Engagement
19. NEW ROLES FOR LIBRARIES
Data management services
Promotion of research and
scholarship
Assessment
30. TYPES OF INFORMATION
REQUESTED
Peer comparisons – overall and by
department
Top researchers
Top research areas
Percent International Collaborations
38. COMPLICATIONS
Researcher profiles
Not all articles in Web of Science
Educating faculty and administration
Faculty resistance to being
‘measured’
41. ALA ANNUAL MEETING
June 2016
The Evolving Role of the
Library in Institutional and
Faculty Assessment
A Discussion of Research
Metrics
Kim Powel, Life Sciences Informationist Emory University
Holly Miller, Associate Dean Scholarly Content and Faculty Engagement, Florida International
University
Joey Figueroa, Solutions Specialist Thomson Reuters
Notes de l'éditeur
Emory Gyn/OB very proud of unique resident research program. First in the country to require research of their residents, many which have lead to formal publications. 2016 celebrates 50 years of the fully supported resident research program. Inviting back alumni and wanted a way to highlight the success of their research and publication efforts.
Presented some challenges; comparison over time. department had tracked publications. With InCites 2.0 can build collection of articles in Web of Science to send into InCites for futher analysis and quick visualizations. InCites only goes back to 1980, but department was excited enough that they would manually add in the missing 13 years (1966- 1979).
Most common analysis is document count and journal impact factor.
Journal of Assisted Reproduction and Genetics
Incites offers unique metric of Journal Normalized Citation Impact. How the publication compares to other articles published in that journal at the same time. A Relative impact that gets around the subject and time bias of Impact factor.
Ocean color images from http://disc.sci.gsfc.nasa.gov/oceancolor/additional/science-focus/ocean-color/science_focus.shtml/nab.shtml
showing the progression of the North Atlantic Bloom during the spring and early summer months in the Northern Hemisphere.
Ocean color images from http://disc.sci.gsfc.nasa.gov/oceancolor/additional/science-focus/ocean-color/science_focus.shtml/nab.shtml
showing the progression of the North Atlantic Bloom during the spring and early summer months in the Northern Hemisphere.
Number of Publications, Top Performers, Time period 2005-2015 – remove graduate students
Normalized Citation Impact, Top Performers, Time period 2005-2015 – remove graduate students
FIT Citation Impact vs. Other Techs (Rensselaer Polytechnic Institute, Worcester Polytechnic Institute, Stevens Institute of Technology, and NJ Institute of Technology)
FIT Engineering Citation Impact vs. Other Techs (RPI, WPI, and Illinois Institute of Technology)
FIT Biology Citation Impact vs. Other Techs (University of South Alabama, Northeastern University)
FIT Physics/Space Sciences Citation Impact vs. Other Techs (RPI, WPI, and IIT)
Normalized Citation Impact Overall – comparing FIT to USA and Global baselines
% International Collaborations – comparing FIT to USA and Global baselines