SlideShare une entreprise Scribd logo
1  sur  39
Télécharger pour lire hors ligne
Scientific and technical foundation for altmetrics in the US 
William Gunn, Ph.D. 
Head of Academic Outreach 
Mendeley 
@mrgunn 
https://orcid.org/0000-0002-3555-2054
Why altmetrics? 
http://www.stm-assoc.org/2009_10_13_MWC_STM_Report.pdf 
•978 data repositories 
•19 funder policies 
•16 data journals New forms of scholarship need new metrics.
Problems with Impact Factor
Country 
Documents 
Citable documents 
Citations 
Self- Citations 
Citations per Document 
H index 
United States 
7,063,329 
6,672,307 
129,540,193 
62,480,425 
20.45 
1,380 
China 
2,680,395 
2,655,272 
11,253,119 
6,127,507 
6.17 
385 
United Kingdom 
1,918,650 
1,763,766 
31,393,290 
7,513,112 
18.29 
851 
Germany 
1,782,920 
1,704,566 
25,848,738 
6,852,785 
16.16 
740 
Japan 
1,776,473 
1,734,289 
20,347,377 
6,073,934 
12.11 
635 
France 
1,283,370 
1,229,376 
17,870,597 
4,151,730 
15.6 
681 
Canada 
993,461 
946,493 
15,696,168 
3,050,504 
18.5 
658 
Italy 
959,688 
909,701 
12,719,572 
2,976,533 
15.26 
588 
Spain 
759,811 
715,452 
8,688,942 
2,212,008 
13.89 
476 
India 
750,777 
716,232 
4,528,302 
1,585,248 
7.99 
301 
Problems with Impact Factor
http://www.plosmedicine.org/article/info:doi/10.1371/journal.pmed.0030291 
Problems with Impact Factor 
During discussions with Thomson Scientific over which article types in PLoS Medicine the company deems as “citable,” it became clear that the process of determining a journal's impact factor is unscientific and arbitrary.”
The higher the impact factor, the more likely the research is to be retracted, partly due to intense competition. 
http://bjoern.brembs.net/news766.html.11 
What matters is who is reading your work! 
There is no correlation between the number a citations an article receives and the impact factor of the journal. http://www.bmj.com/content/314/7079/497.1.full
Adams, Jonathan. "Collaborations: the fourth age of research." Nature 497.7451 (2013): 557-560.
King, Christopher (2012) Thomson Reuters Annual Report 
http://ar.thomsonreuters.com/_files/pdf/MultiauthorPapers_ChrisKing.pdf
What are altmetrics? 
Research impacts more than authors
http://dx.doi.org/10.3789/isqv25no2.2013.04
Citations are slow
Research is fast
...and aggregates research data in the cloud 
Mendeley extracts research data… 
Install Mendeley Desktop 
Collecting rich signals 
from domain experts.
Home 
Work 
Mobile 
Cloud Library
Shared Folder
Mendeley Research Catalog
Mendeley Research Catalog
Read papers + keep track of notes 
470M documents
Taking some misery out of writing
Information Extraction
We are publishing this data to the LOD cloud 
http://code-research.eu/
Defining readership 
•Each document addition is a “read” 
•stamped with metadata describing the context of the read event 
•a read is like a citation, but faster and captures more
Professors on Mendeley tend to be in applied math, stats, and physics. 
Graduate students on Mendeley tend to be in engineering disciplines. 
http://dx.doi.org/10.6084/m9.figshare.1041819
Cell Biology and Neuroscience are highly active disciplines, relative to their output. 
Social sciences are highly active relative to their citations/paper 
http://dx.doi.org/10.6084/m9.figshare.1041819
Readership vs. citations 
•it comes with a payload of metadata 
•it accrues faster 
•it illuminates previously hidden impact
http://arxiv.org/html/1203.4745v1 
altmetrics show broader impact
http://www.asis.org/Bulletin/Apr-13/AprMay13_Lin_Fenner.html 
altmetrics show broader impact
Issues To Be Addressed 
•Identity 
•Privacy 
•Attribution 
•Gaming 
•Filtration 
standards/ 
best practice
Consistency is key 
http://www.niso.org/publications/isq/2013/v25no2/chamberlain/
NISO Altmetrics Standards 
Alfred P. Sloan Foundation 
American Library Association 
California Institute of Technology 
Center for Research Libraries 
EBSCO 
Elsevier 
Harvard 
Internet Archive 
Wiley 
Library and Information Technology Association 
Library of Congress 
Los Alamos National Laboratory 
National Institutes of Health 
National Library of Medicine 
OCLC 
Princeton 
Columbia 
Smithsonian 
Stanford 
…
NISO Altmetrics Standards 
•Types of sources: Mendeley, Twitter, Views, Downloads, Github 
•Quality of sources: collection, reporting, aggregation methods; provenance; availability 
•Use cases: discovery and assessment (of people and objects)
Types of sources 
Most altmetrics providers use the following: 
•Page views or downloads 
•Mendeley readers (articles only for now) 
•Tweets 
•Comments:Blog posts, Pubmed Commons 
•Github
Quality of sources 
Collection methods vary & counts are inconsistent. Further study is needed. 
For reporting, transparency is key. Show raw data, not just a derived number. 
Aggregation of raw data is generally done by the recipient (institution, funder, publisher, author, etc) according to their need, instead of using one central source.
Quality of sources 
Understanding and open reporting of provenance is important for community buy-in and long term stability. 
Raw data should be available under open license, via API, with identifiers. 
Identifiers include DOI:object, ORCID:person, ISNI/Ringgold: institution 
Ex. This person(ORCID), at this institution (ISNI), released this object (DOI).
Use cases 
Two main use cases exist: Discovery and Evaluation 
Because the data sources remain variable, discovery can be done now. Accuracy of numbers matters less in recommendation than in assessment. Precision important for both.
Next Steps 
•NISO white paper will be in public comment period soon. 
•Working Groups will be established to develop best practices and standards. 
•Pending approval, NISO will issue recommended practice or published standard. 
•NISO to develop training to implement and adopt any recommended standards.
Amgen: 47 of 53 “landmark” oncology publications could not be reproduced 
Bayer: 43 of 67 oncology & cardiovascular projects were based on contradictory results 
Dr. John Ioannidis: 432 publications purporting sex differences in hypertension, multiple sclerosis, or lung cancer. Only one data set was reproducible http://reproducibilityinitiative.org 
There is no gold standard
www.mendeley.com 
william.gunn@mendeley.com 
@mrgunn 
https://orcid.org/0000-0002-3555-2054

Contenu connexe

Tendances

U Maryland Connect: How Mendeley Illuminates a Broader Definition of Impact
U Maryland Connect: How Mendeley Illuminates a Broader Definition of ImpactU Maryland Connect: How Mendeley Illuminates a Broader Definition of Impact
U Maryland Connect: How Mendeley Illuminates a Broader Definition of ImpactWilliam Gunn
 
Social Network Analysis with NodeXL Part 1
Social Network Analysis with NodeXL Part 1Social Network Analysis with NodeXL Part 1
Social Network Analysis with NodeXL Part 1Dr Wasim Ahmed
 
OpenAIRE-COAR conference 2014: Next generation metrics of scholarly performa...
 OpenAIRE-COAR conference 2014: Next generation metrics of scholarly performa... OpenAIRE-COAR conference 2014: Next generation metrics of scholarly performa...
OpenAIRE-COAR conference 2014: Next generation metrics of scholarly performa...OpenAIRE
 
Social Media In Research
Social Media In ResearchSocial Media In Research
Social Media In ResearchMichelle Kraft
 
UKSG Conference 2017 Breakout - Advancing the Research Paper of the Future: c...
UKSG Conference 2017 Breakout - Advancing the Research Paper of the Future: c...UKSG Conference 2017 Breakout - Advancing the Research Paper of the Future: c...
UKSG Conference 2017 Breakout - Advancing the Research Paper of the Future: c...UKSG: connecting the knowledge community
 
THOR Workshop - Data Publishing Elsevier
THOR Workshop - Data Publishing ElsevierTHOR Workshop - Data Publishing Elsevier
THOR Workshop - Data Publishing ElsevierMaaike Duine
 
THOR Workshop - Introduction
THOR Workshop - IntroductionTHOR Workshop - Introduction
THOR Workshop - IntroductionMaaike Duine
 
Building a collaborative RDM community, research data network
Building a collaborative RDM community, research data networkBuilding a collaborative RDM community, research data network
Building a collaborative RDM community, research data networkJisc RDM
 
Noshir Contractor's view on the future of Linked Data
Noshir Contractor's view on the future of Linked DataNoshir Contractor's view on the future of Linked Data
Noshir Contractor's view on the future of Linked DataCarlos Pedrinaci
 
THOR Workshop - Data Publishing PLOS
THOR Workshop - Data Publishing PLOSTHOR Workshop - Data Publishing PLOS
THOR Workshop - Data Publishing PLOSMaaike Duine
 
THOR Workshop - Services PANGAEA
THOR Workshop - Services PANGAEATHOR Workshop - Services PANGAEA
THOR Workshop - Services PANGAEAMaaike Duine
 
THOR Workshop - Data Publishing
THOR Workshop - Data PublishingTHOR Workshop - Data Publishing
THOR Workshop - Data PublishingMaaike Duine
 
It is not just about open or closed, it is about control. - Mark Hahnel, Figs...
It is not just about open or closed, it is about control. - Mark Hahnel, Figs...It is not just about open or closed, it is about control. - Mark Hahnel, Figs...
It is not just about open or closed, it is about control. - Mark Hahnel, Figs...Repository Fringe
 
Next Generation Preprint Service
Next Generation Preprint ServiceNext Generation Preprint Service
Next Generation Preprint ServicePhilip Bourne
 
Open science and its advocacy
Open science and its advocacyOpen science and its advocacy
Open science and its advocacySarah Jones
 
Building a scalable, sustainable service with OJS
Building a scalable, sustainable service with OJSBuilding a scalable, sustainable service with OJS
Building a scalable, sustainable service with OJSBrian Hole
 
Open Science: Research Data Management
Open Science: Research Data ManagementOpen Science: Research Data Management
Open Science: Research Data ManagementLibrary_Connect
 
A Framework Concept for Profiling Researchers on Twitter using the Web of Data
A Framework Concept for Profiling Researchers on Twitter using the Web of DataA Framework Concept for Profiling Researchers on Twitter using the Web of Data
A Framework Concept for Profiling Researchers on Twitter using the Web of DataLaurens De Vocht
 
Research Information, Networking, and Collaboration - strategy and challenges
Research Information, Networking, and Collaboration - strategy and challengesResearch Information, Networking, and Collaboration - strategy and challenges
Research Information, Networking, and Collaboration - strategy and challengesLibrary_Connect
 

Tendances (20)

U Maryland Connect: How Mendeley Illuminates a Broader Definition of Impact
U Maryland Connect: How Mendeley Illuminates a Broader Definition of ImpactU Maryland Connect: How Mendeley Illuminates a Broader Definition of Impact
U Maryland Connect: How Mendeley Illuminates a Broader Definition of Impact
 
Social Network Analysis with NodeXL Part 1
Social Network Analysis with NodeXL Part 1Social Network Analysis with NodeXL Part 1
Social Network Analysis with NodeXL Part 1
 
OpenAIRE-COAR conference 2014: Next generation metrics of scholarly performa...
 OpenAIRE-COAR conference 2014: Next generation metrics of scholarly performa... OpenAIRE-COAR conference 2014: Next generation metrics of scholarly performa...
OpenAIRE-COAR conference 2014: Next generation metrics of scholarly performa...
 
Social Media In Research
Social Media In ResearchSocial Media In Research
Social Media In Research
 
UKSG Conference 2017 Breakout - Advancing the Research Paper of the Future: c...
UKSG Conference 2017 Breakout - Advancing the Research Paper of the Future: c...UKSG Conference 2017 Breakout - Advancing the Research Paper of the Future: c...
UKSG Conference 2017 Breakout - Advancing the Research Paper of the Future: c...
 
THOR Workshop - Data Publishing Elsevier
THOR Workshop - Data Publishing ElsevierTHOR Workshop - Data Publishing Elsevier
THOR Workshop - Data Publishing Elsevier
 
THOR Workshop - Introduction
THOR Workshop - IntroductionTHOR Workshop - Introduction
THOR Workshop - Introduction
 
Building a collaborative RDM community, research data network
Building a collaborative RDM community, research data networkBuilding a collaborative RDM community, research data network
Building a collaborative RDM community, research data network
 
Noshir Contractor's view on the future of Linked Data
Noshir Contractor's view on the future of Linked DataNoshir Contractor's view on the future of Linked Data
Noshir Contractor's view on the future of Linked Data
 
THOR Workshop - Data Publishing PLOS
THOR Workshop - Data Publishing PLOSTHOR Workshop - Data Publishing PLOS
THOR Workshop - Data Publishing PLOS
 
THOR Workshop - Services PANGAEA
THOR Workshop - Services PANGAEATHOR Workshop - Services PANGAEA
THOR Workshop - Services PANGAEA
 
THOR Workshop - Data Publishing
THOR Workshop - Data PublishingTHOR Workshop - Data Publishing
THOR Workshop - Data Publishing
 
It is not just about open or closed, it is about control. - Mark Hahnel, Figs...
It is not just about open or closed, it is about control. - Mark Hahnel, Figs...It is not just about open or closed, it is about control. - Mark Hahnel, Figs...
It is not just about open or closed, it is about control. - Mark Hahnel, Figs...
 
Next Generation Preprint Service
Next Generation Preprint ServiceNext Generation Preprint Service
Next Generation Preprint Service
 
Open science and its advocacy
Open science and its advocacyOpen science and its advocacy
Open science and its advocacy
 
NISO Virtual Conference Scientific Data Management: Caring for Your Instituti...
NISO Virtual Conference Scientific Data Management: Caring for Your Instituti...NISO Virtual Conference Scientific Data Management: Caring for Your Instituti...
NISO Virtual Conference Scientific Data Management: Caring for Your Instituti...
 
Building a scalable, sustainable service with OJS
Building a scalable, sustainable service with OJSBuilding a scalable, sustainable service with OJS
Building a scalable, sustainable service with OJS
 
Open Science: Research Data Management
Open Science: Research Data ManagementOpen Science: Research Data Management
Open Science: Research Data Management
 
A Framework Concept for Profiling Researchers on Twitter using the Web of Data
A Framework Concept for Profiling Researchers on Twitter using the Web of DataA Framework Concept for Profiling Researchers on Twitter using the Web of Data
A Framework Concept for Profiling Researchers on Twitter using the Web of Data
 
Research Information, Networking, and Collaboration - strategy and challenges
Research Information, Networking, and Collaboration - strategy and challengesResearch Information, Networking, and Collaboration - strategy and challenges
Research Information, Networking, and Collaboration - strategy and challenges
 

Similaire à Scientific and technical foundation for altmetrics in the US

Mendeley Data: Enhancing Data Discovery, Sharing and Reuse
Mendeley Data: Enhancing Data Discovery, Sharing and ReuseMendeley Data: Enhancing Data Discovery, Sharing and Reuse
Mendeley Data: Enhancing Data Discovery, Sharing and ReuseAnita de Waard
 
Why would a publisher care about open data?
Why would a publisher care about open data?Why would a publisher care about open data?
Why would a publisher care about open data?Anita de Waard
 
Human Genome and Big Data Challenges
Human Genome and Big Data ChallengesHuman Genome and Big Data Challenges
Human Genome and Big Data ChallengesPhilip Bourne
 
On community-standards, data curation and scholarly communication - BITS, Ita...
On community-standards, data curation and scholarly communication - BITS, Ita...On community-standards, data curation and scholarly communication - BITS, Ita...
On community-standards, data curation and scholarly communication - BITS, Ita...Susanna-Assunta Sansone
 
Managing and sharing data
Managing and sharing dataManaging and sharing data
Managing and sharing dataSarah Jones
 
Viva la revolution
Viva la revolutionViva la revolution
Viva la revolutionfigshare
 
RDM LIASA webinar
RDM LIASA webinarRDM LIASA webinar
RDM LIASA webinarSarah Jones
 
Meeting the Computational Challenges Associated with Human Health
Meeting the Computational Challenges Associated with Human HealthMeeting the Computational Challenges Associated with Human Health
Meeting the Computational Challenges Associated with Human HealthPhilip Bourne
 
Roadmaps, Roles and Re-engineering: Developing Data Informatics Capability in...
Roadmaps, Roles and Re-engineering: Developing Data Informatics Capability in...Roadmaps, Roles and Re-engineering: Developing Data Informatics Capability in...
Roadmaps, Roles and Re-engineering: Developing Data Informatics Capability in...LIBER Europe
 
PIDs, Data and Software: How Libraries Can Support Researchers in an Evolving...
PIDs, Data and Software: How Libraries Can Support Researchers in an Evolving...PIDs, Data and Software: How Libraries Can Support Researchers in an Evolving...
PIDs, Data and Software: How Libraries Can Support Researchers in an Evolving...Sarah Anna Stewart
 
Biomedical Research as an Open Digital Enterprise
Biomedical Research as an Open Digital EnterpriseBiomedical Research as an Open Digital Enterprise
Biomedical Research as an Open Digital EnterprisePhilip Bourne
 
Managing and sharing data
Managing and sharing dataManaging and sharing data
Managing and sharing dataSarah Jones
 
The NIH as a Digital Enterprise: Implications for PAG
The NIH as a Digital Enterprise: Implications for PAGThe NIH as a Digital Enterprise: Implications for PAG
The NIH as a Digital Enterprise: Implications for PAGPhilip Bourne
 
A Big Picture in Research Data Management
A Big Picture in Research Data ManagementA Big Picture in Research Data Management
A Big Picture in Research Data ManagementCarole Goble
 
STI 2022 - Generating large-scale network analyses of scientific landscapes i...
STI 2022 - Generating large-scale network analyses of scientific landscapes i...STI 2022 - Generating large-scale network analyses of scientific landscapes i...
STI 2022 - Generating large-scale network analyses of scientific landscapes i...Michele Pasin
 
Data Management and Horizon 2020
Data Management and Horizon 2020Data Management and Horizon 2020
Data Management and Horizon 2020Sarah Jones
 
Alain Frey Research Data for universities and information producers
Alain Frey Research Data for universities and information producersAlain Frey Research Data for universities and information producers
Alain Frey Research Data for universities and information producersIncisive_Events
 
UKSG Conference 2016 Breakout Session - Institutional insights: adopting new ...
UKSG Conference 2016 Breakout Session - Institutional insights: adopting new ...UKSG Conference 2016 Breakout Session - Institutional insights: adopting new ...
UKSG Conference 2016 Breakout Session - Institutional insights: adopting new ...UKSG: connecting the knowledge community
 

Similaire à Scientific and technical foundation for altmetrics in the US (20)

Mendeley Data: Enhancing Data Discovery, Sharing and Reuse
Mendeley Data: Enhancing Data Discovery, Sharing and ReuseMendeley Data: Enhancing Data Discovery, Sharing and Reuse
Mendeley Data: Enhancing Data Discovery, Sharing and Reuse
 
Intro to RDM
Intro to RDMIntro to RDM
Intro to RDM
 
AMIA 2014
AMIA 2014AMIA 2014
AMIA 2014
 
Why would a publisher care about open data?
Why would a publisher care about open data?Why would a publisher care about open data?
Why would a publisher care about open data?
 
Human Genome and Big Data Challenges
Human Genome and Big Data ChallengesHuman Genome and Big Data Challenges
Human Genome and Big Data Challenges
 
On community-standards, data curation and scholarly communication - BITS, Ita...
On community-standards, data curation and scholarly communication - BITS, Ita...On community-standards, data curation and scholarly communication - BITS, Ita...
On community-standards, data curation and scholarly communication - BITS, Ita...
 
Managing and sharing data
Managing and sharing dataManaging and sharing data
Managing and sharing data
 
Viva la revolution
Viva la revolutionViva la revolution
Viva la revolution
 
RDM LIASA webinar
RDM LIASA webinarRDM LIASA webinar
RDM LIASA webinar
 
Meeting the Computational Challenges Associated with Human Health
Meeting the Computational Challenges Associated with Human HealthMeeting the Computational Challenges Associated with Human Health
Meeting the Computational Challenges Associated with Human Health
 
Roadmaps, Roles and Re-engineering: Developing Data Informatics Capability in...
Roadmaps, Roles and Re-engineering: Developing Data Informatics Capability in...Roadmaps, Roles and Re-engineering: Developing Data Informatics Capability in...
Roadmaps, Roles and Re-engineering: Developing Data Informatics Capability in...
 
PIDs, Data and Software: How Libraries Can Support Researchers in an Evolving...
PIDs, Data and Software: How Libraries Can Support Researchers in an Evolving...PIDs, Data and Software: How Libraries Can Support Researchers in an Evolving...
PIDs, Data and Software: How Libraries Can Support Researchers in an Evolving...
 
Biomedical Research as an Open Digital Enterprise
Biomedical Research as an Open Digital EnterpriseBiomedical Research as an Open Digital Enterprise
Biomedical Research as an Open Digital Enterprise
 
Managing and sharing data
Managing and sharing dataManaging and sharing data
Managing and sharing data
 
The NIH as a Digital Enterprise: Implications for PAG
The NIH as a Digital Enterprise: Implications for PAGThe NIH as a Digital Enterprise: Implications for PAG
The NIH as a Digital Enterprise: Implications for PAG
 
A Big Picture in Research Data Management
A Big Picture in Research Data ManagementA Big Picture in Research Data Management
A Big Picture in Research Data Management
 
STI 2022 - Generating large-scale network analyses of scientific landscapes i...
STI 2022 - Generating large-scale network analyses of scientific landscapes i...STI 2022 - Generating large-scale network analyses of scientific landscapes i...
STI 2022 - Generating large-scale network analyses of scientific landscapes i...
 
Data Management and Horizon 2020
Data Management and Horizon 2020Data Management and Horizon 2020
Data Management and Horizon 2020
 
Alain Frey Research Data for universities and information producers
Alain Frey Research Data for universities and information producersAlain Frey Research Data for universities and information producers
Alain Frey Research Data for universities and information producers
 
UKSG Conference 2016 Breakout Session - Institutional insights: adopting new ...
UKSG Conference 2016 Breakout Session - Institutional insights: adopting new ...UKSG Conference 2016 Breakout Session - Institutional insights: adopting new ...
UKSG Conference 2016 Breakout Session - Institutional insights: adopting new ...
 

Plus de William Gunn

ASIST 2013 Panel: Altmetrics at Mendeley
ASIST 2013 Panel: Altmetrics at MendeleyASIST 2013 Panel: Altmetrics at Mendeley
ASIST 2013 Panel: Altmetrics at MendeleyWilliam Gunn
 
Code4lib 2012: Building Research Applications with Mendeley
Code4lib 2012: Building Research Applications with MendeleyCode4lib 2012: Building Research Applications with Mendeley
Code4lib 2012: Building Research Applications with MendeleyWilliam Gunn
 
Beyond Academia: Communicating your Work in Academia and Beyond
Beyond Academia: Communicating your Work in Academia and Beyond Beyond Academia: Communicating your Work in Academia and Beyond
Beyond Academia: Communicating your Work in Academia and Beyond William Gunn
 
Charleston 2013: The Social Side of Research
Charleston 2013: The Social Side of ResearchCharleston 2013: The Social Side of Research
Charleston 2013: The Social Side of ResearchWilliam Gunn
 
Science Online 2013: Data Visualization Using R
Science Online 2013: Data Visualization Using RScience Online 2013: Data Visualization Using R
Science Online 2013: Data Visualization Using RWilliam Gunn
 
ESIP FED Spring 2012: Evolving Networks of Expertise
ESIP FED Spring 2012: Evolving Networks of ExpertiseESIP FED Spring 2012: Evolving Networks of Expertise
ESIP FED Spring 2012: Evolving Networks of ExpertiseWilliam Gunn
 
Charleston 2012: Altmetrics: Analyzing the Value in Scholarly Content
Charleston 2012: Altmetrics: Analyzing the Value in Scholarly ContentCharleston 2012: Altmetrics: Analyzing the Value in Scholarly Content
Charleston 2012: Altmetrics: Analyzing the Value in Scholarly ContentWilliam Gunn
 
VIVO 2010 2010 Paper
VIVO 2010 2010 PaperVIVO 2010 2010 Paper
VIVO 2010 2010 PaperWilliam Gunn
 
Mendeley Open Repositories 2011 Paper
Mendeley Open Repositories 2011 PaperMendeley Open Repositories 2011 Paper
Mendeley Open Repositories 2011 PaperWilliam Gunn
 
Beyond the PDF 2011 Paper
Beyond the PDF 2011 PaperBeyond the PDF 2011 Paper
Beyond the PDF 2011 PaperWilliam Gunn
 
Connecting Researchers with Information - and Unlocking It!
Connecting Researchers with Information - and Unlocking It!Connecting Researchers with Information - and Unlocking It!
Connecting Researchers with Information - and Unlocking It!William Gunn
 
Sci Tech Forum LA 2013: New Directions in Scholarly Communication
Sci Tech Forum LA 2013: New Directions in Scholarly CommunicationSci Tech Forum LA 2013: New Directions in Scholarly Communication
Sci Tech Forum LA 2013: New Directions in Scholarly CommunicationWilliam Gunn
 
Open Science Summit 2011: It's Time We Changed How Science is Done
Open Science Summit 2011: It's Time We Changed How Science is DoneOpen Science Summit 2011: It's Time We Changed How Science is Done
Open Science Summit 2011: It's Time We Changed How Science is DoneWilliam Gunn
 
CNI Spring 2011: Connecting Researchers with Information - and Unlocking It!
CNI Spring 2011: Connecting Researchers with Information - and Unlocking It!CNI Spring 2011: Connecting Researchers with Information - and Unlocking It!
CNI Spring 2011: Connecting Researchers with Information - and Unlocking It!William Gunn
 
OA Week 2011: A Year of Progress
OA Week 2011: A Year of ProgressOA Week 2011: A Year of Progress
OA Week 2011: A Year of ProgressWilliam Gunn
 
OA Week 2011 UC Davis: Beyond the Impact Factor: Getting Your Research Notice...
OA Week 2011 UC Davis: Beyond the Impact Factor: Getting Your Research Notice...OA Week 2011 UC Davis: Beyond the Impact Factor: Getting Your Research Notice...
OA Week 2011 UC Davis: Beyond the Impact Factor: Getting Your Research Notice...William Gunn
 
OA Week 2012 Miami U: How Open Scholarship is Changing Research
OA Week 2012 Miami U: How Open Scholarship is Changing ResearchOA Week 2012 Miami U: How Open Scholarship is Changing Research
OA Week 2012 Miami U: How Open Scholarship is Changing ResearchWilliam Gunn
 
Internet Librarian 2011: Connecting Researchers to Information - and Unlockin...
Internet Librarian 2011: Connecting Researchers to Information - and Unlockin...Internet Librarian 2011: Connecting Researchers to Information - and Unlockin...
Internet Librarian 2011: Connecting Researchers to Information - and Unlockin...William Gunn
 
Open Data Bay Area: Interesting Problems in Academic Data
Open Data Bay Area: Interesting Problems in Academic DataOpen Data Bay Area: Interesting Problems in Academic Data
Open Data Bay Area: Interesting Problems in Academic DataWilliam Gunn
 

Plus de William Gunn (20)

ASIST 2013 Panel: Altmetrics at Mendeley
ASIST 2013 Panel: Altmetrics at MendeleyASIST 2013 Panel: Altmetrics at Mendeley
ASIST 2013 Panel: Altmetrics at Mendeley
 
Code4lib 2012: Building Research Applications with Mendeley
Code4lib 2012: Building Research Applications with MendeleyCode4lib 2012: Building Research Applications with Mendeley
Code4lib 2012: Building Research Applications with Mendeley
 
Beyond Academia: Communicating your Work in Academia and Beyond
Beyond Academia: Communicating your Work in Academia and Beyond Beyond Academia: Communicating your Work in Academia and Beyond
Beyond Academia: Communicating your Work in Academia and Beyond
 
Charleston 2013: The Social Side of Research
Charleston 2013: The Social Side of ResearchCharleston 2013: The Social Side of Research
Charleston 2013: The Social Side of Research
 
Science Online 2013: Data Visualization Using R
Science Online 2013: Data Visualization Using RScience Online 2013: Data Visualization Using R
Science Online 2013: Data Visualization Using R
 
ESIP FED Spring 2012: Evolving Networks of Expertise
ESIP FED Spring 2012: Evolving Networks of ExpertiseESIP FED Spring 2012: Evolving Networks of Expertise
ESIP FED Spring 2012: Evolving Networks of Expertise
 
Charleston 2012: Altmetrics: Analyzing the Value in Scholarly Content
Charleston 2012: Altmetrics: Analyzing the Value in Scholarly ContentCharleston 2012: Altmetrics: Analyzing the Value in Scholarly Content
Charleston 2012: Altmetrics: Analyzing the Value in Scholarly Content
 
VIVO 2010 2010 Paper
VIVO 2010 2010 PaperVIVO 2010 2010 Paper
VIVO 2010 2010 Paper
 
Mendeley Open Repositories 2011 Paper
Mendeley Open Repositories 2011 PaperMendeley Open Repositories 2011 Paper
Mendeley Open Repositories 2011 Paper
 
Beyond the PDF 2011 Paper
Beyond the PDF 2011 PaperBeyond the PDF 2011 Paper
Beyond the PDF 2011 Paper
 
Connecting Researchers with Information - and Unlocking It!
Connecting Researchers with Information - and Unlocking It!Connecting Researchers with Information - and Unlocking It!
Connecting Researchers with Information - and Unlocking It!
 
Sci Tech Forum LA 2013: New Directions in Scholarly Communication
Sci Tech Forum LA 2013: New Directions in Scholarly CommunicationSci Tech Forum LA 2013: New Directions in Scholarly Communication
Sci Tech Forum LA 2013: New Directions in Scholarly Communication
 
Open Science Summit 2011: It's Time We Changed How Science is Done
Open Science Summit 2011: It's Time We Changed How Science is DoneOpen Science Summit 2011: It's Time We Changed How Science is Done
Open Science Summit 2011: It's Time We Changed How Science is Done
 
VIVO 2011 Paper
VIVO 2011 PaperVIVO 2011 Paper
VIVO 2011 Paper
 
CNI Spring 2011: Connecting Researchers with Information - and Unlocking It!
CNI Spring 2011: Connecting Researchers with Information - and Unlocking It!CNI Spring 2011: Connecting Researchers with Information - and Unlocking It!
CNI Spring 2011: Connecting Researchers with Information - and Unlocking It!
 
OA Week 2011: A Year of Progress
OA Week 2011: A Year of ProgressOA Week 2011: A Year of Progress
OA Week 2011: A Year of Progress
 
OA Week 2011 UC Davis: Beyond the Impact Factor: Getting Your Research Notice...
OA Week 2011 UC Davis: Beyond the Impact Factor: Getting Your Research Notice...OA Week 2011 UC Davis: Beyond the Impact Factor: Getting Your Research Notice...
OA Week 2011 UC Davis: Beyond the Impact Factor: Getting Your Research Notice...
 
OA Week 2012 Miami U: How Open Scholarship is Changing Research
OA Week 2012 Miami U: How Open Scholarship is Changing ResearchOA Week 2012 Miami U: How Open Scholarship is Changing Research
OA Week 2012 Miami U: How Open Scholarship is Changing Research
 
Internet Librarian 2011: Connecting Researchers to Information - and Unlockin...
Internet Librarian 2011: Connecting Researchers to Information - and Unlockin...Internet Librarian 2011: Connecting Researchers to Information - and Unlockin...
Internet Librarian 2011: Connecting Researchers to Information - and Unlockin...
 
Open Data Bay Area: Interesting Problems in Academic Data
Open Data Bay Area: Interesting Problems in Academic DataOpen Data Bay Area: Interesting Problems in Academic Data
Open Data Bay Area: Interesting Problems in Academic Data
 

Dernier

GBSN - Biochemistry (Unit 1)
GBSN - Biochemistry (Unit 1)GBSN - Biochemistry (Unit 1)
GBSN - Biochemistry (Unit 1)Areesha Ahmad
 
Recombination DNA Technology (Nucleic Acid Hybridization )
Recombination DNA Technology (Nucleic Acid Hybridization )Recombination DNA Technology (Nucleic Acid Hybridization )
Recombination DNA Technology (Nucleic Acid Hybridization )aarthirajkumar25
 
VIRUSES structure and classification ppt by Dr.Prince C P
VIRUSES structure and classification ppt by Dr.Prince C PVIRUSES structure and classification ppt by Dr.Prince C P
VIRUSES structure and classification ppt by Dr.Prince C PPRINCE C P
 
Stunning ➥8448380779▻ Call Girls In Panchshil Enclave Delhi NCR
Stunning ➥8448380779▻ Call Girls In Panchshil Enclave Delhi NCRStunning ➥8448380779▻ Call Girls In Panchshil Enclave Delhi NCR
Stunning ➥8448380779▻ Call Girls In Panchshil Enclave Delhi NCRDelhi Call girls
 
fundamental of entomology all in one topics of entomology
fundamental of entomology all in one topics of entomologyfundamental of entomology all in one topics of entomology
fundamental of entomology all in one topics of entomologyDrAnita Sharma
 
❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.
❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.
❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.Nitya salvi
 
GBSN - Microbiology (Unit 2)
GBSN - Microbiology (Unit 2)GBSN - Microbiology (Unit 2)
GBSN - Microbiology (Unit 2)Areesha Ahmad
 
All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...
All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...
All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...Sérgio Sacani
 
GBSN - Microbiology (Unit 1)
GBSN - Microbiology (Unit 1)GBSN - Microbiology (Unit 1)
GBSN - Microbiology (Unit 1)Areesha Ahmad
 
Botany 4th semester file By Sumit Kumar yadav.pdf
Botany 4th semester file By Sumit Kumar yadav.pdfBotany 4th semester file By Sumit Kumar yadav.pdf
Botany 4th semester file By Sumit Kumar yadav.pdfSumit Kumar yadav
 
Nanoparticles synthesis and characterization​ ​
Nanoparticles synthesis and characterization​  ​Nanoparticles synthesis and characterization​  ​
Nanoparticles synthesis and characterization​ ​kaibalyasahoo82800
 
Natural Polymer Based Nanomaterials
Natural Polymer Based NanomaterialsNatural Polymer Based Nanomaterials
Natural Polymer Based NanomaterialsAArockiyaNisha
 
Animal Communication- Auditory and Visual.pptx
Animal Communication- Auditory and Visual.pptxAnimal Communication- Auditory and Visual.pptx
Animal Communication- Auditory and Visual.pptxUmerFayaz5
 
Unlocking the Potential: Deep dive into ocean of Ceramic Magnets.pptx
Unlocking  the Potential: Deep dive into ocean of Ceramic Magnets.pptxUnlocking  the Potential: Deep dive into ocean of Ceramic Magnets.pptx
Unlocking the Potential: Deep dive into ocean of Ceramic Magnets.pptxanandsmhk
 
Lucknow 💋 Russian Call Girls Lucknow Finest Escorts Service 8923113531 Availa...
Lucknow 💋 Russian Call Girls Lucknow Finest Escorts Service 8923113531 Availa...Lucknow 💋 Russian Call Girls Lucknow Finest Escorts Service 8923113531 Availa...
Lucknow 💋 Russian Call Girls Lucknow Finest Escorts Service 8923113531 Availa...anilsa9823
 
Botany 4th semester series (krishna).pdf
Botany 4th semester series (krishna).pdfBotany 4th semester series (krishna).pdf
Botany 4th semester series (krishna).pdfSumit Kumar yadav
 
Botany krishna series 2nd semester Only Mcq type questions
Botany krishna series 2nd semester Only Mcq type questionsBotany krishna series 2nd semester Only Mcq type questions
Botany krishna series 2nd semester Only Mcq type questionsSumit Kumar yadav
 
Green chemistry and Sustainable development.pptx
Green chemistry  and Sustainable development.pptxGreen chemistry  and Sustainable development.pptx
Green chemistry and Sustainable development.pptxRajatChauhan518211
 
Spermiogenesis or Spermateleosis or metamorphosis of spermatid
Spermiogenesis or Spermateleosis or metamorphosis of spermatidSpermiogenesis or Spermateleosis or metamorphosis of spermatid
Spermiogenesis or Spermateleosis or metamorphosis of spermatidSarthak Sekhar Mondal
 
TEST BANK For Radiologic Science for Technologists, 12th Edition by Stewart C...
TEST BANK For Radiologic Science for Technologists, 12th Edition by Stewart C...TEST BANK For Radiologic Science for Technologists, 12th Edition by Stewart C...
TEST BANK For Radiologic Science for Technologists, 12th Edition by Stewart C...ssifa0344
 

Dernier (20)

GBSN - Biochemistry (Unit 1)
GBSN - Biochemistry (Unit 1)GBSN - Biochemistry (Unit 1)
GBSN - Biochemistry (Unit 1)
 
Recombination DNA Technology (Nucleic Acid Hybridization )
Recombination DNA Technology (Nucleic Acid Hybridization )Recombination DNA Technology (Nucleic Acid Hybridization )
Recombination DNA Technology (Nucleic Acid Hybridization )
 
VIRUSES structure and classification ppt by Dr.Prince C P
VIRUSES structure and classification ppt by Dr.Prince C PVIRUSES structure and classification ppt by Dr.Prince C P
VIRUSES structure and classification ppt by Dr.Prince C P
 
Stunning ➥8448380779▻ Call Girls In Panchshil Enclave Delhi NCR
Stunning ➥8448380779▻ Call Girls In Panchshil Enclave Delhi NCRStunning ➥8448380779▻ Call Girls In Panchshil Enclave Delhi NCR
Stunning ➥8448380779▻ Call Girls In Panchshil Enclave Delhi NCR
 
fundamental of entomology all in one topics of entomology
fundamental of entomology all in one topics of entomologyfundamental of entomology all in one topics of entomology
fundamental of entomology all in one topics of entomology
 
❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.
❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.
❤Jammu Kashmir Call Girls 8617697112 Personal Whatsapp Number 💦✅.
 
GBSN - Microbiology (Unit 2)
GBSN - Microbiology (Unit 2)GBSN - Microbiology (Unit 2)
GBSN - Microbiology (Unit 2)
 
All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...
All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...
All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...
 
GBSN - Microbiology (Unit 1)
GBSN - Microbiology (Unit 1)GBSN - Microbiology (Unit 1)
GBSN - Microbiology (Unit 1)
 
Botany 4th semester file By Sumit Kumar yadav.pdf
Botany 4th semester file By Sumit Kumar yadav.pdfBotany 4th semester file By Sumit Kumar yadav.pdf
Botany 4th semester file By Sumit Kumar yadav.pdf
 
Nanoparticles synthesis and characterization​ ​
Nanoparticles synthesis and characterization​  ​Nanoparticles synthesis and characterization​  ​
Nanoparticles synthesis and characterization​ ​
 
Natural Polymer Based Nanomaterials
Natural Polymer Based NanomaterialsNatural Polymer Based Nanomaterials
Natural Polymer Based Nanomaterials
 
Animal Communication- Auditory and Visual.pptx
Animal Communication- Auditory and Visual.pptxAnimal Communication- Auditory and Visual.pptx
Animal Communication- Auditory and Visual.pptx
 
Unlocking the Potential: Deep dive into ocean of Ceramic Magnets.pptx
Unlocking  the Potential: Deep dive into ocean of Ceramic Magnets.pptxUnlocking  the Potential: Deep dive into ocean of Ceramic Magnets.pptx
Unlocking the Potential: Deep dive into ocean of Ceramic Magnets.pptx
 
Lucknow 💋 Russian Call Girls Lucknow Finest Escorts Service 8923113531 Availa...
Lucknow 💋 Russian Call Girls Lucknow Finest Escorts Service 8923113531 Availa...Lucknow 💋 Russian Call Girls Lucknow Finest Escorts Service 8923113531 Availa...
Lucknow 💋 Russian Call Girls Lucknow Finest Escorts Service 8923113531 Availa...
 
Botany 4th semester series (krishna).pdf
Botany 4th semester series (krishna).pdfBotany 4th semester series (krishna).pdf
Botany 4th semester series (krishna).pdf
 
Botany krishna series 2nd semester Only Mcq type questions
Botany krishna series 2nd semester Only Mcq type questionsBotany krishna series 2nd semester Only Mcq type questions
Botany krishna series 2nd semester Only Mcq type questions
 
Green chemistry and Sustainable development.pptx
Green chemistry  and Sustainable development.pptxGreen chemistry  and Sustainable development.pptx
Green chemistry and Sustainable development.pptx
 
Spermiogenesis or Spermateleosis or metamorphosis of spermatid
Spermiogenesis or Spermateleosis or metamorphosis of spermatidSpermiogenesis or Spermateleosis or metamorphosis of spermatid
Spermiogenesis or Spermateleosis or metamorphosis of spermatid
 
TEST BANK For Radiologic Science for Technologists, 12th Edition by Stewart C...
TEST BANK For Radiologic Science for Technologists, 12th Edition by Stewart C...TEST BANK For Radiologic Science for Technologists, 12th Edition by Stewart C...
TEST BANK For Radiologic Science for Technologists, 12th Edition by Stewart C...
 

Scientific and technical foundation for altmetrics in the US

  • 1. Scientific and technical foundation for altmetrics in the US William Gunn, Ph.D. Head of Academic Outreach Mendeley @mrgunn https://orcid.org/0000-0002-3555-2054
  • 2. Why altmetrics? http://www.stm-assoc.org/2009_10_13_MWC_STM_Report.pdf •978 data repositories •19 funder policies •16 data journals New forms of scholarship need new metrics.
  • 4. Country Documents Citable documents Citations Self- Citations Citations per Document H index United States 7,063,329 6,672,307 129,540,193 62,480,425 20.45 1,380 China 2,680,395 2,655,272 11,253,119 6,127,507 6.17 385 United Kingdom 1,918,650 1,763,766 31,393,290 7,513,112 18.29 851 Germany 1,782,920 1,704,566 25,848,738 6,852,785 16.16 740 Japan 1,776,473 1,734,289 20,347,377 6,073,934 12.11 635 France 1,283,370 1,229,376 17,870,597 4,151,730 15.6 681 Canada 993,461 946,493 15,696,168 3,050,504 18.5 658 Italy 959,688 909,701 12,719,572 2,976,533 15.26 588 Spain 759,811 715,452 8,688,942 2,212,008 13.89 476 India 750,777 716,232 4,528,302 1,585,248 7.99 301 Problems with Impact Factor
  • 5. http://www.plosmedicine.org/article/info:doi/10.1371/journal.pmed.0030291 Problems with Impact Factor During discussions with Thomson Scientific over which article types in PLoS Medicine the company deems as “citable,” it became clear that the process of determining a journal's impact factor is unscientific and arbitrary.”
  • 6. The higher the impact factor, the more likely the research is to be retracted, partly due to intense competition. http://bjoern.brembs.net/news766.html.11 What matters is who is reading your work! There is no correlation between the number a citations an article receives and the impact factor of the journal. http://www.bmj.com/content/314/7079/497.1.full
  • 7. Adams, Jonathan. "Collaborations: the fourth age of research." Nature 497.7451 (2013): 557-560.
  • 8. King, Christopher (2012) Thomson Reuters Annual Report http://ar.thomsonreuters.com/_files/pdf/MultiauthorPapers_ChrisKing.pdf
  • 9. What are altmetrics? Research impacts more than authors
  • 13. ...and aggregates research data in the cloud Mendeley extracts research data… Install Mendeley Desktop Collecting rich signals from domain experts.
  • 14. Home Work Mobile Cloud Library
  • 18. Read papers + keep track of notes 470M documents
  • 19. Taking some misery out of writing
  • 21. We are publishing this data to the LOD cloud http://code-research.eu/
  • 22. Defining readership •Each document addition is a “read” •stamped with metadata describing the context of the read event •a read is like a citation, but faster and captures more
  • 23. Professors on Mendeley tend to be in applied math, stats, and physics. Graduate students on Mendeley tend to be in engineering disciplines. http://dx.doi.org/10.6084/m9.figshare.1041819
  • 24. Cell Biology and Neuroscience are highly active disciplines, relative to their output. Social sciences are highly active relative to their citations/paper http://dx.doi.org/10.6084/m9.figshare.1041819
  • 25.
  • 26. Readership vs. citations •it comes with a payload of metadata •it accrues faster •it illuminates previously hidden impact
  • 29. Issues To Be Addressed •Identity •Privacy •Attribution •Gaming •Filtration standards/ best practice
  • 30. Consistency is key http://www.niso.org/publications/isq/2013/v25no2/chamberlain/
  • 31. NISO Altmetrics Standards Alfred P. Sloan Foundation American Library Association California Institute of Technology Center for Research Libraries EBSCO Elsevier Harvard Internet Archive Wiley Library and Information Technology Association Library of Congress Los Alamos National Laboratory National Institutes of Health National Library of Medicine OCLC Princeton Columbia Smithsonian Stanford …
  • 32. NISO Altmetrics Standards •Types of sources: Mendeley, Twitter, Views, Downloads, Github •Quality of sources: collection, reporting, aggregation methods; provenance; availability •Use cases: discovery and assessment (of people and objects)
  • 33. Types of sources Most altmetrics providers use the following: •Page views or downloads •Mendeley readers (articles only for now) •Tweets •Comments:Blog posts, Pubmed Commons •Github
  • 34. Quality of sources Collection methods vary & counts are inconsistent. Further study is needed. For reporting, transparency is key. Show raw data, not just a derived number. Aggregation of raw data is generally done by the recipient (institution, funder, publisher, author, etc) according to their need, instead of using one central source.
  • 35. Quality of sources Understanding and open reporting of provenance is important for community buy-in and long term stability. Raw data should be available under open license, via API, with identifiers. Identifiers include DOI:object, ORCID:person, ISNI/Ringgold: institution Ex. This person(ORCID), at this institution (ISNI), released this object (DOI).
  • 36. Use cases Two main use cases exist: Discovery and Evaluation Because the data sources remain variable, discovery can be done now. Accuracy of numbers matters less in recommendation than in assessment. Precision important for both.
  • 37. Next Steps •NISO white paper will be in public comment period soon. •Working Groups will be established to develop best practices and standards. •Pending approval, NISO will issue recommended practice or published standard. •NISO to develop training to implement and adopt any recommended standards.
  • 38. Amgen: 47 of 53 “landmark” oncology publications could not be reproduced Bayer: 43 of 67 oncology & cardiovascular projects were based on contradictory results Dr. John Ioannidis: 432 publications purporting sex differences in hypertension, multiple sclerosis, or lung cancer. Only one data set was reproducible http://reproducibilityinitiative.org There is no gold standard
  • 39. www.mendeley.com william.gunn@mendeley.com @mrgunn https://orcid.org/0000-0002-3555-2054