SlideShare a Scribd company logo
1 of 30
Altmetrics:
building a broader picture of
impact
Paul Groth @pgroth

Web & Media Group
Department of Computer Science
The Network Institute
VU University Amsterdam
http://www.few.vu.nl/~pgroth

#APE2014
Research Project Grants
Applications, awards, and success rates

NIH Data Book – (http://report.nih.gov/ndb/index.aspx)

Data provided by the Division of Information Services, Reporting Branch
"Outside letters basically trump
everything," says Robert Simoni,
chairman of the biology
department at Stanford University
in California.

Metrics: Do metrics matter?
Nature 2010
http://doi.org/10.1038/465860a
―Imagine how the academic appointment process
might change if search and review committees had
access—within an appropriately tagged or linked
online CV, for example, or via the ORCID system—
to information about the specific contributions
made by a candidate to each of his/her works,
including contributions that might not otherwise have
qualified for ‗authorship‘ status?‖

Point of view: Faculty appointments and the record of
scholarship
Amy Brand
http://dx.doi.org/10.7554/eLife.00452
Point of view: Faculty appointments and the record of scholarship
Amy Brand
http://dx.doi.org/10.7554/eLife.00452

Opportunities
• Individuals and institutions need better tools
for curating and networking their own record
of scholarship
• Institutions need more information about
scholarly contribution
• ALMs that reliably differentiate sources of
input (general; academic; expert; etc.) would
be more useful‖
Slide 3: http://article-level-metrics.plos.org/files/2013/10/Brand.pptx
ENTER ALTMETRICS
Altmetrics is the study and use of scholarly
impact measures based on activity in online
tools and environments.

http://doi.org/10.1371/journal.pone.0048753
http://blog.peerj.com/post/65345738206/changing-the-currency-of-science-to-solve-our-greatest
Thanks Ian Mulvany
ALTMETRICS AS MEASURES
OF IMPACT?
―It took approximately a generation (20
years) for bibliographic citation analysis to
achieve acceptability as a measure of
academic impact."
(Vaughan and Shaw,
2003)
(Birkholtz et al. 2013)

(Fausto et al 2012)

http://jasonpriem.org/self-archived/5uni-poster.png

The Research is Happening

http://ploscollections.org/altmetrics
http://asis.org/Bulletin/Apr-13/AprMay13_Piwowar.html
http://www.cwts.nl/pdf/CWTS-WP-2013-003.pdf
http://www.slideshare.net/paulwouters1/issi2013-wg-pw
Bottom Line: use altmetrics as
evidence in a larger story
Examples
Published AND discussed AND cited

23
24
Summary: a broader view
• Different research artifacts
– papers, preprints, slides, videos, code, data

• Different measures
– usage, mentions, views, sharing

• Different stories
– progress so far, workshop impact, outreach
Conclusion
• Altmetrics is still developing
– But useful today

• Allows to build a broader picture of impact
– Using a variety of Artifacts & Measures

• Final thought: research artifacts exist in a
network, we‘re starting to connect it
Thanks
Collaborators: Peter van den Besselaar, Julie
Birkholz, Frank van Harmelen, Shenghui Wang,
Rinke Hoekstra, Thomas Gurney, Mike Taylor,
Anita de Waard, Jason Priem, Dario Taraborelli,
Cameron Neylon, Ian Mulvany

More Related Content

What's hot

Measuring Research Impact on the Web
Measuring Research Impact on the WebMeasuring Research Impact on the Web
Measuring Research Impact on the WebCharleston Conference
 
Scientific research process خطوات البحث العلمي
Scientific research process خطوات البحث العلميScientific research process خطوات البحث العلمي
Scientific research process خطوات البحث العلميMustafa Sadiq
 
Altmetrics Overview
Altmetrics OverviewAltmetrics Overview
Altmetrics OverviewPaul Groth
 
Researching Misinformation
Researching MisinformationResearching Misinformation
Researching MisinformationScott A. Hale
 
Altmetrics for Measuring Research Output
Altmetrics for Measuring Research OutputAltmetrics for Measuring Research Output
Altmetrics for Measuring Research OutputRobin Featherstone
 
Rise presentation for jisc online mtg 2011 06-02
Rise presentation for jisc online mtg 2011 06-02Rise presentation for jisc online mtg 2011 06-02
Rise presentation for jisc online mtg 2011 06-02Richard Nurse
 
Information overload in emergency management
Information overload in emergency managementInformation overload in emergency management
Information overload in emergency managementguestf66e810
 
UCSF Profiles, more Moneyball, less Field of Dreams, presented at U of Chicag...
UCSF Profiles, more Moneyball, less Field of Dreams, presented at U of Chicag...UCSF Profiles, more Moneyball, less Field of Dreams, presented at U of Chicag...
UCSF Profiles, more Moneyball, less Field of Dreams, presented at U of Chicag...lesliey
 
Measuring Research Impact on the Web: Where does the librarian fit in?
Measuring Research Impact on the Web: Where does the librarian fit in?Measuring Research Impact on the Web: Where does the librarian fit in?
Measuring Research Impact on the Web: Where does the librarian fit in?Charleston Conference
 
Demystifying research impact metrics and library support
Demystifying research impact   metrics and library supportDemystifying research impact   metrics and library support
Demystifying research impact metrics and library supportWestern Sydney University
 
Hi600 u09_inst_slides
Hi600 u09_inst_slidesHi600 u09_inst_slides
Hi600 u09_inst_slidesljmcneill33
 
Slides to prompt an Open access discussion
Slides to prompt an Open access discussion Slides to prompt an Open access discussion
Slides to prompt an Open access discussion Balrymes
 
Putting Research Data into Context: A Scholarly Approach to Curating Data for...
Putting Research Data into Context: A Scholarly Approach to Curating Data for...Putting Research Data into Context: A Scholarly Approach to Curating Data for...
Putting Research Data into Context: A Scholarly Approach to Curating Data for...OCLC
 
Mha 507 mha507 mha 507 education for service uopstudy.com
Mha 507 mha507 mha 507 education for service   uopstudy.comMha 507 mha507 mha 507 education for service   uopstudy.com
Mha 507 mha507 mha 507 education for service uopstudy.comUOPCourseHelp
 
Why canceling subscriptions may just yet save scholarship
Why canceling subscriptions may just yet save scholarshipWhy canceling subscriptions may just yet save scholarship
Why canceling subscriptions may just yet save scholarshipBjörn Brembs
 
Joining the ‘buzz’ : the role of social media in raising research visibility
Joining the ‘buzz’ : the role of social media in raising research visibilityJoining the ‘buzz’ : the role of social media in raising research visibility
Joining the ‘buzz’ : the role of social media in raising research visibility Eileen Shepherd
 

What's hot (19)

Measuring Research Impact on the Web
Measuring Research Impact on the WebMeasuring Research Impact on the Web
Measuring Research Impact on the Web
 
Scientific research process خطوات البحث العلمي
Scientific research process خطوات البحث العلميScientific research process خطوات البحث العلمي
Scientific research process خطوات البحث العلمي
 
Altmetrics Overview
Altmetrics OverviewAltmetrics Overview
Altmetrics Overview
 
Researching Misinformation
Researching MisinformationResearching Misinformation
Researching Misinformation
 
Altmetrics for Measuring Research Output
Altmetrics for Measuring Research OutputAltmetrics for Measuring Research Output
Altmetrics for Measuring Research Output
 
Rise presentation for jisc online mtg 2011 06-02
Rise presentation for jisc online mtg 2011 06-02Rise presentation for jisc online mtg 2011 06-02
Rise presentation for jisc online mtg 2011 06-02
 
Information overload in emergency management
Information overload in emergency managementInformation overload in emergency management
Information overload in emergency management
 
UCSF Profiles, more Moneyball, less Field of Dreams, presented at U of Chicag...
UCSF Profiles, more Moneyball, less Field of Dreams, presented at U of Chicag...UCSF Profiles, more Moneyball, less Field of Dreams, presented at U of Chicag...
UCSF Profiles, more Moneyball, less Field of Dreams, presented at U of Chicag...
 
Measuring Research Impact on the Web: Where does the librarian fit in?
Measuring Research Impact on the Web: Where does the librarian fit in?Measuring Research Impact on the Web: Where does the librarian fit in?
Measuring Research Impact on the Web: Where does the librarian fit in?
 
Altmetrics
Altmetrics Altmetrics
Altmetrics
 
Demystifying research impact metrics and library support
Demystifying research impact   metrics and library supportDemystifying research impact   metrics and library support
Demystifying research impact metrics and library support
 
Hi600 u09_inst_slides
Hi600 u09_inst_slidesHi600 u09_inst_slides
Hi600 u09_inst_slides
 
An Online & Social Media Training Curriculum to Facilitate Bench-to-Bedside I...
An Online & Social Media Training Curriculum to Facilitate Bench-to-Bedside I...An Online & Social Media Training Curriculum to Facilitate Bench-to-Bedside I...
An Online & Social Media Training Curriculum to Facilitate Bench-to-Bedside I...
 
Slides to prompt an Open access discussion
Slides to prompt an Open access discussion Slides to prompt an Open access discussion
Slides to prompt an Open access discussion
 
Putting Research Data into Context: A Scholarly Approach to Curating Data for...
Putting Research Data into Context: A Scholarly Approach to Curating Data for...Putting Research Data into Context: A Scholarly Approach to Curating Data for...
Putting Research Data into Context: A Scholarly Approach to Curating Data for...
 
Mha 507 mha507 mha 507 education for service uopstudy.com
Mha 507 mha507 mha 507 education for service   uopstudy.comMha 507 mha507 mha 507 education for service   uopstudy.com
Mha 507 mha507 mha 507 education for service uopstudy.com
 
Why canceling subscriptions may just yet save scholarship
Why canceling subscriptions may just yet save scholarshipWhy canceling subscriptions may just yet save scholarship
Why canceling subscriptions may just yet save scholarship
 
Usability for iCONN
Usability for iCONNUsability for iCONN
Usability for iCONN
 
Joining the ‘buzz’ : the role of social media in raising research visibility
Joining the ‘buzz’ : the role of social media in raising research visibilityJoining the ‘buzz’ : the role of social media in raising research visibility
Joining the ‘buzz’ : the role of social media in raising research visibility
 

Viewers also liked

Data Integration vs Transparency: Tackling the tension
Data Integration vs Transparency: Tackling the tensionData Integration vs Transparency: Tackling the tension
Data Integration vs Transparency: Tackling the tensionPaul Groth
 
"Don't Publish, Release" - Revisited
"Don't Publish, Release" - Revisited "Don't Publish, Release" - Revisited
"Don't Publish, Release" - Revisited Paul Groth
 
Transparency in the Data Supply Chain
Transparency in the Data Supply ChainTransparency in the Data Supply Chain
Transparency in the Data Supply ChainPaul Groth
 
Data for Science: How Elsevier is using data science to empower researchers
Data for Science: How Elsevier is using data science to empower researchersData for Science: How Elsevier is using data science to empower researchers
Data for Science: How Elsevier is using data science to empower researchersPaul Groth
 
Information architecture at Elsevier
Information architecture at ElsevierInformation architecture at Elsevier
Information architecture at ElsevierPaul Groth
 
Decoupling Provenance Capture and Analysis from Execution
Decoupling Provenance Capture and Analysis from ExecutionDecoupling Provenance Capture and Analysis from Execution
Decoupling Provenance Capture and Analysis from ExecutionPaul Groth
 
Research Data Sharing: A Basic Framework
Research Data Sharing: A Basic FrameworkResearch Data Sharing: A Basic Framework
Research Data Sharing: A Basic FrameworkPaul Groth
 
Sources of Change in Modern Knowledge Organization Systems
Sources of Change in Modern Knowledge Organization SystemsSources of Change in Modern Knowledge Organization Systems
Sources of Change in Modern Knowledge Organization SystemsPaul Groth
 
Structured Data & the Future of Educational Material
Structured Data & the Future of Educational MaterialStructured Data & the Future of Educational Material
Structured Data & the Future of Educational MaterialPaul Groth
 
Knowledge Graphs at Elsevier
Knowledge Graphs at ElsevierKnowledge Graphs at Elsevier
Knowledge Graphs at ElsevierPaul Groth
 
Open PHACTS API Walkthrough
Open PHACTS API WalkthroughOpen PHACTS API Walkthrough
Open PHACTS API WalkthroughPaul Groth
 
Tradeoffs in Automatic Provenance Capture
Tradeoffs in Automatic Provenance CaptureTradeoffs in Automatic Provenance Capture
Tradeoffs in Automatic Provenance CapturePaul Groth
 
Provenance for Data Munging Environments
Provenance for Data Munging EnvironmentsProvenance for Data Munging Environments
Provenance for Data Munging EnvironmentsPaul Groth
 
Knowledge Graph Construction and the Role of DBPedia
Knowledge Graph Construction and the Role of DBPediaKnowledge Graph Construction and the Role of DBPedia
Knowledge Graph Construction and the Role of DBPediaPaul Groth
 
21 Search engine optimisation Guidelines
21 Search engine optimisation Guidelines21 Search engine optimisation Guidelines
21 Search engine optimisation GuidelinesGolden Team
 
Ways To Optimize Our Environmental Levy Scheme
Ways To Optimize Our Environmental Levy SchemeWays To Optimize Our Environmental Levy Scheme
Ways To Optimize Our Environmental Levy Schemegueste1a32de7
 
Φύλλο εικόνας Background
Φύλλο εικόνας BackgroundΦύλλο εικόνας Background
Φύλλο εικόνας BackgroundPetros Michailidis
 
Unlocking the Power of Purpose by The EVR1 Institute
Unlocking the Power of Purpose by The EVR1 InstituteUnlocking the Power of Purpose by The EVR1 Institute
Unlocking the Power of Purpose by The EVR1 InstituteBrandon Peele
 

Viewers also liked (20)

Data Integration vs Transparency: Tackling the tension
Data Integration vs Transparency: Tackling the tensionData Integration vs Transparency: Tackling the tension
Data Integration vs Transparency: Tackling the tension
 
"Don't Publish, Release" - Revisited
"Don't Publish, Release" - Revisited "Don't Publish, Release" - Revisited
"Don't Publish, Release" - Revisited
 
Transparency in the Data Supply Chain
Transparency in the Data Supply ChainTransparency in the Data Supply Chain
Transparency in the Data Supply Chain
 
Data for Science: How Elsevier is using data science to empower researchers
Data for Science: How Elsevier is using data science to empower researchersData for Science: How Elsevier is using data science to empower researchers
Data for Science: How Elsevier is using data science to empower researchers
 
Information architecture at Elsevier
Information architecture at ElsevierInformation architecture at Elsevier
Information architecture at Elsevier
 
Decoupling Provenance Capture and Analysis from Execution
Decoupling Provenance Capture and Analysis from ExecutionDecoupling Provenance Capture and Analysis from Execution
Decoupling Provenance Capture and Analysis from Execution
 
Research Data Sharing: A Basic Framework
Research Data Sharing: A Basic FrameworkResearch Data Sharing: A Basic Framework
Research Data Sharing: A Basic Framework
 
Sources of Change in Modern Knowledge Organization Systems
Sources of Change in Modern Knowledge Organization SystemsSources of Change in Modern Knowledge Organization Systems
Sources of Change in Modern Knowledge Organization Systems
 
Structured Data & the Future of Educational Material
Structured Data & the Future of Educational MaterialStructured Data & the Future of Educational Material
Structured Data & the Future of Educational Material
 
Knowledge Graphs at Elsevier
Knowledge Graphs at ElsevierKnowledge Graphs at Elsevier
Knowledge Graphs at Elsevier
 
Open PHACTS API Walkthrough
Open PHACTS API WalkthroughOpen PHACTS API Walkthrough
Open PHACTS API Walkthrough
 
Tradeoffs in Automatic Provenance Capture
Tradeoffs in Automatic Provenance CaptureTradeoffs in Automatic Provenance Capture
Tradeoffs in Automatic Provenance Capture
 
Provenance for Data Munging Environments
Provenance for Data Munging EnvironmentsProvenance for Data Munging Environments
Provenance for Data Munging Environments
 
Knowledge Graph Construction and the Role of DBPedia
Knowledge Graph Construction and the Role of DBPediaKnowledge Graph Construction and the Role of DBPedia
Knowledge Graph Construction and the Role of DBPedia
 
21 Search engine optimisation Guidelines
21 Search engine optimisation Guidelines21 Search engine optimisation Guidelines
21 Search engine optimisation Guidelines
 
Ways To Optimize Our Environmental Levy Scheme
Ways To Optimize Our Environmental Levy SchemeWays To Optimize Our Environmental Levy Scheme
Ways To Optimize Our Environmental Levy Scheme
 
Φύλλο εικόνας Background
Φύλλο εικόνας BackgroundΦύλλο εικόνας Background
Φύλλο εικόνας Background
 
Taking Carcinogens out of the Workplace
Taking Carcinogens out of the WorkplaceTaking Carcinogens out of the Workplace
Taking Carcinogens out of the Workplace
 
Unlocking the Power of Purpose by The EVR1 Institute
Unlocking the Power of Purpose by The EVR1 InstituteUnlocking the Power of Purpose by The EVR1 Institute
Unlocking the Power of Purpose by The EVR1 Institute
 
Made in america terrorist
Made in america terroristMade in america terrorist
Made in america terrorist
 

Similar to Altmetrics: Building a Broader Picture of Impact

Library Connect Webinar - Making the case for sharing with indicators of rese...
Library Connect Webinar - Making the case for sharing with indicators of rese...Library Connect Webinar - Making the case for sharing with indicators of rese...
Library Connect Webinar - Making the case for sharing with indicators of rese...Library_Connect
 
Open Science & Altmetrics
Open Science & AltmetricsOpen Science & Altmetrics
Open Science & AltmetricsIsabella Peters
 
Introduction to open access and how you can get involved
Introduction to open access and how you can get involvedIntroduction to open access and how you can get involved
Introduction to open access and how you can get involvedIryna Kuchma
 
VREs and Research Tools - supporting collaborative research
VREs and Research Tools - supporting collaborative researchVREs and Research Tools - supporting collaborative research
VREs and Research Tools - supporting collaborative researchChristopher Brown
 
Ullmann
UllmannUllmann
Ullmannanesah
 
Top Download Article in Computer Science & Information Technology Research: J...
Top Download Article in Computer Science & Information Technology Research: J...Top Download Article in Computer Science & Information Technology Research: J...
Top Download Article in Computer Science & Information Technology Research: J...AIRCC Publishing Corporation
 
Research process and research data management
Research  process and research data managementResearch  process and research data management
Research process and research data managementKen Chad Consulting Ltd
 
UKSG 2014 Breakout Session - Westminster Research Process and Research Data
UKSG 2014 Breakout Session - Westminster Research Process and Research DataUKSG 2014 Breakout Session - Westminster Research Process and Research Data
UKSG 2014 Breakout Session - Westminster Research Process and Research DataUKSG: connecting the knowledge community
 
EnablingFAIR - Open research data in the UK
EnablingFAIR - Open research data in the UKEnablingFAIR - Open research data in the UK
EnablingFAIR - Open research data in the UKSusanna-Assunta Sansone
 
Changing trends in citation analysis and challenges in API measurement
Changing trends in citation analysis and challenges in API measurementChanging trends in citation analysis and challenges in API measurement
Changing trends in citation analysis and challenges in API measurementMunesh Kumar
 
Virtual Research Networks : Towards Research 2.0
Virtual Research Networks : Towards Research 2.0Virtual Research Networks : Towards Research 2.0
Virtual Research Networks : Towards Research 2.0Guus van den Brekel
 
Research Metadata Mechanics - Simon Porter
Research Metadata Mechanics - Simon PorterResearch Metadata Mechanics - Simon Porter
Research Metadata Mechanics - Simon PorterCASRAI
 
Irjet v4 i73A Survey on Student’s Academic Experiences using Social Media Data53
Irjet v4 i73A Survey on Student’s Academic Experiences using Social Media Data53Irjet v4 i73A Survey on Student’s Academic Experiences using Social Media Data53
Irjet v4 i73A Survey on Student’s Academic Experiences using Social Media Data53IRJET Journal
 
#ALAAC15 Linked Data Love
#ALAAC15 Linked Data Love #ALAAC15 Linked Data Love
#ALAAC15 Linked Data Love Kristi Holmes
 
Acting as Advocate? Seven steps for libraries in the data decade
Acting as Advocate? Seven steps for libraries in the data decadeActing as Advocate? Seven steps for libraries in the data decade
Acting as Advocate? Seven steps for libraries in the data decadeLizLyon
 
AI from the Perspective of a School of Data Science
AI from the Perspective of a School of Data ScienceAI from the Perspective of a School of Data Science
AI from the Perspective of a School of Data SciencePhilip Bourne
 

Similar to Altmetrics: Building a Broader Picture of Impact (20)

June 18 NISO Virtual Conference: Keynote Speaker: Altmetrics at the Portfolio...
June 18 NISO Virtual Conference: Keynote Speaker: Altmetrics at the Portfolio...June 18 NISO Virtual Conference: Keynote Speaker: Altmetrics at the Portfolio...
June 18 NISO Virtual Conference: Keynote Speaker: Altmetrics at the Portfolio...
 
Library Connect Webinar - Making the case for sharing with indicators of rese...
Library Connect Webinar - Making the case for sharing with indicators of rese...Library Connect Webinar - Making the case for sharing with indicators of rese...
Library Connect Webinar - Making the case for sharing with indicators of rese...
 
Open Science & Altmetrics
Open Science & AltmetricsOpen Science & Altmetrics
Open Science & Altmetrics
 
Introduction to open access and how you can get involved
Introduction to open access and how you can get involvedIntroduction to open access and how you can get involved
Introduction to open access and how you can get involved
 
VREs and Research Tools - supporting collaborative research
VREs and Research Tools - supporting collaborative researchVREs and Research Tools - supporting collaborative research
VREs and Research Tools - supporting collaborative research
 
Ullmann
UllmannUllmann
Ullmann
 
Altmetrics
AltmetricsAltmetrics
Altmetrics
 
Top Download Article in Computer Science & Information Technology Research: J...
Top Download Article in Computer Science & Information Technology Research: J...Top Download Article in Computer Science & Information Technology Research: J...
Top Download Article in Computer Science & Information Technology Research: J...
 
iwmw_supporting_research
iwmw_supporting_researchiwmw_supporting_research
iwmw_supporting_research
 
Research process and research data management
Research  process and research data managementResearch  process and research data management
Research process and research data management
 
UKSG 2014 Breakout Session - Westminster Research Process and Research Data
UKSG 2014 Breakout Session - Westminster Research Process and Research DataUKSG 2014 Breakout Session - Westminster Research Process and Research Data
UKSG 2014 Breakout Session - Westminster Research Process and Research Data
 
EnablingFAIR - Open research data in the UK
EnablingFAIR - Open research data in the UKEnablingFAIR - Open research data in the UK
EnablingFAIR - Open research data in the UK
 
Changing trends in citation analysis and challenges in API measurement
Changing trends in citation analysis and challenges in API measurementChanging trends in citation analysis and challenges in API measurement
Changing trends in citation analysis and challenges in API measurement
 
Virtual Research Networks : Towards Research 2.0
Virtual Research Networks : Towards Research 2.0Virtual Research Networks : Towards Research 2.0
Virtual Research Networks : Towards Research 2.0
 
Research Metadata Mechanics - Simon Porter
Research Metadata Mechanics - Simon PorterResearch Metadata Mechanics - Simon Porter
Research Metadata Mechanics - Simon Porter
 
Irjet v4 i73A Survey on Student’s Academic Experiences using Social Media Data53
Irjet v4 i73A Survey on Student’s Academic Experiences using Social Media Data53Irjet v4 i73A Survey on Student’s Academic Experiences using Social Media Data53
Irjet v4 i73A Survey on Student’s Academic Experiences using Social Media Data53
 
#ALAAC15 Linked Data Love
#ALAAC15 Linked Data Love #ALAAC15 Linked Data Love
#ALAAC15 Linked Data Love
 
Acting as Advocate? Seven steps for libraries in the data decade
Acting as Advocate? Seven steps for libraries in the data decadeActing as Advocate? Seven steps for libraries in the data decade
Acting as Advocate? Seven steps for libraries in the data decade
 
ALTMETRICS
ALTMETRICSALTMETRICS
ALTMETRICS
 
AI from the Perspective of a School of Data Science
AI from the Perspective of a School of Data ScienceAI from the Perspective of a School of Data Science
AI from the Perspective of a School of Data Science
 

More from Paul Groth

Data Curation and Debugging for Data Centric AI
Data Curation and Debugging for Data Centric AIData Curation and Debugging for Data Centric AI
Data Curation and Debugging for Data Centric AIPaul Groth
 
Content + Signals: The value of the entire data estate for machine learning
Content + Signals: The value of the entire data estate for machine learningContent + Signals: The value of the entire data estate for machine learning
Content + Signals: The value of the entire data estate for machine learningPaul Groth
 
Data Communities - reusable data in and outside your organization.
Data Communities - reusable data in and outside your organization.Data Communities - reusable data in and outside your organization.
Data Communities - reusable data in and outside your organization.Paul Groth
 
Minimal viable-datareuse-czi
Minimal viable-datareuse-cziMinimal viable-datareuse-czi
Minimal viable-datareuse-cziPaul Groth
 
Knowledge Graph Maintenance
Knowledge Graph MaintenanceKnowledge Graph Maintenance
Knowledge Graph MaintenancePaul Groth
 
Knowledge Graph Futures
Knowledge Graph FuturesKnowledge Graph Futures
Knowledge Graph FuturesPaul Groth
 
Knowledge Graph Maintenance
Knowledge Graph MaintenanceKnowledge Graph Maintenance
Knowledge Graph MaintenancePaul Groth
 
Thoughts on Knowledge Graphs & Deeper Provenance
Thoughts on Knowledge Graphs  & Deeper ProvenanceThoughts on Knowledge Graphs  & Deeper Provenance
Thoughts on Knowledge Graphs & Deeper ProvenancePaul Groth
 
Thinking About the Making of Data
Thinking About the Making of DataThinking About the Making of Data
Thinking About the Making of DataPaul Groth
 
End-to-End Learning for Answering Structured Queries Directly over Text
End-to-End Learning for  Answering Structured Queries Directly over Text End-to-End Learning for  Answering Structured Queries Directly over Text
End-to-End Learning for Answering Structured Queries Directly over Text Paul Groth
 
From Data Search to Data Showcasing
From Data Search to Data ShowcasingFrom Data Search to Data Showcasing
From Data Search to Data ShowcasingPaul Groth
 
Elsevier’s Healthcare Knowledge Graph
Elsevier’s Healthcare Knowledge GraphElsevier’s Healthcare Knowledge Graph
Elsevier’s Healthcare Knowledge GraphPaul Groth
 
The Challenge of Deeper Knowledge Graphs for Science
The Challenge of Deeper Knowledge Graphs for ScienceThe Challenge of Deeper Knowledge Graphs for Science
The Challenge of Deeper Knowledge Graphs for SciencePaul Groth
 
More ways of symbol grounding for knowledge graphs?
More ways of symbol grounding for knowledge graphs?More ways of symbol grounding for knowledge graphs?
More ways of symbol grounding for knowledge graphs?Paul Groth
 
Diversity and Depth: Implementing AI across many long tail domains
Diversity and Depth: Implementing AI across many long tail domainsDiversity and Depth: Implementing AI across many long tail domains
Diversity and Depth: Implementing AI across many long tail domainsPaul Groth
 
Progressive Provenance Capture Through Re-computation
Progressive Provenance Capture Through Re-computationProgressive Provenance Capture Through Re-computation
Progressive Provenance Capture Through Re-computationPaul Groth
 
From Text to Data to the World: The Future of Knowledge Graphs
From Text to Data to the World: The Future of Knowledge GraphsFrom Text to Data to the World: The Future of Knowledge Graphs
From Text to Data to the World: The Future of Knowledge GraphsPaul Groth
 
Combining Explicit and Latent Web Semantics for Maintaining Knowledge Graphs
Combining Explicit and Latent Web Semantics for Maintaining Knowledge GraphsCombining Explicit and Latent Web Semantics for Maintaining Knowledge Graphs
Combining Explicit and Latent Web Semantics for Maintaining Knowledge GraphsPaul Groth
 
The need for a transparent data supply chain
The need for a transparent data supply chainThe need for a transparent data supply chain
The need for a transparent data supply chainPaul Groth
 
Knowledge graph construction for research & medicine
Knowledge graph construction for research & medicineKnowledge graph construction for research & medicine
Knowledge graph construction for research & medicinePaul Groth
 

More from Paul Groth (20)

Data Curation and Debugging for Data Centric AI
Data Curation and Debugging for Data Centric AIData Curation and Debugging for Data Centric AI
Data Curation and Debugging for Data Centric AI
 
Content + Signals: The value of the entire data estate for machine learning
Content + Signals: The value of the entire data estate for machine learningContent + Signals: The value of the entire data estate for machine learning
Content + Signals: The value of the entire data estate for machine learning
 
Data Communities - reusable data in and outside your organization.
Data Communities - reusable data in and outside your organization.Data Communities - reusable data in and outside your organization.
Data Communities - reusable data in and outside your organization.
 
Minimal viable-datareuse-czi
Minimal viable-datareuse-cziMinimal viable-datareuse-czi
Minimal viable-datareuse-czi
 
Knowledge Graph Maintenance
Knowledge Graph MaintenanceKnowledge Graph Maintenance
Knowledge Graph Maintenance
 
Knowledge Graph Futures
Knowledge Graph FuturesKnowledge Graph Futures
Knowledge Graph Futures
 
Knowledge Graph Maintenance
Knowledge Graph MaintenanceKnowledge Graph Maintenance
Knowledge Graph Maintenance
 
Thoughts on Knowledge Graphs & Deeper Provenance
Thoughts on Knowledge Graphs  & Deeper ProvenanceThoughts on Knowledge Graphs  & Deeper Provenance
Thoughts on Knowledge Graphs & Deeper Provenance
 
Thinking About the Making of Data
Thinking About the Making of DataThinking About the Making of Data
Thinking About the Making of Data
 
End-to-End Learning for Answering Structured Queries Directly over Text
End-to-End Learning for  Answering Structured Queries Directly over Text End-to-End Learning for  Answering Structured Queries Directly over Text
End-to-End Learning for Answering Structured Queries Directly over Text
 
From Data Search to Data Showcasing
From Data Search to Data ShowcasingFrom Data Search to Data Showcasing
From Data Search to Data Showcasing
 
Elsevier’s Healthcare Knowledge Graph
Elsevier’s Healthcare Knowledge GraphElsevier’s Healthcare Knowledge Graph
Elsevier’s Healthcare Knowledge Graph
 
The Challenge of Deeper Knowledge Graphs for Science
The Challenge of Deeper Knowledge Graphs for ScienceThe Challenge of Deeper Knowledge Graphs for Science
The Challenge of Deeper Knowledge Graphs for Science
 
More ways of symbol grounding for knowledge graphs?
More ways of symbol grounding for knowledge graphs?More ways of symbol grounding for knowledge graphs?
More ways of symbol grounding for knowledge graphs?
 
Diversity and Depth: Implementing AI across many long tail domains
Diversity and Depth: Implementing AI across many long tail domainsDiversity and Depth: Implementing AI across many long tail domains
Diversity and Depth: Implementing AI across many long tail domains
 
Progressive Provenance Capture Through Re-computation
Progressive Provenance Capture Through Re-computationProgressive Provenance Capture Through Re-computation
Progressive Provenance Capture Through Re-computation
 
From Text to Data to the World: The Future of Knowledge Graphs
From Text to Data to the World: The Future of Knowledge GraphsFrom Text to Data to the World: The Future of Knowledge Graphs
From Text to Data to the World: The Future of Knowledge Graphs
 
Combining Explicit and Latent Web Semantics for Maintaining Knowledge Graphs
Combining Explicit and Latent Web Semantics for Maintaining Knowledge GraphsCombining Explicit and Latent Web Semantics for Maintaining Knowledge Graphs
Combining Explicit and Latent Web Semantics for Maintaining Knowledge Graphs
 
The need for a transparent data supply chain
The need for a transparent data supply chainThe need for a transparent data supply chain
The need for a transparent data supply chain
 
Knowledge graph construction for research & medicine
Knowledge graph construction for research & medicineKnowledge graph construction for research & medicine
Knowledge graph construction for research & medicine
 

Recently uploaded

Procuring digital preservation CAN be quick and painless with our new dynamic...
Procuring digital preservation CAN be quick and painless with our new dynamic...Procuring digital preservation CAN be quick and painless with our new dynamic...
Procuring digital preservation CAN be quick and painless with our new dynamic...Jisc
 
Choosing the Right CBSE School A Comprehensive Guide for Parents
Choosing the Right CBSE School A Comprehensive Guide for ParentsChoosing the Right CBSE School A Comprehensive Guide for Parents
Choosing the Right CBSE School A Comprehensive Guide for Parentsnavabharathschool99
 
Student Profile Sample - We help schools to connect the data they have, with ...
Student Profile Sample - We help schools to connect the data they have, with ...Student Profile Sample - We help schools to connect the data they have, with ...
Student Profile Sample - We help schools to connect the data they have, with ...Seán Kennedy
 
4.18.24 Movement Legacies, Reflection, and Review.pptx
4.18.24 Movement Legacies, Reflection, and Review.pptx4.18.24 Movement Legacies, Reflection, and Review.pptx
4.18.24 Movement Legacies, Reflection, and Review.pptxmary850239
 
AMERICAN LANGUAGE HUB_Level2_Student'sBook_Answerkey.pdf
AMERICAN LANGUAGE HUB_Level2_Student'sBook_Answerkey.pdfAMERICAN LANGUAGE HUB_Level2_Student'sBook_Answerkey.pdf
AMERICAN LANGUAGE HUB_Level2_Student'sBook_Answerkey.pdfphamnguyenenglishnb
 
Keynote by Prof. Wurzer at Nordex about IP-design
Keynote by Prof. Wurzer at Nordex about IP-designKeynote by Prof. Wurzer at Nordex about IP-design
Keynote by Prof. Wurzer at Nordex about IP-designMIPLM
 
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)lakshayb543
 
Culture Uniformity or Diversity IN SOCIOLOGY.pptx
Culture Uniformity or Diversity IN SOCIOLOGY.pptxCulture Uniformity or Diversity IN SOCIOLOGY.pptx
Culture Uniformity or Diversity IN SOCIOLOGY.pptxPoojaSen20
 
4.16.24 21st Century Movements for Black Lives.pptx
4.16.24 21st Century Movements for Black Lives.pptx4.16.24 21st Century Movements for Black Lives.pptx
4.16.24 21st Century Movements for Black Lives.pptxmary850239
 
MULTIDISCIPLINRY NATURE OF THE ENVIRONMENTAL STUDIES.pptx
MULTIDISCIPLINRY NATURE OF THE ENVIRONMENTAL STUDIES.pptxMULTIDISCIPLINRY NATURE OF THE ENVIRONMENTAL STUDIES.pptx
MULTIDISCIPLINRY NATURE OF THE ENVIRONMENTAL STUDIES.pptxAnupkumar Sharma
 
Global Lehigh Strategic Initiatives (without descriptions)
Global Lehigh Strategic Initiatives (without descriptions)Global Lehigh Strategic Initiatives (without descriptions)
Global Lehigh Strategic Initiatives (without descriptions)cama23
 
How to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERPHow to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERPCeline George
 
Like-prefer-love -hate+verb+ing & silent letters & citizenship text.pdf
Like-prefer-love -hate+verb+ing & silent letters & citizenship text.pdfLike-prefer-love -hate+verb+ing & silent letters & citizenship text.pdf
Like-prefer-love -hate+verb+ing & silent letters & citizenship text.pdfMr Bounab Samir
 
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...JhezDiaz1
 
Difference Between Search & Browse Methods in Odoo 17
Difference Between Search & Browse Methods in Odoo 17Difference Between Search & Browse Methods in Odoo 17
Difference Between Search & Browse Methods in Odoo 17Celine George
 
FILIPINO PSYCHology sikolohiyang pilipino
FILIPINO PSYCHology sikolohiyang pilipinoFILIPINO PSYCHology sikolohiyang pilipino
FILIPINO PSYCHology sikolohiyang pilipinojohnmickonozaleda
 
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdfVirtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdfErwinPantujan2
 

Recently uploaded (20)

Procuring digital preservation CAN be quick and painless with our new dynamic...
Procuring digital preservation CAN be quick and painless with our new dynamic...Procuring digital preservation CAN be quick and painless with our new dynamic...
Procuring digital preservation CAN be quick and painless with our new dynamic...
 
Choosing the Right CBSE School A Comprehensive Guide for Parents
Choosing the Right CBSE School A Comprehensive Guide for ParentsChoosing the Right CBSE School A Comprehensive Guide for Parents
Choosing the Right CBSE School A Comprehensive Guide for Parents
 
Student Profile Sample - We help schools to connect the data they have, with ...
Student Profile Sample - We help schools to connect the data they have, with ...Student Profile Sample - We help schools to connect the data they have, with ...
Student Profile Sample - We help schools to connect the data they have, with ...
 
4.18.24 Movement Legacies, Reflection, and Review.pptx
4.18.24 Movement Legacies, Reflection, and Review.pptx4.18.24 Movement Legacies, Reflection, and Review.pptx
4.18.24 Movement Legacies, Reflection, and Review.pptx
 
AMERICAN LANGUAGE HUB_Level2_Student'sBook_Answerkey.pdf
AMERICAN LANGUAGE HUB_Level2_Student'sBook_Answerkey.pdfAMERICAN LANGUAGE HUB_Level2_Student'sBook_Answerkey.pdf
AMERICAN LANGUAGE HUB_Level2_Student'sBook_Answerkey.pdf
 
Keynote by Prof. Wurzer at Nordex about IP-design
Keynote by Prof. Wurzer at Nordex about IP-designKeynote by Prof. Wurzer at Nordex about IP-design
Keynote by Prof. Wurzer at Nordex about IP-design
 
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
 
Raw materials used in Herbal Cosmetics.pptx
Raw materials used in Herbal Cosmetics.pptxRaw materials used in Herbal Cosmetics.pptx
Raw materials used in Herbal Cosmetics.pptx
 
Culture Uniformity or Diversity IN SOCIOLOGY.pptx
Culture Uniformity or Diversity IN SOCIOLOGY.pptxCulture Uniformity or Diversity IN SOCIOLOGY.pptx
Culture Uniformity or Diversity IN SOCIOLOGY.pptx
 
4.16.24 21st Century Movements for Black Lives.pptx
4.16.24 21st Century Movements for Black Lives.pptx4.16.24 21st Century Movements for Black Lives.pptx
4.16.24 21st Century Movements for Black Lives.pptx
 
MULTIDISCIPLINRY NATURE OF THE ENVIRONMENTAL STUDIES.pptx
MULTIDISCIPLINRY NATURE OF THE ENVIRONMENTAL STUDIES.pptxMULTIDISCIPLINRY NATURE OF THE ENVIRONMENTAL STUDIES.pptx
MULTIDISCIPLINRY NATURE OF THE ENVIRONMENTAL STUDIES.pptx
 
Global Lehigh Strategic Initiatives (without descriptions)
Global Lehigh Strategic Initiatives (without descriptions)Global Lehigh Strategic Initiatives (without descriptions)
Global Lehigh Strategic Initiatives (without descriptions)
 
How to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERPHow to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERP
 
Like-prefer-love -hate+verb+ing & silent letters & citizenship text.pdf
Like-prefer-love -hate+verb+ing & silent letters & citizenship text.pdfLike-prefer-love -hate+verb+ing & silent letters & citizenship text.pdf
Like-prefer-love -hate+verb+ing & silent letters & citizenship text.pdf
 
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
 
Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝
 
Difference Between Search & Browse Methods in Odoo 17
Difference Between Search & Browse Methods in Odoo 17Difference Between Search & Browse Methods in Odoo 17
Difference Between Search & Browse Methods in Odoo 17
 
FILIPINO PSYCHology sikolohiyang pilipino
FILIPINO PSYCHology sikolohiyang pilipinoFILIPINO PSYCHology sikolohiyang pilipino
FILIPINO PSYCHology sikolohiyang pilipino
 
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptxYOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
 
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdfVirtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
 

Altmetrics: Building a Broader Picture of Impact

  • 1. Altmetrics: building a broader picture of impact Paul Groth @pgroth Web & Media Group Department of Computer Science The Network Institute VU University Amsterdam http://www.few.vu.nl/~pgroth #APE2014
  • 2.
  • 3. Research Project Grants Applications, awards, and success rates NIH Data Book – (http://report.nih.gov/ndb/index.aspx) Data provided by the Division of Information Services, Reporting Branch
  • 4. "Outside letters basically trump everything," says Robert Simoni, chairman of the biology department at Stanford University in California. Metrics: Do metrics matter? Nature 2010 http://doi.org/10.1038/465860a
  • 5.
  • 6. ―Imagine how the academic appointment process might change if search and review committees had access—within an appropriately tagged or linked online CV, for example, or via the ORCID system— to information about the specific contributions made by a candidate to each of his/her works, including contributions that might not otherwise have qualified for ‗authorship‘ status?‖ Point of view: Faculty appointments and the record of scholarship Amy Brand http://dx.doi.org/10.7554/eLife.00452
  • 7. Point of view: Faculty appointments and the record of scholarship Amy Brand http://dx.doi.org/10.7554/eLife.00452 Opportunities • Individuals and institutions need better tools for curating and networking their own record of scholarship • Institutions need more information about scholarly contribution • ALMs that reliably differentiate sources of input (general; academic; expert; etc.) would be more useful‖ Slide 3: http://article-level-metrics.plos.org/files/2013/10/Brand.pptx
  • 9. Altmetrics is the study and use of scholarly impact measures based on activity in online tools and environments. http://doi.org/10.1371/journal.pone.0048753
  • 12.
  • 13.
  • 15. ―It took approximately a generation (20 years) for bibliographic citation analysis to achieve acceptability as a measure of academic impact." (Vaughan and Shaw, 2003)
  • 16. (Birkholtz et al. 2013) (Fausto et al 2012) http://jasonpriem.org/self-archived/5uni-poster.png The Research is Happening http://ploscollections.org/altmetrics http://asis.org/Bulletin/Apr-13/AprMay13_Piwowar.html
  • 19. Bottom Line: use altmetrics as evidence in a larger story
  • 21.
  • 22.
  • 23. Published AND discussed AND cited 23
  • 24. 24
  • 25.
  • 26.
  • 27.
  • 28. Summary: a broader view • Different research artifacts – papers, preprints, slides, videos, code, data • Different measures – usage, mentions, views, sharing • Different stories – progress so far, workshop impact, outreach
  • 29. Conclusion • Altmetrics is still developing – But useful today • Allows to build a broader picture of impact – Using a variety of Artifacts & Measures • Final thought: research artifacts exist in a network, we‘re starting to connect it
  • 30. Thanks Collaborators: Peter van den Besselaar, Julie Birkholz, Frank van Harmelen, Shenghui Wang, Rinke Hoekstra, Thomas Gurney, Mike Taylor, Anita de Waard, Jason Priem, Dario Taraborelli, Cameron Neylon, Ian Mulvany

Editor's Notes

  1. This is a pain to calculate!
  2. We believe metrics are it but policy makers don’t necessarily. What they want is evidence.
  3. There’s more and more “stuff” – where are we
  4. From Assistant Provost for Faculty Appointments and Information at Harvard University, where she manages the review of faculty appointments University-wide - See more at: http://elife.elifesciences.org/content/2/e00452#sthash.9shtp91n.dpuf
  5. From Assistant Provost for Faculty Appointments and Information at Harvard University, where she manages the review of faculty appointments University-wide - See more at: http://elife.elifesciences.org/content/2/e00452#sthash.9shtp91n.dpuf
  6. This will happen closer than 20 years
  7. Clear correlation between F1000 recommendations and citations
  8. Side note: From the slides:“There is no reason to condemn the incorrectly used Impact Factor and h-index. They can provide supplementary information if they are used in combination with qualitative methods, and are not used as the only decision criterion. Example:• Good practice (h-index as supporting argument): “The exceptionally high h-index of the applicant confirms his/her international standing aested to by our experts.” • Qestionable use (h-index as decision criterion):“We are inclined to support this scientist because his/her h-index distinctly exceeds that of all other applicants.”