Altmetrics in Practice - wssf -- Montreal - Oct 14, 2013
•Download as PPTX, PDF•
3 likes•1,996 views
World Social Science Forum presentation by Mike Buschman
Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Similar to Altmetrics in Practice - wssf -- Montreal - Oct 14, 2013
Similar to Altmetrics in Practice - wssf -- Montreal - Oct 14, 2013 (20)
Recently uploaded
Recently uploaded (20)
Altmetrics in Practice - wssf -- Montreal - Oct 14, 2013
- 1. Mike Buschman mike@plumanalytics.com @mikebuschman @plumanalytics Altmetrics in Practice World Social Science Forum ? Montréal – Oct 14, 2013 1
- 2. Current State of Scholarly Measure Plum Analytics Confidential 2
- 3. Well-known Problems with Citation Analysis • • • • • • Self-citations Citations added because of pressure by editors Negative citations Only about 30% of influences are cited* “Informal” influence isn’t measured through citations Secondary sources – Review articles “take” citations away from reviewed articles • Matthew effect – the rich get richer * MacRoberts and MacRoberts, 2010 3
- 4. Legacy Metrics • Journal Impact Factor – Journal-based measures only • Citation Counts – Designed in the 1960’s – Lagging indicator Plum Analytics Confidential 4
- 5. 5
- 7. PlumX provides access to the full impact spectrum 7
- 8. Our Approach to Altmetrics • Captures • Mentions • Social Media • Citations • Usage Altmetrics 8
- 9. Different Categories of Impact • Usage • Downloads, views, book holdings, ILL, document delivery • Captures • Favorites, bookmarks, saves, readers, groups, watchers • Mentions • Blog posts, news stories, Wikipedia articles, comments, reviews • Social Media • Tweets, Google +1s, likes, shares, ratings • Citations • Scopus, PubMed Citations, Microsoft Academic Search, patents 9
- 10. Citations are lagging indicators • • • • Scopus = 2 Web of Science = 0 Google Scholar = 8 PubMed = 1 10 Photo credit: A. Wayne Vogl and Nicholas D. Pyenson / Smithsonian Institution.
- 11. Metrics for Every Copy • • • • 59 Bitly clicks through PLOS 21 Bitly clicks through DOI link 92 Delicious bookmarks to PLOS 2 Delicious bookmarks to PubMed 11
- 12. How can I use these metrics? • New data to compete for grant dollars • Showcase full breadth of impact • New benchmarks Funding Research • ROI of research • New data to make funding decisions Publishing Research • Uncover hidden data • Add value to IRs and online journals • Recruit / retain “best” authors Plum Analytics Confidential Performing Research 12
- 13. Tracks 20+ Types of Artifacts • • • • • • • • • • • Articles Blog posts Book chapters Books Cases Clinical Trials Conference Papers Data Sets Figures Grants Interviews • Letters • • • • • • • Media Patents Posters Presentations Reports Source Code Theses / Dissertations • Videos • Web Pages 13
- 14. Largest List of Metrics Sources • • • • • • • • • • Amazon Bit.ly CrossRef Delicious Dryad dSpace ePrints Facebook Figshare Github • • • • • • • • • Google+ Medwave Mendeley Microsoft Academic Search PLOS PubMed Reddit Research Blogging Scopus • • • • • • • • • SlideShare SourceForge Stack Overflow Twitter USPTO Vimeo Wikipedia Worldcat YouTube 14
- 16. Artifact / Article Level Metrics 16
- 17. Book metrics 17
- 18. Research Output Summarized Clear, visual summaries of each researcher’s or group’s output 18
- 20. Tabular View Sortable, table-view of full output. Exportable to spreadsheets or integrated into other applications. 20
- 21. Author / Group Visualization 21
- 22. Search: Measuring Present Impact Changes the Game 22
- 24. 24
- 25. 25
- 26. Some active Projects • University of Pittsburgh – Rolling out to full university – Metrics for 35 journals • Cambridge Centre for Health Services • OHSU – Medical taxonomy + metrics • VIVO – Apps and tools working group – Weekly monitor of impact of promoting their research • Royal Society of Chemistry – Pilot to incorporate researcher-level widget into RSC author profile site • University of Alberta – Comparing top business school researchers • Anonymous institution – Testing impact of open access vs. published versions in their repository Plum Analytics Confidential 26
- 27. Groupings & Author Widgets too 27
Editor's Notes
- Published articles in prominent journals cite other articles in prominent journals = prestige and tenure.This mechanism of using citations in published journals to determine impact of research was built in the 1960’s.
- http://blog.qmee.com/qmee-online-in-60-seconds/
- At the time this snapshot of metrics was taken, his work was newly published. It hadn’t been picked up in Web of Science yet at all.However, the metrics surrounding his work give us a leading indicator that it may be impactful research.
- http://demo.plu.mx/a/eKXLDK8_gEB-iSPG_HLlHVGtDVYDreSTzdY7VST1rmY/Plum’s Identity resolution system, can match different artifacts together by known identifiers (like DOI), aliases of URLs, and proprietary clustering analysis algorithms.This system scales across millions of artifacts, and gives a complete view to the metrics.
- This visualization of a researcher’s output, when weighted by impact, shows which artifacts have been getting the most engagement across their entire life’s work.This is very useful when trying to get an overall sense of what a particular researcher (or lab, or group) is most known for.
- Compare the metrics showcasing the capturing of immediate impact versus a search on Google Scholar for something like “brain cancer.”