Using alternative scholarly metrics to showcase the impact of your research: An introduction for researchers (February 7, 2018)

1. Digital Scholar Webinar February 7, 2018 Hosted by the Southern California Clinical and Translational Science Institute (SC CTSI) University of Southern California (USC) and Children’s Hospital Los Angeles (CHLA)

2. Katja Reuter, PhD, Director of the Digital Scholar Program About Today’s Session

3. Alternative Scholarly Metrics

4. Today’s Learning Objectives  Describe the potential and strengths of using alternative scholarly metrics that measure the impact and use of scholarship  Describe basic features of the measurement tool PlumX and how they are used  Describe potential weaknesses of using alternative scholarly metrics and how to address them

5. Caroline Muglia Today’s Speaker Speaker: Caroline Muglia, Co-Associate Dean for Collections and Technical Services; and Head, Resource Sharing and Collection Assessment, USC Libraries

6. Questions: Please use the Q&A Feature 1. Click on the tab here to access Q&A 2. Ask and post question here 1 2

7. Using alternative scholarly metrics to showcase the impact of your research: An introduction for researchers Caroline Muglia Co-Associate Dean for Collections & Technical Services; Head, Resource Sharing & Collection Assessment muglia@usc.edu

8. Scenario 1

9. Dr. Fernando T. Maestre Professor, Biology and Geology Department at Universidad Rey Juan Carlos (Madrid, Spain)

10. What is altmetrics? Altmetrics is a broad term that encapsulates the collection of multiple digital indicators related to scholarly work. These indicators are derived from activity and engagement among diverse stakeholders and scholarly outputs in the research ecosystem, including the public sphere. Source:http://www.niso.org/apps/group_public/download.php/17091/NISO%20RP-25-2016%20Outputs%20of%20the%20NISO%20Alternative%20Assessment%20Project.pdf

11. How does Altmetrics work? ● Researchers leave “data exhaust” when they research and engage with social media ● PlumX mines the exhaust and gathers metrics ● Compares LIKE with LIKE

12. What is “data exhaust?”

13. Trends in promotion and tenure dossiers ● Societal impact ○ Citations to research in public policy documents, references in patents, and citations to research in various sources ● Educational impact ○ Articles and books in syllabi, data and other learning objects ● Public engagement and outreach ○ Press coverage, social media buzz, and downloads and views of scholarship and public dissemination of science

14. Scenario 2

15. Dr. Jennifer B Unger, PhD Professor of Preventive Medicine, Keck School of Medicine of USC

16. List of Dr. Unger’s publications with Plum Analytics “plum print”

17. More detailed view of one article

18. Learn about her related Twitter Activity per article

19. The universe is expanding

20. Why should you care about altmetrics? Citation counts lag Early career researchers Increased visibility of research Assessment and evaluation of research

24. Altmetrics can show you the money Big swing in funding from year to year Competition for research grants Showing clinical impact

25. In 2012, NIH promised to put aside 10% of their funds for AIDS research. In 2015, $3B was reduced to $65M put towards AIDS research.

27. “Over the next year, I will lead a dedicated, combined effort by governments, private industry, researchers, physicians, patients, and philanthropies to target investment, coordinate across silos, and increase access to information for everyone in the cancer community.” -President Barack Obama in “A Moonshot to Cure Cancer,” January 12, 2016

29. In 2015, NIH funded 1 of 5 people.

30. In 2015, 4 of 5 people did not get funded by NIH.

31. Clinical Citations

32. Basic medicine is cited 3 to 5 times more than clinical medicine and this is reflected in journal impact numbers.

33. Scenario 3

34. Clinical Citations with Plum Analytics print

35. More detailed view of one article

36. Detailed view of DynaMed Plus Topics tab

37. 4 major outputs for clinical citations Clinical alerting service

38. 4 major outputs for clinical citations Clinical guidelinesClinical alerting service

39. 4 major outputs for clinical citations Clinical guidelines Systematic reviews Clinical alerting service

40. 4 major outputs for clinical citations Clinical guidelines Systematic reviews Clinical alerting service Clinical Trials

41. Feedback changes behavior

42. Established researchers Early career researchers Archetypes within disciplines

43. Common FAQs (with some answers)

44. Gaming metrics Question: Traditional metrics can be gamed. How can this be avoided in altmetrics? Answer: ▪ Transparency of metrics ▪ PlumX doesn’t provide a score, but instead provides a data visualization ▪ No calculations on top of things and then hiding what went into it Example: Twitter!

45. Retractions Question: How does PlumX account for retracted articles? Answer: ▪ Plum captures that the article was retracted ▪ Also captures the activity around them ▪ Since Plum doesn’t offer a score, it’s not impacted

46. Health policy Question: Where are the altmetrics around health policy (the other side of clinical translational science)? Answer: ▪ They are working on it! They are in the stage of figuring out how to group the altmetrics data (comparing LIKE with LIKE) Stay tuned!

47. Thank you! muglia@usc.edu

48. Supplemental slides

49. NIH Biosketch “contributions to science” ● Historical background that frames the scientific problem ● Influence of the finding/s on the progress of science or the application to health or technology ● Your specific role in the described work ● List of up to four peer-reviewed publications or other non- publication research outputs for each contribution

50. Makes visible what was invisible. Makes measureable what was immeasurable.

51. Plum Analytics is part of CINAHL & EBSCOHost

52. Q u e s t i o n s Program director: Katja Reuter, PhD Email: katja.reuter@usc.edu Twitter: @dmsci Next Digital Scholar Webinar I n f o r m a t i o n a b o u t t h e p r o g r a m http://sc-ctsi.org/digital-scholar/ March 7, 2018/12-1PM PST Topic: Disseminating scientific research via Twitter: Practical insights and research evidence Speaker: Katja Reuter, PhD, Assistant Professor of Clinical Preventive Medicine, Department of Preventive Medicine, Keck School of Medicine of USC; Director of Digital Innovation and Communication, SC CTSI Register at: http://bit.ly/2FhOZ6d

Using alternative scholarly metrics to showcase the impact of your research: An introduction for researchers (February 7, 2018)

SC CTSI at USC and CHLA

Using alternative scholarly metrics to showcase the impact of your research: An introduction for researchers (February 7, 2018)