SlideShare une entreprise Scribd logo
1  sur  41
Investigating Impact Metrics for Performance
for the US EPA National Center for
Computational Toxicology
Antony Williams*, Monica Linnenbrink, Kevin Crofton,
Russell Thomas and Jeffery Edwards
National Center for Computational Toxicology
U.S. Environmental Protection Agency, RTP, NC
August 21-25, 2016
ACS Fall Meeting, Philadelphia, PA
http://www.orcid.org/0000-0002-2668-4821
The views expressed in this presentation are those of the author and do not necessarily reflect the views or policies of the U.S. EPA
Who is NCCT?
• National Center for Computational Toxicology – part of EPA’s
Office of Research and Development
• Research driven by the EPA’s Chemical Safety for
Sustainability Research Program
– Develop new approaches to evaluate the safety of chemicals
– Integrate advances in biology, biotechnology, chemistry, exposure
science and computer science
• Goal - To identify chemical exposures that may disrupt
biological processes and cause adverse outcomes.
• Can we quickly and cheaply evaluate thousands of chemicals
for potential risk?
1
What are our “products”?
• Our scientific publications and presentations
• Our research data
• Our software applications, code, algorithms and models
• Our collaborations
• Our trainings – postdoctoral researchers
• Our Scientific Leadership
2
What are our products?
• Our Scientific Publications and Presentations
https://cfpub.epa.gov/si/si_lab_search_results.cfm?fed_org_id=1267&SIType=PR&TIM
SType=Journal&showCriteria=0&view=citation&sortBy=pubDateYear
3
What are our products?
• Our Applications
4
What are our products?
• Our Data
https://www.epa.gov/chemical-research/downloadable-computational-toxicology-data
5
What are our products?
• Our collaborations
https://www.epa.gov/chemical-research/collaborative-agreements-computational-toxicology-research
6
What are our products?
• Our scientific leadership
https://www.epa.gov/chemical-research/toxicity-forecasting
7
How should our impact be measured?
• Classical measures of impact – publications (How many,
where published, how many times cited)
• The world of AltMetrics (http://altmetrics.org/manifesto/)
8
Altmetrics impact
• Scientific Publications and Presentations – how many
downloads, views, shares, tweets, embeds,
• Research data – downloads, uses, publications about
and citations to data
• Software applications, code, algorithms and models –
number of visitors, geography of visitors, number of
searches, amount of data downloaded, integration to
applications (web service access), resuse of code,
algorithms and models
9
Altmetrics impact
• Collaborations – funding of external work, provision of
ToxCast plated materials,
• Training – postdoctoral researchers – what careers do
they have when they leave NCCT?
• Scientific Leadership – contributions to EPA policy
documents
10
Scientist AltMetrics
• Many Social and Altmetric platforms in recent
years…
• …and publishers use these for tracking, assisting
distribution and for amplification 11
Article Metrics: e.g. PLoS
http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0062325
12
PLoS Article
http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0062325
13
Scientists Identifier: ORCiD
14
ORCiD
15
PlumX: Scientists AltMetrics
https://plu.mx/u/awilliams/
16
PlumX: Scientists AltMetrics
https://plu.mx/u/awilliams/
17
PlumX: Article Level Metrics
https://plu.mx/u/awilliams/
18
AltMetric: Article Level Metrics
https://www.altmetric.com/details/1425979?src=bookmarklet
19
AltMetric: Geographical Metrics
20
GrowKudos: Article Level Data
21
GrowKudos: Article Level Metrics
22
GrowKudos integrating AltMetric
23
Altmetric Widgets
http://api.altmetric.com/embeds.html
24
Kudos Widgets
https://www.growkudos.com/about/user_guide
25
PlumX Widget
26
Integrating Data
• Tools can provide BOTH scientist level
and article level metrics and activities
• NCCT wants to aggregate the activities
of the Center – including through our
scientists and our publications. But also all
of our other “products”…
• Aggregation into one website is underway
27
What we are building…
MOCKUP: Landing Page
28
Scientific Papers: All NCCT
What we would like…
MOCKUP: Publications
Scientific Papers: By Author
What we would like…
MOCKUP: Scientists
Data & Tools: ToxCast Data Download Web
0
50
100
150
200
1-Sep-2015 1-Oct-2015 1-Nov-2015 1-Dec-2015 1-Jan-2016 1-Feb-2016
ToxCast Data Download Webpage Traffic (Daily)
Pageviews Unique Pageviews
0
500
1,000
1,500
2,000
2,500
September '15 October '15 November '15 December '15 January '16 February '16
ToxCast Data Download Webpage Traffic (Monthly)
Pageviews Unique Pageviews
What we would like…
MOCKUP: Data Usage
Data & Tools:ToxCast Data Download Web Demographics
Top Users by Country
1. United States 1,715
2. Germany 170
3. United Kingdom 148
4. Canada 120
5. France 119
6. China 117
7. Japan 84
8. Italy 78
9. South Korea 60
10.Switzerland 56
1
23
4
5
6 78 9
10
What we would like…
MOCKUP: Geographic Access
Interest and Use: 2014 Stakeholder Workshop Survey Results
60%
13%
27%
ToxCast Data
Very Satisfied
Satisfied
Neither Satisfied or
Dissatisfied
Dissatisfied
13%
34%
20%
33%
iCSS Dashboard
Very Satisfied
Satisfied
Neither Satisfied or
Dissatisfied
27%
66%
7%
Workshop
improved
understanding of
data/tools and
use of them
Strongly Agree
Agree
Undecided
Disagree
Strongly Disagree
What we would like…
MOCKUP: Aggregating Feedback
Publications: Using Widgets
34
• We are investigating AltMetric, PlumX and Kudos Widgets
Publications: AltMetric Widget
35
• AltMetric will give us access to social sharing statistics
and other stats
Publications: PlumX Widget
36
• PlumX will give us access to social sharing
statistics and other publication stats
Publications: Kudos Widget
37
• Kudos will provide
details of social
shares and article
“enrichment”
App Analytics: Google
38
The Power of a Tweet
Work in Progress
• Investigating VIVO Open Source
• Data model in development
• ORCiDs for people, DOIs for papers
• Will integrate AltMetric, PlumX and
Kudos embeddable widgets
39
• Integrate existing
EPA tracking
systems – e.g. EPA
Science Inventory
Our center – A BIG Impact!
We are out to measure it…
40

Contenu connexe

Tendances

Encouraging undergraduate students to participate as authors of scientific pu...
Encouraging undergraduate students to participate as authors of scientific pu...Encouraging undergraduate students to participate as authors of scientific pu...
Encouraging undergraduate students to participate as authors of scientific pu...
US Environmental Protection Agency (EPA), Center for Computational Toxicology and Exposure
 
eScience at the Royal Society of Chemistry and our current initiatives
eScience at the Royal Society of Chemistry and our current initiativeseScience at the Royal Society of Chemistry and our current initiatives
eScience at the Royal Society of Chemistry and our current initiatives
US Environmental Protection Agency (EPA), Center for Computational Toxicology and Exposure
 
How the InChI identifier is used to underpin our online chemistry databases a...
How the InChI identifier is used to underpin our online chemistry databases a...How the InChI identifier is used to underpin our online chemistry databases a...
How the InChI identifier is used to underpin our online chemistry databases a...
US Environmental Protection Agency (EPA), Center for Computational Toxicology and Exposure
 
Sharing chemical structures with peer reviewed publications
Sharing chemical structures with peer reviewed publications Sharing chemical structures with peer reviewed publications
Sharing chemical structures with peer reviewed publications
US Environmental Protection Agency (EPA), Center for Computational Toxicology and Exposure
 
The UK National Chemical Database Service – an integration of commercial and ...
The UK National Chemical Database Service – an integration of commercial and ...The UK National Chemical Database Service – an integration of commercial and ...
The UK National Chemical Database Service – an integration of commercial and ...
US Environmental Protection Agency (EPA), Center for Computational Toxicology and Exposure
 
US EPA CompTox Chemistry Dashboard as a source of data to fill data gaps for ...
US EPA CompTox Chemistry Dashboard as a source of data to fill data gaps for ...US EPA CompTox Chemistry Dashboard as a source of data to fill data gaps for ...
US EPA CompTox Chemistry Dashboard as a source of data to fill data gaps for ...
US Environmental Protection Agency (EPA), Center for Computational Toxicology and Exposure
 
The future of scientific information & communication
The future of scientific information & communicationThe future of scientific information & communication
Activities at the Royal Society of Chemistry to gather, extract and analyze b...
Activities at the Royal Society of Chemistry to gather, extract and analyze b...Activities at the Royal Society of Chemistry to gather, extract and analyze b...
Activities at the Royal Society of Chemistry to gather, extract and analyze b...
US Environmental Protection Agency (EPA), Center for Computational Toxicology and Exposure
 
Delivering The Benefits of Chemical-Biological Integration in Computational T...
Delivering The Benefits of Chemical-Biological Integration in Computational T...Delivering The Benefits of Chemical-Biological Integration in Computational T...
Delivering The Benefits of Chemical-Biological Integration in Computational T...
US Environmental Protection Agency (EPA), Center for Computational Toxicology and Exposure
 

Tendances (20)

A chemistry data repository to serve them all
A chemistry data repository to serve them allA chemistry data repository to serve them all
A chemistry data repository to serve them all
 
The needs for chemistry standards, database tools and data curation at the ch...
The needs for chemistry standards, database tools and data curation at the ch...The needs for chemistry standards, database tools and data curation at the ch...
The needs for chemistry standards, database tools and data curation at the ch...
 
Encouraging undergraduate students to participate as authors of scientific pu...
Encouraging undergraduate students to participate as authors of scientific pu...Encouraging undergraduate students to participate as authors of scientific pu...
Encouraging undergraduate students to participate as authors of scientific pu...
 
Overview of open resources to support automated structure verification and e...
Overview of open resources to support automated structure verification  and e...Overview of open resources to support automated structure verification  and e...
Overview of open resources to support automated structure verification and e...
 
An examination of data quality on QSAR Modeling in regards to the environment...
An examination of data quality on QSAR Modeling in regards to the environment...An examination of data quality on QSAR Modeling in regards to the environment...
An examination of data quality on QSAR Modeling in regards to the environment...
 
eScience Resources for the Chemistry Community from the Royal Society of Chem...
eScience Resources for the Chemistry Community from the Royal Society of Chem...eScience Resources for the Chemistry Community from the Royal Society of Chem...
eScience Resources for the Chemistry Community from the Royal Society of Chem...
 
Royal society of chemistry activities to develop a data repository for chemis...
Royal society of chemistry activities to develop a data repository for chemis...Royal society of chemistry activities to develop a data repository for chemis...
Royal society of chemistry activities to develop a data repository for chemis...
 
eScience at the Royal Society of Chemistry and our current initiatives
eScience at the Royal Society of Chemistry and our current initiativeseScience at the Royal Society of Chemistry and our current initiatives
eScience at the Royal Society of Chemistry and our current initiatives
 
Delivering The Benefits of Chemical-Biological Integration in Computational T...
Delivering The Benefits of Chemical-Biological Integration in Computational T...Delivering The Benefits of Chemical-Biological Integration in Computational T...
Delivering The Benefits of Chemical-Biological Integration in Computational T...
 
How the InChI identifier is used to underpin our online chemistry databases a...
How the InChI identifier is used to underpin our online chemistry databases a...How the InChI identifier is used to underpin our online chemistry databases a...
How the InChI identifier is used to underpin our online chemistry databases a...
 
Sharing chemical structures with peer reviewed publications
Sharing chemical structures with peer reviewed publications Sharing chemical structures with peer reviewed publications
Sharing chemical structures with peer reviewed publications
 
ChemSpider – disseminating data and enabling an abundance of chemistry platforms
ChemSpider – disseminating data and enabling an abundance of chemistry platformsChemSpider – disseminating data and enabling an abundance of chemistry platforms
ChemSpider – disseminating data and enabling an abundance of chemistry platforms
 
The UK National Chemical Database Service – an integration of commercial and ...
The UK National Chemical Database Service – an integration of commercial and ...The UK National Chemical Database Service – an integration of commercial and ...
The UK National Chemical Database Service – an integration of commercial and ...
 
US EPA CompTox Chemistry Dashboard as a source of data to fill data gaps for ...
US EPA CompTox Chemistry Dashboard as a source of data to fill data gaps for ...US EPA CompTox Chemistry Dashboard as a source of data to fill data gaps for ...
US EPA CompTox Chemistry Dashboard as a source of data to fill data gaps for ...
 
The future of scientific information & communication
The future of scientific information & communicationThe future of scientific information & communication
The future of scientific information & communication
 
Dealing with the complex challenge of managing diverse analytical chemistry d...
Dealing with the complex challenge of managing diverse analytical chemistry d...Dealing with the complex challenge of managing diverse analytical chemistry d...
Dealing with the complex challenge of managing diverse analytical chemistry d...
 
Activities at the Royal Society of Chemistry to gather, extract and analyze b...
Activities at the Royal Society of Chemistry to gather, extract and analyze b...Activities at the Royal Society of Chemistry to gather, extract and analyze b...
Activities at the Royal Society of Chemistry to gather, extract and analyze b...
 
ChemSpider as an integration hub for interlinked chemistry data
ChemSpider as an integration hub for interlinked chemistry dataChemSpider as an integration hub for interlinked chemistry data
ChemSpider as an integration hub for interlinked chemistry data
 
The EPA iCSS Chemistry Dashboard to Support Compound Identification Using Hig...
The EPA iCSS Chemistry Dashboard to Support Compound Identification Using Hig...The EPA iCSS Chemistry Dashboard to Support Compound Identification Using Hig...
The EPA iCSS Chemistry Dashboard to Support Compound Identification Using Hig...
 
Delivering The Benefits of Chemical-Biological Integration in Computational T...
Delivering The Benefits of Chemical-Biological Integration in Computational T...Delivering The Benefits of Chemical-Biological Integration in Computational T...
Delivering The Benefits of Chemical-Biological Integration in Computational T...
 

En vedette

The influence of data curation on QSAR Modeling – examining issues of qualit...
 The influence of data curation on QSAR Modeling – examining issues of qualit... The influence of data curation on QSAR Modeling – examining issues of qualit...
The influence of data curation on QSAR Modeling – examining issues of qualit...
US Environmental Protection Agency (EPA), Center for Computational Toxicology and Exposure
 
Structure Identification Using High Resolution Mass Spectrometry Data and the...
Structure Identification Using High Resolution Mass Spectrometry Data and the...Structure Identification Using High Resolution Mass Spectrometry Data and the...
Structure Identification Using High Resolution Mass Spectrometry Data and the...
US Environmental Protection Agency (EPA), Center for Computational Toxicology and Exposure
 
The EPA Online Prediction Physicochemical Prediction Platform to Support Envi...
The EPA Online Prediction Physicochemical Prediction Platform to Support Envi...The EPA Online Prediction Physicochemical Prediction Platform to Support Envi...
The EPA Online Prediction Physicochemical Prediction Platform to Support Envi...
US Environmental Protection Agency (EPA), Center for Computational Toxicology and Exposure
 
Shaping Expectations: Defining and Refining the Role of Technical Services in...
Shaping Expectations: Defining and Refining the Role of Technical Services in...Shaping Expectations: Defining and Refining the Role of Technical Services in...
Shaping Expectations: Defining and Refining the Role of Technical Services in...
NASIG
 
Building an Online Profile Using Social Networking and Amplification Tools fo...
Building an Online Profile Using Social Networking and Amplification Tools fo...Building an Online Profile Using Social Networking and Amplification Tools fo...
Building an Online Profile Using Social Networking and Amplification Tools fo...
US Environmental Protection Agency (EPA), Center for Computational Toxicology and Exposure
 

En vedette (20)

Social Media Tools for Scientists and Building an Online Profile
Social Media Tools for Scientists and Building an Online ProfileSocial Media Tools for Scientists and Building an Online Profile
Social Media Tools for Scientists and Building an Online Profile
 
Open PHACTS Chemistry Platform Update and Learnings
Open PHACTS Chemistry Platform Update and Learnings Open PHACTS Chemistry Platform Update and Learnings
Open PHACTS Chemistry Platform Update and Learnings
 
From Data Availability to Information Accessibility: The WellWiki Project
From Data Availability to Information Accessibility: The WellWiki ProjectFrom Data Availability to Information Accessibility: The WellWiki Project
From Data Availability to Information Accessibility: The WellWiki Project
 
NSF Data Management Requirements 101
NSF Data Management Requirements 101NSF Data Management Requirements 101
NSF Data Management Requirements 101
 
Simple Springshare Mashups: Cross-Platform Strategies for Repurposing Digital...
Simple Springshare Mashups: Cross-Platform Strategies for Repurposing Digital...Simple Springshare Mashups: Cross-Platform Strategies for Repurposing Digital...
Simple Springshare Mashups: Cross-Platform Strategies for Repurposing Digital...
 
Using Ecological Momentary Assessment to Examine Post-food Consumption Affect...
Using Ecological Momentary Assessment to Examine Post-food Consumption Affect...Using Ecological Momentary Assessment to Examine Post-food Consumption Affect...
Using Ecological Momentary Assessment to Examine Post-food Consumption Affect...
 
The influence of data curation on QSAR Modeling – examining issues of qualit...
 The influence of data curation on QSAR Modeling – examining issues of qualit... The influence of data curation on QSAR Modeling – examining issues of qualit...
The influence of data curation on QSAR Modeling – examining issues of qualit...
 
SMS Berlin 2016 Cultural Perspectives on Strategic Management
SMS Berlin 2016 Cultural Perspectives on Strategic ManagementSMS Berlin 2016 Cultural Perspectives on Strategic Management
SMS Berlin 2016 Cultural Perspectives on Strategic Management
 
Structure Identification Using High Resolution Mass Spectrometry Data and the...
Structure Identification Using High Resolution Mass Spectrometry Data and the...Structure Identification Using High Resolution Mass Spectrometry Data and the...
Structure Identification Using High Resolution Mass Spectrometry Data and the...
 
Structure Identification Using High Resolution Mass Spectrometry Data and the...
Structure Identification Using High Resolution Mass Spectrometry Data and the...Structure Identification Using High Resolution Mass Spectrometry Data and the...
Structure Identification Using High Resolution Mass Spectrometry Data and the...
 
Environmental Chemistry Compound Identification Using High Resolution Mass Sp...
Environmental Chemistry Compound Identification Using High Resolution Mass Sp...Environmental Chemistry Compound Identification Using High Resolution Mass Sp...
Environmental Chemistry Compound Identification Using High Resolution Mass Sp...
 
Structure Identification Using High Resolution Mass Spectrometry Data and the...
Structure Identification Using High Resolution Mass Spectrometry Data and the...Structure Identification Using High Resolution Mass Spectrometry Data and the...
Structure Identification Using High Resolution Mass Spectrometry Data and the...
 
The EPA Online Prediction Physicochemical Prediction Platform to Support Envi...
The EPA Online Prediction Physicochemical Prediction Platform to Support Envi...The EPA Online Prediction Physicochemical Prediction Platform to Support Envi...
The EPA Online Prediction Physicochemical Prediction Platform to Support Envi...
 
A Bird in the Hand: Leveraging ILL Requests to Improve Electronic Resource A...
A Bird in the Hand: Leveraging ILL Requests to Improve Electronic Resource A...A Bird in the Hand: Leveraging ILL Requests to Improve Electronic Resource A...
A Bird in the Hand: Leveraging ILL Requests to Improve Electronic Resource A...
 
Shaping Expectations: Defining and Refining the Role of Technical Services in...
Shaping Expectations: Defining and Refining the Role of Technical Services in...Shaping Expectations: Defining and Refining the Role of Technical Services in...
Shaping Expectations: Defining and Refining the Role of Technical Services in...
 
Building an Online Profile Using Social Networking and Amplification Tools fo...
Building an Online Profile Using Social Networking and Amplification Tools fo...Building an Online Profile Using Social Networking and Amplification Tools fo...
Building an Online Profile Using Social Networking and Amplification Tools fo...
 
Web Preservation, or Managing your Organisation’s Online Presence After the O...
Web Preservation, or Managing your Organisation’s Online Presence After the O...Web Preservation, or Managing your Organisation’s Online Presence After the O...
Web Preservation, or Managing your Organisation’s Online Presence After the O...
 
Going Concerns: A Perspective from the Nexus of Business, Culture and Instit...
Going Concerns:  A Perspective from the Nexus of Business, Culture and Instit...Going Concerns:  A Perspective from the Nexus of Business, Culture and Instit...
Going Concerns: A Perspective from the Nexus of Business, Culture and Instit...
 
2016 davis-plantbio
2016 davis-plantbio2016 davis-plantbio
2016 davis-plantbio
 
2016 bergen-sars
2016 bergen-sars2016 bergen-sars
2016 bergen-sars
 

Similaire à Investigating Impact Metrics for Performance for the US-EPA National Center for Computational Toxicology

Similaire à Investigating Impact Metrics for Performance for the US-EPA National Center for Computational Toxicology (20)

Smarter Data for Smarter Libraries
Smarter Data for Smarter LibrariesSmarter Data for Smarter Libraries
Smarter Data for Smarter Libraries
 
Stakeholder Outreach and Engagement - Encouraging Use of New Scientific Data
Stakeholder Outreach and Engagement - Encouraging Use of New Scientific DataStakeholder Outreach and Engagement - Encouraging Use of New Scientific Data
Stakeholder Outreach and Engagement - Encouraging Use of New Scientific Data
 
Practical applications for altmetrics in a changing metrics landscape
Practical applications for altmetrics in a changing metrics landscapePractical applications for altmetrics in a changing metrics landscape
Practical applications for altmetrics in a changing metrics landscape
 
Social Networking Tools for Scientists and Building an Online Profile
Social Networking Tools for Scientists and Building an Online ProfileSocial Networking Tools for Scientists and Building an Online Profile
Social Networking Tools for Scientists and Building an Online Profile
 
WhiteSource Webinar-New Research Reveals Key Strategy to Manage Open Source S...
WhiteSource Webinar-New Research Reveals Key Strategy to Manage Open Source S...WhiteSource Webinar-New Research Reveals Key Strategy to Manage Open Source S...
WhiteSource Webinar-New Research Reveals Key Strategy to Manage Open Source S...
 
Measuring impact
Measuring impactMeasuring impact
Measuring impact
 
Building an Online Profile Using Social Networking Tools
Building an Online Profile Using Social Networking ToolsBuilding an Online Profile Using Social Networking Tools
Building an Online Profile Using Social Networking Tools
 
NHS Choices: Managing complex infrastructure to deliver critical online services
NHS Choices: Managing complex infrastructure to deliver critical online servicesNHS Choices: Managing complex infrastructure to deliver critical online services
NHS Choices: Managing complex infrastructure to deliver critical online services
 
MediaEval 2018: NewsREEL Multimedia at MediaEval 2018: News Recommendation wi...
MediaEval 2018: NewsREEL Multimedia at MediaEval 2018: News Recommendation wi...MediaEval 2018: NewsREEL Multimedia at MediaEval 2018: News Recommendation wi...
MediaEval 2018: NewsREEL Multimedia at MediaEval 2018: News Recommendation wi...
 
Agile data science
Agile data scienceAgile data science
Agile data science
 
Altmetrics for Team Science
Altmetrics for Team ScienceAltmetrics for Team Science
Altmetrics for Team Science
 
Challenging cajoling and rewarding the community for their contributions to o...
Challenging cajoling and rewarding the community for their contributions to o...Challenging cajoling and rewarding the community for their contributions to o...
Challenging cajoling and rewarding the community for their contributions to o...
 
Better software, better service, better research: The Software Sustainabilit...
Better software, better service, better research: The Software Sustainabilit...Better software, better service, better research: The Software Sustainabilit...
Better software, better service, better research: The Software Sustainabilit...
 
Extending and measuring the reach and impact of research output: #openaccess,...
Extending and measuring the reach and impact of research output: #openaccess,...Extending and measuring the reach and impact of research output: #openaccess,...
Extending and measuring the reach and impact of research output: #openaccess,...
 
Learning Exchange May 15 - Extending and measuring reach and impact of resear...
Learning Exchange May 15 - Extending and measuring reach and impact of resear...Learning Exchange May 15 - Extending and measuring reach and impact of resear...
Learning Exchange May 15 - Extending and measuring reach and impact of resear...
 
NISO Altmetrics Initiative: A Project Update - Martin Fenner, Technical Lead ...
NISO Altmetrics Initiative: A Project Update - Martin Fenner, Technical Lead ...NISO Altmetrics Initiative: A Project Update - Martin Fenner, Technical Lead ...
NISO Altmetrics Initiative: A Project Update - Martin Fenner, Technical Lead ...
 
Ilik - Beyond the Manuscript: Using IRs for Non Traditional Content Types
Ilik - Beyond the Manuscript: Using IRs for Non Traditional Content TypesIlik - Beyond the Manuscript: Using IRs for Non Traditional Content Types
Ilik - Beyond the Manuscript: Using IRs for Non Traditional Content Types
 
Public engagement while you sleep
Public engagement while you sleepPublic engagement while you sleep
Public engagement while you sleep
 
Delivering chemical-associated data via EPA web applications
Delivering chemical-associated data via EPA web applicationsDelivering chemical-associated data via EPA web applications
Delivering chemical-associated data via EPA web applications
 
NISO Altmetrics Recommended Practice 3:AM Conference presentation
NISO Altmetrics Recommended Practice 3:AM Conference presentationNISO Altmetrics Recommended Practice 3:AM Conference presentation
NISO Altmetrics Recommended Practice 3:AM Conference presentation
 

Dernier

Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune WaterworldsBiogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Sérgio Sacani
 
Module for Grade 9 for Asynchronous/Distance learning
Module for Grade 9 for Asynchronous/Distance learningModule for Grade 9 for Asynchronous/Distance learning
Module for Grade 9 for Asynchronous/Distance learning
levieagacer
 
Bacterial Identification and Classifications
Bacterial Identification and ClassificationsBacterial Identification and Classifications
Bacterial Identification and Classifications
Areesha Ahmad
 
Pests of mustard_Identification_Management_Dr.UPR.pdf
Pests of mustard_Identification_Management_Dr.UPR.pdfPests of mustard_Identification_Management_Dr.UPR.pdf
Pests of mustard_Identification_Management_Dr.UPR.pdf
PirithiRaju
 
SCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptx
SCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptxSCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptx
SCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptx
RizalinePalanog2
 
biology HL practice questions IB BIOLOGY
biology HL practice questions IB BIOLOGYbiology HL practice questions IB BIOLOGY
biology HL practice questions IB BIOLOGY
1301aanya
 
Introduction,importance and scope of horticulture.pptx
Introduction,importance and scope of horticulture.pptxIntroduction,importance and scope of horticulture.pptx
Introduction,importance and scope of horticulture.pptx
Bhagirath Gogikar
 

Dernier (20)

Unit5-Cloud.pptx for lpu course cse121 o
Unit5-Cloud.pptx for lpu course cse121 oUnit5-Cloud.pptx for lpu course cse121 o
Unit5-Cloud.pptx for lpu course cse121 o
 
Site Acceptance Test .
Site Acceptance Test                    .Site Acceptance Test                    .
Site Acceptance Test .
 
9999266834 Call Girls In Noida Sector 22 (Delhi) Call Girl Service
9999266834 Call Girls In Noida Sector 22 (Delhi) Call Girl Service9999266834 Call Girls In Noida Sector 22 (Delhi) Call Girl Service
9999266834 Call Girls In Noida Sector 22 (Delhi) Call Girl Service
 
COMPUTING ANTI-DERIVATIVES (Integration by SUBSTITUTION)
COMPUTING ANTI-DERIVATIVES(Integration by SUBSTITUTION)COMPUTING ANTI-DERIVATIVES(Integration by SUBSTITUTION)
COMPUTING ANTI-DERIVATIVES (Integration by SUBSTITUTION)
 
GBSN - Microbiology (Unit 1)
GBSN - Microbiology (Unit 1)GBSN - Microbiology (Unit 1)
GBSN - Microbiology (Unit 1)
 
9654467111 Call Girls In Raj Nagar Delhi Short 1500 Night 6000
9654467111 Call Girls In Raj Nagar Delhi Short 1500 Night 60009654467111 Call Girls In Raj Nagar Delhi Short 1500 Night 6000
9654467111 Call Girls In Raj Nagar Delhi Short 1500 Night 6000
 
STS-UNIT 4 CLIMATE CHANGE POWERPOINT PRESENTATION
STS-UNIT 4 CLIMATE CHANGE POWERPOINT PRESENTATIONSTS-UNIT 4 CLIMATE CHANGE POWERPOINT PRESENTATION
STS-UNIT 4 CLIMATE CHANGE POWERPOINT PRESENTATION
 
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune WaterworldsBiogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
 
High Class Escorts in Hyderabad ₹7.5k Pick Up & Drop With Cash Payment 969456...
High Class Escorts in Hyderabad ₹7.5k Pick Up & Drop With Cash Payment 969456...High Class Escorts in Hyderabad ₹7.5k Pick Up & Drop With Cash Payment 969456...
High Class Escorts in Hyderabad ₹7.5k Pick Up & Drop With Cash Payment 969456...
 
Module for Grade 9 for Asynchronous/Distance learning
Module for Grade 9 for Asynchronous/Distance learningModule for Grade 9 for Asynchronous/Distance learning
Module for Grade 9 for Asynchronous/Distance learning
 
Bacterial Identification and Classifications
Bacterial Identification and ClassificationsBacterial Identification and Classifications
Bacterial Identification and Classifications
 
Pests of mustard_Identification_Management_Dr.UPR.pdf
Pests of mustard_Identification_Management_Dr.UPR.pdfPests of mustard_Identification_Management_Dr.UPR.pdf
Pests of mustard_Identification_Management_Dr.UPR.pdf
 
SCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptx
SCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptxSCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptx
SCIENCE-4-QUARTER4-WEEK-4-PPT-1 (1).pptx
 
pumpkin fruit fly, water melon fruit fly, cucumber fruit fly
pumpkin fruit fly, water melon fruit fly, cucumber fruit flypumpkin fruit fly, water melon fruit fly, cucumber fruit fly
pumpkin fruit fly, water melon fruit fly, cucumber fruit fly
 
biology HL practice questions IB BIOLOGY
biology HL practice questions IB BIOLOGYbiology HL practice questions IB BIOLOGY
biology HL practice questions IB BIOLOGY
 
Introduction,importance and scope of horticulture.pptx
Introduction,importance and scope of horticulture.pptxIntroduction,importance and scope of horticulture.pptx
Introduction,importance and scope of horticulture.pptx
 
PSYCHOSOCIAL NEEDS. in nursing II sem pptx
PSYCHOSOCIAL NEEDS. in nursing II sem pptxPSYCHOSOCIAL NEEDS. in nursing II sem pptx
PSYCHOSOCIAL NEEDS. in nursing II sem pptx
 
Dopamine neurotransmitter determination using graphite sheet- graphene nano-s...
Dopamine neurotransmitter determination using graphite sheet- graphene nano-s...Dopamine neurotransmitter determination using graphite sheet- graphene nano-s...
Dopamine neurotransmitter determination using graphite sheet- graphene nano-s...
 
IDENTIFICATION OF THE LIVING- forensic medicine
IDENTIFICATION OF THE LIVING- forensic medicineIDENTIFICATION OF THE LIVING- forensic medicine
IDENTIFICATION OF THE LIVING- forensic medicine
 
GBSN - Microbiology (Unit 3)
GBSN - Microbiology (Unit 3)GBSN - Microbiology (Unit 3)
GBSN - Microbiology (Unit 3)
 

Investigating Impact Metrics for Performance for the US-EPA National Center for Computational Toxicology

  • 1. Investigating Impact Metrics for Performance for the US EPA National Center for Computational Toxicology Antony Williams*, Monica Linnenbrink, Kevin Crofton, Russell Thomas and Jeffery Edwards National Center for Computational Toxicology U.S. Environmental Protection Agency, RTP, NC August 21-25, 2016 ACS Fall Meeting, Philadelphia, PA http://www.orcid.org/0000-0002-2668-4821 The views expressed in this presentation are those of the author and do not necessarily reflect the views or policies of the U.S. EPA
  • 2. Who is NCCT? • National Center for Computational Toxicology – part of EPA’s Office of Research and Development • Research driven by the EPA’s Chemical Safety for Sustainability Research Program – Develop new approaches to evaluate the safety of chemicals – Integrate advances in biology, biotechnology, chemistry, exposure science and computer science • Goal - To identify chemical exposures that may disrupt biological processes and cause adverse outcomes. • Can we quickly and cheaply evaluate thousands of chemicals for potential risk? 1
  • 3. What are our “products”? • Our scientific publications and presentations • Our research data • Our software applications, code, algorithms and models • Our collaborations • Our trainings – postdoctoral researchers • Our Scientific Leadership 2
  • 4. What are our products? • Our Scientific Publications and Presentations https://cfpub.epa.gov/si/si_lab_search_results.cfm?fed_org_id=1267&SIType=PR&TIM SType=Journal&showCriteria=0&view=citation&sortBy=pubDateYear 3
  • 5. What are our products? • Our Applications 4
  • 6. What are our products? • Our Data https://www.epa.gov/chemical-research/downloadable-computational-toxicology-data 5
  • 7. What are our products? • Our collaborations https://www.epa.gov/chemical-research/collaborative-agreements-computational-toxicology-research 6
  • 8. What are our products? • Our scientific leadership https://www.epa.gov/chemical-research/toxicity-forecasting 7
  • 9. How should our impact be measured? • Classical measures of impact – publications (How many, where published, how many times cited) • The world of AltMetrics (http://altmetrics.org/manifesto/) 8
  • 10. Altmetrics impact • Scientific Publications and Presentations – how many downloads, views, shares, tweets, embeds, • Research data – downloads, uses, publications about and citations to data • Software applications, code, algorithms and models – number of visitors, geography of visitors, number of searches, amount of data downloaded, integration to applications (web service access), resuse of code, algorithms and models 9
  • 11. Altmetrics impact • Collaborations – funding of external work, provision of ToxCast plated materials, • Training – postdoctoral researchers – what careers do they have when they leave NCCT? • Scientific Leadership – contributions to EPA policy documents 10
  • 12. Scientist AltMetrics • Many Social and Altmetric platforms in recent years… • …and publishers use these for tracking, assisting distribution and for amplification 11
  • 13. Article Metrics: e.g. PLoS http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0062325 12
  • 19. PlumX: Article Level Metrics https://plu.mx/u/awilliams/ 18
  • 20. AltMetric: Article Level Metrics https://www.altmetric.com/details/1425979?src=bookmarklet 19
  • 28. Integrating Data • Tools can provide BOTH scientist level and article level metrics and activities • NCCT wants to aggregate the activities of the Center – including through our scientists and our publications. But also all of our other “products”… • Aggregation into one website is underway 27
  • 29. What we are building… MOCKUP: Landing Page 28
  • 30. Scientific Papers: All NCCT What we would like… MOCKUP: Publications
  • 31. Scientific Papers: By Author What we would like… MOCKUP: Scientists
  • 32. Data & Tools: ToxCast Data Download Web 0 50 100 150 200 1-Sep-2015 1-Oct-2015 1-Nov-2015 1-Dec-2015 1-Jan-2016 1-Feb-2016 ToxCast Data Download Webpage Traffic (Daily) Pageviews Unique Pageviews 0 500 1,000 1,500 2,000 2,500 September '15 October '15 November '15 December '15 January '16 February '16 ToxCast Data Download Webpage Traffic (Monthly) Pageviews Unique Pageviews What we would like… MOCKUP: Data Usage
  • 33. Data & Tools:ToxCast Data Download Web Demographics Top Users by Country 1. United States 1,715 2. Germany 170 3. United Kingdom 148 4. Canada 120 5. France 119 6. China 117 7. Japan 84 8. Italy 78 9. South Korea 60 10.Switzerland 56 1 23 4 5 6 78 9 10 What we would like… MOCKUP: Geographic Access
  • 34. Interest and Use: 2014 Stakeholder Workshop Survey Results 60% 13% 27% ToxCast Data Very Satisfied Satisfied Neither Satisfied or Dissatisfied Dissatisfied 13% 34% 20% 33% iCSS Dashboard Very Satisfied Satisfied Neither Satisfied or Dissatisfied 27% 66% 7% Workshop improved understanding of data/tools and use of them Strongly Agree Agree Undecided Disagree Strongly Disagree What we would like… MOCKUP: Aggregating Feedback
  • 35. Publications: Using Widgets 34 • We are investigating AltMetric, PlumX and Kudos Widgets
  • 36. Publications: AltMetric Widget 35 • AltMetric will give us access to social sharing statistics and other stats
  • 37. Publications: PlumX Widget 36 • PlumX will give us access to social sharing statistics and other publication stats
  • 38. Publications: Kudos Widget 37 • Kudos will provide details of social shares and article “enrichment”
  • 39. App Analytics: Google 38 The Power of a Tweet
  • 40. Work in Progress • Investigating VIVO Open Source • Data model in development • ORCiDs for people, DOIs for papers • Will integrate AltMetric, PlumX and Kudos embeddable widgets 39 • Integrate existing EPA tracking systems – e.g. EPA Science Inventory
  • 41. Our center – A BIG Impact! We are out to measure it… 40