Presentation by Heather Piwowar on Nov 15, 2012 in a webinar hosted by EdFuture 2012 #CFHE12

1. Impact
beyond the
Impact Factor
Heather
Piwowar
@researchremix
cofounder
of
@ImpactStory
EdFuture
2012
some photos NC, SA
#CFHE12

2. Research evaluation
matters

3. who gets hired
who gets grants
which journals succeed
which journal innovations succeed
whether we publish in journals at all
whether we actually write articles
the whole structure of scientific communication

4. right now, impact factor

5. evaluated based on the container
that publishes the research

6. impact factor is
the average number of citations
received by an article in that journal
within first 2 years of publication

7. rewards impact
based on a journal pecking order

8. right now, evaluation looks like this

9. problems!
prefiltered
run-away hits
decision of 4 anonymous people
only one type of impact
favours established venues
expensive
closed

10. Impact
beyond the
Impact Factor
pause for Qs (h:mute)

11. what can the world
look like

12. beyond the
Impact Factor

14. http://www.flickr.com/photos/pixscapes/4331070047

20. right now, evaluation looks like this

21. it can look like this

23. even better, it can look like this

24. not just for articles

25. not just two years from now
http://arxiv.org/html/1203.4745

26. not just on a website

27. not just winners and losers
impact flavors!
CC-BY-NC by maniacyak on flickr
http://www.flickr.com/photos/maniacyak/3432589472

28. #altmetrics
fast
flavourful
open
with context
beyond the article

29. altmetrics.org/tools
Altmetric.com
ImpactStory
PLOS article-level metrics
Plum Analytics
Reader Meter
Science Card

31. Impact
beyond the
Impact Factor
pause for Qs (h:mute)

33. Tell the full story of
research impact.
ImpactStory.org

34. born as total-impact
Nonprofit
Board:
Cameron Neylon, John Wilbanks

44. http://www.flickr.com/photos/quinnanya/2055471833

46. embedding in journals
rOpenSci
Plum demo
Ubiquity Press
PeerEv
dissertations
IR experiments
...

49. barrier-based $$

51. barrier-based pond

52. http://flickr.com/photos/nieve44/2152712789/

53. ImpactStory.org
altmetrics.org/tools

54. Changes are happening in
scholarly communication.
http://www.flickr.com/photos/myklroventine/892446624/

55. http://www.flickr.com/photos/jo-h/2688026447/

56. Tell the full story of
our research impact.

57. thank you!
Jason Priem: cofounder of ImpactStory
Also: Todd Vision, Mike Whitlock, the open science community, and
those who release their articles, datasets and photos openly.
blog.ImpactStory.org
team@ImpactStory.org
@ImpactStory
ImpactStory.org