Presentation given by Jackie Cohen on April 24, 2014 at the Open CourseWare Consortium Global Conference in Slovenia. Abstract - http://conference.ocwconsortium.org/2014/ai1ec_event/a-framework-to-integrate-public-dynamic-metrics-into-an-oer-platform-jaclyn-cohen-and-kathleen-omollo/?instance_id=542 Paper - http://openpraxis.org/index.php/OpenPraxis/article/view/118 or http://deepblue.lib.umich.edu/handle/2027.42/106587

1. A Framework to Integrate Public,
Dynamic Metrics into an OER Platform
Jaclyn Zetta Cohen, Kathleen Ludewig Omollo, Dave Malicke
{jczetta, kludewig, dmalicke}@umich.edu
Open.Michigan Initiative, University of Michigan
Download slides: http://openmi.ch/ocwc-2014-metrics
OCWC Global, April 2014
All content in this presentation unless otherwise noted is © 2014 Regents of the University of Michigan and
licensed under a CC-BY license. http://creativecommons.org/licenses/by/4.0

2. the dynamic metrics and analytics project
...was initiated with a goal of
publicly sharing Open.Michigan usage data,
identifying interesting patterns in OER use,
updating displays of that data dynamically.

3. defining terms
metrics are raw data
analytics are meaningful patterns
metrics come first

4. a repository and referratory
we host and help publish OER
(http://open.umich.edu)
we provide links to third-party platforms
and services which host relevant OER

5. three guides
● goals of sharing: how can we open data easily?
● user research: what do users want?
● technical design: what can/should we do with what
we have?

6. interesting corollary questions
● how to share usage data? what context is
needed?
● what does “use” mean for us?
● how can we share metrics in a
sustainable and useful way?

7. how do we organize OER?
Hierarchical system,
Drupal-based
(https://open.umich.
edu/wiki/OERbit)
Image source: Open.Michigan Initiative, CC-BY

8. how do we organize OER?
A hierarchy of units, courses, resources...
Image source: Open.Michigan Initiative medical collection, open.umich.edu/education/med, CC-BY http://creativecommons.org/licenses/cc-by/4.0

9. cont.
Image source: Open.Michigan M2 Cardiovascular,
http://open.umich.edu/education/med/m2/cardio,
http://creativecommons.org/licenses/by-nc-sa/3.0/

10. how do we measure content use?
Google Analytics, third-party-platform
analytics interfaces, access to APIs...
Image source: Google Analytics, charts

11. together: technical architecture
… informs information architecture.
(e.g. Our hierarchical site structure
allowed us to easily answer some
individual questions with the first
phrase release of this project.)

12. project: first phase
Image source: Open.Michigan M2 Cardiovascular, http://open.umich.edu/education/med/m2/cardio, http://creativecommons.
org/licenses/by-nc-sa/3.0/

13. user research →
● changes in action/use over time
● visual clarity
● ease of access
● availability of totals (lifetime numbers)
● evidence of reach
● evidence of use

14. project: second phase
Currently in
development,
a dashboard
to share raw
metrics for
individual
courses. Image source: Open.Michigan dashboard, in progress.
© Regents of the University of Michigan, CC-BY 4.0.

15. overall
our user research suggests there is
qualitatively measurable value
in providing individual metrics
in clear ways

16. more conclusions
● tech architecture informs information architecture
● metrics can be used to justify costs of OER
production, and serve to strengthen relationships
● user research may lead to ‘better’ analytics
● more to come!

17. so not only is data exciting
...it also helps support
wider sharing of OER.

18. future project endeavors
● more data sharing: SlideShare, Amara.org
● continual development of visuals
● movement toward increased analytics
● increased data export options

19. comments? questions?
email: jczetta@umich.edu
twitter: @jczetta, @open_michigan
learn more: http://openmi.ch/dyn-metrics
read the paper: http://openpraxis.
org/index.php/OpenPraxis/article/view/118

20. thanks!
to all who provided assistance with and support for this
project, especially:
Kevin Coffman, Pieter Kleymeer, Susan Topol, Trisha Paul, Bob
Riddle, Stephanie Dascola, Margaret Ann Murphy, Emily Puckett
Rodgers, Pierre Clement, Michael Hess, Karen Kost;
all interviewees and Open.Michigan Initiative collaborators