1. Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License.
Opening Embedded Assessment
Brandon Muramatsu, mura@mit.edu
David Wiley, david.wiley@gmail.com
Justin Ball, justinball@gmail.com
Joel Duffin, joel.duffin@gmail.com
1Unless otherwise specified this work is licensed under a Creative Commons Attribution 3.0 License.
Cite as: Muramatsu, B., Wiley, D., Ball, J. and Duffin, J. (2014, April). Open Embedded Assessment.
OER14: Building communities of open practice. Newcastle, UK.

2. openassessments.org
2Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License.
Tweet
Questions
#oer14oea
openassessments.org

3. Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License.
Where in the World…
3

4. Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License.
Outline
 Motivation and Background
 Demo
 Shared Open Assessment Banks
4

5. Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License.
Content and Assessment are Separate
5
OER Content
Videos,
Lectures,
Textbooks,
Webpages,
Assessments
Current State of
OER Assessments
PDF Files,
Static,
Contained in
Separate Quiz
& Test Systems
The Challenge

6. Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License.
The Potential?
 Do for assessments and items, what’s been done
for content (whole courses, lectures, videos)
 Embed Anywhere
 Share
 Don’t reinvent the wheel for every course
 Evaluate, Record and Track Responses
 Scale  More use of items/assessments for validity
 May lead to evidence of impact?
6

7. Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License.
Focus: Formative Assessment
 Putting mechanisms for students to check their
understanding / mastery of concepts directly in course
materials
 Primarily for formative (self-check, understanding) not
summative (exams or formal assignments)
7

8. Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License.
What’s done today in OER with
embedded formative assessment?
8

9. Saylor Foundation – saylor.org
9
www.saylor.org
Credit:SaylorFoundation,CCBY

10. Saylor.org Precalculus II
 Course Assessments
 http://www.saylor.org/courses/ma003/?ismissing=0
&resourcetype=4
10
Credit:SaylorFoundation,CCBY
www.saylor.org

11. Saylor.org – “Assessment”
 http://www.saylor.org/site/wp-
content/uploads/2011/11/MA003-1.2.5-PART2.pdf
11
Credit:WashingtonSBCTC,CCBY

12. 12
MIT OpenCourseWare: Massachusetts Institute of Technology, http://ocw.mit.edu/courses/ocw-scholar/ (Accessed 7 Nov, 2013). License: Creative
Commons BY-NC-SA

13. OCW Scholar – 8.03SC
13
Lewin, Walter, Wit Busza, George Stephans, and Martin Connors. 8.03SC Physics III: Vibrations and Waves, Fall 2012. (MIT OpenCourseWare:
Massachusetts Institute of Technology), http://ocw.mit.edu/courses/physics/8-03sc-physics-iii-vibrations-and-waves-fall-2012 (Accessed 7 Nov, 2013).
License: Creative Commons BY-NC-SA

14. OCW Scholar – BCS9.00SC
14
Gabrieli, John. 9.00SC Introduction to Psychology, Fall 2011. (MIT OpenCourseWare: Massachusetts Institute of
Technology), http://ocw.mit.edu/courses/brain-and-cognitive-sciences/9-00sc-introduction-to-psychology-fall-2011 (Accessed 7 Nov, 2013). License:

15. OCW Scholar – 8.01SC
15
Lewin, Walter, Peter Dourmashkin, Thomas Greytak, Craig Watkins, Andy Neely, Sahana Murthy, J. Litster, and Matthew Strafuss. 8.01SC Physics I:
Classical Mechanics, Fall 2010. (MIT OpenCourseWare: Massachusetts Institute of Technology), http://ocw.mit.edu/courses/physics/8-01sc-physics-i-
classical-mechanics-fall-2010 (Accessed 7 Nov, 2013). License: Creative Commons BY-NC-SA

16. 16
Lewin, Walter, Peter Dourmashkin, Thomas Greytak, Craig Watkins, Andy Neely, Sahana Murthy, J. Litster, and Matthew Strafuss. 8.01SC Physics I:
Classical Mechanics, Fall 2010. (MIT OpenCourseWare: Massachusetts Institute of Technology), http://ocw.mit.edu/courses/physics/8-01sc-physics-i-
classical-mechanics-fall-2010 (Accessed 7 Nov, 2013). License: Creative Commons BY-NC-SA

17. 17Unless otherwise specified this work is licensed under a Creative Commons Attribution 3.0 License.

18. 6.002x
18Unless otherwise specified this work is licensed under a Creative Commons Attribution 3.0 License.

19. 6.002x
19Unless otherwise specified this work is licensed under a Creative Commons Attribution 3.0 License.

20. Our Approach
openassessments.org
20Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License.
OpenAssessments.org
Tweet
Questions
#oer14oea

21. Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License.
Open Assessments (Beta)
OpenAssessments.org
 Embed an assessment in any web content
 QTI-player
 Sends analytics
 Focus on formative assessments
 Start with limited question types
 multiple-choice/single answer
21

22. Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License.
Demo!
(cross your fingers)
22

23. openassessments.org
23Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License.
OpenAssessments.org
Tweet
Questions
#oer14oea

24. openassessments.org
24Unless otherwise specified this work is licensed under a Creative Commons Attribution 3.0 License.

25. OEA Stats
25Unless otherwise specified this work is licensed under a Creative Commons Attribution 3.0 License.

26. Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License.
Shared Open Assessment Banks
26

27. Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License.
Questions?
Tweet them using #oer14oea
27

28. Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License.
Opening Embedded Assessment
Brandon Muramatsu, mura@mit.edu
David Wiley, david.wiley@gmail.com
Justin Ball, justinball@gmail.com
Joel Duffin, joel.duffin@gmail.com
28Unless otherwise specified this work is licensed under a Creative Commons Attribution 3.0 License.
Cite as: Muramatsu, B., Wiley, D., Ball, J. and Duffin, J. (2014, April). Open Embedded Assessment.
OER14: Building communities of open practice. Newcastle, UK.