The presentation was given at DevLearn 2011 and covers SCORM in games, metrics in games, a case study and a look at how the new CMI5 spec MAY be useful for tracking learning data in games. NOTE- Slideshare didn't like all of my transitions or the video I included in the original presentation. I have put a URL in place of the video and you'll just have to use your imagination for the transitions. It's a shame too because the transitions really made the presentation. If you want the full presentation with the video and transitions please contact me on twitter @hybridkris.

2. In 1993 the AICC developed the
first runtime interoperability
specification for Learning
Management Systems

3. In 2000, the ADL released SCORM
version 1.0 based largely on the
AICC specification

4. Since the implementation, both
SCORM and the CMI specs
have allowed for excellent
courseware tracking capabilities

5. Courseware, however, has changed
over the past 18 years...

6. How can we adapt the SCORM
model to interface with new
courseware models such as
gaming?...

10. Games are engaging
and becoming more
prominent as a
learning tool
(and they’re fun!).

12. Games can be cost
effective and easy to
implement in
curriculum

14. Games provide a wide
range of interactions
and can be customized
to users

16. Captured game data
can provide rich, deep
metrics for analysis

17. Level Clear!!

18. Game Metrics Examples

19. Call of Duty: Black Ops Metrics
http://www.codblackopsblog.com/wp-content/uploads/2011/01/the_numbers_mason_V2.jpg

20. Call of Duty: Black Ops Metrics
ti sa
T ha T
LO a!
of dat
http://www.codblackopsblog.com/wp-content/uploads/2011/01/the_numbers_mason_V2.jpg

21. Starcraft/Starcraft II Metrics
http://us.blizzard.com/_images/games/sc2/wallpapers/wall1/wall1-1600x1200.jpg
http://images.wikia.com/starcraft/images/c/cb/Screenshot_SC2_DevGame1.jpg

22. Starcraft/Starcraft II Metrics
http://us.blizzard.com/_images/games/sc2/wallpapers/wall1/wall1-1600x1200.jpg
http://images.wikia.com/starcraft/images/c/cb/Screenshot_SC2_DevGame1.jpg

23. http://arstechnica.com/gaming/news/2010/07/excellence-of-
execution-video-of-starcraft-mastery.ars
(SlideShare didn’t like my video)

24. That’s 300 actions
PER MINUTE
http://arstechnica.com/gaming/news/2010/07/excellence-of-
execution-video-of-starcraft-mastery.ars
(SlideShare didn’t like my video)

25. http://arstechnica.com/gaming/news/2010/07/excellence-of-execution-video-of-starcraft-mastery.ars

26. Civilization V
http://arstechnica.com/gaming/news/2010/07/excellence-of-execution-video-of-starcraft-mastery.ars

27. Civilization V Operation FlashPoint
http://arstechnica.com/gaming/news/2010/07/excellence-of-execution-video-of-starcraft-mastery.ars

28. Case Study: “The Change Game”

30. Simple game utilizing
decision tree and quiz
components

31. Web based game developed
in Flash
Simple game utilizing
decision tree and quiz
components

32. Very simple mechanics that
were to be tracked
Web based game developed
in Flash
Simple game utilizing
decision tree and quiz
components

33. Very simple mechanics that
were to be tracked
Web based game developed
in Flash
Simple game utilizing
decision tree and quiz
components

35. Multiple choice style questions
cmi.core.score.raw

36. Free form journal entries and
self assessment forms
cmi.suspend.data
Multiple choice style questions
cmi.core.score.raw

37. Completion of game
cmi.suspend.data
cmi.core.lesson_status
Overall time in game
cmi.core.total_time
Free form journal entries and
self assessment forms
cmi.suspend.data
Multiple choice style questions
cmi.core.score.raw

38. Completion of game
cmi.suspend.data
cmi.core.lesson_status
Overall time in game
cmi.core.total_time
Free form journal entries and
self assessment forms
cmi.suspend.data
Multiple choice style questions
cmi.core.score.raw

39. Results

40. Results
What went right

41. Results
What went right
- Data was tracked and reported to the LMS

42. Results
What went right
- Data was tracked and reported to the LMS
- Implementation was easy using standard
SCORM calls

43. Results
What went right
- Data was tracked and reported to the LMS
- Implementation was easy using standard
SCORM calls
- SCORM data model elements were easily
adapted to the required functionality

44. Results

45. Results
What could be improved

46. Results
What could be improved
- Journal entries are not truly “tracked”

47. Results
What could be improved
- Journal entries are not truly “tracked”
- Game play is limited and doesn’t really reflect
more common game play types

48. Results
What could be improved
- Journal entries are not truly “tracked”
- Game play is limited and doesn’t really reflect
more common game play types
- If the game was “off the shelf”, SCORM
integration would have been far more difficult

49. Results
What could be improved
- Journal entries are not truly “tracked”
- Game play is limited and doesn’t really reflect
more common game play types
- If the game was “off the shelf”, SCORM
integration would have been far more difficult
- No tracking implemented to track the user
through the entire experience

51. Activating CMI 5!!!

53. CMI-5 is the next generation
of Content-to-LMS
interoperability specifications.
It will provide content runtime
data tracking and a means to
transfer course lists.

55. CMI-5 is intended to
replace existing AICC
and SCORM
specifications

57. “Core” set of minimum
pre-defined data
elements for content
tracking

59. Ability for the
content to define
what data to
be collected

61. Game Over

63. Kris Rockwell, CEO Hybrid Learning Systems
@hybridkris
kris.rockwell@hybrid-learning.com
www.hybrid-learning.com