xAPI Camp Autodesk 2016 presentation by Megan Bowe

1. DATA STRATEGY AND
XAPI
Megan Bowe
MakingBetter
@meganbowe
megan@makingbetter.us

2. “The price of light is less than the cost
of darkness.
-Arthur C. Nielsen

3. INTELLIGENT BUSINESS
➤ Marketing analyzes data about audience behavior to reach
more people
➤ Product analyzes data about target consumer activity to
increase engagement
➤ User Experience analyzes data about product usage to
increase customer satisfaction
➤ Management analyzes business results to understand
company and market performance
➤ Therefore, Learning and Development should analyze workforce
performance and growth to improve business results

4. XAPI PUSHES
LEARNING AND
DEVELOPMENT
TO BE A DATA-
DRIVEN SERVICE
The conversation shifts from,
“Which content should we deliver to employees?” to
“What do our people need to do?” and “How can
we help them at or before the time of need?”

5. DATA
Foundation for the best laid plans

6. Image credit: https://www.pinterest.com/billgardiner/star-trek/

7. LOTSA DATA
A large amount of data which
analyzed to uncover hidden
patterns, unknown correlations,
and other useful information.
➤ Reactionary
➤ Requires huge piles of data
➤ Messy
➤ Expensive
➤ Sometimes misleading

8. Image credit: https://plus.google.com/u/0/102069808191484711272/posts

9. DATA STRATEGY IS…
Often discussed in terms of storage,
movement, and sharing. (thanks xAPI!)
Governance
➤ Vocabulary usage
➤ Field usage
➤ API usage
➤ Custom key value pairs
➤ Competency alignment
➤ Coverage
➤ Learning experience design
alignment

10. IT’S COMMUNICABLE
➤ Data Style Guides
➤ Content Strategy
➤ Metadata and Tagging

11. MEASUREMENT
A careful balancing act.

12. WHAT GETS
MEASURED
GETS MANAGED
No one is very sure if Peter
Drucker actually said that.

13. “I often say that when you can measure what
you are speaking about, and express it in
numbers, you know something about it; but
when you cannot express it in numbers, your
knowledge is of a meagre and unsatisfactory
kind; it may be the beginning of knowledge,
but you have scarcely, in your thoughts,
advanced to the stage of science, whatever
the matter may be.
- Lord Kelvin

14. MEDICINE AND EDUCATION
These two professions have had
metrics for over a decade. They
are tracked from different angles.
The measurement has had some
success here and some failure.
➤ Click count trap: Doctors and
EHR systems
➤ Test scores: Education and
standardized testing

15. “…evidence mounted that even superb
and motivated professionals had
come to believe that the boatloads of
measures, and the incentives to “look
good,” had led them to turn away
from the essence of their work.
-Robert Watcher, NYT

16. LEARNING EXPERIENCE DESIGN
Let’s figure out exactly what to track

18. XAPI DATA STRATEGY
What should be done?

19. Interaction Verb Context Object Result Extensions
Poll Question
Submitted
http://adlnet.gov/
expapi/verbs/
responded
Parent: ID lesson
or course poll is
within
http://adlnet.gov/expapi/
activities/question
response:
answer n
All answer choices
and their stats at
the time of
submission
Search Submitted http://adlnet.gov/
expapi/verbs/
search
Category: Page
from which search
was executed
Term searched and link
selected from search
results Activity type:
http://adlnet.gov/expapi/
activityTypes#link
Links to other
search results
shown on the
page
Survey Question
Answered
http://adlnet.gov/
expapi/verbs/
responded
Parent: ID of
survey Activity
http://adlnet.gov/expapi/
activities/question
response:
response
to prompt

22. ANALYTICS AND INTELLIGENCE
AMPLIFICATION
Now the fun part!

23. ANALYTICS
➤ Feedback loop analysis
➤ User journey analysis
➤ Patterns: expected and
unexpected
➤ Predictive: when these things
happen, this is usually the
case.

24. INTELLIGENCE AMPLIFICATION
Reliable data tied to content
strategy makes it possible to find
just the right places to do this.
The moment when information
is needed becomes a huge
opportunity:
➤ Performance support
➤ Adaptive flows
➤ Recommendations
➤ Personal data stores

25. THANK YOU!
Megan Bowe
@meganbowe
megan@makingbetter.us