From an organization-wide executive directive to become more data-driven, a retail corporate L&D team took an internal look at their own data practices. Realizing that they had an overwhelming lack of transparency into their learning initiatives and a great amount of data that had gone unused, the team developed a transformation vision to create a single system of record for learning to enable observability, granularity, and accountability for all team members. The team was committed to the vision of xAPI; however, the data and information they needed in order to make actionable change for their learners was locked away in non-interoperable formats, and they recognized the need to develop a data strategy and implementation plan.
*Originally presented on 10/ 23/2018 at xAPI Camp during DevLearn 2018 by Allie Tscheulin
2. What is xAPI?
Stacey Completed Course #1
Actor Verb ObjectExperience Data is captured
using the Experience API
(xAPI), a standardized Actor
— Verb — Object data format.
This interoperable data
structure allows you to
activate information across
tools and technologies where
Experience Data is created in
real-time.
3. Because xAPI is designed around
activity-based data collection, xAPI
data can provide high-resolution
insights into specific learner activity.
For example, watching a video is
actually a summation of many, much
more granular, actions. This
information can show us how
engaging or valuable an experience is
for a learner.
Stacey Completed Course
Launched
Viewed
Played
Clicked
Paused
Clicked
Opened
Clicked
Clicked
Submitted
Viewed
Closed
Course
Title Page
Video
Rewind
Video
Resource Link
Article
Radio Button #1
Radio Button #2
Answer
Final Slide
Course
But really- What is xAPI?
5. From the specification:
“A profile empowers designers and
developers to establish a controlled,
domain-specific vocabulary and
determine what data should be
captured/stored and reported on. In
other words, a profile really is the
blueprint for a successful, semantically
interoperable xAPI implementation.”
xAPI Profiles?
LaunchedStacey Course #1
Stacey Launched A Rocket!
6. You can think of an xAPI Profile as the
blueprint for how an organization or
specific domain uses xAPI data.
Because xAPI leverages a semantic
format and the words we use can
have many different semantic
meanings, there needs to be a
well-defined template for how the
verbs, objects and other parts of xAPI
statements are to be used and what
they mean conceptually in order to
get the most out of your xAPI data.
Multiple xAPI Profiles?
7. Tracking and Measuring Competency
When an organization aligns a competency
framework to a data interoperability
framework powered by xAPI and xAPI
profiles allows not only automated
reporting on learner activity along a
prescribed learning path, but also provides
a detailed view of the individual learner
journey as well as aggregated data on
program participation and performance.
Competency Framework
The creation of a competency
framework is essential for any
professional development strategy.
A competency framework can be
developed for each role (e.g.,
seller) and/or each content topic
area (e.g., cyber security) to track a
learner’s progress toward mastery
of the role or topic.
xAPI Profile
The creation of a domain-specific
taxonomy, or an xAPI Profile, will
ensure consistency and
interoperability between tools.
Once aligned to the competency
framework patterns of statements
can be validated against
predefined patterns of activity to
ensure automated domain specific
logic.
Profiles + Competencies
9. We need to move from
a content focus to a
data focus.”
problem data assessment outcomes pro-tipsphases data strategy
10. We don’t know what’s
being used.”
problem data assessment outcomes pro-tipsphases data strategy
11. We recognize an increasing
percentage of learning is
happening outside of the LMS but
we have no visibility into that.”
problem data assessment outcomes pro-tipsphases data strategy
12. To start to solve those
problems A Retail
Company turned to xAPI.
Members of their team
began to learn xAPI on
their own, with the cohort
and information online.
Their first steps...
problem data assessment outcomes pro-tipsphases data strategy
13. ...led to big questions.
We don’t know
what questions
to ask right
now.”
How do we
figure out the
right point to
start?”
problem data assessment outcomes pro-tipsphases data strategy
14. Next Steps
Data Assessment
Pilot
Time to make a plan!
A great xAPI transformation
starts with a great plan.
A great plan leads
to a smooth pilot.
And a great pilot leads
to the right iterations.
problem data assessment outcomes pro-tipsphases data strategy
15. Objective: To gain a high level understanding of the
client’s current systems, business objects, initiatives and
technology infrastructure in order to design the most
efficient and effective approach to the implementation of
xAPI within their learning ecosystem.
Implementation
Onsite Workshop
Data Assessment
problem data assessment outcomes pro-tipsphases data strategy
16. ● What are the current metrics I use?
● What else would I like to know about
my learners?
● What reports do I currently use?
● What types of information does my
boss ask for that I do not know?
● What are some specific initiatives
that I want more insight into?
● What are some high impact
programs that I need more data
from?
Business SideData Assessment
problem data assessment outcomes pro-tipsphases data strategy
17. ● What are the current metrics I use?
● What else would I like to know about
my learners?
● What reports do I currently use?
● What types of information does my
boss ask for that I do not know?
● What are some specific initiatives
that I want more insight into?
● What are some high impact
programs that I need more data
from?
Business SideData Assessment
Internal HR
Resources
Management
Training
Seller Readiness
Learner
Engagement
Onboarding
Training
Specific
Compliance
Training
problem data assessment outcomes pro-tipsphases data strategy
18. ● What platforms are available?
● What platforms are already connected?
● How can I access the platform’s data?
● How do I manage identity?
● What are all my data assets I currently
have available?
● Where would myself and/or my learners
access the data dashboards?
Technical SideData Assessment
problem data assessment outcomes pro-tipsphases data strategy
19. ● What platforms are available?
● What platforms are already
connected?
● How can I access the platform’s
data?
● How do I manage identity?
● What are all my data assets I
currently have available?
● Where would myself and/or my
learners access the data
dashboards?
Technical SideData Assessment
LMS
Knowledge Base
Micro-Learning
Platform(s)
Learning
Experience
Platform
Communication
Tool(s)
Intranet
problem data assessment outcomes pro-tipsphases data strategy
20. Internal HR Resources Management Training
Seller Readiness
Learner Engagement
Onboarding Training
Specific Compliance Training
Map the EcosystemData Assessment
LMS Communication
LMS Intranet
Micro
learning
Knowledge
Base
LMS
LMS
LMS LXP
Communication
problem data assessment outcomes pro-tipsphases data strategy
21. Creating a Data-Driven L&D
Team—an xAPI Case Study
xAPI Central Showcase Stage
Thursday, October 25th
10:00 AM - 10:45 AM
Hear the rest of the story Thursday!
Next Steps
Data Assessment
Pilot
problem data assessment outcomes pro-tipsphases data strategy
22. Worksheet Making it real for you!
problem data assessment outcomes pro-tipsphases data strategy
When designing your learning
ecosystem, there are so many factors
to weigh, from learner experience, to
ease of use, to UI design, and so on.
Something L&D leaders should also
consider is the data coming from
these platforms.
Developing an overall data strategy is
critically important to answer the ever
elusive question, “What is the ROI of
my training initiatives?”
23. Worksheet Making it real for you!
problem data assessment outcomes pro-tipsphases data strategy
Platform Insights
Ideal Impact
24. Mission control
for learning & performance
demo.yetanalytics.io
problem data assessment outcomes pro-tipsphases data strategy
25. Pro-Tip #1: Connect your L&D
team and your IT resources
early on to make sure all
parties are onboard
problem data assessment outcomes pro-tipsphases data strategy
26. Pro-Tip #2: Think about your
data strategy in both a current
state and an ideal future state
problem data assessment outcomes pro-tipsphases data strategy
27. Pro-Tip #3: Figure out a
program/objective/goal that will
show a ton of impact through a
lower technical lift
problem data assessment outcomes pro-tipsphases data strategy
28. Pro-Tip #4: Touch base with
other departments to hear
what kinds of information they
would like to know from L&D
problem data assessment outcomes pro-tipsphases data strategy
29. A Few Resources...
● Check out the live demo - https://demo.yetanalytics.io
● Free LRS Sandbox - https://explore.yetanalytics.io
● Let us scan your badge and we’ll send these slides
● The Yet Blog - yetanalytics.com/blog
problem data assessment outcomes pro-tipsphases data strategy
30. Thank you!
● We’re talking all week!
● Visit us at booth #118 (We’re on the treasure hunt!)
● Want to discuss your project? Shoot us an email at
hello@yetanalytics.com
problem data assessment outcomes pro-tipsphases data strategy