Effective learning in the Age of Hybrid Work - Agile Saturday Tallinn 2024
Jim Box: Disrupt or Be Disrupted
1. Jim Box
Sr. Manager, Learning and Development
October 27, 2016
How Digitization is Disrupting Education
and What Cisco is Doing About it
Disrupt or Be Disrupted
2. 1. Virtual/Augmented Reality
2. Artificial Intelligence/Machine Learning
3. Natural Language Processing
4. Analytics/Big Data
Are these topics part of your
everyday conversations?
4. A Little About Us
Job Role
• JRA/JTA
• Exam Blueprint
and sets Domains
Certification-Based
Industry Standard
Segregate Exam and
Course Development
ANSI and DOD
Talent Enablement
Fill the Talent Gap
3 x 5
P & L
Resell through LP
Channel
For Profit Business
13. Our
Moment?
The Digital Lesson …
.
Don’t be afraid to cannibalize your own
business in the name of progress.
This is seen time and again in the digital
revolution.
By the time Kodak had both feet fully in
the digital game, it had been outclassed
by more nimble competitors with better
products.
16. A Learner’s World Has Changed
Homework
Library
Classroom Lecture
A generation ago…
Learner
TelePresence
session
National
newspaper
feed
Chemist
broadcast
session
Virtual lab
IM
scientist
Classroom
lectureExpert
blog
Class
lecture
VOD
Video
phone call
RSS
Open
courseware
Government
research
organization
Game
Newsletter
Expert
Website
with TA
Chemistry club
Twitter
Primate
community
Fauna
community
International newspaper
feed
GPS
to meeting
International library
virtual collection
Museum click-to-talk
iTunes U
podcast
Museum
virtual tour
Museum
National museum
virtual collection
Periodicals
Second Life museum
tour
Botany
community
vBlog
Telephone
Radio & TV
Chemistry
community
Learning Today
Cisco Confidential 16
17. SHORTER ATTENTION SPANS …
The average attention span in 2000 12 seconds
The average attention span in 2015 8.25 seconds
The average attention span of a goldfish 9 seconds
% of people who can really multitask effectively 2%
… MORE DIGITAL DISTRACTIONS
Average consumption of information per day (outside work)
34 gigabytes/12
hrs
Average length watched of a single internet video 2.7 minutes
# of times the average person checks their smartphone daily 150
Frequency the average worker switches tasks per day every 3 minutes
# of times the average worker glances attheir email inbox 30/per hour
Number of browser tabs the average user keeps open 10-14
Source: National Center for Biotechnology Information
19. Education is being Digitally Remastered Too
§ Technology is disrupting education, expanding the
education ecosystem beyond traditional lecture
halls and classrooms to accommodate learners'
preferences for time, place, style and previous
levels of attainment.
§ 90% of U.S. children are online by third grade.
§ 70% of primary and secondary schools in the UK
now use tablet computers.
§ 39% of middle schoolers use smart phones for
homework, 31% use tablets for homework.
§ Students using iPad outperformed the non-iPad
students in every literacy measure they were tested
on.
Sources: Verizon Foundation, MARC 2011 Survey Grades 3-12, and Gartner Research
iPad in Education Results, Apple, October 2014
http://www.bbc.com/news/education-30216408, Dec 2014
20. Learning is everywhere… and just-in-time!
change, take a look at Figure 2.
Figure 2: Learning Methods and Continuous Learning
Workshops
Wikis
vILT courses
VideosSocial networks
Simulations
Reference materials
Professional groups
Podcasts
Performance support tools
Peer feedback
On-the-job assignments
OnlinesearchMOOCsMobileapps
Mentoring
Managerfeedback
After-actionreviews
ArticlesAssessments
Blogs
Books
Checklists
Coaching
Communities of practice
Conferences
Customer feedbackDevelopment plans
Discussion forums
e-Learning courses
Games
Instantmessaging
Instructor-led/classroom
Jobshadowing
Learningportals
Continuous
Approaches
Learning
ENVIRONMENT
EXPOSURE
EXPERIENCE
EDUCATION
Source: Reimagining L&D Capabilities to Drive Continuous Learning, Bersin
by Deloitte, March 2015
“With the Continuous
Learning Model,
there is a new focus
on the development
of the learner in a
holistic sense - not
just formal learning.”
25. Flexibility Removing barriers of access
Untethering learning opportunity from
physical location or time
Learner can review, repeat or skip content
as needed
26. Unbundling Creating libraries of topics that frees up
content for specific, moment-of-need learning
Topics can also be “re-bundled” for deeper
learning needs.
28. Are you planning for
Digital Disruption?
5 Generations in the Workforce
Attention span of a goldfish
Can you see your
Kodak moment coming?
Are You Willing to Disrupt yourself
Don’t always take the easy way
30. Tools End-to-End
Processes
Templates
Training/Support
New
Skills/Talent
Mindset
New Delivery Formats
• NEW online learning Platform
• NEW ePub “Digital Student Kit”
2012 2013 2015 2016Item Item
Reinvent Learning
• Learning through Labs
• JIT Learning
• Multimodal Learning
Dashboard &
Learning Analytics
Measurable learning outcomes
Learner analytics
The “Big Bang”
• Transition to XML/Single-
source authoring
THEN NOW
Word & PPT
ILT courses w/ printed
SG, LG, CAG
Digital Learning
Library
• Comprehensive Library
• Video Instruction
• Practice Exams
PBF to PBM
• Process Change
• Agile maintainence
model
Budget Run-the-BusinessPortfolio
Build Plan
2014
31. Intelligent Content Creation Process
Content Repository DTDs
Learning
Partners
Other
Sources
Mobile
Student
Kit
Instructor Kit
OutputXlator
Book Map
Topic
Map
Topic
Topic
Map
Topic
Book Map
Topic
Map
Topic
Topic
Map
Topic
Topic
Topic
Topic
Topic
Topic
Topic
Topic
TopicTopic
Topic
Topic
Topic
Topic
eKit
ELT
Rules
Develop
Design
Process
Learning@Cisco
32. Tools End-to-End
Processes
Templates
Training/Support
New
Skills/Talent
Mindset
Backend DB
• DB performace issues
• Went to No-SQL DB
• Not Relational DB more
JSON
2017Item Item
XML Template 2
• More Structured
• ID built in to mandate dev path
• Required many many templates
changes
Build in the tool
Desing in XML tool
Develop in XML tool
Publish in XML tool
Stop using Word and PPT
2013 Future
XML Template v1
Everything spelled out
Instructional Design Rules
Re-Use
• Evolved our re-use plan
• Structured Authoring
• Re-use w SA did not work
for our content needs
• Build once use many times
XML Template 4
• Remove all the embedded
instructions
• Lego Brick approach – Base
template with snap on modules
• Documented Guidelines
Operationalize ScaleInnovate
2014 2015 2016
Tagging
Build for Knowledge Servcies
Just in time learning
33. Concurrent FCS
Multiple Outputs
85% Shared Content
Single Development Effort
Single-Source Ÿ Multiple Outputs Ÿ One FCS
ILT
85%SHARED
CONTENT
PPT
PDF
EPUB
CLL
LABS
LABS
VIDEOS
ASSESSMENTS
HTML5
ELT
PPT
PDF
LABS
>_
EPUB
Q&A
VIDEOS
EAIs
HTML
35. Tools End-to-End
Processes
Templates
Training/Support
New
Skills/Talent
Mindset
TTM 8 Months
• 85% Re-Use
2017Item Item
Single Source Dev
• Same XML Source builds ELT and
ILT outputs
• ILT First provided 85% of ELT
Content
Rapid Re-Fresh
Only update the changes
Keep content current
TTM 12 Months
2 teams
2 projects
2013 Future
Separate
Development
ILT and ELT developed in
parallel, but seperately
42:1 Dev Ratio
• 95% Re-use
• Multipule Product single
development effort
E-First
• Build ELT first then leverage
the assets needed for ILT
• More efficient and higher
quality products
Operationalize ScaleInnovate
2014 2015 2016
36. Development
Ra-os
/
Cost
-‐
Summary
ILT,
Level
1
eLearning
(Basic),
Level
2
eLearning
(Interac-ve),
Level
3
eLearning
(Advanced)
Rapid
Development,
Simple Projects
Average
Typical
Project
Average
Cost per-
finished hour
Advanced,
Complex,
More Media
Learning@Cisco
Single Sourced
Development
(ILT, ELT, etc.)
Instructor-Led
Training (ILT) 22:1 43:1 $5,934 82:1 8 Months
Single Source
(1,400h Dev /
32.5h output)
41.8:1
Level 1 eLearning
(Basic) – Content
Pages and
Assessment
49:1 79:1 $10,054 125:1
Level 2 eLearning
(Interactive) – Level
1, plus 25%+
interactive exercises
127:1 184:1 $18,583 267:1
Level 2.5
$10,442
Level 3 eLearning
(Advanced) –
Simulations, Games,
Award Winning type
217:1 490:1 $50,371 716:1
38. What do you think Tomorrows Learner looks like?
39. Formal Learning Informal Learning
Explicit Knowledge Tacit Knowledge
Universal
Knowledge
(Theory / Standards)
(Routinized Work)
Experiential
Knowledge
(Practice)
(Highly Variable Work)
Expert
Routine
Work
(Process)
Technical
Work
(Complex
Process)
Trade / Craft
Work
(Situational
Variability)
Knowledge
Work
(Reason,
Synthesis,
Highly Variable)
Intermediate
Novice
Differing Learning and Knowledge Needs
GEN 2020 MILLENNIALS GEN X BOOMERS TRADITIONALISTS
Learning Preferences
40. Change is inevitable
“It is not the strongest of the
species that survives, nor the
most intelligent that survives.
It is the one that is most
adaptable to Change”
Charles Darwin
41. What’s Wrong with this Picture?
§ Are you prepared to meet the needs of the
Continuous Learner?
§ Is your Learning Formative and Summative?
§ Can you accommodate Micro Credentialing?
§ What is your Digital Delivery Strategy?
§ Are your product development tools,
systems and infrastructure ready to support
a digital education world?
42. What’s Trending…
Personalized: Flexible, Unbundled, Relevant, Knowledge Service
Artificial Intelligence: Robots, Bots, Machine Learning, Natural Language Processing
Virtual Reality: Immersive Experience, Improve Retention
Life Long Learner: Continuous Learning, Validation, Micro Credentials, Micro Course
Digital Analytics: TinCanApi, All Interactions, Multi-faceted, Adaptive Learning
45. Jim Box
Sr. Manager Learning and Development
Cisco
Responsible for Learning@Cisco’s Content Development team
which provides research, engineering, design, development, and
manufacturing of Cisco’s customer-facing education and
certification products. With the goal of growing global talent in the
networking industry, Jim and his team are chartered with creating
best-in-class career certification course and assessment products
for use by Cisco’s customers, partners and employees. Jim also
focuses on the impacts of technology and digitalization on Adult
education pedagogy and learner performance. Most recently Jim
has been overseeing Cisco’s transformation to digital delivery and
XML-based, single-source development with the goal of enabling
performance support and knowledge services for Cisco
customers.