John Kleeman, Questionmark, UK
The world of corporate learning is moving toward the 70+20+10% model. This suggests about 70% of learning happens on the job, 20% via feedback from colleagues and peers and 10% in formal training. SharePoint is one of the key enablers of this move, with its widespread use for blogging, wikis and document repositories. Assessments (quizzes, surveys, tests and exams) are a critical part of learning – helping diagnose what you need to learn, giving feedback on learning, measuring and reinforcing what you have learned. Assessments are also useful in SharePoint for those using it for more formal training and also to keep track of compliance with regulations within SharePoint.
This presentation from a vendor-neutral perspective :
Describes the business benefits of embedding assessments within SharePoint
Gives some examples of how companies are using assessments within SharePoint
Explains how assessments can be used to measure the impact of social and informal learning
Tells about options for including assessments in SharePoint 2010
Shows how it’s possible to very easily include an assessment on almost any SharePoint page
Shares examples of how this is useful
Demonstrates how to report and manage assessment results in SharePoint
Explores how to use assessment results to interpret what is happening and identify needed improvements
By attending this session, you will learn why assessments are useful in social learning and how to apply them within SharePoint, both for social learning and more conventional training and compliance uses.
IAC 2024 - IA Fast Track to Search Focused AI Solutions
Measuring social learning in SharePoint with assessments
1. Measuring Social Learning in
SharePoint with Assessments
John Kleeman
Chairman, Questionmark (www.questionmark.com)
Twitter: @johnkleeman
Email : john at questionmark.com
2. Learning is Changing
Sign up • Academic model
worked for 2500 years
Learn • Internet changing things
– “Google it”
Test – Changing work roles
– Deeper understanding of
Do work learning
3. Learning from your Only ~10% of learning
mentors, conversations comes from study
with peers and meetings (reading, researching,
courses, etc.)
(if you pay attention and
ask questions)
70+20+10
Formal Learning
model of
Learning From Others 10% learning
Learning By
20% Doing
On-The-Job learning by
making mistakes, taking 70%
time for retrospectives
and learning from the
experience.
4. Internet allows us to more easily share knowledge.
We have moved from clear definitions of
Publishers/Producers/Consumers to Prosumers
Publisher model ProSumer model
(books, courses) (wikis, blogs, search)
Producer ProSumer
Consumer ProSumer
5. 70+20+10 model for learning
• Learn from experience
~70% from Experience • Learn from others
• SharePoint
Search, Wikis, Blogs, Discussions
~20% from Others
~10% from Study
6. Sometimes you just need to know!
• Do you want pilot to • Or doctor to check
Google as flies plane? anatomy during surgery?
7. Assessments?
• Assessments are a critical part of learning
– Quizzes (memory recall)
– Surveys (needs analysis)
– Tests (measure knowledge/skills)
– Exams (more formal tests)
• This presentation shows:
– Why assessments useful in learning
– What applications work in SharePoint
– How? Where to learn more?
9. Assessments Through Learning Process
Learning
Collaborative
Mentoring Instructor & E-learning Work Place
Prepare For
Windows CD In/As Learning
Windows CD Of-Learning
Windows CD
Learning Assessments Assessments
Evidence Accumulated
10. Job Task
Windows CD Course
Windows CD
Analysis Evaluations
Learning
Collaborative Slow Forgetting
Windows CD
Needs Analysis
Windows CD Mentoring Instructor & E-learning Work Place
Curve
Prepare For
Windows CD In/As Learning
Windows CD Of Learning
Windows CD
Learning Assessments Assessments
Evidence Accumulated
11. Quizzes and tests slow forgetting curve
• Taking a quiz or test Knowledge Retained
gives retrieval practice 100%
• Reinforces mental 80%
After 5
pathways to make 60%
mins
56%
future recall more likely 40%
42% After 1
20%
week
Data from Test-Enhanced Learning, Roediger and 0%
Karpicke 2006. Psychological Science
Study only Study, Test
12. Quizzes and tests are also objective
evidence someone understands
• Is getting someone to sign they’ve read a
document good enough?
• US Appeals Court 2005:
– “merely having an individual sign a form
acknowledging his responsibility to read the safety
manual is insufficient to insure that the detailed
instructions contained therein have actually been
communicated”
13. Questions Through the Learning Process
Reduce
Forgetting
Create
Intrigue
Knowledge/Skills
Strengthen
Memory
Questions
Questions
Questions
Questions
Questions
Time
15. Formal learning
• Expose pre-course and post-
course assessments at right time
• End of module quizzes to
confirm understanding & reduce
forgetting
• Diagnostic tests -
misconceptions & direct
learning
• Course evaluation surveys
• Authenticate exams
University of Lund, Sweden
16. Employee / partner portal
• Sales channel verification
– Do you have the right sales skills to sell my product?
• Technical verification
– Do you know how to maintain or describe our products?
Typical social learning techniques
• Knowledge check quizzes, e.g. every Mon morning
• Evaluation surveys
• User-generated quizzes
17. Regulatory Compliance
e.g. safety, financial services, pharmaceuticals
• Knowledge check to confirm understanding of training
• Tests to confirm competency
• Survey employees to find problems before they hit you
• Analyze data to see trends
18. Other common applications
• Community of practice
– Engage interest / validate moderators / survey practice
• Performance support
– Just in time diagnostic quizzes that direct to learning
• Report on scores
– Report scores from assessments in SharePoint
– Use SharePoint to collate results
22. Approach #1 : Inbuilt SharePoint
• Good for basic surveys
• Works OOTB
• Not quizzes & tests
– Scoring
– Security
– Shuffling
– Feedback
– Reporting
23. Approach #2 : Custom web parts
• Write your own
– Custom web parts
– SharePoint customizations (e.g. JavaScript)
• Cost to create
• Cost to maintain
• Functionality limits
24. Approach #3
Embed Flash apps
• Easy to do (if you have the tool)
• Results not usually stored
• Won’t work on iPads/iPhones
• Possible for simple quizzes
25. Approach #4: Embed web apps
• Embed assessment
management systems
• Easy to do and
appropriate
26. Assessment must
Software packages the size to fit space in
Assessment for Device/Browser/iframe
SharePoint
Sends
HTML
Auto-Size
senses pixel size of window
27. Surveys? Quizzes & OOTB? Work in Deliver on
tests? cloud? mobiles?
Author
Inbuilt Deliver
SharePoint Report
Author
Custom Deliver
web parts
Report
Author
Embed Deliver
Flash apps Report
Author
Embed web Deliver
apps Report
28.
29.
30. Where to learn more
• 70+20+10 model
– White paper by Charles Jennings www.duntroon.com
• SharePoint and Assessments blog
– http://blog.sharepointlearn.com
– Gives technical how-tos & comments on SharePoint and assessment
• Learning and Assessment on SharePoint white paper
– www.questionmark.com/whitepapers
• Learn by doing
– Start a pilot project and learn as you go
31. If you have questions
Email john at questionmark.com
Twitter @johnkleeman
Editor's Notes
Adapted for SlideShare from presentation at the European SharePoint Conference, October 2011, Berlin
SharePoint is a key part of 70+20+10 in many organizations because it is the place you can learn from others – via Search, Wikis, Blogs and Discussions. It’s often also the place you can learn from experience.
Assessments prepare for learning by creating intrigue and by informing instructors how much needs learning. Assessments in/as learning give evidence to guide instructors and learners into what needs to be learned and what has been learned. Assessments of learning provide evidence of learning.
Needs analysis assessments identify what you already know, it’s very boring to get training on something that you already know, and in the 70+20+10 world, we are learning from all places. Job task analysis surveys identify what we should be teaching and assessing, they survey existing practitioners. And course evaluations give feedback on the quality of the training.
This study compared two groups of students, one group studied only and the other studied and took a test within the same total time. The group who took a test retained more a week later.
Questions before learning create intrigue. Questions during learning strengthen memory and give information to direct learning. Questions after learning reduce forgetting.
See http://technet.microsoft.com/en-us/library/hh285756.aspx for more on this use of SharePoint
Since SharePoint web parts are different sizes, important whatever assessment system you use that the assessment system auto-sizes quizzes, tests and surveys to fit well in the web part.
Advantages and disadvantages of different approaches
Illustration of including a quiz side-by-side with learning content in SharePoint 2010
Illustration of Single Sign On using Active Directory from SharePoint to Questionmark Perception