1. ONLINE LEARNING/
SOCIAL MEDIA
Evaluating Effectiveness and Results:
Connecting the dots between instructional
goals and outcomes
Scott B. Johnson April 20, 2012

2. MYTHS OF MEASUREMENT
f we measure it, it must be important
f it’s important, it must be measureable

3. LEVELS OF MEASUREMENT
ominal
rdinal
nterval

4. SCOPE OF MEASUREMENT
Classroom,
Course,
Program/department,
College,
Institution,
System…

5. EXPECTATIONS IN THE BIG
PERSPECTIVE

6. THE AACC COMPLETION AGENDA
Commitment by our organizations to
assisting our members in producing
50% more students with high-quality
degrees and certificates by 2020

7. NCAA
raduation Success Rate
PA
egree/program completion

8. ACCREDITATION
LC – Criterion Three:
• Evidence of student learning-
• Graduation rates are
examples of evidence.

9. WHAT IS MEASURED?

10. WHAT ARE GRADES?
Exam scores,
attendance,
homework,
papers, projects,
group work

11. WHAT IS RETENTION?
 Return next time
 Stay till the end this time

12. WHAT ARE LEARNING ANALYTICS?
“Data are collected from explicit student actions, such as
completing assignments and taking exams, and from tacit
actions, including online social interactions,
extracurricular activities, posts on discussion forums, and
other activities that are not directly assessed as part of the
student’s educational progress.”
Data mining?

13. SOCIAL MEDIA METRICS?
Friend count845/483/425, follower175count, #posts,G+62,
According to Kaushik “Occam’s Razor” blog - What
matters is everything that happens after you post /
tweet / participate! (for businesses)
http://www.kaushik.net/avinash/

14. PINTEREST?

15. MEANINGFUL RESULTS
onversation Rate – comments or replies per post
mplification Rate - retweets, shares,
pplause Rate – “favorites”, “likes”, “+1s”
conomic Value – the sum of short and long term
revenue and cost savings - ROI

16. GAMIFICATION AND THE INCREASING USE OF
BADGES AND CERTIFICATES
wards and recognitions for successes at different levels
new model of credentialing skills and achievements
ww.Badgestack.org
ozilla Open Badges Project
http://blog.mozilla.org/blog/2011/09/15/openbadges/

17. INSTRUCTIONAL GOALS?
eneral Education Core Curriculum
www.mc3.edu/academics/core-goals

18. SKILLS
cademic skills prepare students for lifelong learning in a
variety of instructional modes.
ore Goal 1: Communication Skills
ore Goal 2: Analytic Skills
ore Goal 3: Quantitative Skills
ore Goal 4: Computer Fluency

19. KNOWLEDGE
nowledge empowers individuals to initiate change, achieve
their potential, generate ideas, and serve the common good.
ore Goal 6: Intellectual Heritage
ore Goal 7: Aesthetic Sensibility and the Arts
ore Goal 8: Physical and Life Sciences
ore Goal 9: Behavioral and Social Sciences

20. VALUES
alues, ethics and diverse perspectives encourage intellectual open-
mindedness, and enable individuals to engage in society in
responsible ways.
ore Goal 11: Civic Responsibility
ore Goal 12: Sensitivity to Global Perspectives and Cultural and Social
Diversity
ore Goal 13: Ethical Reasoning and Behavior

21. PERSPECTIVES ON ONLINE SOCIAL
NETWORKING LARSON, 2007 DENMARK
Consumer, youth, friendship, identity, body and sex, predator, bully,
reassurance, genre, branding, network, love, source critique, sincerity,
democratic, materialistic, language, public, surveillance, group work, time-
consuming, antisocial, social, generation-gap, learning, entertainment,
communication tool, creative, space and place, Nexus of Practice,
Community of Practice, collection, fun, technological, hard-core business

22. OVERARCHING CATEGORIES
esearch
ser
rofessional or learning
dult or parents

23. THANK YOU!
 ION phone 217-333-4393
 Scott 217-265-7722 sbjhnsn@uillinois.edu
 Mobile (217) 689-1307
 Write to : Ion-mail@uillinois.edu
 ION –Twitter http://twitter.com/ION_UI
 LinkedIn – http://tiny.cc/MVCR_LinkedIN
 Facebook -
http://www.facebook.com/pages/Illinois-Online-Netw
 Announcements on the ION site & MVCR.org