Presentation for eMOOCs conference 2016 by Leonie Meijerink, Danika Marquis, Janine Kiers

1. Janine Kiers
Product Manager DelftX MOOCs
Based on conference submission with Danika Marquis and Leonie Meijerink
Evaluating Teaching and Learning

3. What is a successful MOOC?
• Different perspectives
• Branding
• Innovation
• Research
• Educational
CC 0 Public domain Pixabay

4. Quality Assurance cycle
Design
Develop
Run
Evaluate

5. Evaluating Teaching & Learning
• Quality AssuranceIntention:
• ToolsImplementation:
• Share & interpret resultsExperience:
• SuggestionsImprove:

6. Tools: how to evaluate Teaching
and Learning in a MOOC?
• Passing rate
• Student satisfaction
• Design
CC 0 Public domain Pixabay

7. Implementation of evaluation
Tool: Online Learning Experience

8. Online Learning Experience
• Flexible (in time, space & content)
• Diverse (activities, resources & assessment)
• Inclusive (accessible, cultural & gender)
• Supportive (guidance & feedback)
• Interactive (learner – learner/teacher/content)
• Active (learning by doing)
• Contextual (real world situations & problems)
• Innovative (new tools, strategies & insights)

9. Implementation of evaluation
Tools to gather & process data
Sources of data Used in
Student surveys Course report
Forum analysis Course report
Stakeholder interviews Discussion
Platform data Course report

10. • Collaborative Analysis - eLD & Course Team
• Discussion of results
• Implement in rerun
Implementation of evaluation
Teaching and Learning report
CC BY 2.0 IvanWalsh.com

11. Evaluation: platform data
• Data analysed (completers, respondents)
• Participants’ feedback
• in Likert scale
• written feedback

12. Student expectations

13. Workload: expected and actual

14. Describe the course in one word

15. Evaluation: Student activity
Weekly numbers of active students (blue line), students who watched a video
(green line) and students who tried an assignment (orange line).

16. Evaluation: Replay video

17. Evaluation: Student performance
• Review questions e.g. < 50%

18. Experience
Challenges in interpretation
• No student-teacher personal contact
• Survey results are biased
- low response rates & bias for completers
• Heterogeneity of learners
• Eliminate content specific results

19. Learning points from experience
• Standardization of implementation
• Standardization of interpretation of OLE
• Dedicate time for evaluation
• by Course Team
• by support team / eLD

20. Effect of course evaluation
• Improve evaluated course
• Create knowledge base (generalized)
• Reflect on support process
• Professional development

21. Thank you
Questions?