Talk about how to address the design of learning experiences in the current digital environments and how to take into account the student perspective, motivation, feedback, and other various aspects.

1. Designing Engaging
Learning Experiences
in Digital Environments
A/Prof Abelardo Pardo (@abelardopardo)
Faculty of Engineering and IT
slideshare.net/abelardo_pardo
SanAndreasflickr.com
Biosciences Education Forum — BEAN
11 December 2017

2. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 2
AftabUzzamanflickr.com
Design
Problem
Student
View
Our
Brain
In
Digital

3. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 3
AftabUzzamanflickr.com
Our
Brain

4. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 4
TimPierceflickr.com

5. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 5
table
reply
handle
below
define
bli_ _
pia_ _
clo_ _
stu_ _
dan_ _

6. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 6
How does our brain work?
RosarioLizanaflickr.com
Psychology
Neuroscience

7. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 7
Philhearingflickr.com
Gawronski, B., & Creighton, L. A. (2013). Dual Process Theories. In D. E. Carlston (Ed.), The Oxford handbook of social cognition
(pp. 282-312). New York, NY: Oxford University Press.
CarstenTolkmitflickr.com
RationalAutomatic

8. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 8
table
reply
handle
below
define
bli_ _
pia_ _
clo_ _
stu_ _
dan_ _
Dual Process Theory
System 1: fast, intuitive,
implicit (automatic),
subconscious
System 2: slower,
deliberative, explicit
(controlled), conscious

9. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 9
System 2 is lazy
JörgKanngießerflickr.com

10. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 10
AftabUzzamanflickr.com
Student
View
Our
Brain

11. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 11
Simple information transfer is not working
Mazur, E. (2009). Farewell, lecture. Science, 323(5910), 50-51.
Krugazorflickr.com

12. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 12
JuantanKwonflickr.com
Unprecedented amount
of learning opportunities:
resources, spaces,
formats, devices, etc.

13. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 13
HungarianSnowflickr.com
More complex decisions
Unlimited Choices
• Recorded lectures
• Lecture notes
• Collections of previous questions,
answers, etc

14. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 14
Beware of technology pushing us
away from rational thinking
JenRflickr.com

15. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 15
totemisottapaflickr.com
Continuous Decision
Making while Learning

16. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 16
Students’ metacognitive
judgements
affect their
achievements
Dunlosky, J., & Thiede, K. W. (2013). Four cornerstones of calibration research: Why understanding students' judgments can improve
their achievement. Learning and Instruction, 24, 58-61. doi:10.1016/j.learninstruc.2012.05.002
HackNY.orgflickr.com

17. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 17
Overconfidence produces underachievement
Dunlosky, J., & Rawson, K. A. (2012). Overconfidence produces underachievement: Inaccurate self evaluations undermine students’
learning and retention. Learning and Instruction, 22(4), 271-280. doi:10.1016/j.learninstruc.2011.08.003

18. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 18
Bjork, R. A., Dunlosky, J., & Kornell, N. (2013). Self-regulated learning: beliefs, techniques, and illusions. Annu Rev Psychol, 64,
417-444. doi:10.1146/annurev-psych-113011-143823
• Understand human
memory and learning
• Know useful
techniques to study
• Know how to monitor
• Understand existing
biases
IsraeliDefenseForcesflickr.com

19. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 19
5 Low-effect Learning Strategies
AlanLevineflickr.com
Images
for text
Summaries Highlighting Rereading
Keyword
mnemonic
Dunlosky, J. (2013). Strengthening the Student Toolbox. Study Strategies to Boost Learning. American Educator, 37(3), 12-21.

20. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 20
MartinFischflickr.com
Elaborative
interrogation
Self-explanation
Interleaved
practice
Distributed
practice
Practice
Dunlosky, J. (2013). Strengthening the Student Toolbox. Study Strategies to Boost Learning. American Educator, 37(3), 12-21.
5 Effective Learning Strategies

21. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 21
AftabUzzamanflickr.com
Design
Problem
Student
View
Our
Brain

22. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 22

23. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 23
JansonHewsflickr.com

24. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 24
“… teaching in higher education will
necessarily shift the balance of its efforts
towards a greater investment in design as
a way of coping with otherwise intolerable
pressures on staff and resources”
Goodyear, P. (2015). Teaching as Design. HERDSA Review of Higher Education, 2, 27-50.

25. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 25
“There is no such thing as a neutral design”
JeremyBrooksflickr.com
Thaler, R. H., & Sunstein, C. R. (2008). Nudge. Great Britain: Yale University Press.

26. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 26
Thaler, R. H., & Sunstein, C. R. (2008). Nudge. Great Britain: Yale University Press.
“People make good choices in contexts in
which they have experience, good
information, and prompt feedback”
DerekBruffflickr.com

27. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 27
TomHawkflickr.com
• Approach the design as if you were a
choice architect
• Help students to make the right
decisions
• Every small detail counts!

28. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 28
Bonwell, C. C., & Eison, J. A. (1991). Active Learning: Creating Excitement in the Classroom ASHEERIC Higher Education Report No. 1.
Washington, DC, USA: George Washington University.
Active
Learning
Any instructional method
that engages students in the
learning process
Active learning requires
students to do meaningful
learning activities and think
about what they are doing

29. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 29
Active Learning Works

30. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 30
Kugel, P. (1993). How professors develop as teachers. Studies in Higher Education, 18, 315-328. doi:10.1080/03075079312331382241
Self
Course Topic
Student as receptive
Student as active
Student as independent
EdYourdonflickr.com

31. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 31
1. Dual Role — Dual Mind
Judge CoachDomain
ofKnowledge
Mentality
RogerMommaerts
1

32. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 32
SamAbrahamflickr.com
Frontier between physical and virtual spaces is blurring
2. Multiple Spaces2

33. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 33
3. Sense of Purpose (Why?)
After this lecture/week
students should
be able to …
CCSUNZ2013flickr.com
3

34. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 34
trainingpahflickr.com
Bjork, R. A., Dunlosky, J., & Kornell, N. (2013). Self-regulated learning: beliefs, techniques, and illusions. Annu Rev Psychol, 64,
417-444. doi:10.1146/annurev-psych-113011-143823
4. Promote Practice
4

35. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 35
hijukalflickr.com
Think outside of the box
5. Maximise Power of Face-to-Face5

36. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 36
AftabUzzamanflickr.com
Design
Problem
Student
View
Our
Brain
In
Digital

37. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 37
Widen the design space

38. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 38
-NACH-flickr.com
InLectureTutorial/Assignments
Revised Bloom’s Taxonomy
Pohl, M. (2000). Learning to think
thinking to learn: Models and strategies
to develop a classroom culture of
thinking. Hawker Brownlow Education.
Cognitive Skills
Remembering
Understanding
Applying
Analysing
Evaluating
Creating

39. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 39
-NACH-flickr.com
Understanding
Applying
Analysing
Evaluating
Creating
PrepareLecture/Tutorial
Revised Bloom’s Taxonomy
Pohl, M. (2000). Learning to think
thinking to learn: Models and strategies
to develop a classroom culture of
thinking. Hawker Brownlow Education.
Cognitive Skills
Remembering

40. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 40
Available: bit.ly/elec1601 (Only Australian Universities)
1

41. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 41
3

42. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 42
Explain the context, discuss expectations
2

43. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 43
1

44. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 44
1

45. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 45
1

46. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 46
2

47. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 47
4

48. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 48
Practice
4

49. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 49
Preparation: Summative assessment
4

50. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 50
In-class Activities
5

51. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 51
Schell, J. (2012). Can you flip large classes? https://blog.peerinstruction.net/2012/04/06/can-you-flip-large-classes/
Used in Large Classes
5

52. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 52
1. Use the theatre areas (five)
2. Assign an identifier to each area
3. Assign a digital gate to each area
4. Show input values: students raise hand if output is 1
5. Acknowledge the fastest area in the theatre
6. Repeat from step 3 changing the assignments
Outcome: Understand How Digital Gates Work
5

53. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 53
2

54. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 54
Hattie, J. A. (1999). Influences on student learning. Inaugural professorial address, University of Auckland, New Zealand
If You Could Choose One…
• More than 500 meta-analyses
of student achievements
• 100 factors with potential
influence
• Feedback in top five
• (74 meta-analyses) Most
effective form: video, audio,
computer-assisted
instructional feedback, and/or
related goals

55. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 55
Hattie, J., & Timperley, H. (2007). The Power of Feedback. Review of Educational Research, 77(1), 81-112.
doi:10.3102/003465430298487
Tom
Feedback Levels
1. Task Level (understanding, performance)
2. Process Level (what to do to understand, perform)
3. Self-regulation level (detecting and directing effort)
4. Self level (personal evaluation and affect)

56. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 56
Krause, K.-L., Hartley, R., James, R., & McInnis, C. (2005). The First Year Experience in Australian Universities: Findings from a
decade of National Studies. University of Melbourne: Centre for the Study of Higher Education.
Eleafflickr.com
The feedback question gets systematically
lower values in student surveys

57. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 57
Students are less likely to
engage in pre-class activities if
they are not interactive, do not
provide formative feedback,
and not coherently linked with
the face-to-face activities
O'Flaherty, J., & Phillips, C. (2015). The use of flipped classrooms in higher education: A scoping review. The Internet and Higher
Education, 25, 85-95. doi:10.1016/j.iheduc.2015.02.002
DanKlimkeflickr.com

58. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 58
Pardo, A. (2017). A feedback model for data-rich learning experiences. Assessment & Evaluation in Higher Education, 1-11. doi:
10.1080/02602938.2017.1356905
FarukAteşflickr.com
“Feedback is a process to positively influence how students
engage with their work in a learning experience so that they can
improve its overall quality with respect to an appropriate reference
and increase their self-evaluative capacity”

59. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 59
ontasklearning.org

60. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 60

61. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 61
Automatic
Email
2.Process
Level(w
hatto
do
to
understand)

62. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 62
Helpful feedback
Effect size (Cohen’s d) = 0.49
Medium positive effect
Midterm Scores
Effect size (Cohen’s d) = 0.21
Small positive effect
Pardo, A., Jovanović, J., Dawson, S., Gašević, D., & Mirriahi, N. (In press). Using Learning Analytics to Scale the Provision of
Personalised Feedback. British Journal of Educational Technology. doi:10.1111/bjet.12592

63. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 63
• Support instructors to
manage personalised
feedback processes
• Simple rule-base
knowledge encoding
• Provide appropriate
view of data sources
• Scale to large and highly
diverse cohorts
• Open-source project
• Pilots in 2017 finished
• Contact us if interested
ontasklearning.org

64. Abelardo Pardo Designing Engaging Learning Experiences in Digital Environments 64
DrewLeavy
• Rethink student engagement
• There is no neutral design — choice architect
• Dual mind — role, multiple spaces,
sense of purpose, promote practice,
value of face-to-face
• The power of feedback
Conclusions

65. Designing Engaging
Learning Experiences
in Digital Environments
A/Prof Abelardo Pardo (@abelardopardo)
Faculty of Engineering and IT
slideshare.net/abelardo_pardo
Biosciences Education Forum — BEAN
11 December 2017
SanAndreasflickr.com