SlideShare une entreprise Scribd logo
1  sur  34
Assessment and feedback in
large classes
Professor David Carless,
@CarlessDavid
University of Hong Kong,
PHELC, June 2, 2020
https://sites.google.com/dcu.ie/phelc
The University of Hong Kong
Overview
1. Beyond teacher transmission
2. Assessment & feedback designs
3. Enhancing student internal feedback
4. Teacher feedback literacy
The University of Hong Kong
Goals
Reduce unproductive teacher marking
Design feedback processes
that enable student action
The University of Hong Kong
Feedback as telling is overrated
“Learners do not always
learn much purely from
being told, even when they
are told repeatedly in the
kindest possible way”
(Sadler, 2015, p. 16)
The University of Hong Kong
Teacher workload
“The generation of information to students
about their work is time-consuming. It
cannot be justified if there is no explicit
expectation that it will be used”. (Boud &
Molloy, 2013, p. 206).
The University of Hong Kong
The University of Hong Kong
DISCOUNT CODE:
FLR40
Chapter 5:
Enabling feedback through assessment
design
The University of Hong Kong
Tort Law
Core 1st year course: 200+ students
The University of Hong Kong
Professor Rick Glofcheski,
HKU
The University of Hong Kong
Tort Law Assessment
Reflective Media Diary (30%)
+ Tests / Exams
The University of Hong Kong
Reflective Media Diary (RMD)
• Identify relevant legal cases; track
developments; provide analysis;
• Portfolio-style: collecting, selecting &
editing material over time.
The University of Hong Kong
RMD features
Steady student engagement
Promotes reading habits
The University of Hong Kong
Marked online exemplars
Exemplars of past student work of different
levels to clarify expectations
The University of Hong Kong
Internal feedback
What learners generate for themselves
The University of Hong Kong
Meta-cognitive processes deployed when
working on a task
External  Internal feedback
Internal feedback is inherent in any use of
external feedback (Nicol, 2019)
The University of Hong Kong
Exemplars as proxies for feedback
High quality exemplars act as inputs which
stimulate students’ internal feedback
(Carless, 2020, under review)
The University of Hong Kong
The University of Hong Kong
Integration & coherence
Exam questions also based on authentic
sources from news media
The University of Hong Kong
Wider applications
The University of Hong Kong
RMD adapted & taken up by colleagues in
other disciplines
Implications
The University of Hong Kong
(Carless & Winstone, 2020)
Key implications
1. Develop effective assessment &
feedback designs;
2. Stimulate the development of student
internal feedback;
3. Involve students in generating, seeking
and using feedback
The University of Hong Kong
References
Boud, D. & Molloy, E. (2013). Decision-making for feedback. In D. Boud & E. Molloy
(Eds.), Feedback in Higher and Professional Education. London: Routledge.
Carless, D. (2015). Excellence in University Assessment: Learning from award-winning
practice. London: Routledge.
Carless, D. & Boud, D. (2018). The development of student feedback literacy: Enabling
uptake of feedback. Assessment & Evaluation in Higher Education,
doi:10.1080/02602938.2018.1463354
Carless, D. & N. Winstone (2020, forthcoming). Teacher feedback literacy and its
interplay with student feedback literacy, Teaching in Higher Education.
Nicol D (2019) Reconceptualising feedback as an internal not an external process. Italian
Journal of Educational Research. Available at:
https://ojs.pensamultimedia.it/index.php/sird/article/view/3270
Sadler, D.R. (2015). Backwards assessment explanations: Implications for teaching and
assessment practice. In D. Lebler et al. (Eds.), Assessment in music education: From
policy to practice (pp.9-19). Cham: Springer.
Winstone, N. & Carless, D. (2019). Designing effective feedback processes in higher
education: A learning-focused approach. London: Routledge.
The University of Hong Kong
The University of Hong Kong
The University of Hong Kong
Transforming assessment
The University of Hong Kong
Defining teacher feedback literacy
Knowledge, expertise & dispositions to
design feedback processes to enable
student uptake and seed student feedback
literacy
(Carless & Winstone, forthcoming in
Teaching in Higher Education)
The University of Hong Kong
Student feedback literacy
The University of Hong Kong
Making
Judgments
Appreciating
Feedback
Managing
Affect
Taking Action
(Carless & Boud, 2018)
Deploy teacher workload wisely
Reduce teacher commentary at times when
it cannot be taken up (Boud & Molloy, 2013)
The University of Hong Kong
https://www.dylanwiliamcenter.com/feedbac
k-for-learning-make-time-to-save-time/
The University of Hong Kong
“Feedback should
be more work for
the recipient than
the donor”
Potential workload savers
The University of Hong Kong
Increase Decrease
Feedback on student requests Unsolicited comments
Within module guidance Terminal comments
Comments on first task Comments on final task
Feedback in first year Feedback in final year
The University of Hong Kong

Contenu connexe

Tendances

Tendances (20)

Oct 21 Learning-oriented assessment
Oct 21 Learning-oriented assessmentOct 21 Learning-oriented assessment
Oct 21 Learning-oriented assessment
 
Improvement begins with I: The value of feedback literacy
Improvement begins with I: The value of feedback literacyImprovement begins with I: The value of feedback literacy
Improvement begins with I: The value of feedback literacy
 
Teaching for quality student learning
Teaching for quality student learningTeaching for quality student learning
Teaching for quality student learning
 
Feedback literacy as a key to ongoing improvement
Feedback literacy as a key to ongoing improvementFeedback literacy as a key to ongoing improvement
Feedback literacy as a key to ongoing improvement
 
Feedback literacy for digital futures
Feedback literacy for digital futuresFeedback literacy for digital futures
Feedback literacy for digital futures
 
Sustainable assessment & online learning environments
Sustainable assessment & online learning environmentsSustainable assessment & online learning environments
Sustainable assessment & online learning environments
 
AHE Feedback Literacy
AHE Feedback Literacy AHE Feedback Literacy
AHE Feedback Literacy
 
Feedback for the longer term: enhancing student feedback literacy
Feedback for the longer term: enhancing student feedback literacyFeedback for the longer term: enhancing student feedback literacy
Feedback for the longer term: enhancing student feedback literacy
 
Integrating the development of student and staff feedback literacy
Integrating the development of student and staff feedback literacyIntegrating the development of student and staff feedback literacy
Integrating the development of student and staff feedback literacy
 
Researching Excellence in Assessment and Feedback
Researching Excellence in Assessment and FeedbackResearching Excellence in Assessment and Feedback
Researching Excellence in Assessment and Feedback
 
Assessment and feedback for learning: Beyond closed book exams
Assessment and feedback for learning: Beyond closed book examsAssessment and feedback for learning: Beyond closed book exams
Assessment and feedback for learning: Beyond closed book exams
 
Developing staff and student feedback literacy in partnership
Developing staff and student feedback literacy in partnershipDeveloping staff and student feedback literacy in partnership
Developing staff and student feedback literacy in partnership
 
Towards productive teacher-student partnerships in feedback processes
Towards productive teacher-student partnerships in feedback processesTowards productive teacher-student partnerships in feedback processes
Towards productive teacher-student partnerships in feedback processes
 
Assessment Issues & Strategies
Assessment Issues & StrategiesAssessment Issues & Strategies
Assessment Issues & Strategies
 
Feedback in online learning environments
Feedback in online learning environmentsFeedback in online learning environments
Feedback in online learning environments
 
Effective Assessment and feedback designs
Effective Assessment and feedback designsEffective Assessment and feedback designs
Effective Assessment and feedback designs
 
Shared feedback literacy: Designing for productive feedback experiences
Shared feedback literacy: Designing for productive feedback experiencesShared feedback literacy: Designing for productive feedback experiences
Shared feedback literacy: Designing for productive feedback experiences
 
Book Launch: Designing effective feedback processes
Book Launch: Designing effective feedback processesBook Launch: Designing effective feedback processes
Book Launch: Designing effective feedback processes
 
Developing staff & student feedback literacy
Developing staff & student feedback literacyDeveloping staff & student feedback literacy
Developing staff & student feedback literacy
 
Beyond teacher comments: Designing for student uptake of feedback
Beyond teacher comments: Designing for student uptake of feedbackBeyond teacher comments: Designing for student uptake of feedback
Beyond teacher comments: Designing for student uptake of feedback
 

Similaire à Assessment and feedback in large classes

Similaire à Assessment and feedback in large classes (20)

Feedback literacy research and practice: state-of-the art and future directions
Feedback literacy research and practice: state-of-the art and future directionsFeedback literacy research and practice: state-of-the art and future directions
Feedback literacy research and practice: state-of-the art and future directions
 
Students generating and using feedback in online learning environments
Students generating and using feedback in online learning environmentsStudents generating and using feedback in online learning environments
Students generating and using feedback in online learning environments
 
Learners seeking, generating and using feedback inputs: The role of student a...
Learners seeking, generating and using feedback inputs: The role of student a...Learners seeking, generating and using feedback inputs: The role of student a...
Learners seeking, generating and using feedback inputs: The role of student a...
 
Designing satisfying feedback experiences
Designing satisfying feedback experiencesDesigning satisfying feedback experiences
Designing satisfying feedback experiences
 
Supporting the development of student feedback literacy
Supporting the development of student feedback literacySupporting the development of student feedback literacy
Supporting the development of student feedback literacy
 
Supporting Students in Generating and Using Feedback
Supporting Students in Generating and Using FeedbackSupporting Students in Generating and Using Feedback
Supporting Students in Generating and Using Feedback
 
Learner agency, feedback and learning analytics
Learner agency, feedback and learning analyticsLearner agency, feedback and learning analytics
Learner agency, feedback and learning analytics
 
Designing feedback processes for large classes
Designing feedback processes for large classesDesigning feedback processes for large classes
Designing feedback processes for large classes
 
Towards making feedback processes satisfying for teachers and useful for stud...
Towards making feedback processes satisfying for teachers and useful for stud...Towards making feedback processes satisfying for teachers and useful for stud...
Towards making feedback processes satisfying for teachers and useful for stud...
 
Feedback Pack Week 1.pptx
Feedback Pack Week 1.pptxFeedback Pack Week 1.pptx
Feedback Pack Week 1.pptx
 
Effective learning-oriented assessment: Developing student feedback literacy
Effective learning-oriented assessment: Developing student feedback literacyEffective learning-oriented assessment: Developing student feedback literacy
Effective learning-oriented assessment: Developing student feedback literacy
 
Technology-enabled learning-oriented assessment
Technology-enabled learning-oriented assessmentTechnology-enabled learning-oriented assessment
Technology-enabled learning-oriented assessment
 
Keynote sustainable feedback
Keynote sustainable feedbackKeynote sustainable feedback
Keynote sustainable feedback
 
Developing sustainable feedback
Developing sustainable feedback Developing sustainable feedback
Developing sustainable feedback
 
Developing feedback as dialogue
Developing feedback as dialogueDeveloping feedback as dialogue
Developing feedback as dialogue
 
Feedback literacy, feedback seeking and lifelong learning: Implications for d...
Feedback literacy, feedback seeking and lifelong learning: Implications for d...Feedback literacy, feedback seeking and lifelong learning: Implications for d...
Feedback literacy, feedback seeking and lifelong learning: Implications for d...
 
New directions for feedback seeking research and practice
New directions for feedback seeking research and practiceNew directions for feedback seeking research and practice
New directions for feedback seeking research and practice
 
Feedback by design
Feedback by design Feedback by design
Feedback by design
 
Designing for student uptake of feedback in EAP
Designing for student uptake of feedback in EAPDesigning for student uptake of feedback in EAP
Designing for student uptake of feedback in EAP
 
Assessment values & their enactment in the generative AI era
Assessment values & their enactment in the generative AI eraAssessment values & their enactment in the generative AI era
Assessment values & their enactment in the generative AI era
 

Dernier

Salient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functionsSalient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functions
KarakKing
 

Dernier (20)

Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)
 
Exploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptx
Exploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptxExploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptx
Exploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptx
 
Plant propagation: Sexual and Asexual propapagation.pptx
Plant propagation: Sexual and Asexual propapagation.pptxPlant propagation: Sexual and Asexual propapagation.pptx
Plant propagation: Sexual and Asexual propapagation.pptx
 
Fostering Friendships - Enhancing Social Bonds in the Classroom
Fostering Friendships - Enhancing Social Bonds  in the ClassroomFostering Friendships - Enhancing Social Bonds  in the Classroom
Fostering Friendships - Enhancing Social Bonds in the Classroom
 
How to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptxHow to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptx
 
Interdisciplinary_Insights_Data_Collection_Methods.pptx
Interdisciplinary_Insights_Data_Collection_Methods.pptxInterdisciplinary_Insights_Data_Collection_Methods.pptx
Interdisciplinary_Insights_Data_Collection_Methods.pptx
 
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
 
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdfUnit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdf
 
Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024
 
Application orientated numerical on hev.ppt
Application orientated numerical on hev.pptApplication orientated numerical on hev.ppt
Application orientated numerical on hev.ppt
 
Food safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdfFood safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdf
 
How to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POSHow to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POS
 
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
 
Google Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptxGoogle Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptx
 
How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17
 
Salient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functionsSalient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functions
 
REMIFENTANIL: An Ultra short acting opioid.pptx
REMIFENTANIL: An Ultra short acting opioid.pptxREMIFENTANIL: An Ultra short acting opioid.pptx
REMIFENTANIL: An Ultra short acting opioid.pptx
 
FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024
 
Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdf
 
Single or Multiple melodic lines structure
Single or Multiple melodic lines structureSingle or Multiple melodic lines structure
Single or Multiple melodic lines structure
 

Assessment and feedback in large classes

  • 1. Assessment and feedback in large classes Professor David Carless, @CarlessDavid University of Hong Kong, PHELC, June 2, 2020 https://sites.google.com/dcu.ie/phelc The University of Hong Kong
  • 2. Overview 1. Beyond teacher transmission 2. Assessment & feedback designs 3. Enhancing student internal feedback 4. Teacher feedback literacy The University of Hong Kong
  • 3. Goals Reduce unproductive teacher marking Design feedback processes that enable student action The University of Hong Kong
  • 4. Feedback as telling is overrated “Learners do not always learn much purely from being told, even when they are told repeatedly in the kindest possible way” (Sadler, 2015, p. 16) The University of Hong Kong
  • 5. Teacher workload “The generation of information to students about their work is time-consuming. It cannot be justified if there is no explicit expectation that it will be used”. (Boud & Molloy, 2013, p. 206). The University of Hong Kong
  • 6.
  • 7. The University of Hong Kong DISCOUNT CODE: FLR40
  • 8. Chapter 5: Enabling feedback through assessment design The University of Hong Kong
  • 9. Tort Law Core 1st year course: 200+ students The University of Hong Kong
  • 10. Professor Rick Glofcheski, HKU The University of Hong Kong
  • 11. Tort Law Assessment Reflective Media Diary (30%) + Tests / Exams The University of Hong Kong
  • 12. Reflective Media Diary (RMD) • Identify relevant legal cases; track developments; provide analysis; • Portfolio-style: collecting, selecting & editing material over time. The University of Hong Kong
  • 13. RMD features Steady student engagement Promotes reading habits The University of Hong Kong
  • 14. Marked online exemplars Exemplars of past student work of different levels to clarify expectations The University of Hong Kong
  • 15. Internal feedback What learners generate for themselves The University of Hong Kong Meta-cognitive processes deployed when working on a task
  • 16. External  Internal feedback Internal feedback is inherent in any use of external feedback (Nicol, 2019) The University of Hong Kong
  • 17. Exemplars as proxies for feedback High quality exemplars act as inputs which stimulate students’ internal feedback (Carless, 2020, under review) The University of Hong Kong
  • 18. The University of Hong Kong
  • 19. Integration & coherence Exam questions also based on authentic sources from news media The University of Hong Kong
  • 20. Wider applications The University of Hong Kong RMD adapted & taken up by colleagues in other disciplines
  • 23. Key implications 1. Develop effective assessment & feedback designs; 2. Stimulate the development of student internal feedback; 3. Involve students in generating, seeking and using feedback The University of Hong Kong
  • 24. References Boud, D. & Molloy, E. (2013). Decision-making for feedback. In D. Boud & E. Molloy (Eds.), Feedback in Higher and Professional Education. London: Routledge. Carless, D. (2015). Excellence in University Assessment: Learning from award-winning practice. London: Routledge. Carless, D. & Boud, D. (2018). The development of student feedback literacy: Enabling uptake of feedback. Assessment & Evaluation in Higher Education, doi:10.1080/02602938.2018.1463354 Carless, D. & N. Winstone (2020, forthcoming). Teacher feedback literacy and its interplay with student feedback literacy, Teaching in Higher Education. Nicol D (2019) Reconceptualising feedback as an internal not an external process. Italian Journal of Educational Research. Available at: https://ojs.pensamultimedia.it/index.php/sird/article/view/3270 Sadler, D.R. (2015). Backwards assessment explanations: Implications for teaching and assessment practice. In D. Lebler et al. (Eds.), Assessment in music education: From policy to practice (pp.9-19). Cham: Springer. Winstone, N. & Carless, D. (2019). Designing effective feedback processes in higher education: A learning-focused approach. London: Routledge. The University of Hong Kong
  • 25. The University of Hong Kong
  • 26. The University of Hong Kong
  • 28. Defining teacher feedback literacy Knowledge, expertise & dispositions to design feedback processes to enable student uptake and seed student feedback literacy (Carless & Winstone, forthcoming in Teaching in Higher Education) The University of Hong Kong
  • 29. Student feedback literacy The University of Hong Kong Making Judgments Appreciating Feedback Managing Affect Taking Action (Carless & Boud, 2018)
  • 30. Deploy teacher workload wisely Reduce teacher commentary at times when it cannot be taken up (Boud & Molloy, 2013) The University of Hong Kong
  • 31. https://www.dylanwiliamcenter.com/feedbac k-for-learning-make-time-to-save-time/ The University of Hong Kong “Feedback should be more work for the recipient than the donor”
  • 32. Potential workload savers The University of Hong Kong Increase Decrease Feedback on student requests Unsolicited comments Within module guidance Terminal comments Comments on first task Comments on final task Feedback in first year Feedback in final year
  • 33.
  • 34. The University of Hong Kong