SlideShare une entreprise Scribd logo
1  sur  20
Télécharger pour lire hors ligne
Proposing a model for the incremental
development of peer assessment and
feedback skills: a case study
Dr Laura Costelloe
Mary Immaculate College, Limerick
Ireland
Co-authored with Dr Arlene Egan, Roffey
Park Institute, Dublin
Overview of Paper
• Context
• Theoretical observations
• Methodology
• Brief examples from practice
• Discussion: student feedback from focus group
• Overview of theoretical feedback skills development model
• Conclusion
Context
• 60 ECTS PG Diploma for Higher
Education teachers;
• Mainly targeted at early-career
teachers;
• Programme aims to develop teachers’
knowledge, skills and dispositions in a
variety of key areas of academic
practice;
• 5 ECTS module on Educational
Assessment, but programme team
recognised a need to embed skills
related to assessment and feedback
across the programme
Photo by Element5 Digital on Unsplash
National understanding of assessment
of/for/as learning
(National Forum, 2017)
Theoretical Observations
• Assessment broadly defined: formative and summative assessment, involves
actions such as ‘evaluation, grading, marking, critiqueing, reviewing etc.’ (Adachi,
Tai & Dawson, 2018: 454);
• Skill development is maximised when a programmatic approach is adopted (Jessop
& Tomas, 2017);
• Giving and receiving feedback are not innate skills – multiple opportunities to
practice these skills are needed (Adachi, Tai & Dawson, 2018; Cassidy, 2006);
• Sought to build on opportunities for self-assessment to support peer assessment
and feedback (Reinholz, 2016)
Our Aims
• Learners are viewed as both producers and consumers of feedback
(Andrade, 2010); shift away from the teacher as ‘expert’ and only source of
feedback, i.e. develop feedback literacy (Winstone & Carless, 2019);
• Embed formative assessment tasks, including self- and peer-assessment,
throughout the programme and across modules to enable student learning
to be maximised through their active involvement in the learning process
(Gibbs & Jenkins, 1992; Ramsden, 1992);
• Aimed to promote best practice to allow for a ‘congruence between
assessment practices and the kinds of learning a course aims to promote’
(Boud, Cohen & Sampson, 1999: 413).
Photo by Silvan Arnet on Unsplash
Moving from ‘transmission’ to
‘transformation’ (Winstone & Carless, 2019)
• Old paradigm approach:
• Turnaround time
• Detailed comments
• Educators delivering feedback
• Consistency of feedback across modules
• Impact of feedback practices on student
satisfaction
• New paradigm approach:
• Timed to enable application to
subsequent tasks
• Actionable comments
• Opportunities for students to seek and
generate feedback
• Connectivity of learning across modules
• Impact of feedback practices on students’
learning
Effective feedback is not something that happens
after assessment has taken place; rather, it is
designed into learning processes from the outset
(Winstone & Carless, 2019: 9)
How did we do it?
‘Chalk Talk’ exercises
(following Brookfield)
Structured teacher
feedback dialogues
Self-assessment
questionnaires
Co-creation of rubrics
Structured formative
peer review of writing
Guided small group
discursive activities
Individual reflective
writing
Group application of
rubric to group draft
outputs
Programmatic approach: ongoing communication between programme teachers to develop a structured plan for the
‘when’ and ‘how’ of assessment and feedback
Did it work? Methodology
• Hosted focus group, attended by 40% of class cohort (n=6)
• Early career higher education teachers (Early Childhood Education,
Psychology and Education)
• 1-4 years experience
• 5 female, 1 male; representative of the disciplines that were present
(Lynch, 2010; UNESCO, 2011)
• Data analysed thematically
Opening Question: what comes to mind when
you think of peer feedback?
Discussion: key themes
(1) Practice is needed, giving feedback is hard!
“because I think that, as a teacher, giving feedback and assessment is actually
really difficult”
“I didn’t find it [...] easy, but that’s because I’m not used to it, I’m not used to
getting constructive feedback, I’m not used to giving it”
“I found it really hard to give the feedback”
Participants also referred to their dual identity (learner/teacher) and the
tensions/lack of confidence they felt.
Students need opportunities to
develop their abilities to assess others
(2) Rubrics, templates and guidelines were particularly welcomed to
structure the assessment and feedback activities
“I think if you have a structure then you know what you are looking for,
rather than just being like ‘I really liked this’”
Rubrics, templates and guidelines help to address any of the feelings of
fear and mistrust that can accompany peer assessment and feedback
activities;
Our findings support existing research highlighting the importance of
rubrics, templates and clear guidelines to scaffold learners (Adachi et al.
2018; Evans, 2013; Topping, 1998).
Students need opportunities to
develop their abilities give and
receive feedback
(3) Emphasis on group-to-group peer assessment/feedback particularly
beneficial
“I prefer when it’s the whole group giving feedback together, I think it’s easier
than giving it 1-1. You might say ‘oh I really liked when they did this’ and then
[another student] would jump in and say ‘oh yeah, that was really good’. So you
didn’t feel like you were just one person”
“When we were marking them we could see what other people were scoring
and we could say it as a group...safety in numbers”
Indication of the difficulty in making evaluative judgments experienced by
students, including early career HE teachers
Students need opportunities to
develop their abilities to make
judgments
(4) Relationships really matter
“..it was hard to know, to give the feedback, but also to take it as
well….from a peer, it was hard”
“I think that we had a really good group dynamic, in general, across the
whole year. So if next year, people didn’t click as well […] doing something
like that early in the semester might not work as well. Because I think
everyone did really get on, and were open to feedback […] I think it
depends on the group dynamics”
“So if you have a group of students where one student thinks the other
students are rubbish, their feedback is not going to mean anything to
them”
“We really need to look at building relationships I think, and people
trusting each other and everybody seeing each other as peers. Because
you can’t really give peer feedback unless everyone sees themselves as
equals”
A model for incremental feedback skill
development
01
SELF ASSESSMENT
AND FEEDBACK WITH
A MORE QUALIFIED
OTHER
02
SELF AND PEER
ASSESSMENT AND
FEEDBACK
03
GROUP-GROUP PEER
ASSESSMENT AND
FEEDBACK
Collaboratively developed
rubrics/frameworks;
Guided questioning;
Guided discussions
04
1-1 PEER ASSESSMENT
AND FEEDBACK
Apply rubrics to outputs;
1-1 discussions
05
1-GROUP
ASSESSMENT AND
FEEDBACK
Apply rubrics to outputs;
Group discussions
Tutor dialogues; Self-
assessment forms;
Reflective pieces
Use of structured
rubrics/frameworks;
Structured discussions
(Egan and Costelloe, 2016; Costelloe and Egan, 2020)
Conclusions
• Giving and receiving feedback are not innate skills and require
practice and opportunities to develop abilities – even for early career
Higher Education teachers;
• Important to create a safe atmosphere of trust and inclusion where
learning is embraced and concerns are shared – critically important to
create ‘feedback rich environments’ (Esterhazy and Damşa, 2019)
• Students ‘must feel comfortable and trust one another in order to provide
honest and constructive feedback’ (Burke and Pieterick, 2010: 64)
• Particular considerations in the context of developing teacher
feedback literacy – how can we support the development of teacher
feedback literacy in accredited teaching and learning programmes?
Works Cited
• Adachi, C., Tai, J. and Dawson, P. (2018) 'A framework for designing, implementing, communicating and researching peer
assessment', Higher Education Research & Development, 37(3), 453-467.
• Andrade, H.L. (2010) 'Students as the definitive source of formative assessment: academic self-assessment and the self-
regulation of learning', NERA Conference Proceedings 2010, 25.
• Boud, D., Cohen, R. and Sampson, J. (1999) 'Peer learning and assessment', Assessment & Evaluation in Higher Education, 34(4),
413-426.
• Burke, D. and Pieterick, J. (2010) Giving Students Effective Written Feedback, Maidenhead, UK: Open University Press.
• Carless, D. and Boud, D. (2018) 'The development of student feedback literacy: enabling uptake of feedback', Assessment &
Evaluation in Higher Education, 43(8), 1315-1325.
• Cassidy, S. (2006) 'Developing employability skills: peer assessment in higher education', Education + Training, 48(7), 508-517.
• Costelloe, L. and Egan, A. (2020) “Because, as a teacher, giving feedback and assessment is actually really difficult”: using self-
and peer-assessment to develop Higher Education teachers’ skills in assessment and feedback’, Proceedings of Higher Education
Advances Conference, Editorial Universitat Politecnica de Valencia: 501-508. DOI:https://doi.org/10.4995/HEAd20.2020.11096
• Egan, A. and Costelloe, L. (2016) 'Peer assessment of, for and as learning: a core component of an accredited professional
development course for Higher Education teachers', AISHE-J: The All Ireland Journal of Teaching and Learning in Higher
Education, 8(3), 2931-29313.
• Esterhazy, R. and C. Damşa (2019). "Unpacking the feedback process: an analysis of undergraduate students' interactional
meaning-making of feedback comments." Studies in Higher Education 44(2): 260-274.
• Evans, C. (2013) 'Making sense of assessment feedback in Higher Education', Review of Educational Research, 83(1), 70-120.
• Gibbs, G. and Jenkins, A. eds. (1992) Teaching Large Classes in Higher Education, London: Kogan Page.
• Jessop, T. and Tomas, C. (2017) 'The implications of programme assessment patterns for student learning',
Assessment & Evaluation in Higher Education, 42(6), 990-999.
• Lam, R. (2015) 'Assessment as learning; examining a cycle of teaching, learning and assessment of writing in
the portfolio-based classroom', Studies in Higher Education, 1-18.
• Lynch, K. (2010). "Carelessness: a hidden doxa of higher education" Arts and Humanities in Higher Education
9(1): 54-67.
• National Forum for the Enhancement of Teaching and Learning in Higher Education (2017) "Expanding our
Understanding of Assessment and Feedback in Irish Higher Education,“. Available at:
https://www.teachingandlearning.ie/publication/expanding-our-understanding-of-assessment-and-
feedback-in-irish-higher-education/. Last Accessed November 6, 2019.
• Pedder, D. and James, M. (2012) 'Professional learning as a condition for assessment for learning' in Gardner,
J., ed., Assessment and Learning, 2nd ed., London: Sage, 33-48.
• Ramsden, P. (1992) Learning to Teach in Higher Education, London: Routledge.
• Reinholz, D. (2016) 'The assessment cycle: a model for learning through peer-assessment', Assessment &
Evaluation in Higher Education, 41(2).
• Topping, K. (1998) 'Peer assessment between students in colleges and universities', Review of Educational
Research, 68(3), 249-276.
• Winstone, N. and Carless, D. (2019) Designing Effective Feedback Processes in Higher Education: a learning-
focused approach, Oxford: Routledge.
• UNESCO (2011) Women and the Teaching Profession: exploring the feminisation debate.
THANK YOU
Laura.Costelloe@mic.ul.ie
@Lostelloe
Slides available on Slideshare

Contenu connexe

Similaire à Proposing a model for the incremental development of peer assessment and feedback skills: a case study

Moving Beyond Student Ratings to Evaluate Teaching
Moving Beyond Student Ratings to Evaluate TeachingMoving Beyond Student Ratings to Evaluate Teaching
Moving Beyond Student Ratings to Evaluate TeachingVicki L. Wise
 
Reflective Commentary
Reflective Commentary Reflective Commentary
Reflective Commentary susan70
 
Exploring formative assessment
Exploring formative assessmentExploring formative assessment
Exploring formative assessmentgamid111
 
Harnessing the Potential of PeerMark to Enhance and Enrich the Student Exper...
Harnessing the Potential of PeerMark to Enhance and Enrich  the Student Exper...Harnessing the Potential of PeerMark to Enhance and Enrich  the Student Exper...
Harnessing the Potential of PeerMark to Enhance and Enrich the Student Exper...Kenji Lamb
 
Harnessing the Potential of PeerMark to Enhance and Enrich the Student Exper...
Harnessing the Potential of PeerMark to Enhance and Enrich  the Student Exper...Harnessing the Potential of PeerMark to Enhance and Enrich  the Student Exper...
Harnessing the Potential of PeerMark to Enhance and Enrich the Student Exper...Neil G. McPherson
 
Symposium visual final
Symposium visual finalSymposium visual final
Symposium visual finalDianeOnorato
 
TESTA, Kingston University Keynote
TESTA, Kingston University KeynoteTESTA, Kingston University Keynote
TESTA, Kingston University KeynoteTESTA winch
 
Lights, action, clapperboards: changing how students think and perform throug...
Lights, action, clapperboards: changing how students think and perform throug...Lights, action, clapperboards: changing how students think and perform throug...
Lights, action, clapperboards: changing how students think and perform throug...Tansy Jessop
 
"Billy Cart" Unit
"Billy Cart" Unit"Billy Cart" Unit
"Billy Cart" Unitjoelius
 
Formative assessment
Formative assessmentFormative assessment
Formative assessmentdschraeder
 
Pg cert appraising your teaching 2011
Pg cert appraising your teaching 2011 Pg cert appraising your teaching 2011
Pg cert appraising your teaching 2011 ClareVMilsom
 
CoreSep11: assessment_and_feedback
CoreSep11: assessment_and_feedbackCoreSep11: assessment_and_feedback
CoreSep11: assessment_and_feedbackAcademic Development
 
Utilizing Rubrics in Audio/Visual Production
Utilizing Rubrics in Audio/Visual ProductionUtilizing Rubrics in Audio/Visual Production
Utilizing Rubrics in Audio/Visual ProductionCorey Anderson
 
Faculty of Economics Trisakti University - Problem Based Learning (7 Jump Step)
Faculty of Economics Trisakti University - Problem Based Learning (7 Jump Step)Faculty of Economics Trisakti University - Problem Based Learning (7 Jump Step)
Faculty of Economics Trisakti University - Problem Based Learning (7 Jump Step)Dwitya Aribawa
 
Ev681 session3 planning
Ev681 session3 planningEv681 session3 planning
Ev681 session3 planningPippa Totraku
 
Powerful professional development lesson study and observation
Powerful professional development lesson study and observationPowerful professional development lesson study and observation
Powerful professional development lesson study and observationIRIS Connect
 
Y1 Feedback Project, Maynooth Ireland
Y1 Feedback Project, Maynooth IrelandY1 Feedback Project, Maynooth Ireland
Y1 Feedback Project, Maynooth IrelandTansy Jessop
 
Cracking the challenge of formative assessment and feedback
Cracking the challenge of formative assessment and feedbackCracking the challenge of formative assessment and feedback
Cracking the challenge of formative assessment and feedbackTansy Jessop
 
Module 13: School Leadership : Concepts and Application
 Module 13: School Leadership : Concepts and Application Module 13: School Leadership : Concepts and Application
Module 13: School Leadership : Concepts and ApplicationNISHTHA_NCERT123
 

Similaire à Proposing a model for the incremental development of peer assessment and feedback skills: a case study (20)

Moving Beyond Student Ratings to Evaluate Teaching
Moving Beyond Student Ratings to Evaluate TeachingMoving Beyond Student Ratings to Evaluate Teaching
Moving Beyond Student Ratings to Evaluate Teaching
 
Reflective Commentary
Reflective Commentary Reflective Commentary
Reflective Commentary
 
App pgr workshop3
App pgr workshop3App pgr workshop3
App pgr workshop3
 
Exploring formative assessment
Exploring formative assessmentExploring formative assessment
Exploring formative assessment
 
Harnessing the Potential of PeerMark to Enhance and Enrich the Student Exper...
Harnessing the Potential of PeerMark to Enhance and Enrich  the Student Exper...Harnessing the Potential of PeerMark to Enhance and Enrich  the Student Exper...
Harnessing the Potential of PeerMark to Enhance and Enrich the Student Exper...
 
Harnessing the Potential of PeerMark to Enhance and Enrich the Student Exper...
Harnessing the Potential of PeerMark to Enhance and Enrich  the Student Exper...Harnessing the Potential of PeerMark to Enhance and Enrich  the Student Exper...
Harnessing the Potential of PeerMark to Enhance and Enrich the Student Exper...
 
Symposium visual final
Symposium visual finalSymposium visual final
Symposium visual final
 
TESTA, Kingston University Keynote
TESTA, Kingston University KeynoteTESTA, Kingston University Keynote
TESTA, Kingston University Keynote
 
Lights, action, clapperboards: changing how students think and perform throug...
Lights, action, clapperboards: changing how students think and perform throug...Lights, action, clapperboards: changing how students think and perform throug...
Lights, action, clapperboards: changing how students think and perform throug...
 
"Billy Cart" Unit
"Billy Cart" Unit"Billy Cart" Unit
"Billy Cart" Unit
 
Formative assessment
Formative assessmentFormative assessment
Formative assessment
 
Pg cert appraising your teaching 2011
Pg cert appraising your teaching 2011 Pg cert appraising your teaching 2011
Pg cert appraising your teaching 2011
 
CoreSep11: assessment_and_feedback
CoreSep11: assessment_and_feedbackCoreSep11: assessment_and_feedback
CoreSep11: assessment_and_feedback
 
Utilizing Rubrics in Audio/Visual Production
Utilizing Rubrics in Audio/Visual ProductionUtilizing Rubrics in Audio/Visual Production
Utilizing Rubrics in Audio/Visual Production
 
Faculty of Economics Trisakti University - Problem Based Learning (7 Jump Step)
Faculty of Economics Trisakti University - Problem Based Learning (7 Jump Step)Faculty of Economics Trisakti University - Problem Based Learning (7 Jump Step)
Faculty of Economics Trisakti University - Problem Based Learning (7 Jump Step)
 
Ev681 session3 planning
Ev681 session3 planningEv681 session3 planning
Ev681 session3 planning
 
Powerful professional development lesson study and observation
Powerful professional development lesson study and observationPowerful professional development lesson study and observation
Powerful professional development lesson study and observation
 
Y1 Feedback Project, Maynooth Ireland
Y1 Feedback Project, Maynooth IrelandY1 Feedback Project, Maynooth Ireland
Y1 Feedback Project, Maynooth Ireland
 
Cracking the challenge of formative assessment and feedback
Cracking the challenge of formative assessment and feedbackCracking the challenge of formative assessment and feedback
Cracking the challenge of formative assessment and feedback
 
Module 13: School Leadership : Concepts and Application
 Module 13: School Leadership : Concepts and Application Module 13: School Leadership : Concepts and Application
Module 13: School Leadership : Concepts and Application
 

Dernier

Unit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdfUnit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdfDr Vijay Vishwakarma
 
Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfagholdier
 
SOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning PresentationSOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning Presentationcamerronhm
 
Interdisciplinary_Insights_Data_Collection_Methods.pptx
Interdisciplinary_Insights_Data_Collection_Methods.pptxInterdisciplinary_Insights_Data_Collection_Methods.pptx
Interdisciplinary_Insights_Data_Collection_Methods.pptxPooja Bhuva
 
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptxHMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptxEsquimalt MFRC
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfAdmir Softic
 
How to Add New Custom Addons Path in Odoo 17
How to Add New Custom Addons Path in Odoo 17How to Add New Custom Addons Path in Odoo 17
How to Add New Custom Addons Path in Odoo 17Celine George
 
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...Amil baba
 
Python Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docxPython Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docxRamakrishna Reddy Bijjam
 
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...Pooja Bhuva
 
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptxHMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptxmarlenawright1
 
Plant propagation: Sexual and Asexual propapagation.pptx
Plant propagation: Sexual and Asexual propapagation.pptxPlant propagation: Sexual and Asexual propapagation.pptx
Plant propagation: Sexual and Asexual propapagation.pptxUmeshTimilsina1
 
Sociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning ExhibitSociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning Exhibitjbellavia9
 
Graduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - EnglishGraduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - Englishneillewis46
 
Salient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functionsSalient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functionsKarakKing
 
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...Pooja Bhuva
 
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdfUGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdfNirmal Dwivedi
 
Single or Multiple melodic lines structure
Single or Multiple melodic lines structureSingle or Multiple melodic lines structure
Single or Multiple melodic lines structuredhanjurrannsibayan2
 
General Principles of Intellectual Property: Concepts of Intellectual Proper...
General Principles of Intellectual Property: Concepts of Intellectual  Proper...General Principles of Intellectual Property: Concepts of Intellectual  Proper...
General Principles of Intellectual Property: Concepts of Intellectual Proper...Poonam Aher Patil
 
Understanding Accommodations and Modifications
Understanding  Accommodations and ModificationsUnderstanding  Accommodations and Modifications
Understanding Accommodations and ModificationsMJDuyan
 

Dernier (20)

Unit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdfUnit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdf
 
Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdf
 
SOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning PresentationSOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning Presentation
 
Interdisciplinary_Insights_Data_Collection_Methods.pptx
Interdisciplinary_Insights_Data_Collection_Methods.pptxInterdisciplinary_Insights_Data_Collection_Methods.pptx
Interdisciplinary_Insights_Data_Collection_Methods.pptx
 
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptxHMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdf
 
How to Add New Custom Addons Path in Odoo 17
How to Add New Custom Addons Path in Odoo 17How to Add New Custom Addons Path in Odoo 17
How to Add New Custom Addons Path in Odoo 17
 
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
 
Python Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docxPython Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docx
 
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
 
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptxHMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
 
Plant propagation: Sexual and Asexual propapagation.pptx
Plant propagation: Sexual and Asexual propapagation.pptxPlant propagation: Sexual and Asexual propapagation.pptx
Plant propagation: Sexual and Asexual propapagation.pptx
 
Sociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning ExhibitSociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning Exhibit
 
Graduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - EnglishGraduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - English
 
Salient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functionsSalient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functions
 
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
 
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdfUGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
 
Single or Multiple melodic lines structure
Single or Multiple melodic lines structureSingle or Multiple melodic lines structure
Single or Multiple melodic lines structure
 
General Principles of Intellectual Property: Concepts of Intellectual Proper...
General Principles of Intellectual Property: Concepts of Intellectual  Proper...General Principles of Intellectual Property: Concepts of Intellectual  Proper...
General Principles of Intellectual Property: Concepts of Intellectual Proper...
 
Understanding Accommodations and Modifications
Understanding  Accommodations and ModificationsUnderstanding  Accommodations and Modifications
Understanding Accommodations and Modifications
 

Proposing a model for the incremental development of peer assessment and feedback skills: a case study

  • 1. Proposing a model for the incremental development of peer assessment and feedback skills: a case study Dr Laura Costelloe Mary Immaculate College, Limerick Ireland Co-authored with Dr Arlene Egan, Roffey Park Institute, Dublin
  • 2. Overview of Paper • Context • Theoretical observations • Methodology • Brief examples from practice • Discussion: student feedback from focus group • Overview of theoretical feedback skills development model • Conclusion
  • 3. Context • 60 ECTS PG Diploma for Higher Education teachers; • Mainly targeted at early-career teachers; • Programme aims to develop teachers’ knowledge, skills and dispositions in a variety of key areas of academic practice; • 5 ECTS module on Educational Assessment, but programme team recognised a need to embed skills related to assessment and feedback across the programme Photo by Element5 Digital on Unsplash
  • 4. National understanding of assessment of/for/as learning (National Forum, 2017)
  • 5. Theoretical Observations • Assessment broadly defined: formative and summative assessment, involves actions such as ‘evaluation, grading, marking, critiqueing, reviewing etc.’ (Adachi, Tai & Dawson, 2018: 454); • Skill development is maximised when a programmatic approach is adopted (Jessop & Tomas, 2017); • Giving and receiving feedback are not innate skills – multiple opportunities to practice these skills are needed (Adachi, Tai & Dawson, 2018; Cassidy, 2006); • Sought to build on opportunities for self-assessment to support peer assessment and feedback (Reinholz, 2016)
  • 6. Our Aims • Learners are viewed as both producers and consumers of feedback (Andrade, 2010); shift away from the teacher as ‘expert’ and only source of feedback, i.e. develop feedback literacy (Winstone & Carless, 2019); • Embed formative assessment tasks, including self- and peer-assessment, throughout the programme and across modules to enable student learning to be maximised through their active involvement in the learning process (Gibbs & Jenkins, 1992; Ramsden, 1992); • Aimed to promote best practice to allow for a ‘congruence between assessment practices and the kinds of learning a course aims to promote’ (Boud, Cohen & Sampson, 1999: 413). Photo by Silvan Arnet on Unsplash
  • 7. Moving from ‘transmission’ to ‘transformation’ (Winstone & Carless, 2019) • Old paradigm approach: • Turnaround time • Detailed comments • Educators delivering feedback • Consistency of feedback across modules • Impact of feedback practices on student satisfaction • New paradigm approach: • Timed to enable application to subsequent tasks • Actionable comments • Opportunities for students to seek and generate feedback • Connectivity of learning across modules • Impact of feedback practices on students’ learning Effective feedback is not something that happens after assessment has taken place; rather, it is designed into learning processes from the outset (Winstone & Carless, 2019: 9)
  • 8. How did we do it? ‘Chalk Talk’ exercises (following Brookfield) Structured teacher feedback dialogues Self-assessment questionnaires Co-creation of rubrics Structured formative peer review of writing Guided small group discursive activities Individual reflective writing Group application of rubric to group draft outputs Programmatic approach: ongoing communication between programme teachers to develop a structured plan for the ‘when’ and ‘how’ of assessment and feedback
  • 9. Did it work? Methodology • Hosted focus group, attended by 40% of class cohort (n=6) • Early career higher education teachers (Early Childhood Education, Psychology and Education) • 1-4 years experience • 5 female, 1 male; representative of the disciplines that were present (Lynch, 2010; UNESCO, 2011) • Data analysed thematically
  • 10. Opening Question: what comes to mind when you think of peer feedback?
  • 11. Discussion: key themes (1) Practice is needed, giving feedback is hard! “because I think that, as a teacher, giving feedback and assessment is actually really difficult” “I didn’t find it [...] easy, but that’s because I’m not used to it, I’m not used to getting constructive feedback, I’m not used to giving it” “I found it really hard to give the feedback” Participants also referred to their dual identity (learner/teacher) and the tensions/lack of confidence they felt. Students need opportunities to develop their abilities to assess others
  • 12. (2) Rubrics, templates and guidelines were particularly welcomed to structure the assessment and feedback activities “I think if you have a structure then you know what you are looking for, rather than just being like ‘I really liked this’” Rubrics, templates and guidelines help to address any of the feelings of fear and mistrust that can accompany peer assessment and feedback activities; Our findings support existing research highlighting the importance of rubrics, templates and clear guidelines to scaffold learners (Adachi et al. 2018; Evans, 2013; Topping, 1998). Students need opportunities to develop their abilities give and receive feedback
  • 13. (3) Emphasis on group-to-group peer assessment/feedback particularly beneficial “I prefer when it’s the whole group giving feedback together, I think it’s easier than giving it 1-1. You might say ‘oh I really liked when they did this’ and then [another student] would jump in and say ‘oh yeah, that was really good’. So you didn’t feel like you were just one person” “When we were marking them we could see what other people were scoring and we could say it as a group...safety in numbers” Indication of the difficulty in making evaluative judgments experienced by students, including early career HE teachers Students need opportunities to develop their abilities to make judgments
  • 14. (4) Relationships really matter “..it was hard to know, to give the feedback, but also to take it as well….from a peer, it was hard” “I think that we had a really good group dynamic, in general, across the whole year. So if next year, people didn’t click as well […] doing something like that early in the semester might not work as well. Because I think everyone did really get on, and were open to feedback […] I think it depends on the group dynamics” “So if you have a group of students where one student thinks the other students are rubbish, their feedback is not going to mean anything to them”
  • 15. “We really need to look at building relationships I think, and people trusting each other and everybody seeing each other as peers. Because you can’t really give peer feedback unless everyone sees themselves as equals”
  • 16. A model for incremental feedback skill development 01 SELF ASSESSMENT AND FEEDBACK WITH A MORE QUALIFIED OTHER 02 SELF AND PEER ASSESSMENT AND FEEDBACK 03 GROUP-GROUP PEER ASSESSMENT AND FEEDBACK Collaboratively developed rubrics/frameworks; Guided questioning; Guided discussions 04 1-1 PEER ASSESSMENT AND FEEDBACK Apply rubrics to outputs; 1-1 discussions 05 1-GROUP ASSESSMENT AND FEEDBACK Apply rubrics to outputs; Group discussions Tutor dialogues; Self- assessment forms; Reflective pieces Use of structured rubrics/frameworks; Structured discussions (Egan and Costelloe, 2016; Costelloe and Egan, 2020)
  • 17. Conclusions • Giving and receiving feedback are not innate skills and require practice and opportunities to develop abilities – even for early career Higher Education teachers; • Important to create a safe atmosphere of trust and inclusion where learning is embraced and concerns are shared – critically important to create ‘feedback rich environments’ (Esterhazy and Damşa, 2019) • Students ‘must feel comfortable and trust one another in order to provide honest and constructive feedback’ (Burke and Pieterick, 2010: 64) • Particular considerations in the context of developing teacher feedback literacy – how can we support the development of teacher feedback literacy in accredited teaching and learning programmes?
  • 18. Works Cited • Adachi, C., Tai, J. and Dawson, P. (2018) 'A framework for designing, implementing, communicating and researching peer assessment', Higher Education Research & Development, 37(3), 453-467. • Andrade, H.L. (2010) 'Students as the definitive source of formative assessment: academic self-assessment and the self- regulation of learning', NERA Conference Proceedings 2010, 25. • Boud, D., Cohen, R. and Sampson, J. (1999) 'Peer learning and assessment', Assessment & Evaluation in Higher Education, 34(4), 413-426. • Burke, D. and Pieterick, J. (2010) Giving Students Effective Written Feedback, Maidenhead, UK: Open University Press. • Carless, D. and Boud, D. (2018) 'The development of student feedback literacy: enabling uptake of feedback', Assessment & Evaluation in Higher Education, 43(8), 1315-1325. • Cassidy, S. (2006) 'Developing employability skills: peer assessment in higher education', Education + Training, 48(7), 508-517. • Costelloe, L. and Egan, A. (2020) “Because, as a teacher, giving feedback and assessment is actually really difficult”: using self- and peer-assessment to develop Higher Education teachers’ skills in assessment and feedback’, Proceedings of Higher Education Advances Conference, Editorial Universitat Politecnica de Valencia: 501-508. DOI:https://doi.org/10.4995/HEAd20.2020.11096 • Egan, A. and Costelloe, L. (2016) 'Peer assessment of, for and as learning: a core component of an accredited professional development course for Higher Education teachers', AISHE-J: The All Ireland Journal of Teaching and Learning in Higher Education, 8(3), 2931-29313. • Esterhazy, R. and C. Damşa (2019). "Unpacking the feedback process: an analysis of undergraduate students' interactional meaning-making of feedback comments." Studies in Higher Education 44(2): 260-274. • Evans, C. (2013) 'Making sense of assessment feedback in Higher Education', Review of Educational Research, 83(1), 70-120.
  • 19. • Gibbs, G. and Jenkins, A. eds. (1992) Teaching Large Classes in Higher Education, London: Kogan Page. • Jessop, T. and Tomas, C. (2017) 'The implications of programme assessment patterns for student learning', Assessment & Evaluation in Higher Education, 42(6), 990-999. • Lam, R. (2015) 'Assessment as learning; examining a cycle of teaching, learning and assessment of writing in the portfolio-based classroom', Studies in Higher Education, 1-18. • Lynch, K. (2010). "Carelessness: a hidden doxa of higher education" Arts and Humanities in Higher Education 9(1): 54-67. • National Forum for the Enhancement of Teaching and Learning in Higher Education (2017) "Expanding our Understanding of Assessment and Feedback in Irish Higher Education,“. Available at: https://www.teachingandlearning.ie/publication/expanding-our-understanding-of-assessment-and- feedback-in-irish-higher-education/. Last Accessed November 6, 2019. • Pedder, D. and James, M. (2012) 'Professional learning as a condition for assessment for learning' in Gardner, J., ed., Assessment and Learning, 2nd ed., London: Sage, 33-48. • Ramsden, P. (1992) Learning to Teach in Higher Education, London: Routledge. • Reinholz, D. (2016) 'The assessment cycle: a model for learning through peer-assessment', Assessment & Evaluation in Higher Education, 41(2). • Topping, K. (1998) 'Peer assessment between students in colleges and universities', Review of Educational Research, 68(3), 249-276. • Winstone, N. and Carless, D. (2019) Designing Effective Feedback Processes in Higher Education: a learning- focused approach, Oxford: Routledge. • UNESCO (2011) Women and the Teaching Profession: exploring the feminisation debate.