SlideShare une entreprise Scribd logo
1  sur  28
Audio feedback – better feedback?*

    Susanne Voelkel & Luciane V. Mello
         School of Life Sciences




        *funded by the eLearing Steering Group, UoL
“Feedback is one of the most
    powerful influences on learning
         and achievement”*



* Hattie & Timperley, 2007
Effective feedback answers 3 questions*:
• Where am I going?
     – (the goals)
• How am I going?
     – “feed-back”
• Where to next?
     – “feed- forward”




 * Hattie & Timperley, 2007
Good quality feedback – students’ view*

•   Detailed information on how to improve
•   Applicable to future work
•   Personal
•   Timely




* Student focus group, School of Life Sciences
But…. all is not well!
UoL
Can audio feedback help us provide
        better feedback?
Research questions

• Will audio feedback
  – Work?
  – Save staff time?
  – Increase student satisfaction?
  – Help students learn better?
Research design
• Two case studies
  – Undergraduate level
  – Postgraduate level
1. The undergraduate level project
• Year 3, class size 70
• Low stake (10%) essay, exam conditions
  (handwritten)
• Class split randomly in half
  – 50% written feedback (comments)
  – 50% audio feedback (bullet points on script)
• Evaluation
2. The postgraduate level project
• M-level module
• Class size 14
• Group work assessment
  – Individual component
  – Purely formative
• All students receive audio feedback only
• Evaluation
Methods
• Recording the feedback
  – Mobile digital voice recorder
  – Audio files (mp3 format)
  – Measure time (UG)
• Dissemination
  – By email
• Listening to the feedback
  – Mp3 player or computer
Evaluation
• Questionnaire
  – Response rate
     • 44% undergraduate
     • 93% postgraduate
• Interviews (10, UG)
• Marks (UG)
Did it work? The technical side.


• No problems from staff or student side
Did audio feedback save staff time?

           Time (min)      Standard           N
                           deviation
Audio      16              +8                 31
feedback
Written    11              +3                 31
feedback

           Significant difference (p=0.002)
Did audio feedback increase student
            satisfaction?
After reading/ listening to my
      feedback, I fully understand my mark


            Postgrad



              audio                                  agree
                                                     neither
Under-                                               disagree
graduates
             written



                       0   20   40   60   80   100
I understand what I need to do to get a
             better mark in the future


            Postgrad




              audio                                  agree
                                                     neither
Under-                                               disagree
graduates
             written



                       0   20   40   60   80   100
The amount of feedback I got was


            Postgrad
                                                     definitely not
                                                     enough
                                                     not really enough
              audio
                                                     just right
Under-
graduates
             written                                 too much



                       0   20   40   60   80   100
The feedback I got was detailed
                   enough

            Postgrad



              audio                                  agree
                                                     neither
Under-                                               disagree
graduates
             written



                       0   20   40   60   80   100
My feedback was clear


            Postgrad



              audio                                  agree
                                                     neither
Under-                                               disagree
graduates
             written


                       0   20   40   60   80   100
Written comments on audio feedback
                  Undergraduates
   “It (the audio feedback) was very personal, I
   knew exactly what I had to do to make my
   mark better”

  “you get a lot more honest opinion about (your
  work) and a lot more information I think on how
  to improve”

  “…written feedback means that you have it there just
  to look at all the time and it’s a bit harder to go back
  and look at the audio feedback”
Written comments on audio feedback
                  Postgraduates


   “Audio FB was very useful, I strongly feel more
   lecturers should adopt it as part of their
   teaching methods”


  “Audio FB was fantastic and more detailed than
  just writing a few lines in text format”
Effects on student learning?
                                     F
                    80               e
                                     e
                    70
                                     d
                    60
                                     b
                                     a
 Average mark (%)




                    50               c
                                     k
                                                     audio
                    40
                                                     written
                    30

                    20

                    10

                     0
                         Formative       Summative
Research questions – the answers

• Will audio feedback
  – Work?                            yes
  – Save staff time?                 no
  – Increase student satisfaction?   yes
  – Help students learn better?      perhaps
Thank you
svoelkel@liv.ac.uk

Contenu connexe

Plus de Educational Development Division, University of Liverpool

Plus de Educational Development Division, University of Liverpool (20)

Cath gordon teaching and learning conference ppt 2012
Cath gordon teaching and learning conference ppt 2012 Cath gordon teaching and learning conference ppt 2012
Cath gordon teaching and learning conference ppt 2012
 
Tammy thiele june 2012
Tammy thiele  june 2012Tammy thiele  june 2012
Tammy thiele june 2012
 
Josie billington reading for pleasure in schools june 2012
Josie billington reading for pleasure in schools june 2012Josie billington reading for pleasure in schools june 2012
Josie billington reading for pleasure in schools june 2012
 
144A Brownlow Hill: a Prototype Ambient Simulation-based Learning Experience
144A Brownlow Hill: a Prototype Ambient Simulation-based Learning Experience144A Brownlow Hill: a Prototype Ambient Simulation-based Learning Experience
144A Brownlow Hill: a Prototype Ambient Simulation-based Learning Experience
 
Developing strategies and activities to improve interactions between home and...
Developing strategies and activities to improve interactions between home and...Developing strategies and activities to improve interactions between home and...
Developing strategies and activities to improve interactions between home and...
 
FOCAL - Feedback on clinical achievements @ Liverpool
FOCAL - Feedback on clinical achievements @ LiverpoolFOCAL - Feedback on clinical achievements @ Liverpool
FOCAL - Feedback on clinical achievements @ Liverpool
 
The students widening participation forgot? Continuing Education and communit...
The students widening participation forgot? Continuing Education and communit...The students widening participation forgot? Continuing Education and communit...
The students widening participation forgot? Continuing Education and communit...
 
Mike knight
Mike knightMike knight
Mike knight
 
Vaughn l&t 21012 presentation
Vaughn l&t 21012 presentationVaughn l&t 21012 presentation
Vaughn l&t 21012 presentation
 
Glynis cousin keynote
Glynis cousin keynoteGlynis cousin keynote
Glynis cousin keynote
 
Alison hobden
Alison hobdenAlison hobden
Alison hobden
 
Arora anu
Arora anuArora anu
Arora anu
 
M hammond
M hammondM hammond
M hammond
 
Lt conf 2011 drywood presentation
Lt conf 2011 drywood presentationLt conf 2011 drywood presentation
Lt conf 2011 drywood presentation
 
L'pool grounding teaching in learning
L'pool   grounding teaching in learningL'pool   grounding teaching in learning
L'pool grounding teaching in learning
 
L'pool grounding teaching in learning
L'pool   grounding teaching in learningL'pool   grounding teaching in learning
L'pool grounding teaching in learning
 
L+t2011(csu)
L+t2011(csu)L+t2011(csu)
L+t2011(csu)
 
201011 t&l conference_dgh_ac_export
201011 t&l conference_dgh_ac_export201011 t&l conference_dgh_ac_export
201011 t&l conference_dgh_ac_export
 
L&tconference 2011 lv_mello
L&tconference 2011 lv_melloL&tconference 2011 lv_mello
L&tconference 2011 lv_mello
 
290611 deg conference
290611 deg conference290611 deg conference
290611 deg conference
 

Dernier

Measures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDMeasures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDThiyagu K
 
Disha NEET Physics Guide for classes 11 and 12.pdf
Disha NEET Physics Guide for classes 11 and 12.pdfDisha NEET Physics Guide for classes 11 and 12.pdf
Disha NEET Physics Guide for classes 11 and 12.pdfchloefrazer622
 
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...PsychoTech Services
 
Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfJayanti Pande
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxheathfieldcps1
 
The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13Steve Thomason
 
fourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writingfourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writingTeacherCyreneCayanan
 
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Krashi Coaching
 
BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...
BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...
BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...Sapna Thakur
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactPECB
 
A Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformA Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformChameera Dedduwage
 
Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Celine George
 
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdfBASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdfSoniaTolstoy
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhikauryashika82
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfciinovamais
 
Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104misteraugie
 
General AI for Medical Educators April 2024
General AI for Medical Educators April 2024General AI for Medical Educators April 2024
General AI for Medical Educators April 2024Janet Corral
 

Dernier (20)

Measures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDMeasures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SD
 
Disha NEET Physics Guide for classes 11 and 12.pdf
Disha NEET Physics Guide for classes 11 and 12.pdfDisha NEET Physics Guide for classes 11 and 12.pdf
Disha NEET Physics Guide for classes 11 and 12.pdf
 
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
 
Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdf
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
 
The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13
 
fourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writingfourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writing
 
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
 
BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...
BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...
BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global Impact
 
A Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformA Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy Reform
 
Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17
 
Advance Mobile Application Development class 07
Advance Mobile Application Development class 07Advance Mobile Application Development class 07
Advance Mobile Application Development class 07
 
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdfBASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
 
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
 
Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104
 
General AI for Medical Educators April 2024
General AI for Medical Educators April 2024General AI for Medical Educators April 2024
General AI for Medical Educators April 2024
 
Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1
 

Audio feedback – better feedback?

  • 1. Audio feedback – better feedback?* Susanne Voelkel & Luciane V. Mello School of Life Sciences *funded by the eLearing Steering Group, UoL
  • 2. “Feedback is one of the most powerful influences on learning and achievement”* * Hattie & Timperley, 2007
  • 3. Effective feedback answers 3 questions*: • Where am I going? – (the goals) • How am I going? – “feed-back” • Where to next? – “feed- forward” * Hattie & Timperley, 2007
  • 4. Good quality feedback – students’ view* • Detailed information on how to improve • Applicable to future work • Personal • Timely * Student focus group, School of Life Sciences
  • 5. But…. all is not well!
  • 6.
  • 7.
  • 8. UoL
  • 9. Can audio feedback help us provide better feedback?
  • 10. Research questions • Will audio feedback – Work? – Save staff time? – Increase student satisfaction? – Help students learn better?
  • 11. Research design • Two case studies – Undergraduate level – Postgraduate level
  • 12. 1. The undergraduate level project • Year 3, class size 70 • Low stake (10%) essay, exam conditions (handwritten) • Class split randomly in half – 50% written feedback (comments) – 50% audio feedback (bullet points on script) • Evaluation
  • 13. 2. The postgraduate level project • M-level module • Class size 14 • Group work assessment – Individual component – Purely formative • All students receive audio feedback only • Evaluation
  • 14. Methods • Recording the feedback – Mobile digital voice recorder – Audio files (mp3 format) – Measure time (UG) • Dissemination – By email • Listening to the feedback – Mp3 player or computer
  • 15. Evaluation • Questionnaire – Response rate • 44% undergraduate • 93% postgraduate • Interviews (10, UG) • Marks (UG)
  • 16. Did it work? The technical side. • No problems from staff or student side
  • 17. Did audio feedback save staff time? Time (min) Standard N deviation Audio 16 +8 31 feedback Written 11 +3 31 feedback Significant difference (p=0.002)
  • 18. Did audio feedback increase student satisfaction?
  • 19. After reading/ listening to my feedback, I fully understand my mark Postgrad audio agree neither Under- disagree graduates written 0 20 40 60 80 100
  • 20. I understand what I need to do to get a better mark in the future Postgrad audio agree neither Under- disagree graduates written 0 20 40 60 80 100
  • 21. The amount of feedback I got was Postgrad definitely not enough not really enough audio just right Under- graduates written too much 0 20 40 60 80 100
  • 22. The feedback I got was detailed enough Postgrad audio agree neither Under- disagree graduates written 0 20 40 60 80 100
  • 23. My feedback was clear Postgrad audio agree neither Under- disagree graduates written 0 20 40 60 80 100
  • 24. Written comments on audio feedback Undergraduates “It (the audio feedback) was very personal, I knew exactly what I had to do to make my mark better” “you get a lot more honest opinion about (your work) and a lot more information I think on how to improve” “…written feedback means that you have it there just to look at all the time and it’s a bit harder to go back and look at the audio feedback”
  • 25. Written comments on audio feedback Postgraduates “Audio FB was very useful, I strongly feel more lecturers should adopt it as part of their teaching methods” “Audio FB was fantastic and more detailed than just writing a few lines in text format”
  • 26. Effects on student learning? F 80 e e 70 d 60 b a Average mark (%) 50 c k audio 40 written 30 20 10 0 Formative Summative
  • 27. Research questions – the answers • Will audio feedback – Work? yes – Save staff time? no – Increase student satisfaction? yes – Help students learn better? perhaps