SlideShare une entreprise Scribd logo
1  sur  39
Télécharger pour lire hors ligne
Can student-generated content
enhance learning in introductory
           physics?


       Simon Bates, Ross Galloway,
             Karon McBride
  Physics Education Research Group, University of Edinburgh, UK

              AAPT Summer Meeting 2011, Omaha NE, Aug 2011        1
1.  Background and motivation

2.  About

3.  What we did in our courses

4.  What we found
   engagement, examples, effects


                                   2
Background and motivation



Time spent in self-study

The inverted classroom

The cognitive demands of creating rather
 than just doing



                                           3
Background and motivation



Time spent in self-study




             1      2      3   4    5   4
Background and motivation



Time spent in self-study




             1      2      3   4    5   5
Background and motivation



Time spent in self-study

The inverted classroom

The cognitive demands of creating rather
 than just doing



                                           6
Background and motivation



Time spent in self-study

The inverted classroom

The cognitive demands of creating rather
 than just doing



                                           7
The University of Edinburgh
                                           Edinburgh, Scotland
                                                   5th July, 2010




                             PeerWise
        bridging the gap between online learning
        and social media


Paul Denny
Department of Computer Science
The University of Auckland
New Zealand
About PeerWise

•  Web-based MCQ repository built by
   students
•  Students:
 –  develop new questions with
    associated explanations
 –  answer existing questions and
    rate them for quality and difficulty
 –  take part in discussions
 –  collaborate in a community
    space
About PeerWise


                        Student
                     familiarity with
                        Web 2.0
The energy and                           Student
 creativity of a                        generated
  large class                           questions
11
12
13
14
15
16
17
18
About PeerWise

•  To date


  –    77 institutions
  –    557 courses
  –    33757 students have contributed
  –    94207 questions have been written
  –    2308854 answers have been submitted
Implementation

Implemented in 2 successive introductory
  Physics courses (1A & 1B)

P1A: workshop session in
Week 5

Student groups worked
Through structured
Example & devised own Qs
                                           20
Implementation

An assessment was set for the end of
Week 6:

Minimum requirements:

•  Write one question
•  Answer 5
•  Comment on & rate 3

Contributed ~3% to course assessment
                                        21
22
Implementation

We were deliberately
hands off.

•  No moderation
•  No corrections
•  No interventions at all

But we did observe…..

                                23
Findings

P1A in-course
assessment (N=200)
                         Workshop   Live   Due
                         training
350 user-contributed
questions in total

~3500 answers
~2000 comments




                                                 24
Findings




           25
Findings




           26
27
28
29
Findings


Generally, students did:

•  Participate beyond minimum requirements

•  Genuinely surprise us with the quality of
   submissions, creating problems not exercises

•  Engage in community learning, correcting errors

•  Provide positive feedback on using PeerWise
                                                     30
Findings


Generally, students did not:

•  Contribute trivial / irrelevant questions

•  Submit questions with ‘bad physics’

•  Let mistakes or errors persist

•  Use it much beyond the assessment periods

                                               31
Findings




Does degree of PeerWise activity
 correlate with end of course
 performance?

Yes, for the majority of students



                                    32
Findings

Defining activity:

•  Combined measure of number of
   questions, answers, comments and
   days of activity (Q,A,C & D)

•  Divide student score on each of 4
   individual measures into deciles and
   award score 0  10

                                          33
Findings

Defining activity:

•  CM scores from 0  40

•  Median split of cohort on the basis of
   CM scores into ‘HPA’ and ‘LPA’.

See Denny et al Proceeding of the 4th international workshop on Computing education
    research, 2008 51-58 for full details




                                                                                      34
Findings
Findings


           Quartiles
           Q1 – top 25%
           Q2 – upper middle
           Q3 – lower middle
           Q4 – bottom 25%


           22 students did not
           take the FCI
Findings




P1A cohort
Summary

•  Pilot use of PeerWise in two successive intro
   Physics courses

•  Clear evidence of student engagement, with
   high quality submissions and discussions

•  Use of system correlated with course
   outcome, and not just for the best students

                                                   38
Acknowledgements:
We gratefully acknowledge project grant support from the HEA Physical
  Sciences Centre and the support of Paul Denny, University of Auckland.




Poster at PERC

EdPER group website                   bit.ly/EdPER


Talk slides on Slideshare             EdPER_talks


S.P.Bates@ed.ac.uk           
   
Ross.Galloway@ed.ac.uk
                                                                           39

Contenu connexe

Tendances

Project Based Learning by Elwifdni
Project Based Learning by ElwifdniProject Based Learning by Elwifdni
Project Based Learning by Elwifdni
diah Cwek Tauruz
 
Portland Terman Conference Laumakis April 2009
Portland Terman Conference   Laumakis April 2009Portland Terman Conference   Laumakis April 2009
Portland Terman Conference Laumakis April 2009
Mark Laumakis
 

Tendances (20)

Creating Breath in Online Education Through Service Learning Projects, Refle...
 Creating Breath in Online Education Through Service Learning Projects, Refle... Creating Breath in Online Education Through Service Learning Projects, Refle...
Creating Breath in Online Education Through Service Learning Projects, Refle...
 
Theory/literature vs practice - the flipped classroom
Theory/literature vs practice - the flipped classroomTheory/literature vs practice - the flipped classroom
Theory/literature vs practice - the flipped classroom
 
Challenge-Based Learning
Challenge-Based LearningChallenge-Based Learning
Challenge-Based Learning
 
Pedagogy with Technology: getting the horse out in front of the cart
Pedagogy with Technology: getting the horse out in front of the cartPedagogy with Technology: getting the horse out in front of the cart
Pedagogy with Technology: getting the horse out in front of the cart
 
Enhancing orchestration of lab sessions by means of awareness mechanisms
Enhancing orchestration of lab sessions by means of awareness mechanismsEnhancing orchestration of lab sessions by means of awareness mechanisms
Enhancing orchestration of lab sessions by means of awareness mechanisms
 
The feedback loop revisited
The feedback loop revisitedThe feedback loop revisited
The feedback loop revisited
 
Think outside the lecture: heads on hand-on active learning in the classroom
Think outside the lecture: heads on hand-on active learning in the classroomThink outside the lecture: heads on hand-on active learning in the classroom
Think outside the lecture: heads on hand-on active learning in the classroom
 
Faculty Workshop: Boost Student Engagement and Retention
Faculty Workshop: Boost Student Engagement and RetentionFaculty Workshop: Boost Student Engagement and Retention
Faculty Workshop: Boost Student Engagement and Retention
 
E-Learn 2008 - Strategies for Students and Instructors How to Improve Online ...
E-Learn 2008 - Strategies for Students and Instructors How to Improve Online ...E-Learn 2008 - Strategies for Students and Instructors How to Improve Online ...
E-Learn 2008 - Strategies for Students and Instructors How to Improve Online ...
 
Advance he combined_presentation july 2019
Advance he combined_presentation july 2019Advance he combined_presentation july 2019
Advance he combined_presentation july 2019
 
Common-Sense Approaches to Math Curriculum and Assessment Success
Common-Sense Approaches to Math Curriculum and Assessment SuccessCommon-Sense Approaches to Math Curriculum and Assessment Success
Common-Sense Approaches to Math Curriculum and Assessment Success
 
CCC-M F2F meeting_160426
CCC-M F2F meeting_160426CCC-M F2F meeting_160426
CCC-M F2F meeting_160426
 
Project Based Learning by Elwifdni
Project Based Learning by ElwifdniProject Based Learning by Elwifdni
Project Based Learning by Elwifdni
 
I padpresentation 2015_revised
I padpresentation 2015_revisedI padpresentation 2015_revised
I padpresentation 2015_revised
 
Online student feedback-Lawlor & vanGinneken
Online student feedback-Lawlor & vanGinnekenOnline student feedback-Lawlor & vanGinneken
Online student feedback-Lawlor & vanGinneken
 
ID Case Study: Course Evaluation
ID Case Study: Course EvaluationID Case Study: Course Evaluation
ID Case Study: Course Evaluation
 
The Next Generation of Differentiation: The Path to More Powerful Personaliza...
The Next Generation of Differentiation: The Path to More Powerful Personaliza...The Next Generation of Differentiation: The Path to More Powerful Personaliza...
The Next Generation of Differentiation: The Path to More Powerful Personaliza...
 
Learning Presence
Learning PresenceLearning Presence
Learning Presence
 
ABLE - EFYE 2018 induction paper
ABLE - EFYE 2018 induction paperABLE - EFYE 2018 induction paper
ABLE - EFYE 2018 induction paper
 
Portland Terman Conference Laumakis April 2009
Portland Terman Conference   Laumakis April 2009Portland Terman Conference   Laumakis April 2009
Portland Terman Conference Laumakis April 2009
 

Similaire à Can Student-Generated Content Enhance Learning in Introductory Physics?

ICWES15 - Support for elementary School Science Teachers. Presented by Valeri...
ICWES15 - Support for elementary School Science Teachers. Presented by Valeri...ICWES15 - Support for elementary School Science Teachers. Presented by Valeri...
ICWES15 - Support for elementary School Science Teachers. Presented by Valeri...
Engineers Australia
 
Fabio R Arico - Assessing Self-Assessment
Fabio R Arico - Assessing Self-AssessmentFabio R Arico - Assessing Self-Assessment
Fabio R Arico - Assessing Self-Assessment
Fabio R. Arico'
 
James Bond, Monorail Cat and Partying penguins. What happens when you let stu...
James Bond, Monorail Cat and Partying penguins. What happens when you let stu...James Bond, Monorail Cat and Partying penguins. What happens when you let stu...
James Bond, Monorail Cat and Partying penguins. What happens when you let stu...
Simon Bates
 
Fostering a culture change in assessment and feedback through TESTA
Fostering a culture change in assessment and feedback through TESTAFostering a culture change in assessment and feedback through TESTA
Fostering a culture change in assessment and feedback through TESTA
Tansy Jessop
 

Similaire à Can Student-Generated Content Enhance Learning in Introductory Physics? (20)

Bates inverted classroom
Bates inverted classroomBates inverted classroom
Bates inverted classroom
 
Wcse slides bates_galloway_denny
Wcse slides bates_galloway_dennyWcse slides bates_galloway_denny
Wcse slides bates_galloway_denny
 
PeerWise workshop at NTU Singapore
PeerWise workshop at NTU SingaporePeerWise workshop at NTU Singapore
PeerWise workshop at NTU Singapore
 
Just in time teaching a 21st century brain-based technique - jeff loats - l...
Just in time teaching   a 21st century brain-based technique - jeff loats - l...Just in time teaching   a 21st century brain-based technique - jeff loats - l...
Just in time teaching a 21st century brain-based technique - jeff loats - l...
 
PeerWise Bates (STLHE 2013)
PeerWise Bates (STLHE 2013) PeerWise Bates (STLHE 2013)
PeerWise Bates (STLHE 2013)
 
Real-time Assessment: A Guide for Emergency Remote Teaching
Real-time Assessment: A Guide for Emergency Remote TeachingReal-time Assessment: A Guide for Emergency Remote Teaching
Real-time Assessment: A Guide for Emergency Remote Teaching
 
Improving student learning through programme assessment
Improving student learning through programme assessmentImproving student learning through programme assessment
Improving student learning through programme assessment
 
CHECO Retreat - Changing landscape of teaching
CHECO Retreat - Changing landscape of teachingCHECO Retreat - Changing landscape of teaching
CHECO Retreat - Changing landscape of teaching
 
ICWES15 - Support for elementary School Science Teachers. Presented by Valeri...
ICWES15 - Support for elementary School Science Teachers. Presented by Valeri...ICWES15 - Support for elementary School Science Teachers. Presented by Valeri...
ICWES15 - Support for elementary School Science Teachers. Presented by Valeri...
 
Wilczewski iced report to nasa at ksc on 20180609 f
Wilczewski iced report to nasa at ksc on 20180609 fWilczewski iced report to nasa at ksc on 20180609 f
Wilczewski iced report to nasa at ksc on 20180609 f
 
2 stage exams: assessments of, for and as learning
2 stage exams: assessments of, for and as learning 2 stage exams: assessments of, for and as learning
2 stage exams: assessments of, for and as learning
 
Flipped Learning CTD
Flipped Learning CTDFlipped Learning CTD
Flipped Learning CTD
 
Fabio R Arico - Assessing Self-Assessment
Fabio R Arico - Assessing Self-AssessmentFabio R Arico - Assessing Self-Assessment
Fabio R Arico - Assessing Self-Assessment
 
James Bond, Monorail Cat and Partying penguins. What happens when you let stu...
James Bond, Monorail Cat and Partying penguins. What happens when you let stu...James Bond, Monorail Cat and Partying penguins. What happens when you let stu...
James Bond, Monorail Cat and Partying penguins. What happens when you let stu...
 
ODHEC life beyond the lecture
ODHEC life beyond the lectureODHEC life beyond the lecture
ODHEC life beyond the lecture
 
IntrotoActiveLearning.ppt
IntrotoActiveLearning.pptIntrotoActiveLearning.ppt
IntrotoActiveLearning.ppt
 
IntrotoActiveLearning.ppt
IntrotoActiveLearning.pptIntrotoActiveLearning.ppt
IntrotoActiveLearning.ppt
 
Online Teaching Best Practices
Online Teaching Best PracticesOnline Teaching Best Practices
Online Teaching Best Practices
 
Teaching Online 101 - 2014 Brightspace Ignite Wisconsin
Teaching Online 101 - 2014 Brightspace Ignite WisconsinTeaching Online 101 - 2014 Brightspace Ignite Wisconsin
Teaching Online 101 - 2014 Brightspace Ignite Wisconsin
 
Fostering a culture change in assessment and feedback through TESTA
Fostering a culture change in assessment and feedback through TESTAFostering a culture change in assessment and feedback through TESTA
Fostering a culture change in assessment and feedback through TESTA
 

Plus de Simon Bates

Plus de Simon Bates (20)

The anatomy of the empowered educator: pathways for institutional support
The anatomy of the empowered educator: pathways for institutional supportThe anatomy of the empowered educator: pathways for institutional support
The anatomy of the empowered educator: pathways for institutional support
 
Teaching Excellence Summit - the HE perspective on the digital divide
Teaching Excellence Summit - the HE perspective on the digital divideTeaching Excellence Summit - the HE perspective on the digital divide
Teaching Excellence Summit - the HE perspective on the digital divide
 
Students as producers, of high quality engaging assessments to support learning
Students as producers, of high quality engaging assessments to support learningStudents as producers, of high quality engaging assessments to support learning
Students as producers, of high quality engaging assessments to support learning
 
The what, why and how of evidence-based teaching and active learning
The what, why and how of evidence-based teaching and active learningThe what, why and how of evidence-based teaching and active learning
The what, why and how of evidence-based teaching and active learning
 
Beliefs about learning: an interactive quiz
Beliefs about learning: an interactive quizBeliefs about learning: an interactive quiz
Beliefs about learning: an interactive quiz
 
Teaching practices, attitudes and perceptions: a multi-institutional study
Teaching practices, attitudes and perceptions: a multi-institutional studyTeaching practices, attitudes and perceptions: a multi-institutional study
Teaching practices, attitudes and perceptions: a multi-institutional study
 
Future evolution of the learning technology ecosystem
Future evolution of the learning technology ecosystemFuture evolution of the learning technology ecosystem
Future evolution of the learning technology ecosystem
 
Development & trends in teaching and learning
Development & trends in teaching and learning Development & trends in teaching and learning
Development & trends in teaching and learning
 
Interactive engagement strategies for large classes
Interactive engagement strategies for large classesInteractive engagement strategies for large classes
Interactive engagement strategies for large classes
 
Breaking out of the 'walled garden'
Breaking out of the 'walled garden'Breaking out of the 'walled garden'
Breaking out of the 'walled garden'
 
The 21st Century Educator
The 21st Century EducatorThe 21st Century Educator
The 21st Century Educator
 
The 21st Century Educator - students as partners in teaching and learning
The  21st Century Educator - students as partners in teaching and learning The  21st Century Educator - students as partners in teaching and learning
The 21st Century Educator - students as partners in teaching and learning
 
Workshop at 2016 NTU Learning and Teaching Seminar - Students as Partners in ...
Workshop at 2016 NTU Learning and Teaching Seminar - Students as Partners in ...Workshop at 2016 NTU Learning and Teaching Seminar - Students as Partners in ...
Workshop at 2016 NTU Learning and Teaching Seminar - Students as Partners in ...
 
Plenary lecture at 2016 NTU Learning and Teaching Seminar - Students as Partn...
Plenary lecture at 2016 NTU Learning and Teaching Seminar - Students as Partn...Plenary lecture at 2016 NTU Learning and Teaching Seminar - Students as Partn...
Plenary lecture at 2016 NTU Learning and Teaching Seminar - Students as Partn...
 
Keynote lecture at 2016 NTU Learning and Teaching Seminar - Students as Partn...
Keynote lecture at 2016 NTU Learning and Teaching Seminar - Students as Partn...Keynote lecture at 2016 NTU Learning and Teaching Seminar - Students as Partn...
Keynote lecture at 2016 NTU Learning and Teaching Seminar - Students as Partn...
 
NTU Innovations in Teaching Seminar - students as co creators
NTU Innovations in Teaching Seminar - students as co creatorsNTU Innovations in Teaching Seminar - students as co creators
NTU Innovations in Teaching Seminar - students as co creators
 
Faculty and students; as collaborators, coproducers and makers
Faculty and students; as collaborators, coproducers and makersFaculty and students; as collaborators, coproducers and makers
Faculty and students; as collaborators, coproducers and makers
 
The Anatomy of a 21st Century Educator
The Anatomy of a 21st Century Educator The Anatomy of a 21st Century Educator
The Anatomy of a 21st Century Educator
 
Strategies to enhance student engagement and learning in class: blending and ...
Strategies to enhance student engagement and learning in class: blending and ...Strategies to enhance student engagement and learning in class: blending and ...
Strategies to enhance student engagement and learning in class: blending and ...
 
Personalized Learning: Implications for curricula, staff and students
Personalized Learning: Implications for curricula, staff and students Personalized Learning: Implications for curricula, staff and students
Personalized Learning: Implications for curricula, staff and students
 

Dernier

Making and Justifying Mathematical Decisions.pdf
Making and Justifying Mathematical Decisions.pdfMaking and Justifying Mathematical Decisions.pdf
Making and Justifying Mathematical Decisions.pdf
Chris Hunter
 
Seal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptxSeal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptx
negromaestrong
 

Dernier (20)

Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxUnit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptx
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
 
Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104
 
Making and Justifying Mathematical Decisions.pdf
Making and Justifying Mathematical Decisions.pdfMaking and Justifying Mathematical Decisions.pdf
Making and Justifying Mathematical Decisions.pdf
 
ICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptx
 
Application orientated numerical on hev.ppt
Application orientated numerical on hev.pptApplication orientated numerical on hev.ppt
Application orientated numerical on hev.ppt
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdf
 
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
 
Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptx
 
Energy Resources. ( B. Pharmacy, 1st Year, Sem-II) Natural Resources
Energy Resources. ( B. Pharmacy, 1st Year, Sem-II) Natural ResourcesEnergy Resources. ( B. Pharmacy, 1st Year, Sem-II) Natural Resources
Energy Resources. ( B. Pharmacy, 1st Year, Sem-II) Natural Resources
 
ComPTIA Overview | Comptia Security+ Book SY0-701
ComPTIA Overview | Comptia Security+ Book SY0-701ComPTIA Overview | Comptia Security+ Book SY0-701
ComPTIA Overview | Comptia Security+ Book SY0-701
 
Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdf
 
On National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan FellowsOn National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan Fellows
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The Basics
 
Python Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docxPython Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docx
 
Seal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptxSeal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptx
 
ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.
 
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17  How to Extend Models Using Mixin ClassesMixin Classes in Odoo 17  How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
 
General Principles of Intellectual Property: Concepts of Intellectual Proper...
General Principles of Intellectual Property: Concepts of Intellectual  Proper...General Principles of Intellectual Property: Concepts of Intellectual  Proper...
General Principles of Intellectual Property: Concepts of Intellectual Proper...
 

Can Student-Generated Content Enhance Learning in Introductory Physics?

  • 1. Can student-generated content enhance learning in introductory physics? Simon Bates, Ross Galloway, Karon McBride Physics Education Research Group, University of Edinburgh, UK AAPT Summer Meeting 2011, Omaha NE, Aug 2011 1
  • 2. 1.  Background and motivation 2.  About 3.  What we did in our courses 4.  What we found engagement, examples, effects 2
  • 3. Background and motivation Time spent in self-study The inverted classroom The cognitive demands of creating rather than just doing 3
  • 4. Background and motivation Time spent in self-study 1 2 3 4 5 4
  • 5. Background and motivation Time spent in self-study 1 2 3 4 5 5
  • 6. Background and motivation Time spent in self-study The inverted classroom The cognitive demands of creating rather than just doing 6
  • 7. Background and motivation Time spent in self-study The inverted classroom The cognitive demands of creating rather than just doing 7
  • 8. The University of Edinburgh Edinburgh, Scotland 5th July, 2010 PeerWise bridging the gap between online learning and social media Paul Denny Department of Computer Science The University of Auckland New Zealand
  • 9. About PeerWise •  Web-based MCQ repository built by students •  Students: –  develop new questions with associated explanations –  answer existing questions and rate them for quality and difficulty –  take part in discussions –  collaborate in a community space
  • 10. About PeerWise Student familiarity with Web 2.0 The energy and Student creativity of a generated large class questions
  • 11. 11
  • 12. 12
  • 13. 13
  • 14. 14
  • 15. 15
  • 16. 16
  • 17. 17
  • 18. 18
  • 19. About PeerWise •  To date –  77 institutions –  557 courses –  33757 students have contributed –  94207 questions have been written –  2308854 answers have been submitted
  • 20. Implementation Implemented in 2 successive introductory Physics courses (1A & 1B) P1A: workshop session in Week 5 Student groups worked Through structured Example & devised own Qs 20
  • 21. Implementation An assessment was set for the end of Week 6: Minimum requirements: •  Write one question •  Answer 5 •  Comment on & rate 3 Contributed ~3% to course assessment 21
  • 22. 22
  • 23. Implementation We were deliberately hands off. •  No moderation •  No corrections •  No interventions at all But we did observe….. 23
  • 24. Findings P1A in-course assessment (N=200) Workshop Live Due training 350 user-contributed questions in total ~3500 answers ~2000 comments 24
  • 25. Findings 25
  • 26. Findings 26
  • 27. 27
  • 28. 28
  • 29. 29
  • 30. Findings Generally, students did: •  Participate beyond minimum requirements •  Genuinely surprise us with the quality of submissions, creating problems not exercises •  Engage in community learning, correcting errors •  Provide positive feedback on using PeerWise 30
  • 31. Findings Generally, students did not: •  Contribute trivial / irrelevant questions •  Submit questions with ‘bad physics’ •  Let mistakes or errors persist •  Use it much beyond the assessment periods 31
  • 32. Findings Does degree of PeerWise activity correlate with end of course performance? Yes, for the majority of students 32
  • 33. Findings Defining activity: •  Combined measure of number of questions, answers, comments and days of activity (Q,A,C & D) •  Divide student score on each of 4 individual measures into deciles and award score 0  10 33
  • 34. Findings Defining activity: •  CM scores from 0  40 •  Median split of cohort on the basis of CM scores into ‘HPA’ and ‘LPA’. See Denny et al Proceeding of the 4th international workshop on Computing education research, 2008 51-58 for full details 34
  • 36. Findings Quartiles Q1 – top 25% Q2 – upper middle Q3 – lower middle Q4 – bottom 25% 22 students did not take the FCI
  • 38. Summary •  Pilot use of PeerWise in two successive intro Physics courses •  Clear evidence of student engagement, with high quality submissions and discussions •  Use of system correlated with course outcome, and not just for the best students 38
  • 39. Acknowledgements: We gratefully acknowledge project grant support from the HEA Physical Sciences Centre and the support of Paul Denny, University of Auckland. Poster at PERC EdPER group website bit.ly/EdPER Talk slides on Slideshare EdPER_talks S.P.Bates@ed.ac.uk Ross.Galloway@ed.ac.uk 39