Presentation by Dr Ann Ooms , Kingston University and St Georges, University of London, at the "Improving Assessment and Feedback Practices in a Technology-Enhanced Teaching and Learning Environment: Theory and Practice" Event, 19th May 2010 at Kingston University. Part of the "Higher Education Academy : Evidence Based Practice Seminar Series 2010" The presentation provides and overview of the findings from the HEA Pathfinder Project 'Rapid Reaction and Response' concerning the use of mobile classroom technologies to enhance feedback.

1. Rapid Reaction and Response - R³ The in-class use of mobile technologies to support formative assessment and feedback Dr. Ann Ooms Senior Lecturer Faculty of Health and Social Care Sciences Kingston University and St George’s University of London

2. National Student Satisfaction Survey Question 2007 NSS UK 2008 NSS UK 2007 NSS KU 2008 NSS KU 1 - 4 The teaching on my course 82 83 79 82 5 – 9 Assessment and feedback 62 64 59 64 10 – 12 Academic support 71 73 67 72 13 – 15 Organisation & management 71 73 68 73 16 – 18 Learning resources 80 81 73 77 19 - 21 Personal development 77 78 75 77 22 Overall satisfaction 81 82 78 81

5. Electronic Voting Systems

6. Tablet PC

7. Interactive Tablets

8. EduTXT Texting Service

14. Lecturers Faculty Lecturers FADA 2 FASS 1 Business and Law 2 CISM 2 Engineering 2 HSCS 2 Science 2 13

16. Data from Lecturers

17. Use of Technology Technology Number of lecturers Electronic Voting System 9 Tablet PC 5 BlackBoard Content System 2 SchoolPad Interactive Pads 1 Text Messaging 1 i-Pods 2

19. How satisfied are your students in terms of formative assessment activities you provided? Dissatisfied Somewhat dissatisfied Somewhat satisfied Satisfied Pre 3 15 3 Post 0 10 9

20. How satisfied are your students in terms of feedback they received? Dissatisfied Somewhat dissatisfied Somewhat satisfied Satisfied Pre 1 11 6 3 Post 6 13

21. How satisfied are you in terms of your ability to provide feedback to your students? Dissatisfied Somewhat dissatisfied Somewhat satisfied Satisfied Pre 9 11 2 Post 1 12 6

22. Impact of project No impact Minor impact Impact Major impact Mean Students’ enjoyment of classroom sessions 0 6 12 2 3.67 Students’ attendance 7 5 6 1 2.22 Students’ engagement 1 2 14 3 4.00 Students’ conceptual understanding 3 5 12 0 3.00 Students’ test results 6 9 4 0 1.78

23. Impact of project No impact Minor impact Impact Major impact Mean Overall teaching experience 0 3 15 2 4.00 Information you gained about your students’ misunderstandings 0 2 12 5 4.22 Information you gained about your teaching practices 0 1 16 2 4.22 Informed your reflection on your teaching practices 1 1 15 1 4.00

24. Positive impact of the use of mobile technologies on the interaction and feedback patterns No impact Minor impact Impact Major impact Mean M1 L – S 1 1 7 1 1.80 S – L 9 1 2.10 S – S 1 3 6 1.50 M2 L – S 1 2 3 4 2.00 S – L 7 3 2.30 S – S 2 6 1 1.89

25. To what extent do you feel the use of mobile technologies enhanced your teaching

32. Data from Students

33. Impact of the in-classroom use of technologies n Disagree Somewhat disagree Somewhat agree Agree Made it more enjoyable to attend the classroom sessions 455 3.7 7.0 40.7 48.6 Made the classroom sessions more interactive 454 3.1 6.4 32.6 57.9 Had a positive impact on my motivation to study for this module 452 6.0 19.2 43.1 31.6

34. Impact of the in classroom use of technologies n Disagree Somewhat disagree Somewhat agree Agree Was useful for feedback on my understanding 452 3.8 17.1 40.9 38.2 Provided information about my misunderstanding of certain components 455 7.0 20.0 44.2 28.8 Had a positive impact on my understanding of the material taught 451 3.8 14.9 47.7 33.7 Assisted me in focusing my study efforts 450 7.3 23.1 38.4 31.1

35. Descriptive Statistics Question Mean More interactive 2.45 More enjoyable 2.34 Feedback on understanding 2.14 Impact on motivation 2.00 Impact on understanding 2.11 Info about misunderstandings 1.95 Focusing study efforts 1.93

36. Overall, the use of the new technologies was a positive experience for me as a student n = 456 Percent Disagree 3.5 Somewhat disagree 9.2 Somewhat agree 36.8 Agree 50.4

37. I would advise my lecturer to keep using new technologies in his/her modules n = 456 Percent Disagree 2.6 Somewhat disagree 5.7 Somewhat agree 31.8 Agree 59.9

38. I would like other lecturers to used new technologies in their modules n = 452 Percent Disagree 2.9 Somewhat disagree 8.6 Somewhat agree 33.0 Agree 55.5