Formative evaluation of student learning and course design made simple: Fevatools Jim Julius, ITS
1. Fevatools: A Toolkit to jump-start formative assessment of student learning and course design Jim Julius SDSU Course Design Institute May 26, 2010
2. Guiding Questions What does it mean to bring an inquiry mindset to course design? How should one decide what kind of feedback to seek? What tools are available to collect feedback? What do I do with the data?
12. Data from M. Laumakis pICT fellow in 2005 Began teaching parallel 500-student sections of PSYCH 101 in 2006, one traditional and one hybrid First fully online PSYCH 101, Summer 2008 Grade data, attendance data, IDEA survey, clicker survey, observational protocols all part of data gathering
13. SALG How much did the following aspects of the class help your learning? Rated from 1 (no help) to 5 (great help)
16. Community of Inquiry Survey Statements rated from 1 (strongly disagree) to 5 (strongly agree) Based on the Community of Inquiry framework’s three elements: Social Presence Cognitive Presence Teaching Presence
Evaluating the cooking environment / experience: organization, tools, ingredients, recipe. How do you know if it’s “good enough”? How do you know what’s possible?
Summative and formative assessment are often referred to in a learning context as assessment of learning and assessment for learning respectively. Assessment of learning is generally summative in nature and intended to measure learning outcomes and report those outcomes to students, parents, and administrators. Assessment of learning generally occurs at the conclusion of a class, course, semester, or academic year. Assessment for learning is generally formative in nature and is used by teachers to consider approaches to teaching and next steps for individual learners and the class. (from Wikipedia assessment article)In reality, formative evaluation of course design potentially could subsume just about all of both of the other circles. Everything is data. But our attention to this may be limited. We need to know what we want to know.
Achievement: what students know and are able to do at end of course: distinguish "enduring understandings”, "important to know and do" and "worth being familiar with”Satisfaction Retention Success Achievement External proficiencies Real-world performance
Learner characteristics (demographics, prior experience, learning styles/preferences)Design (consider carefully the elements of the design you really want to examine; be sure they are documented)Learning resources (support, intervention, materials of all sorts - and how/when they are used)ContextFaculty Development