Oppenheimer Film Discussion for Philosophy and Film
Using assessment data
1. Using
assessment data
for improving teaching practice
For teachers to respond to student learning needs they need
detailed information about what their students know and can
do through high-quality assessment data, but they also need
opportunities to develop their knowledge as they delve into the
assessment information, says Helen Timperley.
For a long time we’ve known more about the poten- needed to know and do to improve teaching prac-
tial for using assessment data to improve teaching tice in ways that benefitted students. This has now
practice and student learning than actually how to changed. We now know what’s required if assess-
do it. Even 10 years ago, we didn’t have the right ment data is to have a useful impact:
assessment tools, didn’t know enough about their • the data needs to provide teachers with
use to make a difference to teaching practice and curriculum-relevant information
didn’t know what else teachers and their leaders
24 australian college of educators • acer
2. • that information needs to be seen by teach- know and can do, and what they need to know
ers as something that informs teaching and learn- and do to satisfy the requirements of the cur-
ing, rather than as a reflection of the capability riculum or other outcomes valued by the relevant
of individual students and to be used for sorting, community. You need curriculum-related assess-
labelling and credentialling ment information if you want a detailed analysis
• teachers need sufficient knowledge of the of students’ learning needs. These kinds of data
meaning of the assessment data to make appropri- are more useful for the purposes of diagnosing
ate adjustments to practice students’ learning needs than assessments focused
• school leaders need to be able to have the on identifying normative achievement, but not
conversations with teachers to unpack this mean- related to the curriculum.
ing Previous assumptions were that once teachers
• teachers need improved pedagogical con- had this kind of information, they would be able
tent knowledge to make relevant adjustments to to act on it in ways that enhanced student learn-
classroom practice in response to the assessment ing. The problem, though, is that many teach-
information ers’ previous training and approaches to teaching
• school leaders need to know how to lead the practice didn’t require them to interpret and use
kinds of change in thinking and practice that are these kinds of data, because assessment informa-
required for teachers to use the data, and tion was about labelling and categorising students,
• all within the school need to be able to not about guiding and directing teaching practice.
engage in systematic, evidence-informed cycles The interpretation and use of assessment data for
of inquiry that build the relevant knowledge and guiding and directing teaching requires a mind
skills identified above. shift towards professional learning from data and
None of this is easy, but examples of how they a new set of skills.
can be achieved have been identified in my 2008 To enable that, teachers need to ask, with the
best evidence synthesis of professional learning and help of relevant experts, what knowledge and skills
development with Aaron Wilson, Heather Barrar, they require in order to address students’ identi-
and Irene Fung of the international evidence of fied needs, and then more detailed questions. How
the kinds of professional learning experiences that have we contributed to existing student outcomes?
have resulted in improved student outcomes, as What do we already know that we can use to pro-
well as in my investigation with Judith Parr of the mote improved outcomes for students? What do
outcomes of a professional development project in we need to learn to do to promote these outcomes?
New Zealand involving 300 schools. What sources of evidence or knowledge can we
In this professional development project, stu- utilise?
dent achievement gains have occurred at a rate In doing this, teachers begin a formative
beyond that expected over the two years of the assessment cycle that mirrors that of students.
schools’ involvement in the project, particularly Answering these questions requires further use
for the lowest-performing students. The average of assessment data. Considering teachers’ contri-
effect size gain for all schools that focused on writ- bution to existing student outcomes, for exam-
ing was 1.20 and for reading it was 0.92, which is ple, requires teachers to unpack student profiles
pretty good when you compare it with expected within the data and relate them to emphases and
average annual effect size gains, using national approaches in their teaching practices. Student
normative cross-sectional sample data, of 0.20 for profiles of, say, reading comprehension on differ-
writing and 0.26 for reading. ent assessment tasks can help teachers to identify
what they teach well and what requires a different
TeacHer inqUiry and knowledge or new emphasis. By co-constructing the evidence
bUilding cycles to answer the questions, with relevant experts,
Engaging in systematic evidence-informed cycles teachers can identify what it is they need to know
of inquiry that build relevant professional knowl- and do to improve outcomes for students.
edge, skills and dispositions is a cycle that begins
by identifying the knowledge and skills students
need to close the gaps between what they already
3. research
deepening professional knowledge in Linda Darling-Hammond’s Preparing Teachers
and refining skills for a Changing World.
The next part of the cycle requires teachers to The third is the principle that you need to
deepen their professional knowledge and refine provide multiple opportunities to learn and apply
their skills. In synthesising the evidence of the new information and to understand its implica-
kinds of teacher learning that are associated with tions for teaching practices. Interpreting assess-
changes in teaching practice that usefully affect ment information, understanding the implications
student outcomes, I’ve identified three fundamen- for practice and learning how to teach in different
tal things embedded in the content of professional ways in response to that information is a complex
learning. undertaking. It typically takes one to two years,
The first is a focus by the teacher on the links depending on the starting point, for professional
between particular teaching activities, how differ- learning to deepen sufficiently to make a differ-
ent groups of students respond to those activities, ence to student outcomes.
and what their students actually learn. Without Part of the reason for this is that using assess-
such a focus, teachers can’t tell whether changes ment data for the purposes of improving teaching
in their teaching practice are necessarily related to and learning requires changing prior assumptions
positive impacts on student learn- about the purposes of assessment information. If
ing. teachers’ prior theories are not engaged, it’s quite
Interpreting assessment The second is the principle that possible, as Cynthia Coburn has pointed out, that
the knowledge and skills developed they’ll dismiss the new uses as unrealistic and
information, are integrated into coherent prac- inappropriate for their particular practice con-
tice. Knowledge of the curriculum text or reject the new information as irrelevant.
understanding the and how to teach it effectively must Engaging teachers’ existing ideas means discuss-
implications for practice accompany greater knowledge of the ing how those ideas differ from the ideas being
interpretation and use of assessment promoted and assessing the impact that the new
and learning how to information. Identifying students’ approaches might have on their students. If they
learning needs through assessment cannot be persuaded that a new approach is valu-
teach in different ways information is unlikely to lead to able and be certain of support if they implement
in response to that changes in teaching practice unless
teachers have the discipline, cur-
it, teachers are unlikely to adopt it – at least, not
without strong accountability pressures to do so.
information is a complex riculum and pedagogical knowl-
edge to make the relevant changes assessing THe impacT of cHanged
undertaking. to practice. Understanding theories acTions
underpinning assessment informa- The final part of the cycle also involves knowl-
tion, theories underpinning the cur- edge about and the use of assessment information.
riculum and those underpinning effective teaching Given the varied context in which teachers work,
allow teachers to use these understandings as the there can be no guarantee that any specific activity
basis for making decisions about practice. A skills- will have the anticipated result, because impact
only focus doesn’t develop the deep understandings depends on the context in which those changes
teachers need if they’re to change teaching practice occur. In our best evidence synthesis of profes-
in ways that flexibly meet the complex demands sional learning and development, Aaron Wilson,
of everyday teaching and to link the assessment Heather Barrar, and Irene Fung and I identified
data to requirements for new teaching approaches. that the effectiveness of particular changes depends
In fact, without a thorough understanding of the on the knowledge and skills of the students, their
theory, teachers are apt to believe they are teach- teachers and their leaders. Judging impact requires
ing in ways consistent with the assessment infor- the use of assessment information on a daily, term-
mation or they have promoted change in practice by-term and annual basis. To be effective, teach-
when those relationships are typically superficial, ers need a range of ways to assess their students
as Karen Hammerness and her colleagues explain informally and formally.
in their chapter, ‘How teachers learn and develop,’
26 australian college of educators • acer
4. research
leading cHange knowledge and skills to check the impact must
Recent research analyses demonstrating that it is become part of the cycle of inquiry.
teachers who have the greatest system influence When teachers are provided with opportuni-
on student outcomes have led to an increasing ties to use and interpret assessment data in order to
focus on what happens in classrooms and how to become more responsive to their students’ learn-
promote teacher professional learning. For more ing needs, the impact is substantial. Teachers,
on this, see the introduction to Linda Darling- however, can’t do this alone, but require system
Hammond, John Bransford and Pamela LePage’s conditions that provide and support these learning
Preparing Teachers for a Changing World, the work opportunities in ways that are just as responsive
on teacher effects by Barbara Nye and colleagues, to how teachers learn as they are to how students
and the work on instructional and school effective- learn.
ness indicators of Jaap Scheerens and colleagues.
Teachers, however, cannot achieve these REFERENCES
changes alone, but require the kinds of organi- Bransford, J., Darling-Hammond, L. & LePage, L.
sational conditions in which learning from data (2005). Introduction. In L. Darling-Hammond &
becomes an integral part of their practice. A recent J. Bransford (Eds.), Preparing Teachers for
meta-analysis by Viviane Robinson, Claire Lloyd a Changing World: What teachers should
and Ken Rowe identifies school leaders have the
greatest influence on improving student outcomes
learn and be able to do (pp. 1-39). San
Francisco: Jossey Bass.
Changing teaching
through their promotion of and participation in Coburn, C.E. (2001). Collective sense- practice in ways that
teacher professional learning. Creating the kinds making about reading: How teachers
of conditions in schools in which teachers sys- mediate reading policy in their professional benefit students means
tematically use data to inform their practice for communities. Educational Evaluation and
the benefit of students requires that they teach in Policy Analysis, 23(2): 145-170.
we have to check
contexts in which such practice becomes part of Hammerness, K., Darling-Hammond, constantly that the
the organisational routines. L., Bransford, J., Berliner, D., Cochran-
Research on teacher change has shown that Smith, M., McDonald, M. & Zeichner, K. changes are having the
previous assumptions about teachers’ use of assess- (2005). How teachers learn and develop.
ment data were unreasonably optimistic. It’s dif- In L. Darling-Hammond & J. Bransford desired impact.
ficult to change from traditional ideas where (Eds.), Preparing Teachers for a Changing
assessment data was considered to reflect students’ World: What teachers should learn and
abilities, about which little can be done, to one be able to do (pp. 358-389). San Francisco: John
where assessment data is considered to be infor- Wiley & Sons.
mation to guide effective teaching. Making such Nye, B., Konstantanopoulos, S. & Hedges, L.V.
changes is complex. Not only are changes in pro- (2004). How large are teacher effects? Educational
fessional knowledge about and skills in the use of Evaluation and Policy Analysis, 26(3): 237-257. Professor Helen Timperley
assessment data required, but teachers also need Robinson, V., Lloyd, C. & Rowe, K. (2008). The leads the Master of
deeper pedagogical content knowledge so that impact of leadership on student outcomes: An analy- Education program at the
they’re able to respond constructively to what data sis of the differential effects of leadership types. University of Auckland.
are telling them about the changes they need to Educational Administration Quarterly, 44(5): Her research interests
make to their practice. 635-674. include policy, leadership
To undertake this change, teachers need Scheerens, J, Vermeulen, C. & Pelgrum, W. J. and professional learning in
opportunities to develop their knowledge as they (1989). Generalizability of instructional and school education.
delve into the assessment information, to find out effectiveness indicators across nations. International
what it means for their own learning and to engage Journal of Educational Research, 13(7): 789-799. This article is based on
in multiple opportunities to acquire new knowl- Timperley, H. & Parr, J. (In press). Chain of influ- her paper presented at the
edge and skills. Changing teaching practice in ence from policy to practice in the New Zealand lit- fourteenth annual research
ways that benefit students means we have to check eracy strategy. Research Papers in Education. conference of the Australian
constantly that the changes are having the desired Timperley, H., Wilson, A., Barrar, H. & Fung, I. Council for Educational
impact. Effectiveness is context-dependent, so the (2008). Teacher professional learning and develop- Research, which took place
ment: Best evidence synthesis iteration. Wellington: in Perth in August.
New Zealand: Ministry of Education.
professional educator • vol 8 no. 3 • september 2009 27