1. Presenter: Mr. LONG KIMHORT MA in TESOL, IFL
Senior Teacher in International schools
Teacher Trainer & Consultant Of TEFL & TCFL
+85512/10 858 149 tae.kimhort@gmail.com
Chapter 14
Important Qualities
Of Good Assessments
3. INTRODUCTION
Factors that may cause inconsistency in test results
a. Day to day changes in students: changes in health,
motivation, and energy level.
Chapter 14
Important Qualities of Good Assessement
I. Reliability?
4. b. Variations in physical environment: variatons in room
temperature and outside distractions.
Chapter 14
Important Qualities of Good Assessement
I. Reliability?
5. c. Variations in administration of assessment: variaiton in
instructions, timing, and teacher’s repsonses to students’
questions.
Chapter 14
Important Qualities of Good Assessement
I. Reliability?
6. d. Characteristics of assessment instrument: the length,
clarity, and difficulty of tasks.
Ambiguous topic: explain why many scientists believe that birds
are desceneded from dinosaurs.
Chapter 14
Important Qualities of Good Assessement
I. Reliability?
7. Chapter 14
Important Qualities of Good Assessement
I. Reliability?
e. Subjectivity in Scoring: judement made on the basis of
vague, imprecise ceriteria.
8. Chapter 14
Important Qualities of Good Assessement
I. Reliability?
1. Test-retest reliability: is the extent to which an assessment
instrument yields similar results over a short time interval.
2. Score reliability: is the extent to which two or more
independent evalutors of students performance agree in their
judgement. The extent to which they are consistent across
different occasions of testing, different editions of the test,
or different raters scoring the test taker's responses.
3. Internal consistency reliability: is the extent to which
different parts of a single instrument all measure the same
characteristic.
10. Chapter 14
Important Qualities of Good Assessement
II. Standardization ?
The extent to which an assessment involves similar content and
format and is administered and scored in the same way for
everyone.
a. Students should get the same instructions, perform identical
or similar tasks, have the same time limits, and work under
the same constraints.
b. All students’ response should be scored using the same
criteria and standards.
c. Reduce the amount of error in assessment results, especially
error due to variation in test administraiton or subjectivity in
scoring.
d. The more the assessemnt is standardized, the more reliable
the assessement is.
11. Chapter 14
Important Qualities of Good Assessement
III. Validity ?
The extent to which it measures what it’s intended to measure
and allow us to draw appropriete inferences about the
characteristic or ability in question.
12. Chapter 14
Important Qualities of Good Assessement
III. Validity ?
1. Content validity: The extent to which assessment questions
and tasks are a representative sample of the overall body of
knowledge and skills being assessed.
13. Chapter 14
Important Qualities of Good Assessement
III. Validity ?
2. Predictive validity: The extent to which an assessment
instrument accurately predicts future performance in some
arena.
14. Chapter 14
Important Qualities of Good Assessement
III. Validity ?
3. Construct vialdity: The extent to which an assessment
instrument acturally measures an abstract, unobservable
characteristics.
- Construct validity is of most concern when we are trying
to draw genral conclusions about students’s traits and
abilities.
15. Chapter 14
Important Qualities of Good Assessement
IV. Practicality ?
The extent to which assessment instruments and procedures
are easy to use: practicality encompassess issues such as these:
1. How much time will it take to to develop the questions and/
or tasks to be adminstered.
2. Can the assessment be administered to many students at
once, or is one-on-one adminstration required?
3. Are expensive materials involved?
4. How much time will the assessment take away from
instructioinal activities?
5. How quickly and easily can students’ performance be
evaluated?
16. Chapter 14
Important Qualities of Good Assessement
Summarize the lesson today
I. Reliability? :........................................................................
II. Standardization? :...............................................................
III.Validity?:...............................................................................
IV. Practicality? :.......................................................................