Integrating technology in assessment

1. Robert Kirkland Philips
Integrating Technology in Assessment

2. Background
 The e-Learning Jamaica Project is a collaboration
between the Ministry of Science Technology Energy and
Mining and the Ministry of Education to systematically
strengthen inputs to instruction in high schools.
 Information and communications technologies and
instructor capabilities are being enhanced, with a view
to increasing success of students at the CSEC level

3. A Day in the Life
I read the news…
I saw a film…
I saw a photograph….
Having read the book Id love to turn you on
The Beatles 1966
http://www.youtube.com/watch?v=P-Q9D4dcYng

4. Our dilemma
 Havingturned you on…I’d love you to read
the book

5. Project Components
 Infrastructure
 Materials
 Assessment
 Remediation
 Training

6. Dichotomy
 Formative
 Summative
originating in evaluation
literature
Assessment for learning
vs
Assessment of performance

7. Assessment types
 Formative  Summative
 Identifies the learning and
learning needs of each  Provides evidence from which the
(learner) so that the teacher (learners) achievement in a
curriculum domain or the
can organise future learning metacognitive domain or the real
experiences and connect with world domain can be inferred
the (learners) current
knowledge and skills and the
learner can plan and engage
more meaningful work.
 Source :CXC CPEA Brochure

8. Characteristics of the Assessment
Component
 Person-oriented
 Technology-driven
 System-wide
 Influence individual teacher and learner behavior
 Technology values of ease of use and change
 Classroom, school and administrative impact

9. Scope
 Standard materials
 Standard assessments
 Remediation oriented assessments

10. Access
 www.e-ljam.net/moodle

11. Access

12. Standard materials
 English example
 Teacher detailed
lessons
 Strategy support
 Questions
 Self –assessment
 Peer assessment
 Multimedia
 Editable when dated

13. Standard materials
 English example
 Teacher detailed
lessons
 Strategy support
 Questions
 Self –assessment
 Peer assessment
 Multimedia
 Editable when dated

14. Standard assessments
 Multiple choice
 Mapped to MOE Grade 7-9
Curriculum

15.  Internal assessment
CXC Influence
 Includes oral task
 Year-end assessment
http://www.e-ljam.net/?page_id=908

16. CXC Influence
 Several subjects at the CSEC level have internal assessment
elements branded as School Based Assessments and the CPEA
Caribbean Primary Exit Assessment has or will have this.
 This is a teacher/labour intensive activity that has parallels with the
IA in the Grade 9 Diagnostic Examination
 Anecdotal evidence is that weaker students have lower persistence
in completing SBAs although tasks can be repeated to improve final
scores
 Availability of computers has increased the completion rates
according to student reports

17. Sources of formative assessments
 Nelson Thornes
 Biology for You
 Chemistry for You
 Math
• http://www.fi.uu.nl/wisweb/isdde/applets/Blokkendoos.htm
• http://www.fi.uu.nl/wisweb/isdde/applets/NabouwenAanzichten1.htm
 Math
• http://www.cimt.plymouth.ac.uk/projects/mepres/book7/bk7i21/bk7_21i2.htm
 Lets go Learn
• http://www.letsgolearn.com/lglsite/EDGE_prealgebra/educators/

18. Chemistry

19. Chemistry

20. Sources
 Youtube--elearnja
• Chemistry
• Biology
• English
• Math
• IT

21. Youtube------elearnja
 Examples
 Qualitative Analysis 2
• 1.30
• Tactical formative assessment
 Genetic Diagram
• 4.28
• formal question

22. Self-Assessments
 MOODLE
 Items by objective
• http://www.e-ljam.net/moodle/course/view.php?id=203
 Practice tests
• http://www.e-ljam.net/moodle/course/view.php?id=152
 Explanations

23. Year end tests
 Subjects
 English
 Math
 Integrated Science
 Social Studies
 Grades
 7&9

24. Grade 9 assessment features
 Instant reporting
 Teacher participation
 MOE Dashboard
 Early practice on CSEC approaches
 Refuelling of Grade 7 to 9 curriculum

25. Social Studies

26. Science

27. EXAMVIEW
 TWAIN compatible software
 MS-Windows computers
 Office scanners
 Office printers
 Capability for paperless operation
 Capability for web operation

28. EXAMVIEW
 Score
 Percentage
 Student report
 Item Analysis
 Descriptive statistics
 Strand performance—learning focus
 Data import and export

29. Frequency distribution
 Sample results
 Descriptive statistics

30. Sample Item Analysis

31. Sample strand analysis

32. Selective strand performance 2012
120
100
Eng-Infer-Drawing
Conclusions
Eng- Part of speech
80
Eng- Verb Tense
Math- Coordinate Grid
60
Math- Equations
Math-Integers
40
Sci- Forces & motion
20 Sci- Pregnancy & Health
Sci- Pure & impure Matter
0 SS- Consumer Affairs
Guys Hill
Claude McKay
Lister Mair gilby
Munro
Penwood
Ewarton
St Elizabeth Tech
Papine
Fair Prospect
Gaynstead
Chapleton
Petersfield
York Castle
Bishop Gibson
Kingston high
SS- Earning a living
SS- nation building
SS- social & enviromental
issues

33. score
Li
st
er
D Ma
en i r
10
20
30
40
50
60
70
80
90
100
0
ha gil
m by
R T
ob C ow
er ha
tL p n
i g l et
ht on
bo
Pe urn
nw e
oo
Fa Ma d
ir ld
Tr Pro on
e n sp
c e
Ki h T ct
ng ow
st
on n
hi
C gh
la Tr
ud
e oy
M
cK
bb ay
c
Ew oke
G ar
re to
en n
Pe Po
M t er nd
er s f
le ie
ne l d
O
G t tey
uy
s
M Hi
cG ll
school
ra
t
Pa h
pi
H ne
G ol la
ay n
n d
St Fro s te
E me ad
li z
ab Te
e t ch
h
M T
ar ec
ym h
Y
H ork oun
ol
y Ca t
C s
Bi hi ld tl e
sh w
H
er o p ood
be Gi
selected strands Grade 9 2012
rt bs
M on
or
ris
o
M n
W un
ol
m ro
er
s
G
Three key strands 2012 Grade 9
Math-Integers
Math- Equations
Eng- Verb Tense

34. score
Li
st
er
D Ma
en i r
10
20
30
40
50
60
70
80
90
100
0
ha gil
m by
R T
ob C ow
er ha
tL p n
i g l et
ht on
bo
Pe urn
nw e
oo
Fa Ma d
ir ld
Tr Pro on
e n sp
c e
Ki h T ct
ng ow
st
on n
hi
C gh
la Tr
ud
e oy
M
cK
bb ay
c
Ew oke
G ar
re to
en n
Pe Po
M t er nd
er s f
le ie
ne l d
O
G t tey
uy
s
M Hi
cG ll
school
ra
t
Pa h
pi
H ne
G ol la
ay n
n d
St Fro s te
E me ad
li z
ab Te
e t ch
h
M T
ar ec
ym h
Y
H ork oun
ol
y Ca t
C s
Bi hi ld tl e
sh w
H
er o p ood
be Gi
selected strands Grade 9 2012
rt bs
M on
or
ris
o
M n
W un
ol
m ro
er
s
G
Three key strands 2012 Grade 9
Math-Integers
Math- Equations
Eng- Verb Tense

35. Extending the day
 Photographs
 Films/Animations
 Songs
 more…………………………….

36. RESEARCH ACTIVITY
 FACTOR ANALYSIS
 GAMING
 ARTIFICIAL INTELLIGENCE

37. PSPP
 Open source equivalent of SPSS
 Microsoft Excel doesn’t have factor
analysis
 Test taking overrides subject specific
performance

38. Gaming Assessments
 username:guest
> password:humbird2012
>
> The link :
gamedevelopment.narchismultimedia.com

39. AI assessments
 Marking structured questions in Social
Studies
 MOODLE does not perform fuzzy
matching

40. A day in the life
 Making meaning..
• The worst thing about doing this like is that people get a bit
suspicious….you know --what are you up to
• A Beatle speaking sotto voce at the end of the Studio version
 Life and learning and testing is about
photographs and film and music and
..technology of course