SlideShare une entreprise Scribd logo
1  sur  44
Télécharger pour lire hors ligne
nomination for
Higher Education:
Best Innovation in Open and Distance Learning Award
digitalLEARNING
World Education Awards
Delhi, India, July 2011
Overview
1. Why OBOW exams?
2. What is an OBOW exam?
3. How to construct an OBOW exam
4. A Sample OBOW exam
5. Summary and conclusions
2
3
Defining characteristic
• A commitment to
• “... Engaging and worthy problems
or questions of importance, in which
students must use knowledge to
fashion performances effectively
and .”
Grant Wiggins
4
5
• multiple-choice tests
• fill-in-the-blanks
• true-false
• matching words
• … Students are passive
learners 
Authentic assessment is not:
"Life is an open book exam."
• Learners need to be
convinced of the
authenticity of the task if
they are to fully engage
Professor Alan Blinder
Princeton University
6
7
8
SPOT THE
COMPUTER?
Sound familiar?
9
Constructive alignment (Biggs 1999)
Is there is
between the traditional
examination instrument, and term
time pedagogy and defined
learning outcomes?
10
11
How often do
people solve
problems in real life
by locking
themselves in a
room for 3 hours
with no books, no
web access, not
talking to anyone,
answering MCQs?
12
13
Is a closed book,
invigilated exam
more likely to
foster
… or
cramming/ data
dumping?
“Mugging up” is for mugs
• Deep learning will occur only when the
learner is ,
, or , incoming
stimuli …
• Authentic, real-world, workplace-integrated
assessment is
14
15
In brief …
• A semi-structured ‘mini-case (or ‘caselette’)
• Harnesses the power of ICTs to emphasise currency
and real world authenticity
• A summative assessment item …
… invites the student to draw on all that they have
learnt (determining what is relevant).
16
Dull? Boring? Something to fear?
• Final assessment 
• Boredom and stress not conducive to deep learning
• Important to catch the imagination and appeal to the
creativity of the learner
• Multimedia enhancements increase student
satisfaction and learning
(O'Brien and Seawell 2004; Vaughan 2001)
17
Key features
• Students play the role of decision-maker,
auditor, consultant or advisor
• They are presented with a unstructured
(open-ended) problem that requires
resolution (usually in the form of a set of
recommendations)
• No pre-exam night 'cramming'
18
The template
the setting in which the
problem/situation is identified and framed
the project and issues to resolve
the setting of parameters
and suggestions about methods/concepts/models/tools
to employ.
19
The ground rules
• To minimise the scope for unethical behaviour …
1) Time period for the exam must be sufficiently tight
1) Make clear (as a stated objective of the subject)
that
is the key to success
1) 'Text-book' impersonal responses will not attract
high grades.
20
21
An MBA module offered by a KU college …
• The programme is offered online
22
23
Links to
background on
company
24
Images and
multimedia help
to contextualise
problem
25
Excerpts from
third party
accounts
provide
perspective
26
Links to short
articles on the
story
27
Links to real
people
Students have 24 hours to submit …
28
Remains
authentic
throughout
You have to have
invigilated exams or
students will cheat
29
1) Students cheat during
invigilated exams
1) In the adult learner
context, only a small
percentage will attempt
to cheat
2) These people will cheat
whatever the exam
instrument
Seldom observed points
30
31
Getting started
• Keep a look out for material all the time (not
exam time!)
• e.g. Local newspaper, periodical websites,
magazines, television news or current affairs
programmes
32
What to look for
• A that learners can easily relate to in lay
terms
• Objective: to get them to about an
issue
• Student to act as ‘expert witness’ – an effective
mechanism for the validation of their learning in
their own minds
33
Creating a scenario
• Having settled on a theme, gather
together various media that can bring
the case to life
• The inclusion of hyperlinks,
photographs and/or streaming media
adds a human dimension 
34
Lead characters
• No story is complete without lead characters
• Using people with names, and pictures and
voices acts as a catalyst to student engagement
• Fictional characters must give the appearance of
being real!
35
Setting
• Role play  the bridge between a learner's
education and their professional practice
• Placing the learner in the role of the key
decision maker, the expert advisor, or the
auditor
• Revisit the stated learning outcomes
36
Defining the parameters
• The definition of the assessment task might
amount to no more than a paragraph
• Ideally it should invite a wide of variety of
37
Striking a balance
• Avoid 'spoon-feeding' but …
• … not so unstructured a student is either
struck by 'writers block' or goes off in the
wrong direction.
38
Expectations
• Before writing , it is
helpful to develop an outline of the kind of
response one expects from the learner and,
importantly, …
• This process may also lead to being
refined
39
40
OBOW exams …
• A form of assessment that fosters
as opposed to a display of inert knowledge
• Test problem-solving skills not memory
• Equips learners with 21st Century skills
41
What OBOW exams deliver…
• An assessment instrument that is more relevant to
goals of the curriculum, greater authenticity, where
real-world problems take centre-stage
• Allow ICTs to be harnessed to encourage
interaction
• Student engagement with the assessment task 
induces
• Low cost solution for exam delivery in open and
distance learning
42
• Studies show stimulation with audio will
increase retention rate by 20%. If stimulated
with audiovisual, memory retention climbs to
30%. If presented with interactive multimedia
involvement, the retention rate can be as
high as 60%.
43
References
• Williams, Jeremy B. (2009)The efficacy of the final examination: a
comparative study of closed-book, invigilated exams and open-book,
open-web exams (with Amy Wong), British Journal of Educational
Technology, 40 (2), 227-236).
• Williams, Jeremy B. (2007) E-xams: harnessing the power of ICTs to
enhance authenticity, (with Wing Lam and Alton Chua), Educational
Technology and Society, 10 (3), 209-221.
• Williams, Jeremy B. (2007) Using digital storytelling as an assessment
instrument: Preliminary findings at an online
university, (with Kanishka Bedi), Proceedings of the 11th CAA
Conference, pp.433-447, Loughborough, England, 10-11 July.
• Williams, Jeremy B. (2006) The place of the closed book, invigilated
final examination in a knowledge economy, Educational Media
International, 43(2), 107-119.
44

Contenu connexe

Tendances

Online Assessment Presentation
Online Assessment PresentationOnline Assessment Presentation
Online Assessment Presentationmargaretntrent
 
MEU WORKSHOP Evaluation principles and objectives
MEU WORKSHOP Evaluation principles and objectivesMEU WORKSHOP Evaluation principles and objectives
MEU WORKSHOP Evaluation principles and objectivesDevan Pannen
 
An Exploration of Feedback in Midwifery Education
An Exploration of Feedback in Midwifery EducationAn Exploration of Feedback in Midwifery Education
An Exploration of Feedback in Midwifery Educationmdxaltc
 
Assessment Strategies and Innovative Teaching Practices
Assessment Strategies and Innovative Teaching PracticesAssessment Strategies and Innovative Teaching Practices
Assessment Strategies and Innovative Teaching PracticesMostafa Ewees
 
Tools and Evaluation Techniques to Support Social Awareness in CSCeL: The AV...
 Tools and Evaluation Techniques to Support Social Awareness in CSCeL: The AV... Tools and Evaluation Techniques to Support Social Awareness in CSCeL: The AV...
Tools and Evaluation Techniques to Support Social Awareness in CSCeL: The AV...Niki Lambropoulos PhD
 
Effective feedback in medical education
Effective feedback in medical educationEffective feedback in medical education
Effective feedback in medical educationDavid Carless
 
Assessing Problem Based Learning
Assessing Problem Based LearningAssessing Problem Based Learning
Assessing Problem Based LearningCarmel Schettino
 
Authentic assessment
Authentic assessmentAuthentic assessment
Authentic assessmentDavid Carless
 
Continuous and comprehensive evaluation (cce)
Continuous and comprehensive evaluation (cce)Continuous and comprehensive evaluation (cce)
Continuous and comprehensive evaluation (cce)Waheeda Bushra
 
Assessment Assumptions
Assessment AssumptionsAssessment Assumptions
Assessment AssumptionsJason Rhode
 
Professor Graham Gibbs Presentation
Professor Graham Gibbs PresentationProfessor Graham Gibbs Presentation
Professor Graham Gibbs PresentationChris McEwan
 

Tendances (20)

Online Assessment Presentation
Online Assessment PresentationOnline Assessment Presentation
Online Assessment Presentation
 
MEU WORKSHOP Evaluation principles and objectives
MEU WORKSHOP Evaluation principles and objectivesMEU WORKSHOP Evaluation principles and objectives
MEU WORKSHOP Evaluation principles and objectives
 
An Exploration of Feedback in Midwifery Education
An Exploration of Feedback in Midwifery EducationAn Exploration of Feedback in Midwifery Education
An Exploration of Feedback in Midwifery Education
 
Assessment Strategies and Innovative Teaching Practices
Assessment Strategies and Innovative Teaching PracticesAssessment Strategies and Innovative Teaching Practices
Assessment Strategies and Innovative Teaching Practices
 
ARLG 2019: Myer have we made a difference
ARLG 2019: Myer have we made a differenceARLG 2019: Myer have we made a difference
ARLG 2019: Myer have we made a difference
 
Tools and Evaluation Techniques to Support Social Awareness in CSCeL: The AV...
 Tools and Evaluation Techniques to Support Social Awareness in CSCeL: The AV... Tools and Evaluation Techniques to Support Social Awareness in CSCeL: The AV...
Tools and Evaluation Techniques to Support Social Awareness in CSCeL: The AV...
 
Assesment
AssesmentAssesment
Assesment
 
Assessment Strategies
Assessment StrategiesAssessment Strategies
Assessment Strategies
 
Viva voce
Viva voceViva voce
Viva voce
 
Lesson planning
Lesson planningLesson planning
Lesson planning
 
Effective feedback in medical education
Effective feedback in medical educationEffective feedback in medical education
Effective feedback in medical education
 
Introduction to medical education
Introduction to medical education  Introduction to medical education
Introduction to medical education
 
03.1.14 weac.cp 2
03.1.14 weac.cp 203.1.14 weac.cp 2
03.1.14 weac.cp 2
 
Case study
Case studyCase study
Case study
 
Assessing Problem Based Learning
Assessing Problem Based LearningAssessing Problem Based Learning
Assessing Problem Based Learning
 
Improvised Apparatus
Improvised ApparatusImprovised Apparatus
Improvised Apparatus
 
Authentic assessment
Authentic assessmentAuthentic assessment
Authentic assessment
 
Continuous and comprehensive evaluation (cce)
Continuous and comprehensive evaluation (cce)Continuous and comprehensive evaluation (cce)
Continuous and comprehensive evaluation (cce)
 
Assessment Assumptions
Assessment AssumptionsAssessment Assumptions
Assessment Assumptions
 
Professor Graham Gibbs Presentation
Professor Graham Gibbs PresentationProfessor Graham Gibbs Presentation
Professor Graham Gibbs Presentation
 

Similaire à Open Book Open Web (OBOW) exams

Future-directed assessment: Learning that lasts
Future-directed assessment: Learning that lastsFuture-directed assessment: Learning that lasts
Future-directed assessment: Learning that lastsJeremy Williams
 
Technology & Social Inclusion: Enhancing the First Year Experience
Technology & Social Inclusion: Enhancing the First Year Experience Technology & Social Inclusion: Enhancing the First Year Experience
Technology & Social Inclusion: Enhancing the First Year Experience Charles Darwin University
 
Bottom Line Presentation
Bottom Line PresentationBottom Line Presentation
Bottom Line PresentationTaylor Edwards
 
The Role of Learning Technology in Adult Learning and Organization Development
The Role of Learning Technology in Adult Learning and Organization DevelopmentThe Role of Learning Technology in Adult Learning and Organization Development
The Role of Learning Technology in Adult Learning and Organization DevelopmentCandace Chou
 
The Role of Learning Technology in Adult Learning and Organization Development
The Role of Learning Technology in Adult Learning and Organization DevelopmentThe Role of Learning Technology in Adult Learning and Organization Development
The Role of Learning Technology in Adult Learning and Organization DevelopmentCandace Chou
 
Project based learning
Project based learningProject based learning
Project based learningJunaid Masood
 
Project Based Learning Explained
Project Based Learning Explained Project Based Learning Explained
Project Based Learning Explained hallieshae
 
Fostering a culture change in assessment and feedback through TESTA
Fostering a culture change in assessment and feedback through TESTAFostering a culture change in assessment and feedback through TESTA
Fostering a culture change in assessment and feedback through TESTATansy Jessop
 
Putting the Pedagogic Horse before the Technology Cart
Putting the Pedagogic Horse before the Technology CartPutting the Pedagogic Horse before the Technology Cart
Putting the Pedagogic Horse before the Technology CartCharles Darwin University
 
ACCE2016: Authentic Learning Empowered By IT
ACCE2016: Authentic Learning Empowered By ITACCE2016: Authentic Learning Empowered By IT
ACCE2016: Authentic Learning Empowered By ITPaul Herring
 
the craft of e-teaching; moving from digitally shy to digitally confident wit...
the craft of e-teaching; moving from digitally shy to digitally confident wit...the craft of e-teaching; moving from digitally shy to digitally confident wit...
the craft of e-teaching; moving from digitally shy to digitally confident wit...Sue Watling
 
Assessment approaches that work
Assessment approaches that workAssessment approaches that work
Assessment approaches that workTansy Jessop
 
Open Learning: Bridge to Success
Open Learning: Bridge to SuccessOpen Learning: Bridge to Success
Open Learning: Bridge to SuccessBrandon Muramatsu
 
Online Discussion Learning Design
Online Discussion Learning DesignOnline Discussion Learning Design
Online Discussion Learning DesignJeremy Williams
 
Real-time Assessment: A Guide for Emergency Remote Teaching
Real-time Assessment: A Guide for Emergency Remote TeachingReal-time Assessment: A Guide for Emergency Remote Teaching
Real-time Assessment: A Guide for Emergency Remote TeachingFitri Mohamad
 

Similaire à Open Book Open Web (OBOW) exams (20)

Future-directed assessment: Learning that lasts
Future-directed assessment: Learning that lastsFuture-directed assessment: Learning that lasts
Future-directed assessment: Learning that lasts
 
PBL: Why, What and How
PBL: Why, What and HowPBL: Why, What and How
PBL: Why, What and How
 
Technology & Social Inclusion: Enhancing the First Year Experience
Technology & Social Inclusion: Enhancing the First Year Experience Technology & Social Inclusion: Enhancing the First Year Experience
Technology & Social Inclusion: Enhancing the First Year Experience
 
Bottom Line Presentation
Bottom Line PresentationBottom Line Presentation
Bottom Line Presentation
 
The Role of Learning Technology in Adult Learning and Organization Development
The Role of Learning Technology in Adult Learning and Organization DevelopmentThe Role of Learning Technology in Adult Learning and Organization Development
The Role of Learning Technology in Adult Learning and Organization Development
 
The Role of Learning Technology in Adult Learning and Organization Development
The Role of Learning Technology in Adult Learning and Organization DevelopmentThe Role of Learning Technology in Adult Learning and Organization Development
The Role of Learning Technology in Adult Learning and Organization Development
 
MMU TESTA Keynote
MMU TESTA KeynoteMMU TESTA Keynote
MMU TESTA Keynote
 
Project based learning
Project based learningProject based learning
Project based learning
 
Project Based Learning Explained
Project Based Learning Explained Project Based Learning Explained
Project Based Learning Explained
 
Fostering a culture change in assessment and feedback through TESTA
Fostering a culture change in assessment and feedback through TESTAFostering a culture change in assessment and feedback through TESTA
Fostering a culture change in assessment and feedback through TESTA
 
Putting the Pedagogic Horse before the Technology Cart
Putting the Pedagogic Horse before the Technology CartPutting the Pedagogic Horse before the Technology Cart
Putting the Pedagogic Horse before the Technology Cart
 
ACCE2016: Authentic Learning Empowered By IT
ACCE2016: Authentic Learning Empowered By ITACCE2016: Authentic Learning Empowered By IT
ACCE2016: Authentic Learning Empowered By IT
 
the craft of e-teaching; moving from digitally shy to digitally confident wit...
the craft of e-teaching; moving from digitally shy to digitally confident wit...the craft of e-teaching; moving from digitally shy to digitally confident wit...
the craft of e-teaching; moving from digitally shy to digitally confident wit...
 
Embracing AI in new forms of assessment
Embracing AI in new forms of assessmentEmbracing AI in new forms of assessment
Embracing AI in new forms of assessment
 
Leap21 pfs 22 april
Leap21   pfs 22 aprilLeap21   pfs 22 april
Leap21 pfs 22 april
 
Assessment approaches that work
Assessment approaches that workAssessment approaches that work
Assessment approaches that work
 
Open Learning: Bridge to Success
Open Learning: Bridge to SuccessOpen Learning: Bridge to Success
Open Learning: Bridge to Success
 
Online Discussion Learning Design
Online Discussion Learning DesignOnline Discussion Learning Design
Online Discussion Learning Design
 
Webinar innovative teaching
Webinar innovative teachingWebinar innovative teaching
Webinar innovative teaching
 
Real-time Assessment: A Guide for Emergency Remote Teaching
Real-time Assessment: A Guide for Emergency Remote TeachingReal-time Assessment: A Guide for Emergency Remote Teaching
Real-time Assessment: A Guide for Emergency Remote Teaching
 

Plus de Jeremy Williams

Achieving SDG 5: A Comparative Analysis of Gender Equality Policies in Rwanda...
Achieving SDG 5: A Comparative Analysis of Gender Equality Policies in Rwanda...Achieving SDG 5: A Comparative Analysis of Gender Equality Policies in Rwanda...
Achieving SDG 5: A Comparative Analysis of Gender Equality Policies in Rwanda...Jeremy Williams
 
Divestment and the Energy Transition
Divestment and the Energy TransitionDivestment and the Energy Transition
Divestment and the Energy TransitionJeremy Williams
 
Sustainable Futures: Building Social-Ecological Resilience
Sustainable Futures: Building Social-Ecological ResilienceSustainable Futures: Building Social-Ecological Resilience
Sustainable Futures: Building Social-Ecological ResilienceJeremy Williams
 
The UAE Global University, 2023: A Retrospective
The UAE Global University, 2023:  A Retrospective The UAE Global University, 2023:  A Retrospective
The UAE Global University, 2023: A Retrospective Jeremy Williams
 
School as Sustainable Enterprise: Building Climate Resilient Communities thro...
School as Sustainable Enterprise: Building Climate Resilient Communities thro...School as Sustainable Enterprise: Building Climate Resilient Communities thro...
School as Sustainable Enterprise: Building Climate Resilient Communities thro...Jeremy Williams
 
Educational Leadership for Sustainability
Educational Leadership for SustainabilityEducational Leadership for Sustainability
Educational Leadership for SustainabilityJeremy Williams
 
The Kerala Global School, 2022: A Retrospective
The Kerala Global School, 2022:  A Retrospective The Kerala Global School, 2022:  A Retrospective
The Kerala Global School, 2022: A Retrospective Jeremy Williams
 
The Future of Learning: Five trends that could change the face of Indian educ...
The Future of Learning: Five trends that could change the face of Indian educ...The Future of Learning: Five trends that could change the face of Indian educ...
The Future of Learning: Five trends that could change the face of Indian educ...Jeremy Williams
 
Preschool teacher education: Why it’s time for educational technology to live...
Preschool teacher education: Why it’s time for educational technology to live...Preschool teacher education: Why it’s time for educational technology to live...
Preschool teacher education: Why it’s time for educational technology to live...Jeremy Williams
 
Are you a life-long learner?
Are you a life-long learner?Are you a life-long learner?
Are you a life-long learner?Jeremy Williams
 
Investing for the Smart City: Five Points for Tri-City Education Leaders to C...
Investing for the Smart City: Five Points for Tri-City Education Leaders to C...Investing for the Smart City: Five Points for Tri-City Education Leaders to C...
Investing for the Smart City: Five Points for Tri-City Education Leaders to C...Jeremy Williams
 
The Discourse on Quality in Early Childhood Education: What Can We Agree On?
The Discourse on Quality in Early Childhood Education: What Can We Agree On?The Discourse on Quality in Early Childhood Education: What Can We Agree On?
The Discourse on Quality in Early Childhood Education: What Can We Agree On?Jeremy Williams
 
The democratisation of education: Will technology live up to the promise?
The democratisation of education: Will technology live up to the promise?The democratisation of education: Will technology live up to the promise?
The democratisation of education: Will technology live up to the promise?Jeremy Williams
 
Five trends changing the face of education
Five trends changing the face of educationFive trends changing the face of education
Five trends changing the face of educationJeremy Williams
 
Investing in the Girl Child: School as Sustainable Enterprise
Investing in the Girl Child: School as Sustainable EnterpriseInvesting in the Girl Child: School as Sustainable Enterprise
Investing in the Girl Child: School as Sustainable EnterpriseJeremy Williams
 
The Case for the Integration of Natural Capital
The Case for the Integration of Natural CapitalThe Case for the Integration of Natural Capital
The Case for the Integration of Natural CapitalJeremy Williams
 
School as Sustainable Enterprise
School as Sustainable EnterpriseSchool as Sustainable Enterprise
School as Sustainable EnterpriseJeremy Williams
 
Strategic Thinking for Sustainable Enterprise
Strategic Thinking for Sustainable EnterpriseStrategic Thinking for Sustainable Enterprise
Strategic Thinking for Sustainable EnterpriseJeremy Williams
 

Plus de Jeremy Williams (20)

Achieving SDG 5: A Comparative Analysis of Gender Equality Policies in Rwanda...
Achieving SDG 5: A Comparative Analysis of Gender Equality Policies in Rwanda...Achieving SDG 5: A Comparative Analysis of Gender Equality Policies in Rwanda...
Achieving SDG 5: A Comparative Analysis of Gender Equality Policies in Rwanda...
 
Divestment and the Energy Transition
Divestment and the Energy TransitionDivestment and the Energy Transition
Divestment and the Energy Transition
 
Sustainable Futures: Building Social-Ecological Resilience
Sustainable Futures: Building Social-Ecological ResilienceSustainable Futures: Building Social-Ecological Resilience
Sustainable Futures: Building Social-Ecological Resilience
 
The UAE Global University, 2023: A Retrospective
The UAE Global University, 2023:  A Retrospective The UAE Global University, 2023:  A Retrospective
The UAE Global University, 2023: A Retrospective
 
School as Sustainable Enterprise: Building Climate Resilient Communities thro...
School as Sustainable Enterprise: Building Climate Resilient Communities thro...School as Sustainable Enterprise: Building Climate Resilient Communities thro...
School as Sustainable Enterprise: Building Climate Resilient Communities thro...
 
Educational Leadership for Sustainability
Educational Leadership for SustainabilityEducational Leadership for Sustainability
Educational Leadership for Sustainability
 
The Kerala Global School, 2022: A Retrospective
The Kerala Global School, 2022:  A Retrospective The Kerala Global School, 2022:  A Retrospective
The Kerala Global School, 2022: A Retrospective
 
The Future of Learning: Five trends that could change the face of Indian educ...
The Future of Learning: Five trends that could change the face of Indian educ...The Future of Learning: Five trends that could change the face of Indian educ...
The Future of Learning: Five trends that could change the face of Indian educ...
 
Preschool teacher education: Why it’s time for educational technology to live...
Preschool teacher education: Why it’s time for educational technology to live...Preschool teacher education: Why it’s time for educational technology to live...
Preschool teacher education: Why it’s time for educational technology to live...
 
Are you a life-long learner?
Are you a life-long learner?Are you a life-long learner?
Are you a life-long learner?
 
Investing for the Smart City: Five Points for Tri-City Education Leaders to C...
Investing for the Smart City: Five Points for Tri-City Education Leaders to C...Investing for the Smart City: Five Points for Tri-City Education Leaders to C...
Investing for the Smart City: Five Points for Tri-City Education Leaders to C...
 
The Discourse on Quality in Early Childhood Education: What Can We Agree On?
The Discourse on Quality in Early Childhood Education: What Can We Agree On?The Discourse on Quality in Early Childhood Education: What Can We Agree On?
The Discourse on Quality in Early Childhood Education: What Can We Agree On?
 
SAIBSA keynote
SAIBSA keynoteSAIBSA keynote
SAIBSA keynote
 
The democratisation of education: Will technology live up to the promise?
The democratisation of education: Will technology live up to the promise?The democratisation of education: Will technology live up to the promise?
The democratisation of education: Will technology live up to the promise?
 
Five trends changing the face of education
Five trends changing the face of educationFive trends changing the face of education
Five trends changing the face of education
 
Investing in the Girl Child: School as Sustainable Enterprise
Investing in the Girl Child: School as Sustainable EnterpriseInvesting in the Girl Child: School as Sustainable Enterprise
Investing in the Girl Child: School as Sustainable Enterprise
 
The Case for the Integration of Natural Capital
The Case for the Integration of Natural CapitalThe Case for the Integration of Natural Capital
The Case for the Integration of Natural Capital
 
School as Sustainable Enterprise
School as Sustainable EnterpriseSchool as Sustainable Enterprise
School as Sustainable Enterprise
 
Strategic Thinking for Sustainable Enterprise
Strategic Thinking for Sustainable EnterpriseStrategic Thinking for Sustainable Enterprise
Strategic Thinking for Sustainable Enterprise
 
Movie making
Movie makingMovie making
Movie making
 

Dernier

Optical Fibre and It's Applications.pptx
Optical Fibre and It's Applications.pptxOptical Fibre and It's Applications.pptx
Optical Fibre and It's Applications.pptxPurva Nikam
 
Slides CapTechTalks Webinar March 2024 Joshua Sinai.pptx
Slides CapTechTalks Webinar March 2024 Joshua Sinai.pptxSlides CapTechTalks Webinar March 2024 Joshua Sinai.pptx
Slides CapTechTalks Webinar March 2024 Joshua Sinai.pptxCapitolTechU
 
SOLIDE WASTE in Cameroon,,,,,,,,,,,,,,,,,,,,,,,,,,,.pptx
SOLIDE WASTE in Cameroon,,,,,,,,,,,,,,,,,,,,,,,,,,,.pptxSOLIDE WASTE in Cameroon,,,,,,,,,,,,,,,,,,,,,,,,,,,.pptx
SOLIDE WASTE in Cameroon,,,,,,,,,,,,,,,,,,,,,,,,,,,.pptxSyedNadeemGillANi
 
Diploma in Nursing Admission Test Question Solution 2023.pdf
Diploma in Nursing Admission Test Question Solution 2023.pdfDiploma in Nursing Admission Test Question Solution 2023.pdf
Diploma in Nursing Admission Test Question Solution 2023.pdfMohonDas
 
Riddhi Kevadiya. WILLIAM SHAKESPEARE....
Riddhi Kevadiya. WILLIAM SHAKESPEARE....Riddhi Kevadiya. WILLIAM SHAKESPEARE....
Riddhi Kevadiya. WILLIAM SHAKESPEARE....Riddhi Kevadiya
 
How to Create a Toggle Button in Odoo 17
How to Create a Toggle Button in Odoo 17How to Create a Toggle Button in Odoo 17
How to Create a Toggle Button in Odoo 17Celine George
 
What is the Future of QuickBooks DeskTop?
What is the Future of QuickBooks DeskTop?What is the Future of QuickBooks DeskTop?
What is the Future of QuickBooks DeskTop?TechSoup
 
Over the counter (OTC)- Sale, rational use.pptx
Over the counter (OTC)- Sale, rational use.pptxOver the counter (OTC)- Sale, rational use.pptx
Over the counter (OTC)- Sale, rational use.pptxraviapr7
 
Unveiling the Intricacies of Leishmania donovani: Structure, Life Cycle, Path...
Unveiling the Intricacies of Leishmania donovani: Structure, Life Cycle, Path...Unveiling the Intricacies of Leishmania donovani: Structure, Life Cycle, Path...
Unveiling the Intricacies of Leishmania donovani: Structure, Life Cycle, Path...Dr. Asif Anas
 
KARNAADA.pptx made by - saransh dwivedi ( SD ) - SHALAKYA TANTRA - ENT - 4...
KARNAADA.pptx  made by -  saransh dwivedi ( SD ) -  SHALAKYA TANTRA - ENT - 4...KARNAADA.pptx  made by -  saransh dwivedi ( SD ) -  SHALAKYA TANTRA - ENT - 4...
KARNAADA.pptx made by - saransh dwivedi ( SD ) - SHALAKYA TANTRA - ENT - 4...M56BOOKSTORE PRODUCT/SERVICE
 
Easter in the USA presentation by Chloe.
Easter in the USA presentation by Chloe.Easter in the USA presentation by Chloe.
Easter in the USA presentation by Chloe.EnglishCEIPdeSigeiro
 
Patient Counselling. Definition of patient counseling; steps involved in pati...
Patient Counselling. Definition of patient counseling; steps involved in pati...Patient Counselling. Definition of patient counseling; steps involved in pati...
Patient Counselling. Definition of patient counseling; steps involved in pati...raviapr7
 
In - Vivo and In - Vitro Correlation.pptx
In - Vivo and In - Vitro Correlation.pptxIn - Vivo and In - Vitro Correlation.pptx
In - Vivo and In - Vitro Correlation.pptxAditiChauhan701637
 
The Stolen Bacillus by Herbert George Wells
The Stolen Bacillus by Herbert George WellsThe Stolen Bacillus by Herbert George Wells
The Stolen Bacillus by Herbert George WellsEugene Lysak
 
CHUYÊN ĐỀ DẠY THÊM TIẾNG ANH LỚP 11 - GLOBAL SUCCESS - NĂM HỌC 2023-2024 - HK...
CHUYÊN ĐỀ DẠY THÊM TIẾNG ANH LỚP 11 - GLOBAL SUCCESS - NĂM HỌC 2023-2024 - HK...CHUYÊN ĐỀ DẠY THÊM TIẾNG ANH LỚP 11 - GLOBAL SUCCESS - NĂM HỌC 2023-2024 - HK...
CHUYÊN ĐỀ DẠY THÊM TIẾNG ANH LỚP 11 - GLOBAL SUCCESS - NĂM HỌC 2023-2024 - HK...Nguyen Thanh Tu Collection
 
AUDIENCE THEORY -- FANDOM -- JENKINS.pptx
AUDIENCE THEORY -- FANDOM -- JENKINS.pptxAUDIENCE THEORY -- FANDOM -- JENKINS.pptx
AUDIENCE THEORY -- FANDOM -- JENKINS.pptxiammrhaywood
 

Dernier (20)

Optical Fibre and It's Applications.pptx
Optical Fibre and It's Applications.pptxOptical Fibre and It's Applications.pptx
Optical Fibre and It's Applications.pptx
 
Personal Resilience in Project Management 2 - TV Edit 1a.pdf
Personal Resilience in Project Management 2 - TV Edit 1a.pdfPersonal Resilience in Project Management 2 - TV Edit 1a.pdf
Personal Resilience in Project Management 2 - TV Edit 1a.pdf
 
Slides CapTechTalks Webinar March 2024 Joshua Sinai.pptx
Slides CapTechTalks Webinar March 2024 Joshua Sinai.pptxSlides CapTechTalks Webinar March 2024 Joshua Sinai.pptx
Slides CapTechTalks Webinar March 2024 Joshua Sinai.pptx
 
March 2024 Directors Meeting, Division of Student Affairs and Academic Support
March 2024 Directors Meeting, Division of Student Affairs and Academic SupportMarch 2024 Directors Meeting, Division of Student Affairs and Academic Support
March 2024 Directors Meeting, Division of Student Affairs and Academic Support
 
SOLIDE WASTE in Cameroon,,,,,,,,,,,,,,,,,,,,,,,,,,,.pptx
SOLIDE WASTE in Cameroon,,,,,,,,,,,,,,,,,,,,,,,,,,,.pptxSOLIDE WASTE in Cameroon,,,,,,,,,,,,,,,,,,,,,,,,,,,.pptx
SOLIDE WASTE in Cameroon,,,,,,,,,,,,,,,,,,,,,,,,,,,.pptx
 
Diploma in Nursing Admission Test Question Solution 2023.pdf
Diploma in Nursing Admission Test Question Solution 2023.pdfDiploma in Nursing Admission Test Question Solution 2023.pdf
Diploma in Nursing Admission Test Question Solution 2023.pdf
 
Riddhi Kevadiya. WILLIAM SHAKESPEARE....
Riddhi Kevadiya. WILLIAM SHAKESPEARE....Riddhi Kevadiya. WILLIAM SHAKESPEARE....
Riddhi Kevadiya. WILLIAM SHAKESPEARE....
 
How to Create a Toggle Button in Odoo 17
How to Create a Toggle Button in Odoo 17How to Create a Toggle Button in Odoo 17
How to Create a Toggle Button in Odoo 17
 
Prelims of Kant get Marx 2.0: a general politics quiz
Prelims of Kant get Marx 2.0: a general politics quizPrelims of Kant get Marx 2.0: a general politics quiz
Prelims of Kant get Marx 2.0: a general politics quiz
 
What is the Future of QuickBooks DeskTop?
What is the Future of QuickBooks DeskTop?What is the Future of QuickBooks DeskTop?
What is the Future of QuickBooks DeskTop?
 
Over the counter (OTC)- Sale, rational use.pptx
Over the counter (OTC)- Sale, rational use.pptxOver the counter (OTC)- Sale, rational use.pptx
Over the counter (OTC)- Sale, rational use.pptx
 
Unveiling the Intricacies of Leishmania donovani: Structure, Life Cycle, Path...
Unveiling the Intricacies of Leishmania donovani: Structure, Life Cycle, Path...Unveiling the Intricacies of Leishmania donovani: Structure, Life Cycle, Path...
Unveiling the Intricacies of Leishmania donovani: Structure, Life Cycle, Path...
 
KARNAADA.pptx made by - saransh dwivedi ( SD ) - SHALAKYA TANTRA - ENT - 4...
KARNAADA.pptx  made by -  saransh dwivedi ( SD ) -  SHALAKYA TANTRA - ENT - 4...KARNAADA.pptx  made by -  saransh dwivedi ( SD ) -  SHALAKYA TANTRA - ENT - 4...
KARNAADA.pptx made by - saransh dwivedi ( SD ) - SHALAKYA TANTRA - ENT - 4...
 
Finals of Kant get Marx 2.0 : a general politics quiz
Finals of Kant get Marx 2.0 : a general politics quizFinals of Kant get Marx 2.0 : a general politics quiz
Finals of Kant get Marx 2.0 : a general politics quiz
 
Easter in the USA presentation by Chloe.
Easter in the USA presentation by Chloe.Easter in the USA presentation by Chloe.
Easter in the USA presentation by Chloe.
 
Patient Counselling. Definition of patient counseling; steps involved in pati...
Patient Counselling. Definition of patient counseling; steps involved in pati...Patient Counselling. Definition of patient counseling; steps involved in pati...
Patient Counselling. Definition of patient counseling; steps involved in pati...
 
In - Vivo and In - Vitro Correlation.pptx
In - Vivo and In - Vitro Correlation.pptxIn - Vivo and In - Vitro Correlation.pptx
In - Vivo and In - Vitro Correlation.pptx
 
The Stolen Bacillus by Herbert George Wells
The Stolen Bacillus by Herbert George WellsThe Stolen Bacillus by Herbert George Wells
The Stolen Bacillus by Herbert George Wells
 
CHUYÊN ĐỀ DẠY THÊM TIẾNG ANH LỚP 11 - GLOBAL SUCCESS - NĂM HỌC 2023-2024 - HK...
CHUYÊN ĐỀ DẠY THÊM TIẾNG ANH LỚP 11 - GLOBAL SUCCESS - NĂM HỌC 2023-2024 - HK...CHUYÊN ĐỀ DẠY THÊM TIẾNG ANH LỚP 11 - GLOBAL SUCCESS - NĂM HỌC 2023-2024 - HK...
CHUYÊN ĐỀ DẠY THÊM TIẾNG ANH LỚP 11 - GLOBAL SUCCESS - NĂM HỌC 2023-2024 - HK...
 
AUDIENCE THEORY -- FANDOM -- JENKINS.pptx
AUDIENCE THEORY -- FANDOM -- JENKINS.pptxAUDIENCE THEORY -- FANDOM -- JENKINS.pptx
AUDIENCE THEORY -- FANDOM -- JENKINS.pptx
 

Open Book Open Web (OBOW) exams

  • 1. nomination for Higher Education: Best Innovation in Open and Distance Learning Award digitalLEARNING World Education Awards Delhi, India, July 2011
  • 2. Overview 1. Why OBOW exams? 2. What is an OBOW exam? 3. How to construct an OBOW exam 4. A Sample OBOW exam 5. Summary and conclusions 2
  • 3. 3
  • 4. Defining characteristic • A commitment to • “... Engaging and worthy problems or questions of importance, in which students must use knowledge to fashion performances effectively and .” Grant Wiggins 4
  • 5. 5 • multiple-choice tests • fill-in-the-blanks • true-false • matching words • … Students are passive learners  Authentic assessment is not:
  • 6. "Life is an open book exam." • Learners need to be convinced of the authenticity of the task if they are to fully engage Professor Alan Blinder Princeton University 6
  • 7. 7
  • 10. Constructive alignment (Biggs 1999) Is there is between the traditional examination instrument, and term time pedagogy and defined learning outcomes? 10
  • 11. 11
  • 12. How often do people solve problems in real life by locking themselves in a room for 3 hours with no books, no web access, not talking to anyone, answering MCQs? 12
  • 13. 13 Is a closed book, invigilated exam more likely to foster … or cramming/ data dumping?
  • 14. “Mugging up” is for mugs • Deep learning will occur only when the learner is , , or , incoming stimuli … • Authentic, real-world, workplace-integrated assessment is 14
  • 15. 15
  • 16. In brief … • A semi-structured ‘mini-case (or ‘caselette’) • Harnesses the power of ICTs to emphasise currency and real world authenticity • A summative assessment item … … invites the student to draw on all that they have learnt (determining what is relevant). 16
  • 17. Dull? Boring? Something to fear? • Final assessment  • Boredom and stress not conducive to deep learning • Important to catch the imagination and appeal to the creativity of the learner • Multimedia enhancements increase student satisfaction and learning (O'Brien and Seawell 2004; Vaughan 2001) 17
  • 18. Key features • Students play the role of decision-maker, auditor, consultant or advisor • They are presented with a unstructured (open-ended) problem that requires resolution (usually in the form of a set of recommendations) • No pre-exam night 'cramming' 18
  • 19. The template the setting in which the problem/situation is identified and framed the project and issues to resolve the setting of parameters and suggestions about methods/concepts/models/tools to employ. 19
  • 20. The ground rules • To minimise the scope for unethical behaviour … 1) Time period for the exam must be sufficiently tight 1) Make clear (as a stated objective of the subject) that is the key to success 1) 'Text-book' impersonal responses will not attract high grades. 20
  • 21. 21
  • 22. An MBA module offered by a KU college … • The programme is offered online 22
  • 24. 24 Images and multimedia help to contextualise problem
  • 28. Students have 24 hours to submit … 28 Remains authentic throughout
  • 29. You have to have invigilated exams or students will cheat 29
  • 30. 1) Students cheat during invigilated exams 1) In the adult learner context, only a small percentage will attempt to cheat 2) These people will cheat whatever the exam instrument Seldom observed points 30
  • 31. 31
  • 32. Getting started • Keep a look out for material all the time (not exam time!) • e.g. Local newspaper, periodical websites, magazines, television news or current affairs programmes 32
  • 33. What to look for • A that learners can easily relate to in lay terms • Objective: to get them to about an issue • Student to act as ‘expert witness’ – an effective mechanism for the validation of their learning in their own minds 33
  • 34. Creating a scenario • Having settled on a theme, gather together various media that can bring the case to life • The inclusion of hyperlinks, photographs and/or streaming media adds a human dimension  34
  • 35. Lead characters • No story is complete without lead characters • Using people with names, and pictures and voices acts as a catalyst to student engagement • Fictional characters must give the appearance of being real! 35
  • 36. Setting • Role play  the bridge between a learner's education and their professional practice • Placing the learner in the role of the key decision maker, the expert advisor, or the auditor • Revisit the stated learning outcomes 36
  • 37. Defining the parameters • The definition of the assessment task might amount to no more than a paragraph • Ideally it should invite a wide of variety of 37
  • 38. Striking a balance • Avoid 'spoon-feeding' but … • … not so unstructured a student is either struck by 'writers block' or goes off in the wrong direction. 38
  • 39. Expectations • Before writing , it is helpful to develop an outline of the kind of response one expects from the learner and, importantly, … • This process may also lead to being refined 39
  • 40. 40
  • 41. OBOW exams … • A form of assessment that fosters as opposed to a display of inert knowledge • Test problem-solving skills not memory • Equips learners with 21st Century skills 41
  • 42. What OBOW exams deliver… • An assessment instrument that is more relevant to goals of the curriculum, greater authenticity, where real-world problems take centre-stage • Allow ICTs to be harnessed to encourage interaction • Student engagement with the assessment task  induces • Low cost solution for exam delivery in open and distance learning 42
  • 43. • Studies show stimulation with audio will increase retention rate by 20%. If stimulated with audiovisual, memory retention climbs to 30%. If presented with interactive multimedia involvement, the retention rate can be as high as 60%. 43
  • 44. References • Williams, Jeremy B. (2009)The efficacy of the final examination: a comparative study of closed-book, invigilated exams and open-book, open-web exams (with Amy Wong), British Journal of Educational Technology, 40 (2), 227-236). • Williams, Jeremy B. (2007) E-xams: harnessing the power of ICTs to enhance authenticity, (with Wing Lam and Alton Chua), Educational Technology and Society, 10 (3), 209-221. • Williams, Jeremy B. (2007) Using digital storytelling as an assessment instrument: Preliminary findings at an online university, (with Kanishka Bedi), Proceedings of the 11th CAA Conference, pp.433-447, Loughborough, England, 10-11 July. • Williams, Jeremy B. (2006) The place of the closed book, invigilated final examination in a knowledge economy, Educational Media International, 43(2), 107-119. 44

Notes de l'éditeur

  1. http://pairadimes.davidtruss.com/question-everything/