SlideShare une entreprise Scribd logo
1  sur  21
Télécharger pour lire hors ligne
Introduction to
Research Methods
in Education
Jasarat Ilyas Jokhio
M.Ed.
Preston University
Karachi Campus.
Research Methods
 Why is it important to understand research
methods for interdisciplinary researchers?
 Types of research
 How do you measure learning
experimentally?
 Within subjects design
 Between subjects design
 What are you measuring?
 Important Statistical terms
 [other methods]
Research methods as boundary
object in interdisciplinary research
 Study of cross-disciplinary research
collaboration (Mercier, Penuel, Remold, Villalba, Kuhl &
Romo, under review)
 The Bilingual Baby Project
 4-year longitudinal study
 Neuroscience, cognitive science, sociology
 How does growing up in a bilingual environment
influence cognitive development & school
readiness?
 Biggest issues was sample selection (methods)
… [a child] was brought back for me to test, and I was
putting [an ERP] cap on and then his mom said, well,
he’s used to this from going to the neurologist … and
then she told me that he has epilepsy. And I thought
to myself, well, okay, I’m wasting the next two-hours
because I’m not going to be able to use the data….. A
quantitative researcher would never include a child
that—you wouldn’t even waste the time and
resources.
It’s difficult because you do form close
relationships with the families…. So it was
then much harder for our group to eliminate
them from the pool, which we didn’t. We have
followed up, we’ve gone and interviewed her,
and it would be very interesting to see what
kind of school readiness skills that child has
and what kind of problems that mother has
encountered. I know that they wanted
children who had no other disabilities in order
to focus on their language acquisition, but not
all children are of this type
Two Types of Research
Quantitative
 Experimental
 Surveys (usually)
Qualitative
 Biography, phenomenology, grounded theory,
ethnography & case study
Mixed methods
 You can’t account for context with numbers
 The plural of anecdote is not data
What do you want your data &
results to look like?
 Do you want to show learning, engagement,
the process of the activity?
 Do you want to show that your tool works, or
that it is better than an alternative?
 Do you want to describe, code, run statistics,
present a case study?
 How will you design the study to get the type
of results you want to present?
How do you measure
learning experimentally?
Ecology lesson
- Aim: to teach 5 year
olds about complex
systems
- Ten 1-hour long
sessions over 5 weeks
- “Embodied curriculum”
- Technology; dancing;
drawing
0
1
2
3
4
5
6
7
8
9
10
Pre Post
Scoreontest
No way to know whether it was the curriculum,
or just being taught that led to learning
CLAIM: Embodied curriculum is a
good way to teach complex systems
How do you measure
learning experimentally?
(and know that it’s because of what you did…)
Pre/post test design (within subjects)
 Sequestered problem solving (SPS)
 Preparation for future learning (PFL)
 Free-write/free recall
 Delayed post-test
 Multiple baseline/single case design
How do you measure
learning experimentally?
(and know that it’s because of what you did…)
Control design (between subjects)
 Only some of the participants receive
intervention & compare post-test scores
between control & experimental groups
 Compare ‘experimental group’ with
previous groups who did not receive
intervention
 Randomized control trials (the medical
model)
2x2 design
Recall Condition
On Land Under
water
Learning
condition
On Land 20 20
Under
Water
20 20
Godden & Baddeley (1975)
But what are you measuring?
Prerequisites for Maths
Course
- Is maths101 necessary
to pass stats202?
- Half of students had
taken maths101
- All students take
stats202
- Contrast outcomes
0
10
20
30
40
50
60
70
80
90
100
Maths101 No Maths101
Meanpercentonposttest
Floor effect: either the post-test didn’t measure the content or very
little was learned from stats202.
CLAIM: No need to take
maths101 before taking stats202
But what are you measuring…
 Is it valid?
 Internal validity (is the effect caused by the IV)
 External validity (would it replication beyond the sample)
 Is it reliable?
 test-retest reliability
 Split-test reliability
 [piloting]
What sort of learning will you measure?
Important statistical ideas
 Independent variables
 The thing you manipulate/control for
 Main effects & Interaction effects between IV
 Dependent variables
 The outcome measure
 Floor effects & ceiling effects
 Statistical significance
 Usually <.05 for social science
 Indicates whether the effect is genuine or due to
chance
Important statistical ideas
 Level of measurement
 Nominal
 Ordinal
 Interval (& ranking)
 Population & sample
 Normal distribution
 Descriptive statistics
 Means, standard deviations, standard errors,
 Parametric and non-parametric statistics
Assumptions for parametric statistics
 Level of measurement must be at least
interval
 Sample is drawn from a normally distributed
population
 Homogeneity of Variance
 Variance of two samples is not significantly
different
 Independence of scores
Questions?
Key things to look for:
 Are the differences between conditions
significant:
 T-tests, ANOVA, Chi Square
 Is there a relationship between variables?
 Correlations (note: you can’t tell causation from this)
 Pay attention to r values (between 1 and -1).
 Which of the IVs cause the DV?
 Regression Analysis (note: need very large sample
size; controversial technique)
Survey design
 In the past 24 hours, did you watch more
than an hour of television programming,
or not? Yes/No
 In the past 24 hours, did you read a daily
newspaper, or not? Yes/No
 On a scale of 1 to 7, please rate
How satisfied were you with what you
learned and the usability of the software?
(1) Agree strongly…….(7) disagree strongly
Survey design (things to remember)
 Is there only one question in each item?
 Pilot with a number of people – do they read the
question the way it was intended?
 Are all your scales in the same direction (if not,
reverse them before analysis)
 Do the answers match the questions?
 How will you make sense of the answers
 What sort of analysis can you do on rating, frequency,
open-ended items?
 Are particular answers ‘socially desirable?’

Contenu connexe

Tendances

An Introduction to Research Methods in Education
An Introduction to Research Methods in EducationAn Introduction to Research Methods in Education
An Introduction to Research Methods in EducationEl Sameeha
 
importance of Educational research
importance of Educational researchimportance of Educational research
importance of Educational researchAbubakar Naimatkhel
 
Meaning, definitions & need of educational research.
Meaning, definitions & need of educational research.Meaning, definitions & need of educational research.
Meaning, definitions & need of educational research.Neha Deo
 
Survey Research Methodology
Survey Research Methodology Survey Research Methodology
Survey Research Methodology irshad narejo
 
Classification of educational research
Classification of educational researchClassification of educational research
Classification of educational researchVinothiniSylvia
 
E assessment
E assessmentE assessment
E assessmentMad Buny
 
Oral versus written assessments
Oral versus written assessmentsOral versus written assessments
Oral versus written assessmentsChris Willmott
 
Data collection & research instruments
Data collection & research instrumentsData collection & research instruments
Data collection & research instrumentsNia Kurniati
 
Qualitative research design in research in education
Qualitative research design in research in educationQualitative research design in research in education
Qualitative research design in research in educationRashna Asif
 
Qualitative Research Method
 Qualitative Research  Method  Qualitative Research  Method
Qualitative Research Method Kunal Modak
 
Validity and its types
Validity and its typesValidity and its types
Validity and its typesBibiNadia1
 
Experimental method of Educational Research.
Experimental method of Educational Research.Experimental method of Educational Research.
Experimental method of Educational Research.Neha Deo
 
Content analysis
Content analysisContent analysis
Content analysisHans Mallen
 
Presentation types of qualitative research
Presentation types of qualitative researchPresentation types of qualitative research
Presentation types of qualitative researchafzal39sp
 
Qualitative Research in Education
Qualitative Research in EducationQualitative Research in Education
Qualitative Research in EducationDr. Sarita Anand
 

Tendances (20)

An Introduction to Research Methods in Education
An Introduction to Research Methods in EducationAn Introduction to Research Methods in Education
An Introduction to Research Methods in Education
 
importance of Educational research
importance of Educational researchimportance of Educational research
importance of Educational research
 
Meaning, definitions & need of educational research.
Meaning, definitions & need of educational research.Meaning, definitions & need of educational research.
Meaning, definitions & need of educational research.
 
Survey Research Methodology
Survey Research Methodology Survey Research Methodology
Survey Research Methodology
 
Steps in educational research
Steps in educational researchSteps in educational research
Steps in educational research
 
Classification of educational research
Classification of educational researchClassification of educational research
Classification of educational research
 
E assessment
E assessmentE assessment
E assessment
 
Oral versus written assessments
Oral versus written assessmentsOral versus written assessments
Oral versus written assessments
 
Case study Research
Case study Research Case study Research
Case study Research
 
Data collection & research instruments
Data collection & research instrumentsData collection & research instruments
Data collection & research instruments
 
Action research
Action researchAction research
Action research
 
Qualitative research design in research in education
Qualitative research design in research in educationQualitative research design in research in education
Qualitative research design in research in education
 
Qualitative Research Method
 Qualitative Research  Method  Qualitative Research  Method
Qualitative Research Method
 
Validity and its types
Validity and its typesValidity and its types
Validity and its types
 
Experimental method of Educational Research.
Experimental method of Educational Research.Experimental method of Educational Research.
Experimental method of Educational Research.
 
Content analysis
Content analysisContent analysis
Content analysis
 
Presentation types of qualitative research
Presentation types of qualitative researchPresentation types of qualitative research
Presentation types of qualitative research
 
Qualitative Research in Education
Qualitative Research in EducationQualitative Research in Education
Qualitative Research in Education
 
Mixed method research design
Mixed method research designMixed method research design
Mixed method research design
 
Case study method in research
Case study method in researchCase study method in research
Case study method in research
 

En vedette

Research Methods in Education and Education Technology Prof Lili Saghafi Con...
Research Methods in Education and Education Technology Prof Lili Saghafi  Con...Research Methods in Education and Education Technology Prof Lili Saghafi  Con...
Research Methods in Education and Education Technology Prof Lili Saghafi Con...Professor Lili Saghafi
 
Educatonal Research Methodology Framework
Educatonal Research Methodology FrameworkEducatonal Research Methodology Framework
Educatonal Research Methodology FrameworkSt. John's University
 
Research in edu group 1
Research in edu group 1Research in edu group 1
Research in edu group 1Imam Shofwa
 
Epb3044 topic 1 research method 110912 073703
Epb3044 topic 1 research method 110912 073703Epb3044 topic 1 research method 110912 073703
Epb3044 topic 1 research method 110912 073703Macha Lala
 
Research methods course schedule
Research methods course scheduleResearch methods course schedule
Research methods course scheduleJack Powers
 
Seminar Esl Research Methods & Assessment
Seminar Esl Research Methods & AssessmentSeminar Esl Research Methods & Assessment
Seminar Esl Research Methods & Assessmentzulemar
 
Introduction to Research Methods
Introduction to Research MethodsIntroduction to Research Methods
Introduction to Research MethodsEleanor Maclure
 
Nature Of Scientific Inquiry
Nature Of Scientific InquiryNature Of Scientific Inquiry
Nature Of Scientific Inquiryhursmi
 
Lesson 10 research methods sampling and experimental design 2013
Lesson 10 research methods sampling and experimental design 2013Lesson 10 research methods sampling and experimental design 2013
Lesson 10 research methods sampling and experimental design 2013Crystal Delosa
 
Research an overview: A Tutorial PowerPoint Presentation by Ramesh Adhikari
Research an overview: A Tutorial PowerPoint Presentation by Ramesh AdhikariResearch an overview: A Tutorial PowerPoint Presentation by Ramesh Adhikari
Research an overview: A Tutorial PowerPoint Presentation by Ramesh AdhikariRamesh Adhikari
 
Nature of Inquiry and Research
Nature of Inquiry and ResearchNature of Inquiry and Research
Nature of Inquiry and ResearchDAPHNIE MONTEVERDE
 
Identifying the Inquiry and Stating the Problem
Identifying the Inquiry and Stating the ProblemIdentifying the Inquiry and Stating the Problem
Identifying the Inquiry and Stating the ProblemDAPHNIE MONTEVERDE
 
Research methods
Research methodsResearch methods
Research methodsComicspedia
 
Research Methods in Psychology Sampling and Experimental Design
Research Methods in Psychology Sampling and Experimental DesignResearch Methods in Psychology Sampling and Experimental Design
Research Methods in Psychology Sampling and Experimental DesignCrystal Delosa
 
Chapter.1
Chapter.1Chapter.1
Chapter.1jvirwin
 

En vedette (20)

Research Methods in Education and Education Technology Prof Lili Saghafi Con...
Research Methods in Education and Education Technology Prof Lili Saghafi  Con...Research Methods in Education and Education Technology Prof Lili Saghafi  Con...
Research Methods in Education and Education Technology Prof Lili Saghafi Con...
 
Educatonal Research Methodology Framework
Educatonal Research Methodology FrameworkEducatonal Research Methodology Framework
Educatonal Research Methodology Framework
 
Chapter1
Chapter1Chapter1
Chapter1
 
Research in edu group 1
Research in edu group 1Research in edu group 1
Research in edu group 1
 
Monitoring, Evaluation and Reporting
Monitoring, Evaluation and ReportingMonitoring, Evaluation and Reporting
Monitoring, Evaluation and Reporting
 
Epb3044 topic 1 research method 110912 073703
Epb3044 topic 1 research method 110912 073703Epb3044 topic 1 research method 110912 073703
Epb3044 topic 1 research method 110912 073703
 
Research methods course schedule
Research methods course scheduleResearch methods course schedule
Research methods course schedule
 
Seminar Esl Research Methods & Assessment
Seminar Esl Research Methods & AssessmentSeminar Esl Research Methods & Assessment
Seminar Esl Research Methods & Assessment
 
Introduction to Research Methods
Introduction to Research MethodsIntroduction to Research Methods
Introduction to Research Methods
 
Nature Of Scientific Inquiry
Nature Of Scientific InquiryNature Of Scientific Inquiry
Nature Of Scientific Inquiry
 
Lesson 10 research methods sampling and experimental design 2013
Lesson 10 research methods sampling and experimental design 2013Lesson 10 research methods sampling and experimental design 2013
Lesson 10 research methods sampling and experimental design 2013
 
Research an overview: A Tutorial PowerPoint Presentation by Ramesh Adhikari
Research an overview: A Tutorial PowerPoint Presentation by Ramesh AdhikariResearch an overview: A Tutorial PowerPoint Presentation by Ramesh Adhikari
Research an overview: A Tutorial PowerPoint Presentation by Ramesh Adhikari
 
Nature of Inquiry and Research
Nature of Inquiry and ResearchNature of Inquiry and Research
Nature of Inquiry and Research
 
Identifying the Inquiry and Stating the Problem
Identifying the Inquiry and Stating the ProblemIdentifying the Inquiry and Stating the Problem
Identifying the Inquiry and Stating the Problem
 
Introduction To The Research Method
Introduction To The Research MethodIntroduction To The Research Method
Introduction To The Research Method
 
Chapter 2-OVERVIEW OF RESEARCH PROCESS
Chapter 2-OVERVIEW OF RESEARCH PROCESSChapter 2-OVERVIEW OF RESEARCH PROCESS
Chapter 2-OVERVIEW OF RESEARCH PROCESS
 
Research Methods
Research MethodsResearch Methods
Research Methods
 
Research methods
Research methodsResearch methods
Research methods
 
Research Methods in Psychology Sampling and Experimental Design
Research Methods in Psychology Sampling and Experimental DesignResearch Methods in Psychology Sampling and Experimental Design
Research Methods in Psychology Sampling and Experimental Design
 
Chapter.1
Chapter.1Chapter.1
Chapter.1
 

Similaire à Introduction to Research Methods in Education

Kondas IPA IIIIIIIIIIIIIIIIIIIIIIII.pptx
Kondas IPA IIIIIIIIIIIIIIIIIIIIIIII.pptxKondas IPA IIIIIIIIIIIIIIIIIIIIIIII.pptx
Kondas IPA IIIIIIIIIIIIIIIIIIIIIIII.pptxHendrawan78
 
testconst-do-151030115824-lva1-app6892.ppt
testconst-do-151030115824-lva1-app6892.ppttestconst-do-151030115824-lva1-app6892.ppt
testconst-do-151030115824-lva1-app6892.ppttinEspiritu2
 
Active Engagement Using Classroom Response Systems - CSU Pueblo - Jeff Loats
Active Engagement Using Classroom Response Systems - CSU Pueblo - Jeff LoatsActive Engagement Using Classroom Response Systems - CSU Pueblo - Jeff Loats
Active Engagement Using Classroom Response Systems - CSU Pueblo - Jeff LoatsJeff Loats
 
Technological Problem Solving Seminar
Technological Problem Solving SeminarTechnological Problem Solving Seminar
Technological Problem Solving SeminarDavid Morrison-Love
 
3-Quantitative and Qualitative Research and principles
3-Quantitative and Qualitative  Research and principles3-Quantitative and Qualitative  Research and principles
3-Quantitative and Qualitative Research and principlesBeaOrbita1
 
JiTT - Blended Learning Across the Academy - Teaching Prof. Tech - Oct 2015
JiTT - Blended Learning Across the Academy - Teaching Prof. Tech - Oct 2015JiTT - Blended Learning Across the Academy - Teaching Prof. Tech - Oct 2015
JiTT - Blended Learning Across the Academy - Teaching Prof. Tech - Oct 2015Jeff Loats
 
Building a System of Learning and Instructional Improvement – Barbara Schneider
Building a System of Learning and Instructional Improvement – Barbara Schneider Building a System of Learning and Instructional Improvement – Barbara Schneider
Building a System of Learning and Instructional Improvement – Barbara Schneider EduSkills OECD
 
EAPRIL explanatory evaluation
EAPRIL explanatory evaluationEAPRIL explanatory evaluation
EAPRIL explanatory evaluationHenk Sligte
 
Vocce action research
Vocce action researchVocce action research
Vocce action researchThanavathi C
 
TESTA to FASTECH Presentation
TESTA to FASTECH PresentationTESTA to FASTECH Presentation
TESTA to FASTECH PresentationTansy_Jessop
 
Formulating Action Research Questions.pptx
Formulating Action Research Questions.pptxFormulating Action Research Questions.pptx
Formulating Action Research Questions.pptxQuimberlyBaspin
 
Quantifying the Effects of an Active Learning Strategy on the Motivation of S...
Quantifying the Effects of an Active Learning Strategy on the Motivation of S...Quantifying the Effects of an Active Learning Strategy on the Motivation of S...
Quantifying the Effects of an Active Learning Strategy on the Motivation of S...Zin Eddine Dadach
 
MSN5300 Advanced Nursing Inquiry.docx
                               MSN5300 Advanced Nursing Inquiry.docx                               MSN5300 Advanced Nursing Inquiry.docx
MSN5300 Advanced Nursing Inquiry.docxrobert345678
 
Review-Stats-Exp.pptx
Review-Stats-Exp.pptxReview-Stats-Exp.pptx
Review-Stats-Exp.pptxVincentMark7
 
Project-Based Learning for Theory of Knowledge (TOK)
Project-Based Learning for Theory of Knowledge (TOK)Project-Based Learning for Theory of Knowledge (TOK)
Project-Based Learning for Theory of Knowledge (TOK)jenniferjoelle
 

Similaire à Introduction to Research Methods in Education (20)

Test Construction
Test ConstructionTest Construction
Test Construction
 
Kondas IPA IIIIIIIIIIIIIIIIIIIIIIII.pptx
Kondas IPA IIIIIIIIIIIIIIIIIIIIIIII.pptxKondas IPA IIIIIIIIIIIIIIIIIIIIIIII.pptx
Kondas IPA IIIIIIIIIIIIIIIIIIIIIIII.pptx
 
testconst-do-151030115824-lva1-app6892.ppt
testconst-do-151030115824-lva1-app6892.ppttestconst-do-151030115824-lva1-app6892.ppt
testconst-do-151030115824-lva1-app6892.ppt
 
Active Engagement Using Classroom Response Systems - CSU Pueblo - Jeff Loats
Active Engagement Using Classroom Response Systems - CSU Pueblo - Jeff LoatsActive Engagement Using Classroom Response Systems - CSU Pueblo - Jeff Loats
Active Engagement Using Classroom Response Systems - CSU Pueblo - Jeff Loats
 
Technological Problem Solving Seminar
Technological Problem Solving SeminarTechnological Problem Solving Seminar
Technological Problem Solving Seminar
 
3-Quantitative and Qualitative Research and principles
3-Quantitative and Qualitative  Research and principles3-Quantitative and Qualitative  Research and principles
3-Quantitative and Qualitative Research and principles
 
JiTT - Blended Learning Across the Academy - Teaching Prof. Tech - Oct 2015
JiTT - Blended Learning Across the Academy - Teaching Prof. Tech - Oct 2015JiTT - Blended Learning Across the Academy - Teaching Prof. Tech - Oct 2015
JiTT - Blended Learning Across the Academy - Teaching Prof. Tech - Oct 2015
 
Building a System of Learning and Instructional Improvement – Barbara Schneider
Building a System of Learning and Instructional Improvement – Barbara Schneider Building a System of Learning and Instructional Improvement – Barbara Schneider
Building a System of Learning and Instructional Improvement – Barbara Schneider
 
EAPRIL explanatory evaluation
EAPRIL explanatory evaluationEAPRIL explanatory evaluation
EAPRIL explanatory evaluation
 
Vocce action research
Vocce action researchVocce action research
Vocce action research
 
surveys non experimental
surveys non experimentalsurveys non experimental
surveys non experimental
 
TESTA to FASTECH Presentation
TESTA to FASTECH PresentationTESTA to FASTECH Presentation
TESTA to FASTECH Presentation
 
Formulating Action Research Questions.pptx
Formulating Action Research Questions.pptxFormulating Action Research Questions.pptx
Formulating Action Research Questions.pptx
 
Quantifying the Effects of an Active Learning Strategy on the Motivation of S...
Quantifying the Effects of an Active Learning Strategy on the Motivation of S...Quantifying the Effects of an Active Learning Strategy on the Motivation of S...
Quantifying the Effects of an Active Learning Strategy on the Motivation of S...
 
Research Traditions 2010
Research Traditions 2010Research Traditions 2010
Research Traditions 2010
 
Action research 2013 (2)
Action research 2013 (2)Action research 2013 (2)
Action research 2013 (2)
 
MSN5300 Advanced Nursing Inquiry.docx
                               MSN5300 Advanced Nursing Inquiry.docx                               MSN5300 Advanced Nursing Inquiry.docx
MSN5300 Advanced Nursing Inquiry.docx
 
Review-Stats-Exp.pptx
Review-Stats-Exp.pptxReview-Stats-Exp.pptx
Review-Stats-Exp.pptx
 
Project-Based Learning for Theory of Knowledge (TOK)
Project-Based Learning for Theory of Knowledge (TOK)Project-Based Learning for Theory of Knowledge (TOK)
Project-Based Learning for Theory of Knowledge (TOK)
 
Methodology and IRB/URR
Methodology and IRB/URRMethodology and IRB/URR
Methodology and IRB/URR
 

Introduction to Research Methods in Education

  • 1. Introduction to Research Methods in Education Jasarat Ilyas Jokhio M.Ed. Preston University Karachi Campus.
  • 2. Research Methods  Why is it important to understand research methods for interdisciplinary researchers?  Types of research  How do you measure learning experimentally?  Within subjects design  Between subjects design  What are you measuring?  Important Statistical terms  [other methods]
  • 3. Research methods as boundary object in interdisciplinary research  Study of cross-disciplinary research collaboration (Mercier, Penuel, Remold, Villalba, Kuhl & Romo, under review)  The Bilingual Baby Project  4-year longitudinal study  Neuroscience, cognitive science, sociology  How does growing up in a bilingual environment influence cognitive development & school readiness?  Biggest issues was sample selection (methods)
  • 4. … [a child] was brought back for me to test, and I was putting [an ERP] cap on and then his mom said, well, he’s used to this from going to the neurologist … and then she told me that he has epilepsy. And I thought to myself, well, okay, I’m wasting the next two-hours because I’m not going to be able to use the data….. A quantitative researcher would never include a child that—you wouldn’t even waste the time and resources.
  • 5. It’s difficult because you do form close relationships with the families…. So it was then much harder for our group to eliminate them from the pool, which we didn’t. We have followed up, we’ve gone and interviewed her, and it would be very interesting to see what kind of school readiness skills that child has and what kind of problems that mother has encountered. I know that they wanted children who had no other disabilities in order to focus on their language acquisition, but not all children are of this type
  • 6. Two Types of Research Quantitative  Experimental  Surveys (usually) Qualitative  Biography, phenomenology, grounded theory, ethnography & case study Mixed methods  You can’t account for context with numbers  The plural of anecdote is not data
  • 7. What do you want your data & results to look like?  Do you want to show learning, engagement, the process of the activity?  Do you want to show that your tool works, or that it is better than an alternative?  Do you want to describe, code, run statistics, present a case study?  How will you design the study to get the type of results you want to present?
  • 8. How do you measure learning experimentally? Ecology lesson - Aim: to teach 5 year olds about complex systems - Ten 1-hour long sessions over 5 weeks - “Embodied curriculum” - Technology; dancing; drawing 0 1 2 3 4 5 6 7 8 9 10 Pre Post Scoreontest No way to know whether it was the curriculum, or just being taught that led to learning CLAIM: Embodied curriculum is a good way to teach complex systems
  • 9. How do you measure learning experimentally? (and know that it’s because of what you did…) Pre/post test design (within subjects)  Sequestered problem solving (SPS)  Preparation for future learning (PFL)  Free-write/free recall  Delayed post-test  Multiple baseline/single case design
  • 10. How do you measure learning experimentally? (and know that it’s because of what you did…) Control design (between subjects)  Only some of the participants receive intervention & compare post-test scores between control & experimental groups  Compare ‘experimental group’ with previous groups who did not receive intervention  Randomized control trials (the medical model)
  • 11. 2x2 design Recall Condition On Land Under water Learning condition On Land 20 20 Under Water 20 20 Godden & Baddeley (1975)
  • 12. But what are you measuring? Prerequisites for Maths Course - Is maths101 necessary to pass stats202? - Half of students had taken maths101 - All students take stats202 - Contrast outcomes 0 10 20 30 40 50 60 70 80 90 100 Maths101 No Maths101 Meanpercentonposttest Floor effect: either the post-test didn’t measure the content or very little was learned from stats202. CLAIM: No need to take maths101 before taking stats202
  • 13. But what are you measuring…  Is it valid?  Internal validity (is the effect caused by the IV)  External validity (would it replication beyond the sample)  Is it reliable?  test-retest reliability  Split-test reliability  [piloting]
  • 14. What sort of learning will you measure?
  • 15. Important statistical ideas  Independent variables  The thing you manipulate/control for  Main effects & Interaction effects between IV  Dependent variables  The outcome measure  Floor effects & ceiling effects  Statistical significance  Usually <.05 for social science  Indicates whether the effect is genuine or due to chance
  • 16. Important statistical ideas  Level of measurement  Nominal  Ordinal  Interval (& ranking)  Population & sample  Normal distribution  Descriptive statistics  Means, standard deviations, standard errors,  Parametric and non-parametric statistics
  • 17. Assumptions for parametric statistics  Level of measurement must be at least interval  Sample is drawn from a normally distributed population  Homogeneity of Variance  Variance of two samples is not significantly different  Independence of scores
  • 19. Key things to look for:  Are the differences between conditions significant:  T-tests, ANOVA, Chi Square  Is there a relationship between variables?  Correlations (note: you can’t tell causation from this)  Pay attention to r values (between 1 and -1).  Which of the IVs cause the DV?  Regression Analysis (note: need very large sample size; controversial technique)
  • 20. Survey design  In the past 24 hours, did you watch more than an hour of television programming, or not? Yes/No  In the past 24 hours, did you read a daily newspaper, or not? Yes/No  On a scale of 1 to 7, please rate How satisfied were you with what you learned and the usability of the software? (1) Agree strongly…….(7) disagree strongly
  • 21. Survey design (things to remember)  Is there only one question in each item?  Pilot with a number of people – do they read the question the way it was intended?  Are all your scales in the same direction (if not, reverse them before analysis)  Do the answers match the questions?  How will you make sense of the answers  What sort of analysis can you do on rating, frequency, open-ended items?  Are particular answers ‘socially desirable?’

Notes de l'éditeur

  1. Dancing kindergarteners