SlideShare une entreprise Scribd logo
1  sur  24
MAKING MEASURES FOR ACCURATE INFERENCES MONIQUE BIJKER MARCEL VAN DER KLINK ELS BOSHUIZEN CELSTEC, OPEN UNIVERSITY OF THE NETHERLANDS
OVERVIEW ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
PRACTICAL BACKGROUND ,[object Object]
TOWER OF BABEL ,[object Object],[object Object],[object Object],[object Object],[object Object]
VAGUENESS ,[object Object],[object Object]
FINDINGS BASED ON LITERATURE ,[object Object],[object Object],[object Object]
FINDINGS BASED ON LITERATURE ,[object Object],[object Object],[object Object],[object Object],[object Object]
UNADDRESSED QUESTIONS ,[object Object],[object Object],[object Object]
APPROACH ,[object Object],[object Object],[object Object],[object Object],[object Object]
WHY THE RASCH MODEL? ,[object Object],[object Object],[object Object],[object Object],[object Object]
SCALE DISTANCES AND ITEM CONTRIBUTIONS
OTHER PROBLEMS: DISORDERED THRESHOLDS
FORMULA  ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
DATA  COLLECTION ,[object Object],[object Object],[object Object]
RESULTS ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
SCALES SUCH AS TSE tem Infit Outfit Measure Error PTMEA Miscellaneous 83 and 84 are similar in ES and Psy. 80  is different in ES and Psy.  77 .82 .84 1.86 .13 .57 80 1.29 1.27 1.03 .14 .42 72 .74 .74 .90 .14 .70 84 .98 .91 .51A .14 .60 70 .64 .64 .22A .15 .69 71 .77 .75 .09A .15 .72 83 .99 .94 -.41A .15 .70 73 1.13 1.07 -1.10A .15 .54 78 .88 .82 -1.16 .15 .74 All items Mean .91 .89 .21 .15 Person Reliability .79 SD. .19 .18 .94 .01 Person Separation 1.91 All persons Item Reliability .97 Mean .89 .89 1.62 .62 Item Separation 6.24 SD .64 .64 1.35 .11 Cronbach alpha .82 Average measures 1  2  3  4  5  -1.96  -.61  .58  2.37  4.10 Step calibration measures -3.79  -1.95  1.19  4.55
 
 
 
 
Implications for practice ,[object Object],[object Object],[object Object]
Implications for future research ,[object Object],[object Object],[object Object],[object Object]
Rude questions…  ,[object Object],[object Object],[object Object]
THANK YOU FOR YOUR ATTENTION.  Any questions? [email_address]

Contenu connexe

Tendances

Supervised Corpus-based Methods for Word Sense Disambiguation
Supervised Corpus-based Methods for Word Sense DisambiguationSupervised Corpus-based Methods for Word Sense Disambiguation
Supervised Corpus-based Methods for Word Sense Disambiguation
butest
 
Non experimental%20 quantitative%20research%20designs-1
Non experimental%20 quantitative%20research%20designs-1Non experimental%20 quantitative%20research%20designs-1
Non experimental%20 quantitative%20research%20designs-1
jhtrespa
 
Week 4 variables and designs
Week 4 variables and designsWeek 4 variables and designs
Week 4 variables and designs
wawaaa789
 
construct and variables in research methodology
 construct and variables in research methodology construct and variables in research methodology
construct and variables in research methodology
Lavina Singh
 
Research Methodology (MBA II SEM) - Introduction to SPSS
Research Methodology (MBA II SEM) - Introduction to SPSSResearch Methodology (MBA II SEM) - Introduction to SPSS
Research Methodology (MBA II SEM) - Introduction to SPSS
GB Technical University
 
The application of irt using the rasch model presnetation1
The application of irt using the rasch model presnetation1The application of irt using the rasch model presnetation1
The application of irt using the rasch model presnetation1
Carlo Magno
 
Kinds Of Variables Kato Begum
Kinds Of Variables Kato BegumKinds Of Variables Kato Begum
Kinds Of Variables Kato Begum
Dr. Cupid Lucid
 

Tendances (20)

Conceptualization, operationalization and measurement
Conceptualization, operationalization and measurementConceptualization, operationalization and measurement
Conceptualization, operationalization and measurement
 
Supervised Corpus-based Methods for Word Sense Disambiguation
Supervised Corpus-based Methods for Word Sense DisambiguationSupervised Corpus-based Methods for Word Sense Disambiguation
Supervised Corpus-based Methods for Word Sense Disambiguation
 
Non experimental%20 quantitative%20research%20designs-1
Non experimental%20 quantitative%20research%20designs-1Non experimental%20 quantitative%20research%20designs-1
Non experimental%20 quantitative%20research%20designs-1
 
Week 4 variables and designs
Week 4 variables and designsWeek 4 variables and designs
Week 4 variables and designs
 
Research: Chapter One
Research: Chapter OneResearch: Chapter One
Research: Chapter One
 
Results, Discussion, APA Editing, and Defense
Results, Discussion, APA Editing, and DefenseResults, Discussion, APA Editing, and Defense
Results, Discussion, APA Editing, and Defense
 
A New Theory of Classification and Feature Inference Learning: An Exemplar Fr...
A New Theory of Classification and Feature Inference Learning: An Exemplar Fr...A New Theory of Classification and Feature Inference Learning: An Exemplar Fr...
A New Theory of Classification and Feature Inference Learning: An Exemplar Fr...
 
Graduate Paper--Hierarchical clustring and topology for psychometrics paper
Graduate Paper--Hierarchical clustring and topology for psychometrics paperGraduate Paper--Hierarchical clustring and topology for psychometrics paper
Graduate Paper--Hierarchical clustring and topology for psychometrics paper
 
IRT in Test Construction
IRT in Test Construction IRT in Test Construction
IRT in Test Construction
 
construct and variables in research methodology
 construct and variables in research methodology construct and variables in research methodology
construct and variables in research methodology
 
Research Process | Step By Step | Variables In Research |
Research Process | Step By Step | Variables In Research |Research Process | Step By Step | Variables In Research |
Research Process | Step By Step | Variables In Research |
 
Operational definitions
Operational definitionsOperational definitions
Operational definitions
 
NCME_040916
NCME_040916NCME_040916
NCME_040916
 
Research Methodology (MBA II SEM) - Introduction to SPSS
Research Methodology (MBA II SEM) - Introduction to SPSSResearch Methodology (MBA II SEM) - Introduction to SPSS
Research Methodology (MBA II SEM) - Introduction to SPSS
 
In the classroom; a summary dialogue
In the classroom; a summary dialogueIn the classroom; a summary dialogue
In the classroom; a summary dialogue
 
Operational definition
Operational definitionOperational definition
Operational definition
 
The application of irt using the rasch model presnetation1
The application of irt using the rasch model presnetation1The application of irt using the rasch model presnetation1
The application of irt using the rasch model presnetation1
 
Variable
VariableVariable
Variable
 
Kinds Of Variables Kato Begum
Kinds Of Variables Kato BegumKinds Of Variables Kato Begum
Kinds Of Variables Kato Begum
 
Theoratical framework & variables
Theoratical framework & variablesTheoratical framework & variables
Theoratical framework & variables
 

En vedette

Rasch Model Theorem_Scale Construct
Rasch Model Theorem_Scale ConstructRasch Model Theorem_Scale Construct
Rasch Model Theorem_Scale Construct
Saidfudin Mas'udi
 
1a Introduction To Rasch Measurement Model Msm
1a Introduction To Rasch Measurement Model Msm1a Introduction To Rasch Measurement Model Msm
1a Introduction To Rasch Measurement Model Msm
Saidfudin Mas'udi
 
Comparison of therapist to patient judgment bias in low vision
Comparison of therapist to patient judgment bias in low visionComparison of therapist to patient judgment bias in low vision
Comparison of therapist to patient judgment bias in low vision
Guy Davis
 
Marketing Research Ppt
Marketing Research PptMarketing Research Ppt
Marketing Research Ppt
Vivek Sharma
 
IRT - Item response Theory
IRT - Item response TheoryIRT - Item response Theory
IRT - Item response Theory
Ajay Dhamija
 
6 measurement & scaling
6  measurement & scaling6  measurement & scaling
6 measurement & scaling
arjeskay
 
9 steps of the performance appraisal process
9 steps of the performance appraisal process9 steps of the performance appraisal process
9 steps of the performance appraisal process
PerformanceAppraisal123
 

En vedette (20)

Paintings Slideshow
Paintings Slideshow Paintings Slideshow
Paintings Slideshow
 
Bateman eq5 d_for uk rasch user group 2014
Bateman eq5 d_for uk rasch user group 2014Bateman eq5 d_for uk rasch user group 2014
Bateman eq5 d_for uk rasch user group 2014
 
Building face and content validity into health outcome measures in the contex...
Building face and content validity into health outcome measures in the contex...Building face and content validity into health outcome measures in the contex...
Building face and content validity into health outcome measures in the contex...
 
Ad Connect Brochure
Ad Connect BrochureAd Connect Brochure
Ad Connect Brochure
 
Rasch Model Theorem_Scale Construct
Rasch Model Theorem_Scale ConstructRasch Model Theorem_Scale Construct
Rasch Model Theorem_Scale Construct
 
Applied Psych Test Design: Part C - Use of Rasch scaling technology
Applied Psych Test Design: Part C - Use of Rasch scaling technologyApplied Psych Test Design: Part C - Use of Rasch scaling technology
Applied Psych Test Design: Part C - Use of Rasch scaling technology
 
1a Introduction To Rasch Measurement Model Msm
1a Introduction To Rasch Measurement Model Msm1a Introduction To Rasch Measurement Model Msm
1a Introduction To Rasch Measurement Model Msm
 
RIT 101: Understanding Scores From MAP
RIT 101: Understanding Scores From MAPRIT 101: Understanding Scores From MAP
RIT 101: Understanding Scores From MAP
 
Comparison of therapist to patient judgment bias in low vision
Comparison of therapist to patient judgment bias in low visionComparison of therapist to patient judgment bias in low vision
Comparison of therapist to patient judgment bias in low vision
 
The Well-EQUIPped Classroom: Using the Electronic Quality of Inquiry Protocol...
The Well-EQUIPped Classroom: Using the Electronic Quality of Inquiry Protocol...The Well-EQUIPped Classroom: Using the Electronic Quality of Inquiry Protocol...
The Well-EQUIPped Classroom: Using the Electronic Quality of Inquiry Protocol...
 
Performance Assessments with MFRM
Performance Assessments with MFRMPerformance Assessments with MFRM
Performance Assessments with MFRM
 
Developing an in-house speaking assessment: Rasch analysis for action research
Developing an in-house speaking assessment: Rasch analysis for action researchDeveloping an in-house speaking assessment: Rasch analysis for action research
Developing an in-house speaking assessment: Rasch analysis for action research
 
Sub-skills in reading comprehension tests
Sub-skills in reading comprehension testsSub-skills in reading comprehension tests
Sub-skills in reading comprehension tests
 
Scaling agility - Story of a chicken
Scaling agility - Story of a chickenScaling agility - Story of a chicken
Scaling agility - Story of a chicken
 
Marketing Research Ppt
Marketing Research PptMarketing Research Ppt
Marketing Research Ppt
 
Item Response Theory in Constructing Measures
Item Response Theory in Constructing MeasuresItem Response Theory in Constructing Measures
Item Response Theory in Constructing Measures
 
Performance appraisal
Performance appraisalPerformance appraisal
Performance appraisal
 
IRT - Item response Theory
IRT - Item response TheoryIRT - Item response Theory
IRT - Item response Theory
 
6 measurement & scaling
6  measurement & scaling6  measurement & scaling
6 measurement & scaling
 
9 steps of the performance appraisal process
9 steps of the performance appraisal process9 steps of the performance appraisal process
9 steps of the performance appraisal process
 

Similaire à Bijker, M. (2010) Making Measures And Inferences Reserve

KatKennedy REU D.C. Poster
KatKennedy REU D.C. PosterKatKennedy REU D.C. Poster
KatKennedy REU D.C. Poster
Katlynn Kennedy
 
Personalized Learning_1.pptx
Personalized Learning_1.pptxPersonalized Learning_1.pptx
Personalized Learning_1.pptx
WillSoo1
 
An Adaptive Evaluation System to Test Student Caliber using Item Response Theory
An Adaptive Evaluation System to Test Student Caliber using Item Response TheoryAn Adaptive Evaluation System to Test Student Caliber using Item Response Theory
An Adaptive Evaluation System to Test Student Caliber using Item Response Theory
Editor IJMTER
 

Similaire à Bijker, M. (2010) Making Measures And Inferences Reserve (20)

KatKennedy REU D.C. Poster
KatKennedy REU D.C. PosterKatKennedy REU D.C. Poster
KatKennedy REU D.C. Poster
 
A Non-Technical Approach for Illustrating Item Response Theory
A Non-Technical Approach for Illustrating Item Response TheoryA Non-Technical Approach for Illustrating Item Response Theory
A Non-Technical Approach for Illustrating Item Response Theory
 
EAPRIL 2012: Competencies for the Contemporary Career
EAPRIL 2012: Competencies for the Contemporary CareerEAPRIL 2012: Competencies for the Contemporary Career
EAPRIL 2012: Competencies for the Contemporary Career
 
Test equating using irt. final
Test equating using irt. finalTest equating using irt. final
Test equating using irt. final
 
LENGUAGE TESTING (II Bimestre Abril Agosto 2011)
LENGUAGE TESTING (II Bimestre Abril Agosto 2011)LENGUAGE TESTING (II Bimestre Abril Agosto 2011)
LENGUAGE TESTING (II Bimestre Abril Agosto 2011)
 
A New Concurrent Calibration Method For Nonequivalent Group Design Under Nonr...
A New Concurrent Calibration Method For Nonequivalent Group Design Under Nonr...A New Concurrent Calibration Method For Nonequivalent Group Design Under Nonr...
A New Concurrent Calibration Method For Nonequivalent Group Design Under Nonr...
 
Angelie
AngelieAngelie
Angelie
 
Lecture 07
Lecture 07Lecture 07
Lecture 07
 
Revised_Motivated_Strategies_for_Learnin.pdf
Revised_Motivated_Strategies_for_Learnin.pdfRevised_Motivated_Strategies_for_Learnin.pdf
Revised_Motivated_Strategies_for_Learnin.pdf
 
Personalized Learning_1.pptx
Personalized Learning_1.pptxPersonalized Learning_1.pptx
Personalized Learning_1.pptx
 
The Implementation of Structural Equation Modelling Partial Least Squares (SE...
The Implementation of Structural Equation Modelling Partial Least Squares (SE...The Implementation of Structural Equation Modelling Partial Least Squares (SE...
The Implementation of Structural Equation Modelling Partial Least Squares (SE...
 
EDUC8102-6 MD7Assgn4: Research Application Paper #1.
EDUC8102-6 MD7Assgn4: Research Application Paper #1. EDUC8102-6 MD7Assgn4: Research Application Paper #1.
EDUC8102-6 MD7Assgn4: Research Application Paper #1.
 
Assessment For Learning In Immersive And Virtual Environments Evidence-Cent...
Assessment For Learning In Immersive And Virtual Environments   Evidence-Cent...Assessment For Learning In Immersive And Virtual Environments   Evidence-Cent...
Assessment For Learning In Immersive And Virtual Environments Evidence-Cent...
 
Changing issues, changing questions, changing approaches: An overview of rese...
Changing issues, changing questions, changing approaches: An overview of rese...Changing issues, changing questions, changing approaches: An overview of rese...
Changing issues, changing questions, changing approaches: An overview of rese...
 
Research Methodology in management
Research Methodology in management Research Methodology in management
Research Methodology in management
 
Journal raganit santos
Journal raganit santosJournal raganit santos
Journal raganit santos
 
Multi Criteria Decision Making Methodology on Selection of a Student for All ...
Multi Criteria Decision Making Methodology on Selection of a Student for All ...Multi Criteria Decision Making Methodology on Selection of a Student for All ...
Multi Criteria Decision Making Methodology on Selection of a Student for All ...
 
A Theory-Based Framework For Assessing Domainl-Specific Problem-Solving Ability
A Theory-Based Framework For Assessing Domainl-Specific Problem-Solving AbilityA Theory-Based Framework For Assessing Domainl-Specific Problem-Solving Ability
A Theory-Based Framework For Assessing Domainl-Specific Problem-Solving Ability
 
An Adaptive Evaluation System to Test Student Caliber using Item Response Theory
An Adaptive Evaluation System to Test Student Caliber using Item Response TheoryAn Adaptive Evaluation System to Test Student Caliber using Item Response Theory
An Adaptive Evaluation System to Test Student Caliber using Item Response Theory
 
On the Use of the Causal Analysis in Small Type Fit Indices of Adult Mathemat...
On the Use of the Causal Analysis in Small Type Fit Indices of Adult Mathemat...On the Use of the Causal Analysis in Small Type Fit Indices of Adult Mathemat...
On the Use of the Causal Analysis in Small Type Fit Indices of Adult Mathemat...
 

Bijker, M. (2010) Making Measures And Inferences Reserve

  • 1. MAKING MEASURES FOR ACCURATE INFERENCES MONIQUE BIJKER MARCEL VAN DER KLINK ELS BOSHUIZEN CELSTEC, OPEN UNIVERSITY OF THE NETHERLANDS
  • 2.
  • 3.
  • 4.
  • 5.
  • 6.
  • 7.
  • 8.
  • 9.
  • 10.
  • 11. SCALE DISTANCES AND ITEM CONTRIBUTIONS
  • 13.
  • 14.
  • 15.
  • 16. SCALES SUCH AS TSE tem Infit Outfit Measure Error PTMEA Miscellaneous 83 and 84 are similar in ES and Psy. 80 is different in ES and Psy. 77 .82 .84 1.86 .13 .57 80 1.29 1.27 1.03 .14 .42 72 .74 .74 .90 .14 .70 84 .98 .91 .51A .14 .60 70 .64 .64 .22A .15 .69 71 .77 .75 .09A .15 .72 83 .99 .94 -.41A .15 .70 73 1.13 1.07 -1.10A .15 .54 78 .88 .82 -1.16 .15 .74 All items Mean .91 .89 .21 .15 Person Reliability .79 SD. .19 .18 .94 .01 Person Separation 1.91 All persons Item Reliability .97 Mean .89 .89 1.62 .62 Item Separation 6.24 SD .64 .64 1.35 .11 Cronbach alpha .82 Average measures 1 2 3 4 5 -1.96 -.61 .58 2.37 4.10 Step calibration measures -3.79 -1.95 1.19 4.55
  • 17.  
  • 18.  
  • 19.  
  • 20.  
  • 21.
  • 22.
  • 23.
  • 24. THANK YOU FOR YOUR ATTENTION. Any questions? [email_address]