SlideShare une entreprise Scribd logo
1  sur  20
Reliability Testing for Item Analysis Dr. Debdulal Dutta Roy  , Ph.D.        Psychology Research Unit           Indian Statistical Institute          203, B.T. Road         Kolkata - 700108          E-mail:    ddroy@isical.ac.in          Fax : 91 - 33 - 25776680   Tel (o) : 91 - 33 - 2575 3454 Presentation at the Department of Clinical Psychology, Ram Chandra University, Chennai 21.2.09
Reliability Analysis ,[object Object]
Reliability Analysis
Test-Retest Reliability ,[object Object]
Test retest reliability (8 months interval) Test retest reliability of Reading Motivation Questionnaire (n=72) using both t-test and correlation coefficients 0.93** -0.27 1.01 4.5 1.05 4.46 Total     -1.41 0.38 0.83 0.44 0.74 19A     2.43 0.49 0.63 0.41 0.79 16B     0.53 0.35 0.86 0.32 0.89 14B     -0.83 0.32 0.89 0.36 0.85 4A     0 0.23 0.94 0.23 0.94 2A     -1.41 0.44 0.35 0.44 0.25 1B Knowledge 0.706 -0.23 1.01 4.86 1.14 4.82 Total     -2.99 0.26 0.93 0.42 0.78 21A     0.19 0.46 0.69 0.46 0.71 17A     -1.84 0.23 0.94 0.36 0.85 9B     1 0.28 0.92 0.2 0.96 7A     0.81 0.45 0.72 0.42 0.78 6B     1.41 0.48 0.65 0.44 0.75 1A Application Correlation t-ratio(df=71) SD Mean SD Mean         Second session First session    
Test-Retest Multi-item response ,[object Object],[object Object],Last supper: Leonardo Da Vinci
Test-Retest Multi-item response Consistency (8 months interval)
Test-Retest Multi-Trait Consistency  (8 months interval) After 8 moths Tool: Reading motivation questionnaire (Dutta Roy, 2002); N=72 students of same school
Alternate form  ,[object Object],[object Object],[object Object],[object Object],[object Object]
Split-half  ,[object Object],[object Object]
Split-half reliability  ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Split-half Canonical correlation ,[object Object]
Study: Split-half Canonical correlation ,[object Object],[object Object],[object Object]
Internal Consistency ,[object Object]
Coefficient alpha  ,[object Object],[object Object],[object Object],[object Object],[object Object]
Item-Item correspondence: Internal consistency among 42 items of Reading Motivation questionnaire Correspondence Map shows cluster of intrinsic reading motivation items and extrinsic motivation items are scattered widely.
Correspondence map of traits
Rational Equivalence  ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Reliability Coefficients of Attitude towards School Infrastructure Questionnaire (N=175) Ref: Dutta Roy,D. (2008).  Attitude towards school infrastructure in rural areas. Unpublished project report submitted to Indian Statistical Institute, P45. 0.5 10 Willingness to Participate 0.63 5 Equal Opportunity 0.68 7 Easiness 0.5 5 Reliability 0.5 12 Exploring 0.58 12 Adequacy 0.42 5 Comfort 0.68 7 Safety 0.58 5 Cleanliness Kuder Richardson’s Reliability coefficients No. of Items Attitudes
Factors influencing test scores  ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Maximize your efficiency  ,[object Object],[object Object],[object Object],[object Object]

Contenu connexe

Tendances

Reliability (assessment of student learning I)
Reliability (assessment of student learning I)Reliability (assessment of student learning I)
Reliability (assessment of student learning I)
Rey-ra Mora
 
Characteristics of a good psychological test santos
Characteristics of a good psychological test santosCharacteristics of a good psychological test santos
Characteristics of a good psychological test santos
Blessed Santos
 
RELIABILITY IN LANGUAGE TESTING-TITIN'S GROUP
RELIABILITY IN LANGUAGE TESTING-TITIN'S GROUPRELIABILITY IN LANGUAGE TESTING-TITIN'S GROUP
RELIABILITY IN LANGUAGE TESTING-TITIN'S GROUP
Titin Rohayati
 

Tendances (20)

Characteristics of a Good Test
Characteristics of a Good TestCharacteristics of a Good Test
Characteristics of a Good Test
 
Week 8 & 9 - Validity and Reliability
Week 8 & 9 - Validity and ReliabilityWeek 8 & 9 - Validity and Reliability
Week 8 & 9 - Validity and Reliability
 
Reliability bachman 1990 chapter 6
Reliability bachman 1990 chapter 6Reliability bachman 1990 chapter 6
Reliability bachman 1990 chapter 6
 
Valiadity and reliability- Language testing
Valiadity and reliability- Language testingValiadity and reliability- Language testing
Valiadity and reliability- Language testing
 
Reliability and its types: Split half method and test retest methods
Reliability and its types: Split half method and test retest methodsReliability and its types: Split half method and test retest methods
Reliability and its types: Split half method and test retest methods
 
Reliability and dependability by neil jones
Reliability and dependability by neil jonesReliability and dependability by neil jones
Reliability and dependability by neil jones
 
CMSS FIVE
CMSS FIVECMSS FIVE
CMSS FIVE
 
Reliability (assessment of student learning I)
Reliability (assessment of student learning I)Reliability (assessment of student learning I)
Reliability (assessment of student learning I)
 
Characteristics of a Good Test
Characteristics of a Good TestCharacteristics of a Good Test
Characteristics of a Good Test
 
Characteristics of a good psychological test santos
Characteristics of a good psychological test santosCharacteristics of a good psychological test santos
Characteristics of a good psychological test santos
 
Reliability for testing and assessment
Reliability for testing and assessmentReliability for testing and assessment
Reliability for testing and assessment
 
Characteristics of a good test
Characteristics  of a good testCharacteristics  of a good test
Characteristics of a good test
 
Validity of tests
Validity of testsValidity of tests
Validity of tests
 
validity its types and importance
validity its types and importancevalidity its types and importance
validity its types and importance
 
What is Reliability and its Types?
What is Reliability and its Types? What is Reliability and its Types?
What is Reliability and its Types?
 
Validity
ValidityValidity
Validity
 
Likert scale
Likert scaleLikert scale
Likert scale
 
RELIABILITY IN LANGUAGE TESTING-TITIN'S GROUP
RELIABILITY IN LANGUAGE TESTING-TITIN'S GROUPRELIABILITY IN LANGUAGE TESTING-TITIN'S GROUP
RELIABILITY IN LANGUAGE TESTING-TITIN'S GROUP
 
Content validity
Content validityContent validity
Content validity
 
Reliability in Language Testing
Reliability in Language Testing Reliability in Language Testing
Reliability in Language Testing
 

Similaire à Reliability

Applied statistics lecture_4
Applied statistics lecture_4Applied statistics lecture_4
Applied statistics lecture_4
Daria Bogdanova
 
36086 Topic Discussion3Number of Pages 2 (Double Spaced).docx
36086 Topic Discussion3Number of Pages 2 (Double Spaced).docx36086 Topic Discussion3Number of Pages 2 (Double Spaced).docx
36086 Topic Discussion3Number of Pages 2 (Double Spaced).docx
rhetttrevannion
 

Similaire à Reliability (20)

Item analysis
Item analysisItem analysis
Item analysis
 
Practical Language Testing by Fulcher (2010)
Practical Language Testing by Fulcher (2010)Practical Language Testing by Fulcher (2010)
Practical Language Testing by Fulcher (2010)
 
Stat2013
Stat2013Stat2013
Stat2013
 
3010l8.pdf
3010l8.pdf3010l8.pdf
3010l8.pdf
 
Item Response Theory in Constructing Measures
Item Response Theory in Constructing MeasuresItem Response Theory in Constructing Measures
Item Response Theory in Constructing Measures
 
DMAIC
DMAICDMAIC
DMAIC
 
Classical Test Theory (CTT)- By Dr. Jai Singh
Classical Test Theory (CTT)- By Dr. Jai SinghClassical Test Theory (CTT)- By Dr. Jai Singh
Classical Test Theory (CTT)- By Dr. Jai Singh
 
Prediction Of Bioactivity From Chemical Structure
Prediction Of Bioactivity From Chemical StructurePrediction Of Bioactivity From Chemical Structure
Prediction Of Bioactivity From Chemical Structure
 
Medical statistics2
Medical statistics2Medical statistics2
Medical statistics2
 
Applied statistics lecture_4
Applied statistics lecture_4Applied statistics lecture_4
Applied statistics lecture_4
 
Ct lecture 7. comparing two groups cont data
Ct lecture 7. comparing two groups   cont dataCt lecture 7. comparing two groups   cont data
Ct lecture 7. comparing two groups cont data
 
Quantitative Analysis: Conducting, Interpreting, & Writing
Quantitative Analysis: Conducting, Interpreting, & WritingQuantitative Analysis: Conducting, Interpreting, & Writing
Quantitative Analysis: Conducting, Interpreting, & Writing
 
Quantitative Analysis for Emperical Research
Quantitative Analysis for Emperical ResearchQuantitative Analysis for Emperical Research
Quantitative Analysis for Emperical Research
 
Chi square test
Chi square testChi square test
Chi square test
 
Designing Test Collections for Comparing Many Systems
Designing Test Collections for Comparing Many SystemsDesigning Test Collections for Comparing Many Systems
Designing Test Collections for Comparing Many Systems
 
PARAMETRIC STATISTICS .pptx
PARAMETRIC STATISTICS .pptxPARAMETRIC STATISTICS .pptx
PARAMETRIC STATISTICS .pptx
 
PHYSICS EDUCATION PRINCIPLE & EVALUATION TECHNIQUES (LARAS & NUR ASIAH)
PHYSICS EDUCATION PRINCIPLE & EVALUATION TECHNIQUES (LARAS & NUR ASIAH)PHYSICS EDUCATION PRINCIPLE & EVALUATION TECHNIQUES (LARAS & NUR ASIAH)
PHYSICS EDUCATION PRINCIPLE & EVALUATION TECHNIQUES (LARAS & NUR ASIAH)
 
Chisquare Test
Chisquare Test Chisquare Test
Chisquare Test
 
강화학습을 자연어 처리에 이용할 수 있을까? (보상의 희소성 문제와 그 방안)
강화학습을 자연어 처리에 이용할 수 있을까? (보상의 희소성 문제와 그 방안)강화학습을 자연어 처리에 이용할 수 있을까? (보상의 희소성 문제와 그 방안)
강화학습을 자연어 처리에 이용할 수 있을까? (보상의 희소성 문제와 그 방안)
 
36086 Topic Discussion3Number of Pages 2 (Double Spaced).docx
36086 Topic Discussion3Number of Pages 2 (Double Spaced).docx36086 Topic Discussion3Number of Pages 2 (Double Spaced).docx
36086 Topic Discussion3Number of Pages 2 (Double Spaced).docx
 

Plus de D Dutta Roy

Revisiting the fundamental concepts and assumptions of statistics pps
Revisiting the fundamental concepts and assumptions of statistics ppsRevisiting the fundamental concepts and assumptions of statistics pps
Revisiting the fundamental concepts and assumptions of statistics pps
D Dutta Roy
 
Paradigm shift and measurement issues of subjective well being
Paradigm shift and measurement issues of subjective well beingParadigm shift and measurement issues of subjective well being
Paradigm shift and measurement issues of subjective well being
D Dutta Roy
 
Workers Education
Workers EducationWorkers Education
Workers Education
D Dutta Roy
 
Psychiatric classificationshow
Psychiatric classificationshowPsychiatric classificationshow
Psychiatric classificationshow
D Dutta Roy
 

Plus de D Dutta Roy (20)

Inroads to consciousness
Inroads to consciousnessInroads to consciousness
Inroads to consciousness
 
Revisiting the fundamental concepts and assumptions of statistics pps
Revisiting the fundamental concepts and assumptions of statistics ppsRevisiting the fundamental concepts and assumptions of statistics pps
Revisiting the fundamental concepts and assumptions of statistics pps
 
Paradigm shift and measurement issues of subjective well being
Paradigm shift and measurement issues of subjective well beingParadigm shift and measurement issues of subjective well being
Paradigm shift and measurement issues of subjective well being
 
Data visualization in Health related research
Data visualization in Health related researchData visualization in Health related research
Data visualization in Health related research
 
Checklist research and applications
Checklist research and applicationsChecklist research and applications
Checklist research and applications
 
Problems and solution of Technology Adoption in Agriculture
Problems and solution of Technology Adoption in AgricultureProblems and solution of Technology Adoption in Agriculture
Problems and solution of Technology Adoption in Agriculture
 
Research Methodology in management
Research Methodology in management Research Methodology in management
Research Methodology in management
 
Socio cultural & socio-economic dimensions pps
Socio cultural & socio-economic dimensions ppsSocio cultural & socio-economic dimensions pps
Socio cultural & socio-economic dimensions pps
 
Happiness & Rabindrik psychotherapy
Happiness &  Rabindrik psychotherapy Happiness &  Rabindrik psychotherapy
Happiness & Rabindrik psychotherapy
 
Psychological data science
Psychological data sciencePsychological data science
Psychological data science
 
Orientation workshop on Rabindrik Psychotherapy
Orientation workshop on Rabindrik PsychotherapyOrientation workshop on Rabindrik Psychotherapy
Orientation workshop on Rabindrik Psychotherapy
 
Psychoinformatics in management
Psychoinformatics in managementPsychoinformatics in management
Psychoinformatics in management
 
Discrete data mapping
Discrete data mappingDiscrete data mapping
Discrete data mapping
 
Rabindrik psychotherapy rotary
Rabindrik psychotherapy rotaryRabindrik psychotherapy rotary
Rabindrik psychotherapy rotary
 
Clustering of Rabindrik Human Values
Clustering of Rabindrik  Human Values Clustering of Rabindrik  Human Values
Clustering of Rabindrik Human Values
 
Workers Education
Workers EducationWorkers Education
Workers Education
 
Tribal education
Tribal educationTribal education
Tribal education
 
Psychiatric classificationshow
Psychiatric classificationshowPsychiatric classificationshow
Psychiatric classificationshow
 
Box whisker show
Box whisker showBox whisker show
Box whisker show
 
Rabindrik psychotherapy
Rabindrik psychotherapyRabindrik psychotherapy
Rabindrik psychotherapy
 

Dernier

Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.
MateoGardella
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
QucHHunhnh
 
Seal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptxSeal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptx
negromaestrong
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
ciinovamais
 

Dernier (20)

Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
 
psychiatric nursing HISTORY COLLECTION .docx
psychiatric  nursing HISTORY  COLLECTION  .docxpsychiatric  nursing HISTORY  COLLECTION  .docx
psychiatric nursing HISTORY COLLECTION .docx
 
Z Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphZ Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot Graph
 
fourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writingfourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writing
 
Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1
 
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
 
ICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptx
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introduction
 
Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.
 
PROCESS RECORDING FORMAT.docx
PROCESS      RECORDING        FORMAT.docxPROCESS      RECORDING        FORMAT.docx
PROCESS RECORDING FORMAT.docx
 
Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy Consulting
 
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
 
Application orientated numerical on hev.ppt
Application orientated numerical on hev.pptApplication orientated numerical on hev.ppt
Application orientated numerical on hev.ppt
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and Mode
 
Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
 
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
 
Seal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptxSeal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptx
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
 

Reliability

  • 1. Reliability Testing for Item Analysis Dr. Debdulal Dutta Roy  , Ph.D.       Psychology Research Unit         Indian Statistical Institute        203, B.T. Road       Kolkata - 700108        E-mail:    ddroy@isical.ac.in        Fax : 91 - 33 - 25776680 Tel (o) : 91 - 33 - 2575 3454 Presentation at the Department of Clinical Psychology, Ram Chandra University, Chennai 21.2.09
  • 2.
  • 4.
  • 5. Test retest reliability (8 months interval) Test retest reliability of Reading Motivation Questionnaire (n=72) using both t-test and correlation coefficients 0.93** -0.27 1.01 4.5 1.05 4.46 Total     -1.41 0.38 0.83 0.44 0.74 19A     2.43 0.49 0.63 0.41 0.79 16B     0.53 0.35 0.86 0.32 0.89 14B     -0.83 0.32 0.89 0.36 0.85 4A     0 0.23 0.94 0.23 0.94 2A     -1.41 0.44 0.35 0.44 0.25 1B Knowledge 0.706 -0.23 1.01 4.86 1.14 4.82 Total     -2.99 0.26 0.93 0.42 0.78 21A     0.19 0.46 0.69 0.46 0.71 17A     -1.84 0.23 0.94 0.36 0.85 9B     1 0.28 0.92 0.2 0.96 7A     0.81 0.45 0.72 0.42 0.78 6B     1.41 0.48 0.65 0.44 0.75 1A Application Correlation t-ratio(df=71) SD Mean SD Mean         Second session First session    
  • 6.
  • 7. Test-Retest Multi-item response Consistency (8 months interval)
  • 8. Test-Retest Multi-Trait Consistency (8 months interval) After 8 moths Tool: Reading motivation questionnaire (Dutta Roy, 2002); N=72 students of same school
  • 9.
  • 10.
  • 11.
  • 12.
  • 13.
  • 14.
  • 15.
  • 16. Item-Item correspondence: Internal consistency among 42 items of Reading Motivation questionnaire Correspondence Map shows cluster of intrinsic reading motivation items and extrinsic motivation items are scattered widely.
  • 18.
  • 19.
  • 20.