SlideShare une entreprise Scribd logo
1  sur  20
VALIDITY & RELIABILITY
ACCURACY OF SELECTION METHODS
            PREDICTED VALIDITY

100       PERFECT PREDICTION
90
          ASSESSMENT CENTRES/ SAMPLE TEST
80
          ABILITY TESTS
70
          PERSONALITY TESTS (COMBINATION)
60
          BIODATA
50
          STRUCTURED INTERVIEWS
40
          TYPICAL INTERVIEWS
30
          REFERENCES
20
          ASTROLOGY
10
          READING HANDS
0
                CHANCE PREDICTION
The Effectiveness of Personnel
                         Selection     Legal
                                                                            Reacti
                  Method              Validity    Cost      Defensibility
                                                                             on

                                                   Low
Application blanks                      Low                      ?          Neutral

Weighted application                    High       High         High        Neutral
                                        High
Biographical/Interest blanks                     Moderate        ?          Negative

                                        Low
Letters of recommendation                          Low          Low         Positive

                                        High
Cognitive ability tests                            Low          High        Negative

                                        High
Job knowledge tests                                High         High        Positive

                                        High
Performance tests/work samples                     High         High        Positive

                                        High
Assessment Centers                                 High         Low         Positive

Interviews_unstructured; one rater      Low        Low          High        Negative
Structured interviews Behavioral or
situational                             High       High         High        Positive
GENERIC STANDARDS

• VALIDITY
• RELIABILITY
• UTILITY
• LEGALITY
• IMPACT or FACE
  VALIDITY
LEGALITY
• Conform to the laws of the country.
  – Discriminatory regulations
  – Avoid adverse effects on groups
  – Age restrictions
  – Disability Quota
  – Avoid litigations later
UTILITY
• Degree to which the bottom line is effected
  by selection methods
  – Increase the probability of acceptance ratio.
  – Turnover types. Eg strong or weak
    performers.
  – Type of job: greater utility for higher revenue
    jobs/ difficult jobs.
VALIDITY
“The Extent To Which A
 Performance Measure Assesses
 All The Relevant-and Only The
 Relevant-aspects Of Job
 Performance.”
CONTENT VALIDATION
A Test-validation Strategy Performed
“
     By Demonstrating That The Items,
     Questions, Or Problems Posed By A
    Test Are A Representative Sample Of
    The Kinds Of Situations Or Problems
          That Occur On The Job.”
CRITERION-RELATED
         VALIDITY

A Method Of Establishing The
“
Validity Of A Personnel Selection
Method By Showing A Substantial
Correlation Between Test Scores
 And Job-performance Scores.”
Methods for calculating validity
• Content validity
  – expert judgment
  – Content validation ratio
  Criterion Validity
    Predictive Validity
    Concurrent Validity
  Expressed in coefficient co-relation from – 1 to
   +1
HOW VALIDATE
•   Analyze the job
•   Choose the tests
•   Administer the test
•   Relate the test scores and criteria
•   Prepare an Expectancy Chart
•   Cross validate and Revalidite
Measure all               Concurrent Validation
                                                   current job
                                                 incumbents on
                                                    attribute
                                                                                    Obtain correlation
                                                                                   between these two
                                                  Measure all
                                                                                     sets of numbers
                                                  current job
           Graphic Depiction of Concurrent and
                                                   incumbents’
                                                  performance
              Predictive Validation Designs


                                                 Measure all job             Predictive Validation
                                                 applications on
                                                   attribute


                                                    Hire some
                                                  applicants and
                                                  reject others
                                                                                    Obtain correlation
                                                                                   between these two
                                                 Wait for some                       sets of numbers
                                                  time period


                                                 Measure all newly
                                                        hired job
09/21/12                                              incumbents’
                                                                Know more!                               13
                                                     performance
Employee Testing and Selection

                  (Highest 20%) 57-64                                                             97



              (Next highest 20%) 51-56                                                       84
Test Scores




                  (Middle 20%) 45-50                                               71



              (Next lowest 20%) 37-44                                     55



                  (Lowest 20%) 11-36                    29



                                    0             20           40          60           80        100

                                        Chances in a hundred of being rated a ”high performer”; and %
                                           of “ high performers” found in each test score group
RELIABILITY
“The Consistency Of A
 Performance Measure; The
 Degree To Which A
 Performance Measure Is
 Free From Random Error”.
METHODS FOR ESTB
           RELIABILITY
•   1. Test retest
•   2. Spilt-Half
•   3. Parallel test
•   4. Calculate Test’s reliability
•   5. Calculate Standard deviation
ACCURACY OF SELECTION METHODS
            PREDICTED VALIDITY

100       PERFECT PREDICTION
90
          ASSESSMENT CENTRES/ SAMPLE TEST
80
          ABILITY TESTS
70
          PERSONALITY TESTS (COMBINATION)
60
          BIODATA
50
          STRUCTURED INTERVIEWS
40
          TYPICAL INTERVIEWS
30
          REFERENCES
20
          ASTROLOGY
10
          READING HANDS
0
                CHANCE PREDICTION
Selection ratio

                              High




                                                                                                                   Base rate
                                             D: False
                                                                                                 A: True
            Satisfactory                    negatives
                                                                                                Positives
Performance
 cutoff score




                      Job Behaviors




  Unsatisfactory




                                                        C: True                                B: False
                                                      negatives                                Positives
                                Low

                                      Low                    Selection procedure scores                   High
                                               Unqualified                                Qualified
                                                                Selection cutoff score
Validity Correlation Analysis after Cut Scores are Lowered
 Satisfactory
                                        D              C
        Performance
            Job




                                        E




Unsatisfactory
                      0         50       70
                      Lo       Test
                      w        score
Validity Correlation Analysis after Cut Scores are Highered
 Satisfactory
                                        D             C



                                                             A


                                                              B
        Performance
            Job




                                        E




Unsatisfactory
                      0         50      70           98-100
                      Lo       Test
                                                      High
                      w        score

Contenu connexe

Similaire à Tests and validity spr 2012

Characteristics of a good test
Characteristics of a good testCharacteristics of a good test
Characteristics of a good test
Boyet Aluan
 
Reliability
ReliabilityReliability
Reliability
Roi Xcel
 
The audacity of quality requirement-non functional testing- Aware in BugDay B...
The audacity of quality requirement-non functional testing- Aware in BugDay B...The audacity of quality requirement-non functional testing- Aware in BugDay B...
The audacity of quality requirement-non functional testing- Aware in BugDay B...
Prathan Dansakulcharoenkit
 
Chapter 6 - Standardized Measurement & Assessment
Chapter 6 - Standardized Measurement & AssessmentChapter 6 - Standardized Measurement & Assessment
Chapter 6 - Standardized Measurement & Assessment
kjhatzi
 
Performance appraisal
Performance appraisalPerformance appraisal
Performance appraisal
Vishy Vincent
 
Chapter 6 Employee Testing and Selection
Chapter 6 Employee Testing and SelectionChapter 6 Employee Testing and Selection
Chapter 6 Employee Testing and Selection
Ti UtIt
 
Ppt performance appraisal
Ppt performance appraisalPpt performance appraisal
Ppt performance appraisal
divyaactive
 

Similaire à Tests and validity spr 2012 (20)

Characteristics of a good test
Characteristics of a good testCharacteristics of a good test
Characteristics of a good test
 
Reliability
ReliabilityReliability
Reliability
 
Tests and characteristics spr 2012
Tests and characteristics spr 2012Tests and characteristics spr 2012
Tests and characteristics spr 2012
 
Public schools presentation
Public schools presentationPublic schools presentation
Public schools presentation
 
The audacity of quality requirement-non functional testing- Aware in BugDay B...
The audacity of quality requirement-non functional testing- Aware in BugDay B...The audacity of quality requirement-non functional testing- Aware in BugDay B...
The audacity of quality requirement-non functional testing- Aware in BugDay B...
 
Chapter 6 - Standardized Measurement & Assessment
Chapter 6 - Standardized Measurement & AssessmentChapter 6 - Standardized Measurement & Assessment
Chapter 6 - Standardized Measurement & Assessment
 
Hr performance appraisal
Hr performance appraisalHr performance appraisal
Hr performance appraisal
 
Outcomes in Occupational Therapy (& Assistive Technology)
Outcomes in Occupational Therapy (& Assistive Technology)Outcomes in Occupational Therapy (& Assistive Technology)
Outcomes in Occupational Therapy (& Assistive Technology)
 
Performance appraisal
Performance appraisalPerformance appraisal
Performance appraisal
 
Performance appraisal
Performance appraisalPerformance appraisal
Performance appraisal
 
Chapter 6 Employee Testing and Selection
Chapter 6 Employee Testing and SelectionChapter 6 Employee Testing and Selection
Chapter 6 Employee Testing and Selection
 
ISTQB / ISEB Foundation Exam Practice - 4
ISTQB / ISEB Foundation Exam Practice - 4ISTQB / ISEB Foundation Exam Practice - 4
ISTQB / ISEB Foundation Exam Practice - 4
 
SwissQ Testing Trends & Benchmarks 2012 (Englisch)
 SwissQ Testing Trends & Benchmarks 2012 (Englisch) SwissQ Testing Trends & Benchmarks 2012 (Englisch)
SwissQ Testing Trends & Benchmarks 2012 (Englisch)
 
Integrated methodology for testing and quality management.
Integrated methodology for testing and quality management.Integrated methodology for testing and quality management.
Integrated methodology for testing and quality management.
 
Panel Debate - Rating Agencies and Risk Management
Panel Debate - Rating Agencies and Risk Management Panel Debate - Rating Agencies and Risk Management
Panel Debate - Rating Agencies and Risk Management
 
Ppt performance appraisal
Ppt performance appraisalPpt performance appraisal
Ppt performance appraisal
 
Testing review-3
Testing review-3Testing review-3
Testing review-3
 
Chapter 5
Chapter 5Chapter 5
Chapter 5
 
Testing in language programs (chapter 8)
Testing in language programs (chapter 8)Testing in language programs (chapter 8)
Testing in language programs (chapter 8)
 
Sample work test
Sample work testSample work test
Sample work test
 

Plus de Laiqa Ahmed

Compensation and benefits
Compensation and benefitsCompensation and benefits
Compensation and benefits
Laiqa Ahmed
 
Compensation and benefits
Compensation and benefitsCompensation and benefits
Compensation and benefits
Laiqa Ahmed
 
Does brand extension impact parent brand
Does brand extension impact parent brandDoes brand extension impact parent brand
Does brand extension impact parent brand
Laiqa Ahmed
 
Factors influencing successful brand extensions
Factors influencing successful brand extensionsFactors influencing successful brand extensions
Factors influencing successful brand extensions
Laiqa Ahmed
 

Plus de Laiqa Ahmed (20)

Chapter 8
Chapter 8Chapter 8
Chapter 8
 
Chapter 7
Chapter 7Chapter 7
Chapter 7
 
Chapter 6
Chapter 6Chapter 6
Chapter 6
 
Chapter 5
Chapter 5Chapter 5
Chapter 5
 
Chapter 4
Chapter 4Chapter 4
Chapter 4
 
Chapter 3
Chapter 3Chapter 3
Chapter 3
 
Compensation and benefits
Compensation and benefitsCompensation and benefits
Compensation and benefits
 
Job evaluation
Job evaluationJob evaluation
Job evaluation
 
Job evaluation
Job evaluationJob evaluation
Job evaluation
 
Compensation and benefits
Compensation and benefitsCompensation and benefits
Compensation and benefits
 
Strat rect planning spr 2012
Strat rect planning  spr 2012Strat rect planning  spr 2012
Strat rect planning spr 2012
 
Short rect and sel spr 2012
Short rect and sel spr 2012Short rect and sel spr 2012
Short rect and sel spr 2012
 
Rect sel human resource planning spr 2012
Rect sel  human resource planning spr 2012Rect sel  human resource planning spr 2012
Rect sel human resource planning spr 2012
 
Rect and sel -interviews spr 2012
Rect and sel  -interviews spr 2012Rect and sel  -interviews spr 2012
Rect and sel -interviews spr 2012
 
Rect & sel job analysis
Rect & sel   job analysisRect & sel   job analysis
Rect & sel job analysis
 
Manpower analysis spr 2012
Manpower analysis spr 2012Manpower analysis spr 2012
Manpower analysis spr 2012
 
Rect & selection (intro)
Rect & selection (intro)Rect & selection (intro)
Rect & selection (intro)
 
Does brand extension impact parent brand
Does brand extension impact parent brandDoes brand extension impact parent brand
Does brand extension impact parent brand
 
Factors influencing successful brand extensions
Factors influencing successful brand extensionsFactors influencing successful brand extensions
Factors influencing successful brand extensions
 
Chapter 14
Chapter 14Chapter 14
Chapter 14
 

Dernier

Dernier (20)

Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdfLinux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
 
How Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdf
How Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdfHow Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdf
How Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdf
 
Strategic AI Integration in Engineering Teams
Strategic AI Integration in Engineering TeamsStrategic AI Integration in Engineering Teams
Strategic AI Integration in Engineering Teams
 
Syngulon - Selection technology May 2024.pdf
Syngulon - Selection technology May 2024.pdfSyngulon - Selection technology May 2024.pdf
Syngulon - Selection technology May 2024.pdf
 
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
 
Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)
Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)
Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)
 
Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdf
Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdfSimplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdf
Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdf
 
SOQL 201 for Admins & Developers: Slice & Dice Your Org’s Data With Aggregate...
SOQL 201 for Admins & Developers: Slice & Dice Your Org’s Data With Aggregate...SOQL 201 for Admins & Developers: Slice & Dice Your Org’s Data With Aggregate...
SOQL 201 for Admins & Developers: Slice & Dice Your Org’s Data With Aggregate...
 
WSO2CONMay2024OpenSourceConferenceDebrief.pptx
WSO2CONMay2024OpenSourceConferenceDebrief.pptxWSO2CONMay2024OpenSourceConferenceDebrief.pptx
WSO2CONMay2024OpenSourceConferenceDebrief.pptx
 
WebAssembly is Key to Better LLM Performance
WebAssembly is Key to Better LLM PerformanceWebAssembly is Key to Better LLM Performance
WebAssembly is Key to Better LLM Performance
 
Salesforce Adoption – Metrics, Methods, and Motivation, Antone Kom
Salesforce Adoption – Metrics, Methods, and Motivation, Antone KomSalesforce Adoption – Metrics, Methods, and Motivation, Antone Kom
Salesforce Adoption – Metrics, Methods, and Motivation, Antone Kom
 
Google I/O Extended 2024 Warsaw
Google I/O Extended 2024 WarsawGoogle I/O Extended 2024 Warsaw
Google I/O Extended 2024 Warsaw
 
Powerful Start- the Key to Project Success, Barbara Laskowska
Powerful Start- the Key to Project Success, Barbara LaskowskaPowerful Start- the Key to Project Success, Barbara Laskowska
Powerful Start- the Key to Project Success, Barbara Laskowska
 
Intro in Product Management - Коротко про професію продакт менеджера
Intro in Product Management - Коротко про професію продакт менеджераIntro in Product Management - Коротко про професію продакт менеджера
Intro in Product Management - Коротко про професію продакт менеджера
 
The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdf
The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdfThe Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdf
The Value of Certifying Products for FDO _ Paul at FIDO Alliance.pdf
 
The UX of Automation by AJ King, Senior UX Researcher, Ocado
The UX of Automation by AJ King, Senior UX Researcher, OcadoThe UX of Automation by AJ King, Senior UX Researcher, Ocado
The UX of Automation by AJ King, Senior UX Researcher, Ocado
 
Designing for Hardware Accessibility at Comcast
Designing for Hardware Accessibility at ComcastDesigning for Hardware Accessibility at Comcast
Designing for Hardware Accessibility at Comcast
 
Connecting the Dots in Product Design at KAYAK
Connecting the Dots in Product Design at KAYAKConnecting the Dots in Product Design at KAYAK
Connecting the Dots in Product Design at KAYAK
 
PLAI - Acceleration Program for Generative A.I. Startups
PLAI - Acceleration Program for Generative A.I. StartupsPLAI - Acceleration Program for Generative A.I. Startups
PLAI - Acceleration Program for Generative A.I. Startups
 
What's New in Teams Calling, Meetings and Devices April 2024
What's New in Teams Calling, Meetings and Devices April 2024What's New in Teams Calling, Meetings and Devices April 2024
What's New in Teams Calling, Meetings and Devices April 2024
 

Tests and validity spr 2012

  • 2.
  • 3. ACCURACY OF SELECTION METHODS PREDICTED VALIDITY 100 PERFECT PREDICTION 90 ASSESSMENT CENTRES/ SAMPLE TEST 80 ABILITY TESTS 70 PERSONALITY TESTS (COMBINATION) 60 BIODATA 50 STRUCTURED INTERVIEWS 40 TYPICAL INTERVIEWS 30 REFERENCES 20 ASTROLOGY 10 READING HANDS 0 CHANCE PREDICTION
  • 4. The Effectiveness of Personnel Selection Legal Reacti Method Validity Cost Defensibility on Low Application blanks Low ? Neutral Weighted application High High High Neutral High Biographical/Interest blanks Moderate ? Negative Low Letters of recommendation Low Low Positive High Cognitive ability tests Low High Negative High Job knowledge tests High High Positive High Performance tests/work samples High High Positive High Assessment Centers High Low Positive Interviews_unstructured; one rater Low Low High Negative Structured interviews Behavioral or situational High High High Positive
  • 5. GENERIC STANDARDS • VALIDITY • RELIABILITY • UTILITY • LEGALITY • IMPACT or FACE VALIDITY
  • 6. LEGALITY • Conform to the laws of the country. – Discriminatory regulations – Avoid adverse effects on groups – Age restrictions – Disability Quota – Avoid litigations later
  • 7. UTILITY • Degree to which the bottom line is effected by selection methods – Increase the probability of acceptance ratio. – Turnover types. Eg strong or weak performers. – Type of job: greater utility for higher revenue jobs/ difficult jobs.
  • 8. VALIDITY “The Extent To Which A Performance Measure Assesses All The Relevant-and Only The Relevant-aspects Of Job Performance.”
  • 9. CONTENT VALIDATION A Test-validation Strategy Performed “ By Demonstrating That The Items, Questions, Or Problems Posed By A Test Are A Representative Sample Of The Kinds Of Situations Or Problems That Occur On The Job.”
  • 10. CRITERION-RELATED VALIDITY A Method Of Establishing The “ Validity Of A Personnel Selection Method By Showing A Substantial Correlation Between Test Scores And Job-performance Scores.”
  • 11. Methods for calculating validity • Content validity – expert judgment – Content validation ratio Criterion Validity Predictive Validity Concurrent Validity Expressed in coefficient co-relation from – 1 to +1
  • 12. HOW VALIDATE • Analyze the job • Choose the tests • Administer the test • Relate the test scores and criteria • Prepare an Expectancy Chart • Cross validate and Revalidite
  • 13. Measure all Concurrent Validation current job incumbents on attribute Obtain correlation between these two Measure all sets of numbers current job Graphic Depiction of Concurrent and incumbents’ performance Predictive Validation Designs Measure all job Predictive Validation applications on attribute Hire some applicants and reject others Obtain correlation between these two Wait for some sets of numbers time period Measure all newly hired job 09/21/12 incumbents’ Know more! 13 performance
  • 14. Employee Testing and Selection (Highest 20%) 57-64 97 (Next highest 20%) 51-56 84 Test Scores (Middle 20%) 45-50 71 (Next lowest 20%) 37-44 55 (Lowest 20%) 11-36 29 0 20 40 60 80 100 Chances in a hundred of being rated a ”high performer”; and % of “ high performers” found in each test score group
  • 15. RELIABILITY “The Consistency Of A Performance Measure; The Degree To Which A Performance Measure Is Free From Random Error”.
  • 16. METHODS FOR ESTB RELIABILITY • 1. Test retest • 2. Spilt-Half • 3. Parallel test • 4. Calculate Test’s reliability • 5. Calculate Standard deviation
  • 17. ACCURACY OF SELECTION METHODS PREDICTED VALIDITY 100 PERFECT PREDICTION 90 ASSESSMENT CENTRES/ SAMPLE TEST 80 ABILITY TESTS 70 PERSONALITY TESTS (COMBINATION) 60 BIODATA 50 STRUCTURED INTERVIEWS 40 TYPICAL INTERVIEWS 30 REFERENCES 20 ASTROLOGY 10 READING HANDS 0 CHANCE PREDICTION
  • 18. Selection ratio High Base rate D: False A: True Satisfactory negatives Positives Performance cutoff score Job Behaviors Unsatisfactory C: True B: False negatives Positives Low Low Selection procedure scores High Unqualified Qualified Selection cutoff score
  • 19. Validity Correlation Analysis after Cut Scores are Lowered Satisfactory D C Performance Job E Unsatisfactory 0 50 70 Lo Test w score
  • 20. Validity Correlation Analysis after Cut Scores are Highered Satisfactory D C A B Performance Job E Unsatisfactory 0 50 70 98-100 Lo Test High w score