SlideShare une entreprise Scribd logo
1  sur  8
Télécharger pour lire hors ligne
Developing, Validating, and
Analyzing Structured Interviews



BCGi: Adverse Impact & Test
Validation Book Series
What are Structured Interviews
and How are they Scored and Analyzed?

• Structured Interviews are oral interview sessions for hiring or
  promotional selection processes
• They are different than many ad-hoc, informal interviews in both
  the way they are given and how they are scored
• Structured Interviews can include several types of questions:
   – Situational questions
   – Behavioral questions
   – Competency-based questions
• And typically involve several raters and pre-defined scoring
  routines


                      www.BCGinstitute.org
Why is this Topic Important to HR/EEO Professionals?
• Why do I need to know about this topic?
  – Yes… Interviews are “tests” and they are also subject to Title
    VII validation laws and are frequently litigated
  – Informal, ad-hoc interviews are generally not as effective as
    validated, structured interviews
  – There is a process for building and developing strong
    interviews, but many employers don’t take the time
• What are the key essentials I need to know about this topic?
  – Structured interviews are not too difficult to develop
  – Using multiple raters and rating scales can improve the
    effectiveness and validity of your interview process
• What are the consequences surrounding these issues?
  – Ad-hoc, informal interviews can possibly introduce liability and
    lower the quality of your workforce
  – The “start up” cost of a validation case is $30k to $80k
                      www.BCGinstitute.org
Presentation Overview


• Overview & Background
• Methods for Improving the Interview Process
• Types of Questions to Include in Structured
  Interviews
• Steps for Developing Situational Questions
• Administering and Scoring an Interview




                www.BCGinstitute.org
Presentation Overview

• Methods for Improving the Interview Process
  – How valid and reliable the interview is may be highly
    specific to both the situation and to the rater.
• Types of Questions to Include in Structured
  Interviews
  – Situational questions
  – Behavioral questions
  – Competency-based questions


                 www.BCGinstitute.org
Presentation Overview

• Steps for Developing Situational Questions
  – We’ll cover 13 steps that are typically involved in the
    Interview development process
• Administering and Scoring an Interview
  –   Selecting raters
  –   Training raters
  –   Assembling panels
  –   Administering/scoring the interview
  –   Combining applicant scores from multiple panels


                   www.BCGinstitute.org
Resources
• Adverse Impact and Test Validation: A Practitioner's
  Handbook by Daniel A. Biddle, Ph.D.
   – Purchase online at www.BCGinstitute.org

• Adverse Impact and Test Validation Book Series Webinars
   – Recordings available online for all BCGi Platinum Members
   – Webinar slides available online to all BCGi Standard & Platinum
     Members

• BCGi Membership
   – Free Standard Membership
   – Premium Platinum Membership



                        www.BCGinstitute.org
About Our Sponsor: Biddle Consulting Group (BCG)
 BCG is an HR firm dedicated to providing the highest products and services related to
 Equal Employment Opportunity (EEO), Affirmative Action and Employee Selection.
 • BCG’s Consulting Services
     ― Affirmative Action Plan Outsourcing
     ― Compensation Analysis
     ― EEO/AA Litigation Support (Plaintiff and Defendant)
     ― Job Analysis
     ― Test Development and Test Validation
 • BCG’s Software Products
     ― Adverse Impact Toolkit™
     ― AutoAAP® affirmative action plan development software
     ― AutoGOJA® job analysis software
     ― C4 call center testing software
     ― COMPARE™ compensation analysis software
     ― CritiCall® dispatcher/call-taker personnel selection software
     ― ENCOUNTER soft skills video situational judgment testing software
     ― OPAC® office skills testing software
     ― TVAP™ Test Validation & Analysis Program software
                                www.Biddle.com

Contenu connexe

Tendances

Validity and Reliability
Validity and ReliabilityValidity and Reliability
Validity and ReliabilityMaury Martinez
 
Accountability in developing assessment tools
Accountability in developing assessment toolsAccountability in developing assessment tools
Accountability in developing assessment toolsCarlo Magno
 
Inquiry forms questionnaire, opinionnaire, attitude scale, checklist, rating...
Inquiry forms  questionnaire, opinionnaire, attitude scale, checklist, rating...Inquiry forms  questionnaire, opinionnaire, attitude scale, checklist, rating...
Inquiry forms questionnaire, opinionnaire, attitude scale, checklist, rating...DrGavisiddappa Angadi
 
Conceptual Framework in Qualitative Research
Conceptual Framework in Qualitative ResearchConceptual Framework in Qualitative Research
Conceptual Framework in Qualitative ResearchTribhuvan University
 
Item and Distracter Analysis
Item and Distracter AnalysisItem and Distracter Analysis
Item and Distracter AnalysisSue Quirante
 
Quantitative And Qualitative Research
Quantitative And Qualitative ResearchQuantitative And Qualitative Research
Quantitative And Qualitative Researchdoha07
 
Theoretical framework
Theoretical frameworkTheoretical framework
Theoretical frameworkAnton Laus
 
The nature and purpose of the research
The nature and purpose of the researchThe nature and purpose of the research
The nature and purpose of the researchDeighton Gooden
 
Quantitative techniques in research
Quantitative techniques in researchQuantitative techniques in research
Quantitative techniques in researchCarlo Magno
 
Chapter 1 history of testing
Chapter 1 history of testingChapter 1 history of testing
Chapter 1 history of testingRoi Xcel
 
Types of Tests
Types of TestsTypes of Tests
Types of TestsIvy Autor
 
Construction of test
Construction of testConstruction of test
Construction of testAbid Nazir
 
Objective and Essay Test
Objective and Essay TestObjective and Essay Test
Objective and Essay TestRani Insani
 
Test development
Test developmentTest development
Test developmentZubair Khan
 
Test administration (Educational Assessment)
Test administration (Educational Assessment)Test administration (Educational Assessment)
Test administration (Educational Assessment)HennaAnsari
 

Tendances (20)

Validity and Reliability
Validity and ReliabilityValidity and Reliability
Validity and Reliability
 
Accountability in developing assessment tools
Accountability in developing assessment toolsAccountability in developing assessment tools
Accountability in developing assessment tools
 
Inquiry forms questionnaire, opinionnaire, attitude scale, checklist, rating...
Inquiry forms  questionnaire, opinionnaire, attitude scale, checklist, rating...Inquiry forms  questionnaire, opinionnaire, attitude scale, checklist, rating...
Inquiry forms questionnaire, opinionnaire, attitude scale, checklist, rating...
 
Conceptual Framework in Qualitative Research
Conceptual Framework in Qualitative ResearchConceptual Framework in Qualitative Research
Conceptual Framework in Qualitative Research
 
Item and Distracter Analysis
Item and Distracter AnalysisItem and Distracter Analysis
Item and Distracter Analysis
 
Quantitative And Qualitative Research
Quantitative And Qualitative ResearchQuantitative And Qualitative Research
Quantitative And Qualitative Research
 
Theoretical framework
Theoretical frameworkTheoretical framework
Theoretical framework
 
The nature and purpose of the research
The nature and purpose of the researchThe nature and purpose of the research
The nature and purpose of the research
 
Quantitative techniques in research
Quantitative techniques in researchQuantitative techniques in research
Quantitative techniques in research
 
Chapter 1 history of testing
Chapter 1 history of testingChapter 1 history of testing
Chapter 1 history of testing
 
Objective test
Objective testObjective test
Objective test
 
3.2 TEST ADMINISTRATION AND ETHICAL PRINCIPLES
3.2 TEST ADMINISTRATION AND ETHICAL PRINCIPLES3.2 TEST ADMINISTRATION AND ETHICAL PRINCIPLES
3.2 TEST ADMINISTRATION AND ETHICAL PRINCIPLES
 
Reliability and validity
Reliability and validityReliability and validity
Reliability and validity
 
Types of Tests
Types of TestsTypes of Tests
Types of Tests
 
Construction of test
Construction of testConstruction of test
Construction of test
 
The research instruments
The research instrumentsThe research instruments
The research instruments
 
Objective and Essay Test
Objective and Essay TestObjective and Essay Test
Objective and Essay Test
 
Test development
Test developmentTest development
Test development
 
Assembling The Test
Assembling The TestAssembling The Test
Assembling The Test
 
Test administration (Educational Assessment)
Test administration (Educational Assessment)Test administration (Educational Assessment)
Test administration (Educational Assessment)
 

Similaire à Developing, Validating, and Analyzing Structured Interviews (Overview)

Adaptive business analysis skill enhancement program v6.0 slideshare
Adaptive business analysis skill enhancement program v6.0 slideshareAdaptive business analysis skill enhancement program v6.0 slideshare
Adaptive business analysis skill enhancement program v6.0 slideshareAnanya Pani
 
Adaptive business analysis skill enhancement program v6.0 slideshare
Adaptive business analysis skill enhancement program v6.0 slideshareAdaptive business analysis skill enhancement program v6.0 slideshare
Adaptive business analysis skill enhancement program v6.0 slideshareAnanya Pani
 
Benchmarking for hrd professionals
Benchmarking for hrd professionalsBenchmarking for hrd professionals
Benchmarking for hrd professionalsSorab Sadri
 
The New Age Business Analyst - Role of BA in the Changing times of Agile Soft...
The New Age Business Analyst - Role of BA in the Changing times of Agile Soft...The New Age Business Analyst - Role of BA in the Changing times of Agile Soft...
The New Age Business Analyst - Role of BA in the Changing times of Agile Soft...Texavi Innovative Solutions
 
#FIRMday London 28/04/16 - Cubiks 'High Impact Sifting Solutions'
#FIRMday London 28/04/16 - Cubiks 'High Impact Sifting Solutions'#FIRMday London 28/04/16 - Cubiks 'High Impact Sifting Solutions'
#FIRMday London 28/04/16 - Cubiks 'High Impact Sifting Solutions'Emma Mirrington
 
ORGANIZATION DEVELOPMENT - All V9.0.pptx
ORGANIZATION DEVELOPMENT - All V9.0.pptxORGANIZATION DEVELOPMENT - All V9.0.pptx
ORGANIZATION DEVELOPMENT - All V9.0.pptxHR Spot
 
90 days to make a difference - approach
90 days to make a difference - approach90 days to make a difference - approach
90 days to make a difference - approachStuart Creasey
 
Use of candidate testing and assessment in accounting recruitment
Use of candidate testing and assessment in accounting recruitmentUse of candidate testing and assessment in accounting recruitment
Use of candidate testing and assessment in accounting recruitmentCCH iFirm
 
Design research for a quality product
Design research for a quality productDesign research for a quality product
Design research for a quality productCarmen Brion
 
Improving The Delivery Supply Chain: How A Start Up Became a Global Player
Improving The Delivery Supply Chain: How A Start Up Became a Global PlayerImproving The Delivery Supply Chain: How A Start Up Became a Global Player
Improving The Delivery Supply Chain: How A Start Up Became a Global PlayerEdward Byers, PMP, SSGB
 
R a ci & innovation
R a ci & innovationR a ci & innovation
R a ci & innovationAlan Culler
 
Visualizing the Understanding of "Baldrige Excellence Model"
Visualizing the Understanding of "Baldrige Excellence Model" Visualizing the Understanding of "Baldrige Excellence Model"
Visualizing the Understanding of "Baldrige Excellence Model" Abdel-Halim Mahmoud
 
Recruiting 101
Recruiting 101Recruiting 101
Recruiting 101Meemz11
 
#FIRMday London 27th April 2017: Insight in to Video Interviewing, Sonru
#FIRMday London 27th April 2017: Insight in to Video Interviewing, Sonru#FIRMday London 27th April 2017: Insight in to Video Interviewing, Sonru
#FIRMday London 27th April 2017: Insight in to Video Interviewing, SonruEmma Mirrington
 

Similaire à Developing, Validating, and Analyzing Structured Interviews (Overview) (20)

Adaptive business analysis skill enhancement program v6.0 slideshare
Adaptive business analysis skill enhancement program v6.0 slideshareAdaptive business analysis skill enhancement program v6.0 slideshare
Adaptive business analysis skill enhancement program v6.0 slideshare
 
Adaptive business analysis skill enhancement program v6.0 slideshare
Adaptive business analysis skill enhancement program v6.0 slideshareAdaptive business analysis skill enhancement program v6.0 slideshare
Adaptive business analysis skill enhancement program v6.0 slideshare
 
Benchmarking for hrd professionals
Benchmarking for hrd professionalsBenchmarking for hrd professionals
Benchmarking for hrd professionals
 
The New Age Business Analyst - Role of BA in the Changing times of Agile Soft...
The New Age Business Analyst - Role of BA in the Changing times of Agile Soft...The New Age Business Analyst - Role of BA in the Changing times of Agile Soft...
The New Age Business Analyst - Role of BA in the Changing times of Agile Soft...
 
Sanitized tb swstmppp1516july
Sanitized tb swstmppp1516julySanitized tb swstmppp1516july
Sanitized tb swstmppp1516july
 
Vijay Sharma
Vijay SharmaVijay Sharma
Vijay Sharma
 
#FIRMday London 28/04/16 - Cubiks 'High Impact Sifting Solutions'
#FIRMday London 28/04/16 - Cubiks 'High Impact Sifting Solutions'#FIRMday London 28/04/16 - Cubiks 'High Impact Sifting Solutions'
#FIRMday London 28/04/16 - Cubiks 'High Impact Sifting Solutions'
 
Beginning auditor (1)
Beginning auditor (1)Beginning auditor (1)
Beginning auditor (1)
 
Business Analysis.pdf
Business Analysis.pdfBusiness Analysis.pdf
Business Analysis.pdf
 
ORGANIZATION DEVELOPMENT - All V9.0.pptx
ORGANIZATION DEVELOPMENT - All V9.0.pptxORGANIZATION DEVELOPMENT - All V9.0.pptx
ORGANIZATION DEVELOPMENT - All V9.0.pptx
 
90 days to make a difference - approach
90 days to make a difference - approach90 days to make a difference - approach
90 days to make a difference - approach
 
Use of candidate testing and assessment in accounting recruitment
Use of candidate testing and assessment in accounting recruitmentUse of candidate testing and assessment in accounting recruitment
Use of candidate testing and assessment in accounting recruitment
 
Design research for a quality product
Design research for a quality productDesign research for a quality product
Design research for a quality product
 
Improving The Delivery Supply Chain: How A Start Up Became a Global Player
Improving The Delivery Supply Chain: How A Start Up Became a Global PlayerImproving The Delivery Supply Chain: How A Start Up Became a Global Player
Improving The Delivery Supply Chain: How A Start Up Became a Global Player
 
R a ci & innovation
R a ci & innovationR a ci & innovation
R a ci & innovation
 
Visualizing the Understanding of "Baldrige Excellence Model"
Visualizing the Understanding of "Baldrige Excellence Model" Visualizing the Understanding of "Baldrige Excellence Model"
Visualizing the Understanding of "Baldrige Excellence Model"
 
Recruiting 101
Recruiting 101Recruiting 101
Recruiting 101
 
#FIRMday London 27th April 2017: Insight in to Video Interviewing, Sonru
#FIRMday London 27th April 2017: Insight in to Video Interviewing, Sonru#FIRMday London 27th April 2017: Insight in to Video Interviewing, Sonru
#FIRMday London 27th April 2017: Insight in to Video Interviewing, Sonru
 
360 performance appraisal
360 performance appraisal360 performance appraisal
360 performance appraisal
 
Ch06
Ch06 Ch06
Ch06
 

Developing, Validating, and Analyzing Structured Interviews (Overview)

  • 1. Developing, Validating, and Analyzing Structured Interviews BCGi: Adverse Impact & Test Validation Book Series
  • 2. What are Structured Interviews and How are they Scored and Analyzed? • Structured Interviews are oral interview sessions for hiring or promotional selection processes • They are different than many ad-hoc, informal interviews in both the way they are given and how they are scored • Structured Interviews can include several types of questions: – Situational questions – Behavioral questions – Competency-based questions • And typically involve several raters and pre-defined scoring routines www.BCGinstitute.org
  • 3. Why is this Topic Important to HR/EEO Professionals? • Why do I need to know about this topic? – Yes… Interviews are “tests” and they are also subject to Title VII validation laws and are frequently litigated – Informal, ad-hoc interviews are generally not as effective as validated, structured interviews – There is a process for building and developing strong interviews, but many employers don’t take the time • What are the key essentials I need to know about this topic? – Structured interviews are not too difficult to develop – Using multiple raters and rating scales can improve the effectiveness and validity of your interview process • What are the consequences surrounding these issues? – Ad-hoc, informal interviews can possibly introduce liability and lower the quality of your workforce – The “start up” cost of a validation case is $30k to $80k www.BCGinstitute.org
  • 4. Presentation Overview • Overview & Background • Methods for Improving the Interview Process • Types of Questions to Include in Structured Interviews • Steps for Developing Situational Questions • Administering and Scoring an Interview www.BCGinstitute.org
  • 5. Presentation Overview • Methods for Improving the Interview Process – How valid and reliable the interview is may be highly specific to both the situation and to the rater. • Types of Questions to Include in Structured Interviews – Situational questions – Behavioral questions – Competency-based questions www.BCGinstitute.org
  • 6. Presentation Overview • Steps for Developing Situational Questions – We’ll cover 13 steps that are typically involved in the Interview development process • Administering and Scoring an Interview – Selecting raters – Training raters – Assembling panels – Administering/scoring the interview – Combining applicant scores from multiple panels www.BCGinstitute.org
  • 7. Resources • Adverse Impact and Test Validation: A Practitioner's Handbook by Daniel A. Biddle, Ph.D. – Purchase online at www.BCGinstitute.org • Adverse Impact and Test Validation Book Series Webinars – Recordings available online for all BCGi Platinum Members – Webinar slides available online to all BCGi Standard & Platinum Members • BCGi Membership – Free Standard Membership – Premium Platinum Membership www.BCGinstitute.org
  • 8. About Our Sponsor: Biddle Consulting Group (BCG) BCG is an HR firm dedicated to providing the highest products and services related to Equal Employment Opportunity (EEO), Affirmative Action and Employee Selection. • BCG’s Consulting Services ― Affirmative Action Plan Outsourcing ― Compensation Analysis ― EEO/AA Litigation Support (Plaintiff and Defendant) ― Job Analysis ― Test Development and Test Validation • BCG’s Software Products ― Adverse Impact Toolkit™ ― AutoAAP® affirmative action plan development software ― AutoGOJA® job analysis software ― C4 call center testing software ― COMPARE™ compensation analysis software ― CritiCall® dispatcher/call-taker personnel selection software ― ENCOUNTER soft skills video situational judgment testing software ― OPAC® office skills testing software ― TVAP™ Test Validation & Analysis Program software www.Biddle.com