SlideShare une entreprise Scribd logo
1  sur  20
Télécharger pour lire hors ligne
Best Practice Series




 Guidelines for Best Practice in the
Management of Psychometric Tests
Contents                                              Page No


1. Introduction                                             1

2. Why is a policy needed?                                  2

3. What should a policy look like?                          3

4. What should a policy include?                            4

   4.1   Mission statement                                  4

   4.2 Overall responsibility for testing standards         4

   4.3 Who should use tests?                                5

   4.4 When should tests be used?                           6

   4.5 Test choice                                          7

   4.6 Equal opportunities                                  8

   4.7 Use of test scores                                   9

   4.8 Confidentiality and storage of results              10

   4.9 Responsibility to test takers                        11

   4.10 Retesting                                          12

   4.11 Monitoring                                         12

   4.12 Access to materials                                13

   4.13 Copyright                                          13

   4.14 Computers in testing                               14

5. Policy management                                       15

Glossary                                                   16

Useful publications                                        17
1. Introduction



Psychometric tests are powerful tools used by      Tests can be used to challenge stereotyped
organisations for the selection, development and   judgements made by interviewers and often
management of people. Tests can be used:           enable a more objective analysis to take
                                                   place than is possible by interviewing alone.
• to enhance the decision-making process in        Occupational tests have consistently been
  assessment for selection and promotion           shown to be better predictors of job success
                                                   than interviews.
• as an aid to management in areas such as
  motivation and team building                     Using tests can lead to substantial gains for an
                                                   organisation in terms of increased output and
• to identify development needs, as a basis for    efficiency, better quality staff, higher morale,
  employee counselling as well as in               more effective performance, lower training costs
  organisational areas such as management of       and reduced turnover.
  change or succession planning.
                                                   When properly used, psychometric testing helps
Psychometric tests provide additional relevant     to ensure a common language for assessment
information over and above that obtained from      standards throughout an organisation, match
more traditional assessment methods. For           people to jobs, identify individual capabilities and
instance, tests aid recruitment processes by       predict on-the-job performance.
ensuring that all candidates are treated fairly
and measured against a common yardstick.




                                                                                       Best Practice Series > 1
2. Why is a policy needed?



Use of tests must be properly managed in order       The aims of every organisation in using tests are
to reap the potential benefits. If inappropriate     different and policy must be geared to the needs
tests are used, or the information from tests is     and structures of each organisation. For one
misunderstood, or even ignored, there will be no     company, a central unit supervising all test use
advantage in using tests - indeed there will be      may be appropriate. For another, individual test
unproductive costs. The management of tests          users may be required to take final responsibility
should include regular reviews and monitoring to     for their own test use. For this reason each
ensure the organisational aims are being met.        organisation must develop its own way of
                                                     managing test use and formulate a local
In addition, as with any powerful tool, the          policy document.
potential for misuse is ever present. Bad
practice can:                                        The purpose of this booklet is to highlight the
                                                     areas that ought to be covered in such a formal
• reduce the effectiveness of test use               policy document. It also provides examples of
                                                     what policy statements may look like. Readers
• cause considerable suffering to individuals        are free to use or modify these as appropriate
                                                     but the statements do not in themselves
• damage the company’s image with employees,         constitute a policy.
  trade unions and clients
                                                     It is beyond the scope of this booklet to provide
• lead to contravention of the law and the costs     detailed discussion of all the issues that need to
  and bad publicity associated with litigation.      be considered in developing a policy for managing
                                                     tests. SHL is happy to supply expert consultancy
A well-thought out policy on test use will help to   services to help organisations create their own
ensure that the organisation gains maximum           policies for test use if further guidance is desired.
benefit from test use and that potential misuse is
avoided. It will also demonstrate commitment to
good practice.




2 > Best Practice Series
3. What should a policy look like?



Policies work best when they are brief and          The procedural guidelines put the policy into
focused. Long manuals that lie unread in a drawer   practice, and then can, and should, be amended
have little effect on practice. However, general    whenever they cease to meet the aims of the
statements of principle tend to be vague, easily    organisation or the policy. The detail with which
ignored and provide little guidance for the user.   such procedures are specified will depend on the
                                                    nature, style and needs of the organisation.
An effective strategy is to have brief policy
statements supplemented with more detailed
guidelines. The statements can encompass
general principles and are likely to need few
changes even in changing circumstances.




                                                                                     Best Practice Series > 3
4. What should a policy include?



4.1 Mission statement                                  4.2 Overall responsibility for testing
                                                           standards
It is helpful to start with a short general
statement of aims in using tests. This sets the        Test users are always responsible for the way
tone and purpose of the document. It ensures           they personally use tests. However, in some
that readers are aware of the positive objectives      organisations there is a central unit or department
of the use of tests and the reasons for the            that decides policy, oversees practices and
existence of the policy. Otherwise, a policy           provides support for individual users. Often
can be seen as restrictive and bureaucratic,           such a unit contains one or more professional
rather than as a helpful guide to doing                occupational psychologists. Sometimes such
things well.                                           units have an advisory role; at other times they
                                                       dictate procedures.

   Example
                                                       In other organisations each test user makes his or
   We use psychometric tests to enhance the            her own autonomous decisions regarding the use
   quality and quantity of information available for   of tests; small organisations may only have a few
   selection, development and training decisions       trained users; large organisations may have many
   and as an aid to organisational change. We are      users in a single personnel department or test use
   committed to the highest standards of practice      may be decentralised.

   in the use of all psychometric tests, in order to
                                                       Whatever the structure, the responsibilities and
   maximise the benefit of testing to the
                                                       accountabilities of each individual must be clearly
   organisation and the individual, and to promote     defined. It is highly recommended that in large
   fairness and equality of opportunity for all.       organisations with high volume test use, one or
                                                       more chartered psychologists are available to
                                                       support the design, implementation, validation
                                                       and review of test procedures either on a
                                                       consultancy basis or as permanent members
                                                       of staff.


                                                         Example
                                                         Each test user must ensure that he/she uses
                                                         tests to the highest professional standards
                                                         and only in accordance with the guidelines
                                                         set out in this policy.


                                                         The Central Testing Unit is responsible for
                                                         ensuring that all test use in this organisation is
                                                         in accordance with this policy. Any procedure
                                                         that will involve the use of psychometric
                                                         testing must be referred to the Unit for
                                                         approval before implementation. The Unit will
                                                         provide guidelines for the use of tests that
                                                         must be followed by all users.




4 > Best Practice Series
4.3 Who should use tests?                                including scoring, interpretation, feedback and
                                                         applications, in addition to Level 1 training, in
Knowledge and experience are required to use             order to qualify an individual in the use of a
psychometric tests effectively. It is recognised         personality instrument, such as the OPQ.
throughout the world that psychometric
instruments are potentially dangerous in the             The BPS Intermediate Level B certificate is
wrong hands. Indeed, in many countries only              available for those who have completed this
qualified psychologists are allowed to use them.         level of training. Further familiarisation training
                                                         is then required for each additional instrument
In the UK, the British Psychological Society             to be used.
(BPS) has defined a set of essential competencies
constituting a minimum standard for any test user.       Level 3: The BPS Full level B certificate is
All reputable test publishers maintain a register        available to those with a deeper and broader
of qualified people to whom test materials may           perspective on personality and general test use,
be supplied.                                             as well as full training in at least two different
                                                         measures of personality. It is recommended for
Access to materials requires both general training       those who have responsibility for other test
in test use and often familiarisation training for       users and policy decisions. SHL can help those
the specific instruments in question. Publishers         interested to gain the relevant competence.
usually give some recognition to training from
other reputable providers. There are several             Chartered Psychologists: Professional
recognised levels of training.                           occupational psychologists who specialise in
                                                         testing and assessment have a greater
  Test Administration: This qualifies the                knowledge and experience of the use of tests
  individual to carry out the standard procedures        than can be gained from short training courses.
  for administering and scoring tests. The BPS
  Test Administration Certificate covers this level      Chartered psychologists have reached a
  of competence. It does not cover the choice of         standard of training and experience required by
  tests or the interpretation of results. Neither        the BPS and have agreed to abide by the BPS
  does it allow the individual access to materials.      code of conduct.
  Someone trained to this level may only work
  under the close supervision of a fully trained       Qualified users should ensure that materials are
  test user within the organisation. Some              only used appropriately and are not used by
  organisations rely heavily on test administrators    untrained people or for a purpose for which they
  to relieve more highly trained staff. SHL            were not intended. It is also their responsibility to
  suggests a ratio of one fully trained test user to   work within the confines of their own expertise
  three test administrators to ensure proper           and to recognise when refresher training, skills
  supervision at all times.                            updates or expert advice is needed.

  Level 1, Occupational Testing: BPS Level A
                                                         Example
  Certificate of Competence covers the basic
  principles of psychometric testing and the             Only trained test users who hold the relevant
  techniques of selection, administration, scoring,      qualifications may use and interpret
  interpretation and validation of ability tests.        psychometric instruments. Trained test users
  This training course qualifies the individual to       may delegate test administration to a person
  use ability tests and interest inventories.            trained in this area.

  Level 2, Personality Measurement: This
  covers the theoretical and practical issues
  involved in the use of measures of personality,



                                                                                           Best Practice Series > 5
4.4 When should tests be used?                             Tests are best used in decision making, in
                                                           conjunction with other relevant information. In a
Tests may be used for selection, (either for               promotion decision, test results may be integrated
shortlisting or final decisions), placement or             with interview performance, track record and
promotion decisions, development, team building,           managers’ recommendations to provide the best
counselling, out-placement and organisational              information about individual suitability. Use of a
development. It is not possible to discuss the             single test result alone should be avoided
considerations for using tests in each context in          whenever possible.
this short booklet. In each case, the situation
must be evaluated to see whether test use would            Consideration must be given to where test results
be appropriate to help achieve the desired                 fit into a procedure. Tests may be used for
objectives.                                                shortlisting from a large pool of applicants, to
                                                           suggest areas to be explored during an interview,
There are some occasions where it is not usually           or as a final check on the suitability of a
appropriate to use tests. For instance, it is unlikely     chosen candidate.
that test results would be suitable for making
redundancy decisions, since direct information on
job performance should be available.

Tests can be valuable in making redeployment
decisions or in outplacement counselling,
however. Similarly, an organisation may want to
restrict the use of some tests to counselling or
development applications.


   Example
   Tests may be used for selection, development and counselling purposes. Any additional uses should
   be referred to the Central Testing Unit for approval.




6 > Best Practice Series
4.5 Test choice                                         Some organisations may allow individual users to
                                                        select the test they want to use. Others may
Whenever tests are used, it is vital that there is a    require the involvement of internal or external
match between the skills and characteristics            experts in test choice. A middle way would be the
measured and the job or organisational demands.         provision of a general list of ‘approved’ tests from
This is particularly important when selection or        which individual users could choose those
promotion decisions are based on test results.          appropriate to their needs. This allows an
                                                        organisation to prevent the use of instruments of
Objective job analysis is the best way to               uncertain quality. It will not control the relevance
determine the skills required for a particular job.     of measures - in other words the job analysis
These skills are then matched to appropriate            stage will still be required.
tests. In large scale testing procedures, it may be
appropriate to perform criterion related validation     It is important that whenever tests are chosen
studies before test implementation.                     there is written documentation of the reasons
                                                        behind the choice. This may include copies of job
Trained test users should have the skills to            analysis reports, job descriptions, person
evaluate the quality and relevance to job               specifications, validation studies, etc. If the
requirements of an instrument from the                  relevance of a particular measure is challenged,
information provided by the test publisher in the       such evidence supports the test choice,
test manual. Where insufficient information is          shows the care taken and helps ensure users do
provided, caution should be exercised in the use        not take dangerous shortcuts.
of the test.


  Example
  All psychometric tests used must be clearly relevant to the given purpose. Detailed job descriptions
  and person specifications based on objective job analysis must be prepared prior to the choice of
  tests for any selection or promotion procedures. All decisions to use tests should be clearly
  documented with a copy sent to the Central Testing Unit.




                                                                                           Best Practice Series > 7
4.6 Equal opportunities                                Users should take particular care when a
                                                       candidate is not fluent in the language in which
Research has shown that well-constructed               the tests are presented. Actual ability may be
psychometric tests are the single most effective       confounded with language proficiency and results
predictor of job performance. Tests give objective     may be difficult to interpret.
information about a candidate and have been
shown in general to lead to better and fairer          Similar issues arise in the testing of candidates
employment decisions.                                  who are disabled. In these cases, it may be
                                                       necessary to adjust standardised administration
Tests of aptitude or ability have sometimes been       procedures to allow for the disability, as required
found to have disparate impact on ethnic, age or       by the Disability Discrimination Act of 1995.
gender group; i.e. proportionately fewer members       Changes should not be made arbitrarily as this
of one ethnic, age or gender group do well in the      affects test standardisation.
test in some cases. In that these patterns exist, it
is particularly important that appropriate             Test users can call the SHL Helpline for advice.
guidelines are followed to avoid improper use of       Guidelines for Best Practice in Testing People with
tests and potential contravention of anti-             Disabilities is also available from SHL to help in
discrimination laws. Considerations of fairness are    this process.
important in themselves. In addition, there are
legal implications of unfair practices in the            Example
selection and promotion of employees.
                                                         The organisation is committed to selection on
                                                         merit and only measures which are clearly
The main issues concern choosing relevant
                                                         relevant to job demands and free of extraneous
measures and monitoring outcomes. A full
discussion of all the elements of good practice          bias should be used. All assessments for
can be found in Guidelines for Best Practice in          selection and promotion must be monitored to
the Use of Personnel Selection Tests, available          ensure they do not unfairly exclude or
from SHL.                                                disadvantage any section of the population.


                                                         Whenever a disability prevents a suitably
                                                         qualified individual from undergoing standard
                                                         selection procedures, appropriate alternative
                                                         arrangements for assessment must be found.
                                                         Always contact the test publisher for advice
                                                         before making any changes to test
                                                         administration procedures.




8 > Best Practice Series
4.7 Use of test scores                                                     Thought should be given to the integration of test
                                                                           results with other relevant information. This is
Interpretation of results should be accurate and                           particularly important where many different
not exceed the limits of the information. Users                            assessment techniques are used. The booklet
should beware, for example, of failing to take                             Guidelines for Best Practice in the Use of
account of the standard error of measurement in                            Assessment and Development Centres (available
interpreting the difference between any two                                from SHL) discusses the issues that arise here.
scores, or of drawing far-fetched inferences from
personality data.                                                          However, even where only test results and an
                                                                           interview are combined, decisions need to be
Appropriate norms should always be used in                                 made about, for instance, whether good
interpreting scores. Where no suitable norm                                performance in one sphere can compensate for
groups are provided with a test, further guidance                          poor performance in the other, or whether some
should be sought from the publisher. Large-scale                           minimum standard needs to be reached on all
test users should produce their own local norms                            elements. Similarly, in the use of personality
for ability and aptitude tests. SHL will provide                           questionnaires, users need to decide whether a
clients with their own norm groups, if data is                             criterion referenced, “danger zone” or integrative
submitted for analysis1.                                                   approach is to be used.

Tests should always be interpreted by properly
                                                                              Example
trained individuals in the context of clearly
defined criteria. Both quantitative and qualitative                           Test scores must be interpreted on the basis
interpretation can be used. The former should be                              of relevant norm groups. Fixed cut-offs may
restricted to cases where there is sufficient                                 only be imposed where specific evidence of
supporting evidence.                                                          test relevance is available, e.g. job analysis,
                                                                              validation study.
The use of fixed cut-offs with personality
measures can be particularly misleading, without
                                                                              The interpretation of test scores is in
relevant evidence of validity. Qualitative
interpretation may be more appropriate in these                               accordance with the formula, which will be
cases. Decision rules and their rationale should be                           amended from time to time on the basis of
properly documented.                                                          ongoing validation results.




1
This service is currently being offered free of charge provided that permission is given to publish the results anonymously.




                                                                                                                   Best Practice Series > 9
4.8 Confidentiality and storage of                        The Data Protection Act (1998) covers the storage
    results                                               of any information about an individual, whether
                                                          on computer or in another form. Test results
Test results, like all personal information, should       should not be stored or used without candidates’
be stored with due regard to confidentiality.             permission and they have a right to see
Access should be restricted to those with a need          information stored or used, or a meaningful
to know and in accordance with what has been              interpretation of it.
agreed with the respondent during administration
and feedback. Persons who are untrained should
not be allowed access to raw data from tests, but
only to clearly described interpretations.

Individuals do change and develop and so
psychometric data can become less accurate over
time. Test scores should therefore not be kept on
file indefinitely. The time period for which scores
are valid will differ depending on the nature of
the measures and the particular use made of
them. Care should be taken with results over 6-12
months old for selection purposes. Little reliance
should be put on results over three years old for
any purpose.


   Example
   Test results should be kept by test users in locked files. A written interpretation of results should be
   kept in personnel files and provided to relevant individuals.


   Results over 12 months old are invalid for selection or promotion decisions. All results are to be
   destroyed after three years or when the respondent ceases to be employed, whichever is the sooner.




10 > Best Practice Series
4.9 Responsibility to test takers                     After the test session
                                                      Arrangements should be made to provide
Testers should be honest and open with                candidates with feedback on their results as soon
candidates about why the tests are being used         after testing as possible. Personality and
and what will happen to the results. Candidates       motivation questionnaire feedback is critical and
should be offered feedback of their results.          will often enhance the interpreter’s own
Before the test session                               understanding of test results.

Whenever tests or questionnaires are used it is       Feedback does not need to be lengthy, indeed with
important that respondents are given clear            a large number of applicants this might be very
information about the nature of the instruments       time consuming. A face to face interview is
and the reason for using them.                        preferred, but computer generated reports
                                                      supported by telephone feedback may be
Candidates should be given examples of the types      appropiate in some circumstances.
of tests to be used as well as general information
about the skills to be tested and practical           Feedback should be given by qualified users and
information about the testing session. This helps     should be accurate and open. Profile charts may
to reduce anxiety and allows the candidate to         be shown to respondents, but they should not be
prepare constructively for the session. It also       given copies to take away. A short narrative
allows candidates with disabilities to recognise if   summary may be provided if desired. This is
they will need any special arrangements.              particularly useful where testing is for counselling
                                                      and development purposes.
SHL produces a series of practice leaflets as well
as complete practice tests, which organisations       Computer generated expert system or narrative
                                                      report writers can support the feedback interview.
can supply to individuals before testing, so that
                                                      Some may be suitable to give to respondents, but
they can familiarise themselves with what is
                                                      many are intended as aids to interpretation for
required and prepare accordingly. The use of
                                                      the trained test user and could easily be
practice tests is particularly recommended for
                                                      misinterpreted by others. Users should follow the
older candidates, those with less educational
                                                      guidelines provided by the author or publisher of
experience and others likely to be unfamiliar with
                                                      such systems.
formal testing procedures. The offer of a practice
test session is highly desirable, and may be a
particularly useful way of supporting internal          Example
candidates applying for promotion.                      This organisation is committed to dealing fairly
                                                        with all candidates to be tested. We will be
At the test session                                     open and honest about the use of tests,
Make sure all candidates know why and how test
                                                        provide suitable practice materials and relevant
scores are going to be used and who will have
                                                        feedback whenever tests are used.
access to the results. Test administrators should
promote a serious but sympathetic atmosphere.

It is important to remember that the testing
session will be an extremely important event for
the candidate, even if it is a routine one for the
administrator. Instructions should be clear and not
rushed. Administrators should ensure candidates
know what they have to do before each test
begins and that appropriate accommodation has
been made for candidates with disabilities.




                                                                                     Best Practice Series > 11
4.10 Retesting                                          4.11 Monitoring
An issue that arises where positions regularly          Use of tests and other psychometric instruments
become vacant and unsuccessful applicants               should be continually monitored to ensure
reapply is whether they should (be allowed to)          continued appropriateness and effectiveness. In
retake tests. There is no hard and fast rule but an     small scale applications, this may amount to
organisation should have a consistent policy.           ensuring that the techniques remain relevant to
Results can be allowed to stand for up to 12            the job and that up-to-date test versions and
months. It is not desirable to allow candidates to      norms are used. Where larger scale use occurs,
be retested regularly unless alternate forms of         scores should be monitored at regular intervals to
the test are available.                                 update norms.

However, it is reasonable to allow an applicant to      Monitoring by ethnic group, age and gender is
be retested where there is evidence that he/she         required to identify any adverse impact.
might have under-performed the first time, e.g.
due to illness. Otherwise, a suitable interval should   A validation study should be carried out every
generally elapse before retesting is allowed.           five years or so, or whenever changes in the job
                                                        or applicant group are such that initial validity
                                                        could have been affected.
   Example
   For selection purposes a candidate’s test            Monitoring might be the responsibility of local
   results are valid for any similar position for 12    test users, or could be centrally co-ordinated. The
    months from the date of testing. Candidates         performance of a validation study requires
                                                        detailed knowledge beyond that generally gained
   may be retested after six months at their
                                                        in basic level training courses. Advice should be
   request. Candidates may be retested within
                                                        sought from a competent chartered psychologist.
   a shorter period only at the discretion of
   the relevant personnel manager and
   should supply details in writing supporting            Example
   their application.                                     Test monitoring forms should be completed for
                                                          each exercise involving test use and sent to
                                                          the Central Testing Unit for processing.
                                                          Whenever more that 100 people are employed
                                                          in a job category for which tests are used in
                                                          selection, a validation study must be
                                                          performed within three years from the
                                                          commencement of the use of tests.




12 > Best Practice Series
4.12 Access to materials                              4.13 Copyright
This element of a policy should cover who can buy     Test materials are extremely vulnerable to
materials, where they are stored and who has          copyright infringement. In most countries, the
access. The security of materials is paramount.       reproduction of test materials by any means
Free circulation leads to over familiarity and        (including computer installations) without the
devalues psychometric instruments. Responsible        permission of the author is a criminal offence,
test publishers only supply materials to trained      whether or not the reproduced materials are to be
users, who, in turn, must ensure untrained users      sold. Illegal copying of materials leads to lack of
do not gain access to them.                           standardisation and poor control of materials, and
                                                      gives respondents a bad impression. Ultimately,
Within an organisation decisions should be taken      the resulting loss of income will contribute to less
about who should hold test materials and who          new test development, poorer updating services,
should have access. It may not be desirable for all   or higher prices.
users to have access to all materials. Central
storage can help prevent unnecessary duplication      The responsibility for obtaining the publisher’s
of materials but may not be practical in              permission to install a particular test on a generic
decentralised organisations.                          computer “shell system” rests with the user, not
                                                      the supplier, of such a system. The user will be in
An organisation must supply test users with           breach of copyright if permission from the
appropriate storage space where tests can be kept     publisher has not been obtained.
under lock and key. It is highly desirable that all
materials are logged in and out of a test store.      All SHL materials, including profile charts and
This helps ensure materials are not carelessly left   software supplied on computer installations, are
lying around and prevents them going astray.          subject to copyright. SHL has in the past actively
                                                      pursued potential breaches of copyright where
Failure to keep track of materials can be             these are discovered and will continue to do so in
expensive where replacements have to be               the future.
purchased or annual lease fees paid on missing
booklets. Access to computer-based testing
                                                        Example
should be controlled by restricted passwords or
other appropriate means.                                Under no circumstances should any test
                                                        materials be photocopied or installed on
                                                        computer without the test publisher’s
  Example
                                                        express permission.
  Computer-generated reports should be used
  to standardise and support interpretations.
  Only trained users can authorise the use of
  computer-generated reports in a testing
  process. Appropriate reports can be passed
  to candidates or line managers, but only with
  the provision of a named contact in case
  of questions.




                                                                                    Best Practice Series > 13
4.14 Computers in testing                                   Where tests are administered remotely via the
                                                            internet, test takers should be provided with
Computers can provide great benefits to testing             appropriate information about the process and
processes, in standardising administration,                 help should be available if required. Where testing
developing interpretation as well as managing               is not fully controlled, interpretation of scores and
scoring and handling data. In general, the policy           decision-making, e.g. final decisions, should be
considerations for using computerised tests are             supported by supervised testing.
the same as for any other assessment medium.
                                                            Remote Internet-based testing should only be
The test must be appropriate for its purpose.               used for development purposes or when
Computer-based administration must still be                 supported by selected supervised retesting.
controlled by a trained administrator. Use of the
Internet for remote administration can lead to
uncontrolled conditions without care.

Computer-generated interpretation can aid
trained test users, but cannot replace them. Even
when a computer system takes over much of the
testing procedure, its use should always be
supervised by a fully trained user.


   Example
   Test users must ensure that all test materials are securely stored. An accurate log should be kept of all
   test materials held. The log should be updated whenever materials are removed, replaced or added to
   the store.




14 > Best Practice Series
5. Policy management



Thought should be given to the implementation               A review procedure should form part of the policy
procedure for the policy, to ensure that test users         to ensure it remains relevant to the needs of the
are aware of the requirements and are committed             organisation. This should specify when and how
to working within them. Communication is                    the workings of the policy will be examined and
essential in this process. Test users should                how changes are to be made.
understand the function of the policy in preserving
high standards.

Commitment from the top is essential in
implementing a policy successfully. Managers
should ensure that they promote a supportive
atmosphere towards the policy and actively
implement it themselves.


  Example
  It is the responsibility of all test users to ensure that this policy is applied at all times. All deviations
  should be reported to the personnel manager who will take appropriate action. The personnel manager
  will formally review the functioning of the policy after six months initially and then every two years.
  Suggestions for changes and amendments should be addressed directly to the personnel manager.




                                                                                                   Best Practice Series > 15
Glossary



Ability test: A test designed to measure a specific     Personality questionnaire: A questionnaire which
competence such as verbal reasoning or clerical         looks at the typical behaviour, interpersonal style,
checking.                                               thoughts and/or feelings of an individual.

Aptitude test: A test designed to measure               Practice leaflet: A leaflet provided to a test taker
potential performance in a given area - usually         before a testing session, providing a short
through existing abilities.                             description of the tests to be administered and a
                                                        few example items.
Cut-off: The score on a test that separates those
selected from those rejected (the ‘pass’ mark).         Practice test: Test provided to a test taker before
                                                        a testing session that are similar to those to be
Disparate impact: A selection criterion has             used in the session, to allow the test taker to
disparate (or adverse) impact when proportionately      become familiar with test demands and test
fewer members of one ethnic, age or gender group        procedures.
can meet the criterion.
                                                        Practice test session: A session where (practice)
Feedback: The process of reporting back to test         tests are administered under standard test
takers their results. At its best, this is an           conditions in order to help a test taker become
interactive process that enhances the                   familiar with test demands, conditions and
understanding of both the test taker and the test       procedures.
interpreter about the individual.
                                                        Profile chart: A display of a number of test results
Interest inventory: A questionnaire designed to         from the same individual showing relative high and
reveal the preferences of an individual for different     low scores in the different areas tested.
jobs and job areas. They are most often used in
career counselling.                                     Psychometric test: A standardised measure of a
                                                        psychological construct that produces scores which
Job analysis: A structured examination of the           are accurate and valid.
tasks inherent in a job and the skills required to
perform them.                                           Qualitative interpretation: Interpretation based
                                                        on an integration of the content of a series of
Job description: A structured report of the tasks,      results. The meaning of an individual score will
functions and responsibilities required in a job.       differ according to the constellation of all the other
                                                        scores.
Local norms: A norm group (see norms) based on
a representative sample of people from the              Quantitative interpretation: Interpretation based
organisation in question, e.g. previous applicants      on fixed rules applied to numerical scores.
for the same job.
                                                        Standard error of measurement: A measure of
Norms: Standard distributions of test scores based      the accuracy of test scores.
on the performance of a representative sample of
a given group. Psychometric test scores are             Validation: The process of investigating the extent
interpreted through comparison with relevant            to which an instrument measures what it is
norm groups.                                            designed to measure. Often the extent to which
                                                        test scores can predict current or future job
Person specification: A structured description of       performance or some other relevant criterion.
skills, abilities, characteristics and circumstances
required to optimally perform a job.




16 > Best Practice Series
Useful publications



Avoiding Sex Bias in Selection Testing: Guidance For Employers. Equal Opportunities Commission, 1988.

Code of Good Practice in Psychological Testing. Steering Committee for Test Standards, British
Psychological Society, 2002.

Essentials of Psychological Testing. Cronback, L. Harper and Row, 1990.

Guidelines for Best Practice in the Use of Personnel Selection Tests. SHL, 2005.

Guidelines for Best Practice in Testing People with Disabilities. SHL, 2000.

Guidelines for The Development and Use of Computer Based Assessments. British Psychological
Society, 2002.

International Guidelines on Test Use. International Test Commission, 2000.

Occupational Testing Course Notes. SHL, 2004.

Psychological Testing: A Manager’s Guide. Toplis, J., Dulewicz, V. and Fletcher, C. Chartered Institute of
Personnel and Development (4th edition), 2005.

Psychological Testing: A Test User’s Guide. Steering Committee on Test Standards. The British
Psychological Society, 2002.

Psychometric Tests and Racial Equality: A Guide for Employers. Commission for Racial Equality, 1992.

Psychometric Testing and Visual Impairment: An Employer’s Guide. RNIB, 2000.

Selection Tests and Sex Bias. Pearn, M.A., Kandola, R.S. and Mottram, R.D. HMSO, London, 1987.

Standards for Educational and Psychological Testing. AERA, NCME, APA, 1999.

Towards Fair Selection: A Survey of Test Practice and Thirteen Case Studies. Commission for Racial
Equality, London, 1993.

www.acas.org.uk Home of the Advisory Conciliation and Arbitration Service.

www.psychtesting.org.uk Home of the British Psychological Society’s Psychological Testing Centre.

www.bps.org.uk Home of British Psychological Society.

www.cre.gov.uk Home of the Commission for Racial Equality.

www.drc-gb.org Home of the Disability Rights Commission.

www.eoc.org.uk Home of the Equal Opportunities Commission.

www.intestcom.org Home of the International Testing Commission.




                                                                                          Best Practice Series > 17
Guidelines for Best Practice in the
   Management of Psychometric Tests

Whilst SHL has used every effort to ensure that
these guidelines reflect best practice, SHL does
  not accept liability for any loss of whatsoever
   nature suffered by any person or entity as a
  result of placing reliance on these guidelines.
    Users who have concerns are urged to seek
 professional advice before implementing tests.


       The reproduction of these guidelines by
    duplicating machine, photocopying process
      or any other method, including computer
     installations, is breaking the copyright law.


SHL is a registered trademark of SHL Group plc,
 which is registered in the United Kingdom and
                                 other countries


                         © SHL Group plc, 2005




                            United Kingdom
                                 The Pavilion
                               1 Atwell Place
                             Thames Ditton
                            Surrey KT7 0NE

 Client Support Centre: 0870 070 8000
                                                     UK BP6 V1 UKE 3208




                  Fax: (020) 8335 7000


                     info.uk@shlgroup.com
                             www.shl.com

Contenu connexe

Tendances

Certified Professional in Healthcare quality "Cphq"
Certified Professional in Healthcare quality "Cphq"Certified Professional in Healthcare quality "Cphq"
Certified Professional in Healthcare quality "Cphq"Doaa Hussein MBA,CPHQ
 
Dr Ayman Ewies - Clinical audit made easy
Dr Ayman Ewies - Clinical audit made easyDr Ayman Ewies - Clinical audit made easy
Dr Ayman Ewies - Clinical audit made easyAymanEwies
 
What makes er teams efficient? A multi-level exploration of environmental, te...
What makes er teams efficient? A multi-level exploration of environmental, te...What makes er teams efficient? A multi-level exploration of environmental, te...
What makes er teams efficient? A multi-level exploration of environmental, te...FGV Brazil
 
Quality Control In Nursing
Quality Control In NursingQuality Control In Nursing
Quality Control In Nursingmarlasavage
 
PCOMS in New Zealand
PCOMS in New ZealandPCOMS in New Zealand
PCOMS in New ZealandBarry Duncan
 
Cphq course
Cphq courseCphq course
Cphq courseAli Cphq
 
QualityMetric and Magellan Presentation at AHIP Conference 2009
QualityMetric and Magellan Presentation at AHIP Conference 2009QualityMetric and Magellan Presentation at AHIP Conference 2009
QualityMetric and Magellan Presentation at AHIP Conference 2009jponao
 

Tendances (11)

Quality assurance
Quality assuranceQuality assurance
Quality assurance
 
Certified Professional in Healthcare quality "Cphq"
Certified Professional in Healthcare quality "Cphq"Certified Professional in Healthcare quality "Cphq"
Certified Professional in Healthcare quality "Cphq"
 
Quality assurance
Quality assuranceQuality assurance
Quality assurance
 
Dr Ayman Ewies - Clinical audit made easy
Dr Ayman Ewies - Clinical audit made easyDr Ayman Ewies - Clinical audit made easy
Dr Ayman Ewies - Clinical audit made easy
 
What makes er teams efficient? A multi-level exploration of environmental, te...
What makes er teams efficient? A multi-level exploration of environmental, te...What makes er teams efficient? A multi-level exploration of environmental, te...
What makes er teams efficient? A multi-level exploration of environmental, te...
 
Quality assurance
 Quality assurance Quality assurance
Quality assurance
 
Quality Control In Nursing
Quality Control In NursingQuality Control In Nursing
Quality Control In Nursing
 
PCOMS in New Zealand
PCOMS in New ZealandPCOMS in New Zealand
PCOMS in New Zealand
 
Research proses
Research prosesResearch proses
Research proses
 
Cphq course
Cphq courseCphq course
Cphq course
 
QualityMetric and Magellan Presentation at AHIP Conference 2009
QualityMetric and Magellan Presentation at AHIP Conference 2009QualityMetric and Magellan Presentation at AHIP Conference 2009
QualityMetric and Magellan Presentation at AHIP Conference 2009
 

Similaire à Best practiceguidelines management-of-psychometric-tests

Identifying sharing-good-practices
Identifying sharing-good-practicesIdentifying sharing-good-practices
Identifying sharing-good-practicesLo Ivan
 
LPC Models and Techniques in Clinical Supervision
LPC Models and Techniques in Clinical SupervisionLPC Models and Techniques in Clinical Supervision
LPC Models and Techniques in Clinical SupervisionGlenn Duncan
 
IS White Paper 1
IS White Paper 1IS White Paper 1
IS White Paper 1Ann Casey
 
Pembrokeshire Supervision Guide for Social Services
Pembrokeshire Supervision Guide for Social ServicesPembrokeshire Supervision Guide for Social Services
Pembrokeshire Supervision Guide for Social ServicesAlex Clapson
 
NICHE Building Blocks: Protocols
NICHE Building Blocks:  ProtocolsNICHE Building Blocks:  Protocols
NICHE Building Blocks: Protocolsjjorgens
 
228 Chapter 8 • Measurementto collect more validation data mor.docx
228   Chapter 8 • Measurementto collect more validation data mor.docx228   Chapter 8 • Measurementto collect more validation data mor.docx
228 Chapter 8 • Measurementto collect more validation data mor.docxeugeniadean34240
 
Vicky Scott: Implementing research into practice
Vicky Scott: Implementing research into practiceVicky Scott: Implementing research into practice
Vicky Scott: Implementing research into practiceTHL
 
Introducing a tool into an organization
Introducing a tool into an organizationIntroducing a tool into an organization
Introducing a tool into an organizationYoga Setiawan
 
Ob Hrd Performance Mgment And Councling Pratik Negi
Ob Hrd Performance Mgment And Councling   Pratik NegiOb Hrd Performance Mgment And Councling   Pratik Negi
Ob Hrd Performance Mgment And Councling Pratik Negipratik negi
 
Ob Hrd Performance Mgment And Councling Pratik Negi
Ob Hrd Performance Mgment And Councling   Pratik NegiOb Hrd Performance Mgment And Councling   Pratik Negi
Ob Hrd Performance Mgment And Councling Pratik Negipratik negi
 
Clinical Model of Supervision
Clinical Model of SupervisionClinical Model of Supervision
Clinical Model of SupervisionMahnoor Mirza
 
Fostering & Promoting Integrity in Research.pptx
Fostering & Promoting Integrity in Research.pptxFostering & Promoting Integrity in Research.pptx
Fostering & Promoting Integrity in Research.pptxsheelu57
 
The needle in the haystack: external evaluaitons (Saul Guerro, ACF)
The needle in the haystack: external evaluaitons (Saul Guerro, ACF)The needle in the haystack: external evaluaitons (Saul Guerro, ACF)
The needle in the haystack: external evaluaitons (Saul Guerro, ACF)ALNAP
 
Training need assessment in a 5star ho
Training need assessment in a 5star hoTraining need assessment in a 5star ho
Training need assessment in a 5star hoShamimansary
 
shared governance in nursing.pptx
shared governance in nursing.pptxshared governance in nursing.pptx
shared governance in nursing.pptxSHAOLINCHEN2
 
Training 2015-11-06-change management 2015 november - richard k. wanyama lecture
Training 2015-11-06-change management 2015 november - richard k. wanyama lectureTraining 2015-11-06-change management 2015 november - richard k. wanyama lecture
Training 2015-11-06-change management 2015 november - richard k. wanyama lectureRichard K. Wanyama
 

Similaire à Best practiceguidelines management-of-psychometric-tests (20)

Identifying sharing-good-practices
Identifying sharing-good-practicesIdentifying sharing-good-practices
Identifying sharing-good-practices
 
LPC Models and Techniques in Clinical Supervision
LPC Models and Techniques in Clinical SupervisionLPC Models and Techniques in Clinical Supervision
LPC Models and Techniques in Clinical Supervision
 
IS White Paper 1
IS White Paper 1IS White Paper 1
IS White Paper 1
 
Benchmarking
BenchmarkingBenchmarking
Benchmarking
 
Pembrokeshire Supervision Guide for Social Services
Pembrokeshire Supervision Guide for Social ServicesPembrokeshire Supervision Guide for Social Services
Pembrokeshire Supervision Guide for Social Services
 
NICHE Building Blocks: Protocols
NICHE Building Blocks:  ProtocolsNICHE Building Blocks:  Protocols
NICHE Building Blocks: Protocols
 
228 Chapter 8 • Measurementto collect more validation data mor.docx
228   Chapter 8 • Measurementto collect more validation data mor.docx228   Chapter 8 • Measurementto collect more validation data mor.docx
228 Chapter 8 • Measurementto collect more validation data mor.docx
 
Vicky Scott: Implementing research into practice
Vicky Scott: Implementing research into practiceVicky Scott: Implementing research into practice
Vicky Scott: Implementing research into practice
 
Introducing a tool into an organization
Introducing a tool into an organizationIntroducing a tool into an organization
Introducing a tool into an organization
 
Supervision
SupervisionSupervision
Supervision
 
Ob Hrd Performance Mgment And Councling Pratik Negi
Ob Hrd Performance Mgment And Councling   Pratik NegiOb Hrd Performance Mgment And Councling   Pratik Negi
Ob Hrd Performance Mgment And Councling Pratik Negi
 
Ob Hrd Performance Mgment And Councling Pratik Negi
Ob Hrd Performance Mgment And Councling   Pratik NegiOb Hrd Performance Mgment And Councling   Pratik Negi
Ob Hrd Performance Mgment And Councling Pratik Negi
 
Clinical Model of Supervision
Clinical Model of SupervisionClinical Model of Supervision
Clinical Model of Supervision
 
Fostering & Promoting Integrity in Research.pptx
Fostering & Promoting Integrity in Research.pptxFostering & Promoting Integrity in Research.pptx
Fostering & Promoting Integrity in Research.pptx
 
The needle in the haystack: external evaluaitons (Saul Guerro, ACF)
The needle in the haystack: external evaluaitons (Saul Guerro, ACF)The needle in the haystack: external evaluaitons (Saul Guerro, ACF)
The needle in the haystack: external evaluaitons (Saul Guerro, ACF)
 
Training need assessment in a 5star ho
Training need assessment in a 5star hoTraining need assessment in a 5star ho
Training need assessment in a 5star ho
 
Route to success - sustain
Route to success - sustainRoute to success - sustain
Route to success - sustain
 
shared governance in nursing.pptx
shared governance in nursing.pptxshared governance in nursing.pptx
shared governance in nursing.pptx
 
Training 2015-11-06-change management 2015 november - richard k. wanyama lecture
Training 2015-11-06-change management 2015 november - richard k. wanyama lectureTraining 2015-11-06-change management 2015 november - richard k. wanyama lecture
Training 2015-11-06-change management 2015 november - richard k. wanyama lecture
 
Quality assurance
Quality assuranceQuality assurance
Quality assurance
 

Plus de Dickdick Maulana

Uu no. 44_th_2009_ttg_rumah_sakit
Uu no. 44_th_2009_ttg_rumah_sakit Uu no. 44_th_2009_ttg_rumah_sakit
Uu no. 44_th_2009_ttg_rumah_sakit Dickdick Maulana
 
Kepmenkes 1087-standar-k3-rs
Kepmenkes 1087-standar-k3-rs Kepmenkes 1087-standar-k3-rs
Kepmenkes 1087-standar-k3-rs Dickdick Maulana
 
Pmk no. 541_ttg_program_tugas_belajar_sdm_kesehatan_depkes_ri
Pmk no. 541_ttg_program_tugas_belajar_sdm_kesehatan_depkes_ri Pmk no. 541_ttg_program_tugas_belajar_sdm_kesehatan_depkes_ri
Pmk no. 541_ttg_program_tugas_belajar_sdm_kesehatan_depkes_ri Dickdick Maulana
 
Pmk no. 1199 ttg pedoman pengadaan tenaga kesehatan dengan perjanjian kerja
Pmk no. 1199 ttg pedoman pengadaan tenaga kesehatan dengan perjanjian kerjaPmk no. 1199 ttg pedoman pengadaan tenaga kesehatan dengan perjanjian kerja
Pmk no. 1199 ttg pedoman pengadaan tenaga kesehatan dengan perjanjian kerjaDickdick Maulana
 
Materi HSP Sanitarian RS 2014 Dinkes Jabar
Materi  HSP Sanitarian RS 2014 Dinkes JabarMateri  HSP Sanitarian RS 2014 Dinkes Jabar
Materi HSP Sanitarian RS 2014 Dinkes JabarDickdick Maulana
 
Perda no. 2 thn 2014 b3 final otentifikasi
Perda no. 2 thn 2014  b3 final otentifikasi Perda no. 2 thn 2014  b3 final otentifikasi
Perda no. 2 thn 2014 b3 final otentifikasi Dickdick Maulana
 
Pengelolaan Sampah Melalui Pengurangan
Pengelolaan Sampah Melalui PenguranganPengelolaan Sampah Melalui Pengurangan
Pengelolaan Sampah Melalui PenguranganDickdick Maulana
 
Pp no. 19_th_2003_ttg_pengamanan_rokok_bagi_kesehatan
Pp no. 19_th_2003_ttg_pengamanan_rokok_bagi_kesehatanPp no. 19_th_2003_ttg_pengamanan_rokok_bagi_kesehatan
Pp no. 19_th_2003_ttg_pengamanan_rokok_bagi_kesehatanDickdick Maulana
 
Sufg clean coal technologies report
Sufg clean coal technologies reportSufg clean coal technologies report
Sufg clean coal technologies reportDickdick Maulana
 
Pharmaceutical in drinking water
Pharmaceutical in drinking water Pharmaceutical in drinking water
Pharmaceutical in drinking water Dickdick Maulana
 
Sakit dan lingkungan hidup
Sakit dan lingkungan hidup Sakit dan lingkungan hidup
Sakit dan lingkungan hidup Dickdick Maulana
 
Lingkungan air (hidrosphere) lnjtn.
Lingkungan air (hidrosphere) lnjtn. Lingkungan air (hidrosphere) lnjtn.
Lingkungan air (hidrosphere) lnjtn. Dickdick Maulana
 
Lingkungan air (hidrosphere)
Lingkungan air (hidrosphere) Lingkungan air (hidrosphere)
Lingkungan air (hidrosphere) Dickdick Maulana
 
Metode penelitian survai editor masri singarimbun, sofian effendi
Metode penelitian survai   editor masri singarimbun, sofian effendiMetode penelitian survai   editor masri singarimbun, sofian effendi
Metode penelitian survai editor masri singarimbun, sofian effendiDickdick Maulana
 
Sni 6989.59 2008 metoda pengambilan contoh air limbah
Sni 6989.59 2008 metoda pengambilan contoh air limbahSni 6989.59 2008 metoda pengambilan contoh air limbah
Sni 6989.59 2008 metoda pengambilan contoh air limbahDickdick Maulana
 

Plus de Dickdick Maulana (20)

Uu no. 44_th_2009_ttg_rumah_sakit
Uu no. 44_th_2009_ttg_rumah_sakit Uu no. 44_th_2009_ttg_rumah_sakit
Uu no. 44_th_2009_ttg_rumah_sakit
 
Kepmenkes 1087-standar-k3-rs
Kepmenkes 1087-standar-k3-rs Kepmenkes 1087-standar-k3-rs
Kepmenkes 1087-standar-k3-rs
 
Pmk no. 541_ttg_program_tugas_belajar_sdm_kesehatan_depkes_ri
Pmk no. 541_ttg_program_tugas_belajar_sdm_kesehatan_depkes_ri Pmk no. 541_ttg_program_tugas_belajar_sdm_kesehatan_depkes_ri
Pmk no. 541_ttg_program_tugas_belajar_sdm_kesehatan_depkes_ri
 
Pmk no. 1199 ttg pedoman pengadaan tenaga kesehatan dengan perjanjian kerja
Pmk no. 1199 ttg pedoman pengadaan tenaga kesehatan dengan perjanjian kerjaPmk no. 1199 ttg pedoman pengadaan tenaga kesehatan dengan perjanjian kerja
Pmk no. 1199 ttg pedoman pengadaan tenaga kesehatan dengan perjanjian kerja
 
Materi HSP Sanitarian RS 2014 Dinkes Jabar
Materi  HSP Sanitarian RS 2014 Dinkes JabarMateri  HSP Sanitarian RS 2014 Dinkes Jabar
Materi HSP Sanitarian RS 2014 Dinkes Jabar
 
Perda no. 2 thn 2014 b3 final otentifikasi
Perda no. 2 thn 2014  b3 final otentifikasi Perda no. 2 thn 2014  b3 final otentifikasi
Perda no. 2 thn 2014 b3 final otentifikasi
 
Pengelolaan Sampah
Pengelolaan SampahPengelolaan Sampah
Pengelolaan Sampah
 
Pengelolaan Sampah Melalui Pengurangan
Pengelolaan Sampah Melalui PenguranganPengelolaan Sampah Melalui Pengurangan
Pengelolaan Sampah Melalui Pengurangan
 
Pp no. 19_th_2003_ttg_pengamanan_rokok_bagi_kesehatan
Pp no. 19_th_2003_ttg_pengamanan_rokok_bagi_kesehatanPp no. 19_th_2003_ttg_pengamanan_rokok_bagi_kesehatan
Pp no. 19_th_2003_ttg_pengamanan_rokok_bagi_kesehatan
 
Sufg clean coal technologies report
Sufg clean coal technologies reportSufg clean coal technologies report
Sufg clean coal technologies report
 
Kesling 2
Kesling 2 Kesling 2
Kesling 2
 
Water quality strategy
Water quality strategy Water quality strategy
Water quality strategy
 
Pharmaceutical in drinking water
Pharmaceutical in drinking water Pharmaceutical in drinking water
Pharmaceutical in drinking water
 
Sakit dan lingkungan hidup
Sakit dan lingkungan hidup Sakit dan lingkungan hidup
Sakit dan lingkungan hidup
 
Kesehatan lingkungan
Kesehatan lingkungan Kesehatan lingkungan
Kesehatan lingkungan
 
Lingkungan air (hidrosphere) lnjtn.
Lingkungan air (hidrosphere) lnjtn. Lingkungan air (hidrosphere) lnjtn.
Lingkungan air (hidrosphere) lnjtn.
 
Lingkungan air (hidrosphere)
Lingkungan air (hidrosphere) Lingkungan air (hidrosphere)
Lingkungan air (hidrosphere)
 
Metode penelitian survai editor masri singarimbun, sofian effendi
Metode penelitian survai   editor masri singarimbun, sofian effendiMetode penelitian survai   editor masri singarimbun, sofian effendi
Metode penelitian survai editor masri singarimbun, sofian effendi
 
Tetraethyl orthosilicate
Tetraethyl orthosilicateTetraethyl orthosilicate
Tetraethyl orthosilicate
 
Sni 6989.59 2008 metoda pengambilan contoh air limbah
Sni 6989.59 2008 metoda pengambilan contoh air limbahSni 6989.59 2008 metoda pengambilan contoh air limbah
Sni 6989.59 2008 metoda pengambilan contoh air limbah
 

Dernier

A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024Results
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Servicegiselly40
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024The Digital Insurer
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?Antenna Manufacturer Coco
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfsudhanshuwaghmare1
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘RTylerCroy
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?Igalia
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfEnterprise Knowledge
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CVKhem
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 

Dernier (20)

A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 

Best practiceguidelines management-of-psychometric-tests

  • 1. Best Practice Series Guidelines for Best Practice in the Management of Psychometric Tests
  • 2. Contents Page No 1. Introduction 1 2. Why is a policy needed? 2 3. What should a policy look like? 3 4. What should a policy include? 4 4.1 Mission statement 4 4.2 Overall responsibility for testing standards 4 4.3 Who should use tests? 5 4.4 When should tests be used? 6 4.5 Test choice 7 4.6 Equal opportunities 8 4.7 Use of test scores 9 4.8 Confidentiality and storage of results 10 4.9 Responsibility to test takers 11 4.10 Retesting 12 4.11 Monitoring 12 4.12 Access to materials 13 4.13 Copyright 13 4.14 Computers in testing 14 5. Policy management 15 Glossary 16 Useful publications 17
  • 3. 1. Introduction Psychometric tests are powerful tools used by Tests can be used to challenge stereotyped organisations for the selection, development and judgements made by interviewers and often management of people. Tests can be used: enable a more objective analysis to take place than is possible by interviewing alone. • to enhance the decision-making process in Occupational tests have consistently been assessment for selection and promotion shown to be better predictors of job success than interviews. • as an aid to management in areas such as motivation and team building Using tests can lead to substantial gains for an organisation in terms of increased output and • to identify development needs, as a basis for efficiency, better quality staff, higher morale, employee counselling as well as in more effective performance, lower training costs organisational areas such as management of and reduced turnover. change or succession planning. When properly used, psychometric testing helps Psychometric tests provide additional relevant to ensure a common language for assessment information over and above that obtained from standards throughout an organisation, match more traditional assessment methods. For people to jobs, identify individual capabilities and instance, tests aid recruitment processes by predict on-the-job performance. ensuring that all candidates are treated fairly and measured against a common yardstick. Best Practice Series > 1
  • 4. 2. Why is a policy needed? Use of tests must be properly managed in order The aims of every organisation in using tests are to reap the potential benefits. If inappropriate different and policy must be geared to the needs tests are used, or the information from tests is and structures of each organisation. For one misunderstood, or even ignored, there will be no company, a central unit supervising all test use advantage in using tests - indeed there will be may be appropriate. For another, individual test unproductive costs. The management of tests users may be required to take final responsibility should include regular reviews and monitoring to for their own test use. For this reason each ensure the organisational aims are being met. organisation must develop its own way of managing test use and formulate a local In addition, as with any powerful tool, the policy document. potential for misuse is ever present. Bad practice can: The purpose of this booklet is to highlight the areas that ought to be covered in such a formal • reduce the effectiveness of test use policy document. It also provides examples of what policy statements may look like. Readers • cause considerable suffering to individuals are free to use or modify these as appropriate but the statements do not in themselves • damage the company’s image with employees, constitute a policy. trade unions and clients It is beyond the scope of this booklet to provide • lead to contravention of the law and the costs detailed discussion of all the issues that need to and bad publicity associated with litigation. be considered in developing a policy for managing tests. SHL is happy to supply expert consultancy A well-thought out policy on test use will help to services to help organisations create their own ensure that the organisation gains maximum policies for test use if further guidance is desired. benefit from test use and that potential misuse is avoided. It will also demonstrate commitment to good practice. 2 > Best Practice Series
  • 5. 3. What should a policy look like? Policies work best when they are brief and The procedural guidelines put the policy into focused. Long manuals that lie unread in a drawer practice, and then can, and should, be amended have little effect on practice. However, general whenever they cease to meet the aims of the statements of principle tend to be vague, easily organisation or the policy. The detail with which ignored and provide little guidance for the user. such procedures are specified will depend on the nature, style and needs of the organisation. An effective strategy is to have brief policy statements supplemented with more detailed guidelines. The statements can encompass general principles and are likely to need few changes even in changing circumstances. Best Practice Series > 3
  • 6. 4. What should a policy include? 4.1 Mission statement 4.2 Overall responsibility for testing standards It is helpful to start with a short general statement of aims in using tests. This sets the Test users are always responsible for the way tone and purpose of the document. It ensures they personally use tests. However, in some that readers are aware of the positive objectives organisations there is a central unit or department of the use of tests and the reasons for the that decides policy, oversees practices and existence of the policy. Otherwise, a policy provides support for individual users. Often can be seen as restrictive and bureaucratic, such a unit contains one or more professional rather than as a helpful guide to doing occupational psychologists. Sometimes such things well. units have an advisory role; at other times they dictate procedures. Example In other organisations each test user makes his or We use psychometric tests to enhance the her own autonomous decisions regarding the use quality and quantity of information available for of tests; small organisations may only have a few selection, development and training decisions trained users; large organisations may have many and as an aid to organisational change. We are users in a single personnel department or test use committed to the highest standards of practice may be decentralised. in the use of all psychometric tests, in order to Whatever the structure, the responsibilities and maximise the benefit of testing to the accountabilities of each individual must be clearly organisation and the individual, and to promote defined. It is highly recommended that in large fairness and equality of opportunity for all. organisations with high volume test use, one or more chartered psychologists are available to support the design, implementation, validation and review of test procedures either on a consultancy basis or as permanent members of staff. Example Each test user must ensure that he/she uses tests to the highest professional standards and only in accordance with the guidelines set out in this policy. The Central Testing Unit is responsible for ensuring that all test use in this organisation is in accordance with this policy. Any procedure that will involve the use of psychometric testing must be referred to the Unit for approval before implementation. The Unit will provide guidelines for the use of tests that must be followed by all users. 4 > Best Practice Series
  • 7. 4.3 Who should use tests? including scoring, interpretation, feedback and applications, in addition to Level 1 training, in Knowledge and experience are required to use order to qualify an individual in the use of a psychometric tests effectively. It is recognised personality instrument, such as the OPQ. throughout the world that psychometric instruments are potentially dangerous in the The BPS Intermediate Level B certificate is wrong hands. Indeed, in many countries only available for those who have completed this qualified psychologists are allowed to use them. level of training. Further familiarisation training is then required for each additional instrument In the UK, the British Psychological Society to be used. (BPS) has defined a set of essential competencies constituting a minimum standard for any test user. Level 3: The BPS Full level B certificate is All reputable test publishers maintain a register available to those with a deeper and broader of qualified people to whom test materials may perspective on personality and general test use, be supplied. as well as full training in at least two different measures of personality. It is recommended for Access to materials requires both general training those who have responsibility for other test in test use and often familiarisation training for users and policy decisions. SHL can help those the specific instruments in question. Publishers interested to gain the relevant competence. usually give some recognition to training from other reputable providers. There are several Chartered Psychologists: Professional recognised levels of training. occupational psychologists who specialise in testing and assessment have a greater Test Administration: This qualifies the knowledge and experience of the use of tests individual to carry out the standard procedures than can be gained from short training courses. for administering and scoring tests. The BPS Test Administration Certificate covers this level Chartered psychologists have reached a of competence. It does not cover the choice of standard of training and experience required by tests or the interpretation of results. Neither the BPS and have agreed to abide by the BPS does it allow the individual access to materials. code of conduct. Someone trained to this level may only work under the close supervision of a fully trained Qualified users should ensure that materials are test user within the organisation. Some only used appropriately and are not used by organisations rely heavily on test administrators untrained people or for a purpose for which they to relieve more highly trained staff. SHL were not intended. It is also their responsibility to suggests a ratio of one fully trained test user to work within the confines of their own expertise three test administrators to ensure proper and to recognise when refresher training, skills supervision at all times. updates or expert advice is needed. Level 1, Occupational Testing: BPS Level A Example Certificate of Competence covers the basic principles of psychometric testing and the Only trained test users who hold the relevant techniques of selection, administration, scoring, qualifications may use and interpret interpretation and validation of ability tests. psychometric instruments. Trained test users This training course qualifies the individual to may delegate test administration to a person use ability tests and interest inventories. trained in this area. Level 2, Personality Measurement: This covers the theoretical and practical issues involved in the use of measures of personality, Best Practice Series > 5
  • 8. 4.4 When should tests be used? Tests are best used in decision making, in conjunction with other relevant information. In a Tests may be used for selection, (either for promotion decision, test results may be integrated shortlisting or final decisions), placement or with interview performance, track record and promotion decisions, development, team building, managers’ recommendations to provide the best counselling, out-placement and organisational information about individual suitability. Use of a development. It is not possible to discuss the single test result alone should be avoided considerations for using tests in each context in whenever possible. this short booklet. In each case, the situation must be evaluated to see whether test use would Consideration must be given to where test results be appropriate to help achieve the desired fit into a procedure. Tests may be used for objectives. shortlisting from a large pool of applicants, to suggest areas to be explored during an interview, There are some occasions where it is not usually or as a final check on the suitability of a appropriate to use tests. For instance, it is unlikely chosen candidate. that test results would be suitable for making redundancy decisions, since direct information on job performance should be available. Tests can be valuable in making redeployment decisions or in outplacement counselling, however. Similarly, an organisation may want to restrict the use of some tests to counselling or development applications. Example Tests may be used for selection, development and counselling purposes. Any additional uses should be referred to the Central Testing Unit for approval. 6 > Best Practice Series
  • 9. 4.5 Test choice Some organisations may allow individual users to select the test they want to use. Others may Whenever tests are used, it is vital that there is a require the involvement of internal or external match between the skills and characteristics experts in test choice. A middle way would be the measured and the job or organisational demands. provision of a general list of ‘approved’ tests from This is particularly important when selection or which individual users could choose those promotion decisions are based on test results. appropriate to their needs. This allows an organisation to prevent the use of instruments of Objective job analysis is the best way to uncertain quality. It will not control the relevance determine the skills required for a particular job. of measures - in other words the job analysis These skills are then matched to appropriate stage will still be required. tests. In large scale testing procedures, it may be appropriate to perform criterion related validation It is important that whenever tests are chosen studies before test implementation. there is written documentation of the reasons behind the choice. This may include copies of job Trained test users should have the skills to analysis reports, job descriptions, person evaluate the quality and relevance to job specifications, validation studies, etc. If the requirements of an instrument from the relevance of a particular measure is challenged, information provided by the test publisher in the such evidence supports the test choice, test manual. Where insufficient information is shows the care taken and helps ensure users do provided, caution should be exercised in the use not take dangerous shortcuts. of the test. Example All psychometric tests used must be clearly relevant to the given purpose. Detailed job descriptions and person specifications based on objective job analysis must be prepared prior to the choice of tests for any selection or promotion procedures. All decisions to use tests should be clearly documented with a copy sent to the Central Testing Unit. Best Practice Series > 7
  • 10. 4.6 Equal opportunities Users should take particular care when a candidate is not fluent in the language in which Research has shown that well-constructed the tests are presented. Actual ability may be psychometric tests are the single most effective confounded with language proficiency and results predictor of job performance. Tests give objective may be difficult to interpret. information about a candidate and have been shown in general to lead to better and fairer Similar issues arise in the testing of candidates employment decisions. who are disabled. In these cases, it may be necessary to adjust standardised administration Tests of aptitude or ability have sometimes been procedures to allow for the disability, as required found to have disparate impact on ethnic, age or by the Disability Discrimination Act of 1995. gender group; i.e. proportionately fewer members Changes should not be made arbitrarily as this of one ethnic, age or gender group do well in the affects test standardisation. test in some cases. In that these patterns exist, it is particularly important that appropriate Test users can call the SHL Helpline for advice. guidelines are followed to avoid improper use of Guidelines for Best Practice in Testing People with tests and potential contravention of anti- Disabilities is also available from SHL to help in discrimination laws. Considerations of fairness are this process. important in themselves. In addition, there are legal implications of unfair practices in the Example selection and promotion of employees. The organisation is committed to selection on merit and only measures which are clearly The main issues concern choosing relevant relevant to job demands and free of extraneous measures and monitoring outcomes. A full discussion of all the elements of good practice bias should be used. All assessments for can be found in Guidelines for Best Practice in selection and promotion must be monitored to the Use of Personnel Selection Tests, available ensure they do not unfairly exclude or from SHL. disadvantage any section of the population. Whenever a disability prevents a suitably qualified individual from undergoing standard selection procedures, appropriate alternative arrangements for assessment must be found. Always contact the test publisher for advice before making any changes to test administration procedures. 8 > Best Practice Series
  • 11. 4.7 Use of test scores Thought should be given to the integration of test results with other relevant information. This is Interpretation of results should be accurate and particularly important where many different not exceed the limits of the information. Users assessment techniques are used. The booklet should beware, for example, of failing to take Guidelines for Best Practice in the Use of account of the standard error of measurement in Assessment and Development Centres (available interpreting the difference between any two from SHL) discusses the issues that arise here. scores, or of drawing far-fetched inferences from personality data. However, even where only test results and an interview are combined, decisions need to be Appropriate norms should always be used in made about, for instance, whether good interpreting scores. Where no suitable norm performance in one sphere can compensate for groups are provided with a test, further guidance poor performance in the other, or whether some should be sought from the publisher. Large-scale minimum standard needs to be reached on all test users should produce their own local norms elements. Similarly, in the use of personality for ability and aptitude tests. SHL will provide questionnaires, users need to decide whether a clients with their own norm groups, if data is criterion referenced, “danger zone” or integrative submitted for analysis1. approach is to be used. Tests should always be interpreted by properly Example trained individuals in the context of clearly defined criteria. Both quantitative and qualitative Test scores must be interpreted on the basis interpretation can be used. The former should be of relevant norm groups. Fixed cut-offs may restricted to cases where there is sufficient only be imposed where specific evidence of supporting evidence. test relevance is available, e.g. job analysis, validation study. The use of fixed cut-offs with personality measures can be particularly misleading, without The interpretation of test scores is in relevant evidence of validity. Qualitative interpretation may be more appropriate in these accordance with the formula, which will be cases. Decision rules and their rationale should be amended from time to time on the basis of properly documented. ongoing validation results. 1 This service is currently being offered free of charge provided that permission is given to publish the results anonymously. Best Practice Series > 9
  • 12. 4.8 Confidentiality and storage of The Data Protection Act (1998) covers the storage results of any information about an individual, whether on computer or in another form. Test results Test results, like all personal information, should should not be stored or used without candidates’ be stored with due regard to confidentiality. permission and they have a right to see Access should be restricted to those with a need information stored or used, or a meaningful to know and in accordance with what has been interpretation of it. agreed with the respondent during administration and feedback. Persons who are untrained should not be allowed access to raw data from tests, but only to clearly described interpretations. Individuals do change and develop and so psychometric data can become less accurate over time. Test scores should therefore not be kept on file indefinitely. The time period for which scores are valid will differ depending on the nature of the measures and the particular use made of them. Care should be taken with results over 6-12 months old for selection purposes. Little reliance should be put on results over three years old for any purpose. Example Test results should be kept by test users in locked files. A written interpretation of results should be kept in personnel files and provided to relevant individuals. Results over 12 months old are invalid for selection or promotion decisions. All results are to be destroyed after three years or when the respondent ceases to be employed, whichever is the sooner. 10 > Best Practice Series
  • 13. 4.9 Responsibility to test takers After the test session Arrangements should be made to provide Testers should be honest and open with candidates with feedback on their results as soon candidates about why the tests are being used after testing as possible. Personality and and what will happen to the results. Candidates motivation questionnaire feedback is critical and should be offered feedback of their results. will often enhance the interpreter’s own Before the test session understanding of test results. Whenever tests or questionnaires are used it is Feedback does not need to be lengthy, indeed with important that respondents are given clear a large number of applicants this might be very information about the nature of the instruments time consuming. A face to face interview is and the reason for using them. preferred, but computer generated reports supported by telephone feedback may be Candidates should be given examples of the types appropiate in some circumstances. of tests to be used as well as general information about the skills to be tested and practical Feedback should be given by qualified users and information about the testing session. This helps should be accurate and open. Profile charts may to reduce anxiety and allows the candidate to be shown to respondents, but they should not be prepare constructively for the session. It also given copies to take away. A short narrative allows candidates with disabilities to recognise if summary may be provided if desired. This is they will need any special arrangements. particularly useful where testing is for counselling and development purposes. SHL produces a series of practice leaflets as well as complete practice tests, which organisations Computer generated expert system or narrative report writers can support the feedback interview. can supply to individuals before testing, so that Some may be suitable to give to respondents, but they can familiarise themselves with what is many are intended as aids to interpretation for required and prepare accordingly. The use of the trained test user and could easily be practice tests is particularly recommended for misinterpreted by others. Users should follow the older candidates, those with less educational guidelines provided by the author or publisher of experience and others likely to be unfamiliar with such systems. formal testing procedures. The offer of a practice test session is highly desirable, and may be a particularly useful way of supporting internal Example candidates applying for promotion. This organisation is committed to dealing fairly with all candidates to be tested. We will be At the test session open and honest about the use of tests, Make sure all candidates know why and how test provide suitable practice materials and relevant scores are going to be used and who will have feedback whenever tests are used. access to the results. Test administrators should promote a serious but sympathetic atmosphere. It is important to remember that the testing session will be an extremely important event for the candidate, even if it is a routine one for the administrator. Instructions should be clear and not rushed. Administrators should ensure candidates know what they have to do before each test begins and that appropriate accommodation has been made for candidates with disabilities. Best Practice Series > 11
  • 14. 4.10 Retesting 4.11 Monitoring An issue that arises where positions regularly Use of tests and other psychometric instruments become vacant and unsuccessful applicants should be continually monitored to ensure reapply is whether they should (be allowed to) continued appropriateness and effectiveness. In retake tests. There is no hard and fast rule but an small scale applications, this may amount to organisation should have a consistent policy. ensuring that the techniques remain relevant to Results can be allowed to stand for up to 12 the job and that up-to-date test versions and months. It is not desirable to allow candidates to norms are used. Where larger scale use occurs, be retested regularly unless alternate forms of scores should be monitored at regular intervals to the test are available. update norms. However, it is reasonable to allow an applicant to Monitoring by ethnic group, age and gender is be retested where there is evidence that he/she required to identify any adverse impact. might have under-performed the first time, e.g. due to illness. Otherwise, a suitable interval should A validation study should be carried out every generally elapse before retesting is allowed. five years or so, or whenever changes in the job or applicant group are such that initial validity could have been affected. Example For selection purposes a candidate’s test Monitoring might be the responsibility of local results are valid for any similar position for 12 test users, or could be centrally co-ordinated. The months from the date of testing. Candidates performance of a validation study requires detailed knowledge beyond that generally gained may be retested after six months at their in basic level training courses. Advice should be request. Candidates may be retested within sought from a competent chartered psychologist. a shorter period only at the discretion of the relevant personnel manager and should supply details in writing supporting Example their application. Test monitoring forms should be completed for each exercise involving test use and sent to the Central Testing Unit for processing. Whenever more that 100 people are employed in a job category for which tests are used in selection, a validation study must be performed within three years from the commencement of the use of tests. 12 > Best Practice Series
  • 15. 4.12 Access to materials 4.13 Copyright This element of a policy should cover who can buy Test materials are extremely vulnerable to materials, where they are stored and who has copyright infringement. In most countries, the access. The security of materials is paramount. reproduction of test materials by any means Free circulation leads to over familiarity and (including computer installations) without the devalues psychometric instruments. Responsible permission of the author is a criminal offence, test publishers only supply materials to trained whether or not the reproduced materials are to be users, who, in turn, must ensure untrained users sold. Illegal copying of materials leads to lack of do not gain access to them. standardisation and poor control of materials, and gives respondents a bad impression. Ultimately, Within an organisation decisions should be taken the resulting loss of income will contribute to less about who should hold test materials and who new test development, poorer updating services, should have access. It may not be desirable for all or higher prices. users to have access to all materials. Central storage can help prevent unnecessary duplication The responsibility for obtaining the publisher’s of materials but may not be practical in permission to install a particular test on a generic decentralised organisations. computer “shell system” rests with the user, not the supplier, of such a system. The user will be in An organisation must supply test users with breach of copyright if permission from the appropriate storage space where tests can be kept publisher has not been obtained. under lock and key. It is highly desirable that all materials are logged in and out of a test store. All SHL materials, including profile charts and This helps ensure materials are not carelessly left software supplied on computer installations, are lying around and prevents them going astray. subject to copyright. SHL has in the past actively pursued potential breaches of copyright where Failure to keep track of materials can be these are discovered and will continue to do so in expensive where replacements have to be the future. purchased or annual lease fees paid on missing booklets. Access to computer-based testing Example should be controlled by restricted passwords or other appropriate means. Under no circumstances should any test materials be photocopied or installed on computer without the test publisher’s Example express permission. Computer-generated reports should be used to standardise and support interpretations. Only trained users can authorise the use of computer-generated reports in a testing process. Appropriate reports can be passed to candidates or line managers, but only with the provision of a named contact in case of questions. Best Practice Series > 13
  • 16. 4.14 Computers in testing Where tests are administered remotely via the internet, test takers should be provided with Computers can provide great benefits to testing appropriate information about the process and processes, in standardising administration, help should be available if required. Where testing developing interpretation as well as managing is not fully controlled, interpretation of scores and scoring and handling data. In general, the policy decision-making, e.g. final decisions, should be considerations for using computerised tests are supported by supervised testing. the same as for any other assessment medium. Remote Internet-based testing should only be The test must be appropriate for its purpose. used for development purposes or when Computer-based administration must still be supported by selected supervised retesting. controlled by a trained administrator. Use of the Internet for remote administration can lead to uncontrolled conditions without care. Computer-generated interpretation can aid trained test users, but cannot replace them. Even when a computer system takes over much of the testing procedure, its use should always be supervised by a fully trained user. Example Test users must ensure that all test materials are securely stored. An accurate log should be kept of all test materials held. The log should be updated whenever materials are removed, replaced or added to the store. 14 > Best Practice Series
  • 17. 5. Policy management Thought should be given to the implementation A review procedure should form part of the policy procedure for the policy, to ensure that test users to ensure it remains relevant to the needs of the are aware of the requirements and are committed organisation. This should specify when and how to working within them. Communication is the workings of the policy will be examined and essential in this process. Test users should how changes are to be made. understand the function of the policy in preserving high standards. Commitment from the top is essential in implementing a policy successfully. Managers should ensure that they promote a supportive atmosphere towards the policy and actively implement it themselves. Example It is the responsibility of all test users to ensure that this policy is applied at all times. All deviations should be reported to the personnel manager who will take appropriate action. The personnel manager will formally review the functioning of the policy after six months initially and then every two years. Suggestions for changes and amendments should be addressed directly to the personnel manager. Best Practice Series > 15
  • 18. Glossary Ability test: A test designed to measure a specific Personality questionnaire: A questionnaire which competence such as verbal reasoning or clerical looks at the typical behaviour, interpersonal style, checking. thoughts and/or feelings of an individual. Aptitude test: A test designed to measure Practice leaflet: A leaflet provided to a test taker potential performance in a given area - usually before a testing session, providing a short through existing abilities. description of the tests to be administered and a few example items. Cut-off: The score on a test that separates those selected from those rejected (the ‘pass’ mark). Practice test: Test provided to a test taker before a testing session that are similar to those to be Disparate impact: A selection criterion has used in the session, to allow the test taker to disparate (or adverse) impact when proportionately become familiar with test demands and test fewer members of one ethnic, age or gender group procedures. can meet the criterion. Practice test session: A session where (practice) Feedback: The process of reporting back to test tests are administered under standard test takers their results. At its best, this is an conditions in order to help a test taker become interactive process that enhances the familiar with test demands, conditions and understanding of both the test taker and the test procedures. interpreter about the individual. Profile chart: A display of a number of test results Interest inventory: A questionnaire designed to from the same individual showing relative high and reveal the preferences of an individual for different low scores in the different areas tested. jobs and job areas. They are most often used in career counselling. Psychometric test: A standardised measure of a psychological construct that produces scores which Job analysis: A structured examination of the are accurate and valid. tasks inherent in a job and the skills required to perform them. Qualitative interpretation: Interpretation based on an integration of the content of a series of Job description: A structured report of the tasks, results. The meaning of an individual score will functions and responsibilities required in a job. differ according to the constellation of all the other scores. Local norms: A norm group (see norms) based on a representative sample of people from the Quantitative interpretation: Interpretation based organisation in question, e.g. previous applicants on fixed rules applied to numerical scores. for the same job. Standard error of measurement: A measure of Norms: Standard distributions of test scores based the accuracy of test scores. on the performance of a representative sample of a given group. Psychometric test scores are Validation: The process of investigating the extent interpreted through comparison with relevant to which an instrument measures what it is norm groups. designed to measure. Often the extent to which test scores can predict current or future job Person specification: A structured description of performance or some other relevant criterion. skills, abilities, characteristics and circumstances required to optimally perform a job. 16 > Best Practice Series
  • 19. Useful publications Avoiding Sex Bias in Selection Testing: Guidance For Employers. Equal Opportunities Commission, 1988. Code of Good Practice in Psychological Testing. Steering Committee for Test Standards, British Psychological Society, 2002. Essentials of Psychological Testing. Cronback, L. Harper and Row, 1990. Guidelines for Best Practice in the Use of Personnel Selection Tests. SHL, 2005. Guidelines for Best Practice in Testing People with Disabilities. SHL, 2000. Guidelines for The Development and Use of Computer Based Assessments. British Psychological Society, 2002. International Guidelines on Test Use. International Test Commission, 2000. Occupational Testing Course Notes. SHL, 2004. Psychological Testing: A Manager’s Guide. Toplis, J., Dulewicz, V. and Fletcher, C. Chartered Institute of Personnel and Development (4th edition), 2005. Psychological Testing: A Test User’s Guide. Steering Committee on Test Standards. The British Psychological Society, 2002. Psychometric Tests and Racial Equality: A Guide for Employers. Commission for Racial Equality, 1992. Psychometric Testing and Visual Impairment: An Employer’s Guide. RNIB, 2000. Selection Tests and Sex Bias. Pearn, M.A., Kandola, R.S. and Mottram, R.D. HMSO, London, 1987. Standards for Educational and Psychological Testing. AERA, NCME, APA, 1999. Towards Fair Selection: A Survey of Test Practice and Thirteen Case Studies. Commission for Racial Equality, London, 1993. www.acas.org.uk Home of the Advisory Conciliation and Arbitration Service. www.psychtesting.org.uk Home of the British Psychological Society’s Psychological Testing Centre. www.bps.org.uk Home of British Psychological Society. www.cre.gov.uk Home of the Commission for Racial Equality. www.drc-gb.org Home of the Disability Rights Commission. www.eoc.org.uk Home of the Equal Opportunities Commission. www.intestcom.org Home of the International Testing Commission. Best Practice Series > 17
  • 20. Guidelines for Best Practice in the Management of Psychometric Tests Whilst SHL has used every effort to ensure that these guidelines reflect best practice, SHL does not accept liability for any loss of whatsoever nature suffered by any person or entity as a result of placing reliance on these guidelines. Users who have concerns are urged to seek professional advice before implementing tests. The reproduction of these guidelines by duplicating machine, photocopying process or any other method, including computer installations, is breaking the copyright law. SHL is a registered trademark of SHL Group plc, which is registered in the United Kingdom and other countries © SHL Group plc, 2005 United Kingdom The Pavilion 1 Atwell Place Thames Ditton Surrey KT7 0NE Client Support Centre: 0870 070 8000 UK BP6 V1 UKE 3208 Fax: (020) 8335 7000 info.uk@shlgroup.com www.shl.com