Soumettre la recherche
Mettre en ligne
formseminar_module8.ppt
•
Télécharger en tant que PPT, PDF
•
0 j'aime
•
17 vues
T
ThemovieCorner
Suivre
Data collection
Lire moins
Lire la suite
Formation
Signaler
Partager
Signaler
Partager
1 sur 59
Télécharger maintenant
Recommandé
data collection.ppt
data collection.ppt
Yashwanth Rm
Introduction to Data Collection Methods Tools (1).ppt
Introduction to Data Collection Methods Tools (1).ppt
KalumPalihawadana1
data collection and Interpretation.ppt
data collection and Interpretation.ppt
Geetanjali Mishra
data collection.ppt
data collection.ppt
SwatiHans10
chapter 5.ppt data collection and analysis
chapter 5.ppt data collection and analysis
etebarkhmichale
COMMUNITY NEED ASSESSMENT.pptx
COMMUNITY NEED ASSESSMENT.pptx
GhaffarAhmed9
Data Analytics-Unit 1 , this Is ppt for student help
Data Analytics-Unit 1 , this Is ppt for student help
SaurabhJaiswal790114
WEEK2-S2 (2).pptx
WEEK2-S2 (2).pptx
KingshukBose6
Recommandé
data collection.ppt
data collection.ppt
Yashwanth Rm
Introduction to Data Collection Methods Tools (1).ppt
Introduction to Data Collection Methods Tools (1).ppt
KalumPalihawadana1
data collection and Interpretation.ppt
data collection and Interpretation.ppt
Geetanjali Mishra
data collection.ppt
data collection.ppt
SwatiHans10
chapter 5.ppt data collection and analysis
chapter 5.ppt data collection and analysis
etebarkhmichale
COMMUNITY NEED ASSESSMENT.pptx
COMMUNITY NEED ASSESSMENT.pptx
GhaffarAhmed9
Data Analytics-Unit 1 , this Is ppt for student help
Data Analytics-Unit 1 , this Is ppt for student help
SaurabhJaiswal790114
WEEK2-S2 (2).pptx
WEEK2-S2 (2).pptx
KingshukBose6
Data Collection Methods.pptx
Data Collection Methods.pptx
ssuser6199b7
Chapter_4_Scientific_Research_Methods_Methods_of_Data_Collection.pdf
Chapter_4_Scientific_Research_Methods_Methods_of_Data_Collection.pdf
eyuelmulugeta
Research instruments
Research instruments
zain khan
271_33_powerpoint-slides_chapter-6-types-sources-data.ppt
271_33_powerpoint-slides_chapter-6-types-sources-data.ppt
SrikantKapoor1
Data Collection Methods_Seminar.pptx
Data Collection Methods_Seminar.pptx
ShruthiMalipatil1
Unit4-Data collection.pptx
Unit4-Data collection.pptx
Praveen Kumar
Unit4-Data collection.pptx
Unit4-Data collection.pptx
Praveen Kumar
Unit4-Data collection.pptx
Unit4-Data collection.pptx
Praveen Kumar
Unit4-Data collection.pptx
Unit4-Data collection.pptx
Praveen Kumar
Data Collection Method ppt
Data Collection Method ppt
Maaz ul haq
Research process quantitative and qualitative
Research process quantitative and qualitative
EMERENSIA X
Research Methodology Workshop - Quantitative and Qualitative
Research Methodology Workshop - Quantitative and Qualitative
Hanna Stahlberg
secondary and primary data.pptx
secondary and primary data.pptx
CHIRANTANMONDAL2
biostatistics for eving degree N&M recentstudent2.ppt
biostatistics for eving degree N&M recentstudent2.ppt
Fatima117039
Researchpe-5.pptx
Researchpe-5.pptx
Parwez17
T3 data collecting techniques
T3 data collecting techniques
kompellark
Statistics for business decisions
Statistics for business decisions
Yeshwanth Gowda
Different Methods of Collection of Data
Different Methods of Collection of Data
P. Veeresha
Data collection methods RSS6 2014
Data collection methods RSS6 2014
RSS6
Lec 6 - Data Collection.pdf
Lec 6 - Data Collection.pdf
MohamedAli17961
6967176.ppt
6967176.ppt
ThemovieCorner
Indian contract act 1876.ppt
Indian contract act 1876.ppt
ThemovieCorner
Contenu connexe
Similaire à formseminar_module8.ppt
Data Collection Methods.pptx
Data Collection Methods.pptx
ssuser6199b7
Chapter_4_Scientific_Research_Methods_Methods_of_Data_Collection.pdf
Chapter_4_Scientific_Research_Methods_Methods_of_Data_Collection.pdf
eyuelmulugeta
Research instruments
Research instruments
zain khan
271_33_powerpoint-slides_chapter-6-types-sources-data.ppt
271_33_powerpoint-slides_chapter-6-types-sources-data.ppt
SrikantKapoor1
Data Collection Methods_Seminar.pptx
Data Collection Methods_Seminar.pptx
ShruthiMalipatil1
Unit4-Data collection.pptx
Unit4-Data collection.pptx
Praveen Kumar
Unit4-Data collection.pptx
Unit4-Data collection.pptx
Praveen Kumar
Unit4-Data collection.pptx
Unit4-Data collection.pptx
Praveen Kumar
Unit4-Data collection.pptx
Unit4-Data collection.pptx
Praveen Kumar
Data Collection Method ppt
Data Collection Method ppt
Maaz ul haq
Research process quantitative and qualitative
Research process quantitative and qualitative
EMERENSIA X
Research Methodology Workshop - Quantitative and Qualitative
Research Methodology Workshop - Quantitative and Qualitative
Hanna Stahlberg
secondary and primary data.pptx
secondary and primary data.pptx
CHIRANTANMONDAL2
biostatistics for eving degree N&M recentstudent2.ppt
biostatistics for eving degree N&M recentstudent2.ppt
Fatima117039
Researchpe-5.pptx
Researchpe-5.pptx
Parwez17
T3 data collecting techniques
T3 data collecting techniques
kompellark
Statistics for business decisions
Statistics for business decisions
Yeshwanth Gowda
Different Methods of Collection of Data
Different Methods of Collection of Data
P. Veeresha
Data collection methods RSS6 2014
Data collection methods RSS6 2014
RSS6
Lec 6 - Data Collection.pdf
Lec 6 - Data Collection.pdf
MohamedAli17961
Similaire à formseminar_module8.ppt
(20)
Data Collection Methods.pptx
Data Collection Methods.pptx
Chapter_4_Scientific_Research_Methods_Methods_of_Data_Collection.pdf
Chapter_4_Scientific_Research_Methods_Methods_of_Data_Collection.pdf
Research instruments
Research instruments
271_33_powerpoint-slides_chapter-6-types-sources-data.ppt
271_33_powerpoint-slides_chapter-6-types-sources-data.ppt
Data Collection Methods_Seminar.pptx
Data Collection Methods_Seminar.pptx
Unit4-Data collection.pptx
Unit4-Data collection.pptx
Unit4-Data collection.pptx
Unit4-Data collection.pptx
Unit4-Data collection.pptx
Unit4-Data collection.pptx
Unit4-Data collection.pptx
Unit4-Data collection.pptx
Data Collection Method ppt
Data Collection Method ppt
Research process quantitative and qualitative
Research process quantitative and qualitative
Research Methodology Workshop - Quantitative and Qualitative
Research Methodology Workshop - Quantitative and Qualitative
secondary and primary data.pptx
secondary and primary data.pptx
biostatistics for eving degree N&M recentstudent2.ppt
biostatistics for eving degree N&M recentstudent2.ppt
Researchpe-5.pptx
Researchpe-5.pptx
T3 data collecting techniques
T3 data collecting techniques
Statistics for business decisions
Statistics for business decisions
Different Methods of Collection of Data
Different Methods of Collection of Data
Data collection methods RSS6 2014
Data collection methods RSS6 2014
Lec 6 - Data Collection.pdf
Lec 6 - Data Collection.pdf
Plus de ThemovieCorner
6967176.ppt
6967176.ppt
ThemovieCorner
Indian contract act 1876.ppt
Indian contract act 1876.ppt
ThemovieCorner
company act 1956.ppt
company act 1956.ppt
ThemovieCorner
consumer protective act7.ppt
consumer protective act7.ppt
ThemovieCorner
psus-role-in-nation-building.ppt
psus-role-in-nation-building.ppt
ThemovieCorner
8075399.ppt
8075399.ppt
ThemovieCorner
Surya-Deva-presentation.ppt
Surya-Deva-presentation.ppt
ThemovieCorner
MLA_Format-1.ppt
MLA_Format-1.ppt
ThemovieCorner
mla-8-2017_powerpoint_presentation.pptx
mla-8-2017_powerpoint_presentation.pptx
ThemovieCorner
Presentation.pptx
Presentation.pptx
ThemovieCorner
Health_Welfare_Provisions (1).pptx
Health_Welfare_Provisions (1).pptx
ThemovieCorner
hrd-for-workers-1.pptx
hrd-for-workers-1.pptx
ThemovieCorner
ppt HRM.pptx
ppt HRM.pptx
ThemovieCorner
Plus de ThemovieCorner
(13)
6967176.ppt
6967176.ppt
Indian contract act 1876.ppt
Indian contract act 1876.ppt
company act 1956.ppt
company act 1956.ppt
consumer protective act7.ppt
consumer protective act7.ppt
psus-role-in-nation-building.ppt
psus-role-in-nation-building.ppt
8075399.ppt
8075399.ppt
Surya-Deva-presentation.ppt
Surya-Deva-presentation.ppt
MLA_Format-1.ppt
MLA_Format-1.ppt
mla-8-2017_powerpoint_presentation.pptx
mla-8-2017_powerpoint_presentation.pptx
Presentation.pptx
Presentation.pptx
Health_Welfare_Provisions (1).pptx
Health_Welfare_Provisions (1).pptx
hrd-for-workers-1.pptx
hrd-for-workers-1.pptx
ppt HRM.pptx
ppt HRM.pptx
Dernier
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17
Celine George
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
kauryashika82
psychiatric nursing HISTORY COLLECTION .docx
psychiatric nursing HISTORY COLLECTION .docx
PoojaSen20
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
QucHHunhnh
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global Impact
PECB
Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdf
agholdier
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.
christianmathematics
Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptx
VishalSingh1417
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
iammrhaywood
Gardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch Letter
MateoGardella
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
KokoStevan
PROCESS RECORDING FORMAT.docx
PROCESS RECORDING FORMAT.docx
PoojaSen20
Seal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptx
negromaestrong
Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.
MateoGardella
fourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writing
TeacherCyreneCayanan
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
Celine George
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
QucHHunhnh
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The Basics
TechSoup
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
heathfieldcps1
Application orientated numerical on hev.ppt
Application orientated numerical on hev.ppt
RamjanShidvankar
Dernier
(20)
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
psychiatric nursing HISTORY COLLECTION .docx
psychiatric nursing HISTORY COLLECTION .docx
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdf
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.
Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
Gardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch Letter
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
PROCESS RECORDING FORMAT.docx
PROCESS RECORDING FORMAT.docx
Seal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptx
Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.
fourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writing
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The Basics
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
Application orientated numerical on hev.ppt
Application orientated numerical on hev.ppt
formseminar_module8.ppt
1.
IPDET Module 8: Selecting and
Constructing Data Collection Instruments
2.
IPDET © 2009 2 Introduction •
Data Collection Strategies • Characteristics of Good Measures • Quantitative and Qualitative Data • Tools for Collecting Data
3.
IPDET © 2009 3 Data
Collection Strategies • No one best way: decision depends on: – What you need to know: numbers or stories – Where the data reside: environment, files, people – Resources and time available – Complexity of the data to be collected – Frequency of data collection – Intended forms of data analysis
4.
IPDET © 2009 4 Rules
for Collecting Data • Use multiple data collection methods • Use available data, but need to know – how the measures were defined – how the data were collected and cleaned – the extent of missing data – how accuracy of the data was ensured
5.
IPDET © 2009 5 Rules
for Collecting Data • If must collect original data: – be sensitive to burden on others – pre-test, pre-test, pre-test – establish procedures and follow them (protocol) – maintain accurate records of definitions and coding – verify accuracy of coding, data input
6.
IPDET © 2009 6 Structured
Approach • All data collected in the same way • Especially important for multi-site and cluster evaluations so you can compare • Important when you need to make comparisons with alternate interventions
7.
IPDET © 2009 7 Use
Structured Approach When: • need to address extent questions • have a large sample or population • know what needs to be measured • need to show results numerically • need to make comparisons across different sites or interventions
8.
IPDET © 2009 8 Semi-structured
Approach • Systematic and follow general procedures but data are not collected in exactly the same way every time • More open and fluid • Does not follow a rigid script – may ask for more detail – people can tell what they want in their own way
9.
IPDET © 2009 9 Use
Semi-structured Approach when: • conducting exploratory work • seeking understanding, themes, and/or issues • need narratives or stories • want in-depth, rich, “backstage” information • seek to understand results of data that are unexpected
10.
IPDET © 2009 10 Characteristics
of Good Measures • Is the measure relevant? • Is the measure credible? • Is the measure valid? • Is the measure reliable?
11.
Relevance Does the measure capture what
matters? Do not measure what is easy instead of what is needed IPDET © 2009 11
12.
IPDET © 2009 12 Credibility Is
the measure believable? Will it be viewed as a reasonable and appropriate way to capture the information sought?
13.
Internal Validity How well
does the measure capture what it is supposed to? Are waiting lists a valid measure of demand? IPDET © 2009 13
14.
Reliability A measure’s precision and stability-
extent to which the same result would be obtained with repeated trials How reliable are: – birth weights of newborn infants? – speeds measured by a stopwatch? IPDET © 2009 14
15.
IPDET © 2009 15 Quantitative
Approach • Data in numerical form • Data that can be precisely measured – age, cost, length, height, area, volume, weight, speed, time, and temperature • Harder to develop • Easier to analyze
16.
IPDET © 2009 16 Qualitative
Approach • Data that deal with description • Data that can be observed or self-reported, but not always precisely measured • Less structured, easier to develop • Can provide “rich data” — detailed and widely applicable • Is challenging to analyze • Is labor intensive to collect • Usually generates longer reports
17.
IPDET © 2009 17 Which
Data? - do not need to quantify the results - are not sure what you are able to measure Qualitative - want narrative or in-depth information - want to cover a large group - want to be precise - know what you want to measure Quantitative - want to conduct statistical analysis Then Use: If you:
18.
Obtrusive vs. Unobtrusive Methods Obtrusive data
collection methods that directly obtain information from those being evaluated e.g. interviews, surveys, focus groups Unobtrusive data collection methods that do not collect information directly from evaluees e.g., document analysis, GoogleEarth, observation at a distance, trash of the stars IPDET © 2009 18
19.
IPDET © 2009 19 How
to Decide on Data Collection Approach • Choice depends on the situation • Each technique is more appropriate in some situations than others • Caution: All techniques are subject to bias
20.
Triangulation to Increase Accuracy
of Data • Triangulation of methods – collection of same information using different methods • Triangulation of sources – collection of same information from a variety of sources • Triangulation of evaluators – collection of same information from more than one evaluator IPDET © 2009 20
21.
IPDET © 2009 21 Data
Collection Tools • Participatory Methods • Records and Secondary Data • Observation • Surveys and Interviews • Focus Groups • Diaries, Journals, Self-reported Checklists • Expert Judgment • Delphi Technique • Other Tools
22.
IPDET © 2009 22 Tool
1: Participatory Methods • Involve groups or communities heavily in data collection • Examples: – community meetings – mapping – transect walks
23.
Community Meetings • One
of the most common participatory methods • Must be well organized – agree on purpose – establish ground rules • who will speak • time allotted for speakers • format for questions and answers IPDET © 2009 23
24.
IPDET © 2009 24 Mapping •
Drawing or using existing maps • Useful tool to involve stakeholders – increases understanding of the community – generates discussions, verifies secondary sources of information, perceived changes • Types of mapping: – natural resources, social, health, individual or civic assets, wealth, land use, demographics
25.
Transect Walks • Evaluator
walks around community observing people, surroundings, and resources • Need good observation skills • Walk a transect line through a map of a community — line should go through all zones of the community IPDET © 2009 25
26.
IPDET © 2009 26 Tool
2: Records and Secondary Data • Examples of sources: – files/records – computer data bases – industry or government reports – other reports or prior evaluations – census data and household survey data – electronic mailing lists and discussion groups – documents (budgets, organizational charts, policies and procedures, maps, monitoring reports) – newspapers and television reports
27.
IPDET © 2009 27 Using
Existing Data Sets Key issues: validity, reliability, accuracy, response rates, data dictionaries, and missing data rates
28.
IPDET © 2009 28 Advantage/Challenge: Available
Data Advantages Often less expensive and faster than collecting the original data again Challenges There may be coding errors or other problems. Data may not be exactly what is needed. You may have difficulty getting access. You have to verify validity and reliability of data
29.
IPDET © 2009 29 Tool
3: Observation • See what is happening – traffic patterns – land use patterns – layout of city and rural areas – quality of housing – condition of roads – conditions of buildings – who goes to a health clinic
30.
Observation is Helpful when: •
need direct information • trying to understand ongoing behavior • there is physical evidence, products, or outputs than can be observed • need to provide alternative when other data collection is infeasible or inappropriate IPDET © 2009 30
31.
Degree of Structure
of Observations • Structured: determine, before the observation, precisely what will be observed before the observation • Unstructured: select the method depending upon the situation with no pre-conceived ideas or a plan on what to observe • Semi-structured: a general idea of what to observe but no specific plan IPDET © 2009 31
32.
Google Earth IPDET ©
2009 32 • Maps and satellite images for complex or pinpointed regional searches • Has an Advanced version and an Earth Outreach version • Web site for Google Earth – http://earth.google.com/
33.
Ways to Record
Information from Observations • Observation guide – printed form with space to record • Recording sheet or checklist – Yes/no options; tallies, rating scales • Field notes – least structured, recorded in narrative, descriptive style IPDET © 2009 33
34.
IPDET © 2009 34 Guidelines
for Planning Observations • Have more than one observer, if feasible • Train observers so they observe the same things • Pilot test the observation data collection instrument • For less structured approach, have a few key questions in mind
35.
IPDET © 2009 35 Advantages
and Challenges: Observation Advantages Collects data on actual vs. self- reported behavior or perceptions. It is real-time vs. retrospective Challenges Observer bias, potentially unreliable; interpretation and coding challenges; sampling can be a problem; can be labor intensive; low response rates
36.
IPDET © 2009 36 Tool
4: Surveys and Interviews • Excellent for asking people about: – perceptions, opinions, ideas • Less accurate for measuring behavior • Sample should be representative of the whole • Big problem with response rates
37.
IPDET © 2009 37 Structures
for Surveys • Structured: – Precisely worded with a range of pre-determined responses that the respondent can select – Everyone asked exactly the same questions in exactly the same way, given exactly the same choices • Semi-structured – Asks same general set of questions but answers to the questions are predominantly open-ended
38.
IPDET © 2009 38 Structured
vs. Semi-structured Surveys Structured harder to develop easier to complete easier to analyze more efficient when working with large numbers Semi- structured easier to develop: open ended questions more difficult to complete: burdensome for people to complete as a self-administrated questionnaire harder to analyze but provide a richer source of data, interpretation of open-ended responses subject to bias
39.
IPDET © 2009 39 Modes
of Survey Administration • Telephone surveys • Self-administered questionnaires distributed by mail, e-mail, or websites • Administered questionnaires, common in the development context • In development context, often issues of language and translation
40.
IPDET © 2009 40 Mail
/ Phone / Internet Surveys • Literacy issues • Consider accessibility – reliability of postal service – turn-around time • Consider bias – What population segment has telephone access? Internet access?
41.
IPDET © 2009 41 Advantages
and Challenges of Surveys Advantages Best when you want to know what people think, believe, or perceive, only they can tell you that Challenges People may not accurately recall their behavior or may be reluctant to reveal their behavior if it is illegal or stigmatized. What people think they do or say they do is not always the same as what they actually do.
42.
IPDET © 2009 42 Interviews •
Often semi-structured • Used to explore complex issues in depth • Forgiving of mistakes: unclear questions can be clarified during the interview and changed for subsequent interviews • Can provide evaluators with an intuitive sense of the situation
43.
IPDET © 2009 43 Challenges
of Interviews • Can be expensive, labor intensive, and time consuming • Selective hearing on the part of the interviewer may miss information that does not conform to pre-existing beliefs • Cultural sensitivity: e.g., gender issues
44.
IPDET © 2009 44 Tool
5: Focus Groups • Type of qualitative research where small homogenous groups of people are brought together to informally discuss specific topics under the guidance of a moderator • Purpose: to identify issues and themes, not just interesting information, and not “counts”
45.
Focus Groups Are Inappropriate
when: • language barriers are insurmountable • evaluator has little control over the situation • trust cannot be established • free expression cannot be ensured • confidentiality cannot be assured IPDET © 2009 45
46.
IPDET © 2009 46 Focus
Group Process Phase Action 1 Opening Ice-breaker; explain purpose; ground rules; introductions 2 Warm- up Relate experience; stimulate group interaction; start with least threatening and simplest questions 3 Main body Move to more threatening or sensitive and complex questions; elicit deep responses; connect emergent data to complex, broad participation 4 Closure End with closure-type questions; summarize and refine; present theories, etc; invite final comments or insights; thank participants
47.
IPDET © 2009 47 Advantages
and Challenges of Focus Groups Advantages Can be conducted relatively quickly and easily; may take less staff time than in-depth, in-person interviews; allow flexibility to make changes in process and questions; can explore different perspectives; can be fun Challenges Analysis is time consuming; participants not be representative of population, possibly biasing the data; group may be influenced by moderator or dominant group members
48.
IPDET © 2009 48 Tool
6: Diaries and Self- Reported Checklists • Use when you want to capture information about events in people’s daily lives • Participants capture experiences in real- time not later in a questionnaire • Used to supplement other data collection
49.
IPDET © 2009 49 Guidelines
for Diaries or Journals Step Process 1 Recruit people face-to-face • encourage participation, appeal to altruism, assure confidentiality, provide incentive 2 Provide a booklet to each participant • cover page with clear instructions, definitions, example • short memory-joggers, explain terms, comments on last page , calendar 3 Consider the time-period for collecting data • if too long, may become burdensome or tedious • if too short may miss the behavior or event
50.
IPDET © 2009 50 Self-reported
Checklists • Cross between a questionnaire and a diary • The evaluator specifies a list of behaviors or events and asks the respondents to complete the checklist • Done over a period of time to capture the event or behavior • More quantitative approach than diary
51.
IPDET © 2009 51 Advantages
and Challenges of Diaries and Self-reported Checklists Advantages Can capture in-depth, detailed data that might be otherwise forgotten Can collect data on how people use their time Can collect sensitive information Supplements interviews provide richer data Challenges Requires some literacy May change behavior Require commitment and self-discipline Data may be incomplete or inaccurate Poor handwriting, difficult to understand phrases
52.
Tool 7: Expert
Judgment Use of experts, one- on-one or as a panel E.g., Government task forces, Advisory Groups Can be structured or unstructured Issues in selecting experts IPDET © 2009 52
53.
IPDET © 2009 53 Selecting
Experts • Establish criteria for selecting experts not only on recognition as expert but also based on: – areas of expertise – diverse perspectives – diverse political views – diverse technical expertise
54.
IPDET © 2009 54 Advantages
and Challenges of Expert Judgment Advantages Fast, relatively inexpensive Challenges Weak for impact evaluation May be based mostly on perceptions Value of data depends on how credible the experts are perceived to be
55.
IPDET © 2009 55 Tool
8: Delphi Technique • Enables experts to engage remotely in a dialogue and reach consensus, often about priorities • Experts asked specific questions; often rank choices • Responses go to a central source, are summarized and fed back to the experts without attribution • Experts can agree or argue with others’ comments • Process may be iterative
56.
IPDET © 2009 56 Advantages
and Challenges of Delphi Technique Advantages Allows participants to remain anonymous Is inexpensive Is free of social pressure, personality influence, and individual dominance Is conducive to independent thinking Allows sharing of information Challenges May not be representative Has tendency to eliminate extreme positions Requires skill in written communication Requires time and participant commitment
57.
Other Measurement Tools -
scales (weight) - tape measure - stop watches - chemical tests : i.e. quality of water - health testing tools: i.e. blood pressure - aptitude and achievement tests -citizen report cards IPDET © 2009 57
58.
IPDET © 2009 58 Data
Collection Summary Choose more than one data collection technique No “best” tool Do not let the tool drive your work but rather choose the right tool to address the evaluation question
59.
A Final Note…. IPDET
© 2009 “I never guess. It is a capital mistake to theorize before one has data. Insensibly one begins to twist facts and theories, instead of theories to suit facts.” --Sir Arthur Conan Doyle 59 Questions?
Télécharger maintenant