SlideShare une entreprise Scribd logo
1  sur  19
WEEK 2: SURVEY FORM: QUESTIONS, SCALES,
AND APPEARANCE MEASUREMENT: SCALING,
RELIABILITY, VALIDITY
Quantitative Research Methods
AGENDA
• Week 2 Recap (previous week)
• Days 1+2 – Week 3:
• Fink Chapter 3: Getting it Together: Some Practical Concerns
• S&B Chapter 8: Data collection methods: Observation
• Next week assignment and readings…
CHAPTER 2: THE SURVEY FORM: QUESTIONS, SCALES, AND
APPEARANCE.
HOW TO CONDUCT SURVEYS – A STEP BY STEP GUIDE (FINK)
1. Overview and Length Counts
2. Getting the Survey in Order
3. Questionnaire Format: Aesthetics and Other Concerns
4. Branching Questions, or the Infamous ¨Skip¨ Pattern
5. Administration: Who Gives What to Whom?
6. Reliability and Validity: The Quality of Your Survey
7. Selecting and Adapting Surveys
8. Finding Surveys on the Web
9. The Survey is Put on Trail: Guidelines for Pilot Testing
10. A Far-Reaching World: Surveys, Language, and Culture
CHAPTER 2: THE SURVEY FORM: QUESTIONS, SCALES, AND
APPEARANCE.
HOW TO CONDUCT SURVEYS – A STEP BY STEP GUIDE (FINK)
Overview and Length Counts
How long should a survey be? The length of a survey depends on what
you need to know and how many questions are necessary so that the resulting
answers are credible. How much time do they have available, and will they pay
attention to the survey?
CHAPTER 2: THE SURVEY FORM: QUESTIONS, SCALES, AND
APPEARANCE.
HOW TO CONDUCT SURVEYS – A STEP BY STEP GUIDE (FINK)
Getting the Survey in Order
All surveys should be preceded by an introduction and the first set of
questions should be related to the topic described in it.
CHAPTER 2: THE SURVEY FORM: QUESTIONS, SCALES, AND
APPEARANCE.
HOW TO CONDUCT SURVEYS – A STEP BY STEP GUIDE (FINK)
Example: An Introduction to a Telephone Survey and its First Question.
Hello, I am calling from the California University. We are surveying people why live in student housing to find out whether it is a
satisfactory place to live. Your name was selected at random from the housing registry, a directory of students who have
voluntary listed their telephone numbers. Our questionnaires will take no more than 4 minutes. You can interrupt me at any time.
May I ask you the questions?
[If YES, continue. If NO, say thank you, express concern for bothering the person, and hang up.]
[Continue here.]
The first question asks you about your overall satisfaction with the apartment. Do you consider it [read choices]
Definitely Satisfactory
Probably Satisfactory
Probably not Satisfactory
Definitely not Satisfactory
[Do NOT SAY] no opinion or don´t know/wrong answer
CHAPTER 2: THE SURVEY FORM: QUESTIONS, SCALES, AND
APPEARANCE.
HOW TO CONDUCT SURVEYS – A STEP BY STEP GUIDE (FINK)
Checklist to Guide Question Order
• For any given topic, ask relatively objective questions before the subjective ones.
• Move from the most familiar to the least.
• Follow the natural sequence of time.
• See to it that all questions are independent.
• Relatively easy-to-answer questions (including demographic questions such as age
or occupation) should be asked at the end.
• Avoid many items that look alike.
• Sensitive questions should be placed well after the start of the survey but also well
before its conclusion.
• Questions should be in logical order.
CHAPTER 2: THE SURVEY FORM: QUESTIONS, SCALES, AND
APPEARANCE.
HOW TO CONDUCT SURVEYS – A STEP BY STEP GUIDE (FINK)
Questionnaire Format: Aesthetics and Other Concerns
A questionnaire´s appearance is vitally important. A written self-
administered questionnaire that is hard to read can confuse or irritate
respondents.
Do: put just one question on a line. Leave plenty of space for responses.
Don´t: squeeze several questions together. Do not abbreviate questions.
CHAPTER 2: THE SURVEY FORM: QUESTIONS, SCALES, AND
APPEARANCE.
HOW TO CONDUCT SURVEYS – A STEP BY STEP GUIDE (FINK)
Branching Questions, or the Infamous ¨Skip¨ Pattern
If you want to ask about a topic that you know in advance will not be
relevant to everyone in the survey, you might design a form such as the one in
the following example:
3. Do you participate in sports?
a. No (GO TO QUESTION 4)
b. Yes
IF YES, which sports do you perform?
Yes No
Soccer 1 2
Track and Field 1 2
Other, Please name:
CHAPTER 2: THE SURVEY FORM: QUESTIONS, SCALES, AND
APPEARANCE.
HOW TO CONDUCT SURVEYS – A STEP BY STEP GUIDE (FINK)
Administration: Who Gives What to Whom?
Self-administered questionnaires require a great deal of preparation and
monitoring to get a reasonable response rate.
CHAPTER 2: THE SURVEY FORM: QUESTIONS, SCALES, AND
APPEARANCE.
HOW TO CONDUCT SURVEYS – A STEP BY STEP GUIDE (FINK)
Administration: Who Gives What to Whom?
Checklist for using self-administered questionnaires
• Send respondents an advance letter via regular mail or email telling them the purpose of
your questionnaire
• Prepare a short, formal explanation to accompany the questionnaire form.
• Consider sending respondents a summary of the findings.
• If you ask questions that may be construed as personal – such a gender, etc. – explain why
the questions are necessary.
• Keep the questionnaire procedures simple.
• Keep questionnaires short.
• Consider incentives.
• Be prepared to follow up or send reminders.
• If you are doing an online survey: have a hardcopy, instructions, all in one, etc.
CHAPTER 2: THE SURVEY FORM: QUESTIONS, SCALES, AND
APPEARANCE.
HOW TO CONDUCT SURVEYS – A STEP BY STEP GUIDE (FINK)
Reliability and Validity: The Quality of Your Survey
Survey reliability: test-retest reliability (survey same group twice)
equivalency reliability (2 different forms – A & B)
internally consistent (Cronbach Alpha)
CHAPTER 2: THE SURVEY FORM: QUESTIONS, SCALES, AND
APPEARANCE.
HOW TO CONDUCT SURVEYS – A STEP BY STEP GUIDE (FINK)
Selecting and Adapting Surveys
There are many surveys and survey questions that you can get online for
free. Not always appropriate for your research. You do not know if the free
questions have been tried out or analyzed, if so to whom.
CHAPTER 2: THE SURVEY FORM: QUESTIONS, SCALES, AND
APPEARANCE.
HOW TO CONDUCT SURVEYS – A STEP BY STEP GUIDE (FINK)
Finding Surveys on the Web
Gallup Organizations: http://www.gallup.com
General Social Survey: http://www.norc.org/Research/Projects/Pages/general-
social-survey.aspx
National Opinion Research Center: http://norc.uchicago.edu/homepage.htm
The Pew Charitable Trusts: http://www.pewtrusts.org
The Agency for Healthcare Research and Quality:
http://www.ahrq.gov/data/datasources.htm
The U.S. Census http://www.census.gov
The Institute of Education Sciences through the National Center for Education
Statistics: http://nces.ed.gov/datatools/index.asp?DataToolSectionmID=3
CHAPTER 2: THE SURVEY FORM: QUESTIONS, SCALES, AND
APPEARANCE.
HOW TO CONDUCT SURVEYS – A STEP BY STEP GUIDE (FINK)
The Survey is Put on Trail: Guidelines for Pilot Testing
Guidelines for Pilot Testing
1. Try to anticipate the actual circumstances in which the survey will be conducted and make
plans to handle them.
2. You can start by trying out selected portions of the survey in an informal fashion.
3. Choose respondents similar to the ones who will eventually complete the survey.
4. Enlist as many people in the pilot as seems reasonable without wasting your resources.
5. For reliability, focus on the clarity of the questions and the general format of the survey.
6. To help bolster validity, you should ensure that all relevant topics have been included in the
survey (given your resources)
7. Test your ability to get a range of responses. If people truly differ in their views or feelings,
will the survey capture those differences.
CHAPTER 2: THE SURVEY FORM: QUESTIONS, SCALES, AND
APPEARANCE.
HOW TO CONDUCT SURVEYS – A STEP BY STEP GUIDE (FINK)
A Far-Reaching World: Surveys, Language, and Culture
Many surveys are translated into different languages. If you plan on
translating your survey, do not assume that you can automatically reqord each
question into the new language.
AGENDA
• Week 3:
• S&B Chapter 8: Data collection methods: Observation
S&B CHAPTER 8: DATA COLLECTION
METHODS: OBSERVATION
WEEK 3 ASSIGNMENT AND
READINGS…
1. Chapter 3 (Fink) & Chapter 8 (S&B):
2. See Blackboard Learn

Contenu connexe

Tendances

Planning and conducting surveys
Planning and conducting surveysPlanning and conducting surveys
Planning and conducting surveys
Ulster BOCES
 
Social studies school based assessment outline
Social studies school based assessment outlineSocial studies school based assessment outline
Social studies school based assessment outline
Deighton Gooden
 
How To Conduct Survey 209
How To Conduct Survey 209How To Conduct Survey 209
How To Conduct Survey 209
swati18
 

Tendances (19)

Planning and conducting surveys
Planning and conducting surveysPlanning and conducting surveys
Planning and conducting surveys
 
Social studies school based assessment outline
Social studies school based assessment outlineSocial studies school based assessment outline
Social studies school based assessment outline
 
Social studies school based assessment outline
Social studies school based assessment outlineSocial studies school based assessment outline
Social studies school based assessment outline
 
Questionnaires
QuestionnairesQuestionnaires
Questionnaires
 
Questionnaire design spring2004
Questionnaire design spring2004Questionnaire design spring2004
Questionnaire design spring2004
 
How To Create A Questionnaire
How To Create A QuestionnaireHow To Create A Questionnaire
How To Create A Questionnaire
 
Questionnaire
QuestionnaireQuestionnaire
Questionnaire
 
Questionnaire
QuestionnaireQuestionnaire
Questionnaire
 
Design and Development of Questionnaire
Design and Development of Questionnaire Design and Development of Questionnaire
Design and Development of Questionnaire
 
YOUR QUESTIONNAIRE DESIGN CHECKLIST
YOUR QUESTIONNAIRE DESIGN CHECKLIST YOUR QUESTIONNAIRE DESIGN CHECKLIST
YOUR QUESTIONNAIRE DESIGN CHECKLIST
 
How To Conduct Survey 209
How To Conduct Survey 209How To Conduct Survey 209
How To Conduct Survey 209
 
Presentation5 satisfactionsurvey from EDU 652 Week 5
Presentation5 satisfactionsurvey from EDU 652 Week 5Presentation5 satisfactionsurvey from EDU 652 Week 5
Presentation5 satisfactionsurvey from EDU 652 Week 5
 
Social studies school based assessment outline
Social studies school based assessment outlineSocial studies school based assessment outline
Social studies school based assessment outline
 
How to ace Phd/Doctoral final oral defense or viva voce'
How to ace Phd/Doctoral final oral defense or viva voce'How to ace Phd/Doctoral final oral defense or viva voce'
How to ace Phd/Doctoral final oral defense or viva voce'
 
10 step guide to questionnaire design
10 step guide to questionnaire design10 step guide to questionnaire design
10 step guide to questionnaire design
 
Questionnaire
QuestionnaireQuestionnaire
Questionnaire
 
Tips for PhD viva preparation
Tips for PhD viva preparationTips for PhD viva preparation
Tips for PhD viva preparation
 
Questionnaire design and validation
Questionnaire design and validationQuestionnaire design and validation
Questionnaire design and validation
 
Questionnaire design
Questionnaire design Questionnaire design
Questionnaire design
 

Similaire à Week 3

steps in Questionnaire design
steps in Questionnaire designsteps in Questionnaire design
steps in Questionnaire design
heena pathan
 

Similaire à Week 3 (20)

questionnaire_rakhisawlane.ppt
questionnaire_rakhisawlane.pptquestionnaire_rakhisawlane.ppt
questionnaire_rakhisawlane.ppt
 
design of questionnaire
design of questionnairedesign of questionnaire
design of questionnaire
 
QUESTIONNAIRE
QUESTIONNAIREQUESTIONNAIRE
QUESTIONNAIRE
 
BRS SA 2.0 (2021) - Part 3 of 3.pptx
BRS SA 2.0 (2021) - Part 3 of 3.pptxBRS SA 2.0 (2021) - Part 3 of 3.pptx
BRS SA 2.0 (2021) - Part 3 of 3.pptx
 
Chapter 8 data collection
Chapter 8 data collectionChapter 8 data collection
Chapter 8 data collection
 
questionnaire preparation
questionnaire preparationquestionnaire preparation
questionnaire preparation
 
steps in Questionnaire design
steps in Questionnaire designsteps in Questionnaire design
steps in Questionnaire design
 
Survey design workshop
Survey design workshopSurvey design workshop
Survey design workshop
 
Survey design 1
Survey design 1Survey design 1
Survey design 1
 
Survey Research SN.pptx
Survey Research SN.pptxSurvey Research SN.pptx
Survey Research SN.pptx
 
SHANDY-LYN-RECENT-1.pptx
SHANDY-LYN-RECENT-1.pptxSHANDY-LYN-RECENT-1.pptx
SHANDY-LYN-RECENT-1.pptx
 
Questionnaire Design - Meaning, Types, Layout and Process of Designing Questi...
Questionnaire Design - Meaning, Types, Layout and Process of Designing Questi...Questionnaire Design - Meaning, Types, Layout and Process of Designing Questi...
Questionnaire Design - Meaning, Types, Layout and Process of Designing Questi...
 
A look at audience research for your organisation
A look at audience research for your organisationA look at audience research for your organisation
A look at audience research for your organisation
 
Questionnary
QuestionnaryQuestionnary
Questionnary
 
Tool design
Tool design Tool design
Tool design
 
Questionnaire, interview, observation and rating scale
 Questionnaire, interview, observation and rating scale  Questionnaire, interview, observation and rating scale
Questionnaire, interview, observation and rating scale
 
Survey research
Survey researchSurvey research
Survey research
 
WRITING YOUR STATEMENT OF THE PROBLEM.pptx
WRITING YOUR STATEMENT OF THE PROBLEM.pptxWRITING YOUR STATEMENT OF THE PROBLEM.pptx
WRITING YOUR STATEMENT OF THE PROBLEM.pptx
 
Questionnaire in Market Research.pptx
Questionnaire in Market Research.pptxQuestionnaire in Market Research.pptx
Questionnaire in Market Research.pptx
 
Lesson - Questionnaire in Research Study.pptx
Lesson - Questionnaire in Research Study.pptxLesson - Questionnaire in Research Study.pptx
Lesson - Questionnaire in Research Study.pptx
 

Dernier

unwanted pregnancy Kit [+918133066128] Abortion Pills IN Dubai UAE Abudhabi
unwanted pregnancy Kit [+918133066128] Abortion Pills IN Dubai UAE Abudhabiunwanted pregnancy Kit [+918133066128] Abortion Pills IN Dubai UAE Abudhabi
unwanted pregnancy Kit [+918133066128] Abortion Pills IN Dubai UAE Abudhabi
Abortion pills in Kuwait Cytotec pills in Kuwait
 
Call Girls Hebbal Just Call 👗 7737669865 👗 Top Class Call Girl Service Bangalore
Call Girls Hebbal Just Call 👗 7737669865 👗 Top Class Call Girl Service BangaloreCall Girls Hebbal Just Call 👗 7737669865 👗 Top Class Call Girl Service Bangalore
Call Girls Hebbal Just Call 👗 7737669865 👗 Top Class Call Girl Service Bangalore
amitlee9823
 
Insurers' journeys to build a mastery in the IoT usage
Insurers' journeys to build a mastery in the IoT usageInsurers' journeys to build a mastery in the IoT usage
Insurers' journeys to build a mastery in the IoT usage
Matteo Carbone
 
0183760ssssssssssssssssssssssssssss00101011 (27).pdf
0183760ssssssssssssssssssssssssssss00101011 (27).pdf0183760ssssssssssssssssssssssssssss00101011 (27).pdf
0183760ssssssssssssssssssssssssssss00101011 (27).pdf
Renandantas16
 
Russian Call Girls In Gurgaon ❤️8448577510 ⊹Best Escorts Service In 24/7 Delh...
Russian Call Girls In Gurgaon ❤️8448577510 ⊹Best Escorts Service In 24/7 Delh...Russian Call Girls In Gurgaon ❤️8448577510 ⊹Best Escorts Service In 24/7 Delh...
Russian Call Girls In Gurgaon ❤️8448577510 ⊹Best Escorts Service In 24/7 Delh...
lizamodels9
 
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
dollysharma2066
 
Mifty kit IN Salmiya (+918133066128) Abortion pills IN Salmiyah Cytotec pills
Mifty kit IN Salmiya (+918133066128) Abortion pills IN Salmiyah Cytotec pillsMifty kit IN Salmiya (+918133066128) Abortion pills IN Salmiyah Cytotec pills
Mifty kit IN Salmiya (+918133066128) Abortion pills IN Salmiyah Cytotec pills
Abortion pills in Kuwait Cytotec pills in Kuwait
 

Dernier (20)

VVVIP Call Girls In Greater Kailash ➡️ Delhi ➡️ 9999965857 🚀 No Advance 24HRS...
VVVIP Call Girls In Greater Kailash ➡️ Delhi ➡️ 9999965857 🚀 No Advance 24HRS...VVVIP Call Girls In Greater Kailash ➡️ Delhi ➡️ 9999965857 🚀 No Advance 24HRS...
VVVIP Call Girls In Greater Kailash ➡️ Delhi ➡️ 9999965857 🚀 No Advance 24HRS...
 
B.COM Unit – 4 ( CORPORATE SOCIAL RESPONSIBILITY ( CSR ).pptx
B.COM Unit – 4 ( CORPORATE SOCIAL RESPONSIBILITY ( CSR ).pptxB.COM Unit – 4 ( CORPORATE SOCIAL RESPONSIBILITY ( CSR ).pptx
B.COM Unit – 4 ( CORPORATE SOCIAL RESPONSIBILITY ( CSR ).pptx
 
unwanted pregnancy Kit [+918133066128] Abortion Pills IN Dubai UAE Abudhabi
unwanted pregnancy Kit [+918133066128] Abortion Pills IN Dubai UAE Abudhabiunwanted pregnancy Kit [+918133066128] Abortion Pills IN Dubai UAE Abudhabi
unwanted pregnancy Kit [+918133066128] Abortion Pills IN Dubai UAE Abudhabi
 
Mondelez State of Snacking and Future Trends 2023
Mondelez State of Snacking and Future Trends 2023Mondelez State of Snacking and Future Trends 2023
Mondelez State of Snacking and Future Trends 2023
 
Call Girls Hebbal Just Call 👗 7737669865 👗 Top Class Call Girl Service Bangalore
Call Girls Hebbal Just Call 👗 7737669865 👗 Top Class Call Girl Service BangaloreCall Girls Hebbal Just Call 👗 7737669865 👗 Top Class Call Girl Service Bangalore
Call Girls Hebbal Just Call 👗 7737669865 👗 Top Class Call Girl Service Bangalore
 
Insurers' journeys to build a mastery in the IoT usage
Insurers' journeys to build a mastery in the IoT usageInsurers' journeys to build a mastery in the IoT usage
Insurers' journeys to build a mastery in the IoT usage
 
0183760ssssssssssssssssssssssssssss00101011 (27).pdf
0183760ssssssssssssssssssssssssssss00101011 (27).pdf0183760ssssssssssssssssssssssssssss00101011 (27).pdf
0183760ssssssssssssssssssssssssssss00101011 (27).pdf
 
Mysore Call Girls 8617370543 WhatsApp Number 24x7 Best Services
Mysore Call Girls 8617370543 WhatsApp Number 24x7 Best ServicesMysore Call Girls 8617370543 WhatsApp Number 24x7 Best Services
Mysore Call Girls 8617370543 WhatsApp Number 24x7 Best Services
 
Call Girls In Panjim North Goa 9971646499 Genuine Service
Call Girls In Panjim North Goa 9971646499 Genuine ServiceCall Girls In Panjim North Goa 9971646499 Genuine Service
Call Girls In Panjim North Goa 9971646499 Genuine Service
 
Yaroslav Rozhankivskyy: Три складові і три передумови максимальної продуктивн...
Yaroslav Rozhankivskyy: Три складові і три передумови максимальної продуктивн...Yaroslav Rozhankivskyy: Три складові і три передумови максимальної продуктивн...
Yaroslav Rozhankivskyy: Три складові і три передумови максимальної продуктивн...
 
KYC-Verified Accounts: Helping Companies Handle Challenging Regulatory Enviro...
KYC-Verified Accounts: Helping Companies Handle Challenging Regulatory Enviro...KYC-Verified Accounts: Helping Companies Handle Challenging Regulatory Enviro...
KYC-Verified Accounts: Helping Companies Handle Challenging Regulatory Enviro...
 
VIP Call Girls In Saharaganj ( Lucknow ) 🔝 8923113531 🔝 Cash Payment (COD) 👒
VIP Call Girls In Saharaganj ( Lucknow  ) 🔝 8923113531 🔝  Cash Payment (COD) 👒VIP Call Girls In Saharaganj ( Lucknow  ) 🔝 8923113531 🔝  Cash Payment (COD) 👒
VIP Call Girls In Saharaganj ( Lucknow ) 🔝 8923113531 🔝 Cash Payment (COD) 👒
 
It will be International Nurses' Day on 12 May
It will be International Nurses' Day on 12 MayIt will be International Nurses' Day on 12 May
It will be International Nurses' Day on 12 May
 
Russian Call Girls In Gurgaon ❤️8448577510 ⊹Best Escorts Service In 24/7 Delh...
Russian Call Girls In Gurgaon ❤️8448577510 ⊹Best Escorts Service In 24/7 Delh...Russian Call Girls In Gurgaon ❤️8448577510 ⊹Best Escorts Service In 24/7 Delh...
Russian Call Girls In Gurgaon ❤️8448577510 ⊹Best Escorts Service In 24/7 Delh...
 
Enhancing and Restoring Safety & Quality Cultures - Dave Litwiller - May 2024...
Enhancing and Restoring Safety & Quality Cultures - Dave Litwiller - May 2024...Enhancing and Restoring Safety & Quality Cultures - Dave Litwiller - May 2024...
Enhancing and Restoring Safety & Quality Cultures - Dave Litwiller - May 2024...
 
HONOR Veterans Event Keynote by Michael Hawkins
HONOR Veterans Event Keynote by Michael HawkinsHONOR Veterans Event Keynote by Michael Hawkins
HONOR Veterans Event Keynote by Michael Hawkins
 
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
 
Best VIP Call Girls Noida Sector 40 Call Me: 8448380779
Best VIP Call Girls Noida Sector 40 Call Me: 8448380779Best VIP Call Girls Noida Sector 40 Call Me: 8448380779
Best VIP Call Girls Noida Sector 40 Call Me: 8448380779
 
Regression analysis: Simple Linear Regression Multiple Linear Regression
Regression analysis:  Simple Linear Regression Multiple Linear RegressionRegression analysis:  Simple Linear Regression Multiple Linear Regression
Regression analysis: Simple Linear Regression Multiple Linear Regression
 
Mifty kit IN Salmiya (+918133066128) Abortion pills IN Salmiyah Cytotec pills
Mifty kit IN Salmiya (+918133066128) Abortion pills IN Salmiyah Cytotec pillsMifty kit IN Salmiya (+918133066128) Abortion pills IN Salmiyah Cytotec pills
Mifty kit IN Salmiya (+918133066128) Abortion pills IN Salmiyah Cytotec pills
 

Week 3

  • 1. WEEK 2: SURVEY FORM: QUESTIONS, SCALES, AND APPEARANCE MEASUREMENT: SCALING, RELIABILITY, VALIDITY Quantitative Research Methods
  • 2. AGENDA • Week 2 Recap (previous week) • Days 1+2 – Week 3: • Fink Chapter 3: Getting it Together: Some Practical Concerns • S&B Chapter 8: Data collection methods: Observation • Next week assignment and readings…
  • 3. CHAPTER 2: THE SURVEY FORM: QUESTIONS, SCALES, AND APPEARANCE. HOW TO CONDUCT SURVEYS – A STEP BY STEP GUIDE (FINK) 1. Overview and Length Counts 2. Getting the Survey in Order 3. Questionnaire Format: Aesthetics and Other Concerns 4. Branching Questions, or the Infamous ¨Skip¨ Pattern 5. Administration: Who Gives What to Whom? 6. Reliability and Validity: The Quality of Your Survey 7. Selecting and Adapting Surveys 8. Finding Surveys on the Web 9. The Survey is Put on Trail: Guidelines for Pilot Testing 10. A Far-Reaching World: Surveys, Language, and Culture
  • 4. CHAPTER 2: THE SURVEY FORM: QUESTIONS, SCALES, AND APPEARANCE. HOW TO CONDUCT SURVEYS – A STEP BY STEP GUIDE (FINK) Overview and Length Counts How long should a survey be? The length of a survey depends on what you need to know and how many questions are necessary so that the resulting answers are credible. How much time do they have available, and will they pay attention to the survey?
  • 5. CHAPTER 2: THE SURVEY FORM: QUESTIONS, SCALES, AND APPEARANCE. HOW TO CONDUCT SURVEYS – A STEP BY STEP GUIDE (FINK) Getting the Survey in Order All surveys should be preceded by an introduction and the first set of questions should be related to the topic described in it.
  • 6. CHAPTER 2: THE SURVEY FORM: QUESTIONS, SCALES, AND APPEARANCE. HOW TO CONDUCT SURVEYS – A STEP BY STEP GUIDE (FINK) Example: An Introduction to a Telephone Survey and its First Question. Hello, I am calling from the California University. We are surveying people why live in student housing to find out whether it is a satisfactory place to live. Your name was selected at random from the housing registry, a directory of students who have voluntary listed their telephone numbers. Our questionnaires will take no more than 4 minutes. You can interrupt me at any time. May I ask you the questions? [If YES, continue. If NO, say thank you, express concern for bothering the person, and hang up.] [Continue here.] The first question asks you about your overall satisfaction with the apartment. Do you consider it [read choices] Definitely Satisfactory Probably Satisfactory Probably not Satisfactory Definitely not Satisfactory [Do NOT SAY] no opinion or don´t know/wrong answer
  • 7. CHAPTER 2: THE SURVEY FORM: QUESTIONS, SCALES, AND APPEARANCE. HOW TO CONDUCT SURVEYS – A STEP BY STEP GUIDE (FINK) Checklist to Guide Question Order • For any given topic, ask relatively objective questions before the subjective ones. • Move from the most familiar to the least. • Follow the natural sequence of time. • See to it that all questions are independent. • Relatively easy-to-answer questions (including demographic questions such as age or occupation) should be asked at the end. • Avoid many items that look alike. • Sensitive questions should be placed well after the start of the survey but also well before its conclusion. • Questions should be in logical order.
  • 8. CHAPTER 2: THE SURVEY FORM: QUESTIONS, SCALES, AND APPEARANCE. HOW TO CONDUCT SURVEYS – A STEP BY STEP GUIDE (FINK) Questionnaire Format: Aesthetics and Other Concerns A questionnaire´s appearance is vitally important. A written self- administered questionnaire that is hard to read can confuse or irritate respondents. Do: put just one question on a line. Leave plenty of space for responses. Don´t: squeeze several questions together. Do not abbreviate questions.
  • 9. CHAPTER 2: THE SURVEY FORM: QUESTIONS, SCALES, AND APPEARANCE. HOW TO CONDUCT SURVEYS – A STEP BY STEP GUIDE (FINK) Branching Questions, or the Infamous ¨Skip¨ Pattern If you want to ask about a topic that you know in advance will not be relevant to everyone in the survey, you might design a form such as the one in the following example: 3. Do you participate in sports? a. No (GO TO QUESTION 4) b. Yes IF YES, which sports do you perform? Yes No Soccer 1 2 Track and Field 1 2 Other, Please name:
  • 10. CHAPTER 2: THE SURVEY FORM: QUESTIONS, SCALES, AND APPEARANCE. HOW TO CONDUCT SURVEYS – A STEP BY STEP GUIDE (FINK) Administration: Who Gives What to Whom? Self-administered questionnaires require a great deal of preparation and monitoring to get a reasonable response rate.
  • 11. CHAPTER 2: THE SURVEY FORM: QUESTIONS, SCALES, AND APPEARANCE. HOW TO CONDUCT SURVEYS – A STEP BY STEP GUIDE (FINK) Administration: Who Gives What to Whom? Checklist for using self-administered questionnaires • Send respondents an advance letter via regular mail or email telling them the purpose of your questionnaire • Prepare a short, formal explanation to accompany the questionnaire form. • Consider sending respondents a summary of the findings. • If you ask questions that may be construed as personal – such a gender, etc. – explain why the questions are necessary. • Keep the questionnaire procedures simple. • Keep questionnaires short. • Consider incentives. • Be prepared to follow up or send reminders. • If you are doing an online survey: have a hardcopy, instructions, all in one, etc.
  • 12. CHAPTER 2: THE SURVEY FORM: QUESTIONS, SCALES, AND APPEARANCE. HOW TO CONDUCT SURVEYS – A STEP BY STEP GUIDE (FINK) Reliability and Validity: The Quality of Your Survey Survey reliability: test-retest reliability (survey same group twice) equivalency reliability (2 different forms – A & B) internally consistent (Cronbach Alpha)
  • 13. CHAPTER 2: THE SURVEY FORM: QUESTIONS, SCALES, AND APPEARANCE. HOW TO CONDUCT SURVEYS – A STEP BY STEP GUIDE (FINK) Selecting and Adapting Surveys There are many surveys and survey questions that you can get online for free. Not always appropriate for your research. You do not know if the free questions have been tried out or analyzed, if so to whom.
  • 14. CHAPTER 2: THE SURVEY FORM: QUESTIONS, SCALES, AND APPEARANCE. HOW TO CONDUCT SURVEYS – A STEP BY STEP GUIDE (FINK) Finding Surveys on the Web Gallup Organizations: http://www.gallup.com General Social Survey: http://www.norc.org/Research/Projects/Pages/general- social-survey.aspx National Opinion Research Center: http://norc.uchicago.edu/homepage.htm The Pew Charitable Trusts: http://www.pewtrusts.org The Agency for Healthcare Research and Quality: http://www.ahrq.gov/data/datasources.htm The U.S. Census http://www.census.gov The Institute of Education Sciences through the National Center for Education Statistics: http://nces.ed.gov/datatools/index.asp?DataToolSectionmID=3
  • 15. CHAPTER 2: THE SURVEY FORM: QUESTIONS, SCALES, AND APPEARANCE. HOW TO CONDUCT SURVEYS – A STEP BY STEP GUIDE (FINK) The Survey is Put on Trail: Guidelines for Pilot Testing Guidelines for Pilot Testing 1. Try to anticipate the actual circumstances in which the survey will be conducted and make plans to handle them. 2. You can start by trying out selected portions of the survey in an informal fashion. 3. Choose respondents similar to the ones who will eventually complete the survey. 4. Enlist as many people in the pilot as seems reasonable without wasting your resources. 5. For reliability, focus on the clarity of the questions and the general format of the survey. 6. To help bolster validity, you should ensure that all relevant topics have been included in the survey (given your resources) 7. Test your ability to get a range of responses. If people truly differ in their views or feelings, will the survey capture those differences.
  • 16. CHAPTER 2: THE SURVEY FORM: QUESTIONS, SCALES, AND APPEARANCE. HOW TO CONDUCT SURVEYS – A STEP BY STEP GUIDE (FINK) A Far-Reaching World: Surveys, Language, and Culture Many surveys are translated into different languages. If you plan on translating your survey, do not assume that you can automatically reqord each question into the new language.
  • 17. AGENDA • Week 3: • S&B Chapter 8: Data collection methods: Observation
  • 18. S&B CHAPTER 8: DATA COLLECTION METHODS: OBSERVATION
  • 19. WEEK 3 ASSIGNMENT AND READINGS… 1. Chapter 3 (Fink) & Chapter 8 (S&B): 2. See Blackboard Learn