Used in CARMA summer workshop on Web survey methods.

1. CARMA Internet Research Module Research Design Catalog Jeffrey Stanton

2. May 17-19, 2007 Internet Data Collection Methods (Day 1-2) Research Design Catalog Objective knowledge test 1 shot self report, single data source 1 shot survey, multi-data source Two (or more) wave survey AKA “Panel” Design (Field) Quasi-experiment (Field) Experiment Repeated measures (field) experiment Time series Interview or Focus Group Document analysis Archival text mining Including discussion groups, email archives, text message logs, etc. Naturalistic (unobtrusive) observation Case Study Participant observation Ethnographic methods Historical methods

3. Mixed Methods Designs Sequential Explanatory Quantitative data obtained first, qualitative second Example: Cross-sectional web survey followed by Skype interviews Priority given to quantitative data Questioning in qualitative phase driven by specific results obtained earlier Sequential Exploratory Qualitative data obtained first, quantitative second Example: Discussion forum used to develop issues poll Priority given to qualitative data Numbers from quantitative phase used to underscore or affirm themes from qualitative Concurrent Mixed Methods Designs collect quantitative and qualitative data at the same time, for example using open ended comment boxes on a web survey. Neither type of data gets priority, results are synthesized or used for corroboration.

4. May 17-19, 2007 Internet Data Collection Methods (Day 1-4) Cross Sectional SurveyTiming Exercise: How Long? 150-WordIntroduction Introductory material, implied consent Likert type questions Checklists Open-ended questions Demographics Plus instructions 45 Likert Items 20 itemchecklist 2 open endedparagraphs 8 demographicquestions

5. May 17-19, 2007 Internet Data Collection Methods (Day 1-5) Two Condition Quasi-Experiment Condition 1: Introductory material, implied consent Manipulation (condition 1) Dependent measure Demographics Manipulation check Thanks Condition 2: Introductory material, implied consent Manipulation (condition 2) Dependent measure Demographics Manipulation check Thanks

6. Why Quasi? Why would a web-based, two version survey be considered a quasi-experiment rather than a true experiment? What are some alternative methods of conducting a multi-condition study with manipulations (i.e., other than a web survey)? What are some of the pitfalls of trying to conduct an experiment using Internet tools to interact with research participants?

7. May 17-19, 2007 Internet Data Collection Methods (Day 1-7) Time 1: Introductory material, implied consent Unique identifier Independent measure Baseline measure Demographics Thanks Time 2: Introductory material, implied consent (Matching) Unique identifier Change measure Experience check Thanks Intervention Maturation Training Design Example 3: Two Wave Panel Design

9. May 17-19, 2007 Internet Data Collection Methods (Day 1-10) Design Example 5: Linked Dyads Participant 1: Introductory material, implied consent Unique identifier Scales Demographics Referral Procedure Thanks Recruiting Message Participant 2: Introductory material, implied consent Unique identifier Scales Demographics Referral Check Thanks