10. 10のチェックリスト
1. リサーチ・クエスチョン
2. 属性と水準
3. 設問の構成
4. 実験計画法
5. 選好を引き出す
6. 調査のデザイン
7. データ収集のプラン
8. 統計解析
9. 結果と結論
10.研究発表
10Bridges JFP, Hauber AB, Marshall D, Lloyd A, Prosser LA, Regier DA, et al. Conjoint Analysis Applications in Health—a Checklist: A Report of the ISPOR
Good Research Practices for Conjoint Analysis Task Force. Value in Health. 2011 Jun 1;14(4):403–13.
12. ②属性と水準
属性の定義、属性の選択を行った際の適格/除
外選択、水準の選択について記載する
12
Identifying Attributes
One of the most important stages of any preference elicitation study is the identification of
attributes, a process that is often guided by extensive qualitative analysis. We began this
process with in-depth, open-ended interviews of a sample of outpatients with hearing loss
recruited at the Johns Hopkins Hospital, Baltimore, Maryland. This qualitative approach has
been used in other preference studies and is similar to other qualitative methods that have
been employed to study hearing loss and hearing aids. Trained fieldworkers conducted the
semistructured interviews and encouraged participants to discuss their feelings and
experiences with hearing loss and/or hearing aids. A series of questions provided structure
across interviews, while leaving room for respondents to address their individual concerns
with their aids. Interviews were recorded, transcribed, and analyzed using interpretive
phenomenological analysis.
Bridges JFP, Lataille AT, Buttorff C, White S, Niparko JK. Consumer Preferences for Hearing Aid Attributes: A Comparison of Rating and
Conjoint Analysis Methods. Trends in Amplification. 2012 Mar 1;16(1):40–8.
14. ②-2 属性の選択
属性の定義、選択、水準の選択を明確に
1. リサーチクエスチョンを明らかにするもの
2. 意思決定と関係があるもの
3. 採用した/しなかった属性で相関がありそう
なものはコントロールをする
属
14
属性の数
Clark MD, Determann D, Petrou S, Moro D, de Bekker-Grob EW. Discrete Choice Experiments in Health Economics: A Review of the Literature. PharmacoEconomics. 2014 Sep;32(9):883–902.
属性が多すぎると、回答者が
トレードオフ関係を頭の中で
整理できず混乱してしまいす
15. 属性の選択 論文例
15
Attribute Selection
From the patient interviews, Table 1 presents the final seven attributes chosen for analysis,
the description used in the survey instrument, and a number of quotes that illustrate how the
respondents discussed the factors. From these interviews, four major themes developed. The
first theme is the overall hearing aid performance. Respondents characterized……. The
second theme focuses on the aid’s aesthetic and how that affects purchase and usage.
Features of this theme include the appearance of the hearing aid,…...The third theme focuses
on the overall cost of the aid,….. The fourth theme focuses on specific features of the aid
and……. Respondents defined “handling of aid” as the convenience and ease of operating,
wearing, and maintaining the hearing aid.
During the process of refining the attribute levels, we determined that some attributes were
not relevant or were too complicated to include in our analysis…...
Bridges JFP, Lataille AT, Buttorff C, White S, Niparko JK. Consumer Preferences for Hearing Aid Attributes: A Comparison of Rating and
Conjoint Analysis Methods. Trends in Amplification. 2012 Mar 1;16(1):40–8.
17. 水準の選択 論文例
17
Assigning Levels
Assigning levels to attributes is an equally important aspect of conjoint analysis (Bridges et al., 2011;
Ryan & Farrar, 2000). In addition to soliciting attribute levels from the qualitative data, we also
rigorously piloted a draft survey instrument to further develop the levels. Four versions of the survey
instrument were tested during piloting, with refinement made to the wording of the attributes and levels.
To avoid additional complexity, we focused on the development of two levels for each attribute, which
are also summarized in Table 1. As a means to avoid extreme levels, which could serve as anchoring
points, we developed characteristics that represented a moderately above and below average level for
each factor (Bridges et al., 2011)
Bridges JFP, Lataille AT, Buttorff C, White S, Niparko JK. Consumer Preferences for Hearing Aid Attributes: A Comparison of Rating and
Conjoint Analysis Methods. Trends in Amplification. 2012 Mar 1;16(1):40–8.
25. 実験計画法の論文例
25
Formulating Scenarios
To create the conjoint analysis choice tasks, we used a full-profile, paired comparison. The
experimental design utilized a minimal, main-effects orthogonal array that identified eight
uncorrelated scenarios (Bridges et al., 2011; Louviere et al., 2000), each paired with its
complete opposite. An example of this pair comparison is presented in Figure 2.The scales
and conjoint tasks were presented with careful definitions on what each attribute meant and
specific instructions on how to complete the Likert scale questions and the conjoint choice
tasks.
Bridges JFP, Lataille AT, Buttorff C, White S, Niparko JK. Consumer Preferences for Hearing Aid Attributes: A Comparison of Rating and
Conjoint Analysis Methods. Trends in Amplification. 2012 Mar 1;16(1):40–8.
28. 調査のデザイン/データ収集 論文例
28
Sample
Respondents with sensorineural hearing loss beyond the 30dB speech reception threshold
were recruited from the Johns Hopkins Hospital, Department of Otolaryngology. Clinicians
informed potential respondents of the study during a scheduled visit, referring those who
agreed to participate to study staff. Respondents could either complete the survey
immediately following their appointment at the outpatient center or take it home with them
to complete and return to their clinician using a prepaid envelope that was provided. As
compensation for their time, respondents were offered a validated parking voucher or a gift
card from a national coffee chain. Although formal sample size calculations are rare in
stated-preference consumer studies (Bridges, 2003), a number of rules of thumb have been
described in the literature (Bridges et al., 2011). Applying a simple rule of thumb based
on the number of attributes and levels (Orme, 2009), a minimum sample size for our
relatively simple experiment is 32 respondents. Alternatively, a parametric approach has
been proposed by Louviere et al. (2000), implying a minimum sample size of 48
respondents. We thus aimed to have a sample size between 50 and 60 respondents. Although
this is relatively small compared to the average study in health (Marshall et al., 2010), it
has been successful in other stated preference studies of comparable complexity (Akkazieva,
Gulacsi, Brandtmuller, Pentekk, & Bridges, 2006).
Bridges JFP, Lataille AT, Buttorff C, White S, Niparko JK. Consumer Preferences for Hearing Aid Attributes: A Comparison of Rating and
Conjoint Analysis Methods. Trends in Amplification. 2012 Mar 1;16(1):40–8.
30. 回答者属性の評価 論文例
30
Response Rate
A total of 5020 US physicians were invited to participate in the survey. Of those invited, 341
individuals (7%) responded to the invitation and, of those who responded, 260 (76%) were
eligible to participate (i.e., those physicians who were practicing, board certified, and
currently treating patients with bone metastases from solid tumors). A total of 256 of 260
(98%) eligible physicians consented to participate and 200 (78%) completed the survey.
Data for all 200 physicians were included in the final analysis.
Arellano J, Hauber AB, Mohamed AF, Gonzalez JM, Collins H, Hechmati G, et al. Physicians’ Preferences for Bone Metastases Drug Therapy in the
United States. Value in Health. 2015 Jan 1;18(1):78–83.
31. 回答者属性の評価 論文例
31
Demographics
Respondents (Table 2) tended to be white, male, older, and
upper income: 66% of the respondents were male, 84%
were white, and 46% were between the ages of 51 and 70;
28% had 4 years of college and nearly 43% had some kind
of postgraduate degree; 48% had incomes more than
US$100,000; 44% had never worn a hearing aid. Most
respondents (62.5%) said they suffered from sensorineural
hearing loss. Health insurance covered all or a portion of
the cost of a hearing aid in almost 36% of the cases.
Respondents were shown pictures of six possible types of
hearing aids: in-the-ear or full shell, half-shell, in-the-canal,
completely-in-the-canal, behind-the-ear, and bone-anchored.
They were allowed to select more than one choice. Most
respondents said they would like to wear a completely-in-
the-canal or a behind-the-ear style
Bridges JFP, Lataille AT, Buttorff C, White S, Niparko JK. Consumer Preferences for Hearing Aid Attributes: A Comparison of Rating and
Conjoint Analysis Methods. Trends in Amplification. 2012 Mar 1;16(1):40–8.
33. 内的/外的妥当性の検討 論文例
33
The Internal Validity Task
We repeated the analysis of question design and estimation methods using the correlation
measures from the internal validity (holdout questions) task. Details are in Appendix 2. The
results for internal validity are similar to the results for external validity. However, there
are two differences worth noting. First, while ……
External Validity Task: Final Bag Selection
Respondents were told that they had $100 to spend and were asked to choose among five
bags. The five bags shown to each respondent were drawn randomly from an
orthogonal fractional factorial design of 16 bags. This design was the same across all four
experimental conditions, so that there was no difference, on average, in the bags shown to
respondents in each condition. The five bags were also independent of responses to the
earlier conjoint questions. ……..
Toubia O, Simester D, Hauser J,Dahan E. Fast Polyhedral Adaptive Conjoint Estimation Marketing Science 2003.22(3):273–303
35. モデル推計手法 論文例
35
Preference Weights
The preference weights for the six attributes (time until first SRE, time until 2-point
increase in pain on the Brief Pain Inventory Short Form, risk of osteonecrosis of the jaw
each year, risk of 0.5-mg/dL increase in baseline creatinine level each year [risk of renal
impairment], mode of administration, and out-of-pocket cost to patient each month)
included in the analysis from Table 1 are presented in Figure 2. The parameter estimates can
be interpreted as the relative strength of preference for each attribute level.
As seen in Figure 2, the most important attributes were out-of-pocket ….
For each attribute level, the difference in preferences between oncologists and all other
physicians was estimated in a post hoc analysis. The null hypothesis for the test was that all
estimated differences were zero. The estimated P value for the Wald test was 0.2982,
suggesting that there is no difference between oncologists’preferences and preferences of
other physicians in the study. With respect to the hypothetical patient profiles, no
statistically significant differences in physician treatment preferences were observed
between responders with full access to either patient profile.
Arellano J, Hauber AB, Mohamed AF, Gonzalez JM, Collins H, Hechmati G, et al. Physicians’ Preferences for Bone Metastases Drug Therapy in the
United States. Value in Health. 2015 Jan 1;18(1):78–83.
36. モデル推計手法 論文例
36Arellano J, Hauber AB, Mohamed AF, Gonzalez JM, Collins H, Hechmati G, et al. Physicians’ Preferences for Bone Metastases Drug Therapy in the
United States. Value in Health. 2015 Jan 1;18(1):78–83.
41. Appendix 論文例
41Prioritization of Potential Mates’ History of Sexual Fidelity During a Conjoint Ranking Task. - PubMed - NCBI [Internet]. Available from:
https://vpn1.sfc.keio.ac.jp/+CSCO+1h756767633A2F2F6A6A6A2E61706F762E61797A2E6176752E746269++/pubmed/24769738