SlideShare a Scribd company logo
1 of 19
Copyright © 2008, SAS Institute Inc. All rights reserved.
Practical Design for
Discrete Choice
Experiments
Bradley Jones, SAS Institute
August 13, 2008
Copyright © 2008, SAS Institute Inc. All rights reserved.
DEMA 2008, August 2008,
Cambridge
2
 Respondents indicate the alternative they prefer most in
each choice set
 Alternatives are called profiles
 Each profile is a combination of attribute levels
 Choice sets typically consist of two, three or four profiles
Discrete Choice Experiment Setup
Copyright © 2008, SAS Institute Inc. All rights reserved.
Example: Marketing a new laptop computer
Attributes Levels
Hard Drive 40 GB 80 GB
Speed 1.5 GHz 2.0 GHz
Battery Life 4 hours6 hours
Price $1,000 $1,200 $1,500
DEMA 2008, August 2008,
Cambridge
3
Copyright © 2008, SAS Institute Inc. All rights reserved.
Sample Choice Set
Hard Disk Speed Battery Price
40Gig 1.5GHz 6hours $1,000
40Gig 2.0GHz 4hours $1,500
Check the box for the laptop you prefer.
Profile 1
Profile 2
4DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
5
multinomial logit model
based on the random utilities model
where xjs represents the attribute levels and β is the set of
parameter values
probability of choosing alternative j in choice set s
Statistical model
ε′= +js js jsU xβ
=1
option chosen
in choice set
js
ts
js J
t
j e
p
s e
′
′
 
= ÷
  ∑
xβ
xβ
DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
D criterion - minimize the determinant of the variance matrix of
the estimators:
( )( )1
det −
M Xβ,
Design optimality criterion
DEMA 2008, August 2008,
Cambridge
6
Equivalently – maximize the determinant of the
information matrix, M.
Copyright © 2008, SAS Institute Inc. All rights reserved.
7
Bayesian optimal designs:
• construct a prior distribution for the parameters
• find design that performs best on average
• Sándor & Wedel (2001, 2002, 2005)
Dependence on the unknown parameter, β
( ) ( ) ( ) ( )( )
1
,
S
s s s s s
s=
′ ′= −∑M Xβ X P β p β p β X
DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
Design for Nonlinear Models
To design an informative experiment …..
You need to know something about the response function …..
And about the parameter values.
8DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
Bayesian D-Optimal Design
Bayesian ideas are natural to cope with the fact that
the information matrix, M, depends on β.
Chaloner and Larntz (1986) developed a Bayesian D-
Optimality criterion:
Φ(d) = ∫ log det [M(β;d)] p(β) dβ
9DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
Computing Bayesian D-Optimal Designs
A major impediment to Bayesian D-optimal design
has been COMPUTATIONAL.
The integral over β can be VERY SLOW.
It must be computed MANY TIMES in the course of
finding an optimal design.
10DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
Bayesian Computations
Gotwalt, Jones and Steinberg (2007) use a quadrature
method, due to Mysovskikh.
This method is guaranteed to exactly integrate all
polynomials up to 5th degree and all odd-degree
monomials.
With p parameters, it requires just O(p2) function evaluations.
11DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
Mysovskikh quadrature
Assume a normal prior with independence.
• Center the integral about the prior mean.
• Scale each variable by its standard deviation.
• Integrate over distance from the prior mean and, at
each distance, over a spherical shell.
12DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
Mysovskikh quadrature continued…
Radial integral: Generalized Gauss-LaGuerre
quadrature, with an extra point at the origin.
Spherical integrals: The Mysovskikh quadrature
scheme.
13DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
Spherical integral
A simplex, its edge midpoints on the sphere, and
the inverses of all of these points.
Simplex point weights: p(7-p)/2(p+1)2(p+2).
Mid-point weights: 2(p-1)2/p(p+1)2(p+2).
14DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
Simplex point
Mid-point
Each point is both a simplex
point and a mid-point.
All weights equal1/6.
Quadrature points in two dimensions
15DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
Study Description
16 Respondents – 8 developers 8 sales & marketing
9 Male 7 Female
2 Surveys with 6 choice sets in each
Respondents were assigned randomly to surveys
blocked by job function
16DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
Software Demonstration
17DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
Conclusions
1) Discrete Choice Conjoint Experiments require design
methods for nonlinear models.
2) D-Optimal Bayesian designs reduce the dependence
of the design on the unknown parameters.
3) New quadrature methods make computation of these
designs much faster.
4) Commercial software makes carrying out such
studies simple and efficient.
18DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
References
Atkinson, A. C. and Donev, A. N. (1992). Optimum Experimental Designs, Oxford U.K.: Clarendon Press.
Cassity C.R., (1965) “Abscissas, Coefficients, and Error Term for the Generalized Gauss-Laguerre Quadrature Formula Using the Zero
Ordinate,” Mathematics ofComputation, 19, 287-296.
Chaloner, K. and Verdinelli, I. (1995). Bayesian experimental design: a re-view, Statistical Science 10: 273-304.
Grossmann, H., Holling, H. and Schwabe, R. (2002). Advances in optimum experimental design for conjoint analysis and discrete
choice models, in Advances in Econometrics, Econometric Models in Marketing, Vol. 16, Franses, P. H. and Montgomery, A. L.,
eds. Amsterdam: JAI Press, 93-117.
Gotwalt, C., Jones, B. and Steinberg, D. (2009) Fast Computation of Designs Robust to Parameter Uncertainty for Nonlinear Settings
accepted at Technometrics.
Huber, J. and Zwerina, K. (1996). The importance of utility balance in efficient choice designs, Journal of Marketing Research 33: 307-
317.
McFadden, D. (1974). Conditional logit analysis of qualitative choice behavior, in Frontiers in Econometrics, Zarembka, P., ed. New
York: Academic Press, 105-142.
Meyer, R. K. and Nachtsheim, C. J. (1995). The coordinate-exchange algorithm for constructing exact optimal experimental designs,
Technometrics 37: 60-69.
Monahan, J. and Genz, A. (1997). Spherical-radial integration rules for Bayesian computation, Journal of the American Statistical
Association 92: 664-674.
Sandor, Z. and Wedel, M. (2001). Designing conjoint choice experiments using managers' prior beliefs, Journal of Marketing Research
38: 430-444.
19DEMA 2008, August 2008,
Cambridge

More Related Content

Viewers also liked

Happy Halloween
Happy HalloweenHappy Halloween
Happy Halloweengonzanafer
 
GRADIUM MARKETING SUPPORT
GRADIUM MARKETING SUPPORTGRADIUM MARKETING SUPPORT
GRADIUM MARKETING SUPPORTJulio Matos
 
Intervento Zecchi-Valdrè Inglese
Intervento Zecchi-Valdrè IngleseIntervento Zecchi-Valdrè Inglese
Intervento Zecchi-Valdrè IngleseIrecoop Toscana
 
B I O Products Sriphatoom Uni 24062011
B I O  Products  Sriphatoom Uni 24062011B I O  Products  Sriphatoom Uni 24062011
B I O Products Sriphatoom Uni 24062011aj_kwan.ph
 
Sosiaalinen media osaksi opetusta
Sosiaalinen media osaksi opetustaSosiaalinen media osaksi opetusta
Sosiaalinen media osaksi opetustaHannu Kuusela
 
What's Next Replay! Lyon 2011 - A. Cogoluegnes
What's Next Replay! Lyon 2011 - A. CogoluegnesWhat's Next Replay! Lyon 2011 - A. Cogoluegnes
What's Next Replay! Lyon 2011 - A. CogoluegnesZenika
 
Induction for returning students 2012
Induction for returning students 2012Induction for returning students 2012
Induction for returning students 2012Alison Hardy
 
Fête de la Seiche- Soto Enrique
Fête de la Seiche- Soto EnriqueFête de la Seiche- Soto Enrique
Fête de la Seiche- Soto Enriquekedougou
 
30 xaneiro día da paz
30 xaneiro día da paz30 xaneiro día da paz
30 xaneiro día da pazmigadepan
 
Finn-ID: case Valio & RFID
Finn-ID: case Valio & RFIDFinn-ID: case Valio & RFID
Finn-ID: case Valio & RFIDFinn-ID Oy
 
Prezentare Living different
Prezentare Living differentPrezentare Living different
Prezentare Living differentcecisromania
 

Viewers also liked (20)

Record label research
Record label researchRecord label research
Record label research
 
Happy Halloween
Happy HalloweenHappy Halloween
Happy Halloween
 
GRADIUM MARKETING SUPPORT
GRADIUM MARKETING SUPPORTGRADIUM MARKETING SUPPORT
GRADIUM MARKETING SUPPORT
 
New york new york
New york new yorkNew york new york
New york new york
 
Intervento Zecchi-Valdrè Inglese
Intervento Zecchi-Valdrè IngleseIntervento Zecchi-Valdrè Inglese
Intervento Zecchi-Valdrè Inglese
 
Navigator Centrum
Navigator CentrumNavigator Centrum
Navigator Centrum
 
B I O Products Sriphatoom Uni 24062011
B I O  Products  Sriphatoom Uni 24062011B I O  Products  Sriphatoom Uni 24062011
B I O Products Sriphatoom Uni 24062011
 
Record label research
Record label researchRecord label research
Record label research
 
Keerth nath
Keerth nathKeerth nath
Keerth nath
 
Sosiaalinen media osaksi opetusta
Sosiaalinen media osaksi opetustaSosiaalinen media osaksi opetusta
Sosiaalinen media osaksi opetusta
 
What's Next Replay! Lyon 2011 - A. Cogoluegnes
What's Next Replay! Lyon 2011 - A. CogoluegnesWhat's Next Replay! Lyon 2011 - A. Cogoluegnes
What's Next Replay! Lyon 2011 - A. Cogoluegnes
 
Induction for returning students 2012
Induction for returning students 2012Induction for returning students 2012
Induction for returning students 2012
 
Fête de la Seiche- Soto Enrique
Fête de la Seiche- Soto EnriqueFête de la Seiche- Soto Enrique
Fête de la Seiche- Soto Enrique
 
30 xaneiro día da paz
30 xaneiro día da paz30 xaneiro día da paz
30 xaneiro día da paz
 
Ecn Valdre
Ecn ValdreEcn Valdre
Ecn Valdre
 
Finn-ID: case Valio & RFID
Finn-ID: case Valio & RFIDFinn-ID: case Valio & RFID
Finn-ID: case Valio & RFID
 
Mordini (2)
Mordini (2)Mordini (2)
Mordini (2)
 
Prezentare Living different
Prezentare Living differentPrezentare Living different
Prezentare Living different
 
Minustako bloggari?
Minustako bloggari?Minustako bloggari?
Minustako bloggari?
 
6 Туристична презентація регіону - Любов Спірідонова
6 Туристична презентація регіону - Любов Спірідонова6 Туристична презентація регіону - Любов Спірідонова
6 Туристична презентація регіону - Любов Спірідонова
 

Similar to upload test

Software tools, crystal descriptors, and machine learning applied to material...
Software tools, crystal descriptors, and machine learning applied to material...Software tools, crystal descriptors, and machine learning applied to material...
Software tools, crystal descriptors, and machine learning applied to material...Anubhav Jain
 
Accelerated life testing
Accelerated life testingAccelerated life testing
Accelerated life testingSteven Li
 
Six Sigma Mechanical Tolerance Analysis 1
Six Sigma Mechanical Tolerance Analysis 1Six Sigma Mechanical Tolerance Analysis 1
Six Sigma Mechanical Tolerance Analysis 1David Panek
 
Big Data + Big Sim: Query Processing over Unstructured CFD Models
Big Data + Big Sim: Query Processing over Unstructured CFD ModelsBig Data + Big Sim: Query Processing over Unstructured CFD Models
Big Data + Big Sim: Query Processing over Unstructured CFD ModelsUniversity of Washington
 
Jorge Silva, Sr. Research Statistician Developer, SAS at MLconf ATL - 9/18/15
Jorge Silva, Sr. Research Statistician Developer, SAS at MLconf ATL - 9/18/15Jorge Silva, Sr. Research Statistician Developer, SAS at MLconf ATL - 9/18/15
Jorge Silva, Sr. Research Statistician Developer, SAS at MLconf ATL - 9/18/15MLconf
 
Chap 8. Optimization for training deep models
Chap 8. Optimization for training deep modelsChap 8. Optimization for training deep models
Chap 8. Optimization for training deep modelsYoung-Geun Choi
 
Hyperparameter optimization with approximate gradient
Hyperparameter optimization with approximate gradientHyperparameter optimization with approximate gradient
Hyperparameter optimization with approximate gradientFabian Pedregosa
 
Automated Machine Learning Applied to Diverse Materials Design Problems
Automated Machine Learning Applied to Diverse Materials Design ProblemsAutomated Machine Learning Applied to Diverse Materials Design Problems
Automated Machine Learning Applied to Diverse Materials Design ProblemsAnubhav Jain
 
theory of computation lecture 01
theory of computation lecture 01theory of computation lecture 01
theory of computation lecture 018threspecter
 
Sparse Isotropic Hashing
Sparse Isotropic HashingSparse Isotropic Hashing
Sparse Isotropic HashingIkuro Sato
 
Efficient evaluation of flatness error from Coordinate Measurement Data using...
Efficient evaluation of flatness error from Coordinate Measurement Data using...Efficient evaluation of flatness error from Coordinate Measurement Data using...
Efficient evaluation of flatness error from Coordinate Measurement Data using...Ali Shahed
 
Multi-criteria Decision Analysis for Customization of Estimation by Analogy M...
Multi-criteria Decision Analysis for Customization of Estimation by Analogy M...Multi-criteria Decision Analysis for Customization of Estimation by Analogy M...
Multi-criteria Decision Analysis for Customization of Estimation by Analogy M...gregoryg
 
A simulation based multi-objective design optimization of electronic packages...
A simulation based multi-objective design optimization of electronic packages...A simulation based multi-objective design optimization of electronic packages...
A simulation based multi-objective design optimization of electronic packages...Phuong Dx
 
IRJET- Review of Existing Methods in K-Means Clustering Algorithm
IRJET- Review of Existing Methods in K-Means Clustering AlgorithmIRJET- Review of Existing Methods in K-Means Clustering Algorithm
IRJET- Review of Existing Methods in K-Means Clustering AlgorithmIRJET Journal
 
A Framework and Infrastructure for Uncertainty Quantification and Management ...
A Framework and Infrastructure for Uncertainty Quantification and Management ...A Framework and Infrastructure for Uncertainty Quantification and Management ...
A Framework and Infrastructure for Uncertainty Quantification and Management ...aimsnist
 

Similar to upload test (20)

Software tools, crystal descriptors, and machine learning applied to material...
Software tools, crystal descriptors, and machine learning applied to material...Software tools, crystal descriptors, and machine learning applied to material...
Software tools, crystal descriptors, and machine learning applied to material...
 
Accelerated life testing
Accelerated life testingAccelerated life testing
Accelerated life testing
 
Srikanta Mishra
Srikanta MishraSrikanta Mishra
Srikanta Mishra
 
Vldb14
Vldb14Vldb14
Vldb14
 
Six Sigma Mechanical Tolerance Analysis 1
Six Sigma Mechanical Tolerance Analysis 1Six Sigma Mechanical Tolerance Analysis 1
Six Sigma Mechanical Tolerance Analysis 1
 
Staad pro
Staad proStaad pro
Staad pro
 
Big Data + Big Sim: Query Processing over Unstructured CFD Models
Big Data + Big Sim: Query Processing over Unstructured CFD ModelsBig Data + Big Sim: Query Processing over Unstructured CFD Models
Big Data + Big Sim: Query Processing over Unstructured CFD Models
 
Jorge Silva, Sr. Research Statistician Developer, SAS at MLconf ATL - 9/18/15
Jorge Silva, Sr. Research Statistician Developer, SAS at MLconf ATL - 9/18/15Jorge Silva, Sr. Research Statistician Developer, SAS at MLconf ATL - 9/18/15
Jorge Silva, Sr. Research Statistician Developer, SAS at MLconf ATL - 9/18/15
 
Chap 8. Optimization for training deep models
Chap 8. Optimization for training deep modelsChap 8. Optimization for training deep models
Chap 8. Optimization for training deep models
 
Hyperparameter optimization with approximate gradient
Hyperparameter optimization with approximate gradientHyperparameter optimization with approximate gradient
Hyperparameter optimization with approximate gradient
 
Automated Machine Learning Applied to Diverse Materials Design Problems
Automated Machine Learning Applied to Diverse Materials Design ProblemsAutomated Machine Learning Applied to Diverse Materials Design Problems
Automated Machine Learning Applied to Diverse Materials Design Problems
 
theory of computation lecture 01
theory of computation lecture 01theory of computation lecture 01
theory of computation lecture 01
 
Sparse Isotropic Hashing
Sparse Isotropic HashingSparse Isotropic Hashing
Sparse Isotropic Hashing
 
Real Time Geodemographics
Real Time GeodemographicsReal Time Geodemographics
Real Time Geodemographics
 
Licentiate Defense Slide
Licentiate Defense SlideLicentiate Defense Slide
Licentiate Defense Slide
 
Efficient evaluation of flatness error from Coordinate Measurement Data using...
Efficient evaluation of flatness error from Coordinate Measurement Data using...Efficient evaluation of flatness error from Coordinate Measurement Data using...
Efficient evaluation of flatness error from Coordinate Measurement Data using...
 
Multi-criteria Decision Analysis for Customization of Estimation by Analogy M...
Multi-criteria Decision Analysis for Customization of Estimation by Analogy M...Multi-criteria Decision Analysis for Customization of Estimation by Analogy M...
Multi-criteria Decision Analysis for Customization of Estimation by Analogy M...
 
A simulation based multi-objective design optimization of electronic packages...
A simulation based multi-objective design optimization of electronic packages...A simulation based multi-objective design optimization of electronic packages...
A simulation based multi-objective design optimization of electronic packages...
 
IRJET- Review of Existing Methods in K-Means Clustering Algorithm
IRJET- Review of Existing Methods in K-Means Clustering AlgorithmIRJET- Review of Existing Methods in K-Means Clustering Algorithm
IRJET- Review of Existing Methods in K-Means Clustering Algorithm
 
A Framework and Infrastructure for Uncertainty Quantification and Management ...
A Framework and Infrastructure for Uncertainty Quantification and Management ...A Framework and Infrastructure for Uncertainty Quantification and Management ...
A Framework and Infrastructure for Uncertainty Quantification and Management ...
 

More from sahilsahoo85 (20)

sigproc-sp.pdf
sigproc-sp.pdfsigproc-sp.pdf
sigproc-sp.pdf
 
CHANGELOG.txt
CHANGELOG.txtCHANGELOG.txt
CHANGELOG.txt
 
testing_7.ppt
testing_7.ppttesting_7.ppt
testing_7.ppt
 
testing_6.ppt
testing_6.ppttesting_6.ppt
testing_6.ppt
 
testing_5.ppt
testing_5.ppttesting_5.ppt
testing_5.ppt
 
testing_5.ppt
testing_5.ppttesting_5.ppt
testing_5.ppt
 
testing_5.ppt
testing_5.ppttesting_5.ppt
testing_5.ppt
 
testing_5.ppt
testing_5.ppttesting_5.ppt
testing_5.ppt
 
testing_5.ppt
testing_5.ppttesting_5.ppt
testing_5.ppt
 
testing_4.ppt
testing_4.ppttesting_4.ppt
testing_4.ppt
 
testing_3.ppt
testing_3.ppttesting_3.ppt
testing_3.ppt
 
testing_2.ppt
testing_2.ppttesting_2.ppt
testing_2.ppt
 
testing_1.ppt
testing_1.ppttesting_1.ppt
testing_1.ppt
 
testing_0.ppt
testing_0.ppttesting_0.ppt
testing_0.ppt
 
testing_0.ppt
testing_0.ppttesting_0.ppt
testing_0.ppt
 
questionnaries-theme.tpl_.php_.txt
questionnaries-theme.tpl_.php_.txtquestionnaries-theme.tpl_.php_.txt
questionnaries-theme.tpl_.php_.txt
 
ccccccc.ppt
ccccccc.pptccccccc.ppt
ccccccc.ppt
 
testing.ppt
testing.ppttesting.ppt
testing.ppt
 
testing_0.ppt
testing_0.ppttesting_0.ppt
testing_0.ppt
 
upload test2
upload test2upload test2
upload test2
 

Recently uploaded

WebRTC and SIP not just audio and video @ OpenSIPS 2024
WebRTC and SIP not just audio and video @ OpenSIPS 2024WebRTC and SIP not just audio and video @ OpenSIPS 2024
WebRTC and SIP not just audio and video @ OpenSIPS 2024Lorenzo Miniero
 
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdfMuhammad Subhan
 
Collecting & Temporal Analysis of Behavioral Web Data - Tales From The Inside
Collecting & Temporal Analysis of Behavioral Web Data - Tales From The InsideCollecting & Temporal Analysis of Behavioral Web Data - Tales From The Inside
Collecting & Temporal Analysis of Behavioral Web Data - Tales From The InsideStefan Dietze
 
Continuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
Continuing Bonds Through AI: A Hermeneutic Reflection on ThanabotsContinuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
Continuing Bonds Through AI: A Hermeneutic Reflection on ThanabotsLeah Henrickson
 
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...TrustArc
 
TopCryptoSupers 12thReport OrionX May2024
TopCryptoSupers 12thReport OrionX May2024TopCryptoSupers 12thReport OrionX May2024
TopCryptoSupers 12thReport OrionX May2024Stephen Perrenod
 
Extensible Python: Robustness through Addition - PyCon 2024
Extensible Python: Robustness through Addition - PyCon 2024Extensible Python: Robustness through Addition - PyCon 2024
Extensible Python: Robustness through Addition - PyCon 2024Patrick Viafore
 
The Metaverse: Are We There Yet?
The  Metaverse:    Are   We  There  Yet?The  Metaverse:    Are   We  There  Yet?
The Metaverse: Are We There Yet?Mark Billinghurst
 
Hyatt driving innovation and exceptional customer experiences with FIDO passw...
Hyatt driving innovation and exceptional customer experiences with FIDO passw...Hyatt driving innovation and exceptional customer experiences with FIDO passw...
Hyatt driving innovation and exceptional customer experiences with FIDO passw...FIDO Alliance
 
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...ScyllaDB
 
Intro to Passkeys and the State of Passwordless.pptx
Intro to Passkeys and the State of Passwordless.pptxIntro to Passkeys and the State of Passwordless.pptx
Intro to Passkeys and the State of Passwordless.pptxFIDO Alliance
 
ADP Passwordless Journey Case Study.pptx
ADP Passwordless Journey Case Study.pptxADP Passwordless Journey Case Study.pptx
ADP Passwordless Journey Case Study.pptxFIDO Alliance
 
Using IESVE for Room Loads Analysis - UK & Ireland
Using IESVE for Room Loads Analysis - UK & IrelandUsing IESVE for Room Loads Analysis - UK & Ireland
Using IESVE for Room Loads Analysis - UK & IrelandIES VE
 
2024 May Patch Tuesday
2024 May Patch Tuesday2024 May Patch Tuesday
2024 May Patch TuesdayIvanti
 
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdfIntroduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdfFIDO Alliance
 
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...panagenda
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightSafe Software
 
Long journey of Ruby Standard library at RubyKaigi 2024
Long journey of Ruby Standard library at RubyKaigi 2024Long journey of Ruby Standard library at RubyKaigi 2024
Long journey of Ruby Standard library at RubyKaigi 2024Hiroshi SHIBATA
 
Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)
Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)
Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)Paige Cruz
 

Recently uploaded (20)

WebRTC and SIP not just audio and video @ OpenSIPS 2024
WebRTC and SIP not just audio and video @ OpenSIPS 2024WebRTC and SIP not just audio and video @ OpenSIPS 2024
WebRTC and SIP not just audio and video @ OpenSIPS 2024
 
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
 
Collecting & Temporal Analysis of Behavioral Web Data - Tales From The Inside
Collecting & Temporal Analysis of Behavioral Web Data - Tales From The InsideCollecting & Temporal Analysis of Behavioral Web Data - Tales From The Inside
Collecting & Temporal Analysis of Behavioral Web Data - Tales From The Inside
 
Continuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
Continuing Bonds Through AI: A Hermeneutic Reflection on ThanabotsContinuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
Continuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
 
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
 
TopCryptoSupers 12thReport OrionX May2024
TopCryptoSupers 12thReport OrionX May2024TopCryptoSupers 12thReport OrionX May2024
TopCryptoSupers 12thReport OrionX May2024
 
Extensible Python: Robustness through Addition - PyCon 2024
Extensible Python: Robustness through Addition - PyCon 2024Extensible Python: Robustness through Addition - PyCon 2024
Extensible Python: Robustness through Addition - PyCon 2024
 
The Metaverse: Are We There Yet?
The  Metaverse:    Are   We  There  Yet?The  Metaverse:    Are   We  There  Yet?
The Metaverse: Are We There Yet?
 
Hyatt driving innovation and exceptional customer experiences with FIDO passw...
Hyatt driving innovation and exceptional customer experiences with FIDO passw...Hyatt driving innovation and exceptional customer experiences with FIDO passw...
Hyatt driving innovation and exceptional customer experiences with FIDO passw...
 
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
 
Intro to Passkeys and the State of Passwordless.pptx
Intro to Passkeys and the State of Passwordless.pptxIntro to Passkeys and the State of Passwordless.pptx
Intro to Passkeys and the State of Passwordless.pptx
 
ADP Passwordless Journey Case Study.pptx
ADP Passwordless Journey Case Study.pptxADP Passwordless Journey Case Study.pptx
ADP Passwordless Journey Case Study.pptx
 
Using IESVE for Room Loads Analysis - UK & Ireland
Using IESVE for Room Loads Analysis - UK & IrelandUsing IESVE for Room Loads Analysis - UK & Ireland
Using IESVE for Room Loads Analysis - UK & Ireland
 
2024 May Patch Tuesday
2024 May Patch Tuesday2024 May Patch Tuesday
2024 May Patch Tuesday
 
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdfIntroduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf
 
Overview of Hyperledger Foundation
Overview of Hyperledger FoundationOverview of Hyperledger Foundation
Overview of Hyperledger Foundation
 
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and Insight
 
Long journey of Ruby Standard library at RubyKaigi 2024
Long journey of Ruby Standard library at RubyKaigi 2024Long journey of Ruby Standard library at RubyKaigi 2024
Long journey of Ruby Standard library at RubyKaigi 2024
 
Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)
Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)
Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)
 

upload test

  • 1. Copyright © 2008, SAS Institute Inc. All rights reserved. Practical Design for Discrete Choice Experiments Bradley Jones, SAS Institute August 13, 2008
  • 2. Copyright © 2008, SAS Institute Inc. All rights reserved. DEMA 2008, August 2008, Cambridge 2  Respondents indicate the alternative they prefer most in each choice set  Alternatives are called profiles  Each profile is a combination of attribute levels  Choice sets typically consist of two, three or four profiles Discrete Choice Experiment Setup
  • 3. Copyright © 2008, SAS Institute Inc. All rights reserved. Example: Marketing a new laptop computer Attributes Levels Hard Drive 40 GB 80 GB Speed 1.5 GHz 2.0 GHz Battery Life 4 hours6 hours Price $1,000 $1,200 $1,500 DEMA 2008, August 2008, Cambridge 3
  • 4. Copyright © 2008, SAS Institute Inc. All rights reserved. Sample Choice Set Hard Disk Speed Battery Price 40Gig 1.5GHz 6hours $1,000 40Gig 2.0GHz 4hours $1,500 Check the box for the laptop you prefer. Profile 1 Profile 2 4DEMA 2008, August 2008, Cambridge
  • 5. Copyright © 2008, SAS Institute Inc. All rights reserved. 5 multinomial logit model based on the random utilities model where xjs represents the attribute levels and β is the set of parameter values probability of choosing alternative j in choice set s Statistical model ε′= +js js jsU xβ =1 option chosen in choice set js ts js J t j e p s e ′ ′   = ÷   ∑ xβ xβ DEMA 2008, August 2008, Cambridge
  • 6. Copyright © 2008, SAS Institute Inc. All rights reserved. D criterion - minimize the determinant of the variance matrix of the estimators: ( )( )1 det − M Xβ, Design optimality criterion DEMA 2008, August 2008, Cambridge 6 Equivalently – maximize the determinant of the information matrix, M.
  • 7. Copyright © 2008, SAS Institute Inc. All rights reserved. 7 Bayesian optimal designs: • construct a prior distribution for the parameters • find design that performs best on average • Sándor & Wedel (2001, 2002, 2005) Dependence on the unknown parameter, β ( ) ( ) ( ) ( )( ) 1 , S s s s s s s= ′ ′= −∑M Xβ X P β p β p β X DEMA 2008, August 2008, Cambridge
  • 8. Copyright © 2008, SAS Institute Inc. All rights reserved. Design for Nonlinear Models To design an informative experiment ….. You need to know something about the response function ….. And about the parameter values. 8DEMA 2008, August 2008, Cambridge
  • 9. Copyright © 2008, SAS Institute Inc. All rights reserved. Bayesian D-Optimal Design Bayesian ideas are natural to cope with the fact that the information matrix, M, depends on β. Chaloner and Larntz (1986) developed a Bayesian D- Optimality criterion: Φ(d) = ∫ log det [M(β;d)] p(β) dβ 9DEMA 2008, August 2008, Cambridge
  • 10. Copyright © 2008, SAS Institute Inc. All rights reserved. Computing Bayesian D-Optimal Designs A major impediment to Bayesian D-optimal design has been COMPUTATIONAL. The integral over β can be VERY SLOW. It must be computed MANY TIMES in the course of finding an optimal design. 10DEMA 2008, August 2008, Cambridge
  • 11. Copyright © 2008, SAS Institute Inc. All rights reserved. Bayesian Computations Gotwalt, Jones and Steinberg (2007) use a quadrature method, due to Mysovskikh. This method is guaranteed to exactly integrate all polynomials up to 5th degree and all odd-degree monomials. With p parameters, it requires just O(p2) function evaluations. 11DEMA 2008, August 2008, Cambridge
  • 12. Copyright © 2008, SAS Institute Inc. All rights reserved. Mysovskikh quadrature Assume a normal prior with independence. • Center the integral about the prior mean. • Scale each variable by its standard deviation. • Integrate over distance from the prior mean and, at each distance, over a spherical shell. 12DEMA 2008, August 2008, Cambridge
  • 13. Copyright © 2008, SAS Institute Inc. All rights reserved. Mysovskikh quadrature continued… Radial integral: Generalized Gauss-LaGuerre quadrature, with an extra point at the origin. Spherical integrals: The Mysovskikh quadrature scheme. 13DEMA 2008, August 2008, Cambridge
  • 14. Copyright © 2008, SAS Institute Inc. All rights reserved. Spherical integral A simplex, its edge midpoints on the sphere, and the inverses of all of these points. Simplex point weights: p(7-p)/2(p+1)2(p+2). Mid-point weights: 2(p-1)2/p(p+1)2(p+2). 14DEMA 2008, August 2008, Cambridge
  • 15. Copyright © 2008, SAS Institute Inc. All rights reserved. Simplex point Mid-point Each point is both a simplex point and a mid-point. All weights equal1/6. Quadrature points in two dimensions 15DEMA 2008, August 2008, Cambridge
  • 16. Copyright © 2008, SAS Institute Inc. All rights reserved. Study Description 16 Respondents – 8 developers 8 sales & marketing 9 Male 7 Female 2 Surveys with 6 choice sets in each Respondents were assigned randomly to surveys blocked by job function 16DEMA 2008, August 2008, Cambridge
  • 17. Copyright © 2008, SAS Institute Inc. All rights reserved. Software Demonstration 17DEMA 2008, August 2008, Cambridge
  • 18. Copyright © 2008, SAS Institute Inc. All rights reserved. Conclusions 1) Discrete Choice Conjoint Experiments require design methods for nonlinear models. 2) D-Optimal Bayesian designs reduce the dependence of the design on the unknown parameters. 3) New quadrature methods make computation of these designs much faster. 4) Commercial software makes carrying out such studies simple and efficient. 18DEMA 2008, August 2008, Cambridge
  • 19. Copyright © 2008, SAS Institute Inc. All rights reserved. References Atkinson, A. C. and Donev, A. N. (1992). Optimum Experimental Designs, Oxford U.K.: Clarendon Press. Cassity C.R., (1965) “Abscissas, Coefficients, and Error Term for the Generalized Gauss-Laguerre Quadrature Formula Using the Zero Ordinate,” Mathematics ofComputation, 19, 287-296. Chaloner, K. and Verdinelli, I. (1995). Bayesian experimental design: a re-view, Statistical Science 10: 273-304. Grossmann, H., Holling, H. and Schwabe, R. (2002). Advances in optimum experimental design for conjoint analysis and discrete choice models, in Advances in Econometrics, Econometric Models in Marketing, Vol. 16, Franses, P. H. and Montgomery, A. L., eds. Amsterdam: JAI Press, 93-117. Gotwalt, C., Jones, B. and Steinberg, D. (2009) Fast Computation of Designs Robust to Parameter Uncertainty for Nonlinear Settings accepted at Technometrics. Huber, J. and Zwerina, K. (1996). The importance of utility balance in efficient choice designs, Journal of Marketing Research 33: 307- 317. McFadden, D. (1974). Conditional logit analysis of qualitative choice behavior, in Frontiers in Econometrics, Zarembka, P., ed. New York: Academic Press, 105-142. Meyer, R. K. and Nachtsheim, C. J. (1995). The coordinate-exchange algorithm for constructing exact optimal experimental designs, Technometrics 37: 60-69. Monahan, J. and Genz, A. (1997). Spherical-radial integration rules for Bayesian computation, Journal of the American Statistical Association 92: 664-674. Sandor, Z. and Wedel, M. (2001). Designing conjoint choice experiments using managers' prior beliefs, Journal of Marketing Research 38: 430-444. 19DEMA 2008, August 2008, Cambridge