SlideShare une entreprise Scribd logo
1  sur  43
BAMS 517 Decision Analysis:  A Dynamic Programming Perspective Martin L. Puterman UBC Sauder School of Business Winter Term  2010
Introduction to Decision Analysis -outline ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Some dynamic decision problems ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],In each case there is a trade-off between immediate reward and uncertain long term gain
Common ingredients of these dynamic decision problems ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Basic Decision Analysis
Decision Analysis ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Decision Analysis ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Simple decision problems ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Assessing Probabilities Through Decision Trees
The election stock market problem ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
The election problem on September 8 Payoff (Gain) Obama wins Obama loses Buy 1 share 1  (+.44) 0 (-.56) Do not 0  0
A decision tree for the election problem Do not  invest $0 Buy 1 share $0.44 Obama wins Obama loses 1-q q -$0.56
Valuing gambles  ,[object Object],[object Object],[object Object]
Solving the election problem -   a reduced problem  Do not invest $0 Buy 1 share $( q-.56) We replace the gamble by its expectation – latter we use expected utility of the gamble
The election problem solution ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Odds ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Odds revisited ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
A decision tree for the Super Bowl problem Do not  bet $0 Bet on Arizona  $40 Arizona wins Arizona loses 1-q q -$1
Solving the Super Bowl problem Do not bet $0 Bet on  Arizona $ 41q -1 You would be indifferent between the two decisions if q = 1/41 or 1-q =40/41
Odds and Bookmaker’s Odds ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Games of Chance and Odds The payout on a successful bet on a single number is 35 to 1 plus the amount bet. The true bookmaker’s odds are 37 to 1 on an American roulette wheel (with 0 and 00). (assuming a fair wheel)
A decision tree for a single number bet in roulette Do not  bet $0 Bet $1 on 7  $35 Ball stops on 7 Lose 37/38 1/38 -$1
Solving the roulette problem Do not $0 Bet $1 on 7  -$ 0.0526
Bet name Winning spaces Payout Odds against winning Expected value (on a $1 bet) 0 0 35 to 1 37 to 1 − $0.053 00 00 35 to 1 37 to 1 − $0.053 Straight up Any single number 35 to 1 37 to 1 − $0.053 Row 00 0, 00 17 to 1 18 to 1 − $0.053 Split any two adjoining numbers vertical or horizontal 17 to 1 18 to 1 − $0.053 Trio 0, 1, 2 or 00, 2, 3 11 to 1 11.667 to 1 − $0.053 Street any three numbers horizontal (1, 2, 3 or 4, 5, 6 etc.) 11 to 1 11.667 to 1 − $0.053 Corner any four adjoining numbers in a block (1, 2, 4, 5 or 17, 18, 20, 21 etc. ) 8 to 1 8.5 to 1 − $0.053 Five Number Bet 0, 00, 1, 2, 3 6 to 1 6.6 to 1 − $0.079 Six Line any six numbers from two horizontal rows (1, 2, 3, 4, 5, 6 or 28, 29, 30, 31, 32, 33 etc.) 5 to 1 5.33 to 1 − $0.053 1st Column 1, 4, 7, 10, 13, 16, 19, 22, 25, 28, 31, 34 2 to 1 2.167 to 1 − $0.053 2nd Column 2, 5, 8, 11, 14, 17, 20, 23, 26, 29, 32, 35 2 to 1 2.167 to 1 − $0.053 3rd Column 3, 6, 9, 12, 15, 18, 21, 24, 27, 30, 33, 36 2 to 1 2.167 to 1 − $0.053 1st Dozen 1 through 12 2 to 1 2.167 to 1 − $0.053 2nd Dozen 13 through 24 2 to 1 2.167 to 1 − $0.053 3rd Dozen 25 through 36 2 to 1 2.167 to 1 − $0.053 Odd 1, 3, 5, ..., 35 1 to 1 1.111 to 1 − $0.053 Even 2, 4, 6, ..., 36 1 to 1 1.111 to 1 − $0.053 Red 1, 3, 5, 7, 9, 12, 14, 16, 18, 19, 21, 23, 25, 27, 30, 32, 34, 36 1 to 1 1.111 to 1 − $0.053 Black 2, 4, 6, 8, 10, 11, 13, 15, 17, 20, 22, 24, 26, 28, 29, 31, 33, 35 1 to 1 1.111 to 1 − $0.053 1 to 18 1, 2, 3, ..., 18 1 to 1 1.111 to 1 − $0.053 19 to 36 19, 20, 21, ..., 36 1 to 1 1.111 to 1 − $0.053
Roulette  ,[object Object],[object Object],[object Object],[object Object],[object Object]
Money Lines or “odds sets” ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Assigning probabilities to events ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Assigning probabilities to events ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Assigning probabilities to events ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Assigning probabilities to events ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
The implied decision tree Thumbtack land up Thumbtack lands on “ tip down” Spinner blue Spinner red +1 0 0 +1 Choice A Choice B
Implications of using reference lottery ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Another option – acquire information ,[object Object],[object Object],[object Object],[object Object],[object Object]
Assigning probabilities to events ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Axioms of Probability  ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
The law of total probabilities ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Bayes’ rule ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Updating probability assessments ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Updating probability assessments ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Probabilities for single events ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
The “Monty Hall” problem ,[object Object],[object Object],[object Object],[object Object],[object Object]
The “Monty Hall” problem ,[object Object],[object Object],[object Object]
Summary ,[object Object],[object Object],[object Object],[object Object],[object Object]

Contenu connexe

Similaire à Decision Analysis I 2010

Fin415 Week 2 Slides
Fin415 Week 2 SlidesFin415 Week 2 Slides
Fin415 Week 2 Slidessmarkbarnes
 
Ug statistics help
Ug statistics helpUg statistics help
Ug statistics helpBrent Heard
 
_23e08c8545a6e563cf150d67c00b7b56_Utility-of-Money.pdf
_23e08c8545a6e563cf150d67c00b7b56_Utility-of-Money.pdf_23e08c8545a6e563cf150d67c00b7b56_Utility-of-Money.pdf
_23e08c8545a6e563cf150d67c00b7b56_Utility-of-Money.pdfMuhammadAsadAli27
 
Individual decision making ppt @ becdoms
Individual decision making ppt @ becdomsIndividual decision making ppt @ becdoms
Individual decision making ppt @ becdomsBabasab Patil
 
Unit 12: Probability
Unit 12: ProbabilityUnit 12: Probability
Unit 12: ProbabilityRenegarmath
 
Decision treeprimer 1
Decision treeprimer 1Decision treeprimer 1
Decision treeprimer 1olenyxa
 
Anastasi Lecture 2008
Anastasi Lecture 2008Anastasi Lecture 2008
Anastasi Lecture 2008behnke3791
 
Lecture3 Modelling Decision Processes
Lecture3 Modelling Decision ProcessesLecture3 Modelling Decision Processes
Lecture3 Modelling Decision ProcessesKodok Ngorex
 
QuestionWhich of the following data sets is most likel.docx
QuestionWhich of the following data sets is most likel.docxQuestionWhich of the following data sets is most likel.docx
QuestionWhich of the following data sets is most likel.docxcatheryncouper
 
Decision Trees - a tool for better decision-making
Decision Trees- a tool for better decision-makingDecision Trees- a tool for better decision-making
Decision Trees - a tool for better decision-makingOmar Ha-Redeye
 
Don’t Believe Everything You See (or Think): Optical Illusions as a window on...
Don’t Believe Everything You See (or Think): Optical Illusions as a window on...Don’t Believe Everything You See (or Think): Optical Illusions as a window on...
Don’t Believe Everything You See (or Think): Optical Illusions as a window on...Paul Sas
 
Solutions to Problem Set 2 The following note was very i.docx
Solutions to Problem Set 2 The following note was very i.docxSolutions to Problem Set 2 The following note was very i.docx
Solutions to Problem Set 2 The following note was very i.docxrafbolet0
 
Mean and Variance of Discrete Random Variable.pptx
Mean and Variance of Discrete Random Variable.pptxMean and Variance of Discrete Random Variable.pptx
Mean and Variance of Discrete Random Variable.pptxMarkJayAquillo
 
1. In the construction of decision trees, which of the following s.docx
1. In the construction of decision trees, which of the following s.docx1. In the construction of decision trees, which of the following s.docx
1. In the construction of decision trees, which of the following s.docxhyacinthshackley2629
 
Ratios And Proportions Notes
Ratios And Proportions NotesRatios And Proportions Notes
Ratios And Proportions NotesJeremy Shortess
 
Week8finalexamlivelecture april2012
Week8finalexamlivelecture april2012Week8finalexamlivelecture april2012
Week8finalexamlivelecture april2012Brent Heard
 

Similaire à Decision Analysis I 2010 (20)

Fin415 Week 2 Slides
Fin415 Week 2 SlidesFin415 Week 2 Slides
Fin415 Week 2 Slides
 
Ug statistics help
Ug statistics helpUg statistics help
Ug statistics help
 
_23e08c8545a6e563cf150d67c00b7b56_Utility-of-Money.pdf
_23e08c8545a6e563cf150d67c00b7b56_Utility-of-Money.pdf_23e08c8545a6e563cf150d67c00b7b56_Utility-of-Money.pdf
_23e08c8545a6e563cf150d67c00b7b56_Utility-of-Money.pdf
 
Individual decision making ppt @ becdoms
Individual decision making ppt @ becdomsIndividual decision making ppt @ becdoms
Individual decision making ppt @ becdoms
 
Unit 12: Probability
Unit 12: ProbabilityUnit 12: Probability
Unit 12: Probability
 
R4 decision
R4 decisionR4 decision
R4 decision
 
Decision treeprimer 1
Decision treeprimer 1Decision treeprimer 1
Decision treeprimer 1
 
Anastasi Lecture 2008
Anastasi Lecture 2008Anastasi Lecture 2008
Anastasi Lecture 2008
 
Decision treeprimer 1
Decision treeprimer 1Decision treeprimer 1
Decision treeprimer 1
 
Decision theory
Decision theoryDecision theory
Decision theory
 
Lecture3 Modelling Decision Processes
Lecture3 Modelling Decision ProcessesLecture3 Modelling Decision Processes
Lecture3 Modelling Decision Processes
 
QuestionWhich of the following data sets is most likel.docx
QuestionWhich of the following data sets is most likel.docxQuestionWhich of the following data sets is most likel.docx
QuestionWhich of the following data sets is most likel.docx
 
Decision Trees - a tool for better decision-making
Decision Trees- a tool for better decision-makingDecision Trees- a tool for better decision-making
Decision Trees - a tool for better decision-making
 
Don’t Believe Everything You See (or Think): Optical Illusions as a window on...
Don’t Believe Everything You See (or Think): Optical Illusions as a window on...Don’t Believe Everything You See (or Think): Optical Illusions as a window on...
Don’t Believe Everything You See (or Think): Optical Illusions as a window on...
 
Solutions to Problem Set 2 The following note was very i.docx
Solutions to Problem Set 2 The following note was very i.docxSolutions to Problem Set 2 The following note was very i.docx
Solutions to Problem Set 2 The following note was very i.docx
 
Mean and Variance of Discrete Random Variable.pptx
Mean and Variance of Discrete Random Variable.pptxMean and Variance of Discrete Random Variable.pptx
Mean and Variance of Discrete Random Variable.pptx
 
1. In the construction of decision trees, which of the following s.docx
1. In the construction of decision trees, which of the following s.docx1. In the construction of decision trees, which of the following s.docx
1. In the construction of decision trees, which of the following s.docx
 
Decision theory
Decision theoryDecision theory
Decision theory
 
Ratios And Proportions Notes
Ratios And Proportions NotesRatios And Proportions Notes
Ratios And Proportions Notes
 
Week8finalexamlivelecture april2012
Week8finalexamlivelecture april2012Week8finalexamlivelecture april2012
Week8finalexamlivelecture april2012
 

Dernier

Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)Jisc
 
General Principles of Intellectual Property: Concepts of Intellectual Proper...
General Principles of Intellectual Property: Concepts of Intellectual  Proper...General Principles of Intellectual Property: Concepts of Intellectual  Proper...
General Principles of Intellectual Property: Concepts of Intellectual Proper...Poonam Aher Patil
 
How to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptxHow to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptxCeline George
 
Graduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - EnglishGraduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - Englishneillewis46
 
Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)Jisc
 
ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.MaryamAhmad92
 
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptxSKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptxAmanpreet Kaur
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17Celine George
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsTechSoup
 
Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxUnit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxVishalSingh1417
 
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...Nguyen Thanh Tu Collection
 
Application orientated numerical on hev.ppt
Application orientated numerical on hev.pptApplication orientated numerical on hev.ppt
Application orientated numerical on hev.pptRamjanShidvankar
 
Spellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please PractiseSpellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please PractiseAnaAcapella
 
Kodo Millet PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
Kodo Millet  PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...Kodo Millet  PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
Kodo Millet PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...pradhanghanshyam7136
 
Fostering Friendships - Enhancing Social Bonds in the Classroom
Fostering Friendships - Enhancing Social Bonds  in the ClassroomFostering Friendships - Enhancing Social Bonds  in the Classroom
Fostering Friendships - Enhancing Social Bonds in the ClassroomPooky Knightsmith
 
Towards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptxTowards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptxJisc
 
Interdisciplinary_Insights_Data_Collection_Methods.pptx
Interdisciplinary_Insights_Data_Collection_Methods.pptxInterdisciplinary_Insights_Data_Collection_Methods.pptx
Interdisciplinary_Insights_Data_Collection_Methods.pptxPooja Bhuva
 
Understanding Accommodations and Modifications
Understanding  Accommodations and ModificationsUnderstanding  Accommodations and Modifications
Understanding Accommodations and ModificationsMJDuyan
 
Food safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdfFood safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdfSherif Taha
 

Dernier (20)

Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)
 
General Principles of Intellectual Property: Concepts of Intellectual Proper...
General Principles of Intellectual Property: Concepts of Intellectual  Proper...General Principles of Intellectual Property: Concepts of Intellectual  Proper...
General Principles of Intellectual Property: Concepts of Intellectual Proper...
 
How to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptxHow to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptx
 
Graduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - EnglishGraduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - English
 
Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)
 
ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.
 
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptxSKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The Basics
 
Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxUnit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptx
 
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
 
Application orientated numerical on hev.ppt
Application orientated numerical on hev.pptApplication orientated numerical on hev.ppt
Application orientated numerical on hev.ppt
 
Spellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please PractiseSpellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please Practise
 
Spatium Project Simulation student brief
Spatium Project Simulation student briefSpatium Project Simulation student brief
Spatium Project Simulation student brief
 
Kodo Millet PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
Kodo Millet  PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...Kodo Millet  PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
Kodo Millet PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
 
Fostering Friendships - Enhancing Social Bonds in the Classroom
Fostering Friendships - Enhancing Social Bonds  in the ClassroomFostering Friendships - Enhancing Social Bonds  in the Classroom
Fostering Friendships - Enhancing Social Bonds in the Classroom
 
Towards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptxTowards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptx
 
Interdisciplinary_Insights_Data_Collection_Methods.pptx
Interdisciplinary_Insights_Data_Collection_Methods.pptxInterdisciplinary_Insights_Data_Collection_Methods.pptx
Interdisciplinary_Insights_Data_Collection_Methods.pptx
 
Understanding Accommodations and Modifications
Understanding  Accommodations and ModificationsUnderstanding  Accommodations and Modifications
Understanding Accommodations and Modifications
 
Food safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdfFood safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdf
 

Decision Analysis I 2010

  • 1. BAMS 517 Decision Analysis: A Dynamic Programming Perspective Martin L. Puterman UBC Sauder School of Business Winter Term 2010
  • 2.
  • 3.
  • 4.
  • 6.
  • 7.
  • 8.
  • 10.
  • 11. The election problem on September 8 Payoff (Gain) Obama wins Obama loses Buy 1 share 1 (+.44) 0 (-.56) Do not 0 0
  • 12. A decision tree for the election problem Do not invest $0 Buy 1 share $0.44 Obama wins Obama loses 1-q q -$0.56
  • 13.
  • 14. Solving the election problem - a reduced problem Do not invest $0 Buy 1 share $( q-.56) We replace the gamble by its expectation – latter we use expected utility of the gamble
  • 15.
  • 16.
  • 17.
  • 18. A decision tree for the Super Bowl problem Do not bet $0 Bet on Arizona $40 Arizona wins Arizona loses 1-q q -$1
  • 19. Solving the Super Bowl problem Do not bet $0 Bet on Arizona $ 41q -1 You would be indifferent between the two decisions if q = 1/41 or 1-q =40/41
  • 20.
  • 21. Games of Chance and Odds The payout on a successful bet on a single number is 35 to 1 plus the amount bet. The true bookmaker’s odds are 37 to 1 on an American roulette wheel (with 0 and 00). (assuming a fair wheel)
  • 22. A decision tree for a single number bet in roulette Do not bet $0 Bet $1 on 7 $35 Ball stops on 7 Lose 37/38 1/38 -$1
  • 23. Solving the roulette problem Do not $0 Bet $1 on 7 -$ 0.0526
  • 24. Bet name Winning spaces Payout Odds against winning Expected value (on a $1 bet) 0 0 35 to 1 37 to 1 − $0.053 00 00 35 to 1 37 to 1 − $0.053 Straight up Any single number 35 to 1 37 to 1 − $0.053 Row 00 0, 00 17 to 1 18 to 1 − $0.053 Split any two adjoining numbers vertical or horizontal 17 to 1 18 to 1 − $0.053 Trio 0, 1, 2 or 00, 2, 3 11 to 1 11.667 to 1 − $0.053 Street any three numbers horizontal (1, 2, 3 or 4, 5, 6 etc.) 11 to 1 11.667 to 1 − $0.053 Corner any four adjoining numbers in a block (1, 2, 4, 5 or 17, 18, 20, 21 etc. ) 8 to 1 8.5 to 1 − $0.053 Five Number Bet 0, 00, 1, 2, 3 6 to 1 6.6 to 1 − $0.079 Six Line any six numbers from two horizontal rows (1, 2, 3, 4, 5, 6 or 28, 29, 30, 31, 32, 33 etc.) 5 to 1 5.33 to 1 − $0.053 1st Column 1, 4, 7, 10, 13, 16, 19, 22, 25, 28, 31, 34 2 to 1 2.167 to 1 − $0.053 2nd Column 2, 5, 8, 11, 14, 17, 20, 23, 26, 29, 32, 35 2 to 1 2.167 to 1 − $0.053 3rd Column 3, 6, 9, 12, 15, 18, 21, 24, 27, 30, 33, 36 2 to 1 2.167 to 1 − $0.053 1st Dozen 1 through 12 2 to 1 2.167 to 1 − $0.053 2nd Dozen 13 through 24 2 to 1 2.167 to 1 − $0.053 3rd Dozen 25 through 36 2 to 1 2.167 to 1 − $0.053 Odd 1, 3, 5, ..., 35 1 to 1 1.111 to 1 − $0.053 Even 2, 4, 6, ..., 36 1 to 1 1.111 to 1 − $0.053 Red 1, 3, 5, 7, 9, 12, 14, 16, 18, 19, 21, 23, 25, 27, 30, 32, 34, 36 1 to 1 1.111 to 1 − $0.053 Black 2, 4, 6, 8, 10, 11, 13, 15, 17, 20, 22, 24, 26, 28, 29, 31, 33, 35 1 to 1 1.111 to 1 − $0.053 1 to 18 1, 2, 3, ..., 18 1 to 1 1.111 to 1 − $0.053 19 to 36 19, 20, 21, ..., 36 1 to 1 1.111 to 1 − $0.053
  • 25.
  • 26.
  • 27.
  • 28.
  • 29.
  • 30.
  • 31. The implied decision tree Thumbtack land up Thumbtack lands on “ tip down” Spinner blue Spinner red +1 0 0 +1 Choice A Choice B
  • 32.
  • 33.
  • 34.
  • 35.
  • 36.
  • 37.
  • 38.
  • 39.
  • 40.
  • 41.
  • 42.
  • 43.