SlideShare a Scribd company logo
1 of 1
Download to read offline
Toward machines that behave ethically better than humans do
 Matthijs           Pontier 1, 2
                1                                                          Moral Goals      Belief strengths   Actions   Output
 Johan F, Hoorn




                                                         Moral reasoner
 1 VU                                                                                                             F
        University, Amsterdam                                                Autonomy
 2 http://camera-vu.nl/matthijs/
                                                                                                               Action1
   matthijspon@gmail.com

                                                                            Beneficence


                                                                                                               Action2
Abstract
Increasing dependence on autonomous                                       Non-maleficence
operating systems calls for ethical machine
behavior. Our moral reasoner combines
connectionism, utilitarianism, and ethical
theory about moral duties. The moral
decision-making matches the analysis of
expert ethicists in the health domain. This is
particularly useful when machines interact
with humans in a medical context. Connected
to a model of emotional intelligence and
affective decision making, we can explore
how moral decision making impacts affective
behavior and vice versa.



Background
Rosalind Picard (1997): ‘‘The greater the
freedom of a machine, the more it will need
moral standards.’’

Wallach, Franklin, and Allen (2010) argue
that agents that adhere to a deontological
ethic or that are utilitarians also require
emotional intelligence, a sense of self, and a
theory of mind.

We connected the moral system to Silicon
Coppélia (Hoorn, Pontier, & Siddiqui, 2011), a
model of emotional intelligence and affective
decision making. Silicon Coppélia contains a
feedback loop that learns the preferences of
an individual patient so to personalize its
behavior.



Results
                                                 Discussion
                                                 Sample Exp. 5: A patient with incurable cancer refuses chemotherapy to
                                                 live a few months longer, almost without pain, because he is convinced
                                                 of being cancer-free. According to Buchanan and Brock (1989), the
                                                 ethically preferable answer is to “try again.” The patient seems less than
                                                 fully autonomous and his decision leads to harm, denying the chance to
                                                 a longer life (a violation of the duty of beneficence). This he might regret
                                                 later. Our moral reasoner comes to the same conclusion as the ethical
                                                 experts. However, even among doctors, there is no consensus about the
                                                 interpretation of values, their ranking and meaning. Van Wynsberghe
                                                 (2012) found this depends on: the type of care (i.e., social vs. physical
                                                 care), the task (e.g., bathing vs. lifting vs. socializing), the care-givers
                                                 and their style, as well as the care-receivers and their specific needs.

More Related Content

Similar to Toward machines that behave ethically better than humans do - Poster

1. Consider again The Experience Machine from Week 2. Would you get .pdf
1. Consider again The Experience Machine from Week 2. Would you get .pdf1. Consider again The Experience Machine from Week 2. Would you get .pdf
1. Consider again The Experience Machine from Week 2. Would you get .pdf
cronkwurphyb44502
 
Final Project In this two-phased final assignment, students wil.docx
Final Project In this two-phased final assignment, students wil.docxFinal Project In this two-phased final assignment, students wil.docx
Final Project In this two-phased final assignment, students wil.docx
AKHIL969626
 
1111298173 282415 7
1111298173 282415 71111298173 282415 7
1111298173 282415 7
dborcoman
 
CHAPTER1CONSIDERINGMORALPHILOSOPHIESAND PRINCIPLEShatsour.docx
CHAPTER1CONSIDERINGMORALPHILOSOPHIESAND PRINCIPLEShatsour.docxCHAPTER1CONSIDERINGMORALPHILOSOPHIESAND PRINCIPLEShatsour.docx
CHAPTER1CONSIDERINGMORALPHILOSOPHIESAND PRINCIPLEShatsour.docx
tiffanyd4
 
CHAPTER 2Principles of Healthcare EthicsJim Summers.docx
CHAPTER 2Principles of Healthcare EthicsJim Summers.docxCHAPTER 2Principles of Healthcare EthicsJim Summers.docx
CHAPTER 2Principles of Healthcare EthicsJim Summers.docx
christinemaritza
 
SBCC Framework
SBCC FrameworkSBCC Framework
SBCC Framework
CChange
 
12. roy's theory
12. roy's theory12. roy's theory
12. roy's theory
Sukh Preet
 
CHAPTER1CONSIDERINGMORALPHILOSOPHIESAND PRINCIPLEShatsour
CHAPTER1CONSIDERINGMORALPHILOSOPHIESAND PRINCIPLEShatsourCHAPTER1CONSIDERINGMORALPHILOSOPHIESAND PRINCIPLEShatsour
CHAPTER1CONSIDERINGMORALPHILOSOPHIESAND PRINCIPLEShatsour
TawnaDelatorrejs
 

Similar to Toward machines that behave ethically better than humans do - Poster (20)

MEDICAL ETHICS LECTURE 2022.pptx
MEDICAL ETHICS LECTURE 2022.pptxMEDICAL ETHICS LECTURE 2022.pptx
MEDICAL ETHICS LECTURE 2022.pptx
 
1. Consider again The Experience Machine from Week 2. Would you get .pdf
1. Consider again The Experience Machine from Week 2. Would you get .pdf1. Consider again The Experience Machine from Week 2. Would you get .pdf
1. Consider again The Experience Machine from Week 2. Would you get .pdf
 
Final Project In this two-phased final assignment, students wil.docx
Final Project In this two-phased final assignment, students wil.docxFinal Project In this two-phased final assignment, students wil.docx
Final Project In this two-phased final assignment, students wil.docx
 
1111298173 282415 7
1111298173 282415 71111298173 282415 7
1111298173 282415 7
 
CHAPTER1CONSIDERINGMORALPHILOSOPHIESAND PRINCIPLEShatsour.docx
CHAPTER1CONSIDERINGMORALPHILOSOPHIESAND PRINCIPLEShatsour.docxCHAPTER1CONSIDERINGMORALPHILOSOPHIESAND PRINCIPLEShatsour.docx
CHAPTER1CONSIDERINGMORALPHILOSOPHIESAND PRINCIPLEShatsour.docx
 
Callista Roy's Theory of Adaptation.ppt
Callista Roy's Theory of Adaptation.pptCallista Roy's Theory of Adaptation.ppt
Callista Roy's Theory of Adaptation.ppt
 
CHAPTER 2Principles of Healthcare EthicsJim Summers.docx
CHAPTER 2Principles of Healthcare EthicsJim Summers.docxCHAPTER 2Principles of Healthcare EthicsJim Summers.docx
CHAPTER 2Principles of Healthcare EthicsJim Summers.docx
 
SBCC Framework
SBCC FrameworkSBCC Framework
SBCC Framework
 
Alimohammadi Et Al.docx
Alimohammadi Et Al.docxAlimohammadi Et Al.docx
Alimohammadi Et Al.docx
 
Chapter4 ethical issues
Chapter4  ethical issuesChapter4  ethical issues
Chapter4 ethical issues
 
12-roystheory-130614111953-phpapp02.pdf
12-roystheory-130614111953-phpapp02.pdf12-roystheory-130614111953-phpapp02.pdf
12-roystheory-130614111953-phpapp02.pdf
 
12. roy's theory
12. roy's theory12. roy's theory
12. roy's theory
 
CHAPTER1CONSIDERINGMORALPHILOSOPHIESAND PRINCIPLEShatsour
CHAPTER1CONSIDERINGMORALPHILOSOPHIESAND PRINCIPLEShatsourCHAPTER1CONSIDERINGMORALPHILOSOPHIESAND PRINCIPLEShatsour
CHAPTER1CONSIDERINGMORALPHILOSOPHIESAND PRINCIPLEShatsour
 
Chapter 7
Chapter  7Chapter  7
Chapter 7
 
Toward machines that behave ethically better than humans do
Toward machines that behave ethically better than humans doToward machines that behave ethically better than humans do
Toward machines that behave ethically better than humans do
 
THE ROY’S ADAPTATION MODEL OF NURSING.pptx
THE ROY’S ADAPTATION MODEL OF NURSING.pptxTHE ROY’S ADAPTATION MODEL OF NURSING.pptx
THE ROY’S ADAPTATION MODEL OF NURSING.pptx
 
Behaviour Change Communication.pptx
Behaviour Change Communication.pptxBehaviour Change Communication.pptx
Behaviour Change Communication.pptx
 
Introduction to bioethics
Introduction to bioethicsIntroduction to bioethics
Introduction to bioethics
 
BI-M2-CU7.pdf
BI-M2-CU7.pdfBI-M2-CU7.pdf
BI-M2-CU7.pdf
 
Common Theories.pptx
Common Theories.pptxCommon Theories.pptx
Common Theories.pptx
 

More from Matthijs Pontier

Hoe overheden en bedrijven je bespieden om je gedrag te manipuleren | Privacy...
Hoe overheden en bedrijven je bespieden om je gedrag te manipuleren | Privacy...Hoe overheden en bedrijven je bespieden om je gedrag te manipuleren | Privacy...
Hoe overheden en bedrijven je bespieden om je gedrag te manipuleren | Privacy...
Matthijs Pontier
 
Piratenpartij presentatie programma en kandidaten Tweede kamerverkiezingen 2021
Piratenpartij presentatie programma en kandidaten Tweede kamerverkiezingen 2021Piratenpartij presentatie programma en kandidaten Tweede kamerverkiezingen 2021
Piratenpartij presentatie programma en kandidaten Tweede kamerverkiezingen 2021
Matthijs Pontier
 
Ai shifting powers 2020 01-09
Ai shifting powers 2020 01-09Ai shifting powers 2020 01-09
Ai shifting powers 2020 01-09
Matthijs Pontier
 
Wie wordt de baas over onze big data? | 2019 10-29 HvA
Wie wordt de baas over onze big data? | 2019 10-29 HvAWie wordt de baas over onze big data? | 2019 10-29 HvA
Wie wordt de baas over onze big data? | 2019 10-29 HvA
Matthijs Pontier
 
Who controls our smart cities - CuriousU Summer School - Twente University - ...
Who controls our smart cities - CuriousU Summer School - Twente University - ...Who controls our smart cities - CuriousU Summer School - Twente University - ...
Who controls our smart cities - CuriousU Summer School - Twente University - ...
Matthijs Pontier
 
How we can use technology to increase our freedom - Psychedelic Society of th...
How we can use technology to increase our freedom - Psychedelic Society of th...How we can use technology to increase our freedom - Psychedelic Society of th...
How we can use technology to increase our freedom - Psychedelic Society of th...
Matthijs Pontier
 
Laat jij je meeslepen?
Laat jij je meeslepen?Laat jij je meeslepen?
Laat jij je meeslepen?
Matthijs Pontier
 
Encod jaarplan 2018
Encod jaarplan 2018Encod jaarplan 2018
Encod jaarplan 2018
Matthijs Pontier
 
Wie krijgt de controle over onze data - Inholland Diemen - 2017 11-23
Wie krijgt de controle over onze data - Inholland Diemen - 2017 11-23 Wie krijgt de controle over onze data - Inholland Diemen - 2017 11-23
Wie krijgt de controle over onze data - Inholland Diemen - 2017 11-23
Matthijs Pontier
 
How we can use technology to increase our freedom - and outsmart governments ...
How we can use technology to increase our freedom - and outsmart governments ...How we can use technology to increase our freedom - and outsmart governments ...
How we can use technology to increase our freedom - and outsmart governments ...
Matthijs Pontier
 
Wie de data controleert, heeft de macht - Symposium sticky / gastles UniC, U...
Wie de data controleert, heeft de macht - Symposium  sticky / gastles UniC, U...Wie de data controleert, heeft de macht - Symposium  sticky / gastles UniC, U...
Wie de data controleert, heeft de macht - Symposium sticky / gastles UniC, U...
Matthijs Pontier
 
Hoe we kunnen zorgen dat iedereen profiteert van robotisering | ConferentieSo...
Hoe we kunnen zorgen dat iedereen profiteert van robotisering | ConferentieSo...Hoe we kunnen zorgen dat iedereen profiteert van robotisering | ConferentieSo...
Hoe we kunnen zorgen dat iedereen profiteert van robotisering | ConferentieSo...
Matthijs Pontier
 
Het belang van privacy, als je niets te verbergen hebt
Het belang van privacy, als je niets te verbergen hebt Het belang van privacy, als je niets te verbergen hebt
Het belang van privacy, als je niets te verbergen hebt
Matthijs Pontier
 
Het draait om onze ideeen - pitch lijsttrekkersverkiezingen piratenpartij TK2...
Het draait om onze ideeen - pitch lijsttrekkersverkiezingen piratenpartij TK2...Het draait om onze ideeen - pitch lijsttrekkersverkiezingen piratenpartij TK2...
Het draait om onze ideeen - pitch lijsttrekkersverkiezingen piratenpartij TK2...
Matthijs Pontier
 
How autonomous cars are going to change our future - and what we can do to op...
How autonomous cars are going to change our future - and what we can do to op...How autonomous cars are going to change our future - and what we can do to op...
How autonomous cars are going to change our future - and what we can do to op...
Matthijs Pontier
 
Geef de grondwet (eindelijk eens) waarde
Geef de grondwet (eindelijk eens) waardeGeef de grondwet (eindelijk eens) waarde
Geef de grondwet (eindelijk eens) waarde
Matthijs Pontier
 
Exponential technology - How do we make sure everyone benefits?
Exponential technology - How do we make sure everyone benefits?Exponential technology - How do we make sure everyone benefits?
Exponential technology - How do we make sure everyone benefits?
Matthijs Pontier
 
Piratenpartij: Tegen macht, Voor vrijheid
Piratenpartij: Tegen macht, Voor vrijheidPiratenpartij: Tegen macht, Voor vrijheid
Piratenpartij: Tegen macht, Voor vrijheid
Matthijs Pontier
 

More from Matthijs Pontier (20)

Hoe overheden en bedrijven je bespieden om je gedrag te manipuleren | Privacy...
Hoe overheden en bedrijven je bespieden om je gedrag te manipuleren | Privacy...Hoe overheden en bedrijven je bespieden om je gedrag te manipuleren | Privacy...
Hoe overheden en bedrijven je bespieden om je gedrag te manipuleren | Privacy...
 
Piratenpartij presentatie programma en kandidaten Tweede kamerverkiezingen 2021
Piratenpartij presentatie programma en kandidaten Tweede kamerverkiezingen 2021Piratenpartij presentatie programma en kandidaten Tweede kamerverkiezingen 2021
Piratenpartij presentatie programma en kandidaten Tweede kamerverkiezingen 2021
 
Ai shifting powers 2020 01-09
Ai shifting powers 2020 01-09Ai shifting powers 2020 01-09
Ai shifting powers 2020 01-09
 
Wie wordt de baas over onze big data? | 2019 10-29 HvA
Wie wordt de baas over onze big data? | 2019 10-29 HvAWie wordt de baas over onze big data? | 2019 10-29 HvA
Wie wordt de baas over onze big data? | 2019 10-29 HvA
 
Who controls our smart cities - CuriousU Summer School - Twente University - ...
Who controls our smart cities - CuriousU Summer School - Twente University - ...Who controls our smart cities - CuriousU Summer School - Twente University - ...
Who controls our smart cities - CuriousU Summer School - Twente University - ...
 
How we can use technology to increase our freedom - Psychedelic Society of th...
How we can use technology to increase our freedom - Psychedelic Society of th...How we can use technology to increase our freedom - Psychedelic Society of th...
How we can use technology to increase our freedom - Psychedelic Society of th...
 
Laat jij je meeslepen?
Laat jij je meeslepen?Laat jij je meeslepen?
Laat jij je meeslepen?
 
Encod jaarplan 2018
Encod jaarplan 2018Encod jaarplan 2018
Encod jaarplan 2018
 
Wie krijgt de controle over onze data - Inholland Diemen - 2017 11-23
Wie krijgt de controle over onze data - Inholland Diemen - 2017 11-23 Wie krijgt de controle over onze data - Inholland Diemen - 2017 11-23
Wie krijgt de controle over onze data - Inholland Diemen - 2017 11-23
 
How we can use technology to increase our freedom - and outsmart governments ...
How we can use technology to increase our freedom - and outsmart governments ...How we can use technology to increase our freedom - and outsmart governments ...
How we can use technology to increase our freedom - and outsmart governments ...
 
Wie de data controleert, heeft de macht - Symposium sticky / gastles UniC, U...
Wie de data controleert, heeft de macht - Symposium  sticky / gastles UniC, U...Wie de data controleert, heeft de macht - Symposium  sticky / gastles UniC, U...
Wie de data controleert, heeft de macht - Symposium sticky / gastles UniC, U...
 
Hoe de Piratenpartij de rechtsstaat wil beschermen en waarom je deze presenta...
Hoe de Piratenpartij de rechtsstaat wil beschermen en waarom je deze presenta...Hoe de Piratenpartij de rechtsstaat wil beschermen en waarom je deze presenta...
Hoe de Piratenpartij de rechtsstaat wil beschermen en waarom je deze presenta...
 
Hoe we kunnen zorgen dat iedereen profiteert van robotisering | ConferentieSo...
Hoe we kunnen zorgen dat iedereen profiteert van robotisering | ConferentieSo...Hoe we kunnen zorgen dat iedereen profiteert van robotisering | ConferentieSo...
Hoe we kunnen zorgen dat iedereen profiteert van robotisering | ConferentieSo...
 
Het belang van privacy, als je niets te verbergen hebt
Het belang van privacy, als je niets te verbergen hebt Het belang van privacy, als je niets te verbergen hebt
Het belang van privacy, als je niets te verbergen hebt
 
Hoe de piratenpartij de rechtsstaat wil beschermen - en wetten klaar wil make...
Hoe de piratenpartij de rechtsstaat wil beschermen - en wetten klaar wil make...Hoe de piratenpartij de rechtsstaat wil beschermen - en wetten klaar wil make...
Hoe de piratenpartij de rechtsstaat wil beschermen - en wetten klaar wil make...
 
Het draait om onze ideeen - pitch lijsttrekkersverkiezingen piratenpartij TK2...
Het draait om onze ideeen - pitch lijsttrekkersverkiezingen piratenpartij TK2...Het draait om onze ideeen - pitch lijsttrekkersverkiezingen piratenpartij TK2...
Het draait om onze ideeen - pitch lijsttrekkersverkiezingen piratenpartij TK2...
 
How autonomous cars are going to change our future - and what we can do to op...
How autonomous cars are going to change our future - and what we can do to op...How autonomous cars are going to change our future - and what we can do to op...
How autonomous cars are going to change our future - and what we can do to op...
 
Geef de grondwet (eindelijk eens) waarde
Geef de grondwet (eindelijk eens) waardeGeef de grondwet (eindelijk eens) waarde
Geef de grondwet (eindelijk eens) waarde
 
Exponential technology - How do we make sure everyone benefits?
Exponential technology - How do we make sure everyone benefits?Exponential technology - How do we make sure everyone benefits?
Exponential technology - How do we make sure everyone benefits?
 
Piratenpartij: Tegen macht, Voor vrijheid
Piratenpartij: Tegen macht, Voor vrijheidPiratenpartij: Tegen macht, Voor vrijheid
Piratenpartij: Tegen macht, Voor vrijheid
 

Recently uploaded

IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
Enterprise Knowledge
 

Recently uploaded (20)

08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfTech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdf
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 

Toward machines that behave ethically better than humans do - Poster

  • 1. Toward machines that behave ethically better than humans do Matthijs Pontier 1, 2 1 Moral Goals Belief strengths Actions Output Johan F, Hoorn Moral reasoner 1 VU F University, Amsterdam Autonomy 2 http://camera-vu.nl/matthijs/ Action1 matthijspon@gmail.com Beneficence Action2 Abstract Increasing dependence on autonomous Non-maleficence operating systems calls for ethical machine behavior. Our moral reasoner combines connectionism, utilitarianism, and ethical theory about moral duties. The moral decision-making matches the analysis of expert ethicists in the health domain. This is particularly useful when machines interact with humans in a medical context. Connected to a model of emotional intelligence and affective decision making, we can explore how moral decision making impacts affective behavior and vice versa. Background Rosalind Picard (1997): ‘‘The greater the freedom of a machine, the more it will need moral standards.’’ Wallach, Franklin, and Allen (2010) argue that agents that adhere to a deontological ethic or that are utilitarians also require emotional intelligence, a sense of self, and a theory of mind. We connected the moral system to Silicon Coppélia (Hoorn, Pontier, & Siddiqui, 2011), a model of emotional intelligence and affective decision making. Silicon Coppélia contains a feedback loop that learns the preferences of an individual patient so to personalize its behavior. Results Discussion Sample Exp. 5: A patient with incurable cancer refuses chemotherapy to live a few months longer, almost without pain, because he is convinced of being cancer-free. According to Buchanan and Brock (1989), the ethically preferable answer is to “try again.” The patient seems less than fully autonomous and his decision leads to harm, denying the chance to a longer life (a violation of the duty of beneficence). This he might regret later. Our moral reasoner comes to the same conclusion as the ethical experts. However, even among doctors, there is no consensus about the interpretation of values, their ranking and meaning. Van Wynsberghe (2012) found this depends on: the type of care (i.e., social vs. physical care), the task (e.g., bathing vs. lifting vs. socializing), the care-givers and their style, as well as the care-receivers and their specific needs.