Robot minds and human ethics: The need for a comprehensive model of moral decision making

Ethics and Information Technology

Volumn 12, Issue 3, 2010, Pages 243-250

  Wallach, Wendell ^a,b  

^a Interdisciplinary Center For Bioethics ^*  (United States)

^b YALE UNIVERSITY   (United States)

Author keywords

Computers; Decision making; Emotions; Machine ethics; Moral agent; Moral judgment; Moral philosophy; Moral psychology; Robots; Virtues

Indexed keywords

COMPUTERS; DECISION MAKING; PHILOSOPHICAL ASPECTS; ROBOTS;

EMOTIONS; MORAL AGENTS; MORAL JUDGMENT; MORAL PHILOSOPHY; MORAL PSYCHOLOGY; VIRTUES;

BEHAVIORAL RESEARCH;

EID: 77955559970     PISSN: 13881957     EISSN: 15728439     Source Type: Journal    
DOI: 10.1007/s10676-010-9232-8     Document Type: Article

References (45)

1. Allen, C. (2002). Calculated morality: Ethical computing in the limit. In I. Smit & G. Lasker (Eds.), Cognitive, emotive and ethical aspects of decision making and human action, vol I. Germany/Windsor, Ontario: Baden Baden/IIAS.
2. Allen, C., Varner, G., & Zinser, J. (2000). Prolegomena to any future artificial moral agent. Journal of Experimental and Theoretical Artificial Intelligence, 12, 251-261.
3. Anderson, M., & Anderson, S. (2006). Machine ethics. IEEE Intelligent Systems, 21(4), 10-11.
4. Anderson, M., Anderson, S., & Armen, C. (2006). An approach to computing ethics. IEEE Intelligent Systems, 21(4), 56-63.
5. Axelrod, R., & Hamilton, W. (1981). The evolution of cooperation. Science, 211, 1390-1396.
6. Bentham, J. [1823] 2008. Introduction to the Principles of Morals and Legislation. Whitefish, MT: Kessinger Publishing, LLC.
7. Danielson, P. (1992). Artificial morality: Virtuous robots for virtual games. New York: Routledge.
8. Darley, J., & Batson, D. (1973). From Jerusalem to Jericho: A study of situational and dispositional variables in helping behavior. Journal of Personality and Social Psychology, 27, 100-108.
9. de Waal, F. (1996). Good natured: The evolution of right & wrong in humans and other animals. Cambridge, MA: Harvard University Press.
10. Flack, J., & de Waal, F. (2000) 'Any Animal Whatever': Darwinian building blocks of morality in monkeys and apes. In L. Katz (Ed.), Evolutionary origins of morality (pp. 1-30). Imprint Academic.
11. Franklin, S. (2003). IDA: A conscious artifact? Journal of Consciousness Studies, 10, 47-66.
12. Franklin, S., & Patterson, F. G. (2006). The LIDA architecture: Adding new modes of learning to an intelligent, Autonomous, Software Agent. IDPT-2006 Proceedings (Integrated Design and Process Technology). Society for Design and Process Science.
13. Gigerenzer, G. (2010). Moral satisficing: Rethinking morality as bounded rationality. TopiCS (forthcoming).
14. Greene, J., Sommerville, B., Nystrom, L., Darley, J., & Cohen, J. (2001). An fMRI investigation of emotional engagement in moral Judgment. Science, vol. 293, Sept. 14, 2001, 2105-2108, 2001.
15. Greenwald, A., & Banaji, M. (1995). Implicit social cognition: Attitudes, self-esteem, and stereotypes. Psychological Review, 102, 4-27.
16. Haidt, J. (2001). The emotional dog and its rational tail: A social intuitionist approach to moral judgment. Psychological Review, 108(4), 814-834.
17. Haidt, J. (2003). The moral emotions. In R. J. Davidson, K. R. Scherer, & H. H. Goldsmith (Eds.), Handbook of affective sciences (pp. 852-870). Oxford: Oxford University Press.
18. Hamilton, W. (1964a). The general evolution of social behavior I. Journal of Theoretical Biology, 7, 1-16.
19. Hamilton, W. (1964b). The general evolution of social behavior II. Journal of Theoretical Biology, 7, 17-52.
20. Hauser, M. (2006). Moral minds: How nature designed our universal sense of right and wrong. New York: Ecco.
21. Hume, D. [1739-1740] 2009. A treatise on human nature: Being an attempt to introduce the experimental method of reasoning into moral subjects. Ithaca: Cornell University Press.
22. Isen, A., & Levin, P. F. (1972). Effect of feeling good on helping: Cookies and kindness. Journal of Personality and Social Psychology, 21, 384-388.
23. Kohlberg, L. (1981). Essays on moral development, vol. I: The philosophy of moral development. San Francisco: Harper & Row.
24. Kohlberg, L. (1984). Essays on moral development, vol 2: The psychology of moral development. San Francisco: Harper & Row.
25. Lapsley, D., & Narvaez, D. (Eds.). (2004). Moral development, self, and identity. Mahwah, New Jersey: Lawrence Erlbaum Associates.
26. Mikhail, J. (2000). Rawls' linguistic analogy: A study of the "generative grammar" model of moral theory described by John Rawls in A Theory of Justice. PhD Dissertation, Cornell University.
27. Miller, G. (1956). The magical number seven, plus or minus two: Some limits on our capacity for processing information. The Psychological Review, 63(2), 81-97.
28. Moore, G. E. [1903] 2008. Principia Ethica. Cambridge, UK: Cambridge University Press.
29. Nucci, L., & Narvaez, D. (2008). Handbook of moral and character education. New York: Routledge.
30. Piaget, J. (1972). Judgment and reasoning in the child. Totowa, NJ: Littlefield, Adams and Company.
31. Rawls, J. [1971] 1999. A theory of justice. Cambridge, MA: Harvard University Press.
32. Sanfey, A., Rilling, J., Aronson, J., Nystrom, L., & Cohen, J. (2003) The neural basis of economic decision-making in the Ultimatum Game. Science, 300(5626), 1755-1758.
33. Searle, J. (1980). Minds, brains, and programs. Behavioral and Brain Sciences, 3(3), 417-458.
34. Simon, H. (1957). A behavioral model of rational choice, in models of man, social and rational: Mathematical essays on rational human behavior in a social setting. New York: Wiley.
35. Simon, H. (1982). Models of bounded rationality, vols. 1 and 2. Cambridge, MA: MIT Press.
36. Singer, P. (1990). Animal liberation. New York: New York Review Books.
37. Smith, A. [1759] 2004. The theory of moral sentiments. Whitefish, MT: Kessinger Publishing, LLC.
38. Torrance, S. (2008). Ethics and consciousness in artificial agents. Artificial Intelligence and Society, 22(4), 34.
39. Tversky, A., & Kahneman, D. (1974). Judgment under uncertainty: Heuristics and biases. Science, 185, 1124-1131.
40. Uleman, J., & Bargh, J. (Eds.). (1989). Unintended thought. New York: Guilford.
41. Wallach, W., & Allen, C. (2009). Moral machines: Teaching robots right from wrong. New York: Oxford University Press.
42. Wallach, W., Allen, C., & Smit, I. (2008). Machine morality: Bottom-up and top-down approaches for modelling human moral faculties. AI and Society, 22(4), 565-582.
43. Wallach, W., Franklin, S., & Allen, C. (2010). A conceptual and computational model of moral decision making in human and artificial agents. TopiCS (forthcoming).
44. Wilson, E. (1975). Sociobiology: The new synthesis. Cambridge, MA: Harvard University Press.
45. Yudkowsky, E. (2001). What is Friendly AI? Available online at http://singinst. org/ourresearch/publications/what-is-friendly-ai. html.