Moral decision making in autonomous systems: Enforcement, moral emotions, dignity, trust, and deception

Proceedings of the IEEE

Volumn 100, Issue 3, 2012, Pages 571-589

  Arkin, Ronald Craig ^a   Ulam, Patrick ^a   Wagner, Alan R ^a  

^a GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Autonomous robots; robot ethics; unmanned systems

Indexed keywords

DECISION MAKING; DECISION SUPPORT SYSTEMS; PHILOSOPHICAL ASPECTS; ROBOTICS;

AUTONOMOUS SYSTEMS; DECISION MAKING PROCESS; ENTERTAINMENT ROBOTICS; ETHICAL BEHAVIOR; PSYCHOLOGICAL MODEL; ROBOT ETHICS; ROBOTIC BEHAVIOR; UNMANNED SYSTEM;

ROBOTS;

EID: 84857370423     PISSN: 00189219     EISSN: None     Source Type: Journal    
DOI: 10.1109/JPROC.2011.2173265     Document Type: Conference Paper

References (57)

1. J. Adams, "US defends unmanned drone attacks after harsh UN Report," Christian Science Monitor, Jun. 5, 2010. [Online]. Available: http://www.csmonitor.com/World/terrorism-security/2010/0603/US-defends-unmanned- drone-attacks-after-harsh-UN-report
2. C. Allen, W. Wallach, and I. Smit, "Why machine ethics?" IEEE Intell. Syst., vol. 21, no. 4, pp. 12-17, Jul./Aug. 2006.
3. D. Amodio, P. Devine, and E. Harmon-Jones, "A dynamic model of guilt," Psychol. Sci., vol. 18, no. 6, pp. 524-530, 2007.
4. M. Anderson, S. Anderson, and C. Armen, "An approach to computing ethics," IEEE Intell. Syst., vol. 21, no. 4, pp. 56-63, Jul./Aug. 2006.
5. R. C. Arkin, "ehavior-Based Robotics. Cambridge, MA: MIT Press, 1998.
6. R. C. Arkin, "Moving up the food chain: Motivation and emotion in behavior-based robots," in Who Needs Emotions: The Brain Meets the Robot, J. Fellous and M. Arbib, Eds. Oxford, U.K.: Oxford Univ. Press, 2005.
7. R. C. Arkin, Governing Lethal Behavior in Autonomous Systems. London, U.K.: Taylor & Francis, 2009.
8. R. C. Arkin, "The case for ethical autonomy in unmanned systems," J. Military Ethics, vol. 9, no. 4, pp. 332-341, 2010.
9. R. Arkin, M. Fujita, T. Takagi, and R. Hasegawa, "An ethological and emotional basis for human-robot interaction," Robot. Autonom. Syst., vol. 42, no. 3-4, pp. 191-201, Mar. 2003.
10. R. C. Arkin and P. Ulam, "An ethical adaptor: Behavioral modification derived from moral emotions," in Proc. IEEE Int. Symp. Comput. Intell. Robot. Autom., Daejeon, Korea, Dec. 2009, pp. 381-387.
11. R. C. Arkin, A. Wagner, and B. Duncan, "Responsibility and lethality for unmanned systems: Ethical pre-mission responsibility advisement," in Proc. IEEE Workshop Roboethics, Kobe, Japan, pp. 1-8, May 2009.
12. K. Arkoudas, S. Bringsjord, and P. Bello, "Toward ethical robots via mechanized deontic logic," AAAI Tech. Rep. FS-05-06, 2005, AAAI Fall Symposium on Machine Ethics.
13. L. Baldor, Military Declined to Bomb Group of Taliban at Funeral. Washington, DC: Associated Press, Sep. 14, 2006.
14. C. F. Bond and M. Robinson, "The evolution of deception," J. Nonverbal Behav., vol. 12, no. 4, pp. 295-307, 1988.
15. S. Bringsjord, K. Arkoudas, and P. Bello, "Toward a general logicist methodology for engineering ethically correct robots," IEEE Intell. Syst., vol. 21, no. 4, pp. 38-44, Jul./Aug. 2006.
16. S. Brosnan, "Nonhuman species' reactions to inequity and their implications for fairness," Social Justice Res., vol. 19, no. 2, pp. 153-185, Jun. 2006. (Pubitemid 44290907)
17. M. Cervellati, J. Esteban, and L. Kranich, "Moral values, self-regulatory emotions, and redistribution," Inst. Econ. Anal., "arcelona, Spain, working paper, May 2007.
18. D. Cheney and R. Seyfarth, "aboon Metaphysics. Chicago, IL: Univ. Chicago Press, 2007.
19. F. Conway and T. Siegelman, Dark Hero of the Information Age: In Search of Norbert Wiener the Father of Cybernetics. New York: Basic Books, 2006.
20. C. De Melo, L. Zheng, and J. Gratch, "Expression of moral emotions in cooperating agents," in Proc. Int. Conf. Intell. Virtual Agents, Amsterdam, The Netherlands, 2009, DOI: 10.1007/978-3-642-04380-2-32.
21. D. Ettinger and P. Jehiel, "Towards a theory of deception," ESRC Centre for Economic Learning and Social Evolution," London, U.K., ELSE Working Papers (181), 2009.
22. EURON Roboethics Roadmap, Version 2.0, 2007.
23. J. Fellous and M. Arbib, Eds., Who Needs Emotions: The Brain Meets the Robot. Oxford, U.K.: Oxford Univ. Press, 2005, pp. 245-270.
24. D. Filkins, "Operators of drones are faulted in Afghan deaths," New York Times, May 29, 2010. [Online]. Available: http://www.nytimes.com/2010/ 05/30/world/asia/30drone.html.
25. M. S. Gazzaniga, The Ethical Brain. New York: Dana Press, 2005.
26. S. Gerwehr and R. W. Glenn, "The art of darkness: Deception and urban operations," Rand Corporation, Santa Monica, CA, 2000.
27. J. Haidt, "The moral emotions," in Handbook of Affective Sciences, R. J. Davidson, K. R. Scherer, and H. Hill Goldsmith, Eds. Oxford, U.K.: Oxford Univ. Press, 2003.
28. J. Horty, Agency and Deontic Logic. Oxford, U.K.: Oxford Univ. Press, 2001.
29. K. Ikuta, M. Nokata, and H. Ishii, "Safety evaluation method of human-care robot control," in Proc. Int. Symp. Micromechatron. Human Sci., 2000, pp. 119-127.
30. W. Joy, "Why the future doesn't need us," Wired, no. 8.04, Apr. 2000. [Online]. Available: http://www.wired.com/wired/archive/8.04/joy.html.
31. H. H. Kelley, J. G. Holmes, N. L. Kerr, H. T. Reis, C. E. Rusbult, and P. A. M. V. Lange, An Atlas of Interpersonal Situations. New York: Cambridge Univ. Press, 2003.
32. H. H. Kelley and J. W. Thibaut, Interpersonal Relations: A Theory of Interdependence. New York: Wiley, 1978.
33. D. MacKenzie, R. C. Arkin, and J. Cameron, "Multiagent mission specification and execution," Autonom. Robots, vol. 4, no. 1, pp. 29-57, Jan. 1997.
34. G. Marchant, B. Allenby, R. Arkin, E. Barrett, J. Borenstein, L. Gaudet, O. Kittrie, P. Lin, G. Lucas, R. O'Meara, and J. Silberman, "International governance of autonomous military robots," Columbia Sci. Technol. Law Rev., 2011. [Online]. Available: http://www.stlr.org/volumes/volume-xii-2010-2011/ marchant/.
35. J. Moor, "The nature, importance, and difficulty of machine ethics," IEEE Intell. Syst., vol. 21, no. 4, pp. 18-21, Jul./Aug. 2006.
36. H. Moravec, Mind Children: The Future of Robot and Human Intelligence. Cambridge, MA: Harvard Univ. Press, 1990.
37. L. Moshkina, R. C. Arkin, J. Lee, and H. Jung, "Time varying affective response for humanoid robots," in Proc. Int. Conf. Social Robot., Seoul, Korea, Aug. 2009. DOI: 10.1.1.149.9375.
38. L. Norderflet, "Dignity and the care of the elderly," Med. Health Care Philosophy, vol. 6, pp. 103-110, 2003.
39. R. Norman, Ethics, Killing and War. Cambridge, U.K.: Cambridge Univ. Press, 1995.
40. D. Norman, "Some observations on mental models," in Mental Models, D. Gentner and A. Stevens, Eds. Hillsdale, NJ: Lawrence Erlbaum, 1983.
41. M. J. Osborne and A. Rubinstein, A Course in Game Theory. Cambridge, MA: MIT Press, 1994.
42. D. Pfaff, The Neuroscience of Fair Play. New York: Dana Press, 2007.
43. A. Powers and S. Kiesler, "The advisor robot: Tracing people's mental model from a robot's physical attributes," in Proc. 1st ACM SIGCHI/SIGART Conf. Human-Robot Interaction, Salt Lake City, UT, pp. 218-225, 2006. (Pubitemid 44032410)
44. G. Rizzolati and C. Sinigaglia, Mirrors in the Brain: How Our Minds Share Actions and Emotions. Oxford, U.K.: Oxford Univ. Press, 2008.
45. N. Sharkey, "The ethical frontiers of robotics," Science, vol. 322, pp. 1800-1801, Dec. 12, 2008.
46. D. Smits and P. De Boeck, "A componential IRT model for guilt," Multivariate Behav. Res., vol. 38, no. 2, pp. 161-188, 2003. (Pubitemid 36964272)
47. M. Spenko, H. Yu, and S. Dubowsky, "robotic personal aids for mobility and monitoring for the elderly," IEEE Trans. Neural Syst. Rehab. Eng., vol. 14, no. 3, pp. 344-351, Sep. 2006. (Pubitemid 44543558)
48. R. Sullivan, Drone Crew Blamed in Afghan Civilian Deaths. Washington, DC: Associated Press, May 5, 2010.
49. J. Tangney, J. Stuewig, and D. Mashek, "Moral emotions and moral behavior," Annu. Rev. Psychol., vol. 58, pp. 345-372, 2007.
50. G. Veruggio, "The birth of roboethics," in Proc. IEEE Int. Conf. Robot. Autom. Workshop Robo-Ethics, "arcelona, Spain, pp. 2-4, Apr. 18, 2005.
51. A. Wagner, "The role of trust and relationships in human-robot interaction," Ph.D. dissertation, Schl. Interactive Comput., Georgia Inst. Technol., Atlanta, GA, Dec. 2009.
52. A. Wagner and R. C. Arkin, "analyzing social situations for human-robot interaction," Interaction Studies, vol. 9, no. 2, pp. 277-300, 2008.
53. A. Wagner and R. C. Arkin, "Acting deceptively: Providing robots with the capacity for deception," Int. J. Social Robot., vol. 3, no. 1, pp. 5-26, 2011.
54. M. Walzer, Just and Unjust Wars, 4th ed. New York: Basic Books, 1977.
55. D. Wells, Ed., An Encyclopedia of War and Ethics. Westport, CT: Greenwood Press, 1996.
56. V. Wiegel, M. Van den Hoven, and G. Lokhorst, "Privacy, deontic epistemic action logic and software agents," Ethics Inf. Technol., vol. 7, pp. 251-264, 2005.
57. M. Zinn, O. Khatib, B. Roth, and K. Salisbury, "Playing it safe: A new concept for human-friendly robot design," IEEE Robot. Autom. Mag., vol. 11, no. 2, pp. 13-21, Jun. 2004.