Investigations on empathy towards humans and robots using fMRI

Computers in Human Behavior

Volumn 33, Issue , 2014, Pages 201-212

  Rosenthal Von Der Pütten, Astrid M ^a   Schulte, Frank P ^a   Eimler, Sabrina C ^a   Sobieraj, Sabrina ^a   Hoffmann, Laura ^a   Maderwald, Stefan ^a   Brand, Matthias ^a   Krämer, Nicole C ^a  

^a UNIVERSITY OF DUISBURG ESSEN   (Germany)

Author keywords

Empathy; Experimental study; Functional magnetic resonance imaging; Human robot interaction; Psychophysiological measures

Indexed keywords

EID: 84893955979     PISSN: 07475632     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.chb.2014.01.004     Document Type: Article

References (92)

1. Y. Akitsuki, and J. Decety Social context and perceived agency affects empathy for pain: An event-related fMRI investigation NeuroImage 47 2 2009 722 734
2. Althaus, P.; Ishiguro, H.; Kanda, T.; Miyashita, T.; & Christensen, H. I. (2004). Navigation for human-robot interaction tasks. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA 2004) (pp. 1894-1900). doi: http://dx.doi.org/10.1109/ROBOT.2004.1308100.
3. L. Aziz-Zadeh, T. Sheng, S.-L. Liew, and H. Damasio Understanding otherness: The neural bases of action comprehension and pain empathy in a congenital amputee Cerebral Cortex 22 4 2012 811 819 10.1093/cercor/bhr139
4. S. Baron-Cohen Mindblindness: An essay on autism and theory of mind 1995 MIT Press Cambridge, MA
5. Bartneck, C. (2002). eMuu - An embodied emotional character for the ambient intelligent home. (unpublished PhD thesis). Eindhoven University of Technology, Eindhoven. < http://www.bartneck.de/publications/2002/eMuu/ bartneckPHDThesis2002.pdf >.
6. Bartneck, C.; Rosalia, C.; Menges, R.; & Deckers, I. (2006). Robot abuse - A limitation of the Media Equation. In CHI '06. Proceedings of the conference on computer-human interaction. Montréal, Québec, Canada.
7. C. Bartneck, and J. Hue Exploring the abuse of robots Interaction Studies 9 2008 415 433 10.1075/is.9.3.04bar
8. C.D. Batson These things called empathy: Eight related but distinct phenomena J. Decety, W.J. Ickes, The social neuroscience of empathy 2009 MIT Press Cambridge, Mass 3 15
9. Becker-Asano, C.; & Ishiguro, H. (2009). Laughter in social robotics - No laughing matter. In Proceedings of the International Workshop on Social Intelligence Design (SID2009) (pp. 287-300).
10. C. Becker-Asano, and I. Wachsmuth Affect simulation with primary and secondary emotions: Intelligent virtual agents H. Prendinger, J.C. Lester, M. Ishizuka, Lecture notes in computer science Vol. 5208 2008 Springer, Berlin Heidelberg Berlin, Heidelberg 15 28
11. Bethel, C. L.; & Murphy, R. R. (2006). Affective expression in appearance-constrained robots. In Proceedings of the 2nd ACM/IEE conference on human-robot interaction (pp. 327-328). (Pubitemid 44032426)
12. Blow, M. P.; Dautenhahn, K.; Appleby, A.; Nehaniv, C. L.; & Lee, D. (2006a). Perception of robot smiles and dimensions for human-robot interaction design. In Proceedings of the 15th IEEE international workshop on robot and human interactive communication (RO-MAN 2006) (pp. 469-474).
13. Blow, M. P.; Dautenhahn, K.; Appleby, A.; Nehaniv, C. L.; & Lee, D. (2006b). The art of designing robot faces - Dimensions for human-robot Interaction. In M. A. Goodrich, A. C. Schultz, & D. J. Bruemmer (Eds.), HRI'06. Proceedings of ACM SIGCHI/SIGART 2nd Conference on Human Robot Interaction (pp. 321-332). NY, USA: ACM New York.
14. Breazeal, C. L. (2002). Designing sociable robots: Issues and lessons. In K. Dautenhahn, A. H. Bond, L. Cañamero, & B. Edmonds (Eds.), Socially intelligent agents. Creating relationships with computers and robots. Creating relationships with computers and robots (pp. 149-156). Norwell, MA: Kluwer.
15. C.L. Breazeal Emotion and sociable humanoid robots: Applications of affective computing in human-computer interaction International Journal of Human-Computer Studies 59 1-2 2003 119 155 10.1016/S1071-5819(03)00018-1
16. Brett, M. (1999). The MNI brain and the Talairach atlas. < http://imaging.mrc-cbu.cam.ac.uk/imaging/MniTalairach >.
17. L. Cañamero Playing the emotion game with feelix: Socially intelligent agents K. Dautenhahn, A.H. Bond, L. Cañamero, B. Edmonds, Multiagent systems, artificial societies, and simulated organizations 2002 Springer US 69 76
18. T. Chaminade, M. Zecca, S.-J. Blakemore, A. Takanishi, C.D. Frith, and S. Micera et al. Brain response to a humanoid robot in areas implicated in the perception of human emotional gestures PLoS One 5 7 2010 e11577 EP
19. J. Cohen Statistical power analysis for the behavioral sciences 2nd ed. 1988 Lawrence Erlbaum Associates Hillsdale, New Jersey
20. C.L. Cox, L.Q. Uddin, A. Di Martino, F.X. Castellanos, M.P. Milham, and C. Kelly The balance between feeling and knowing: Affective and cognitive empathy are reflected in the brain's intrinsic functional dynamics Social Cognitive and Affective Neuroscience 7 6 2012 727 737 10.1093/scan/nsr051
21. Cramer, H.; Goddijn, J.; Wielinga, B.; & Evers, V. (2010). Effects of (in) accurate empathy and situational valence on attitudes towards robots. In P. Hinds (Ed.), Proceedings of the 5th ACM/IEEE international conference on human-robot Interaction (HRI'10) (pp. 141-142). Piscataway, NJ: IEEE Press.
22. A. D'Argembeau, P. Ruby, F. Collette, C. Degueldre, E. Balteau, and A. Luxen et al. Distinct regions of the medial prefrontal cortex are associated with self-referential processing and perspective taking Journal of Cognitive Neuroscience 19 6 2007 935 944 10.1162/jocn.2007.19.6.935 (Pubitemid 46849729)
23. M.H. Davis A multidimensional approach to individual differences in empathy JSAS Catalog of Selected Documents in Psychology 10 85 1980 1 19
24. M.H. Davis Measuring individual differences in empathy: Evidence for a multidimensional approach Journal of Personality and Social Psychology 44 1 1983 113 126 10.1037/0022-3514.44.1.113
25. F. Deutsch, and R.A. Madle Empathy: Historic and current conceptualizations, measurement, and a cognitive theoretical perspective Human Development 18 1975 267 287
26. J. Decety The functional architecture of human empathy Behavioral and Cognitive Neuroscience Reviews 3 2 2004 71 100 10.1177/1534582304267187
27. N. Eisenberg Emotion, regulation, and moral development Annual Review of Psychology 51 2000 665 697
28. Feshbach, N.D. (1976). Empathy in children: A special ingredient of social development. Los Angeles.
29. P. Fossati In search of the emotional self: An fMRI study using positive and negative emotional words American Journal of Psychiatry 160 11 2003 1938 1945 10.1176/appi.ajp.160.11.1938 (Pubitemid 39619629)
30. U. Frith, and C.D. Frith Development and neurophysiology of mentalizing Philosophical Transactions of the Royal Society B: Biological Sciences 358 1431 2003 459 473 10.1098/rstb.2002.1218 (Pubitemid 36386247)
31. S.C. Gadanho, and J. Hallam Robot learning driven by emotions Adaptive Behavior 9 1 2001 42 64 10.1177/105971230200900102 (Pubitemid 34837974)
32. V. Gazzola, G. Rizzolatti, B. Wicker, and C. Keysers The anthropomorphic brain: The mirror neuron system responds to human and robotic actions NeuroImage 35 4 2007 1674 1684 10.1016/j.neuroimage.2007.02.003 (Pubitemid 46561357)
33. Gockley, R.; Bruce, A.; Forlizzi, J.; Michalowski, M. P.; & Mundell, A. (2005). Designing robots for long-term social interaction. In Proceedings of the IEEE/RSJ international conference on intelligent robots and systems (IROS 2005) (pp. 2199-2204).
34. J. Goetz, S.B. Kiesler, and A. Powers Matching robot appearance and behavior to tasks to improve human-robot cooperation Proceedings of the 12th IEEE international workshop on robot and human interactive communication 2003 Piscataway, NJ IEEE Operations Center 55 60
35. Gratch, J.; & Marsella, S. (2001). Tears and fears: Modeling emotions and emotional behaviors in synthetic agents. In International conference on autonomous agents.
36. D.A. Gusnard, E. Akbudak, G.L. Shulman, and M.E. Raichle Medial prefrontal cortex and self-referential mental activity: Relation to a default mode of brain function Proceedings of the National Academy of Sciences 98 7 2001 4259 4264 10.1073/pnas.071043098 (Pubitemid 32249932)
37. G. Hein, and T. Singer I feel how you feel but not always: the empathic brain and its modulation: Cognitive neuroscience Current Opinion in Neurobiology 18 2 2008 153 158 10.1016/j.conb.2008.07.012
38. M.L. Hoffman Empathy, its development and prosocial implications C.B. Keasey, Nebraska Symposium on Motivation vol. 25 1977 University of Nebraska Press
39. Hoffmann, L.; Krämer, N. C.; Lam-Chi, A.; & Kopp, S. (2009). Media Equation revisited: Do users show polite reactions towards an embodied agent? In Z. Ruttkay, M. Kipp, A. Nijholt, & H. Vilhjálmsson (Eds.). Vol. 5773. Lecture notes in computer science, intelligent virtual agents 2009 (pp. 159-165). Amsterdam, The Netherlands: Springer-Verlag.
40. Hüttenrauch, H.; & Severinson-Eklundh, K. (2002). Fetch and carry with CERO: Observations from a long term user study with a service robot. In Proceedings of the 11th IEEE international workshop on robot and human interactive communication (RO-MAN 2002) (pp. 158-164).
41. W. Ickes Empathic accuracy 1997 The Guilford Press New York
42. M. Jabbi, M. Swart, and C. Keysers Empathy for positive and negative emotions in the gustatory cortex NeuroImage 34 4 2007 1744 1753 10.1016/j.neuroimage.2006.10.032 (Pubitemid 46187071)
43. Kahn P.H.; Kanda, T.; Ishiguro, H.; Gill, B. T.; Jolina H. Ruckert, Shen, S.; et al. (2012a). Do people hold a humanoid robot morally accountable for the harm it causes? In Holly A. Yanco, A. Steinfeld, V. Evers, & Odest Chadwicke Jenkins (Eds.), International conference on human-robot interaction, HRI'12, Boston, MA, USA - March 05-08, 2012 (pp. 33-40). ACM.
44. P.H. Kahn, T. Kanda, H. Ishiguro, N.G. Freier, R.L. Severson, and B.T. Gill et al. "Robovie, you'll have to go into the closet now": Children's social and moral relationships with a humanoid robot Developmental Psychology 48 2 2012 303 314 10.1037/a0027033
45. T. Kanda, T. Hirano, D. Eaton, and H. Ishiguro Interactive robots as social partners and peer tutors for children: A field trial Human-Computer Interaction 19 1 2004 61 84 10.1207/s15327051hci1901&2-4
46. T. Kanda, T. Miyashita, T. Osada, Y. Haikawa, and H. Ishiguro Analysis of humanoid appearances in human-robot interaction IEEE Transactions on Robotics 24 3 2008 725 735 10.1109/TRO.2008.921566
47. T. Klamer, and S. Ben Allouch Acceptance and use of a zoomorphic robot in a domestic setting R. Trappl, European Meetings on Cybernetics and Systems Research (EMCSR) 2010 2010 Vienna Austria 553 558
48. Koay, K. L.; & Dautenhahn, K. (2007). Living with robots: Investigating the habituation effect in participants' preferences during a longitudinal human-robot interaction study. In Proceedings of the 16th IEEE international workshop on robot and human interactive communication (RO-MAN 2007) (pp. 564-569).
49. T. Komatsu, and S. Yamada Effects of robotic agents' appearances on users' interpretations of the agents' attitudes: Towards an expansion of uncanny valley assumption Proceedings of the 16th IEEE international conference on robot and human interactive communication 2007 IEEE Press; IEEE Piscataway, NJ 380 385
50. S. Krach, F. Hegel, B. Wrede, G. Sagerer, F. Binkofski, and T. Kircher et al. Can machines think? Interaction and perspective taking with robots investigated via fMRI PLoS One 3 7 2008 e2597 10.1371/journal.pone.0002597
51. N.C. Krämer, S.C. Eimler, A.M. von der Pütten, and S. Payr Theory of companions: what can theoretical models contribute to applications and understanding of human-robot interaction? Applied Artificial Intelligence 25 6 2011 474 502 10.1080/08839514.2011.587153
52. N.C. Krämer, J. Klatt, L. Hoffmann, and A.M. Rosenthal-von der Pütten "Emotional" robots and agents - Implementation of emotions in artificial entities C. Mohiyeddini, M. Eysenck, S. Bauer, Handbook of psychology of emotions. Recent theoretical perspectives and novel empirical findings 2013 Nova Science Pub Inc 277 296
53. R.M. Krauss, and S.R. Fussell Perspective-taking in communication: Representations of others' knowledge in reference Social Cognition 9 1 1991 2 24
54. J.L. Lancaster, J.L. Summerln, L. Rainey, C.S. Freitas, and P.T. Fox The Talairach daemon, a database server for Talairach atlas labels NeuroImage 5 1997 S633
55. J.L. Lancaster, M.G. Woldorff, L.M. Parsons, M. Liotti, C.S. Freitas, and L. Rainey et al. Automated Talairach Atlas labels for functional brain mapping Human Brain Mapping 10 3 2000 120 131 10.1002/1097-0193(200007)10:3<120::AID- HBM30>3.0.CO;2-8 (Pubitemid 30456920)
56. Larsen, R. J.; & Fredrickson, B. L. (2003). Measurement issues in emotion research. In D. Kahneman, E. Diener, & N. Schwarz (Eds.). Well-being. The foundations of hedonic psychology (1st ed.; pp. 40-60). New York: Russell Sage Foundation.
57. Leite, I.; Martinho, C.; Paiva, A.; & Pereira, A. (2008). Social presence in long-term human-computer relationships. In Proceedings of the 4th international workshop on human-computer interaction.
58. Leite, I.; Martinho, C.; Pereira, A.; & Paiva, A. (2008). iCat: An affective game buddy based on anticipatory mechanisms. In L. Padgham, D. Parkes, & J. P. Müller (Eds.), AAMAS'2008. Proceedings of the 7th international conference on autonomous agents and multiagent systems (pp. 1229-1232). Estoril, Portugal.
59. M.D. Lieberman Social cognitive neuroscience: A review of core processes Annual Review of Psychology 58 1 2007 259 289 10.1146/annurev.psych.58.110405. 085654
60. T. Lipps Psychological studies 1926 Williams and Wilkens Baltimore
61. M. Lotze, U. Heymans, N. Birbaumer, R. Veit, M. Erb, and H. Flor et al. Differential cerebral activation during observation of expressive gestures and motor acts Neuropsychologia 44 10 2006 1787 1795 10.1016/j.neuropsychologia. 2006.03.016 (Pubitemid 43928006)
62. J.A. Maldjian, P.J. Laurienti, and J.H. Burdette Precentral gyrus discrepancy in electronic versions of the Talairach atlas NeuroImage 21 1 2004 450 455 10.1016/j.neuroimage.2003.09.032 (Pubitemid 38115035)
63. J.A. Maldjian, P.J. Laurienti, R.A. Kraft, and J.H. Burdette An automated method for neuroanatomic and cytoarchitectonic atlas-based interrogation of fMRI data sets NeuroImage 19 3 2003 1233 1239 10.1016/S1053-8119(03)00169-1 (Pubitemid 36918259)
64. W. McDougall Introduction to social psychology 1908 Methuen London
65. G.H. Mead Mind, self, and society 1934 University of Chicago Press Chicago
66. N. Miura, M. Sugiura, M. Takahashi, T. Moridaira, A. Miyamoto, and Y. Kuroki et al. An advantage of bipedal humanoid robot on the empathy generation: A neuroimaging study Proceedings of the IEEE/RSJ international conference on intelligent robots and systems 2008 IEEE Piscataway, NJ 2465 2470
67. C. Nass, B.J. Fogg, and Y. Moon Can computers be teammates? International Journal of Human-Computer Studies 45 1996 669 678 (Pubitemid 126374567)
68. C. Nass, and Y. Moon Machines and mindlessness: Social responses to computers Journal of Social Issues 56 1 2000 81 103 10.1111/0022-4537.00153 (Pubitemid 30442265)
69. C. Nass, Y. Moon, and P. Carney Are respondents polite to computers? Social desirability and direct responses to computers Journal of Applied Social Psychology 29 5 1999 1093 1110
70. C. Nass, J. Steuer, and E.R. Tauber Computers are social actors B. Adelson, S.T. Dumais, J.R. Olson, Proceedings of the SIGCHI conference of human factors in computing systems 1994 ACM Press New York, NY, Reading, MA 72 78
71. S. Ogawa, T.M. Lee, A.R. Kay, and D.W. Tank Brain magnetic resonance imaging with contrast dependent on blood oxygenation Proceedings of the National Academy of Sciences 87 1990 9868 9872 (Pubitemid 120016545)
72. Orzada, S.; Quick, H. H.; Ladd, M. E.; Bahr, A.; Bolz, T.; Yazdanbakhsh, P.; et al. (2009). A flexible 8-channel transmit/receive body coil for 7 T human imaging. In Proceedings of the 17th annual meeting of ISMRM (p. 2999).
73. D. Perry, T. Hendler, and S.G. Shamay-Tsoory Can we share the joy of others? Empathic neural responses to distress vs joy Social Cognitive and Affective Neuroscience 7 8 2012 909 916 10.1093/scan/nsr073
74. Piaget, J. (1932). The moral judgment of the child. (trans.). London: Kegan Paul, Trench, Trubner & Co.
75. B.A. Poser, and D.G. Norris 3D single-shot VASO using a Maxwell gradient compensated GRASE sequence Magnetic Resonance in Medicine 62 1 2009 255 262 10.1002/mrm.22000
76. B.A. Poser, and D.G. Norris Investigating the benefits of multi-echo EPI for fMRI at 7 T NeuroImage 45 4 2009 1162 1172 10.1016/j.neuroimage.2009.01.007
77. D. Premack, and G. Woodruff Does the chimpanzee have a theory of mind? Behavioral and Brain Sciences 1 4 1978 515 526 10.1017/S0140525X00076512 (Pubitemid 10077282)
78. Reeves, B.; & Nass, C. (1996). The Media Equation: How people treat computers, television, and new media like real people and places. Cambridge University Press.
79. Renteria, A.; Pastor, C.; & Gaminde, G. (2010). Intelligent homes to assist elderly people. In Proceedings of international workshop on ambient assisted living.
80. B. Robins, K. Dautenhahn, R. te Boekhorst, and A.G. Billard Robots as assistive technology - Does appearance matter? Proceedings of the 13th IEEE international workshop on robot and human interactive communication 2004 IEEE Piscataway, NJ 277 282 (Pubitemid 40822681)
81. A.M. Rosenthal-von der Pütten, N.C. Krämer, L. Hoffmann, S. Sobieraj, and S.C. Eimler An experimental study on emotional reactions towards a robot International Journal of Social Robotics 5 1 2013 17 34 10.1007/s12369-012-0173-8
82. R. Saxe Uniquely human social cognition Current Opinion in Neurobiology 16 2 2006 235 239 10.1016/j.conb.2006.03.001
83. T. Singer, B. Seymour, J. O'Doherty, H. Kaube, R.J. Dolan, and C.D. Frith Empathy for pain involves the affective but not sensory components of pain Science 303 5661 2004 1157 1162 10.1126/science.1093535 (Pubitemid 38233574)
84. T. Singer, B. Seymour, J.P. O'Doherty, K.E. Stephan, R.J. Dolan, and C.D. Frith Empathic neural responses are modulated by the perceived fairness of others Nature 439 7075 2006 466 469 10.1038/nature04271 (Pubitemid 43152836)
85. R. Sinha, C. Lacadie, P. Skudlarski, and B.E. Wexler Neural circuits underlying emotional distress in humans Annals of the New York Academy of Sciences 1032 1 2004 254 257 10.1196/annals.1314.032 (Pubitemid 40298487)
86. Y.F. Tai, C. Scherfler, D.J. Brooks, N. Sawamoto, and U. Castiello The human premotor cortex is 'mirror' only for biological actions Current Biology 14 2 2004 117 120 10.1016/j.cub.2004.01.005 (Pubitemid 38203923)
87. J. Talairach, and P. Tournoux Co-planar stereotaxic atlas of the human brain 1988 Thieme Medical Publishers Stuttgart, New York
88. von der Pütten, A. M.; & Krämer, N. C. (2012). A survey on robot appearances. In Proceedings of the 7th ACM/IEEE international conference on human-robot interaction (HRI'12) (pp. 267-268).
89. A.M. von der Pütten, S.C. Eimler, and N.C. Krämer Living with a robot companion: Empirical study on the interaction with an artificial health advisor Proceedings of the 2011 ACM international conference on multimodal interaction 2011 ACM New York 327 334
90. A.M. von der Pütten, N.C. Krämer, J. Gratch, and S.-H. Kang "It doesn't matter what you are!" Explaining social effects of agents and avatars Computers in Human Behavior 26 6 2010 1641 1650 10.1016/j.chb.2010. 06.012
91. D. Watson, A. Tellegen, and L.A. Clark Development and validation of brief measure of positive ans negative affect: The PANAS scales Journal of Personality and Social Psychology 54 6 1988 1063 1070 10.1037/0022-3514.54.6. 1063
92. A. Whiten Natural theories of mind: evolution, development and simulation of everyday mindreading 1991 Basil Blackwell Oxford