In our own image? Emotional and neural processing differences when observing human-human vs human-robot interactions

Social Cognitive and Affective Neuroscience

Volumn 10, Issue 11, 2014, Pages 1515-1524

  Wang, Yin ^a   Quadflieg, Susanne ^a  

^a NEW YORK UNIVERSITY   (United States)

Author keywords

Impression formation; Mind attributions; Person construal; Person dyads; Social robotics

Indexed keywords

ADOLESCENT; ADULT; BRAIN CORTEX; BRAIN MAPPING; EMOTION; FEMALE; HUMAN; HUMAN RELATION; MALE; NUCLEAR MAGNETIC RESONANCE IMAGING; PERCEPTION; PHYSIOLOGY; PROCEDURES; ROBOTICS; THEORY OF MIND; YOUNG ADULT;

ADOLESCENT; ADULT; BRAIN MAPPING; CEREBRAL CORTEX; EMOTIONS; FEMALE; HUMANS; INTERPERSONAL RELATIONS; MAGNETIC RESONANCE IMAGING; MALE; ROBOTICS; SOCIAL PERCEPTION; THEORY OF MIND; YOUNG ADULT;

EID: 84947716084     PISSN: 17495016     EISSN: 17495024     Source Type: Journal    
DOI: 10.1093/scan/nsv043     Document Type: Article

References (87)

1. Abraham, A., Werning, M., Rakoczy, H., von Cramon, D.Y., Schubotz, R.I. (2008). Minds, persons, and space: an fMRI investigation into the relational complexity of higher order intentionality. Consciousness and Cognition, 17, 438-50.
2. Adolphs, R. (2002). Recognizing emotion from facial expressions: psychological and neurological mechanisms. Behavioral and Cognitive Neuroscience Reviews, 1, 21-62.
3. Aichhorn, M., Perner, J., Weiss, B., Kronbichler, M., Staffen, W., Ladurner, G. (2009). Temporo-parietal junction activity in theory-of-mind tasks: falseness, beliefs, or attention. Journal of Cognitive Neuroscience, 21, 1179-92.
4. Apperly, I.A., Samson, D., Chiavarino, C., Humphreys, G.W. (2004). Frontal and temporoparietal lobes contributions to theory of mind: neuropsychological evidence from a false belief task with reduced language and executive demands. Journal of Cognitive Neuroscience, 16, 1773-84.
5. Atkinson, A.P., Adolphs, R. (2011). The neuropsychology of face perception: beyond simple dissociations and functional selectivity. Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences, 366, 1726-38.
6. Bartneck, C. (2013). Robots in the theatre and the media. In: Proceedings of the Design & Semantics of Form & Movement (DeSForM2013), Wuxi, August 2013, Philips, 64-70.
7. Beck, A., Stevens, B., Bard, K.A., Cańamero, L. (2012). Emotional body language displayed by artificial agents. ACM Transactions on Interactive Intelligent Systems, 2, 1-29.
8. Bzdok, D., Schilbach, L., Vogeley, K., et al. (2012). Parsing the neural correlates of moral cognition: ALE meta-analysis on morality, theory of mind, and empathy. Brain Structure & Function, 217, 783-96.
9. Brett, M., Anton, J.L., Valabregue, R., Poline, J.B. (2002). Region of interest analysis using an SPM toolbox [abstract]. In Presented at the 8th International Conference on Functional Mapping of the Human Brain, June 2-6, 2002, Sendai, Japan. Available on CD-ROM in NeuroImage, Vol 16, No 2, abstract 497.
10. Broadbent, E., Kumar, V., Li, X., et al. (2013). Robots with display screens: a robot with a more humanlike face display is perceived to have more mind and a better personality. PLoS One, 8, e72589.
11. Canessa, N., Alemanno, F., Riva, F., et al. (2012). The neural bases of social intention understanding: the role of interaction goals. PLoS One, 7, e42347.
12. Carter, E.J., Hodgins, J.K., Rakison, D.H. (2011). Exploring the neural correlates of goaldirected action and intention understanding. NeuroImage, 54, 1634-42.
13. Centelles, L., Assaiante, C., Nazarian, B., Anton, J.L., Schmitz, C. (2011). Recruitment of both the mirror and the mentalizing networks when observing social interactions depicted by point-lights: a neuroimaging study. PLoS One, 6, e15749.
14. Chaminade, T., Cheng, G. (2009). Social cognitive neuroscience and humanoid robots. Journal of Physiology, 103, 286-95.
15. Chaminade, T., Rosset, D., Da Fonseca, D., et al. (2012). How do we think machines think? An fMRI study of alleged competition with an artificial intelligence. Frontiers in Human Neuroscience, 6, 103.
16. Chaminade, T., Zecca, M., Blakemore, S.J., et al. (2010). Brain response to a humanoid robot in areas implicated in the perception of human emotional gestures. PLoS One, 5, e11577.
17. Cheetham, M., Suter, P., Jäncke, L. (2011). The human likeness dimension of the "uncanny valley hypothesis": behavioral and functional MRI findings. Frontiers in Human Neuroscience, 5, 126.
18. Contreras, J.M., Banaji, M.R., Mitchell, J.P. (2012). Dissociable neural correlates of stereotypes and other forms of semantic knowledge. Social Cognitive and Affective Neuroscience, 7, 764-70.
19. Costanzo, M., Archer, D. (1989). Interpreting the expressive behavior of others: the interpersonal perception task. Journal of Nonverbal Behavior, 13, 225-44.
20. Cullen, H., Kanai, R., Bahrami, B., Ress, G. (2014). Individual differences in anthropomorphic attributions and human brain structure. Social Cognitive and Affective Neuroscience, 9, 1276-80.
21. Dautenhahn, K. (2007). Socially intelligent robots: dimensions of human-robot interaction. Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences, 362, 679-704.
22. Dautenhahn, K., Woods, S., Kaouri, C., Walters, M.L., Koay, K.L., Werry, I. (2005). What is a robot companion-friend, assistant, or butler? Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, 1488-93, doi:10.1109/IROS.2005.1545189.
23. Dodell-Feder, D., Koster-Hale, J., Bedny, M., Saxe, R. (2011). fMRI item analysis in a theory of mind task. NeuroImage, 55, 705-12.
24. Dubal, S., Foucher, A., Jouvent, R., Nadel, J. (2011). Human brain spots emotion in non humanoid robots. Social Cognitive and Affective Neuroscience, 6, 90-7.
25. Fairhall, S.L., Anzellotti, S., Ubaldi, S., Caramazza, A. (2014). Person-and place-selective neural substrates for entity-specific semantic access. Cerebral Cortex, 24, 1687-1696.
26. Fiske, A.P. (1992). The four elementary forms of sociality: framework for a unified theory of social relations. Psychological Review, 99, 689-723.
27. Ghosh, V.E., Moscovitch, M., Colella, B.M., Gilboa, A. (2014). Schema representation in patients with ventromedial PFC lesions. Journal of Neuroscience, 34, 12057-70.
28. Gobbini, M.I., Gentili, C., Ricciardi, E., et al. (2011). Distinct neural systems involved in agency and animacy detection. Journal of Cognitive Neuroscience, 23, 1911-20.
29. Gobbini, M.I., Koralek, A.C., Bryan, R.E., Montgomery, K.J., Haxby, J.V. (2007). Two takes on the social brain: a comparison of theory of mind tasks. Journal of Cognitive Neuroscience, 19, 1803-14.
30. Goebel, R., Esposito, F., Formisano, E. (2006). Analysis of FIAC data with BrainVoyager QX. Human Brain Mapping, 27, 392-401.
31. Gray, H.M., Gray, K., Wegner, D.M. (2007). Dimensions of mind perception. Science, 315, 619.
32. Gray, K., Waytz, A., Young, L. (2012). The moral dyad: a fundamental template unifying moral judgment. Psychological Inquiry, 23, 206-15.
33. Gray, K., Wegner, D.M. (2009). Moral typecasting: divergent perceptions of moral agents and moral patients. Journal of Personality and Social Psychology, 96, 505-20.
34. Gray, K., Wegner, D.M. (2012). Feeling robots and human zombies: mind perception and the uncanny valley. Cognition, 125, 125-30.
35. Hall, J., Tritton, T., Rowe, A., Pipe, A., Melhuish, C., Leonards, U. (2014). Perception of own and robot engagement in human-robot interactions and their dependence on robotics knowledge. Robotics and Autonomous Systems, 62, 392-9.
36. Hartwright, C.E., Apperly, I.A., Hansen, P.C. (2014). Representation, control, or reasoning? Distinct functions for theory of mind within the medial prefrontal cortex. Journal of Cognitive Neuroscience, 26, 683-98.
37. Haxby, J.V., Gobbini, M.I. (2011). Distributed neural systems for face perception. In: Calder, A., Rhodes, G., Johnson, M., Haxby, J., editors. The Oxford Handbook of Face Perception. Oxford: Oxford University Press, pp. 93-110.
38. Hooker, C.I., Verosky, S.C., Germine, L.T., Knight, R.T., D'Esposito, M. (2010). Neural activity during social signal perception correlates with self-reported empathy. Brain Research, 1308, 100-13.
39. Iacoboni, M., Lieberman, M.D., Knowlton, B.J., et al. (2004). Watching social interactions produces dorsomedial prefrontal and medial parietal BOLD fMRI signal increases compared to a resting baseline. NeuroImage, 21, 1167-73.
40. Knobe, J., Prinz, J. (2008). Intuitions about consciousness: experimental studies. Phenomenology and the Cognitive Sciences, 7, 67-83.
41. Koster-Hale, J., Saxe, R., Dungan, J., Young, L.L. (2013). Decoding moral judgments from neural representations of intentions. Proceedings of the National Academy of Sciences of the United States of America, 110, 5648-53.
42. Krach, S., Hegel, F., Wrede, B., Sagerer, G., Binkofski, F., Kircher, T. (2008). Can machines think? Interaction and perspective taking with robots investigated via fMRI. PLoS One, 3, e2597.
43. Krämer, N.C., von der Pütten, A., Eimler, S. (2012). Human-agent and human-robot interaction theory: similarities to and differences from human-human interaction. In: Zacarias, M., de Oliveira, J., editors. Human-Computer Interaction: The Agency Perspective. Berlin: Springer, pp. 215-40.
44. Kujala, M.V., Carlson, S., Hari, R. (2012). Engagement of the amygdala in third-person view of face-to-face interaction. Human Brain Mapping, 33, 1753-62.
45. MacDorman, K.F., Ishiguro, H. (2006). The uncanny advantage of using androids in cognitive and social science research. Interaction Studies, 7, 297-337.
46. Mason, M.F., Magee, J.C., Fiske, S.T. (2014). Neural substrates of social status inferences: roles of medial prefrontal cortex and superior temporal sulcus. Journal of Cognitive Neuroscience, 26, 1131-40.
47. Minato, T., Shimada, M., Itakura, S., Lee, K., Ishiguro, H. (2006). Evaluating the human likeness of an android by comparing gaze behaviors elicited by the android and a person. Advanced Robotics: The International Journal of the Robotics Society of Japan, 20, 1147-63.
48. Misselhorn, C. (2009). Empathy with inanimate objects and the uncanny valley. Minds and Machines, 19, 345-59.
49. Mitchell, J.P., Banaji, M.R., Macrae, C.N. (2005). General and specific contributions of the medial prefrontal cortex to knowledge about mental states. NeuroImage, 28, 757-62.
50. Moril, M. (1970). Bukimi no tani [The uncanny valley]. Energy, 7, 33-5.
51. Normile, D. (2014). In our own image. Science, 346, 188-9.
52. Nourbakhsh, I.R. (2013). Robot Futures. Cambridge: MIT Press.
53. Nussbaum, M.C. (1995). Objectification. Philosophy & Public Affairs, 24, 249-91.
54. Oldfield, R.C. (1971). The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia, 9, 97-113.
55. Ollinger, J.M., Shulman, G.L., Corbetta, M. (2001). Separating processes within a trial in event-related functional MRI. NeuroImage, 13, 210-7.
56. Opfer, J.E. (2002). Identifying living and sentient kinds from dynamic information: the case of goal-directed versus aimless autonomous movement in conceptual change. Cognition, 86, 97-122.
57. Peelen, M.V., Wiggett, A., Downing, P.E. (2006). Patterns of fMRI activity dissociate overlapping functional brain areas that respond to biological motion. Neuron, 49, 815-22.
58. Pierno, A.C., Becchio, C., Turella, L., Tubaldi, F., Castiello, U. (2008). Observing social interactions: the effect of gaze. Social Neuroscience, 3, 51-9.
59. Proverbio, A.M., Riva, F., Paganelli, L., et al. (2011). Neural coding of cooperative vs. affective human interactions. PLoS One, 6, e22026.
60. Pryor, J.B., Reeder, G.D., Monroe, A.E. (2012). The infection of bad company: stigma by association. Journal of Personality and Social Psychology, 102, 224-41.
61. Quadflieg, S., Flannigan, N., Waiter, G.D., et al. (2011). Stereotype-based modulation of person perception. NeuroImage, 57, 549-57.
62. Quadflieg, S., Gentile, F., Rossion, B. (2015). The neural basis of perceiving person interactions. Cortex, doi:10.1016/j.cortex.2014.12.020.
63. Ramsey, R., Hamilton, A.F. (2010). Triangles have goals too: understanding action representation in left aIPS. Neuropsychologia, 48, 2773-6.
64. Robbins, P., Jack, A.I. (2006). The phenomenal stance. Philosophical Studies, 127, 59-85.
65. Rosenthal-von der Pütten, A.M., Schulte, F.P., Eimler, S.C., et al. (2014). Investigations on empathy towards humand and robots using fMRI. Computers in Human Behavior, 33, 201-12.
66. Saggar, M., Shelly, W.E., Lepage, J.-F., Hoeft, F., Reiss, A.L. (2014). Revealing the neural networks associated with processing of natural social interaction and the related effects of actor-orientation and face visibility. NeuroImage, 84, 648-56.
67. Samson, D., Apperly, I.A., Chiavarino, C., Humphreys, G.W. (2004). The left temporoparietal junction is necessary for representing someone else's belief. Nature Neuroscience, 7, 499-500.
68. Satpute, A.B., Badre, D., Ochsner, K.N. (2014). Distinct regions of prefrontal cortex are associated with the controlled retrieval and selection of social information. Cerebral Cortex, 24, 1269-77.
69. Saygin, A.P., Chaminade, T., Ishiguro, H., Driver, J., Frith, C. (2012). The thing that should not be: predictive coding and the uncanny valley in perceiving human and humanoid robot actions. Social Cognitive and Affective Neuroscience, 7, 413-22.
70. Schurz, M., Radua, J., Aichhorn, M., Richlan, F., Perner, J. (2014). Fractionating theory of mind: A meta-analysis of functional brain imaging studies. Neurosciences and Biobehavioral Reviews, 42, 9-34.
71. Shariff, A.F., Tracy, J.L. (2011). What are emotion expressions for? Current Directions in Psychological Science, 20, 395-9.
72. Shaw-Garlock, G. (2009). Looking forward to sociable robots. International Journal of Social Robotics, 1, 249-60.
73. Simmons, W.K., Reddish, M., Bellgowan, P.S.F., Martin, A. (2010). The selectivity and functional connectivity of the anterior temporal lobes. Cerebral Cortex, 20, 813-25.
74. Sinke, C.B.A., Sorger, B., Goebel, R., de Gelder, B. (2010). Tease or threat? Judging social interactions from bodily expressions. NeuroImage, 49, 1717-27.
75. Skudlarski, P., Constable, R.T., Gore, J.C. (1999). ROC analysis of statistical methods used in functional MRI: individual subjects. NeuroImage, 9, 311-29.
76. Spunt, R.P., Adolphs, R. (2014). Validating the why/how contrast for functional MRI studies of theory of mind. NeuroImage, 99, 301-11.
77. Spunt, R.P., Lieberman, M.D. (2012). An integrative model of the neural systems supporting the comprehension of observed emotional behavior. NeuroImage, 59, 3050-9.
78. Szczepanski, S., Knight, R.T. (2014). Insights into human behavior from lesions to the prefrontal cortex. Neuron, 83, 1002-18.
79. Takahashi, H., Terada, K., Morita, T., et al. (2014). Different impressions of other agents obtained through social interaction uniquely modulate dorsal and ventral pathway activities in the social human brain. Cortex, 58, 289-300.
80. Tinwell, A. (2014). Applying psychological plausibility to the uncanny valley phenomenon. In: Grimshaw, M., editor. Oxford Handbook of Virtuality. Oxford: University Press, pp. 173-86.
81. Tinwell, A., Grimshaw, M., Abdel Nabi, D. (2014). The uncanny valley and nonverbal communication in virtual characters. In: Tanenbaum, J., Seif El-Nasr, M., Nixon, M., editors. Nonverbal Communication in Virtual Worlds. Pittsburgh: ETC Press, pp. 325-42.
82. Turing, A.M. (1950). Computing machinery and intelligence. Mind, 59, 433-60.
83. van Kesteren, M.T.R., Ruiter, D.J., Fernández, G., Henson, R.N. (2012). How schema and novelty augment memory formation. Trends in Neurosciences, 35, 211-19.
84. Van Overwalle, F. (2009). Social cognition and the brain: a meta-analysis. Human Brain Mapping, 30, 829-58.
85. Wagner, D.D., Kelley, W.M., Heatherton, T.F. (2011). Individual differences in the spontaneous recruitment of brain regions supporting mental state understanding when viewing natural social scenes. Cerebral Cortex, 21, 2788-96.
86. Walter, H., Adenzato, M., Ciaramidaro, A., Enrici, I., Pia, L., Bara, B.G. (2004). Understanding intentions in social interaction: the role of the anterior paracingulate cortex. Journal of Cognitive Neuroscience, 16, 1854-63.
87. Weiner, K.S., Grill-Spector, K. (2010). Sparsely-distributed organization of face and limb activations in human ventral temporal cortex. NeuroImage, 52, 1559-73.