The thing that should not be: Predictive coding and the uncanny valley in perceiving human and humanoid robot actions

Social Cognitive and Affective Neuroscience

Volumn 7, Issue 4, 2012, Pages 413-422

  Saygin, Ayse Pinar ^a,b   Chaminade, Thierry ^b,c   Ishiguro, Hiroshi ^d,e   Driver, Jon ^b   Frith, Chris ^b,f  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

^c AIX MARSEILLE UNIVERSITY   (France)

^d OSAKA UNIVERSITY   (Japan)

^e ADVANCED TELECOMMUNICATIONS RESEARCH INSTITUTE INTERNATIONAL   (Japan)

^f AARHUS UNIVERSITY   (Denmark)

Author keywords

Action perception; Anterior intraparietal sulcus; Extrastriate body area; Functional magnetic resonance imaging (fMRI); Mirror neuron system; Predictive coding; Repetition suppression; Temporal cortex

Indexed keywords

OXYGEN;

ADULT; ARTICLE; BIOMECHANICS; BRAIN CORTEX; BRAIN MAPPING; EYE MOVEMENT; FEMALE; GESTURE; HUMAN; IMAGE PROCESSING; MALE; MOTION; MOVEMENT PERCEPTION; NUCLEAR MAGNETIC RESONANCE IMAGING; PHOTOSTIMULATION; PHYSIOLOGY; PREDICTIVE VALUE; RANDOMIZATION; ROBOTICS; VASCULARIZATION;

ADULT; BIOMECHANICS; BRAIN MAPPING; CEREBRAL CORTEX; EYE MOVEMENTS; FEMALE; GESTURES; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; MOTION; MOTION PERCEPTION; OXYGEN; PHOTIC STIMULATION; PREDICTIVE VALUE OF TESTS; RANDOM ALLOCATION; ROBOTICS; YOUNG ADULT;

EID: 84859839593     PISSN: 17495016     EISSN: 17495024     Source Type: Journal    
DOI: 10.1093/scan/nsr025     Document Type: Article

References (93)

1. Aitkenhead, M.J., McDonald, A.J.S. (2006). The state of play in machineenvironment interactions. Artificial Intelligence Review, 25, 247-76.
2. Bar, M. (2009). Predictions: a universal principle in the operation of the human brain. Introduction. Philosophical Transactions of the Royal Society of London B: Biological Sciences, 364, 1181-2.
3. Barlow, H. (2001). The exploitation of regularities in the environment by the brain. Behavioral and Brain Science, 24, 602-7.
4. Barsalou, L.W. (2009). Simulation, situated conceptualization, and prediction. Philosophical Transactions of the Royal Society of London B: Biological Sciences, 364, 1281-9.
5. Bartels, A., Logothetis, N.K., Moutoussis, K. (2008). fMRI and its interpretations: an illustration on directional selectivity in area V5/MT. Trends in Neurosciences, 31, 444-3.
6. Blake, R., Shiffrar, M. (2007). Perception of human motion. Annual Review of Psychology, 58, 47-73.
7. Buccino, G., Lui, F., Canessa, N., et al. (2004). Neural circuits involved in the recognition of actions performed by nonconspecifics: an FMRI study. Journal of Cognitive Neuroscience, 16, 114-26.
8. Calvo-Merino, B., Grezes, J., Glaser, D.E., Passingham, R.E., Haggard, P. (2006). Seeing or doing? Influence of visual and motor familiarity in action observation. Current Biology, 16, 1905-10.
9. Candidi, M., Urgesi, C., Ionta, S., Aglioti, S.M. (2008). Virtual lesion of ventral premotor cortex impairs visual perception of biomechanically possible but not impossible actions. Society of Neuroscience, 3, 388-400.
10. Catmur, C., Walsh, V., Heyes, C. (2007). Sensorimotor learning configures the human mirror system. Current Biology, 17, 1527-31.
11. Chaminade, T., Hodgins, J.K. (2006). Artificial agents in social cognitive sciences. Interaction Studies, 7, 347-53.
12. Chaminade, T., Hodgins, J., Kawato, M. (2007). Anthropomorphism influences perception of computer-animated characters' actions. Social Cognitive and Affective Neuroscience, 2, 206-16.
13. Chaminade, T., Zecca, M., Blakemore, S.-J., et al. (2010). Brain response to a humanoid robot in areas implicated in the perception of human emotional gestures. PLoS ONE, 5(7), e11577.
14. Chong, T.T., Cunnington, R., Williams, M.A., Kanwisher, N., Mattingley, J.B. (2008). fMRI adaptation reveals mirror neurons in human inferior parietal cortex. Current Biology, 18, 1576-80.
15. Coradeschi, S., Ishiguro, H., Asada, M., et al. (2006). Human-inspired robots. IEEE Intelligent Systems, 21, 74-85.
16. Craighero, L., Metta, G., Sandini, G., Fadiga, L. (2007). The mirror-neuron system: data and models. Progress in Brain Research, 164, 39-59.
17. Cross, E.S., Hamilton, A.F., Grafton, S.T. (2006). Building a motor simulation de novo: observation of dance by dancers. Neuroimage, 31, 1257-67.
18. Culham, J.C., Valyear, K.F. (2006). Human parietal cortex in action. Current Opinion in Neurobiology, 16, 205-12.
19. Dautenhahn, K. (2007). Socially intelligent robots: dimensions of human-robot interaction. Philosophical Transactions of the Royal Society of London B: Biological Sciences, 362, 679-704.
20. Desimone, R., Duncan, J. (1995). Neural mechanisms of selective visual attention. Annual Review of Neuroscience, 18, 193-222.
21. Dinstein, I., Hasson, U., Rubin, N., Heeger, D.J. (2007). Brain areas selective for both observed and executed movements. Journal of Neurophysiology, 98, 1415-27.
22. Freud, S. (1919). Das Unheimliche. SE, 17, 217-256. Translated at http://www-rohan.sdsu.edu/~amtower/uncanny.html (January 2011, date last accessed).
23. Friston, K. (2005). A theory of cortical responses. Philosophical Transactions of the Royal Society of London B: Biological Sciences, 360, 815-836.
24. Friston, K. (2010). The free-energy principle: a unified brain theory? Nature Reviews Neuroscience, 11, 127-38.
25. Fujii, N., Hihara, S., Iriki, A. (2008). Social cognition in premotor and parietal cortex. Social Neuroscience, 3, 250-60.
26. Gazzola, V., Rizzolatti, G., Wicker, B., Keysers, C. (2007). The anthropomorphic brain: the mirror neuron system responds to human and robotic actions. Neuroimage, 35, 1674-84.
27. Gibson, J.J. (1979). The ecological approach to visual perception. Boston: Houghton- Mifflin.
28. Grafton, S.T., Hamilton, A.F. (2007). Evidence for a distributed hierarchy of action representation in the brain. Human Movement Science, 26, 590-616.
29. Grefkes, C., Fink, G.R. (2005). The functional organization of the intraparietal sulcus in humans and monkeys. Journal of Anatomy, 207, 3-17.
30. Gregory, R.L. (1980). Perceptions as hypotheses. Philosophical Transactions of the Royal Society of London B: Biological Sciences, 290, 181-97.
31. Grill-Spector, K., Henson, R., Martin, A. (2006). Repetition and the brain: neural models of stimulus-specific effects. Trends in Cognitive Sciences, 10, 14-23.
32. Grossman, E.D., Jardine, N.A., Pyles, J.A. (2010). fMRI-adaptation reveals invariant coding for biological motion on the human STS. Frontiers in Human Neuroscience, 4(15), 1-18.
33. Hamilton, A.F., Grafton, S.T. (2006). Goal representation in human anterior intraparietal sulcus. Journal of Neurosciences, 26, 1133-7.
34. Hamilton, A.F., Grafton, S.T. (2008). Action outcomes are represented in human inferior frontoparietal cortex. Cerebral Cortex, 18, 1160-8.
35. Ho, C.-C., MacDorman, K.F. (2010). Revisiting the uncanny valley theory: Developing and validating an alternative to the Godspeed indices. Computers in Human Behavior, 26(6), 1508-18.
36. Henson, R.N., Rugg, M.D. (2003). Neural response suppression, haemodynamic repetition effects, and behavioural priming. Neuropsychologia, 41, 263-70.
37. Hetfield, J., Ulrich, L. Hammett, K. (1986). The Thing That Should Not Be. Master of Puppets, Electra Records. 12 inch Vinyl.
38. Ishiguro, H. (2006). Android science: conscious and subconscious recognition. Connection Science, 18, 319-32.
39. Jakobs, O., Wang, L.E., Dafotakis, M., Grefkes, C., Zilles, K., Eickhoff, S.B. (2009). Effects of timing and movement uncertainty implicate the temporo-parietal junction in the prediction of forthcoming motor actions. Neuroimage, 47, 667-77.
40. Jastorff, J., Orban, G.A. (2009). Human functional magnetic resonance imaging reveals separation and integration of shape and motion cues in biological motion processing. Journal of Neuroscience, 29, 7315-29.
41. Jentsch, E. (1995 (1906)). On the psychology of the uncanny. Angelaki, 2, 7-16.
42. Kahn, P.H., Ishiguro, H., Friedman, B., et al. (2007). What is a human? Toward psychological benchmarks in the field of human-robot interaction. Interaction Studies, 8, 363-90.
43. Kanda, T., Ishiguro, H., Imai, M., Ono, T. (2004). Development and evaluation of interactive humanoid robots. Proceedings of the IEEE, 92, 1839-50.
44. Kanda, T., Miyashita, T., Osada, T., Haikawa, Y., Ishiguro, H. (2008). Analysis of humanoid appearances in human-robot interaction. IEEE Transactions on Robotics, 24, 725-35.
45. Kawato, M. (1999). Internal models for motor control and trajectory planning. Current Opinion in Neurobiology, 9, 718-27.
46. Kiebel, S.J., Daunizeau, J., Friston, K.J. (2009). Perception and hierarchical dynamics. Frontiers in Neuroinformatics, 3, 20.
47. Kilner, J.M., Friston, K.J., Frith, C.D. (2007). The mirror-neuron system: a Bayesian perspective. Neuroreport, 18, 619-23.
48. Kilner, J.M., Neal, A., Weiskopf, N., Friston, K.J., Frith, C.D. (2009). Evidence of mirror neurons in human inferior frontal gyrus. Journal of Neuroscience, 29, 10153-9.
49. Kilner, J.M., Paulignan, Y., Blakemore, S.J. (2003). An interference effect of observed biological movement on action. Current Biology, 13, 522-5.
50. Krekelberg, B., Boynton, G.M., van Wezel, R.J. (2006). Adaptation: from single cells to BOLD signals. Trends in Neurosciences, 29, 250-6.
51. Kriegeskorte, N., Simmons, W.K., Bellgowan, P.S., Baker, C.I. (2009). Circular analysis in systems neuroscience: the dangers of double dipping. Nature Neuroscience, 12, 535-40.
52. Lange, J., Lappe, M. (2006). A model of biological motion perception from configural form cues. Journal of Neuroscience, 26(11), 2894-2906.
53. Lestou, V., Pollick, F.E., Kourtzi, Z. (2008). Neural substrates for action understanding at different description levels in the human brain. Journal of Cognitive Neuroscience, 20, 324-41.
54. Levi, S. (2004). Why Tom Hanks is less than human: While sensors cannot capture how humans act, humans can give life to digital characters. Newsweek, 650, 305-6.
55. Lovecraft, H.P. (1984 (1936)). The Shadow Over Innsmouth. In: Joshi, S.T., editor. The Dunwich Horror and Others. Sauk City, WI: Arkham House.
56. MacDorman, K.F., Ishiguro, H. (2006). The uncanny advantage of using androids in cognitive and social science research. Interaction Studies, 7, 297-337.
57. MacDorman, K.F., Green, R.D., Ho, C.C., Koch, C.T. (2009a). Too real for comfort? Uncanny responses to computer generated faces. Computers in Human Behavior, 25, 695-710.
58. MacDorman, K.F., Vasudevan, S.K., Ho, C.-C. (2009b). Does Japan really have robot mania? Comparing attitudes by implicit and explicit measures. AI & Society, 23, 485-510.
59. Matelli, M., Luppino, G. (2001). Parietofrontal circuits for action and space perception in the macaque monkey. Neuroimage, 14, S27-32.
60. Mori, M. (1970). The uncanny valley. Energy, 7, 33-5.
61. Mukamel, R., Ekstrom, A., Kaplan, J., Iacoboni, M., Fried, I. (2010). Single neuron responses in humans during execution and observation of actions. Current Biology, 20, 750-6.
62. Oberman, L.M., McCleery, J.P., Ramachandran, V.S., Pineda, J.A. (2007). EEG evidence for mirror neuron activity during the observation of human and robot actions: Toward an analysis of the human qualities of interactive robots. Neurocomputing, 70, 2194-203.
63. Peelen, M.V., Downing, P.E. (2007). The neural basis of visual body perception. Nature Reviews Neuroscience, 8, 636-48.
64. Pelphrey, K.A., Mitchell, T.V., McKeown, M.J., Goldstein, J., Allison, T., McCarthy, G. (2003). Brain activity evoked by the perception of human walking: controlling for meaningful coherent motion. Journal of Neurosciences, 23, 6819-25.
65. Perani, D., Fazio, F., Borghese, N.A., et al. (2001). Different brain correlates for watching real and virtual hand actions. Neuroimage, 14, 749-58.
66. Petrides, M., Pandya, D.N. (1988). Association fiber pathways to the frontal cortex from the superior temporal region in the rhesus monkey. The Journal of Comparative Neurology, 273, 52-66.
67. Pobric, G., Hamilton, A.F. (2006). Action understanding requires the left inferior frontal cortex. Current Biology, 16, 524-9.
68. Pollick, F.E. (2009). In search of the Uncanny Valley. In: Daras, P., Ibarra, O.M., editors. UC Media 2009. Venice, Italy: Springer, pp. 69-78.
69. Pollick, F.E., Hale, J.G., Tzoneva-Hadjigeorgieva, M. (2005). Perception of humanoid movement. International Journal of Humanoid Robotics, 3, 277-300.
70. Press, C., Gillmeister, H., Heyes, C. (2007). Sensorimotor experience enhances automatic imitation of robotic action. Proceedings: Biological Sciences/The Royal Society, 274, 2509-14.
71. Rao, R.P., Ballard, D.H. (1999). Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. Nature Neuroscience, 2, 79-87.
72. Rizzolatti, G., Craighero, L. (2004). The mirror-neuron system. Annual Review of Neuroscience, 27, 169-92.
73. Rizzolatti, G., Fogassi, L., Gallese, V. (2001). Neurophysiological mechanisms underlying the understanding and imitation of action. Nature Review Neuroscience, 2, 661-70.
74. Rozzi, S., Calzavara, R., Belmalih, A., et al. (2006). Cortical connections of the inferior parietal cortical convexity of the macaque monkey. Cerebral Cortex, 16, 1389-417.
75. Sanchez-Vives, M.V., Slater, M. (2005). From presence to consciousness through virtual reality. Nature Reviews Neuroscience, 6, 332-9.
76. Saygin, A.P. (2007). Superior temporal and premotor brain areas necessary for biological motion perception. Brain, 130, 2452-61.
77. Saygin, A.P., Cicekli, I. (2002). Pragmatics in human-computer conversations. Journal of Pragmatics, 34, 227-58.
78. Saygin, A.P., Chaminade, T., Ishiguro, H. (2010). The perception of humans and robots: Uncanny hills in parietal cortex. Annual Meeting of the Cognitive Science Society, August 2010, Portland, Oregon.
79. Saygin, A.P., Wilson, S.M., Dronkers, N., Bates, E. (2004a). Action comprehension in aphasia: Linguistic and non-linguistic deficits and their lesion correlates. Neuropsychologia 42, 1788-1804.
80. Saygin, A.P., Wilson, S.M., Hagler, D.J. Jr, Bates, E., Sereno, M.I. (2004b). Point-light biological motion perception activates human premotor cortex. Journal of Neuroscience, 24, 6181-8.
81. Seltzer, B., Pandya, D.N. (1994). Parietal, temporal, and occipital projections to cortex of the superior temporal sulcus in the rhesus monkey: A retrograde tracer study. Journal of Comparative Neurology, 343, 445-63.
82. Seyama, J., Nagayama, R. (2007). The uncanny valley: Effect of realism on the impression of artificial human faces. Presence: Teleoperators and Virtual Environments, 16, 337-51.
83. Shepard, R.N. (2001). Perceptual-cognitive universals as reflections of the world. Behavior and Brain Science, 24, 581-601.
84. Shimada, S. (2010). Deactivation in the sensorimotor area during observation of a human agent performing robotic actions. Brain and Cognition, 72, 394-9.
85. Steckenfinger, S.A., Ghazanfar, A.A. (2009). Monkey visual behavior falls into the uncanny valley. Proceedings of the National Academy of Science USA, 106, 18362-6.
86. Tai, Y.F., Scherfler, C., Brooks, D.J., Sawamoto, N., Castiello, U. (2004). The human premotor cortex is 'mirror' only for biological actions. Current Biology, 14, 117-20.
87. Tapus, A., Matarić, M.J., Scassellati, B. (2007). The grand challenges in socially assistive robotics. IEEE Robotics and Automation Magazine, 14, 35-42.
88. Thompson, R., Duncan, J. (2009). Attentional modulation of stimulus representation in human fronto-parietal cortex. Neuroimage, 48, 436-48.
89. Wolpert, D.M., Doya, K., Kawato, M. (2003). A unifying computational framework for motor control and social interaction. Philosophical Transactions of the Royal Society of London B: Biological Sciences, 29, 358:593-602.
90. Wolpert, D.M., Ghahramani, Z., Jordan, M.I. (1995). An internal model for sensorimotor integration. Science, 269, 1880-2.
91. Wolpert, D.M., Miall, R.C. (1996). Forward models for physiological motor control. Neural Networks, 9, 1265-79.
92. Xu, Y., Turk-Browne, N.B., Chun, M.M. (2007). Dissociating task performance from fMRI repetition attenuation in ventral visual cortex. Journal of Neuroscience, 27, 5981-85.
93. Yuille, A., Kersten, D. (2006). Vision as Bayesian inference: analysis by synthesis? Trends in Cognitive Sciences, 10, 301-8.