Electrophysiology and brain imaging of biological motion

Philosophical Transactions of the Royal Society B: Biological Sciences

Volumn 358, Issue 1431, 2003, Pages 435-445

  Puce, Aina ^a   Perrett, David ^b  

^a WEST VIRGINIA UNIVERSITY SCHOOL OF MEDICINE   (United States)

^b UNIVERSITY OF ST ANDREWS   (United Kingdom)

Author keywords

Animals; Biological motion; Event related potentials; Functional magnetic resonance imaging; Humans; Single unit electrophysiology

Indexed keywords

MOVEMENT; NEUROLOGY;

ANIMALIA; PRIMATES;

EID: 0037471793     PISSN: 09628436     EISSN: None     Source Type: Journal    
DOI: 10.1098/rstb.2002.1221     Document Type: Review

References (105)

1. Adolphs, R. 1999 Social cognition and the human brain. Trends Cogn. Sci. 3, 469-479.
2. Aggleton, J. P., Burton, M. J. & Passingham, R. E. 1980 Cortical and subcortical afferents to the amygdala of the rhesus monkey (Macaca mulatta). Brain Res. 190, 347-368.
3. Allison, T., Puce, A. & McCarthy, G. 2000 Social perception from visual cues: role of the STS region. Trends Cogn. Sci. 4, 267-278.
4. Baker, C. I., Keysers, C., Jellema, T., Wicker, B. & Perrett, D. I. 2001 Neuronal representation of disappearing and hidden objects in temporal cortex of the macaque. Exp. Brain Res. 140, 375-381.
5. Barbas, H. 1988 Anatomic organization of basoventral and mediodorsal visual recipient prefrontal regions in the rhesus monkey. J. Comp. Neurol. 276, 313-342.
6. Baron-Cohen, S. 1995 Mindblindness: an essay on autism and theory of mind. Cambridge, MA: MIT Press.
7. Baron-Cohen, S., Wheelwright, S. & Joliffe, T. 1997 Is there a 'language of the eyes'? Evidence from normal adults, and adults with autism or Asperger syndrome Vis. Cogn 4, 311-331.
8. Bassili, J. N. 1978 Facial motion in the perception of faces and of emotional expression. J. Exp. Psychol. Hum. Percept. Perf. 4, 373-379.
9. Beauchamp, M. S., Lee, K. E., Haxby, J. V. & Martin, A. 2002 Parallel visual motion processing streams for manipulable objects and human movements. Neuron 34, 149-159.
10. Bentin, S., Allison, T., Puce, A., Perez, A. & McCarthy, G. 1996 Electrophysiological studies of face perception in humans. J. Cogn. Neurosci. 8, 551-565.
11. Binkofski, F., Buccino, G., Posse, S., Seitz, R. J., Rizzolatti, G. & Freund, H. J. 1999a A fronto-parietal circuit for object manipulation in man: evidence from an fMRI study. Eur. J. Neurosci. 11, 3276-3286.
12. Binkofski, F., Buccino, G., Stephan, K. M., Rizzolatti, G., Seitz, R. J. & Freund, H. J. 1999b A parieto-premotor network for object manipulation: evidence from neuroimaging. Exp. Brain Res. 128, 210-213.
13. Blake, R. 1993 Cats perceive biological motion. Psychol. Sci. 4, 54-57.
14. Blakemore, S.-J. & Decety, J. 2001 From the perception of action to the understanding of intention. Nature Rev. Neurosci. 2, 561-567.
15. Bonda, E., Petrides, M., Ostry, D. & Evans, A. 1996 Specific involvement of human parietal systems and the amygdala in the perception of biological motion. J. Neurosci. 16, 3737-3744.
16. Boussaoud, D., Ungerleider, L. G. & Desimone, R. 1990 Pathways for motion analysis: cortical connections of the medial superior temporal and fundus of the superior temporal visual areas in the macaque. J. Comp. Neurol. 296, 462-495.
17. Brothers, L. 1997 Friday's footprint: how society shapes the human mind. New York: Oxford University Press.
18. Calvert, G. A., Bullmore, E. T., Brammer, M. J., Campbell, R., Williams, S. C., McGuire, P. K., Woodruff, P. W., Iversen, S. D. & David, A. S. 1997 Activation of auditory cortex during silent lipreading. Science 276, 593-595.
19. Calvert, G. A., Campbell, R. & Brammer, M. J. 2000 Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Curr. Biol. 10, 649-657.
20. Campbell, R. 1992 The neuropsychology of lipreading. Phil. Trans. R. Soc. Lond. B 335, 39-45.
21. Campbell, R., Landis, T. & Regard, M. 1986 Face recognition and lipreading. Brain 109, 509-521.
22. Campbell, R., MacSweeney, M., Surguladze, S., Calvert, G., McGuire, P., Suckling, J., Brammer, M. J. & David, A. S. 2001 Cortical substrates for the perception of face actions: an fMRI study of the specificity of activation for seen speech and for meaningless lower-face acts (gurning). Brain Res. Cogn. Brain Res. 12, 233-243.
23. Carey, D. P., Perrett, D. I. & Oram, M. W. 1997 Recognizing, understanding and reproducing action. In Handbook of neuropsychology, vol. 11. Action and cognition (ed. M. Jeannerod), pp. 111-129. Amsterdam: Elsevier.
24. Cutting, J. E. & Kozlowski, L. T. 1977 Recognizing friends by their walk: gait perception without familiarity cues. Bull. Psychonomic. Soc. 9, 353-356.
25. Desimone, R. 1991 Face-selective cells in the temporal cortex of monkeys. J. Cogn. Neurosci. 3, 1-8.
26. Desimone, R., Albright, T. D., Gross, C. G. & Bruce, C. 1984 Stimulus-selective properties of inferior temporal neurons in the macaque. J. Neurosci. 4, 2051-2062.
27. di Pellegrino, G., Fadiga, L., Fogassi, V., Gallese, V. & Rizzolatti, G. 1992 Understanding motor events: a neurophysiological study. Exp. Brain Res. 91, 176-180.
28. Dittrich, W. H. 1993 Action categories and the perception of biological motion. Perception 22, 15-22.
29. Downar, J., Crawley, A. P., Mikulis, D. J. & Davis, K. D. 2002 A cortical network sensitive to stimulus salience in a neutral behavioral context across multiple sensory modalities. J. Neurophysiol. 87, 615-620.
30. Downing, P. E., Jiang, Y. H., Shuman, M. & Kanwisher, N. 2001 A cortical area selective for visual processing of the human body. Science 293, 2470-2473.
31. Driver, J., Davis, G., Ricciardelli, P., Kidd, P., Maxwell, E. & Baron-Cohen, S. 1999 Gaze perception triggers reflexive visuospatial orienting. Vis. Cogn. 6, 509-540.
32. Eimer, M. 1998 Does the face-specific N170 component reflect the activity of a specialized eye processor? Neuroreport 9, 2945-2948.
33. Emery, N. J. 2000 The eyes have it: the neuroethology, function and evolution of social gaze. Neurosci. Biobehav. Rev. 24, 581-604.
34. Felleman, D. J. & Van Essen, D. C. 1991 Distributed hierarchical processing in the primate cerebral cortex. Cerebr. Cortex 1, 1-47.
35. Friesen, C. K. & Kingstone, A. 1998 The eyes have it! Reflexive orienting is triggered by nonpredictive gaze. Psychol. Bull. Rev. 5, 490-495.
36. Gallese, V., Fadiga, L., Fogassi, L. & Rizzolatti, G. 1996 Action recognition in the premotor cortex. Brain 119, 593-609.
37. Gallese, V., Fadiga, L., Fogassi, L. & Rizzolatti, G. 2002 Action representation and the inferior parietal lobule. Attention Perform. 19, 247-266.
38. Grezes, J., Fonlupt, P., Bertenthal, B., Delon-Martin, C., Segebarth, C. & Decety, J. 2001 Does perception of biological motion rely on specific brain regions? Neuroimage 13, 775-785.
39. Grossman, E., Donnelly, M., Price, R., Pickens, D., Morgan, V., Neighbor, G. & Blake, R. 2000 Brain areas involved in perception of biological motion. J. Cogn. Neurosci. 12, 711-720.
40. Halsband, U., Schmitt, J., Weyers, M., Binkofski, F., Grützner, G. & Freund, H. J. 2001 Recognition and imitation of pantomimed motor acts after unilateral parietal and premotor lesions: a perspective on apraxia. Neuropsychologia 39, 200-216.
41. Hietanen, J. K. 1999 Does your gaze direction and head orientation shift my visual attention? Neuroreport 10, 3443-3447.
42. Hietanen, J. K. 2002 Social attention orienting integrates visual information from head and body orientation. Psychol. Res. 66, 174-179.
43. Hietanen, J. K. & Perrett, D. I. 1996 Motion sensitive cells in the macaque superior temporal polysensory area: response discrimination between self- and externally generated pattern motion. Behav. Brain Res. 76, 155-167.
44. Hoffman, E. A. & Haxby, J. V. 2000 Distinct representations of eye gaze and identity in the distributed human neural system for face perception. Nature Neurosci. 3, 80-84.
45. Howard, R. J., Brammer, M., Wright, I., Woodruff, P. W., Bullmore, E. T. & Zeki, S. 1996 A direct demonstration of functional specialization within motion-related visual and auditory cortex of the human brain. Curr. Biol. 6, 1015-1019.
46. Humphreys, G. W., Donnelly, N. & Riddoch, M. J. 1993 Expression is computed separately from facial identity, and it is computed separately for moving and static faces: neuropsychological evidence. Neuropsychologia 31, 173-181.
47. Iacoboni, M., Woods, R. P., Brass, M., Bekkering, H., Mazziotta, J. C. & Rizzolatti, G. 1999 Cortical mechanisms of human imitation. Science 286, 2526-2528.
48. Iacoboni, M., Koski, L. M., Brass, M., Bekkering, H., Woods, R. P., Dubeau, M. C., Mazziotta, J. C. & Rizzolatti, G. 2001 Reafferent copies of imitated actions in the right superior temporal cortex. Proc. Natl Acad. Sci. USA 98, 13 995-13 999.
49. Jeannerod, M., Decety, J. & Michel, F. 1994 Impairment of grasping movements following a bilateral posterior parietal lesion. Neuropsychologia 32, 369-380.
50. Jeannerod, M., Arbib, M. A., Rizzolatti, G. & Sakata, H. 1995 Grasping objects: the cortical mechanisms of visuomotor transformation. Trends Neurosci. 18, 314-320.
51. Jellema, T. & Perrett, D. I. 2002 Coding of visible and hidden actions. Attention Perform. 19, 356-380.
52. Jellema, T., Baker, C. I., Wicker, B. & Perrett, D. I. 2000 Neural representation for the perception of the intentionality of hand actions. Brain Cogn. 44, 280-302.
53. Jellema, T., Oram, M. W., Baker, C. I. & Perrett, D. I. 2002 Cell populations in the banks of the superior temporal sulcus of the macaque and imitation. In The imitative mind: development, evolution, and brain bases (ed. A. Meltzoff & W. Prinz), pp. 267-290. Cambridge University Press.
54. Johansson, G. 1973 Visual perception of biological motion and a model of its analysis. Percept. Psychophys. 14, 202-211.
55. Kawashima, R., Imaizumi, S., Mori, K., Okada, K., Goto, R., Kiritani, S., Ogawa, A. & Fukuda, H. 1999 Selective visual and auditory attention toward utterances: a PET study. Neuroimage 10, 209-215.
56. Kleinke, C. L. 1986 Gaze and eye contact: a research review. Psychol. Bull. 100, 78-100.
57. Kohler, E., Keysers, C., Umilta, M. A., Fogassi, L., Gallese, V. & Rizzolatti, G. 2002 Hearing sounds, understanding actions: action representation in mirror neurons. Science 297, 846-848.
58. Kourtzi, Z. & Kanwisher, N. 2000 Activation in human MT/MST by static images with implied motion. J. Cogn. Neurosci. 12, 48-55.
59. Kozlowski, L. T. & Cutting, J. E. 1977 Recognizing the sex of a walker from a dynamic point-light display. Percept. Psychophys. 21, 575-580.
60. Langton, S. R. H. & Bruce, V. 2000 You must see the point: automatic processing of cues to the direction of social attention. J. Exp. Psychol. Hum. Percep. Perf. 26, 747-757.
61. McGurk, H. & MacDonald, J. 1976 Hearing lips and seeing voices. Nature 264, 746-748.
62. McLeod, P., Dittrich, W., Driver, J., Perrett, D. I. & Zihl, J. 1996 Preserved and impaired detection of structure from motion in a 'motion-blind' patient. Vis. Cogn. 3, 363-391.
63. Mistlin, A. J. & Perrett, D. I. 1990 Visual and somatosensory processing in the macaque temporal cortex: the role of 'expectation'. Exp. Brain Res. 82, 437-450.
64. Narumoto, J., Okada, T., Sadato, N., Fukui, K. & Yonekura, Y. 2001 Attention to emotion modulates fMRI activity in human right superior temporal sulcus. Cogn. Brain Res. 12, 225-231.
65. Nishitani, N. & Hari, R. 2000 Temporal dynamics of cortical representation for action. Proc. Natl Acad. Sci. USA 97, 913-918.
66. Nishitani, N. & Hari, R. 2001 Sign language and mirror neuron system. Neuroimage 12(6), S452.
67. Oram, M. W. & Perrett, D. I. 1994 Responses of anterior superior temporal polysensory (STPa) neurons to 'biological motion' stimuli. J. Cogn. Neurosci. 6, 99-116.
68. Oram, M. W. & Perrett, D. I. 1996 Integration of form and motion in the anterior superior temporal polysensory area (STPa) of the macaque monkey. J. Neurophysiol. 76, 109-129.
69. Pavlova, M. & Sokolov, A. 2000 Orientation specificity in biological motion perception. Percept. Psychophys. 62, 889-899.
70. Pavlova, M., Krägeloh-Mann, I., Birbaumer, N. & Sokolov, A. 2002 Biological motion shown backwards: the apparent-facing effect. Perception 31, 435-443.
71. Perrett, D. I., Rolls, E. T. & Caan, W. 1982 Visual neurons responsive to faces in the monkey temporal cortex. Exp. Brain Res. 47, 329-342.
72. Perrett, D. I., Smith, P. A. J., Potter, D. D., Mistlin, A. J., Head, A. S., Milner, A. D. & Jeeves, M. A. 1984 Neurones responsive to faces in the temporal cortex: studies of functional organization, sensitivity to identity and relation to perception. Hum. Neurobiol. 3, 197-208.
73. Perrett, D. I., Smith, P. A. J., Potter, D. D., Mistlin, A. J., Head, A. S., Milner, A. D. & Jeeves, M. A. 1985a Visual cells in the temporal cortex sensitive to face view and gaze direction. Proc. R. Soc. Lond. B 223, 293-317.
74. Perrett, D. I., Smith, P. A. J., Mistlin, A. J., Chitty, A. J., Head, A. S., Potter, D. D., Broennimann, R., Milner, A. D. & Jeeves, M. A. 1985b Visual analysis of body movements by neurones in the temporal cortex of the macaque monkey: a preliminary report. Behav. Brain Res. 16, 153-170.
75. Perrett, D. I., Harries, M. H., Bevan, R., Thomas, S., Benson, P. J., Mistlin, A. J., Chitty, A. J., Hietanen, J. K. & Ortega, J. E. 1989 Frameworks of analysis for the neural representation of animate objects and actions. J. Exp. Biol. 146, 87-113.
76. Perrett, D. I., Harries, M. H., Benson, P. J., Chitty, A. J. & Mistlin, A. J. 1990a Retrieval of structure from rigid and biological motion; an analysis of the visual response of neurons in the macaque temporal cortex. In AI and the eye (ed. T. Troscianko & A. Blake), pp. 181-201. Chichester, UK: Wiley.
77. Perrett, D. I., Harries, M., Chitty, A. J. & Mistlin, A. J. 1990b Three stages in the classification of body movements by visual neurones. In Images and understanding (ed. H. B. Barlow, C. Blakemore & M. Weston-Smith), pp. 94-108. Cambridge University Press.
78. Perrett, D. I., Mistlin, A. J., Harries, M. H. & Chitty, A. J. 1990c Understanding the visual appearance and consequence of hand actions. In Vision and action: the control of grasping (ed. M. A. Goodale), pp. 163-180. Norwood, NJ: Ablex Publishing.
79. Perrett, D. I., Hietanen, J. K., Oram, M. W. & Benson, P. J. 1992 Organization and functions of cells responsive to faces in the temporal cortex. Phil. Trans. R. Soc. Lond. B 335, 23-30.
80. Puce, A. & Allison, T. 1999 Differential processing of mobile and static faces by temporal cortex. Neuroimage 9(6), S801.
81. Puce, A., Allison, T., Bentin, S., Gore, J. C. & McCarthy, G. 1998 Temporal cortex activation in humans viewing eye and mouth movements. J. Neurosci. 18, 2188-2199.
82. Puce, A., Smith, A. & Allison, T. 2000 ERPs evoked by viewing moving eyes and mouths. Cogn. Neuropsychol. 17, 221-239.
83. Puce, A., Castiello, U., Syngeniotis, A. & Abbott, D. 2001 The human STS region integrates form and motion. Neuroimage 13(6), S931.
84. Rizzolatti, G., Camarda, R., Fogassi, L., Gentilucci, M., Luppino, G. & Matelli, M. 1988 Functional organization of inferior area 6 in the macaque monkey. II. Area F5 and the control of distal movements. Exp. Brain Res. 71, 491-507.
85. Rizzolatti, G., Fadiga, L., Gallese, V. & Fogassi, L. 1996a Pre-motor cortex and the recognition of motor actions. Brain Res. Cogn. Brain Res. 3, 131-141.
86. Rizzolatti, G., Fadiga, L., Matelli, M., Bettinardi, V., Paulesu, E., Perani, D. & Fazio, F. 1996b Localization of grasp representations in humans by PET. 1. Observation versus execution. Exp. Brain Res. 111, 246-252.
87. Rizzolatti, G., Fogassi, L. & Gallese, V. 2001 Neurophysiological mechanisms underlying the understanding and imitation of action. Nature Rev. Neurosci. 2, 661-670.
88. Sams, M., Aulanko, R., Hämäläinen, M., Hari, R., Lounasmaa, O. V., Lu, S. T. & Simola, J. 1991 Seeing speech: visual information from lip movements modifies activity in the human auditory cortex. Neurosci. Lett. 127, 141-145.
89. Schenk, T. & Zihl, J. 1997 Visual motion perception after brain damage: II. Deficits in form-from-motion perception. Neuropsychologia 35, 1299-1310.
90. Sirigu, A., Duhamel, J. R., Cohen, L., Pillon, B., Dubois, B. & Agid, Y. 1996 The mental representation of hand movements after parietal cortex damage. Science 273, 1564-1568.
91. Taylor, M. J., Edmonds, G. E., McCarthy, G. & Allison, T. 2001 Eyes first! Eye processing develops before face processing in children. Neuroreport 12, 1671-1676.
92. Thompson, J. C., Wheaton, K., Berkovic, S. F., Jackson, G. & Puce, A. 2002a Hemodynamic responses in humans to the perception of compatible and incompatible body motion. In The fMRI Experience IV Proc. NIH, Maryland, 2002, 93.
93. Thompson, J. C., Wheaton, K., Castiello, U. & Puce, A. 2002b ERPs differentiate between facial motion and motion in general. Abstract no. 14221. Academic Press OHBM Annual Scientific Meeting 2002.
94. Thornton, I. M., Pinto, J. & Shiffrar, M. 1998 The visual perception of human locomotion. Cogn. Neuropsychol. 15, 535-552.
95. Umilta, M. A., Kohler, E., Gallese, V., Fogassi, L., Fadiga, L., Keysers, C. & Rizzolatti, G. 2001 I know what you are doing: a neurophysiological study. Neuron 31, 155-165.
96. Vaina, L. M., LeMay, M., Bienfang, D. C., Choi, A. Y. & Nakayama, K. 1990 Intact 'biological motion' and 'structure from motion' perception in a patient with impaired motion mechanisms: a case study. Vis. Neurosci. 5, 353-369.
97. Vaina, L. M., Solomon, J., Chowdhury, S., Sinha, P. & Belliveau, J. W. 2001 Functional neuroanatomy of biological motion perception in humans. Proc. Natl Acad. Sci. USA 98, 11 656-11 661.
98. Vuilleumier, P. 2002 Perceived gaze direction in faces and spatial attention: a study in patients with parietal damage and unilateral neglect. Neuropsychologia 40, 1013-1026.
99. Wachsmuth, E., Oram, M. W. & Perrett, D. I. 1994 Recognition of objects and their component parts: responses of single units in the temporal cortex of the macaque. Cerebr. Cortex 4, 509-522.
100. Wheaton, K. J., Pipingas, A., Silberstein, R. & Puce, A. 2001 Neuronal responses elicited to viewing the actions of others. Vis. Neurosci. 18, 401-406.
101. Wheaton, K. J., Aranda, G. & Puce, A. 2002a ERPs elicited to combined emotional and gestural movements of the face as a function of congruency. Abstract no. 14186. Academic Press OHBM Annual Scientific Meeting 2002.
102. Wheaten K. J., Aranda, G. & Puce, A. 2002b Affective modulation of gestural and visual speech stimuli: an ERP study. Abstract no. 14215. Academic Press OHBM Annual Scientific Meeting 2002.
103. Wheaton, K. J., Thompson, J. C., Berkevic, S. F., Jackson, G. & Puce, A. 2002c Brain regions responsive to the perception of human motion. The fMRI Experience IV Proc. NIH, Maryland 2002, p. 103.
104. Wicker, B., Michel, F., Henaff, M.-A. & Decety, J. 1998 Brain regions involved in the perception of gaze: a PET study. Neuroimage 8, 221-227.
105. Williams, J. H., Whiten, A., Suddendorf, T. & Perrett, D. I. 2001 Imitation, mirror neurons and autism. Neurosci. Biobehav. Rev. 25, 287-295.