Perceiving biological motion: Dissociating visible speech from walking

Journal of Cognitive Neuroscience

Volumn 15, Issue 6, 2003, Pages 800-809

  Santi, Andrea ^a   Servos, Philip ^a,b   Vatikiotis Bateson, Eric ^c   Kuratate, Takaaki ^c   Munhall, Kevin ^c,d  

^a WILFRID LAURIER UNIVERSITY   (Canada)

^b CIHR Group on Action and Perception   (Japan)

^c ADVANCED TELECOMMUNICATIONS RESEARCH INSTITUTE INTERNATIONAL   (Japan)

^d QUEEN S UNIVERSITY   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; BRAIN FUNCTION; BRAIN REGION; CENTRAL NERVOUS SYSTEM; FEMALE; FRONTAL CORTEX; HUMAN; KINEMATICS; MALE; MOTOR ACTIVITY; NEUROPSYCHOLOGY; NORMAL HUMAN; NUCLEAR MAGNETIC RESONANCE IMAGING; OCCIPITAL CORTEX; PERCEPTION; PRIORITY JOURNAL; SPEECH; WALKING;

ADULT; BIOMECHANICS; BRAIN MAPPING; FEMALE; HUMANS; LIGHT; MAGNETIC RESONANCE IMAGING; MALE; MOTION; MOTION PERCEPTION; MOTOR CORTEX; PATTERN RECOGNITION, VISUAL; PHOTIC STIMULATION; SPEECH; SPEECH PERCEPTION; WALKING;

EID: 0041823335     PISSN: 0898929X     EISSN: None     Source Type: Journal    
DOI: 10.1162/089892903322370726     Document Type: Article

References (57)

1. Adolphs, R. (1999). Social cognition and the human brain. Trends in Cognitive Sciences, 3, 469-479.
2. Allison, T., Puce, A., & McCarthy, G. (2000). Social perception from visual cues: Role of the STS region. Trends in Cognitive Sciences, 4, 267-278.
3. Allison, T., Puce, A., Spencer, D. D., & McCarthy, G. (1999). Electrophysiological studies of human face perception: I. Potentials generated in occipitotemporal cortex by face and non-face stimuli. Cerebral Cortex, 9, 415-430.
4. Avikainen, S., Forss, N., & Hari, R. (2002). Modulated activation of the human S1 and S11 cortices during observation of hand actions. Neuroimage, 15, 640-646.
5. Barbieri, E. A., Gati, J. S., Rutt, B. K., & Menon, R. S. (2000). A transmit-only/receive-only (TORO) RF system for high-field MRI/MRS applications. Magnetic Resonance in Medicine, 43, 284-289.
6. Baynes, K., Funnell, M. G., & Fowler, C. A. (1994). Hemispheric contributions to the integration of visual and auditory information in speech perception. Perception and Psychophysics, 55, 633-641.
7. Bernstein, L. E., Auer, E. T., Moore, J. K., Ponton, C. W., Don, M., & Singh, M. (2002). Visual speech perception without primary auditory cortex activation. NeuroReport, 13, 311-315.
8. Binder, J. R., Rao, S. M., Hammeke, T. A., Yetkin, F. Z., Jesmanowicz, A., Bandettini, P. A., Wong, E. C., Estkowski, L. D., Goldstein, M. D., Haughton, V. M., & Hyde, J. S. (1994). Functional magnetic resonance imaging of human auditory cortex. Annals in Neurology, 35, 662-672.
9. Bonda, E., Petrides, M., Ostry, D., & Evans, A. (1996). Specific involvement of human parietal systems and the amygdala in the perception of biological motion. Journal of Neuroscience, 16, 3737-3744.
10. Borod, J. C., Haywood, C. S., & Koff, E. (1997). Neuropsychological aspects of facial asymmetry during emotional expression: A review of the normal adult literature. Neuropsychology Review, 7, 41-60.
11. Buccino, G., Binkofski, F., Fink, G. R., Fadiga, L., Fogassi, L., Gallese, V., Seitz, R. J., Zilles, K., Rizzolatti, G., & Freund, H.-J. (2001). Action observation activates premotor and parietal areas in a somatotopic manner: An fMRI study. European Journal of Neuroscience, 13, 400-404.
12. Burton, M. W., Noll, D. C., & Small, S. L. (2001). The anatomy of auditory word processing: Individual variability. Brain and Language, 77, 119-131.
13. Calvert, G. A., Bullmore, E. T., Brammer, M. J., Campbell, R., Williams, S. C. R., McGuire, P. K., Woodruff, P. W. R., Iversen, S. D., & David, A. S. (1997). Activation of auditory cortex during silent lipreading. Science, 276, 593-596.
14. Calvert, G. A., & Campbell, R. (2003). Reading speech from still and moving faces: The neural substrates of visible speech. Journal of Cognitive Neuroscience, 15, 57-70.
15. Campbell, R. (1986). The lateralization of lip-read sounds: A first look. Brain and Cognition, 5, 1-21.
16. Campbell, R. (1992). The neuropsychology of lipreading. Philosophical Transactions of the Royal Society of London, Series B: Biological Sciences, 335, 39-45.
17. Campbell, R., De Gelder, B., & De Haan, E. (1996). The lateralization of lip-reading: A second look. Neuropsychologia, 34, 1235-1240.
18. Campbell, R, MacSweeney, M., Surguladze, S., Calvert, G., McGuire, P., Suckling, J., Brammer, M. J., & David, A. S. (2001). Cortical substrates for the perception of face actions: An fMRI study of the specificity of activation for seen speech and for meaningless lower-face acts (gurning). Cognitive Brain Research, 12, 233-243.
19. Campbell, R., Zihl, J., Massaro, D., Munhall, K., & Cohen, M. M. (1997). Speechreading in the akinetopsic patient, L. M. Brain, 120, 1793-1803.
20. Chee, M. W. L., O'Craven, K. M., Bergida, R., Rosen, B. R., & Savoy, R. L. (1999). Auditory and visual word processing studied with fMRI. Human Brain Mapping, 7, 15-28.
21. Diesch, E. (1995). Left and right hemifield advantages of fusions and combinations in audiovisual speech perception. Quarterly Journal of Experimental Psychology: Human Experimental Psychology, 48A, 320-333.
22. di Pellegrino, G., Fadiga, L., Fogassi, L., Gallese, V., & Rizzolatti, G. (1992). Understanding motor events: A neurophysiological study. Experimental Brain Research, 91, 176-180.
23. Dupont, P., De Bruyn, B., Vandenberghe, R., Rosier, A., Michiels, J., Marchal, G., Mortelmans, L., & Orban, G. A. (1997). The kinetic occipital region in human visual cortex. Cerebral Cortex, 7, 283-292.
24. Duvernoy, H. M. (1991). The human brain, surface, three-dimensional sectional anatomy and MRI. Wien, Germany: Springer-Verlag.
25. Fiez, J. A. (1997). Phonology, semantics, and the role of the left inferior prefrontal cortex. Human Brain Mapping, 5, 79-83.
26. Fried, I., Katz, A., McCarthy, G., Sass, K. J., Williamson, P., Spencer, S. S., & Spencer, D. D. (1991). Functional organization of human supplementary motor cortex studied by electrical stimulation. Journal of Neuroscience, 11, 3656-3666.
27. Gallese, V., Fadiga, L., Fogassi, L., & Rizzolatti, G. (1996) Action recognition in the premotor cortex. Brain, 119, 593-609.
28. Gallese, V., & Goldman, A. (1998). Mirror neurons and the simulation theory of mind-reading. Trends in Cognitive Sciences, 2, 493-501.
29. Grezes, J., Fonlupt, P., Bertenthal, B., Delon-Martin, C., Segebarth, C., & Decety, J. (2001). Does perception of biological motion rely on specific brain regions? Neuroimage, 13, 775-785.
30. Grossman, E., Donnelly, M., Price, R., Pickens, D., Morgan, V., Neighbor, G., & Blake, R. (2000). Brain areas involved in perception of biological motion. Journal of Cognitive Neuroscience, 12, 711-720.
31. Hari, R., Forss, N., Avikainen, S., Kirveskari, E., Salenius, S., & Rizzolatti, G. (1998). Activation of human primary motor cortex during action observation: A neuromagnetic study. Proceedings of the National Academy of Sciences, U.S.A., 95, 15061-15065.
32. Howard, R. J., Brammer, M., Wright, I., Woodruff, P. W., Bullmore, E. T., & Zeki, S. (1996). A direct demonstration of functional specialization within motion-related visual and auditory cortex of the human brain. Current Biology, 6, 1015-1019.
33. Iacoboni, M., Woods, R. P., Brass, M., Bekkering, H., Mazziotta, J. C., & Rizzolatti, G. (1999). Cortical mechanisms of human imitation. Science, 286, 2526-2528.
34. Ishai, A., Ungerleider, L. G., Martin, A., Schouten, J. L., & Haxby, J. V. (1999). Distributed representation of objects in the human ventral visual pathway. Proceedings of the National Academy of Sciences, U.S.A., 96, 9379-9384.
35. Johansson, G. (1973). Visual perception of biological motion and a model for its analysis. Perception and Psychophysics, 14, 201-211.
36. Kanwisher, N., McDermott, J., & Chun, M M. (1997). The fusiform face area: A module in human extrastriate cortex specialized for face perception. Journal of Neuroscience, 17, 4302-4311.
37. McGurk, H., & MacDonald, J. (1976). Hearing lips and seeing voices. Nature, 264, 746-748.
38. McLeod, P., Dittrich, W., Driver, J., Perrett, D., & Zihl, J. (1996). Preserved and impaired detection of structure from motion by a 'motion-blind' patient. Visual Cognition, 3, 363-391.
39. Munhall, K. G., Servos, P., Santi, A., & Goodale, M. A. (2002). Dynamic visual speech perception in a patient with visual form agnosia. NeuroReport, 13, 1793-1796.
40. Nishitani, N., & Hari, R. (2000). Temporal dynamics of cortical representation for action. Proceedings of the National Academy of Sciences, U.S.A., 97, 913-918.
41. Passingham, R. E. (1995). The status of the premotor areas: Evidence from PET scanning. In W. R. Ferrell & U. Proske (Eds.), Neural control of movement (pp. 167-178). New York: Plenum.
42. Perry., R. J., Rosen, H. R., Kramer, J. H., Beer, J. S., Levenson, R. L., & Miller, B. L. (2001). Hemispheric dominance for emotions, empathy and social behaviour: Evidence from right and left banders with frontotemporal dementia. Neurocase, 7, 145-160.
43. Puce, A., Allison, T., Bentin, S., Gore, J. C., & McCarthy, G. (1998). Temporal cortex activation in humans viewing eye and mouth movements. Journal of Neuroscience, 18, 2188-2199.
44. Reisberg, D., McLean, J., & Goldfield, A. (1987) Easy to hear but hard to understand: A lip-reading advantage with intact auditory stimuli. In B. Dodd & R. Campbell (Eds.), Hearing by eye: The psychology of lip-reading (pp. 97-113). London: Erlbaum.
45. Rizzolatti, G., Fadiga, L., Gallese, V., & Fogassi, L. (1996). Premotor cortex and the recognition of motor actions. Cognitive Brain Research, 3, 131-141.
46. Rizzolatti, G., Fadiga, L., Matelli, M., Bettinardi, V., Paulesu, E., Perani, D., & Fazio, F. (1996). Localization of grasp representations in humans by PET: 1. Observation versus execution. Experimental Brain Research, 111, 246-252.
47. Rolls, E. T. (2000). The orbitofrontal cortex and reward. Cerebral Cortex, 10, 284-294.
48. Rosenblum, L. D., Johnson, J. A., & Saldana, H. M. (1996). Point-light facial displays enhance comprehension of speech in noise. Journal of Speech and Hearing Research, 39, 1159-1170.
49. Rosenblum, L. D., & Saldana, H. M. (1996). An audiovisual test of kinematic primitives for visual speech perception. Journal of Experimental Psychology: Human Perception and Performance, 22, 318-331.
50. Servos, P., Osu, R., Santi, A., & Kawato, M. (2002). The neural substrates of biological motion perception: An fMRI study. Cerebral Cortex, 12, 772-782.
51. Smeele, P. M., Massaro, D. W., Cohen, M. M., & Sittig, A. C. (1998). Journal of Experimental Psychology: Human Perception and Performance, 24, 1232-1242.
52. Stephan, K. M., Fink, G. R., Passingham, R. E., Silbersweig, D., Ceballos-Baumann, A. O., Frith, C. D., & Frackowiak, R. S. J. (1995). Functional anatomy of the mental representation of upper extremity movements in healthy subjects. Journal of Neurophysiology, 73, 373-386.
53. Sumby, W. H., & Pollack, I. (1954). Visual contribution to speech intelligibility in noise. Journal of the Acoustical Society of America, 26, 212-215.
54. Summerfield, Q. (1992). Lipreading and audio-visual speech perception. Philosophical Transactions of the Royal Society of London, B, 335, 71-77.
55. Talairach, J., & Tournoux, P. (1988). Co-planar stereotaxic atlas of the human brain. New York: Thieme.
56. Vaina, L. M., Solomon, J., Chowdhury, S., Sinha, P., & Belliveau, J. W. (2001). Functional neuroanatomy of biological motion perception in humans. Proceedings of the National Academy of Sciences, U.S.A., 98, 11656-11661.
57. Wicker, B., Michel, F., Henaff, M., & Decety, J. (1998). Brain regions involved in the perception of gaze: A PET study. Neuroimage, 8, 221-227.