The evolution of multisensory vocal communication in primates and the influence of developmental timing

Multisensory Development

Volumn , Issue , 2012, Pages

  Ghazanfar, Asif A ^a  

^a PRINCETON UNIVERSITY   (United States)

Author keywords

Brain maturation; Development of speech reading; Heterochrony; Multisensory development; Neural pruning; Perceptual narrowing; Precocial development

Indexed keywords

EID: 84868191767     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1093/acprof:oso/9780199586059.003.0016     Document Type: Chapter

References (89)

1. Adachi, I., Kuwahata, H., Fujita, K., Tomonaga, M., and Matsuzawa, T. (2006). Japanese macaques form a cross-modal representation of their own species in their first year of life. Primates, 47, 350-54.
2. Adachi, I., Kuwahata, H., Fujita, K., Tomonaga, M., and Matsuzawa, T. (2009). Plasticity of the ability to form cross-modal representations in infant Japanese macaques. Developmental Science, 12, 446-52.
3. Agmon, A., Yang, L.T., O'Dowd, D.K., and Jones, E.G. (1993). Organized growth of thalamocortical axons from the deep tier of terminations into layer IV of developing mouse barrel cortex. Journal of Neuroscience, 13, 5365-82.
4. Antinucci, F. (1989). Systematic comparison of early sensorimotor development. In Cognitive structure and development in nonhuman primates (ed. F. Antinucci), pp. 67-85. Lawrence Erlbaum Associates, Hillsdale, New Jersey.
5. Barnes, C.L., and Pandya, D.N. (1992). Efferent cortical connections of multimodal cortex of the superior temporal sulcus in the rhesus-monkey. Journal of Comparative Neurology, 318, 222-44.
6. Barraclough, N.E., Xiao, D., Baker, C.I., Oram, M.W., and Perrett, D.I. (2005). Integration of visual and auditory information by superior temporal sulcus neurons responsive to the sight of actions. Journal of Cognitive Neuroscience, 17, 377-91.
7. Batterson, V.G., Rose, S.A., Yonas, A., Grant, K.S., and Sackett, G.P. (2008). The effect of experience on the development of tactual-visual transfer in pigtailed macaque monkeys. Developmental Psychobiology, 50, 88-96.
8. Bauer, H.R. (1987). Frequency code: orofacial correlates of fundamental frequency. Phonetica, 44, 173-91.
9. Beauchamp, M.S., Lee, K.E., Argall, B.D., and Martin, A. (2004). Integration of auditory and visual information about objects in superior temporal sulcus. Neuron, 41, 809-23.
10. Benevento, L.A., Fallon, J., Davis, B.J., and Rezak, M. (1977). Auditory-visual interactions in single cells in the cortex of the superior temporal sulcus and the orbital frontal cortex of the macaque monkey. Experimental Neurology, 57, 849-72.
11. Besle, J., Fort, A., Delpuech, C., and Giard, M.H. (2004). Bimodal speech: early suppressive visual effects in human auditory cortex. European Journal of Neuroscience, 20, 2225-34.
12. Bizley, J.K., Nodal, F.R., Bajo, V.M., Nelken, I., and King, A.J. (2007). Physiological and anatomical evidence for multisensory interactions in auditory cortex. Cerebral Cortex, 17, 2172-89.
13. Bourgeois, J.P., and Rakic, P. (1993). Changes of synaptic density in the primary visual cortex of the macaque monkey from fetal to adult stage. Journal of Neuroscience, 13, 2801-20.
14. Bruce, C., Desimone, R., and Gross, C.G. (1981). Visual properties of neurons in a polysensory area in superior temporal sulcus of the macaque. Journal Of Neurophysiology, 46, 369-84.
15. Calvert, G.A., and Campbell, R. (2003). Reading speech from still and moving faces: the neural substrates of visible speech. Journal of Cognitive Neuroscience, 15, 57-70.
16. Calvert, G.A., Bullmore, E.T., Brammer, M.J., et al. (1997). Activation of auditory cortex during silent lipreading. Science, 276, 593-96.
17. Calvert, G.A., Campbell, R., and Brammer, M.J. (2000). Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex. Current Biology, 10, 649-57.
18. Cappe, C., and Barone, P. (2005). Heteromodal connections supporting multisensory integration at low levels of cortical processing in the monkey. European Journal of Neuroscience, 22, 2886-2902.
19. Carriere, B.N., Royal, D.W., Perrault, T.J., et al. (2007). Visual deprivation alters the development of cortical multisensory integration. Journal of Neurophysiology, 98, 2858-67.
20. Chandrasekaran, C., and Ghazanfar, A.A. (2009). Different neural frequency bands integrate faces and voices differently in the superior temporal sulcus. Journal of Neurophysiology, 101, 773-88.
21. Clancy, B., Darlington, R.B., and Finlay, B.L. (2000). The course of human events: predicting the timing of primate neural development. Developmental Science, 3, 57-66.
22. Cowan, W.M., Fawcett, J.W., O'Leary, D.D., and Stanfield, B.B. (1984). Regressive events in neurogenesis. Science, 225, 1258-65.
23. Crowley, J.C., and Katz, L.C. (1999). Development of ocular dominance columns in the absence of retinal input. Nature Neuroscience, 2, 1125-30.
24. Deacon, T.W. (1990). Rethinking mammalian brain evolution. American Zoologist, 30, 629-705.
25. Driver, J., and Noesselt, T. (2008). Multisensory interplay reveals crossmodal influences on 'sensory-specific' brain regions, neural responses, and judgments. Neuron, 57, 11-23.
26. Dufour, V., Pascalis, O., and Petit, O. (2006). Face processing limitation to own species in primates: a comparative study in brown capuchins, Tonkean macaques and humans. Behavioural Processes, 73, 107-113.
27. Ettlinger, G., and Wilson, W.A. (1990). Cross-modal performance: behavioural processes, phylogenetic considerations and neural mechanisms. Behavioural Brain Research, 40, 169-92.
28. Evans, T.A., Howell, S., and Westergaard, G.C. (2005). Auditory-visual cross-modal perception of communicative stimuli in tufted capuchin monkeys (Cebus apella). Journal of Experimental Psychology-Animal Behavior Processes, 31, 399-406.
29. Finlay, B.L., and Darlington, R.B. (1995). Linked regularities in the development and evolution of mammalian brains. Science, 268, 1578-84.
30. Finlay, B.L., Darlington, R.B., and Nicastro, N. (2001). Developmental structure of brain evolution. Behavorial and Brain Sciences, 24, 263-308.
31. Fitch, W.T. (1997). Vocal tract length and formant frequency dispersion correlate with body size in rhesus macaques. Journal of the Acoustical Society of America, 102, 1213-22.
32. Fitch, W.T., and Hauser, M.D. (1995). Vocal production in nonhuman-primates-acoustics, physiology, and functional constraints on honest advertisement. American Journal of Primatology, 37, 191-219.
33. Ghazanfar, A.A., and Logothetis, N.K. (2003). Facial expressions linked to monkey calls. Nature, 423, 937-38.
34. Ghazanfar, A.A., and Rendall, D. (2008). Evolution of human vocal production. Current Biology, 18, R457-60.
35. Ghazanfar, A.A., and Schroeder, C.E. (2006). Is neocortex essentially multisensory? Trends In Cognitive Sciences, 10, 278-85.
36. Ghazanfar, A.A., Maier, J.X., Hoffman, K.L., and Logothetis, N.K. (2005). Multisensory integration of dynamic faces and voices in rhesus monkey auditory cortex. Journal of Neuroscience, 25, 5004-5012.
37. Ghazanfar, A.A., Turesson, H.K., Maier, J.X., Van Dinther, R., Patterson, R.D., and Logothetis, N.K. (2007). Vocal tract resonances as indexical cues in rhesus monkeys. Current Biology, 17, 425-30.
38. Ghazanfar, A.A., Chandrasekaran, C., and Logothetis, N.K. (2008). Interactions between the superior temporal sulcus and auditory cortex mediate dynamic face/voice integration in rhesus monkeys. Journal Of Neuroscience, 28, 4457-69.
39. Gibson, K.R. (1991). Myelination and behavioral development: a comparative perspective on questions of neoteny, altriciality and intelligence. In Brain maturation and cognitive development: comparative and cross-cultural perspectives (eds. K.R. Gibson and A.C. Petersen), pp. 29-63. Aldine de Gruyter, New York.
40. Gottlieb, G. (1971). Ontogenesis of sensory function in birds and mammals. In The biopsychology of development (eds. E. Tobach, L.R. Aronson and E. Shaw), pp. 67-128. Academic Press, New York.
41. Gottlieb, G. (1992). Individual development and evolution: the genesis of novel behavior. Oxford University Press, New York.
42. Gunderson, V.M. (1983). Development of cross-modal recognition in infant pigtail monkeys (Macaca-Nemestrina). Developmental Psychology, 19, 398-404.
43. Gunderson, V.M., Rose, S.A., and Grantwebster, K.S. (1990). Cross-modal transfer in high-risk and low-risk infant pigtailed macaque monkeys. Developmental Psychology, 26, 576-81.
44. Hauser, M.D., Evans, C.S. and Marler, P. (1993). The role of articulation in the production of rhesus-monkey, macaca-mulatta, vocalizations. Animal Behaviour, 45, 423-33.
45. Hauser, M.D., and Ybarra, M.S. (1994). The role of lip configuration in monkey vocalizations-experiments using xylocaine as a nerve block. Brain and Language, 46, 232-44.
46. Izumi, A. and Kojima, S. (2004). Matching vocalizations to vocalizing faces in a chimpanzee (Pan troglodytes). Animal Cognition, 7, 179-84.
47. Jiang, J.T., Alwan, A., Keating, P.A., Auer, E.T., and Bernstein, L.E. (2002). On the relationship between face movements, tongue movements, and speech acoustics. Eurasip Journal on Applied Signal Processing, 2002, 1174-88.
48. Jordan, K.E. and Brannon, E.M. (2006). The multisensory representation of number in infancy. Proceedings Of The National Academy Of Sciences U.S.A., 103, 3486-89.
49. Jordan, K.E., Brannon, E.M., Logothetis, N.K., and Ghazanfar, A.A. (2005). Monkeys match the number of voices they hear with the number of faces they see. Current Biology, 15, 1034-38.
50. Kaas, J.H. (1991). Plasticity of sensory and motor maps in adult animals. Annual Review of Neuroscience, 5, 137-67.
51. Kayser, C., Petkov, C.I., Augath, M., and Logothetis, N.K. (2007). Functional imaging reveals visual modulation of specific fields in auditory cortex. Journal Of Neuroscience, 27, 1824-35.
52. Kayser, C., Petkov, C.I., and Logothetis, N.K. (2008). Visual modulation of neurons in auditory cortex. Cerebral Cortex, 18, 1560-74.
53. Kingsbury, M.A., and Finlay, B.L. (2001). The cortex in multidimensional space: where do cortical areas come from? Developmental Science, 4, 125-57.
54. Konner, M. (1991). Universals of behavioral development in relation to brain myelination. In Brain maturation and cognitive development: comparative and cross-cultural perspectives (eds. K.R. Gibson and A.C. Petersen), pp. 181-223. Aldine de Gruyter, New York.
55. Kuhl, P.K., and Meltzoff, A.N. (1982). The bimodal perception of speech in infancy. Science, 218, 1138-41.
56. Lewkowicz, D.J., and Ghazanfar, A.A. (2006). The decline of cross-species intersensory perception in human infants. Proceedings of the National Acadademy Sciences U.S.A., 103, 6771-74.
57. Lewkowicz, D.J., and Ghazanfar, A.A. (2009). The emergence of multisensory systems through perceptual narrowing. Trends in Cognitive Sciences, 13, 470-78.
58. Lewkowicz, D.J. and Lickliter, R. (1994). The development of intersensory perception: comparative perspectives. Lawrence Erlbaum Associates, Hillsdale, N.J.
59. Lickliter, R. (1990). Premature visual-stimulation accelerates intersensory functioning in bobwhite quail neonates. Developmental Psychobiology, 23, 15-27.
60. Lickliter, R., and Stoumbos, J. (1991). Enhanced prenatal auditory experience facilitates species-specific visual responsiveness in bobwhite quail chicks (Colinus virginianus). Journal of Comparative Psychology, 105, 89-94.
61. Low, L.K. and Cheng, H.J. (2006). Axon pruning: an essential step underlying the developmental plasticity of neuronal connections. Philosophical Transactioms of the Royal Society of London, B. Biological Sciences, 361, 1531-44.
62. Malkova, L., Heuer, E., and Saunders, R.C. (2006). Longitudinal magnetic resonance imaging study of rhesus monkey brain development. European Journal of Neuroscience, 24, 3204-3212.
63. Noesselt, T., Rieger, J.W., Schoenfeld, M.A. et al. (2007). Audiovisual temporal correspondence modulates human multisensory superior temporal sulcus plus primary sensory cortices. Journal Of Neuroscience, 27, 11431-41.
64. Owren, M.J., Seyfarth, R.M., and Cheney, D.L. (1997). The acoustic features of vowel-like grunt calls in chacma baboons (Papio cyncephalus ursinus): Implications for production processes and functions. Journal of the Acoustical Society of America, 101, 2951-63.
65. Parr, L.A. (2004). Perceptual biases for multimodal cues in chimpanzee (Pan troglodytes) affect recognition. Animal Cognition, 7, 171-78.
66. Partan, S.R. (2002). Single and multichannel signal composition: facial expressions and vocalizations of rhesus macaques (Macaca mulatta). Behaviour, 139, 993-1027.
67. Pascalis, O., Haan, M.D. and Nelson, C.A. (2002). Is face processing species-specific during the first year of life? Science, 296, 1321-23.
68. Patterson, M.L., and Werker, J.F. (2003). Two-month-old infants match phonetic information in lips and voice. Developmental Science, 6, 191-96.
69. Purves, D., White, L. E., and Riddle, D. R. (1996). Is neural development darwinian? Trends in Neuroscience, 19, 460-64.
70. Quartz, S.R., and Sejnowski, T.J. (1997). The neural basis of cognitive development: a constructivist manifesto. Behavioral and Brain Sciences, 20, 537-56.
71. Rendall, D., Owren, M.J., and Rodman, P.S. (1998). The role of vocal tract filtering in identity cueing in rhesus monkey (Macaca mulatta) vocalizations. Journal of the Acoustical Society of America, 103, 602-614.
72. Sacher, G.A., and Staffeldt, E.F. (1974). Relation of gestation time to brain weight for placental mammals: implications for the theory of vertebrate growth. American Naturalist, 108, 593-615.
73. Sams, M., Aulanko, R., Hamalainen, M., et al. (1991). Seeing speech: visual information from lip movements modifies activity in the human auditory cortex. Neuroscience Letters, 127, 141-45.
74. Schneirla, T.C. (1949). Levels in the psychological capacities of animals. In Philosophy for the future (eds. R.W. Sellars, V.J. Mcgill and M. Farber), pp. 243-86. Macmillan, New York.
75. Schroeder, C.E., and Foxe, J.J. (2002). The timing and laminar profile of converging inputs to multisensory areas of the macaque neocortex. Cognitive Brain Research, 14, 187-98.
76. Scott, L.S., and Monesson A. (2009). The origin of biases in face perception. Psychological Science, 20, 676-80.
77. Scott, L.S., and Monesson A. (2010). Experience-dependent neural specialization during infancy. Neuropsychologia, 48, 1857-61.
78. Scott, L.S., Pascalis, O., and Nelson, C.A. (2007). A domain general theory of the development of perceptual discrimination. Current Directions in Psychological Science, 16, 197-201.
79. Seltzer, B., and Pandya, D.N. (1994). Parietal, temporal, and occipital projections to cortex of the superior temporal sulcus in the rhesus monkey: a retrograde tracer study. Journal of Comparative Neurology, 343, 445-63.
80. Seyfarth, R.M., and Cheney, D.L. (1986). Vocal development in vervet monkeys. Animal Behaviour, 34, 1640-58.
81. Sugita, Y. (2008). Face perception in monkeys reared with no exposure to faces. Proceedings of the National Academy of Sciences U.S.A., 105, 394-98.
82. Turkewitz, G., and Kenny, P.A. (1982). Limitations on input as a basis for neural organization and perceptual development: a preliminary theoretical statement. Developmental Psychobiology, 15, 357-68.
83. van Wassenhove, V., Grant, K.W., and Poeppel, D. (2005). Visual speech speeds up the neural processing of auditory speech. Proceedings Of The National Academy Of Sciences, U.S.A., 102, 1181-1186.
84. Wallace, M.T., and Stein, B.E. (2001). Sensory and multisensory responses in the newborn monkey superior colliculus. Journal of Neuroscience, 21, 8886-94.
85. Wallace, M.T., Carriere, B.N., Perrault, T.J., Vaughan, J.W., and Stein, B.E. (2006). The development of cortical multisensory integration. Journal Of Neuroscience, 26, 11844-49.
86. Wright, T.M., Pelphrey, K.A., Allison, T., Mckeown, M.J., and McCarthy, G. (2003). Polysensory interactions along lateral temporal regions evoked by audiovisual speech. Cerebral Cortex, 13, 1034-43.
87. Yehia, H., Rubin, P., and Vatikiotis-Bateson, E. (1998). Quantitative association of vocal-tract and facial behavior. Speech Communication, 26, 23-43.
88. Yehia, H.C., Kuratate, T., and Vatikiotis-Bateson, E. (2002). Linking facial animation, head motion and speech acoustics. Journal of Phonetics, 30, 555-68.
89. Zangenehpour, S., Ghazanfar, A.A., Lewkowicz, D.J., and Zatorre, R.J. (2009). Heterochrony and cross-species intersensory matching by infant vervet monkeys. PLoS ONE, 4, e4302.