Integration of faces and vocalizations in ventral prefrontal cortex: Implications for the evolution of audiovisual speech

Proceedings of the National Academy of Sciences of the United States of America

Volumn 109, Issue SUPPL.1, 2012, Pages 10717-10724

  Romanski, Lizabeth M ^a  

^a UNIVERSITY OF ROCHESTER SCHOOL OF MEDICINE AND DENTISTRY   (United States)

Author keywords

Frontal lobe; Neurophysiology; Primate; Sensory integration

Indexed keywords

COMMUNICATION SKILL; EVOLUTION; FACIAL EXPRESSION; GESTURE; INFERIOR FRONTAL GYRUS; LANGUAGE ABILITY; MACACA; NERVE CELL NETWORK; PREFRONTAL CORTEX; PRIORITY JOURNAL; REVIEW; SPEECH; VISION; VISUAL INFORMATION; VOCALIZATION; ANIMAL; HEARING; HISTOLOGY; HUMAN; PHYSIOLOGY;

MACACA; PRIMATES;

ANIMALS; AUDITORY PERCEPTION; BIOLOGICAL EVOLUTION; FACIAL EXPRESSION; HUMANS; PREFRONTAL CORTEX; SPEECH; VISUAL PERCEPTION;

EID: 84866156143     PISSN: 00278424     EISSN: 10916490     Source Type: Journal    
DOI: 10.1073/pnas.1204335109     Document Type: Review

References (97)

1. Petrides M, Pandya DN (2002) Comparative cytoarchitectonic analysis of the human and the macaque ventrolateral prefrontal cortex and corticocortical connection patterns in the monkey. Eur J Neurosci 16:291-310. (Pubitemid 36160249)
2. Preuss T (2007) Primate Origins: Adaptations and Evolution, eds Ravosa M, Dagosto M (Springer, New York).
3. Preuss TM, Goldman-Rakic PS (1991) Myelo- and cytoarchitecture of the granular frontal cortex and surrounding regions in the strepsirhine primate Galago and the anthropoid primate Macaca. J Comp Neurol 310:429-474.
4. Carmichael ST, Price JL (1995) Sensory and premotor connections of the orbital and medial prefrontal cortex of macaque monkeys. J Comp Neurol 363:642-664. (Pubitemid 26028726)
5. Gerbella M, Belmalih A, Borra E, Rozzi S, Luppino G (2010) Cortical connections of the macaque caudal ventrolateral prefrontal areas 45A and 45B. Cereb Cortex 20:141-168.
6. Saleem KS, Kondo H, Price JL (2008) Complementary circuits connecting the orbital and medial prefrontal networks with the temporal, insular, and opercular cortex in the macaque monkey. J Comp Neurol 506:659-693.
7. Winters W, Kado R, Adey W (1969) A Stereotaxic Brain Atlas for Macaca nemestrina (Univ California Press, Los Angeles).
8. Petrides M, Cadoret G, Mackey S (2005) Orofacial somatomotor responses in the macaque monkey homologue of Broca's area. Nature 435:1235-1238. (Pubitemid 40943088)
9. Paxinos G, Huang X, Toga AW (2000) The Rhesus Monkey Brain (Academic, San Diego).
10. Romanski LM, Goldman-Rakic PS (2002) An auditory domain in primate prefrontal cortex. Nat Neurosci 5:15-16. (Pubitemid 34038776)
11. Romanski LM, Averbeck BB, Diltz M (2005) Neural representation of vocalizations in the primate ventrolateral prefrontal cortex. J Neurophysiol 93:734-747.
12. Jürgens U (2009) The neural control of vocalization in mammals: A review. J Voice 23:1-10.
13. Coudé G, et al. (2011) Neurons controlling voluntary vocalization in the macaque ventral premotor cortex. PLoS ONE 6:e26822.
14. Barbas H (1988) Anatomic organization of basoventral and mediodorsal visual recipient prefrontal regions in the rhesus monkey. J Comp Neurol 276:313-342.
15. Barbas H, Pandya DN (1989) Architecture and intrinsic connections of the prefrontal cortex in the rhesus monkey. J Comp Neurol 286:353-375. (Pubitemid 19215075)
16. Chavis DA, Pandya DN (1976) Further observations on corticofrontal connections in the rhesus monkey. Brain Res 117:369-386.
17. Bullier J, Schall JD, Morel A (1996) Functional streams in occipito-frontal connections in the monkey. Behav Brain Res 76:89-97. (Pubitemid 26135402)
18. Ungerleider LG, Gaffan D, Pelak VS (1989) Projections from inferior temporal cortex to prefrontal cortex via the uncinate fascicle in rhesus monkeys. Exp Brain Res 76:473-484. (Pubitemid 19203599)
19. O Scalaidhe SP, Wilson FA, Goldman-Rakic PS (1997) Areal segregation of face-processing neurons in prefrontal cortex. Science 278:1135-1138.
20. Scalaidhe SP, Wilson FAW, Goldman-Rakic PS (1999) Face-selective neurons during passive viewing and working memory performance of rhesus monkeys: Evidence for intrinsic specialization of neuronal coding. Cereb Cortex 9:459-475. (Pubitemid 29367766)
21. Wilson FA, Scalaidhe SP, Goldman-Rakic PS (1993) Dissociation of object and spatial processing domains in primate prefrontal cortex. Science 260:1955-1958. (Pubitemid 23258279)
22. Webster MJ, Bachevalier J, Ungerleider LG (1994) Connections of inferior temporal areas TEO and TE with parietal and frontal cortex in macaque monkeys. Cereb Cortex 4:470-483. (Pubitemid 24297011)
23. Pandya DN, Hallett M, Kmukherjee SK (1969) Intra- and interhemispheric connections of the neocortical auditory system in the rhesus monkey. Brain Res 14:49-65.
24. Jones EG, Powell TP (1970) An anatomical study of converging sensory pathways within the cerebral cortex of the monkey. Brain 93:793-820.
25. Galaburda AM, Pandya DN (1983) The intrinsic architectonic and connectional organization of the superior temporal region of the rhesus monkey. J Comp Neurol 221:169-184. (Pubitemid 14227337)
26. Barbas H, Mesulam MM (1985) Cortical afferent input to the principalis region of the rhesus monkey. Neuroscience 15:619-637. (Pubitemid 15236336)
27. Petrides M, Pandya DN (1988) Association fiber pathways to the frontal cortex from the superior temporal region in the rhesus monkey. J Comp Neurol 273:52-66.
28. Morel A, Garraghty PE, Kaas JH (1993) Tonotopic organization, architectonic fields, and connections of auditory cortex in macaque monkeys. J Comp Neurol 335:437-459. (Pubitemid 23260381)
29. Jones EG, Dell'Anna ME, Molinari M, Rausell E, Hashikawa T (1995) Subdivisions of macaque monkey auditory cortex revealed by calcium-binding protein immunoreactivity. J Comp Neurol 362:153-170.
30. Hackett TA, Stepniewska I, Kaas JH (1998) Thalamocortical connections of the parabelt auditory cortex in macaque monkeys. J Comp Neurol 400:271-286. (Pubitemid 28440748)
31. Rauschecker JP, Tian B, Hauser M(1995) Processing of complex sounds in the macaque nonprimary auditory cortex. Science 268:111-114.
32. Tian B, Reser D, Durham A, Kustov A, Rauschecker JP (2001) Functional specialization in rhesus monkey auditory cortex. Science 292:290-293. (Pubitemid 32295388)
33. Romanski LM, et al. (1999) Dual streams of auditory afferents target multiple domains in the primate prefrontal cortex. Nat Neurosci 2:1131-1136. (Pubitemid 30126373)
34. Romanski LM (2007) Representation and integration of auditory and visual stimuli in the primate ventral lateral prefrontal cortex. Cereb Cortex 17(suppl 1):i61-i69.
35. Ungerleider LG, Mishkin M (1982) Two cortical visual systems. In Analysis of Visual Behavior, eds Ingle DJ, Goodale MA, Mansfield RJW (MIT Press, Cambridge, MA), pp 549-586.
36. Bruce CJ, Goldberg ME (1985) Primate frontal eye fields. I. Single neurons discharging before saccades. J Neurophysiol 53:603-635. (Pubitemid 15144063)
37. Funahashi S, Bruce CJ, Goldman-Rakic PS (1989) Mnemonic coding of visual space in the monkey's dorsolateral prefrontal cortex. J Neurophysiol 61:1-19.
38. Funahashi S, Chafee MV, Goldman-Rakic PS (1993) Prefrontal neuronal activity in rhesus monkeys performing a delayed anti-saccade task. Nature 365:753-756. (Pubitemid 23339881)
39. Quintana J, Fuster JM (1992) Mnemonic and predictive functions of cortical neurons in a memory task. Neuroreport 3:721-724.
40. Chafee MV, Goldman-Rakic PS (1998) Matching patterns of activity in primate prefrontal area 8a and parietal area 7ip neurons during a spatial working memory task. J Neurophysiol 79:2919-2940. (Pubitemid 28317024)
41. Kim JN, Shadlen MN (1999) Neural correlates of a decision in the dorsolateral prefrontal cortex of the macaque. Nat Neurosci 2:176-185.
42. Freedman DJ, Miller EK (2008) Neural mechanisms of visual categorization: Insights from neurophysiology. Neurosci Biobehav Rev 32:311-329.
43. Nieder A, Freedman DJ, Miller EK (2002) Representation of the quantity of visual items in the primate prefrontal cortex. Science 297:1708-1711. (Pubitemid 35000787)
44. Miller EK, Cohen JD (2001) An integrative theory of prefrontal cortex function. Annu Rev Neurosci 24:167-202. (Pubitemid 32695227)
45. Rosenkilde CE, Bauer RH, Fuster JM (1981) Single cell activity in ventral prefrontal cortex of behaving monkeys. Brain Res 209:375-394. (Pubitemid 11137025)
46. Suzuki H, Azuma M (1983) Topographic studies on visual neurons in the dorsolateral prefrontal cortex of the monkey. Exp Brain Res 53:47-58. (Pubitemid 14216242)
47. Thorpe SJ, Rolls ET, Maddison S (1983) The orbitofrontal cortex: Neuronal activity in the behaving monkey. Exp Brain Res 49:93-115. (Pubitemid 13180756)
48. Rolls ET, Critchley HD, Browning AS, Inoue K (2006) Face-selective and auditory neurons in the primate orbitofrontal cortex. Exp Brain Res 170:74-87. (Pubitemid 43363601)
49. Mishkin M, Manning FJ (1978) Non-spatial memory after selective prefrontal lesions in monkeys. Brain Res 143:313-323. (Pubitemid 8277912)
50. Romanski LM, Diehl MM (2011) Neurons responsive to face-view in the primate ventrolateral prefrontal cortex. Neuroscience 189:223-235.
51. Tsao DY, Schweers N, Moeller S, Freiwald WA (2008) Patches of face-selective cortex in the macaque frontal lobe. Nat Neurosci 11:877-879.
52. Démonet JF, et al. (1992) The anatomy of phonological and semantic processing in normal subjects. Brain 115:1753-1768.
53. Paulesu E, Frith CD, Frackowiak RSJ (1993) The neural correlates of the verbal component of working memory. Nature 362:342-345. (Pubitemid 23101305)
54. Buckner RL, Raichle ME, Petersen SE (1995) Dissociation of human prefrontal cortical areas across different speech production tasks and gender groups. J Neurophysiol 74:2163-2173.
55. Demb JB, et al. (1995) Semantic encoding and retrieval in the left inferior prefrontal cortex: A functional MRI study of task difficulty and process specificity. J Neurosci 15:5870-5878.
56. Stromswold K, Caplan D, Alpert N, Rauch S (1996) Localization of syntactic comprehension by positron emission tomography. Brain Lang 52:452-473. (Pubitemid 26097791)
57. Price CJ (1998) The functional anatomy of word comprehension and production. Trends Cogn Sci 2:281-288.
58. Gelfand JR, Bookheimer SY (2003) Dissociating neural mechanisms of temporal sequencing and processing phonemes. Neuron 38:831-842. (Pubitemid 36694788)
59. Poldrack RA, et al. (1999) Functional specialization for semantic and phonological processing in the left inferior prefrontal cortex. Neuroimage 10:15-35. (Pubitemid 29369890)
60. Newman JD, Lindsley DF (1976) Single unit analysis of auditory processing in squirrel monkey frontal cortex. Exp Brain Res 25:169-181.
61. Tanila H, Carlson S, Linnankoski I, Kahila H (1993) Regional distribution of functions in dorsolateral prefrontal cortex of the monkey. Behav Brain Res 53:63-71. (Pubitemid 23074030)
62. Wollberg Z, Sela J (1980) Frontal cortex of the awake squirrel monkey: responses of single cells to visual and auditory stimuli. Brain Res 198:216-220. (Pubitemid 10002688)
63. Romanski LM, Averbeck BB (2009) The primate cortical auditory system and neural representation of conspecific vocalizations. Annu Rev Neurosci 32:315-346.
64. Cohen YE, et al. (2009) A functional role for the ventrolateral prefrontal cortex in non-spatial auditory cognition. Proc Natl Acad Sci USA 106:20045-20050.
65. Romanski LM, Bates JF, Goldman-Rakic PS (1999) Auditory belt and parabelt projections to the prefrontal cortex in the rhesus monkey. J Comp Neurol 403:141-157. (Pubitemid 28566827)
66. Hackett TA, Stepniewska I, Kaas JH (1999) Prefrontal connections of the parabelt auditory cortex in macaque monkeys. Brain Res 817:45-58. (Pubitemid 29225344)
67. Poremba A, Mishkin M (2007) Exploring the extent and function of higher-order auditory cortex in rhesus monkeys. Hear Res 229:14-23. (Pubitemid 46920886)
68. Gifford GW, 3rd, MacLean KA, Hauser MD, Cohen YE (2005) The neurophysiology of functionally meaningful categories: Macaque ventrolateral prefrontal cortex plays a critical role in spontaneous categorization of species-specific vocalizations. J Cogn Neurosci 17:1471-1482. (Pubitemid 41291970)
69. Russ BE, Lee YS, Cohen YE (2007) Neural and behavioral correlates of auditory categorization. Hear Res 229:204-212. (Pubitemid 46920877)
70. Lee JH, Russ BE, Orr LE, Cohen YE (2009) Prefrontal activity predicts monkeys' decisions during an auditory category task. Front Integr Neurosci 3:16.
71. Deacon TW (1992) Cortical connections of the inferior arcuate sulcus cortex in the macaque brain. Brain Res 573:8-26.
72. Aboitiz F (2012) Gestures, vocalizations, and memory in language origins. Front Evol Neurosci 4:2.
73. Sugihara T, Diltz MD, Averbeck BB, Romanski LM (2006) Integration of auditory and visual communication information in the primate ventrolateral prefrontal cortex. J Neurosci 26:11138-11147. (Pubitemid 44772202)
74. Stein BE, Meredith MA (1993) The Merging of the Senses (MIT Press, Cambridge, MA).
75. Barraclough NE, Xiao D, Baker CI, Oram MW, Perrett DI (2005) Integration of visual and auditory information by superior temporal sulcus neurons responsive to the sight of actions. J Cogn Neurosci 17:377-391. (Pubitemid 40364527)
76. Ghazanfar AA, Maier JX, Hoffman KL, Logothetis NK (2005) Multisensory integration of dynamic faces and voices in rhesus monkey auditory cortex. J Neurosci 25:5004-5012. (Pubitemid 40712843)
77. Lakatos P, et al. (2009) The leading sense: Supramodal control of neurophysiological context by attention. Neuron 64:419-430.
78. Kayser C, Logothetis NK, Panzeri S (2010) Visual enhancement of the information representation in auditory cortex. Curr Biol 20:19-24.
79. McGurk H, MacDonald J (1976) Hearing lips and seeing voices. Nature 264:746-748.
80. Bertelson P, Aschersleben G (2003) Temporal ventriloquism: Crossmodal interaction on the time dimension. 1. Evidence from auditory-visual temporal order judgment. Int J Psychophysiol 50:147-155. (Pubitemid 37162877)
81. Driver J, Noesselt T (2008) Multisensory interplay reveals crossmodal influences on 'sensory-specific' brain regions, neural responses, and judgments. Neuron 57:11-23.
82. Stein BE, Stanford TR (2008) Multisensory integration: Current issues from the perspective of the single neuron. Nat Rev Neurosci 9:255-266. (Pubitemid 351430829)
83. Noppeney U, Ostwald D, Werner S (2010) Perceptual decisions formed by accumulation of audiovisual evidence in prefrontal cortex. J Neurosci 30:7434-7446.
84. Beauchamp MS, Nath AR, Pasalar S (2010) fMRI-guided transcranial magnetic stimulation reveals that the superior temporal sulcus is a cortical locus of the McGurk effect. J Neurosci 30:2414-2417.
85. Jones JA, Callan DE (2003) Brain activity during audiovisual speech perception: An fMRI study of the McGurk effect. Neuroreport 14:1129-1133. (Pubitemid 36930260)
86. Homae F, Hashimoto R, Nakajima K, Miyashita Y, Sakai KL (2002) From perception to sentence comprehension: The convergence of auditory and visual information of language in the left inferior frontal cortex. Neuroimage 16:883-900.
87. Xu J, Gannon PJ, Emmorey K, Smith JF, Braun AR (2009) Symbolic gestures and spoken language are processed by a common neural system. Proc Natl Acad Sci USA 106:20664-20669.
88. Passingham RE, Toni I, Rushworth MF (2000) Specialisation within the prefrontal cortex: The ventral prefrontal cortex and associative learning. Exp Brain Res 133:103-113. (Pubitemid 30411662)
89. Calvert GA, Hansen PC, Iversen SD, Brammer MJ (2001) Detection of audio-visual integration sites in humans by application of electrophysiological criteria to the BOLD effect. Neuroimage 14:427-438. (Pubitemid 32709557)
90. Miller LM, D'Esposito M (2005) Perceptual fusion and stimulus coincidence in the cross-modal integration of speech. J Neurosci 25:5884-5893. (Pubitemid 40911419)
91. Ojanen V, et al. (2005) Processing of audiovisual speech in Broca's area. Neuroimage 25:333-338. (Pubitemid 40387315)
92. Hein G, et al. (2007) Object familiarity and semantic congruency modulate responses in cortical audiovisual integration areas. J Neurosci 27:7881-7887. (Pubitemid 47173312)
93. Campanella S, Belin P (2007) Integrating face and voice in person perception. Trends Cogn Sci 11:535-543. (Pubitemid 350181565)
94. Jordan KE, Brannon EM, Logothetis NK, Ghazanfar AA (2005) Monkeys match the number of voices they hear to the number of faces they see. Curr Biol 15:1034-1038. (Pubitemid 40772151)
95. Sliwa J, Duhamel JR, Pascalis O, Wirth S (2011) Spontaneous voice-face identity matching by rhesus monkeys for familiar conspecifics and humans. Proc Natl Acad Sci USA 108:1735-1740.
96. Eifuku S, De Souza WC, Tamura R, Nishijo H, Ono T (2004) Neuronal correlates of face identification in the monkey anterior temporal cortical areas. J Neurophysiol 91:358-371. (Pubitemid 38084380)
97. Sugase Y, Yamane S, Ueno S, Kawano K (1999) Global and fine information coded by single neurons in the temporal visual cortex. Nature 400:869-873. (Pubitemid 29406722)