Representation and integration of auditory and visual stimuli in the primate ventral lateral prefrontal cortex

Cerebral Cortex

Volumn 17, Issue SUPPL. 1, 2007, Pages

  Romanski, Lizabeth M ^a  

^a UNIVERSITY OF ROCHESTER   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL; AUDITORY NERVOUS SYSTEM; AUDITORY STIMULATION; PHOTOSTIMULATION; PHYSIOLOGY; PREFRONTAL CORTEX; PRIMATE; REVIEW;

ACOUSTIC STIMULATION; ANIMALS; AUDITORY PATHWAYS; PHOTIC STIMULATION; PREFRONTAL CORTEX; PRIMATES;

EID: 38449096703     PISSN: 10473211     EISSN: 14602199     Source Type: Journal    
DOI: 10.1093/cercor/bhm099     Document Type: Article

References (111)

1. Averbeck BB, Romanski LM. 2004. Principal and independent components of macaque vocalizations: constructing stimuli to probe highlevel sensory processing. J Neurophysiol. 91:2897-2909. (Pubitemid 38649792)
2. Averbeck BB, Romanski LM. 2006. Probabilistic encoding of vocalizations in macaque ventral lateral prefrontal cortex. J Neurosci. 26:11023-11033. (Pubitemid 44772192)
3. Baranek GT. 1999. Autism during infancy: a retrospective video analysis of sensory-motor and social behaviors at 9-12 months of age. J Autism Dev Disord. 29:213-224. (Pubitemid 29328245)
4. Barbas H. 1988. Anatomic organization of basoventral and mediodorsal visual recipient prefrontal regions in the rhesus monkey. J. Comp. Neurol. 276:313-342. (Pubitemid 18262073)
5. Barbas H. 1992. Architecture and cortical connections of the prefrontal cortex in the rhesus monkey [review]. Adv Neurol. 57:91-115.
6. Barber MJ, Clark JW, Anderson CH. 2003. Generating neural circuits that implement probabilistic reasoning. Phys Rev E Stat Nonlin Soft Matter Phys. 68:041912.
7. Barraclough NE, Xiao D, Baker CI, Oram MW, Perrett DI. 2005. Integration of visual and auditory information by superior temporal sulcus neurons responsive to the sight of actions. J Cogn Neurosci. 17:377-391. (Pubitemid 40364527)
8. Bar-Yosef O, Rotman Y, Nelken I. 2002. Responses of neurons in cat primary auditory cortex to bird chirps: effects of temporal and spectral context. J Neurosci. 22:8619-8632. (Pubitemid 35387602)
9. Baylis GC, Rolls ET, Leonard CM. 1987. Functional subdivisions of the temporal lobe neocortex. J Neurosci. 7:330-342. (Pubitemid 17017463)
10. Beauchamp MS, Lee KE, Argall BD, Martin A. 2004. Integration of auditory and visual information about objects in superior temporal sulcus. Neuron. 41:809-823. (Pubitemid 38326842)
11. Bell AJ, Sejnowski TJ. 1996. Learning the higher-order structure of a natural sound. Network. 7:261-266.
12. Bennetto L, Pennington BF, Rogers SJ. 1996. Intact and impaired memory functions in autism. Child Dev. 67:1816-1835. (Pubitemid 126420332)
13. Benevento LA, Fallon J, Davis BJ, Rezak M. 1977. Auditory-visual interaction in single cells in the cortex of the superior temporal sulcus and the orbital frontal cortex of the macaque monkey. Exp Neurol. 57:849-872. (Pubitemid 8242630)
14. Bodner M, Kroger J, Fuster JM. 1996. Auditory memory cells in dorsolateral prefrontal cortex. Neuroreport. 7:1905-1908. (Pubitemid 26348189)
15. Bradbury JW, Vehrencamp SL. 1998. Principles of animal communication. Oxford: Blackwell.
16. Bruce C, Desimone R, Gross CG. 1981. Visual properties of neurons in a polysensory area in superior temporal sulcus of the macaque. J Neurophysiol. 46:369-384. (Pubitemid 11087648)
17. Buckner RL, Raichle ME, Petersen SE. 1995. Dissociation of human prefrontal cortical areas across different speech production tasks and gender groups. J Neurophysiol. 74:2163-2173.
18. Calvert GA. 2001. Crossmodal processing in the human brain: insights from functional neuroimaging studies. Cereb Cortex. 11:1110-1123. (Pubitemid 33108238)
19. Calvert GA, Hansen PC, Iversen SD, Brammer MJ. 2001. Detection of audio-visual integration sites in humans by application of electrophysiological criteria to the BOLD effect. Neuroimage. 14:427-438. (Pubitemid 32709557)
20. Chafee MV, Goldman-Rakic PS. 1998. Matching patterns of activity in primate prefrontal area 8a and parietal area 7ip neurons during a spatial working memory task. J Neurophysiol. 79:2919-2940. (Pubitemid 28317024)
21. Chavis DA, Pandya DN. 1976. Further observations on corticofrontal connections in the rhesus monkey. Brain Res. 117:369-386.
22. Cohen JD, Perlstein WM, Braver TS, Nystrom LE, Noll DC, Jonides J, Smith EE. 1997. Temporal dynamics of brain activation during a working memory task. Nature. 386:604-608.
23. Courtney SM, Ungerleider LG, Keil K, Haxby JV. 1996. Object and spatial visual working memory activate separate neural systems in human cortex. Cereb Cortex. 6:39-49.
24. de Gelder B, Vroomen J, Annen L, Masthof E, Hodiamont P. 2003. Audiovisual integration in schizophrenia. Schizophr Res. 59:211-218.
25. Demb JB, Desmond JE, Wagner AD, Vaidya CJ, Glover GH, Gabrieli JD. 1995. Semantic encoding and retrieval in the left inferior prefrontal cortex: a functional MRI study of task difficulty and process specificity. J Neurosci. 15:5870-5878.
26. Evans TA, Howell S, Westergaard GC. 2005. Auditory-visual crossmodal perception of communicative stimuli in tufted capuchin monkeys (Cebus apella). J Exp Psychol Anim Behav Process. 31:399-406. (Pubitemid 41650691)
27. Fecteau S, Armony JL, Joanette Y, Belin P. 2005. Sensitivity to voice in human prefrontal cortex. J Neurophysiol. 94:2251-2254. (Pubitemid 41192894)
28. Ferrari M. 1982. Childhood autism: deficits of communication and symbolic development. I. Distinctions from language disorders. J Commun Disord. 15:191-208.
29. Fiez JA, Raife EA, Balota DA, Schwarz JP, Raichle ME, Petersen SE. 1996. A positron emission tomography study of the short-term maintenance of verbal information. J Neurosci. 16:808-822. (Pubitemid 26028837)
30. Fulton JF. 1950. Functional lobotomy and affective behavior. New York: Norton.
31. Funahashi S, Bruce CJ, Goldman-Rakic PS. 1990. Visuospatial coding in primate prefrontal neurons revealed by oculomotor paradigms. J Neurophysiol. 63:814-831. (Pubitemid 20138753)
32. Fuster JM. 1989. The prefrontal cortex: anatomy, physiology, and neuropsychology of the frontal lobe. New York: Raven Press.
33. Fuster JM, Bodner M, Kroger JK. 2000. Cross-modal and cross-temporal association in neurons of frontal cortex. Nature. 405:347-351. (Pubitemid 30337067)
34. Gabrieli J D E, Poldrack RA, Desmond JE. 1998. The role of left prefrontal cortex in language and memory. Proc Natl Acad Sci USA. 95:906-913. (Pubitemid 28124885)
35. Ghazanfar AA, Hauser MD. 1999. The neuroethology of primate vocal communication: substrates for the evolution of speech. Trends Cogn Sci. 3:377-384. (Pubitemid 29476109)
36. Ghazanfar AA, Logothetis NK. 2003. Neuroperception: facial expressions linked to monkey calls. Nature. 423:937-938. (Pubitemid 36806899)
37. Ghazanfar AA, Maier JX, Hoffman KL, Logothetis NK. 2005. Multisensory integration of dynamic faces and voices in rhesus monkey auditory cortex. J Neurosci. 25:5004-5012. (Pubitemid 40712843)
38. Gifford GW 3rd, Hauser MD, Cohen YE. 2003. Discrimination of functionally referential calls by laboratory-housed rhesus macaques: implications for neuroethological studies. Brain Behav Evol. 61:213-224. (Pubitemid 36717133)
39. Gifford GW 3rd, Maclean KA, Hauser MD, Cohen YE. 2005. The neurophysiology of functionally meaningful categories: macaque ventrolateral prefrontal cortex plays a critical role in spontaneous categorization of species-specific vocalizations. J Cogn Neurosci. 17:1471-1482. (Pubitemid 41291970)
40. Goldman-Rakic P. 1987. Circuitry of primate prefrontal cortex and regulation of behavior by representational memory. In: Plum F, editor. Handbook of physiology. Section 1: The nervous system. Vol. V. Higher functions of the brain. Bethesda (MD): American Physiological Society. p. 373-418.
41. Goldman-Rakic PS. 1996a. Regional and cellular fractionation of working memory. Proc Natl Acad Sci USA. 93:13473-13480. (Pubitemid 26424144)
42. Goldman-Rakic PS. 1996b. The prefrontal landscape: implications of functional architecture for understanding human mentation and the central executive. Phil Trans R Soc Lond B Biol Sci. 351:1445-1453. (Pubitemid 27005371)
43. Gouzoules H, Gouzoules S, Tomaszycki M. 1998. Agnostic screams and the classification of dominance relationships: are monkeys fuzzy logicians? Anim Behav. 55:51-60. (Pubitemid 28165192)
44. Hackett TA, Stepniewska I, Kaas JH. 1998. Subdivisions of auditory cortex and ipsilateral cortical connections of the parabelt auditory cortex in macaque monkeys. J Comp Neurol. 394:475-495. (Pubitemid 28183571)
45. Hackett TA, Stepniewska I, Kaas JH. 1999. Prefrontal connections of the parabelt auditory cortex in macaque monkeys. Brain Res. 817:45-58. (Pubitemid 29225344)
46. Hauser MD. 1996. The Evolution of communication. Cambridge (MA): MIT Press. p. 92-101.
47. Hauser MD. 1998. Functional referents and acoustic similarity: field playback experiments with rhesus monkeys. Anim Behav. 55:1647-1658. (Pubitemid 28329765)
48. Hauser MD, Marler P. 1993. Food associated calls in rhesus macaques. Macaca mulatta. I. Socioecological factors. Behav Ecol. 4:194-205. (Pubitemid 24409949)
49. Homae F, Hashimoto R, Nakajima K, Miyashita Y, Sakai KL. 2002. From perception to sentence comprehension: the convergence of auditory and visual information of language in the left inferior frontal cortex. Neuroimage. 16:883-900.
50. Hoshi E, Shima K, Tanji J. 2000. Neuronal activity in the primate prefrontal cortex in the process of motor selection based on two behavioral rules. J Neurophysiol. 83:2355-2373. (Pubitemid 30198684)
51. Hughes C, Russell J, Robbins, TW. 1994. Evidence for executive dysfunction in autism. Neuropsychologia. 32:477-492. (Pubitemid 24154254)
52. Izumi A, Kojima S. 2004. Matching vocalizations to vocalizing faces in a chimpanzee (Pan troglodytes). Anim Cogn. 7:179-184.
53. Jacobs RA. 2002. What determines visual cue reliability? Trends Cogn Sci. 6:345-350. (Pubitemid 34828313)
54. Jones JA, Callan DE. 2003. Brain activity during audiovisual speech perception: an fMRI study of the McGurk effect. Neuroreport. 14:1129-1133. (Pubitemid 36930260)
55. Kaas JH, Hackett TA. 2000. Subdivisions of auditory cortex and processing streams in primates. Proc Natl Acad Sci USA 97:11793-11799.
56. Knill DC, Pouget A. 2004. The Bayesian brain: the role of uncertainty in neural coding and computation. Trends Neurosci. 27:712-719. (Pubitemid 39488074)
57. Lau B, Stanley GB, Dan Y. 2002. Computational subunits of visual cortical neurons revealed by artificial neural networks. Proc Natl Acad Sci USA 99:8974-8979. (Pubitemid 34693668)
58. Lewicki MS. 2002. Efficient coding of natural sounds. Nat Neurosci. 5:356-363. (Pubitemid 34279816)
59. Linsker R. 1988. Self-organization in a perceptual network. IEEE Computer. 21:117.
60. Luppino G, Calzavara R, Rozzi S, Matelli M. 2001. Projections from the superior temporal sulcus to the agranular frontal cortex in the macaque. Eur J Neurosci. 14:1035-40. (Pubitemid 35463777)
61. Marmarmelis P, Marmarmelis V. 1978. Analysis of physiological systems: the white-noise approach. New York: Plenum Press.
62. McGurk H, MacDonald J. 1976. Hearing lips and seeing voices. Nature. 264:746-748.
63. Mechler F, Reich DS, Victor JD. 2002. Detection and discrimination of relative spatial phase by V1 neurons. J Neurosci. 22:6129-6157. (Pubitemid 35387656)
64. Miller LM, D'Esposito M. 2005. Perceptual fusion and stimulus coincidence in the cross-modal integration of speech. J Neurosci. 25:5884-5893. (Pubitemid 40911419)
65. Mishkin M, Manning FJ. 1978. Non-spatial memory after selective prefrontal lesions in monkeys. Brain Research. 143:313-323. (Pubitemid 8277912)
66. Mishkin M. 1964. Preservation of central sets after frontal lesions in monkeys. In: Warren JK, editor. The frontal granular cortex and behavior. New York: McGraw-Hill. p. 219-241.
67. Morel A, Garraghty PE, Kaas JH. 1993. Tonotopic organization, architectonic fields, and connections of auditory cortex in macaque monkeys. J Comp Neurol. 335:437-459. (Pubitemid 23260381)
68. Muller RA, Behen ME, Rothermel RD, Chugani DC, Muzik O, Mangner TJ, Chugani HT. 1999. Brain mapping of language and auditory perception in high-functioning autistic adults: a PET study. J Autism Dev Disord. 29:19-31. (Pubitemid 29118069)
69. Nakamura K, Sakai K, Hikosaka O. 1998. Neuronal activity in medial frontal cortex during learning of sequential procedures. J Neurophysiol. 80:2671-2687. (Pubitemid 28546194)
70. Nearey TM. 1989. Static, dynamic, and relational properties in vowel perception. J Acoust Soc Am. 85:2088-2113. (Pubitemid 19131587)
71. Oram MW, Perrett D. 1994. Responses of anterior superior temporal polysensory (STPa) neurons to "biological motion" stimuli. J Cogn Neurosci. 6:99-116.
72. O'Scalaidhe SP, Wilson F A W, Goldman-Rakic PS. 1997. Areal segregation of face-processing neurons in prefrontal cortex. Science. 278:1135-1138. (Pubitemid 27517897)
73. O'Scalaidhe SP, Wilson F A W, Goldman-Rakic PS. 1999. Face-selective neurons during passive viewing and working memory performance of rhesus monkeys: evidence for intrinsic specialization of neuronal coding. Cereb Cortex. 9:459-475. (Pubitemid 29367766)
74. Owings DH, Morton ES. 1998. Animal vocal communication: a new approach. Cambridge (MA): Cambridge University Press.
75. Owren MJ, Rendall D. 2001. Sound on the rebound: bringing form and function back to the forefront in understanding nonhuman primate vocal signaling. Evol Anthropol. 10:58-71.
76. Paulesu E, Frith CD, Frackowiak R S J. 1993. The neural correlates of the verbal component of working memory. Nature. 362:342-345. (Pubitemid 23101305)
77. Petrides M, Alivisatos B, Frey S. 2002. Differential activation of the human orbital, mid-ventrolateral, and mid-dorsolateral prefrontal cortex during the processing of visual stimuli. Proc Natl Acad Sci USA. 99:5649-5654. (Pubitemid 34411604)
78. Petrides M, Pandya DN. 1988. Association fiber pathways to the frontal cortex from the superior temporal region in the rhesus monkey. J Comp Neurol. 273:52-66.
79. Pigarev IN, Rizzolatti G, Schandolara C. 1979. Neurons responding to visual stimuli in the frontal lobe of macaque monkeys. Neurosci Lett. 12:207-212. (Pubitemid 9180174)
80. Preuss TM, Goldman-Rakic PS. 1991. Myelo-and cytoarchitecture of the granular frontal cortex and surrounding regions in the strepsirhine primate Galago and the anthropoid primate Macaca. J. Comp Neurol. 310:429-474.
81. Pouget A, Dayan P, Zemel RS. 2003. Inference and computation with population codes. Annu Rev Neurosci. 26:381-410. (Pubitemid 37064939)
82. Rao SC, Rainer G, Miller EK. 1997. Integration of what and where in the primate prefrontal cortex. Science. 276:821-824. (Pubitemid 27199866)
83. Rauschecker JP. 1998. Parallel processing in the auditory cortex of primates. Audiol Neurootol. 3:86-103. (Pubitemid 28159884)
84. Rauschecker JP, Tian B. 2000. Mechanisms and streams for processing of "what" and "where" in auditory cortex. Proc Natl Acad Sci USA. 97:11800-11806.
85. Rauschecker JP, Tian B, Hauser M. 1995. Processing of complex sounds in the macaque nonprimary auditory cortex. Science. 268:111-114.
86. Romanski LM. 2004. Domain specificity in the primate prefrontal cortex. Cogn Affect Behav Neurosci. 4:421-429. (Pubitemid 40342891)
87. Romanski LM, Averbeck BB, Diltz M. 2005. Neural representation of vocalizations in the primate ventrolateral prefrontal cortex. J Neurophysiol. 93:734-747.
88. Romanski LM, Bates JF, Goldman-Rakic PS. 1999. Auditory belt and parabelt projections to the prefrontal cortex in the rhesus monkey. J Comp Neurol. 403:141-157. (Pubitemid 28566827)
89. Romanski LM, Goldman-Rakic PS. 2002. An auditory domain in primate prefrontal cortex. Nat Neurosci. 5:15-16. (Pubitemid 34038776)
90. Romanski LM, Tian B, Fritz J, Mishkin M, Goldman-Rakic PS, Rauschecker JP. 1999. Dual streams of auditory afferents target multiple domains in the primate prefrontal cortex. Nat Neurosci. 2:1131-1136. (Pubitemid 30126373)
91. Romo R, Brody CD, Hernandez A, Lemus L. 1999. Neuronal correlates of parametric working memory in the prefrontal cortex. Nature. 399:470-473. (Pubitemid 29258852)
92. Rosenkilde CE, Bauer RH, Fuster JM. 1981. Single cell activity in ventral prefrontal cortex of behaving monkeys. Brain Res. 209:375-394. (Pubitemid 11137025)
93. Sahani M, Dayan P. 2003. Doubly distributional population codes: simultaneous representation of uncertainty and multiplicity. Neural Comput. 15:2255-2279. (Pubitemid 37052885)
94. Sahani M, Linden JF. 2003. How linear are auditory cortical responses? In: Becker S, Thrun S and Obermayer K. editors., Advances in neural information processing systems. Cambridge, (MA): MIT Press. NIPS. p. 109-116.
95. Salinas E, Hernandez A, Zainos A, Romo R. 2000. Periodicity and firing rate as candidate neural codes for the frequency of vibrotactile stimuli. J Neurosci. 20:5503-5515. (Pubitemid 30457747)
96. Schultz RT, Gauthier I, Klin A, Fulbright RK, Anderson AW, Volkmar F, Skudlarski P, Lacadie C, Cohen DJ, Gore JC. 2000. Abnormal ventral temporal cortical activity during face discrimination among individuals with autism and Asperger syndrome. Arch Gen Psychiatry. 57:331-340. (Pubitemid 30202323)
97. Stein BE, Meredith MA. 1993. The merging of the senses. Cambridge: MIT Press.
98. Stromswold K, Caplan D, Alpert N, Rauch S. 1996. Localization of syntactic comprehension by positron emission tomography. Brain Lang. 52:452-473. (Pubitemid 26097791)
99. Sugihara T, Diltz MD, Averbeck BB, Romanski LM. 2006. Integration of auditory and visual communication information in the primate ventrolateral prefrontal cortex. J Neurosci. 26:11138-11147. (Pubitemid 44772202)
100. Surguladze SA, Calvert GA, Brammer MJ, Campbell R, Bullmore ET, Giampietro V, David AS. 2001. Audio-visual speech perception in schizophrenia: an fMRI study. Psychiatry Res. 106:1-14. (Pubitemid 32174864)
101. Tanaka K. 1993. Neuronal mechanisms of object recognition. Science. 262:685-688. (Pubitemid 23350686)
102. Tian B, Reser D, Durham A, Kustov A, Rauschecker JP. 2001. Functional specialization in rhesus monkey auditory cortex. Science. 292:290-293. (Pubitemid 32295388)
103. Ungerleider LG, Courtney SM, Haxby JV. Forthcoming 1998. A neural system for human visual working memory. Proc Natl Acad Sci USA. 95:883-890. (Pubitemid 28124882)
104. Ungerleider LG, Mishkin M. 1982. Two cortical visual systems. In: Ingle DJ, Goodale MA, Mansfield RJW, editors. Analysis of visual behavior. Cambridge (MA): MIT Press. p. 549-586.
105. Wallis JD, Anderson KC, Miller EK. 2001. Single neurons in prefrontal cortex encode abstract rules. Nature. 411:953-956. (Pubitemid 32601492)
106. Wallis JD, Miller EK. 2003. Neuronal activity in primate dorsolateral and orbital prefrontal cortex during performance of a reward preference task. Eur J Neurosci. 18:2069-2081. (Pubitemid 37372389)
107. Webster MJ, Bachevalier J, Ungerleider LG. 1994. Connections of inferior temporal areas TEO and TE with parietal and frontal cortex in macaque monkeys. Cereb Cortex. 4:470-483. (Pubitemid 24297011)
108. Williams GV, Rao SG, Goldman-Rakic PS. 2002. The physiological role of 5-HT2A receptors in working memory. J Neurosci. 22:2843-2854. (Pubitemid 37465833)
109. Williams JH, Massaro DW, Peel NJ, Bosseler A, Suddendorf T. 2004. Visual-auditory integration during speech imitation in autism. Res Dev Disabil. 25:559-575. (Pubitemid 39486041)
110. Wilson F A W, O'Scalaidhe SP, Goldman-Rakic PS. 1993. Dissociation of object and spatial processing domains in primate prefrontal cortex. Science. 260:1955-1958. (Pubitemid 23258279)
111. Zemel RS, Dayan P, Pouget A. 1998. Probabilistic interpretation of population codes. Neural Comput. 10:403-430. (Pubitemid 128463159)