Timing of audiovisual inputs to the prefrontal cortex and multisensory integration

Neuroscience

Volumn 214, Issue , 2012, Pages 36-48

  Romanski, L M ^a   Hwang, J ^a,b  

^a UNIVERSITY OF ROCHESTER SCHOOL OF MEDICINE AND DENTISTRY   (United States)

^b UNIVERSITY OF ROCHESTER   (United States)

Author keywords

Faces; Frontal lobe; Multisensory integration; Neurophysiology; Temporal coincidence; Vocalizations

Indexed keywords

ANIMAL CELL; ANIMAL EXPERIMENT; ARTICLE; AUDITORY FEEDBACK; AUDITORY STIMULATION; BRAIN NERVE CELL; BRAIN REGION; COMPREHENSION; CONTROLLED STUDY; EVOKED AUDITORY RESPONSE; EVOKED VISUAL RESPONSE; FACIAL EXPRESSION; FEMALE; LATENT PERIOD; MALE; NEUROPHYSIOLOGY; NEUROTRANSMISSION; NONHUMAN; PREFRONTAL CORTEX; PRIORITY JOURNAL; SENSORIMOTOR INTEGRATION; SIGNAL DETECTION; SPEECH INTELLIGIBILITY; SPEECH PERCEPTION; TEMPORAL SUMMATION; VISUAL FEEDBACK; VISUAL STIMULATION; VOCALIZATION;

ACOUSTIC STIMULATION; ANIMALS; AUDITORY PATHWAYS; AUDITORY PERCEPTION; FEMALE; HUMANS; MACACA MULATTA; MALE; PHOTIC STIMULATION; PREFRONTAL CORTEX; REACTION TIME; VISUAL PATHWAYS; VISUAL PERCEPTION;

EID: 84861802192     PISSN: 03064522     EISSN: 18737544     Source Type: Journal    
DOI: 10.1016/j.neuroscience.2012.03.025     Document Type: Article

References (55)

1. Barraclough N.E., Xiao D., Baker C.I., Oram M.W., Perrett D.I. Integration of visual and auditory information by superior temporal sulcus neurons responsive to the sight of actions. J Cogn Neurosci 2005, 17:377-391.
2. Baylis G.C., Rolls E.T., Leonard C.M. Selectivity between faces in the responses of a population of neurons in the cortex in the superior temporal sulcus of the monkey. Brain Res 1985, 342:91-102.
3. Bell A.H., Meredith M.A., Van Opstal A.J., Munoz D.P. Crossmodal integration in the primate superior colliculus underlying the preparation and initiation of saccadic eye movements. J Neurophysiol 2005, 93:3659-3673.
4. Bertelson P., Aschersleben G. Temporal ventriloquism: crossmodal interaction on the time dimension. 1. Evidence from auditory-visual temporal order judgment. Int J Psychophysiol 2003, 50(1-2):147-155.
5. Bertelson P., Radeau M. Cross-modal bias and perceptual fusion with auditory-visual spatial discordance. Percept Psychophys 1981, 29:578-584.
6. Bushara K.O., Grafman J., Hallett M. Neural correlates of auditory-visual stimulus onset asynchrony detection. J Neurosci 2001, 21:300-304.
7. Calvert GA. Crossmodal processing in the human brain: insights from functional neuroimaging studies. Cereb Cortex 2001, 11:1110-1123.
8. Cappe C., Thut G., Romei V., Murray M.M. Auditory-visual multisensory interactions in humans: timing, topography, directionality, and sources. J Neurosci 2010, 30:12572-12580.
9. De Gelder B., Bertelson P. Multisensory integration, perception and ecological validity. Trends Cogn Sci 2003, 7(10):460-467.
10. Dixon N.F., Spitz L. The detection of auditory visual desynchrony. Perception 1980, 9(6):719-721.
11. Driver J. Enhancement of selective listening by illusory mislocation of speech sounds due to lip-reading. Nature 1996, 381:66-68.
12. Ghazanfar A.A., Maier J.X., Hoffman K.L., Logothetis N.K. Multisensory integration of dynamic faces and voices in rhesus monkey auditory cortex. J Neurosci 2005, 25:5004-5012.
13. Gouzoules S., Gouzoules H., Marler P. Rhesus monkey (Macaca mulatta) screams: representational signaling in the recruitment of agonistic aid. Anim Behav 1984, 32:183-193.
14. Gothard K.M., Erickson C.A., Amaral D.G. How do rhesus monkeys (Macaca mulatta) scan faces in a visual paired comparison task?. Anim Cogn 2004, 2004(7):25-36.
15. Hauser M.D., Marler P. Food associated calls in rhesus macaques (Macaca mulatta) I. Socioecological factors. Behav Ecol 1993, 4:194-205.
16. Hanes D.P., Thompson K.G., Schall J.D. Relationship of presaccadic activity in frontal eye field and supplementary eye field to saccade initiation in macaque: Poisson spike train analysis. Exp Brain Res 1995, 103(1):85-96.
17. Kayser C., Logothetis N.K., Panzeri S. Visual enhancement of the information representation in auditory cortex. Curr Biol 2010, 20:19-24.
18. Kikuchi Y, Lawson M, Horwitz B, Mishkin M, Rauschecker JP (2009) Neuronal representation of harmonics in monkey auditory cortex. Society for Neuroscience Abstracts.
19. Lakatos P., Chen C.M., O'Connell M.N., Mills A., Schroeder C.E. Neuronal oscillations and multisensory interaction in primary auditory cortex. Neuron 2007, 53:279-292.
20. Lakatos P., O'Connell M.N., Barczak A., Mills A., Javitt D.C., Schroeder C.E. The leading sense: supramodal control of neurophysiological context by attention. Neuron 2009, 64(3):419-430.
21. Lee J., Williford T., Maunsell J.H. Spatial attention and the latency of neuronal responses in macaque area V4. J Neurosci 2007, 27(36):9632-9637.
22. Legendy C.R., Salcman M. Bursts and recurrences of bursts in the spike trains of spontaneously active striate cortex neurons. J Neurophysiol 1985, 53(4):926-939.
23. Macaluso E., George N., Dolan R., Spence C., Driver J. Spatial and temporal factors during processing of audiovisual speech: a PET study. Neuroimage 2004, 21(2):725-732.
24. Massaro D.W., Cohen M.M., Smeele P.M. Perception of asynchronous and conflicting visual and auditory speech. J Acoust Soc Am 1996, 100:1777-1786.
25. McGurk H., MacDonald J. Hearing lips and seeing voices. Nature 1976, 264(5588):746-748.
26. Meredith M.A., Nemitz J.W., Stein B.E. Determinants of multisensory integration in superior colliculus neurons. I. Temporal factors. J Neurosci 1987, 7:3215-3229.
27. Miller L.M., D'Esposito M. Perceptual fusion and stimulus coincidence in the cross-modal integration of speech. J Neurosci 2005, 25:5884-5893.
28. Munhall K.G., Gribble P., Sacco L., Ward M. Temporal constraints on the McGurk effect. Percept Psychophys 1996, 58(3):351-362.
29. Musacchia G., Schroeder C.E. Neuronal mechanisms, response dynamics and perceptual functions of multisensory interactions in auditory cortex. Hear Res 2009, 258:72-79.
30. O'Scalaidhe S.P., Wilson F.A.W., Goldman-Rakic P.S. Areal segregation of face-processing neurons in prefrontal cortex. Science 1997, 278:1135-1138.
31. O'Scalaidhe S.P., Wilson F.A.W., Goldman-Rakic P.S. Face-selective neurons during passive viewing and working memory performance of rhesus monkeys: Evidence for intrinsic specialization of neuronal coding. Cereb Cortex 1999, 9:459-475.
32. Partan S.R. Single and multichannel signal composition: facial expressions and vocalizations of rhesus macaques (Macaca mulatta). Behaviour 2002, 139:993-1028.
33. Petrides M., Pandya D.N. Comparative cytoarchitectonic analysis of the human and the macaque ventrolateral prefrontal cortex and corticocortical connection patterns in the monkey. Eur J Neurosci 2002, 16:291-310.
34. Preuss T.M., Goldman-Rakic P.S. Myelo- and cytoarchitecture of the granular frontal cortex and surrounding regions in the strepsirhine primate Galago and the anthropoid primate Macaca. J Comp Neurol 1991, 310:429-474.
35. Rolls E.T., Critchley H.D., Browning A.S., Inoue K. Face-selective and auditory neurons in the primate orbitofrontal cortex. Exp Brain Res 2006, 170(1):74-87.
36. Romanski L.M. Representation and integration of auditory and visual stimuli in the primate ventral lateral prefrontal cortex. Cereb Cortex 2007, 17(Suppl 1):i61-i69.
37. Romanski L.M., Averbeck B.B., Diltz M. Neural representation of vocalizations in the primate ventrolateral prefrontal cortex. J Neurophysiol 2005, 93(2):734-747.
38. Romanski L.M., Bates J.F., Goldman-Rakic P.S. Auditory belt and parabelt projections to the prefrontal cortex in the rhesus monkey. J Comp Neurol 1999, 403:141-157.
39. Romanski L.M., Diehl M.M. Neurons responsive to face-view in the primate ventrolateral prefrontal cortex. Neuroscience 2011, 189:223-235.
40. Romanski L.M., Goldman-Rakic P.S. An auditory domain in primate prefrontal cortex. Nat Neurosci 2002, 5:15-16.
41. Romanski LM, Tian B, Fritz J, Mishkin M, Goldman-Rakic PS, Rauschecker JP (1999b). Dual streams of auditory afferents target multiple domains in the primate prefrontal cortex. 2:1131-1136.
42. Rosenkilde C.E., Bauer R.H., Fuster J.M. Single cell activity in ventral prefrontal cortex of behaving monkeys. Brain Res 1981, 209:375-394.
43. Ross L.A., Saint-Amour D., Leavitt V.M., Javitt D.C., Foxe J.J. Do you see what I am saying? Exploring visual enhancement of speech comprehension in noisy environments. Cereb Cortex 2007, 17:1147-1153.
44. Rowland B.A., Quessy S., Stanford T.R., Stein B.E. Multisensory integration shortens physiological response latencies. J Neurosci 2007, 27(22):5879-5884.
45. Russ B.E., Ackelson A.L., Baker A.E., Cohen Y.E. Coding of auditory-stimulus identity in the auditory non-spatial processing stream. J Neurophysiol 2008, 99(1):87-95.
46. Schroeder C.E., Lakatos P., Kajikawa Y., Partan S., Puce A. Neuronal oscillations and visual amplification of speech. Trends Cogn Sci 2008, 12(3):106-113.
47. Senkowski D., Talsma D., Grigutsch M., Herrmann C.S., Woldorff M.G. Good times for multisensory integration: effects of the precision of temporal synchrony as revealed by gamma-band oscillations. Neuropsychologia 2007, 45(3):561-571.
48. Stein B.E., Meredith M.A. The merging of the senses 1993, MIT Press, Cambridge.
49. Stevenson R.A., Altieri N.A., Kim S., Pisoni D.B., James T.W. Neural processing of asynchronous audiovisual speech perception. Neuroimage 2010, 49:3308-3318.
50. Sugihara T., Diltz M.D., Averbeck B.B., Romanski L.M. Integration of auditory and visual communication information in the primate ventrolateral prefrontal cortex. J Neuroscience 2006, 26:11138-11147.
51. Tsao D.Y., Schweers N., Moeller S., Freiwald W.A. Patches of face-selective cortex in the macaque frontal lobe. Nat Neurosci 2008, 11:877-879.
52. van Atteveldt N.M., Formisano E., Blomert L., Goebel R. The effect of temporal asynchrony on the multisensory integration of letters and speech sounds. Cereb Cortex 2007, 17:962-974.
53. van Wassenhove V., Grant K.W., Poeppel D. Temporal window of integration in auditory-visual speech perception. Neuropsychologia 2007, 45(3):598-607.
54. Vatakis A, Ghazanfar AA, Spence C (2008) Facilitation of multisensory integration by the " unity effect" reveals that speech is special. J Vis 8:9:14.1-1411.
55. Vatakis A., Spence C. Crossmodal binding: evaluating the " unity assumption" using audiovisual speech stimuli. Percept Psychophys 2007, 69(5):744-756.