Multisensory facilitation of behavior in monkeys: Effects of stimulus intensity

Journal of Cognitive Neuroscience

Volumn 22, Issue 12, 2010, Pages 2850-2863

  Cappe, Céline ^a,b,c   Murray, Micah M ^c   Barone, Pascal ^b   Rouiller, Eric M ^a  

^a UNIVERSITY OF FRIBOURG   (Switzerland)

^b UNIVERSITÉ DE TOULOUSE   (France)

^c LAUSANNE UNIVERSITY HOSPITAL   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

ANIMAL EXPERIMENT; ARTICLE; BEHAVIOR; FACILITATION; MALE; MONKEY; NERVE POTENTIAL; NEUROPHYSIOLOGY; NONHUMAN; PRIORITY JOURNAL; SPATIAL SUMMATION; STIMULUS RESPONSE; ARM MOVEMENT; AUDITORY STIMULATION; FEASIBILITY STUDY; HAPLORHINI; PREDICTION; PROBABILITY; SACCADIC EYE MOVEMENT; SENSORIMOTOR FUNCTION; VISUAL STIMULATION;

ACOUSTIC STIMULATION; ANALYSIS OF VARIANCE; ANIMALS; AUDITORY PERCEPTION; MACACA FASCICULARIS; MALE; PHOTIC STIMULATION; PSYCHOMOTOR PERFORMANCE; REACTION TIME; VISUAL PERCEPTION;

EYE MOVEMENTS; MAMMALS;

AUDITORY STIMULI; AUDITORY-VISUAL; IMPROVE PERFORMANCE; INCONSISTENT DATA; MULTISENSORY; MULTISENSORY STIMULUS; NON-HUMAN PRIMATE; SENSORIMOTORS; SIGNAL EFFECTS; STIMULUS INTENSITY;

PROBABILITY;

EID: 77956062365     PISSN: 0898929X     EISSN: 15308898     Source Type: Journal    
DOI: 10.1162/jocn.2010.21423     Document Type: Article

References (93)

1. Alvarado, J. C., Stanford, T. R., Vaughan, J. W., & Stein, B. E. (2007). Cortex mediates multisensory but not unisensory integration in superior colliculus. Journal of Neuroscience, 27, 12775-12786. (Pubitemid 350159583)
2. Barraclough, N. E., Xiao, D., Baker, C. I., Oram, M. W., & Perrett, D. I. (2005). Integration of visual and auditory information by superior temporal sulcus neurons responsive to the sight of actions. Journal of Cognitive Neuroscience, 17, 377-391.
3. Bell, A. H., Corneil, B. D., Meredith, M. A., & Munoz, D. P. (2001). The influence of stimulus properties on multisensory processing in the awake primate superior colliculus. Canadian Journal of Experimental Psychology, 55, 123-132.
4. Bell, A. H., Meredith, M. A., Van Opstal, A. J., & Munoz, D. P. (2005). Crossmodal integration in the primate superior colliculus underlying the preparation and initiation of saccadic eye movements. Journal of Neurophysiology, 93, 3659-3673.
5. Bizley, J. K., Nodal, F. R., Bajo, V. M., Nelken, I., & King, A. J. (2007). Physiological and anatomical evidence for multisensory interactions in auditory cortex. Cerebral Cortex, 17, 2172-2189.
6. Blau, V., van Atteveldt, N., Ekkebus, M., Goebel, R., & Blomert, L. (2009). Reduced neural integration of letters and speech sounds links phonological and reading deficits in adult dyslexia. Current Biology, 19, 503-508.
7. Bolognini, N., Leo, F., Passamonti, C., Stein, B. E., & Làdavas, E. (2007). Multisensory-mediated auditory localization. Perception, 36, 1477-1485.
8. Brosch, M., Selezneva, E., & Scheich, H. (2005). Nonauditory events of a behavioral procedure activate auditory cortex of highly trained monkeys. Journal of Neuroscience, 25, 6797-6806.
9. Cappe, C., & Barone, P. (2005). Heteromodal connections supporting multisensory integration at low levels of cortical processing in the monkey. European Journal of Neuroscience, 22, 2886-2902.
10. Cappe, C., Morel, A., Barone, P., & Rouiller, E. M. (2009). The thalamocortical projection systems in primate: An anatomical support for multisensory and sensorimotor integrations. Cerebral Cortex, 19, 2025-2037.
11. Cappe, C., Morel, A., & Rouiller, E. M. (2007). Thalamocortical and the dual pattern of corticothalamic projections of the posterior parietal cortex in macaque monkeys. Neuroscience, 146, 1371-1387.
12. Cappe, C., Rouiller, E. M., & Barone, P. (2009). Multisensory anatomic pathway. Hearing Research, 258, 28-36.
13. Cappe, C., Thut, G., Romei, V., & Murray, M. M. (2009). Selective integration of auditory-visual looming cues by humans. Neuropsychologia, 47, 1045-1052.
14. Chandrasekaran, C., & Ghazanfar, A. A. (2009). Different neural frequency bands integrate faces and voices differently in the superior temporal sulcus. Journal of Neurophysiology, 101, 773-788.
15. Corballis, M. C. (1998). Interhemispheric neural summation in the absence of the corpus callosum. Brain, 121, 1795-1807.
16. Corneil, B. D., Van Wanrooij, M., Munoz, D. P., & Van Opstal, A. J. (2002). Auditory-visual interactions subserving goaldirected saccades in a complex scene. Journal of Neurophysiology, 88, 438-454. (Pubitemid 34755363)
17. Diederich, A., & Colonius, H. (2004). Bimodal and trimodal multisensory enhancement: Effects of stimulus onset and intensity on RT. Perception and Psychophysics, 66, 1388-1404.
18. Driver, J., & Noesselt, T. (2008). Multisensory interplay reveals crossmodal influences on "sensory-specific" brain regions, neural responses, and judgments. Neuron, 57, 11-23.
19. Durif, C., Jouffrais, C., & Rouiller, E. M. (2003). Single-unit responses in the auditory cortex of monkeys performing a conditional acousticomotor task. Experimental Brain Research, 153, 614-627.
20. Falchier, A., Clavagnier, S., Barone, P., & Kennedy, H. (2002). Anatomical evidence of multimodal integration in primate striate cortex. Journal of Neuroscience, 22, 5749-5759.
21. Frens, M. A., & Van Opstal, A. J. (1998). Visual-auditory interactions modulate saccade-related activity in monkey superior colliculus. Brain Research Bulletin, 46, 211-224. (Pubitemid 28293166)
22. Fu, K. M., Johnston, T. A., Shah, A. S., Arnold, L., Smiley, J., Hackett, T. A., et al. (2003). Auditory cortical neurons respond to somatosensory stimulation. Journal of Neuroscience, 23, 7510-7515.
23. Fu, K. M., Shah, A. S., O'Connell, M. N., McGinnis, T., Eckholdt, H., Lakatos, P., et al. (2004). Timing and laminar profile of eye-position effects on auditory responses in primate auditory cortex. Journal of Neurophysiology, 92, 3522-3531.
24. Ghazanfar, A. A., Chandrasekaran, C., & Logothetis, N. K. (2008). Interactions between the superior temporal sulcus and auditory cortex mediate dynamic face/voice integration in rhesus monkeys. Journal of Neuroscience, 28, 4457-4469.
25. Ghazanfar, A. A., & Logothetis, N. K. (2003). Facial expressions linked to monkey calls. Nature, 423, 937-938.
26. Ghazanfar, A. A., Maier, J. X., Hoffman, K. L., & Logothetis, N. K. (2005). Multisensory integration of dynamic faces and voices in rhesus monkey auditory cortex. Journal of Neuroscience, 25, 5004-5012.
27. Ghazanfar, A. A., Nielsen, K., & Logothetis, N. K. (2006). Eye movements of monkeys viewing vocalizing conspecifics. Cognition, 101, 515-529.
28. Ghazanfar, A. A., & Schroeder, C. E. (2006). Is neocortex essentially multisensory? Trends in Cognitive Sciences, 10, 278-285.
29. Giard, M. H., & Peronnet, F. (1999). Auditory-visual integration during multimodal object recognition in humans: A behavioral and electrophysiological study. Journal of Cognitive Neuroscience, 11, 473-490.
30. Giray, M., & Ulrich, R. (1993). Motor coactivation revealed by response force in divided and focused attention. Journal of Experimental Psychology: Human Perception and Performance, 19, 1278-1291.
31. Gondan, M., Niederhaus, B., Rösler, F., & Röder, B. (2005). Multisensory processing in the redundant-target effect: A behavioral and event-related potential study. Perception and Psychophysics, 67, 713-726.
32. Grant, K. W., & Seitz, P. F. (2000). The use of visible speech cues for improving auditory detection of spoken sentences. Journal of the Acoustical Society of America, 108, 1197-1208.
33. Hackett, T. A., De La Mothe, L. A., Ulbert, I., Karmos, G., Smiley, J., & Schroeder, C. E. (2007). Multisensory convergence in auditory cortex, II. Thalamocortical connections of the caudal superior temporal plane. Journal of Comparative Neurology, 502, 924-952. (Pubitemid 46806628)
34. Hairston, W. D., Burdette, J. H., Flowers, D. L., Wood, F. B., & Wallace, M. T. (2005). Altered temporal profile of visual-auditory multisensory interactions in dyslexia. Experimental Brain Research, 166, 474-480.
35. Hairston, W. D., Laurienti, P. J., Mishra, G., Burdette, J. H., & Wallace, M. T. (2003). Multisensory enhancement of localization under conditions of induced myopia. Experimental Brain Research, 152, 404-408.
36. Hershenson, M. (1962). Reaction time as a measure of intersensory facilitation. Journal of Experimental Psychology, 63, 289-293.
37. Hirokawa, J., Bosch, M., Sakata, S., Sakurai, Y., & Yamamori, T. (2008). Functional role of the secondary visual cortex in multisensory facilitation in rats. Neuroscience, 153, 1402-1417.
38. Holmes, N. P. (2009). The principle of inverse effectiveness in multisensory integration: Some statistical considerations. Brain Topography, 21, 168-176.
39. Hughes, H. C., Reuter-Lorenz, P. A., Nozawa, G., & Fendrich, R. (1994). Visual-auditory interactions in sensorimotor processing: Saccades versus manual responses. Journal of Experimental Psychology: Human Perception and Performance, 20, 131-153.
40. Izumi, A., & Kojima, S. (2004). Matching vocalizations to vocalizing faces in a chimpanzee (Pan troglodytes). Animal Cognition, 7, 179-184.
41. Jepma, M., Wagenmakers, E. J., Band, G. P., & Nieuwenhuis, S. (2009). The effects of accessory stimuli on information processing: Evidence from electrophysiology and a diffusion model analysis. Journal of Cognitive Neuroscience, 21, 847-864.
42. Kayser, C., & Logothetis, N. K. (2009). Directed interactions between auditory and superior temporal cortices and their role in sensory integration. Frontiers in Integrative Neuroscience, 3, doi: 10.3389/neuro.07.007.2009.
43. Kayser, C., Petkov, C. I., Augath, M., & Logothetis, N. K. (2005). Integration of touch and sound in auditory cortex. Neuron, 48, 373-384.
44. Kayser, C., Petkov, C. I., Augath, M., & Logothetis, N. K. (2007). Functional imaging reveals visual modulation of specific fields in auditory cortex. Journal of Neuroscience, 27, 1824-1835. (Pubitemid 46310306)
45. Kayser, C., Petkov, C. I., & Logothetis, N. K. (2008). Visual modulation of neurons in auditory cortex. Cerebral Cortex, 18, 1560-1574.
46. Kermadi, I., Liu, Y., Tempini, A., Calciati, E., & Rouiller, E. M. (1998). Neuronal activity in the primate supplementary motor area and the primary motor cortex in relation to spatio-temporal bimanual coordination. Somatosensory Motor Research, 15, 287-308.
47. Komura, Y., Tamura, R., Uwano, T., Nishijo, H., & Ono, T. (2005). Auditory thalamus integrates visual inputs into behavioral gains. Nature Neuroscience, 8, 1203-1209.
48. Lakatos, P., Chen, C. M., O'Connell, M. N., Mills, A., & Schroeder, C. E. (2007). Neuronal oscillations and multisensory interaction in primary auditory cortex. Neuron, 53, 279-292.
49. Lamarre, Y., Busby, L., & Spidalieri, G. (1983). Fast ballistic arm movements triggered by visual, auditory, and somesthetic stimuli in the monkey. I. Activity of precentral cortical neurons. Journal of Neurophysiology, 50, 1343-1358.
50. Laurienti, P. J., Burdette, J. H., Maldjian, J. A., & Wallace, M. T. (2006). Enhanced multisensory integration in older adults. Neurobiology of Aging, 27, 1155-1163.
51. Ma, W. J., Zhou, X., Ross, L. A., Foxe, J. J., & Parra, L. C. (2009). Lip-reading aids word recognition most in moderate noise: A Bayesian explanation using high-dimensional feature space. PLoS One, 4, e4638.
52. Macmillan, N., & Creelman, C. (1991). Detection theory: A user's guide. UK: Cambridge University Press.
53. Maier, J. X., Neuhoff, J. G., Logothetis, N. K., & Ghazanfar, A. A. (2004). Multisensory integration of looming signals by rhesus monkeys. Neuron, 43, 177-181.
54. Martuzzi, R., Murray, M. M., Michel, C. M., Thiran, J. P., Maeder, P. P., Clarke, S., et al. (2007). Multisensory interactions within human primary cortices revealed by BOLD dynamics. Cerebral Cortex, 17, 1672-1679.
55. Meredith, M. A., & Allman, B. L. (2009). Subthreshold multisensory processing in cat auditory cortex. NeuroReport, 20, 126-131.
56. Meredith, M. A., & Stein, B. E. (1986). Visual, auditory, and somatosensory convergence on cells in superior colliculus results in multisensory integration. Journal of Neurophysiology, 56, 640-662.
57. Miller, J. (1982). Divided attention: Evidence for coactivation with redundant signals. Cognitive Psychology, 14, 247-279.
58. Miller, J., Ulrich, R., & Lamarre, Y. (2001). Locus of the redundantsignals effect in bimodal divided attention: A neurophysiological analysis. Perception and Psychophysics, 63, 555-562.
59. Molholm, S., Ritter, W., Murray, M. M., Javitt, D. C., Schroeder, C. E., & Foxe, J. J. (2002). Multisensory auditory-visual interactions during early sensory processing in humans: A high-density electrical mapping study. Brain Research, Cognitive Brain Research, 14, 115-128.
60. Mordkoff, J. T., Miller, J., & Roch, A. C. (1996). Absence of coactivation in the motor component: Evidence from psychophysiological measures of target detection. Journal of Experimental Psychology: Human Perception and Performance, 22, 25-41.
61. Murray, M. M., Foxe, J. J., Higgins, B. A., Javitt, D. C., & Schroeder, C. E. (2001). Visuo-spatial neural response interactions in early cortical processing during a simple reaction time task: A high-density electrical mapping study. Neuropsychologia, 39, 828-844.
62. Neil, P. A., Chee-Ruiter, C., Scheier, C., Lewkowicz, D. J., & Shimojo, S. (2006). Development of multisensory spatial integration and perception in humans. Developmental Science, 9, 454-464.
63. Nickerson, R. S. (1973). Intersensory facilitation of reaction time: Energy summation or preparation enhancement? Psychological Review, 80, 489-509.
64. Perrault, T. J., Jr., Vaughan, J. W., Stein, B. E., & Wallace, M. T. (2005). Superior colliculus neurons use distinct operational modes in the integration of multisensory stimuli. Journal of Neurophysiology, 93, 2575-2586.
65. Porter, K. K., Metzger, R. R., & Groh, J. M. (2006). Representation of eye position in primate inferior colliculus. Journal of Neurophysiology, 95, 1826-1842.
66. Porter, K. K., Metzger, R. R., & Groh, J. M. (2007). Visualand saccade-related signals in the primate inferior colliculus. Proceedings of the National Academy of Sciences, U.S.A., 104, 17855-17860.
67. Raab, D. H. (1962). Statistical facilitation of simple reaction times. Transactions of the New York Academy of Sciences, 24, 574-590.
68. Rach, S., & Diederich, A. (2006). Visual-tactile integration: Does stimulus duration influence the relative amount of response enhancement? Experimental Brain Research, 173, 514-520.
69. Rockland, K. S., & Ojima, H. (2003). Multisensory convergence in calcarine visual areas in macaque monkey. International Journal of Psychophysiology, 50, 19-26.
70. Romanski, L. M. (2007). Representation and integration of auditory and visual stimuli in the primate ventral lateral prefrontal cortex. Cerebral Cortex, 17(Suppl. 1), i61-i69.
71. Romei, V., Murray, M. M., Cappe, C. C., & Thut, G. (2009). Preperceptual and stimulus-selective enhancement of low-level human visual cortex excitability by sounds. Current Biology, 19, 1799-1805.
72. Romei, V., Murray, M. M., Merabet, L. B., & Thut, G. (2007). Occipital transcranial magnetic stimulation has opposing effects on visual and auditory stimulus detection: Implications for multisensory interactions. Journal of Neuroscience, 27, 11465-11472. (Pubitemid 350006902)
73. Ross, L. A., Saint-Amour, D., Leavitt, V. M., Javitt, D. C., & Foxe, J. J. (2007). Do you see what I am saying? Exploring visual enhancement of speech comprehension in noisy environments. Cerebral Cortex, 17, 1147-1153.
74. Ross, L. A., Saint-Amour, D., Leavitt, V. M., Molholm, S., Javitt, D. C., & Foxe, J. J. (2007). Impaired multisensory processing in schizophrenia: Deficits in the visual enhancement of speech comprehension under noisy environmental conditions. Schizophrenia Research, 97, 173-183.
75. Rouger, J., Lagleyre, S., Fraysse, B., Deneve, S., Deguine, O., & Barone, P. (2007). Evidence that cochlear-implanted deaf patients are better multisensory integrators. Proceedings of the National Academy of Sciences, U.S.A., 104, 7295-7300.
76. Schlack, A., Sterbing-D'Angelo, S. J., Hartung, K., Hoffmann, K. P., & Bremmer, F. (2005). Multisensory space representations in the macaque ventral intraparietal area. Journal of Neuroscience, 25, 4616-4625.
77. Schroeder, C. E., & Foxe, J. J. (2002). The timing and laminar profile of converging inputs to multisensory areas of the macaque neocortex. Brain Research, Cognitive Brain Research, 14, 187-198.
78. Schroeder, C. E., Lakatos, P., Kajikawa, Y., Partan, S., & Puce, A. (2008). Neuronal oscillations and visual amplification of speech. Trends in Cognitive Science, 12, 106-113.
79. Schroeder, C. E., Lindsley, R. W., Specht, C., Marcovici, A., Smiley, J. F., & Javitt, D. C. (2001). Somatosensory input to auditory association cortex in the macaque monkey. Journal of Neurophysiology, 85, 1322-1327.
80. Senkowski, D., Molholm, S., Gomez-Ramirez, M., & Foxe, J. J. (2006). Oscillatory beta activity predicts response speed during a multisensory audiovisual reaction time task: A high-density electrical mapping study. Cerebral Cortex, 16, 1556-1565.
81. Smiley, J. F., & Falchier, A. (2009). Multisensory connections of monkey auditory cerebral cortex. Hearing Research, doi: 10.1016/j.heares.2009. 06.019.
82. Sperdin, H., Cappe, C., Foxe, J. J., & Murray, M. M. (2009). Early, low-level auditorysomatosensory multisensory interactions impact reaction time speed. Frontiers in Integrative Neuroscience, 3, doi:10.3389/neuro.07.002.2009.
83. Stein, B. E., London, N., Wilkinson, L. K., & Price, D. D. (1996). Enhancement of perceived visual intensity by auditory stimuli: A psychophysical analysis. Journal of Cognitive Neuroscience, 8, 497-506.
84. Stein, B. E., & Meredith, M. A. (1993). The merging of the senses. Cambridge, MA: The MIT Press.
85. Stein, B. E., & Stanford, T. R. (2008). Multisensory integration: Current issues from the perspective of the single neuron. Nature Review Neuroscience, 9, 255-266.
86. Sugihara, T., Diltz, M. D., Averbeck, B. B., & Romanski, L. M. (2006). Integration of auditory and visual communication information in the primate ventrolateral prefrontal cortex. Journal of Neuroscience, 26, 11138-11147.
87. Sumby, W., & Pollack, I. (1954). Visual contribution to speech intelligibility in noise. Journal of the Acoustical Society of America, 26, 212-215.
88. Todd, J. W. (1912). Reaction to multiple stimuli. Archives of Psychology, 3, 1-65.
89. Vatikiotis-Bateson, E., Eigsti, I. M., Yano, S., & Munhall, K. G. (1998). Eye movement of perceivers during audiovisual speech perception. Perception & Psychophysics, 60, 926-940.
90. Wallace, M. T., Carriere, B. N., Perrault, T. J., Jr., Vaughan, J. W., & Stein, B. E. (2006). The development of cortical multisensory integration. Journal of Neuroscience, 26, 11844-11849.
91. Wang, Y., Celebrini, S., Trotter, Y., & Barone, P. (2008). Visuo-auditory interactions in the primary visual cortex of the behaving monkey: Electrophysiological evidence. BMC Neuroscience, 9, 79.
92. Welch, R. B., & Warren, D. H. (1986). Intersensory interactions. In J. P. Thomas (Ed.), Handbook of perception and human performance, volume I: Sensory processes and perception (pp. 25-21-25-36). New York: Wiley.
93. Werner-Reiss, U., Kelly, K. A., Trause, A. S., Underhill, A. M., & Groh, J. M. (2003). Eye position affects activity in primary auditory cortex of primates. Current Biology, 13, 554-562.