Enhancement of perceived visual intensity by auditory stimuli: A psychophysical analysis

Journal of Cognitive Neuroscience

Volumn 8, Issue 6, 1996, Pages 497-506

  Stein, Barry E ^a   London, Nancy ^a   Wilkinson, Lee K ^b   Price, Donald D ^b  

^a WAKE FOREST SCHOOL OF MEDICINE   (United States)

^b VIRGINIA COMMONWEALTH UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; ASSOCIATION; AUDITORY STIMULATION; CENTRAL NERVOUS SYSTEM; CLINICAL ARTICLE; HUMAN; HUMAN EXPERIMENT; HYPOTHESIS; LIGHT EMITTING DIODE; NORMAL HUMAN; PERCEPTION; PRIORITY JOURNAL; PSYCHOPHYSICS; SENSORY NERVE CELL; VISUAL STIMULATION;

EID: 0030468445     PISSN: 0898929X     EISSN: None     Source Type: Journal    
DOI: 10.1162/jocn.1996.8.6.497     Document Type: Article

References (56)

1. Andersen, R. A., Essick, G. K., & Siegel, R. M. (1985). Encoding of spatial location by posterior parietal neurons. Science, 230, 456-458.
2. Andreassi, J. L., & Greco, J. R. (1975). Effects of bisensory stimulation on reaction time and the evoked cortical potential. Physiological Psychology, 3, 189-194.
3. Barlow, R. B., Jr., Snodderly, D. M., & Swadlow, H. A. (1978). Intensity coding in primate visual system. Experimental Brain Research, 31, 163-177.
4. Bernstein, I. H. (1970). Can we see and hear at the same time? Acta Psychologica, 33, 21-35.
5. Bernstein, I. H., Clark, M. H., & Edelstein, B. A. (1969). Effects of an auditory signal on visual reaction time. Journal of Experimental Psychology, 80, 567-569.
6. Bertelson, P., & Radeau, M. (1981). Cross-modal bias and perceptual fusion with auditory-visual spatial discordance. Perception and Psychophysics, 29, 578-584.
7. Costin, D., Neville, H. J., Meredith, M. A., & Stein, B. E. (1991). Rules of multisensory integration and attention: ERP and behavioral evidence in humans. Society for Neuroscience Abstract, 17, 656.
8. Fidell, S. (1970). Sensory function in multimodal signal detection. Journal of the Acoustical Society of America, 47, 1009-1015.
9. Fisher, B. D., & Pylyshyn, Z. W. (1994). The cognitive architecture of bimodal event perception: A commentary and addendum to Radeau (1994). Current Psychology of Cognition, 13(1), 92-96.
10. Frens, M. A., Van Opstal, A. J., & Van der Willigen, R. F. (1995). Spatial and temporal factors determine audio-visual interactions in human saccadic eye movements. Perception and Psychophysics, 57, 802-816.
11. Gamlin, P. DE R., Zhang, H., & Clarke, R. J. (1995). Luminance neurons in the pretectal olivary nucleus mediate the pupillary light reflex in the rhesus monkey. Experimental Brain Research, 106, 169-176.
12. Gielen, S. C. A. M., Schmidt, R. A., & van den Heuvel, P. J. M. (1983). On the nature of intersensory facilitation of reaction time. Perception and Psychophysics, 34, 161-168.
13. Hershenson, M. (1962). Reaction time as a measure of intersensory facilitation. Journal of Experimental Psychology, 63, 289-293.
14. Hughes, H. C., Reuter-Lorenz, P. A., Nozawa, G., & Fendrich, R. (1994). Auditory-visual interactions in sensory-motor processing: Saccades versus manual responses. Journal of Experimental Psychology: Human Perception and Performance, 20, 131-153.
15. Jones, J. A., & Munhall, K. G. (1995). Auditory localization and audiovisual speech perception. Journal of the Acoustical Society of America, 97, 3286.
16. Kadunce, D. C., Wallace, M. T., Benedek, G., & Stein, B. E. (1994). Cross-modal inhibition in multisensory neurons is based on unimodal receptive field organization. Society for Neuroscience Abstract, 20, 1186.
17. Kayama, Y., Riso, R. R., Bartlett, J. R., & Doty, R. W. (1979). Luxotonic responses of units in macaque striate cortex. Journal of Neurophysiology, 42, 1495-1517.
18. King, A. J., & Palmer, A. R. (1985). Integration of visual and auditory information in bimodal neurones in the guinea-pig superior colliculus. Experimental Brain Research, 60, 492-500.
19. Maunsell, J. H. R., & Ferrera, V. P. (1995). Attentional mechanisms in visual cortex. In M. S. Gazzaniga (Ed.), The cognitive neurosciences (pp. 451-461), Cambridge, MA: MIT Press.
20. McGurk, H., & MacDonald, J. (1976). Hearing lips and seeing voices. Nature (London), 264, 746-748.
21. Meredith, M. A., & Stein, B. E. (1983). Interactions among converging sensory inputs in the superior colliculus. Science, 221, 389-391.
22. Meredith, M. A., & Stein, B. E. (1986a). Visual, auditory, and somatosensory convergence on cells in superior colliculus results in multisensory integration. Journal of Neurophysiology, 56, 640-662.
23. Meredith, M. A., & Stein, B. E. (1986b). Spatial factors determine the activity of multisensory neurons in cat superior colliculus. Brain Research, 365, 350-354.
24. Morell, L. K. (1968a). Cross-modality effects upon choice reaction time. Psychonomic Science, 11, 129-130.
25. Morell, L. K. (1968b). Temporal characteristics of sensory interaction in choice reaction times. Journal of Experimental Psychology, 77, 14-18.
26. Munoz, D. P., & Corneil, B. D. (1995). Evidence for interactions between target selection and visual fixation for saccade generation in humans. Experimental Brain Research, 103, 168-173.
27. Nickerson, R. S. (1973). Intersensory facilitation of reaction time: Energy summation or preparation enhancement? Psychological Review, 80, 489-509.
28. Nozawa, G., Reuter-Lorenz, P. A., & Hughes, H. C. (1994). Parallel and serial processes in the human oculomotor system: Bimodal convergence and express saccades. Biological Cybernetics, 72, 19-34.
29. Orban, G. A. (1984). Neuronal operations in the visual cortex. New York: Springer-Verlag.
30. Papaioannou, J., & White, A. (1972). Maintained activity of lateral geniculate nucleus neurons as a function of background luminance. Experimental Neurology, 34, 558-566.
31. Peck, C. K., Baro, J. A., & Warder, S. M. (1992). Sensory integration in the deep layers of the superior colliculus. Progress in Brain Research, 95, 91-102.
32. Peck, C. K., Baro, J. A., & Warder, S. M. (1995). Effects of eye position on saccadic eye movements and on the neuronal responses to auditory and visual stimuli in cat superior colliculus. Experimental Brain Research, 103, 227-242.
33. Perrott, D. R., Saberi, K., Brown, K., & Strybel, T. Z. (1990). Auditory psychomotor coordination and visual search performance. Perception and Psychophysics, 48, 214-226.
34. Posner, M. I., Nissen, M. J., & Klein, R. M. (1976). Visual dominance: An information-processing account of its origins and significance. Psychological Review, 83, 157-171.
35. Price, D. D., Bush, F. M., Long, S., & Harkins, S. W. (1994). A comparison of pain measurement characteristics of mechanical visual analogue and simple numerical rating scales. Pain, 56, 217-226.
36. Price, D. D., McGrath, P. A., Rafii, A., & Buckingham, B. (1983). The validation of visual analogue scales as ratio scale measures for chronic and experimental pain. Pain, 17, 45-60.
37. Ramachandran, R., Wallace, M. T., Clemo, H. R., & Stein, B. E. (1993). Multisensory convergence and integration in rat cortex. Society for Neuroscience Abstract, 19, 1447.
38. Reisberg, D. (1978). Looking where you listen: Visual cues and auditory attention. Acta Psychologica, 42, 331-341.
39. Reisberg, D., Scheiber, R., & Potemken, L. (1981). Eye position and the control of auditory attention. Journal of Experimental Psychology; Human Perception and Performance, 7, 318-323.
40. Sams, M., Aulanko, R., Hamalainen, M., Hari, R., Lounasmaa, O. V., Lu, S.-T., & Simola, J. (1991). Seeing speech: Visual information from lip movements modified activity in the human auditory cortex. Neuroscience Letters, 127, 141-145.
41. Simon, J. R., and Craft, J. L. (1970). Effects of an irrelevant auditory stimulus on visual choice reaction time. Journal of Experimental Psychology, 86, 272-274.
42. Stein, B. E., & Meredith, M. A. (1993). The merging of the senses. Cambridge, MA: MIT Press.
43. Stein, B. E., Huneycutt, W. S., & Meredith, M. A. (1988). Neurons and behavior: The same rules of multisensory integration apply. Brain Research, 448, 355-358.
44. Stein, B. E., Meredith, M. A., Huneycutt, W. S., & McDade, L. (1989). Behavioral indices of multisensory integration: Orientation to visual cues is affected by auditory stimuli. Journal of Cognitive Neuroscience, 1, 12-24.
45. Stein, B. E., Meredith, M. A., & Wallace, M. T. (1993). The visually responsive neuron and beyond: Multisensory integration in cat and monkey. Progress in Brain Research, 95, 79-90.
46. Stevens, S. S. (1975). Psychophysics (pp. 116-117). New York: Wiley.
47. Sumby, W. H., & Pollack, I. (1954). Visual contribution to speech intelligibility in noise. Journal of the Acoustical Society of America, 26, 212-215.
48. Wallace, M. T., & Stein, B. E. (1994). Cross-modal synthesis in the midbrain depends on input from association cortex. Journal of Neurophysiology, 71, 429-432.
49. Wallace, M. T., Meredith, M. A., & Stein, B. E. (1992). Integration of multiple sensory inputs in cat cortex. Experimental Brain Research, 91, 484-488.
50. Wallace, M. T., Meredith, M. A., & Stein, B. E. (1993). Converging influences from visual, auditory and somatosensory cortices onto output neurons of the superior colliculus. Journal of Neurophysiology, 69, 1797-1809.
51. Wallace, M. T., Wilkinson, L. K., & Stein, B. E. (1994). Sensory representations and the integration of multiple sensory cues in the monkey superior colliculus. Society for Neuroscience Abstract, 20, 1186.
52. Watkins, W. H. J., & Feehrer, C. E. (1965). Acoustic facilitation of visual detection. Journal of Experimental Psychology, 70, 322-333.
53. Welch, R. B., & Warren, D. H. (1980). Immediate perceptual response to intersensory discrepancy. Psychological Bulletin, 88, 638-667.
54. Welch, R. B., & Warren, D. H. (1986). Intersensory interactions. In K. R. Boff, L. Kaufman, & J. P. Thomas (Eds.), Handbook of perception and human performance, Volume I: Sensory processes and perception (pp. 25-1-25-36). New York: Wiley.
55. Wilkinson, L. K., Price, D. D., London, N., & Stein, B. E. (1993). Multisensory integration influences perception of visual intensity. Society for Neuroscience Abstract, 19, 1802.
56. Wolters, N. C. W., & Schiano, D. J. (1989). On listening where we look: The fragility of a phenomenon. Perception and Psychophysics, 45, 184-186.