Visual-haptic cue weighting is independent of modality-specific attention

Journal of Vision

Volumn 8, Issue 1, 2008, Pages

  Helbig, Hannah B ^a,b   Ernst, Marc O ^a  

^a MAX PLANCK INSTITUTE FOR BIOLOGICAL CYBERNETICS   (Germany)

^b NONE   (Germany)

Author keywords

Attention; Dual task; Multisensory integration; Touch; Vision

Indexed keywords

ADOLESCENT; ADULT; ARTICLE; ATTENTION; FEMALE; HUMAN; PERCEPTIVE DISCRIMINATION; PERCEPTIVE THRESHOLD; PHOTOSTIMULATION; PHYSIOLOGY; VISION;

ADOLESCENT; ADULT; ATTENTION; DISCRIMINATION (PSYCHOLOGY); FEMALE; HUMANS; PHOTIC STIMULATION; SENSORY THRESHOLDS; VISUAL PERCEPTION;

EID: 38849099827     PISSN: None     EISSN: 15347362     Source Type: Journal    
DOI: 10.1167/8.1.21     Document Type: Article

References (51)

1. Alais, D., & Burr, D. (2004). The ventriloquist effect results from near-optimal bimodal integration. Current Biology, 14, 257-262.
2. Allport, D. A., Antonis, B., & Reynolds, P. (1972). On the division of attention: A disproof of the single channel hypothesis. Quarterly Journal of Experimental Psychology, 24, 225-235.
3. Alsius, A., Navarra, J., Campbell, R., & Soto-Faraco, S. (2005). Audiovisual integration of speech falters under high attention demands. Current Biology, 15, 839-843.
4. Bertelson, P., & Radeau, M. (1981). Crossmodal bias and perceptual fusion with auditory-visual discordance. Perception & Psychophysics, 29, 578-584.
5. Bertelson, P., Vroomen, J., De Gelder, B., & Driver, J. (2000). The ventriloquist effect does not depend on the direction of deliberate visual attention. Perception & Psychophysics, 62, 321-332.
6. Bresciani, J.-P., Dammeier, F., & Ernst, M. O. (2006). Vision and touch are automatically integrated for the perception of sequences of events. Journal of Vision, 6(5):2, 554-564, http://journalofvision.org/6/5/2/, doi:10.1167/6.5.2.
7. Bresciani, J. P., Ernst, M. O., Drewing, K., Bouyer, G., Maury, V., & Kheddar, A. (2005). Feeling what you hear: Auditory signals can modulate tactile tap perception. Experimental Brain Research, 162, 172-180.
8. Calvert, G. A., Bullmore, E. T., Brammer, M. J., Campbell, R., Williams, S. C., McGuire, P. K., et al. (1997). Activation of auditory cortex during silent lipreading. Science, 276, 593-596.
9. Clark, J. J., & Yuille, A. L. (1990). Data fusion for sensory information processing systems. Boston: Kluwer Academic Publishers.
10. Colin, C., Radeau, M., Soquet, A., Dachy, B., & Deltenre, P. (2002). Electrophysiology of spatial scene analysis: The mismatch negativity (MMN) is sensitive to the ventriloquism illusion. Clinical Neurophysiology, 113, 507-518.
11. Colin, C., Radeau, M., Soquet, A., Demolin, D., Colin, F., & Deltenre, P. (2002). Mismatch negativity evoked by the McGurk-MacDonald effect: A phonetic representation within short-term memory. Clinical Neurophysiology, 113, 495-506.
12. De Gelder, B., & Vroomen, J. (2000). The perception of emotions by ear and by eye. Cognition & Emotion, 14, 289-311.
13. Driver, J. (1996). Enhancement of selective listening by illusory mislocation of speech sound due to lipreading. Nature, 381, 66-68.
14. Ernst, M. (2006). A Bayesian view on multimodal cue integration (chap. 6, pp. 105-131). New York: Oxford University Press.
15. Ernst, M. O., & Banks, M. S. (2002). Humans integrate visual and haptic information in a statistically optimal fashion. Nature, 415, 429-433.
16. Ernst, M. O., & Bülthoff, H. H. (2004). Merging the senses into a robust percept. Trends in Cognitive Sciences, 8, 162-169.
17. Gepshtein, S., & Banks, M. S. (2003). Viewing geometry determines how vision and haptics combine in size perception. Current Biology, 13, 483-488.
18. Gepshtein, S., Burge, J., Ernst, M. O., & Banks, M. S. (2005). The combination of vision and touch depends on spatial proximity. Journal of Vision, 5(11):7, 1013-1023, http://journalofvision.org/5/11/7/, doi:10.1167/5.11.7.
19. Helbig, H. B., & Ernst, M. O. (2007a). Knowledge about a common source can promote visual haptic integration. Perception 36, 1523-1533.
20. Helbig, H. B., & Ernst, M. O. (2007b). Optimal integration of shape information from vision and touch. Experimental Brain Research, 179, 595-606.
21. Hillis, J., Ernst, M., Banks, M., & Landy, M. (2002). Combining sensory information: Mandatory fusion within, but not between, senses. Science, 298, 1627-1630.
22. Kayser, C., Petkov, C., Augath, M., & Logothetis, N. (2005). Integration of touch and sound in auditory cortex. Neuron, 48, 373-384.
23. Knill, D. C., & Saunders, J. A. (2003). Do humans optimally integrate stereo and texture information for judgments of surface slant? Vision Research, 43, 2539-2558.
24. Lavie, N. (1995). Perceptual load as a necessary condition for selective attention. Journal of Experimental Psychology: Human Perception and Performance, 21, 451-468.
25. Macaluso, E., Frith, C. D., & Driver, J. (2000). Modulation of human visual cortex by crossmodal spatial attention. Science, 289, 1206-1208.
26. Massaro, D. W. (1987a). Information-processing theory and strong inference: A paradigm for psychological inquiry. In H. Heuer & A. F. Sanders (Eds.), Perspectives on perception and action (pp. 273-299). Hillsdale, NJ: Lawrence Erlbaum Associates.
27. Massaro, D. W. (1987b). Speech perception by ear and eye: A paradigm for psychological inquiry. Hillsdale, NJ: Lawrence Erlbaum Associates.
28. Massaro, D. W. (1998). Perceiving talking faces: From speech perception to a behavioral principle. Cambridge, MA: MIT Press.
29. Näätämen, R. (1992). Attention and brain function. Hillsdale, NJ: Lawrence Erlbaum.
30. Pekkoia, J., Ojanen, V., Autti, T., Jaaskelainen, I. P., Mottonen, R., Tarkiainen, A., et al. (2005). Primary auditory cortex activation by visual speech: An fMRI Study at 3 t. Neuroreport, 16, 125-128.
31. Prinzmetal, W., Amiri, H., Allen, K., & Edwards, T. (1998). Phonomenology of attention: I. Color, location, orientation, and spatial frequency. Journal of Experimental Psychology: Human Perception and Performance, 24, 1-22.
32. Prinzmetal, W., Nwachuku, I., Bodanski, L., Blumenfeld, L., & Shimizu, N. (1997). The phenomenology of attention. 2. brightness and contrast. Consciousness and Cognition, 6, 372-412.
33. Roach, N. W., Heron, J., & McGraw, P. V. (2006). Resolving multisensory conflict: A strategy for balancing the costs and benefits of audio-visual integration. Proceedings of the Royal Society of London B: Biological Sciences, 273, 2159-2168.
34. Shams, L., Kamitani, Y., & Shimojo, S. (2000). Illusions. What you see is what you hear. Nature, 408, 788.
35. Shams, L., Kamitani, Y., & Shimojo, S. (2002). Visual illusion induced by sound. Cognitive Brain Research, 14, 147-152.
36. Shams, L., Ma, W. J., & Beierholm, U. (2005). Sound-induced flash illusion as an optimal percept. Neuroreport, 16, 1923-1927.
37. Shore, D. I., & Simic, N. (2005). Integration of visual and tactile stimuli: Top-down influences require time. Experimental Brain Research, 166, 509-517.
38. Soto-Faraco, S., Navarra, J., & Alsius, A. (2004). Assessing automaticity in audiovisual speech integration: Evidence from the speeded classification task. Cognition & Emotion, 92, 13-23.
39. Spence, C., & Driver, J. (2000). Attracting attention to the illusory location of a sound: Reflexive cross-modal orienting and ventriloquism. Neuroreport, 11, 2057-2061.
40. Spence, C., Pavani, F., & Driver, J. (2004). Spatial constraints on visual-tactile cross-modal distractor congruency effects. Cognitive, Affective, and Behavioral Neuroscience, 4, 148-169.
41. Spence, C., & Walton, M. (2005). On the inability to ignore touch when responding to vision in the crossmodal congruency task. Acta Psychologica, 118, 47-70.
42. Stekelenburg, J. J., Vroomen, J., & de Gelder, B. (2004). Illusory sound shifts induced by the ventriloquist illusion evoke the mismatch negativity. Neuroscience Letters, 357, 163-166.
43. van Atteveldt, N., Formisano, E., Goebel, R., & Blomert, L. (2004). Integration of letters and speech sounds in the human brain. Neuron, 43, 271-282.
44. van Beers, R. J., Wolpert, D. M., & Haggard, P. (2002). When feeling is more important than seeing in sensor-imotor adaptation. Current Biology, 12, 834-837.
45. Vroomen, J., Bertelson, P., & de Gelder, & (2001a). The ventriloquist effect does not depend on the direction of automatic visual attention. Perception & Psychophysics, 63, 651-659.
46. Vroomen, J., Driver, J., & de Gelder, B. (2001b). Is cross-modal integration of emotional expressions independent of attentional resources? Cognitive, Affective, & Behavioral Neuroscience, 1, 382-387.
47. Warren, D. H., Welch, R. B., & McCarthy, T. J. (1981). The role of visual-auditory "compellingness" in the ventriloquism effect: Implications for transitivity among the spatial senses. Perception & Psychophysics, 30, 557-564.
48. Wichmann, F. A., & Hill, N. J. (2001). The psychometric function: I. fitting, sampling, and goodness of fit. Perception & Psychophysics, 63, 1293-1313.
49. Wickens, C. D. (1980). The structure of attentional resources. In R. Nickerson (Ed.), Attention and performance (vol. VIII, pp. 239-257). Hillsdale, NJ: Lawrence Erlbaum Associates.
50. Wickens, C. D. (1984). Processing resources in attention. In R. Parasuraman & R. Davies (Eds.), Varieties of attention (pp. 63-101). New York: Academic Press.
51. Yuille, A. L., & Bülthoff, H. H. (1996). Bayesian theory and psychophysics. In D. Knill & W. Richards (Eds.), Perception as Bayesian inference. Cambridge, MA: Cambridge University Press.