Cross-modal links among vision, audition, and touch in complex environments

Human Factors

Volumn 50, Issue 1, 2008, Pages 17-26

  Ferris, Thomas K ^a   Sarter, Nadine B ^a  

^a UNIVERSITY OF MICHIGAN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL COMPLEXITY; INTERFACES (COMPUTER); MODAL ANALYSIS;

CROSS-MODAL LINKS; DATA-RICH DOMAINS; TACTILE STIMULI;

BEHAVIORAL RESEARCH;

ADULT; ARTICLE; ASSOCIATION; AUDITORY STIMULATION; CROSS LINKING; DEPTH PERCEPTION; FEMALE; HEARING; HUMAN; HUMAN EXPERIMENT; LATENT PERIOD; MALE; NORMAL HUMAN; SIMULATION; STIMULUS RESPONSE; TACTILE STIMULATION; TASK PERFORMANCE; TOUCH; VISION; VISUAL STIMULATION;

AUDITORY PERCEPTION; CUES; HUMANS; MILITARY PERSONNEL; PSYCHOMOTOR PERFORMANCE; REACTION TIME; TOUCH; UNITED STATES; USER-COMPUTER INTERFACE; VISUAL PERCEPTION;

EID: 40449106687     PISSN: 00187208     EISSN: None     Source Type: Journal    
DOI: 10.1518/001872008X250566     Document Type: Article

References (34)

1. Blauert, J. (1997). Spatial hearing: The psychophysics of human sound localization. Cambridge, MA: MIT Press.
2. Driver, J., & Spence, C. (1998a). Attention and the crossmodal construction of space. Trends in Cognitive Science, 2, 254-262.
3. Driver, J., & Spence, C. (1998b). Cross-modal links in spatial attention. Philosophical Transactions of the Royal Society Series B, 353, 1319-1331.
4. Driver, J., & Spence, C. (2004). Crossmodal spatial attention: Evidence from human performance. In C. Spence & J. Driver (Eds.), Cross-modal space and crossmodal attention (pp. 179-220). New York: Oxford University Press.
5. Ernst, M. O., & Bülthoff, H. H. (2004). Merging the senses into a robust percept. Trends in Cognitive Science, 8, 162-169.
6. Frassinetti, F., Bolognini, N., & Làdavas, E. (2002). Enhancement of visual perception by crossmodal visuo-auditory interaction. Experimental Brain Research, 147, 332-343.
7. Gröhn, M., Lokki, T., & Takala, T. (2002). Static and dynamic sound source localization in a virtual room. In Proceedings of AES 22nd International Conference: Virtual, Synthetic, and Entertainment Audio (pp. 337-344). New York: Audio Engineering Society.
8. Kennett, S., Spence, C., & Driver, J. (2002). Visuo-tactile links in covert exogenous spatial attention remap across changes in unseen hand posture. Perception and Psychophysics, 64, 1083-1094.
9. Klein, R. M. (2000). Inhibition of return. Trends in Cognitive Sciences, 4, 138-147.
10. Levene, H. (1960). Robust tests for equality of variances. In I. Olkin, S. G. Ghurye, W. Hoeffding, W. G. Madow, & H. B. Mann (Eds.), Contributions to probability and statistics: Essays in honor of Harold Hotelling (pp. 278-292). Stanford, CA: Stanford University Press.
11. Mondor, T. A., & Zatorre, R. J. (1995). Shifting and focusing auditory spatial attention. Journal of Experimental Psychology: Human Perception and Performance, 21, 387-409.
12. Oviatt, S. (2003). Multimodal interfaces. In J. Jacko & A. Sears (Eds.), The human-computer interaction handbook: Fundamentals, evolving technologies and emerging applications (pp. 286-304). Mahwah, NJ: Erlbaum.
13. Raj, A. K., Kass, S. J., & Perry, J. F. (2000). Vibrotactile displays for improving spatial awareness. In Proceedings of the XIVth Triennial Congress of the International Ergonomics Association and 44th Annual Meeting of the Human Factors and Ergonomics Society (pp. 1.181-1.184). Santa Monica, CA: Human Factors and Ergonomics Society.
14. Reuter-Lorenz, P. A., Jha, A. P., & Rosenquist, J. N. (1996). What is inhibited in inhibition of return? Journal of Experimental Psychology: Human Perception and Performance, 22, 367-378.
15. Reuter-Lorenz, P. A., & Rosenquist, J. N. (1996). Auditory cues and inhibition of return: The importance of oculomotor activation. Experimental Brain Research, 112, 119-126.
16. Sarter, N. B. (2002). Multimodal information presentation in support of human-automation communication and coordination. In E. Salas (Ed.), Advances in human performance and cognitive engineering research (pp. 3 3-36). New York: JAI Press.
17. Sarter, N. B. (2006). Multimodal information presentation: Design guidance and research challenges. International Journal of Industrial Ergonomics, 36, 439-445.
18. Satterthwaite, F. E. (1946). An approximate distribution of estimates of variance components. Biometrics Bulletin, 2, 110-114.
19. Schmitt, M., Postma, A., & de Haan, E. (2001). Cross-modal exogenous attention and distance effects in vision and hearing. European Journal of Cognitive Psychology, 13, 343-368.
20. Simon, J. R. (1990). The effects of an irrelevant directional cue on human information processing. In R. W. Proctor & T. G. Reeve (Eds.), Stimulus-response compatibility: An integrated perspective (pp. 31-86). Amsterdam: North-Holland/Elsevier.
21. Simon, J. R., & Rudell, A. P. (1967). Auditory S-R compatibility: The effect of an irrelevant cue on information processing. Journal of Applied Psychology, 51, 300-304.
22. Spence, C. (2001). Crossmodal attentional capture: A controversy resolved? In C. L. Folk & B. S. Gibson (Eds.), Attraction, distraction, and action: Multiple perspectives on attentional capture (pp. 231-262). Amsterdam: Elsevier.
23. Spence, C., & Driver, J. (1997a). Audiovisual links in exogenous covert spatial orienting. Perception and Psychophysics, 59, 1-22.
24. Spence, C., & Driver, J. (1997b). Cross-modal links in attention between audition, vision, and touch: Implications for interface design. International Journal of Cognitive Ergonomics, 1, 351-373.
25. Spence, C., & Driver, J. (1998). Auditory and audiovisual inhibition of return. Perception and Psychophysics, 60, 125-139.
26. Spence, C., Lloyd, D., McGlone, F., Nicholls, M. E. R., & Driver, J. (2000). Inhibition of return is supramodal: A demonstration between all possible pairings of vision, touch, and audition. Experimental Brain Research, 134, 42-48.
27. Spence, C., McDonald, J., & Driver, J. (2004). Exogenous spatial-cuing studies of human cross-modal attention and multisensory integration. In C. Spence & J. Driver (Eds.), Crossmodal space and crossmodal attention (pp. 277-320). New York: Oxford University Press.
28. Spence, C., Nicholls, M. E. R., Gillespie, N., & Driver, J. (1998). Cross-modal links in exogenous covert spatial orienting between touch, audition, and vision. Perception and Psychophysics, 60, 544-557.
29. Tassinari, G., & Campara, D. (1996). Consequences of covert orienting to non-informative stimuli of different modalities: A unitary mechanism? Neuropsychologia, 34, 235-245.
30. van Erp, J. B. F., van Veen, H. A. H. C., Jansen, C., & Dobbins, T. (2005). Waypoint navigation with a vibrotactile waist belt. ACM Transactions on Applied Perception, 2, 106-117.
31. Ward, L. M. (1994). Supramodal and modality-specific mechanisms for stimulus-driven shifts of auditory and visual attention. Canadian Journal of Experimental Psychology, 48, 242-259.
32. Ward, L. M., McDonald, J. J., & Lin, D. (2000). On asymmetries in cross-modal spatial attention orienting. Perception and Psychophysics, 62, 1258-1264.
33. Wickens, C. D. (1980). The structure of attentional resources. In R. Nickerson (Ed.), Attention and performance VIII (pp. 239-257). Hillsdale, NJ: Erlbaum.
34. Wickens, C. D. (1984). Processing resources in attention. In R. Parasuraman & R. Davies (Eds.), Varieties of attention (pp. 63-101). New York: Academic Press.