Multisensory warning signals for event perception and safe driving

Theoretical Issues in Ergonomics Science

Volumn 9, Issue 6, 2008, Pages 523-554

  Spence, Charles ^a   Ho, Cristy ^a  

^a UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

Auditory icon; Cognitive neuroscience; Driving; Multisensory warning signal; Neuroergonomics; Spatial attention; Tactile displays

Indexed keywords

EID: 85010607529     PISSN: 1463922X     EISSN: 1464536X     Source Type: Journal    
DOI: 10.1080/14639220701816765     Document Type: Article

References (257)

1. Abe, G. and Richardson, J., 2004. The effect of alarm timing on driver behaviour: an investigation of differences in driver trust and response to alarms according to alarm timing. Transportation Research Part F: Traffic Psychology and Behaviour, 7, 307-322.
2. Abe, G. and Richardson, J., 2005. The influence of alarm timing on braking response and driver trust in low speed driving. Safety Science, 43, 639-654.
3. Abe, G. and Richardson, J., 2006. Alarm timing, trust and driver expectation for forward collision warning systems. Applied Ergonomics, 37, 577-586.
4. Akamatsu, M., MacKenzie, I.S., and Hasbroucq, T., 1995. A comparison of tactile, auditory, and visual feedback in a pointing task using a mouse-type device. Ergonomics, 38, 816-827.
5. Alm, H. and Nilsson, L., 1995. The effects of a mobile telephone task on driver behaviour in a car following situation. Accident Analysis and Prevention, 27, 707-715.
6. Arrabito, G.R., Mondor, T.A., and Kent, K.J., 2004. Judging the urgency of non-verbal auditory alarms: a case study. Ergonomics, 47, 821-849.
7. Ashley, S., 2001. Driving the info highway. Scientific American, 285 (4), 44-50.
8. Badia, P., et al., 1990. Responsiveness to olfactory stimuli presented in sleep. Physiology and Behavior, 48, 87-90.
9. Baker, R.A., Ware, J.R., and Sipowicz, R.R., 1962. Vigilance: a comparison in auditory, visual, and combined audio-visual tasks. Canadian Journal of Psychology, 16, 192-198.
10. Ballas, J.A., 1993. Common factors in the identification of an assortment of brief everyday sounds. Journal of Experimental Psychology: Human Perception and Performance, 19, 250-267.
11. Ballas, J.A., 1994. Delivery of information through sound. In: G. Kramer, ed. Auditory display: sonification, audification and auditory interfaces. Reading, MA: Addison-Wesley, 79-94.
12. Barbagli, F., et al., 2006. Haptic discrimination of force direction and the influence of visual information. ACM Transactions on Applied Perception, 3, 125-135.
13. Baron, R.A. and Kalsher, M.J., 1998. Effects of a pleasant ambient fragrance on simulated driving performance: the sweet smell of… safety? Environment and Behavior, 30, 535-552.
14. Begault, D.R., 1993. Head-up auditory displays for traffic collision avoidance system advisories: a preliminary investigation. Human Factors, 35, 707-717.
15. Begault, D.R., 1994. 3-D sound for virtual reality and multimedia. Cambridge, MA: Academic Press.
16. Begault, D.R. and Wenzel, E.M., 1990. Techniques and applications for binaural sound manipulation in human-machine interfaces. NASA Technical Memorandum No. 102279. Moffett Field, CA: NASA Ames Research Center.
17. Belz, S.M., Robinson, G.S., and Casali, J.G., 1999. A new class of auditory warning signals for complex systems: auditory icons. Human Factors, 41, 608-618.
18. Benali-Khoudja, M., et al., 2004. Tactile interfaces: a state-of-the-art survey. Proceedings of the 35th international symposium on robotics. ISR 2004, 23-26 March, Paris, 1-9.
19. Bergenheim, M., et al., 1996. Experimental evidence for a sensory synchronisation of sensory information to conscious experience. In: S.R. Hameroff, A.W. Kaszniak and A.S. Scott, eds. Toward a science of consciousness: the first Tucson discussions and debates. Cambridge, MA: MIT Press, 303-310.
20. Blattner, M.M., Sumikawa, D.A., and Greenberg, R.M., 1989. Earcons and icons: their structure and common design principles. Human-Computer Interaction, 4, 11-44.
21. Bliss, J.P., 1997. Alarm reaction patterns by pilots as a function of reaction modality. International Journal of Aviation Psychology, 7, 1-14.
22. Bliss, J.P. and Acton, S.A., 2003. Alarm mistrust in automobiles: how collision alarm reliability affects driving. Applied Ergonomics, 34, 499-509.
23. Bounds, W., 1996. Sounds and scents to jolt drowsy drivers. Wall Street Journal, 6 May, B1.
24. Brewster, S. and Brown, L.M., 2004. Tactons: structured tactile messages for non-visual information display. Proceedings of the 5th Australasian user interface conference (AUIC2004), 15-23.
25. Breznitz, S., 1984. Cry wolf: the psychology of false alarms. Hillsdale, NJ: Erlbaum.
26. Bristow, D., et al., 2005. Blinking suppresses the neural response to unchanging retinal stimulation. Current Biology, 15, 1296-1300.
27. Broadbent, D.E., 1958. Perception and communication. Elmsford, NJ: Pergamon.
28. Bronkhorst, A.W., Veltman, J.A., and van Breda, L., 1996. Application of a three-dimensional auditory display in flight task. Human Factors, 38, 23-33.
29. Brown, R.L., Galloway, W.D., and Gildersleeve, K.R., 1965. Effects of intense noise on processing of cutaneous information of varying complexity. Perceptual and Motor Skills, 20, 749-754.
30. Brown, S.B., 2005. Effects of haptic and auditory warnings on driver intersection behaviour and perception. Unpublished Master’s thesis. Department of Industrial and Systems Engineering, Virginia Tech.
31. Brown, S.B., et al., 2005. Effect of haptic brake pulse warnings on driver behavior during an intersection approach. Proceedings of the Human Factors and Ergonomics Society 49th annual meeting. Santa Monica, CA: HFES, 1892-1896.
32. Bruce, D., Boehm-Davis, D.A. and Mahach, K., 2000. In-vehicle auditory display of symbolic information. Proceedings of the IEA 2000/HFES 2000 congress, 3-230-3-233.
33. Burke, M.W., Gilson, R.D., and Jagacinski, R.J., 1980. Multi-modal information processing for visual workload relief. Ergonomics, 23, 961-975.
34. Burnett, G.E. and Joyner, S.M., 1997. An assessment of moving map and symbol-based route guidance systems. In: Y.I. Noy ed. Ergonomics and safety of intelligent driver interfaces. Mahwah, NJ: Lawrence Erlbaum, 115-137.
35. Burnett, G.E. and Porter, J.M., 2001. Ubiquitous computing within cars: designing controls for nonvisual use. International Journal of Human-Computer Studies, 55, 521-531.
36. Burrows, A.A., 1962. Choice response in quiet and loaded channels with verbal and non-verbal auditory stimuli. Human Factors, 4, 187-192.
37. Burt, J.L., et al., 1995. A psychophysiological evaluation of the perceived urgency of auditory warning signals. Ergonomics, 38, 2327-2340.
38. Cabrera, D., Ferguson, S., and Laing, G., 2005. Development of auditory alerts for air traffic control consoles. Audio Engineering Society, 119th convention, 1-21.
39. Calvert, G.A., Spence, C. and Stein, B.E., eds., 2004. The handbook of multisensory processes. Cambridge, MA: MIT Press.
40. Campbell, J.L., et al., 1996. Investigation of alternative displays for side collision avoidance systems. Report No. DOT HS 808 579. Seattle, WA: Battelle Human Factors Transportation Center.
41. Carskadon, M.A. and Herz, R.S., 2004. Minimal olfactory perception during sleep: why odor alarms will not work for humans. Sleep, 27, 402-405.
42. Catchpole, K.R., McKeown, J.D., and Withington, D.J., 2004. Localizable auditory warning pulses. Ergonomics, 47, 748-771.
43. Chambrin, M.-C., 2001. Alarms in the intensive care: how can the number of false alarms be reduced? Critical Care, 5, 184-188.
44. Chan, A.H.S. and Chan, K.W.L., 2006. Synchronous and asynchronous presentation of auditory and visual signals: implications for control console design. Applied Ergonomics, 37, 131-140.
45. Chen, D., Katdare, A., and Lucas, N., 2006. Chemosignals of fear enhance cognitive performance in humans. Chemical Senses, 31, 415-423.
46. Cnossen, F., Meijman, T., and Rothengatter, T., 2004. Adaptive strategy changes as a function of task demands: a study of car drivers. Ergonomics, 47, 218-236.
47. Cockburn, A. and Brewster, S., 2005. Multimodal feedback for the acquisition of small targets. Ergonomics, 48, 1129-1150.
48. Colonius, H. and Diederich, A., 2004. Multisensory interaction in saccadic reaction time: a time-window-of-integration model. Journal of Cognitive Neuroscience, 16, 1000-1009.
49. Deatherage, B.H., 1972. Auditory and other sensory forms of information presentation. In: H.P. Van Cott and R.G. Kinkade, eds. Human engineering guide to equipment design. New York: John Wiley and Sons, 123-160.
50. Dewar, R.E., 1988. In-vehicle information and driver overload. International Journal of Vehicle Design, 9, 557-564.
51. Dingus, T.A., et al., 1997. Effects of age, system experience, and navigation technique on driving with an advanced traveler information system. Human Factors, 39, 177-199.
52. Doll, T.J. and Folds, D.J., 1986. Auditory signals in military aircraft: ergonomic principles vs practice. Applied Ergonomics, 17, 257-264.
53. Dosey, M.A. and Meisels, M., 1969. Personal space and self-protection. Journal of Personal and Social Psychology, 11, 93-97.
54. Doyle, M.C. and Snowden, R.J., 1999. The effect of auditory warning signals on visual target identification. In: D. Harris, ed. Engineering psychology and cognitive ergonomics, Vol. 4: Job design, product design and human-computer interaction. Aldershot, UK: Ashgate, 245-251.
55. Driver, J., 2001. A selective review of selective attention research from the past century. British Journal of Psychology, 92, 53-78.
56. Driving Standards Agency, 2004. The highway code. London: Department for Transport.
57. Dukic, T., Hanson, L., and Falkmer, T., 2006. Effect of drivers’ age and push button locations on visual time off road, steering wheel deviation and safety perception. Ergonomics, 49, 78-92.
58. Edworthy, J. and Hellier, E., 2006. Complex nonverbal auditory signals and speech warnings. In: M.S. Wogalter, ed. Handbook of warnings. Mahwah, NJ: Lawrence Erlbaum, 199-220.
59. Edworthy, J., Loxley, S., and Dennis, I., 1991. Improving auditory warning design: relationship between warning sound parameters and perceived urgency. Human Factors, 33, 205-231.
60. Evans, L., 1991. Traffic safety and the driver. New York: Van Nostrand Reinhold.
61. Fairclough, S.H., Ashby, M.C., and Parkes, A.M., 1993. In-vehicle displays, visual workload and usability evaluation. In: A.G. Gale, I.D. Brown, C.M. Haslegrave, H.W. Kruysse and S.P. Taylor, eds. Vision in vehicles - IV. Amsterdam: Elsevier Science, 245-254.
62. Fastl, H., 2005. Psycho-acoustics and sound quality. In: J. Blauert, ed. Communication acoustics. New York: Springer-Verlag, 139-162.
63. Felipe, N.J. and Sommer, R., 1966. Invasions of personal space. Social Problems, 14, 206-214.
64. Fenton, R.E. and Montano, W.B., 1968. An intervehicular spacing display for improved car-following performance. IEEE Transactions on Man-Machine Systems, MMS-9, 29-35.
65. Fidell, S., 1982. Comments on Mulligan and Shaw’s ‘Multimodal signal detection: independent decisions vs integration’. Perception and Psychophysics, 31, 90.
66. Fidell, S. and Teffeteller, S., 1981. Scaling the annoyance of intrusive sounds. Journal of Sound and Vibration, 78, 291-298.
67. Fitch, G.M., et al., 2007. Toward developing an approach for alerting drivers to the direction of a crash threat. Human Factors, 49, 710-720.
68. Fitch, W.T. and Kramer, G., eds., 1994. Sonifying the body electric: superiority of an auditory over a visual display in a complex, multivariate system. Reading, MA: addison-Wesley.
69. Gaver, W.W., 1986. Auditory icons: using sound in computer interfaces. Human-Computer Interaction, 2, 167-177.
70. Gaver, W.W., 1989. The SonicFinder: an interface that uses auditory icons. Human-Computer Interaction, 4, 67-94.
71. Gaver, W.W., Smith, R.B. and O’Shea, T., 1991. Effective sounds in complex systems: the ARKOLA simulation. Proceedings of the SIGCHI conference on human factors in computing systems: reaching through technology, 85-90.
72. Geldard, F.A., 1960. Some neglected possibilities of communication. Science, 131, 1583-1588.
73. Geldard, F.A., 1961. Cutaneous channels of communication. In: W.A. Rosenblith, ed. Sensory communications. Cambridge, MA: MIT Press, 73-87.
74. Geldard, F.A. and Sherrick, C.E., 1965. Multiple cutaneous stimulation: the discrimination of vibratory patterns. Journal of the Acoustical Society of America, 37, 797-801.
75. Gepshtein, S., et al., 2005. The combination of vision and touch depends on spatial proximity. Journal of Vision, 5, 1013-1023.
76. Gibson, J.J. and Crooks, L.E., 1938. A theoretical field-analysis of automobile-driving. American Journal of Psychology, 51, 453-471.
77. Gilliland, K. and Schlegel, R.E., 1994. Tactile stimulation of the human head for information display. Human Factors, 36, 700-717.
78. Gilmer, B.v.H., 1961. Toward cutaneous electro-pulse communication. Journal of Psychology, 52, 211-222.
79. Godthelp, H. and Schumann, J., 1993. Intelligent accelerator: an element of driver support. In: A.M. Parkes and S. Franzen, eds. Driving future vehicles. London: Taylor & Francis, 265-274.
80. Graham, R., 1999. Use of auditory icons as emergency warnings: evaluation within a vehicle collision avoidance application. Ergonomics, 42, 1233-1248.
81. Grayhem, R., et al., 2005. Effects of odor administration on driving performance, safety, alertness, and fatigue. Poster presented at the 27th annual meeting of the Association for Chemoreception Sciences, Sarasota, FL.
82. Green, M., 2000. ‘How long does it take to stop?’ Methodological analysis of driver perception-brake times. Transportation Human Factors, 2, 195-216.
83. Gregg, L.W., 1960. Some coding problems in the design of a cutaneous communication channel. US Army Medical Research Report, 424, 85-102.
84. Guillaume, A., et al., 2003. Judging the urgency of nonvocal auditory warning signals: perceptual and cognitive processes. Journal of Experimental Psychology: Applied, 9, 196-212.
85. Haas, E.C. and Casali, J.G., 1995. Perceived urgency and response time to multi-tone and frequency-modulated warning signals in broadband noise. Ergonomics, 38, 2313-2326.
86. Haas, E.C. and Edworthy, J., 1996. Designing urgency into auditory warnings using pitch, speed and loudness. Computing and Control Engineering Journal, 7, 193-198.
87. Haas, M.W., 1995. Virtually-augmented interfaces for tactical aircraft. Biological Psychology, 40, 229-238.
88. Haigney, D. and Westerman, S.J., 2001. Mobile (cellular) phone use and driving: a critical review of research methodology. Ergonomics, 44, 132-143.
89. Hall, E.T., 1966. The hidden dimension: man’s use of space in public and private. London: Bodley Head.
90. Halliday, A.M. and Mingay, R., 1964. On the resolution of small time intervals and the effect of conduction delays on the judgement of simultaneity. Quarterly Journal of Experimental Psychology, 16, 35-46.
91. Harrar, V. and Harris, L.R., 2005. Simultaneity constancy: detecting events with touch and vision. Experimental Brain Research, 166, 465-473.
92. Hawkes, G.R. and Loeb, M., 1961. Vigilance for cutaneous and auditory signals. Journal of Auditory Research, 4, 272-284.
93. Hawkes, G.R. and Loeb, M., 1962. Vigilance for cutaneous and auditory stimuli as a function of intersignal interval and signal strength. Journal of Psychology, 53, 211-218.
94. Hediger, H., 1955. Studies of the psychology and behaviour of captive animals in zoos and circuses. New York: Criterion Books.
95. Hellier, E.J., Edworthy, J., and Dennis, I., 1993. Improving auditory warning design: quantifying and predicting the effects of different warning parameters on perceived urgency. Human Factors, 35, 693-706.
96. Hempel, T. and Altinsoy, E., 2005. Multimodal user interfaces: designing media for the auditory and the tactile channel. In: R.W. Proctor and K.P.L. Vu, eds. Handbook of human factors in web design. Mahwah, NJ: Lawrence Erlbaum, 134-155.
97. Hennessy, J.R., 1966. Cutaneous sensitivity communications. Human Factors, 8, 463-469.
98. Hills, B.L., 1980. Vision, visibility, and perception in driving. Perception, 9, 183-216.
99. Hirsch, J., 1974. Rate control in man-machine systems. In: F.A. Geldard, ed. Cutaneous communication systems as devices. Austin, TX: Psychonomic Society, 65-72.
100. Hirst, S. and Graham, R., 1997. The format and presentation of collision warnings. In: Y.I. Noy, ed. Ergonomics and safety of intelligent driver interfaces. Mahwah, NJ: Lawrence Erlbaum, 203-219.
101. Ho, C., 2006. Multisensory aspects of the spatial cuing of driver attention. Unpublished doctoral dissertation. Department of Experimental Psychology, University of Oxford, UK.
102. Ho, C., Reed, N., and Spence, C., 2006a. Assessing the effectiveness of ‘intuitive’ vibrotactile warning signals in preventing front-to-rear-end collisions in a driving simulator. Accident Analysis and Prevention, 38, 989-996.
103. Ho, C., Reed, N., and Spence, C., 2007. Multisensory in-car warning signals for collision avoidance. Human Factors, 49, 1107-1114.
104. Ho, C., Santangelo, V. and Spence, C., submitted. Multisensory warning signals: when spatial location matters. Journal of Experimental Psychology: Applied.
105. Ho, C. and Spence, C., 2005a. Assessing the effectiveness of various auditory cues in capturing a driver’s visual attention. Journal of Experimental Psychology: Applied, 11, 157-174.
106. Ho, C. and Spence, C., 2005b. Olfactory facilitation of dual-task performance. Neuroscience Letters, 389, 35-40.
107. Ho, C. and Spence, C., 2006. Verbal interface design: do verbal directional cues automatically orient visual spatial attention? Computers in Human Behavior, 22, 733-748.
108. Ho, C. and Spence, C., 2007. Head orientation biases tactile localization. Brain Research, 1144C, 136-141.
109. Ho, C. and Spence, C., in press. The multisensory driver: implications for ergonomic car interface design. Aldershot: Ashgate.
110. Ho, C., Spence, C. and Tan, H.Z., 2005a. Warning signals go multisensory. Proceedings of HCI International 2005, 9, Paper No. 2284, 1-10.
111. Ho, C., Tan, H.Z., and Spence, C., 2005b. Using spatial vibrotactile cues to direct visual attention in driving scenes. Transportation Research Part F: Traffic Psychology and Behaviour, 8, 397-412.
112. Ho, C., Tan, H.Z., and Spence, C., 2006b. The differential effect of vibrotactile and auditory cues on visual spatial attention. Ergonomics, 49, 724-738.
113. Holmes, N.P. and Spence, C., 2005. Multisensory integration: space, time, and superadditivity. Current Biology, 15, R762-R764.
114. Horowitz, A.D. and Dingus, T.A., 1992. Warning signal design: a key human factors issue in an in-vehicle front-to-rear-end collision warning system. Proceedings of the Human Factors and Ergonomics Society 36th annual meeting. Santa Monica, CA: HFES, 1011-1013.
115. Horowitz, M.J., Duff, D.F., and Stratton, L.O., 1964. Body-buffer zone: exploration of personal space. Archive of General Psychiatry, 11, 651-656.
116. Howell, W.C. and Briggs, G.E., 1959. An initial evaluation of a vibrotactile display in complex control tasks. Tech. Rep. No. (813)-6. Columbus, OH: the Ohio State University Research Foundation.
117. Hughes, P.K. and Cole, B.L., 1986. What attracts attention when driving? Ergonomics, 29, 377-391.
118. Humphrey, C.E., 1952. Auditory displays: I. Spatial orientation by means of auditory signals - an exploratory study. Report No. APL/JHU-TG-122. Silver Spring, Maryland: applied Physics Laboratory, The Johns Hopkins University.
119. Hunter, W.W., Bundy, H.L., and Daniel, R.B., 1976. An assessment of the effectiveness of the following-too-closely monitor. Chapel Hill, NC: University of North Carolina: Highway Safety Research Center.
120. Jagacinski, R.J., Miller, D.P., and Gilson, R.D., 1979. A comparison of kinesthetic-tactual and visual displays via a critical tracking task. Human Factors, 21, 79-86.
121. Janssen, W. and Nilsson, L., 1993. Behavioural effects of driver support. In: A.M. Parkes and S. Franzen, eds. Driving future vehicles. London: Taylor & Francis, 147-155.
122. Janssen, W.H. and Thomas, H., 1997. In-vehicle collision avoidance support under adverse visibility conditions. In: Y.I. Noy, ed. Ergonomics and safety of intelligent driver interfaces. Mahwah, NJ: Lawrence Erlbaum, 221-229.
123. Johansson, G. and Rumar, K., 1971. Drivers’ brake reaction times. Human Factors, 13, 23-27.
124. Johnson, T.L. and Shapiro, K.L., 1989. Attention to auditory and peripheral visual stimuli: effects of arousal and predictability. Acta Psychologica, 72, 233-245.
125. Jones, D., 1989. The sonic interface. In: M.J. Smith and G. Salvendy, eds. Work with computers: organizational, management, stress and health aspects. Amsterdam: Elsevier, 382-388.
126. Jordan, P.W. and Johnson, G.I., 1993. Exploring mental workload via TLX: the case of operating a car stereo while driving. In: A.G. Gale, I.D. Brown, C.M. Haslegrave, H.W. Kruysse and S.P. Taylor, eds. Vision in vehicles - IV. Amsterdam: Elsevier Science, 255-262.
127. Jordan, T.C., 1972. Characteristics of visual and proprioceptive response times in the learning of a motor skill. Quarterly Journal of Experimental Psychology, 24, 536-543.
128. Kadunce, D.C., et al., 1997. Mechanisms of within- and cross-modality suppression in the superior colliculus. Journal of Neurophysiology, 78, 2834-2847.
129. Kantowitz, B.H., Triggs, T.J., and Barnes, V., 1990. Stimulus-response compatibility and human factors. In: R.W. Proctor and T.G. Reeve, eds. Stimulus-response compatibility: an integrated perspective. Amsterdam: North-Holland, 365-388.
130. Kappauf, W.E. and Powe, W.E., 1959. Performance decrement on an audio-visual checking task. Journal of Experimental Psychology, 57, 49-56.
131. Keller, P. and Stevens, C., 2004. Meaning from environmental sounds: types of signal-referent relations and their effect on recognizing auditory icons. Journal of Experimental Psychology: Applied, 10, 3-12.
132. Kemeny, A. and Panerai, F., 2003. Evaluating perception in driving simulation experiments. Trends in Cognitive Sciences, 7, 31-37.
133. Kenny, T., et al., 2004. Integrated vehicle instrument simulations - i-ViS initial design philosophy. Imeche 2004, 93-102.
134. King, R.A. and Corso, G.M., 1993. Auditory displays: if they are so useful, why are they turned off? Proceedings of the Human Factors and Ergonomics Society 37th annual meeting. Santa Monica, CA: HFES, 549-553.
135. Kitagawa, N. and Spence, C., 2006. Audiotactile multisensory interactions in human information processing. Japanese Psychological Research, 48, 158-173.
136. Kitagawa, N., Zampini, M., and Spence, C., 2005. Audiotactile interactions in near and far space. Experimental Brain Research, 166, 528-537.
137. Korteling, J.E., 1990. Perception-response speed and driving capabilities of brain-damaged and older drivers. Human Factors, 32, 95-108.
138. Krishnan, H., et al., 2001. Rear-end collision warning system: design and evaluation via simulation. Transportation Research Record, 1759, 52-60.
139. Kume, Y., et al., 1998. Information transmission through soles by vibro-tactile stimulation. Transactions of the Virtual Reality Society of Japan, 3, 83-88.
140. Lansdown, T., Brook-Carter, N., and Kersloot, T., 2004. Distraction from multiple in-vehicle secondary tasks: vehicle performance and mental workload implications. Ergonomics, 47, 91-104.
141. Laurienti, P.J., et al., 2004. Semantic congruence is a critical factor in multisensory behavioral performance. Experimental Brain Research, 158, 405-414.
142. Laurienti, P.J., et al., 2006. Enhanced multisensory integration in older adults. Neurobiology of Aging, 27, 1155-1163.
143. Lazarus, H. and Hoge, H., 1986. Industrial safety: acoustic signals for danger situations in factories. Applied Ergonomics, 17, 41-46.
144. Lee, J.D., Gore, B.F., and Campbell, J.L., 1999. Display alternatives for in-vehicle warning and sign information: message style, location, and modality. Transportation Human Factors, 1, 347-375.
145. Lee, J.D., Hoffman, J.D., and Hayes, E., 2004. Collision warning design to mitigate driver distraction. Chi 2004, 6, 65-72.
146. Lee, J.D., et al., 2001. Speech-based interaction with in-vehicle computers: the effect of speech-based e-mail on drivers’ attention to the roadway. Human Factors, 43, 631-640.
147. Lee, J.D., et al., 2006. Effects of adaptive cruise control and alert modality on driver performance. Transportation Research Record, 1980, 49-56.
148. Lindeman, R.W. and Yanagida, Y., 2003. Empirical studies for effective near-field haptics in virtual environments. Proceedings of the IEEE Virtual Reality, 287-288.
149. Lindeman, R.W., et al., (2003). Effective vibrotactile cueing in a visual search task. Proceedings of the 9th IFIP TC13 international conference on human-computer interaction (INTERACT 2003), 89-96.
150. Liu, Y.-C., 2001. Comparative study of the effects of auditory, visual and multimodal displays on drivers’ performance in advanced traveller information systems. Ergonomics, 44, 425-442.
151. Loomis, J.M. and Beall, A.C., 1998. Visually controlled locomotion: its dependence on optic flow, three-dimensional space perception, and cognition. Ecological Psychology, 10, 271-285.
152. Lucas, P.A., 1995. An evaluation of the communicative ability of auditory icons and earcons. Proceeding of the 2nd international conference on auditory display ICAD’94, 121-128.
153. Luo, R.C. and Kay, M.G., 1989. Multisensor integration and fusion in intelligent systems. IEEE Transactions on Systems, Man, and Cybernetics, 19, 901-931.
154. McAdams, S., 1993. Recognition of sound sources and events. In: S. McAdams and E. Bigand, eds. Thinking in sound: the cognitive psychology of human audition. Oxford: Clarendon Press, 146-198.
155. McGehee, D.V., Mazzae, E.N., and Baldwin, G.H.S., 2000. Driver reaction time in crash avoidance research: validation of a driving simulator study on a test track. Proceedings of the IEA 2000/ HFES 2000 congress, 3, 320-323.
156. McGehee, D.V. and Raby, M., 2003. The design and evaluation of snowplow lane awareness system. HF-PPC 2003-1. Iowa City: University of Iowa Public Policy Center.
157. McGehee, D.V., et al., 2002. The effect of warning timing on collision avoidance behavior in a stationary lead vehicle scenario. Human performance: models, intelligent vehicle initiative, traveller advisory and information systems. Washington, DC: Transportation Research Board, 1-7.
158. McKeown, J.D., 2005. Candidates for within-vehicle auditory displays. Proceedings of ICAD 05 -eleventh meeting of the international conference on auditory display, 182-189.
159. McKeown, J.D. and Isherwood, S., 2007. Mapping the urgency and pleasantness of speech, auditory icons, and abstract alarms to their referents within the vehicle. Human Factors, 49, 417-428.
160. McLane, R.C. and Wierwille, W.W., 1975. The influence of motion and audio cues on driver performance in an automobile simulator. Human Factors, 17, 488-501.
161. Makhsous, M., et al., 2005. Reducing whole-body vibration and musculoskeletal injury with a new car seat design. Ergonomics, 48, 1183-1199.
162. Mariani, M., 2001. COMUNICAR: designing multimodal interaction for advanced in-vehicle interfaces. Proceedings of the human factors in transportation, communication, health, and the workplace, Human Factors and Ergonomics Society Europe chapter annual meeting, 113-120.
163. Mather, G., 2004. Perceptual and cognitive limits on driver information processing. Imeche, 2004, 85-92.
164. Menning, H., et al., 2005. Spatial auditory attention is modulated by tactile priming. Experimental Brain Research, 164, 41-47.
165. Miller, J., 1982. Divided attention: evidence for coactivation with redundant signals. Cognitive Psychology, 14, 247-279.
166. Mollenhauer, M., et al., 1994. The effects of sensory modality and information priority on in-vehicle signing and information systems. Proceedings of the 38th annual meeting of the Human Factors and Ergonomics Society. Santa Monica, CA: HFES, 1072-1077.
167. Mordkoff, J.T. and Egeth, H.E., 1993. Response time and accuracy revisited: converging support for the interactive race model. Journal of Experimental Psychology: Human Perception and Performance, 19, 981-991.
168. Mowbray, G.H. and Gebhard, J.W., 1961. Man’s senses as informational channels. In: H.W. Sinaiko, ed. Selected papers on human factors in the design and use of control systems. New York: Dover, 115-149.
169. Munns, M., 1971. Ways to alarm pilots. Aerospace Medicine, 42, 731-734.
170. Nagel, S.K., et al., 2005. Beyond sensory substitution - learning the sixth sense. Journal of Neural Engineering, 2, R13-R26.
171. Nelson, R.J., McCandlish, C.A., and Douglas, V.D., 1990. Reaction times for hand movements made in response to visual versus vibratory cues. Somatosensory and Motor Research, 7, 337-352.
172. Nicolas, S., 1997. On the speed of different senses and nerve transmission by Hirsch 1862. Psychological Research, 59, 261-268.
173. Nissan, N., 2006, April 20. IC tag child protection test results released - drivers find service useful in alerting them to children in the vicinity. Available from: http://www.nissan-global.com/EN/NEWS/2006/_STORY/060420-02-e.html [Accessed 28 April 2006].
174. Ohita, H. and Komatsu, H., 1991. Speed perception in driving - comparison with TV observation. In: A.G. Gale, ed. Vision in vehicles III. Amsterdam: Elsevier, 415-426.
175. Oyer, J. and Hardick, J., 1963. Response of population to optimum warning signal. Final Report No. SHSLR163. Washington, DC: Office of Civil Defence.
176. Paillard, J., 1993. The hand and the tool: the functional architecture of human technical skills. In: A. Berthelet and J. Chavaillon, eds. The use of tools by human and non-human primates. New York: Oxford University Press, 34-46.
177. Parasuraman, R., Hancock, P.A., and Olofinboba, O., 1997. Alarm effectiveness in driver-centred collision-warning systems. Ergonomics, 40, 390-399.
178. Partan, S. and Marler, P., 1999. Communication goes multimodal. Science, 283, 1272-1273.
179. Patten, C.J.D., et al., 2004. Using mobile telephones: cognitive workload and attention resource allocation. Accident Analysis and Prevention, 36, 341-350.
180. Poppel, E., 1988. Mindworks: time and conscious experience. Boston: Harcourt.
181. Posner, M.I., Nissen, M.J., and Klein, R.M., 1976. Visual dominance: an information-processing account of its origins and significance. Psychological Review, 83, 157-171.
182. Prehn, A., et al., 2006. Chemosensory anxiety signals augment the startle reflex in humans. Neuroscience Letters, 394, 127-130.
183. Previc, F.H., 1998. The neuropsychology of 3-D space. Psychological Bulletin, 124, 123-164.
184. Previc, F.H., 2000. Neuropsychological guidelines for aircraft control stations. IEEE Engineering in Medicine and Biology Magazine, 19, 81-88.
185. Proctor, R.W., et al., 2005. Implications of compatibility and cuing effects for multimodal interfaces. Proceedings of HCI International 2005, 11, Paper No. 2733, 1-10.
186. RAC Foundation, 2005, 3 June. The scent of danger. Available from: http://www.racfoundation.org/releases/030605rac.htm [Accessed 4 June 2005].
187. Ramsey, K.L. and Simmons, F.B., 1993. High-powered automobile stereos. Otolaryngology head and neck surgery, 109, 108-110.
188. Reed, M.P. and Green, P.A., 1999. Comparison of driving performance on-road and in a low-cost simulator using a concurrent telephone dialling task. Ergonomics, 42, 1015-1037.
189. Riddoch, G., 1941. Phantom limbs and body shape. Brain, 64, 197-222.
190. Rinspeed, R., undated. 'Senso’- the car that senses the driver. Available from: http://www.rinspeed.com/pages/cars/senso/pre-senso.htm [Accessed 30 May 2005].
191. Rizzolatti, G., et al., 1997. The space around us. Science, 277, 190-191.
192. Rockwell, T.H., 1972. Eye movement analysis of visual information acquisition in driving - an overview. Proceedings of the 6th Conference of the Australian Road Research Board, 6, 316-331.
193. Rockwell, T.H., 1988. Spare visual capacity in driving - revisited: new empirical results for an old idea. In: A.G. Gale, M.H. Freeman, C.M. Haslegrave, P. Smith and S.P. Taylor, eds. Vision in vehicles II. Amsterdam: Elsevier Science, 317-324.
194. Rodway, P., 2005. The modality shift effect and the effectiveness of warning signals in different modalities. Acta Psychologica, 120, 199-226.
195. Rumar, K., 1990. The basic driver error: late detection. Ergonomics, 33, 1281-1290.
196. Rupert, A.H., 2000. An instrumentation solution for reducing spatial disorientation mishaps. IEEE Engineering in Medicine and Biology Magazine, 19, 71-80.
197. Sanders, M.S. and McCormick, E.J., 1993. Human factors in engineering and design. 7th ed. New York: McGraw-Hill.
198. Santangelo, V., Belardinelli, M.O., and Spence, C., 2007. The suppression of reflexive visual and auditory orienting when attention is otherwise engaged. Journal of Experimental Psychology: Human Perception and Performance, 33, 137-148.
199. Santangelo, V., Ho, C. and Spence, C., 2008. Capturing spatial attention with multisensory cues. Psychonomic Bulletin and Review, 15, 398-403.
200. Santangelo, V. and Spence, C., 2007a. Assessing the automaticity of reflexive tactile attentional orienting. Perception, 36, 1497-1505.
201. Santangelo, V. and Spence, C., 2007b. Multisensory cues capture spatial attention regardless of perceptual load. Journal ofExperimental Psychology: Human Perception and Performance, 33, 1311-1321.
202. Sarter, N., Ferris, T., and Hameed, S., 2006. Performance effects of crossmodal links in attention: do they scale to complex environments? Paper presented at the 7th annual meeting of the International Multisensory Research Forum, Dublin, Ireland.
203. Schuler, A. and Raudenbush, B., 2005. Effects of intermittent peppermint odor administration on alertness, mood, mobility, and sleep patterns. Poster presented at the 27th annual meeting of the Association for Chemoreception Sciences, Sarasota, FL.
204. Schumann, J. and Naab, K., 1992. On the effectiveness of an active steering wheel in critical driving situations - a proving ground experiment. Proceedings of the conference on road safety in Europe, 194-208.
205. Schumann, J., et al., 1993. Breaking up open-loop steering control actions the steering wheel as an active control device. In: A.G. Gale, I.D. Brown, C.M. Haslegrave, H.W. Kruysse and S.P. Taylor, eds. Vision in vehicles - IV. Amsterdam: Elsevier Science, 321-332.
206. Selcon, S.J., Taylor, R.M., and McKenna, F.P., 1995. Integrating multiple information sources: using redundancy in the design of warnings. Ergonomics, 38, 2362-2370.
207. Selcon, S.J., Taylor, R.M., and Shadrake, R.A., 1991. Giving the pilot two sources of information: help or hindrance. In: E. Farmer, ed. Human resource management in aviation. Aldershot, UK: Avebury Technical, 139-148.
208. Shinar, D., 1978. Psychology on the road: the human factor in traffic safety. New York: Wiley.
209. Simpson, C.A. and Williams, D.H., 1980. Response time effects of alerting tone and semantic context for synthesized voice cockpit warnings. Human Factors, 22, 319-330.
210. Simpson, C.A., et al., 1987. Speech controls and displays. In: G. Salvendy, ed. Handbook of human factors. New York: Wiley, 1490-1525.
211. Sivak, M., 1996. The information that drivers use: is it indeed 90% visual? Perception, 25, 1081-1090.
212. Sklar, A.E. and Sarter, N.B., 1999. Good vibrations: tactile feedback in support of attention allocation and human-automation coordination in event-driven domains. Human Factors, 41, 543-552.
213. Sommer, R., 1959. Studies in personal space. Sociometry, 22, 247-260.
214. Sorkin, R.D., 1987. Design of auditory and tactile displays. In: G. Salvendy, ed. Handbook of human factors. New York: Wiley, 549-576.
215. Sorkin, R.D., 1988. Why are people turning off our alarms? Journal of the Acoustical Society of America, 84, 1107-1108.
216. Sorkin, R.D. and Woods, D.D., 1985. Systems with human monitors: a signal detection analysis. Human-Computer Interaction, 1, 49-75.
217. Sound Alert Technology, undated. Directional sound in aircraft. Available from: http://www.soundalert.com/pdfs/localizer_aviation.pdf [Accessed 2 December 2005].
218. Spence, C., 2001. Crossmodal attentional capture: a controversy resolved?. In: C.L. Folk and B.S. Gibson, eds. Attraction, distraction and action: multiple perspectives on attentional capture. Amsterdam: Elsevier Science, 231-262.
219. Spence, C. and Driver, J., 1997a. Audiovisual links in exogenous covert spatial orienting. Perception and Psychophysics, 59, 1-22.
220. Spence, C. and Driver, J., 1997b. Cross-modal links in attention between audition, vision, and touch: implications for interface design. International Journal of Cognitive Ergonomics, 1, 351-373.
221. Spence, C. and Driver, J., 1999. A new approach to the design of multimodal warning signals. In: D. Harris, ed. Engineering psychology and cognitive ergonomics, Vol. 4: Job design, product design and human-computer interaction. Aldershot, UK: Ashgate, 455-461.
222. Spence, C. and Driver, J., eds., 2004. Crossmodal space and crossmodal attention. Oxford: Oxford University Press.
223. Spence, C., McDonald, J., and Driver, J., 2004. Exogenous spatial cuing studies of human crossmodal attention and multisensory integration. In: C. Spence and J. Driver, eds. Crossmodal space and crossmodal attention. Oxford: Oxford University Press, 277-320.
224. Spence, C., Nicholls, M.E.R., and Driver, J., 2001. The cost of expecting events in the wrong sensory modality. Perception and Psychophysics, 63, 330-336.
225. Spence, C. and Read, L., 2003. Speech shadowing while driving: on the difficulty of splitting attention between eye and ear. Psychological Science, 14, 251-256.
226. Spence, C. and Squire, S., 2003. Multisensory integration: Maintaining the perception of synchrony. Current Biology, 13, R519-R521.
227. Stanton, N. and Edworthy, J., 1999. Human factors in auditory warnings. Aldershot, UK: Ashgate.
228. Steele, M. and Gillespie, B., 2001. Shared control between human and machine: using a haptic steering wheel to aid in land vehicle guidance. Proceedings of the Human Factors and Ergonomics Society 45th annual meeting. Santa Monica, CA: HFES, 1671-1675.
229. Stein, B.E. and Meredith, M.A., 1993. The merging of the senses. Cambridge, MA: MIT Press.
230. Stokes, A., Wickens, C., and Kite, K., 1990. Display technology: human factors concepts. Warrendale, PA: Society of Automotive Engineers.
231. Strayer, D.L., Drews, F.A., and Johnston, W.A., 2003. Cell phone-induced failures of visual attention during simulated driving. Journal of Experimental Psychology: Applied, 9, 23-32.
232. Strayer, D.L. and Johnston, W.A., 2001. Driven to distraction: dual-task studies of simulated driving and conversing on a cellular telephone. Psychological Science, 12, 462-466.
233. Suetomi, T. and Kido, K., 1997. Driver behavior under a collision warning system - a driving simulator study. SAE Technical Publication, No. 970279, 1242, 75-81.
234. Summala, H., Lamble, D., and Laakso, M., 1998. Driving experience and perception of the lead car’s braking when looking at in-car targets. Accident Analysis and Prevention, 30, 401-407.
235. Sussman, E.D., et al., 1985. Driver inattention and highway safety. Transportation Research Record, 1047, 40-48.
236. Svensson, M.S. and Tap, H., 2003. Alarms - localization, orientation and recognition. International Journal of Human-Computer Interaction, 15, 51-66.
237. Tijerina, L., et al., 2000. Preliminary studies in haptic displays for rear-end collision avoidance system and adaptive cruise control system applications. Report No. DOT HS 808 (TBD). Washington, DC: National Highway Transportation Safety Administration.
238. Todd, J.W., 1912. Reaction to multiple stimuli. New York: Science Press.
239. Treat, J.R., et al., 1977. Tri-level study of the causes of traffic accidents. Vol. 1: Causal factor tabulations and assessments. Vol. 2: Special analyses. Final Report on US Department of Transportation. Contract No. DOT-HS-034-3-535-770. Washington, DC: US Government Printing Office.
240. Triggs, T.J., Lewison, W.H., and Sanneman, R., 1974. Some experiments with flight-related electrocutaneous and vibrotactile displays. In: F.A. Geldard, ed. Cutaneous communication systems as devices. Austin, TX: Psychonomic Society, 57-64.
241. Van der Lubbe, R.H.J. and Postma, A., 2005. Interruption from auditory and visual onsets even when attention is in a focused state. Experimental Brain Research, 164, 464-471.
242. Van Egmond, R., 2004. Emotional experience of frequency modulated sounds: implications for the design of alarm sounds. In: D. de Waard, K.A. Brookhuis and C.M. Weikert, eds. Human factors in design. Maastricht, The Netherlands: Shaker Publishing, 345-356.
243. Van Erp, J.B.F., 2005. Presenting directions with a vibrotactile torso display. Ergonomics, 48, 302-313.
244. Van Erp, J.B.F., and van Veen, H.A.H.C., 2001. Vibro-tactile information processing in automobiles. Proceedings of EuroHaptics 2001, 99-104.
245. Van Erp, J.B.F. and van Veen, H.A.H.C., 2004. Vibrotactile in-vehicle navigation system. Transportation Research Part F: Traffic Psychology and Behavior, 7, 247-256.
246. Van Winsum, W., Martens, M. and Herland, L., 1999. The effects of speech versus tactile driver support messages on workload, driver behaviour and user acceptance. TNO-Report No. TM-99-C043. Soesterberg, The Netherlands: tNO Human Factors Research Institute.
247. Veitengruber, J.E., 1978. Design criteria for aircraft warning, caution, and advisory alerting systems. Journal of Aircraf t, 15, 574-581.
248. Vitense, H.S., Jacko, J.A., and Emery, V.K., 2003. Multimodal feedback: an assessment of performance and mental workload. Ergonomics, 46, 68-87.
249. Von Bekesy, G., 1963. Interaction of paired sensory stimuli and conduction in peripheral nerves. Journal of Applied Physiology, 18, 1276-1284.
250. Wang, D.D., Proctor, R.W., and Pick, D.F., 2003. Stimulus-response compatibility effects for warning signals and steering responses. Proceedings of the 2nd international driving symposium on human factors in driver assessment, training and vehicle design, 226-230.
251. Wang, J.-S., Knipling, R.R., and Goodman, M.J., 1996. The role of driver inattention in crashes: new statistics from the 1995 crashworthiness data system. 40th annual proceedings of the Association for the Advancement of Automotive Medicine. 377-392.
252. Ward, L.M., McDonald, J.J., and Golestani, N., 1998. Cross-modal control of attention shifts. In: R.D. Wright, ed. Visual attention. New York: Oxford University Press, 232-268.
253. Washburn, D.A., et al., 2003. Olfactory use in virtual environment training. Modeling and Simulation Magazine, 2 (3), 19-25.
254. Wiener, E.L., 1977. Controlled flight into terrain accidents: system-induced errors. Human Factors, 19, 171-181.
255. Wilkins, P.A. and Acton, W.I., 1982. Noise and accidents - a review. Annals of Occupational Hygiene, 25, 249-260.
256. Zaidel, D.M., Paarlberg, W.T., and Shinar, D., 1978. Driver performance and individual differences in attention and information processing. Report No. DOT-HS-803 793. Bloomington, IN: Institute for Research in Public Safety, Indiana University.
257. Zampini, M., et al., 2007. Audiotactile multisensory interactions in front and rear space. Neuropsychologia, 45, 1869-1877.