Multimodal warnings to enhance risk communication and safety

Safety Science

Volumn 61, Issue , 2014, Pages 29-35

  Haas, Ellen C ^a   Van Erp, Jan B F ^b  

^a U S ARMY RESEARCH LABORATORY   (United States)

^b TNO   (Netherlands)

Author keywords

Auditory warnings; Multimodal displays; Risk communication; Safety; Tactile warnings

Indexed keywords

AUDITORY WARNING; DISPLAY DESIGNS; MULTI-MODAL DISPLAYS; RISK COMMUNICATION; SAFETY INFORMATION; TACTILE WARNINGS; USER PERFORMANCE; VISUAL PERCEPTION;

ACCIDENT PREVENTION; COMMUNICATION;

SAFETY ENGINEERING;

ARTICLE; ASSOCIATION; ATTENTION; AUDITORY FEEDBACK; AUDITORY WARNING; DANGER, RISK, SAFETY AND RELATED PHENOMENA; DISPLAY SYSTEM; HEARING; INFORMATION DISSEMINATION; INTERPERSONAL COMMUNICATION; MENTAL LOAD; PRIORITY JOURNAL; RESPONSE TIME; RISK COMMUNICATION; SAFETY; TACTILE WARNING; TASK PERFORMANCE; TOUCH; VISION; VISUAL FEEDBACK;

EID: 84887015680     PISSN: 09257535     EISSN: 18791042     Source Type: Journal    
DOI: 10.1016/j.ssci.2013.07.011     Document Type: Article

References (69)

1. Abita J.L., Stanford R.L., Carkhuff B.G. Alarm system for blind and visually impaired individuals, U.S. Patent No. 5838238 1998, U.S. Patent and Trademark Office, Washington, DC.
2. Baldwin C.L., Eisert J.L., Garcia A., Lewis B., Pratt S.M., Gonzalez C. Multimodal urgency coding: auditory, visual, and tactile parameters and their impact on perceived urgency. Work: A Journal of Prevention, Assessment and Rehabilitation 2012, 41:3586-3591.
3. Brewster, S.A., Brown, L.M., 2004. Tactons: structured tactile messages for non-visual information display. In: Cockburn, A., (Ed.), Conferences in research and Practice in Information Technology.
4. Brown, L.M., Brewster, S.A., Purchase, H.C., 2006. Multidimensional tactons for non-visual information presentation in mobile devices. In: Proceedings of MobileHCI'06, pp. 231-238.
5. Burke J.L., Prewett M.S., Gray A.A., Yang L., Stilson F.R., Coovert M.D., Elliot L.R., Redden E. Comparing the effects of visual-auditory and visual-tactile feedback on user performance: a meta-analysis. Proceedings of the 8th International Conference on Multimodal Interfaces 2006, 108-117. ACM, New York, NY, USA.
6. Calhoun G.L., Draper M.H., Ruff H.A., Fontejon J.V., Guilfoos B. Evaluation of tactile alerts for control station operation. Proceedings of the Human Factors and Ergonomic Society 47th Annual Meeting 2003, 2118-2122. Human Factors and Ergonomic Society, Santa Monica, CA.
7. De Vries S.C., Van Erp J.B.F., Kiefer R.J. Direction coding using a tactile chair. Applied Ergonomics 2009, 40(3):477-484.
8. Deatherage B.H. Auditory and other sensory forms of information presentation. Human Engineering Guide to Equipment Design (rev. ed) 1972, 123-166. U.S. Government Printing Office, Washington DC. H.P. Van Cott, R.G. Kinkade (Eds.).
9. Doll T.J., Folds D.J. Auditory signals in military aircraft: ergonomics principles versus practice. Applied Ergonomics 1986, 17(4):257-264.
10. Durlach N.I., Colburn H.S. Binaural phenomenon. Handbook of Perception Hearing 1978, vol. IV. Academic Press, New York.
11. Edworthy J. Improving auditory warning design: relationship between warning sound parameters and perceived urgency. Human Factors 1991, 33:205-232.
12. Edworthy J. The semantic associations of acoustic parameters commonly used in the design of auditory information. Ergonomics 1992, 2341-2361.
13. Edworthy J., Hellier E. Complex nonverbal auditory signals and speech warnings. Handbook of Warnings 2006, 99-220. Lawrence Erlbaum and Associates, Mahwah, New Jersey. M.S. Wogalter (Ed.).
14. Elliott, L.R., Coovert, M.D., Redden, E.S., 2009. Overview of meta-analyses investigating vibrotactile versus visual display options. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 5611 LNCS (PART 2), pp. 435-443.
15. Endsley, M.R., Rosiles, S.A., 1995. Vertical auditory localization for spatial orientation. In: Proceedings of the Human Factors and Ergonomics Society 39th Annual Meeting, pp. 586-590.
16. ETSI Guidelines on the Multimodality of Icons Symbols and Pictograms. ETSI EG 202 048 2002, ETSI, Sophia Antipolis Cedex, France.
17. ETSI Multimodal Interaction Communication and Navigation Guidelines. ETSI EG 202 191 2003, ETSI, Sophia Antipolis Cedex, France.
18. Ferris T.K., Sarter N.B. Cross-Modal links among vision, audition, and touch in complex environments. Human Factors 2008, 50:17-26.
19. Fitch G.M., Kiefer R.J., Hankey J.M., Kleiner B.M. Toward developing an approach for alerting drivers to the direction of a crash threat. Human Factors 2007, 49:710-720.
20. Gaver W.W. The sonicfinder: an interface that uses auditory icons. Human-Computer Interaction 1989, 4:67-94.
21. Graham R. Use of auditory icons as emergency warnings: evaluation within a vehicle collision avoidance application. Ergonomics 1999, 42:1233-1248.
22. Haas E.C., Edworthy J. An introduction to auditory warnings and alarms. Handbook of Warnings 2006, 189-198. Lawrence Erlbaum and Associates, Mahwah, New Jersey. M.S. Wogalter (Ed.).
23. Haas, E.C., Stachowiak, C., 2007. Multimodal displays to enhance human-robot interaction on-the-move. In: Proceedings of the 2007 Workshop on Performance Metrics for Intelligent Systems, pp. 135-140.
24. Haas E.C., Casali J.G. Perceived urgency and response time to multi-tone and frequency-modulated warning signals in broadband noise. Ergonomics 1995, 38:2313-2326.
25. Hancock P.A., Mercado J.E., Merlo J., Van Erp J.B.F. Improving target detection in visual search through augmenting multi-sensory cues. Ergonomics 2013, 10.1080/00140139.2013.771219.
26. Ho C. Multisensory Aspects of the Spatial Cueing of Driver Attention. PhD thesis 2006, University of Oxford.
27. Ho C., Reed N., Spence C. Assessing the effectiveness of "intuitive" vibrotactile warning signals in preventing front-to-rear-end collisions in a driving simulator. Accident Analysis & Prevention 2006, 38:989-997.
28. Ho C., Spence C. The Multisensory Driver: Implications for Ergonomic Car Interface Design 2008, Ashgate Publishing, Aldershot.
29. Ho C., Tan H.Z., Spence C. Using spatial vibrotactile cues to direct visual attention in driving scenes. Transportation Research Part F: Traffic Psychology and Behaviour 2005, 8:397-412.
30. Hogema J.H., De Vries S.C., Van Erp J.B.F., Kiefer R.J. A tactile seat for direction coding in car driving: field evaluation. IEEE Transactions on Haptics 2009, 2:181-188.
31. Hoggan, E., Brewster, S., 2006. Crossmodal spatial location: Initial experiments. NordiCHI 2006: Changing Roles, pp. 469-472.
32. ISO, 1998 ISO (International Organization for Standardization), 1998. ISO 14915: Multimedia user interface design software ergonomic requirements, Part 3: Media combination and selection.
33. ISO, Technical Committee ISO/TC 159 (Ergonomics) International Standard (ISO 7731); Danger Signals for Work Places - Auditory Danger Signals 1986, International Organization for Standardization, Switzerland.
34. Jones L.A., Sarter N.B. Tactile displays: guidance for their design and application. Human Factors 2008, 50:90-111.
35. Laroche C., Tran Quoc H., Hetu R., McDuff S. Detectsound: a computerized model for predicting the detectability of warning signals in noisy environments. Applied Acoustics 1991, 33:195-214.
36. Lazarus H., Hoge H. Industrial safety: acoustic signals for danger situations in factories. Applied Ergonomics 1986, 17:41-46.
37. Lee, J.D., Hoffman, J.D., Hayes, E., 2004. Collision warning design to mitigate driver distraction. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, vol. 6, pp. 65-72.
38. Lees M.N., Cosman J., Lee J.D., Vecera S.P., Dawson J.D., Rizzo M. Cross-modal warnings for orienting attention in older drivers with and without attention impairments. Applied Ergonomics 2012, 43:768-776.
39. Lu, S.A., Wickens, C.D., Sarter, N.B., Sebok, A., 2011. Informing the design of multimodal displays: a meta-analysis of empirical studies comparing auditory and tactile interruptions. In: Proceeedings of the Human Factors and Ergonomics Society 55th Annual Meeting, pp. 1170-1174.
40. Martens, M.H., Van Winsum, W., 2001. Effects of speech versus tactile support messages on driving behaviour and workload. In: Proceedings of the 17th International Technical Conference on Enhanced Safety of Vehicles, Amsterdam.
41. McAnally K.I., Martin R. Spatial audio displays improve the detection of target messages in a continuous monitoring task. Human Factors 2007, 49:688-695.
42. Ng J.Y.C., Man J.C.F., Fels S., Dumont G., Ansermino J.M. An evaluation of a vibro-tactile display prototype for physiological monitoring. Anesthesia & Alangesia 2005, 101:1719-1724.
43. Oskarsson P.E., Eriksson L., Carlander O. Enhanced perception and performance by multimodal threat cueing in simulated combat vehicle. Human Factors 2011, 54:122-137.
44. Paivio A. Mental Representations: A Dual Coding Approach 1990, Oxford University Press, Oxford, United Kingdom, pp. 53-84.
45. Patterson R.D. Guidelines for Auditory Warning Systems on Civil Aircraft, Civil Aviation Authority Paper 82017 1982, Civil Aviation Authority, Airworthines Division, Cheltanham, England.
46. Prewett M.S., Elliott L.R., Walvoord A.G., Coovert M.D. A meta-analysis of vibrotactile and visual information displays for improving task performance. IEEE Transactions on Systems, Man and Cybernetics Part C: Applications and Reviews 2012, 42:123-132.
47. Sarter, N.B., 2006. Multimodal information presentation: design guidance and research challenges. In: Bisantz, A.M., (Ed.) Cognitive Engineering Insights for Human Performance and Decision Making, International Journal of Industrial Ergonomics, pp. 439-445.
48. Sarter N. Multimodal displays: conceptual basis, design guidance, and research needs. The Oxford Handbook of Cognitive Engineering 2013, 556-565. Oxford University Press, Oxford, United Kingdom. J.D. Lee, A. Kirlick (Eds.).
49. Scott J.J., Gray R. A comparison of tactile, visual, and auditory warnings for rear-end collision prevention in simulated driving. Human Factors 2008, 50:264-275.
50. Shannon R.V., Zen Fan.-Gang., Kamath Vivek., Ekelid M. Speech recognition with primarily temporal cues. Science 1995, 270:303-304.
51. Shilling R.D., Shinn-Cunningham B. Virtual auditory displays. Handbook of Virtual Environments 2002, 65-92. Erlbaum, Mahwah, NJ. K. Stanney (Ed.).
52. Sklar A.E., Sarter N.B. Good vibrations: tactile feedback in support of attention allocation and human-automation coordination in event-driven domains. Human Factors 1999, 41:543-552.
53. Spence C. Crossmodal spatial attention 2010, vol. 1191. Annals of the New York Academy of Science, pp. 182-200.
54. Spence C., Driver J. Cross-modal links in attention between audition, vision, and touch: implications for interface design. International Journal of Cognitive Ergonomics 1997, 1:351-373.
55. Spence C., Pavani F., Driver J. Crossmodal links between vision and touch in covert endogenous spatial attention. Journal of Experimental Psychology; Human Perception and Performance 2000, 26:1298-1319.
56. Stephan K.L., Smith S.E., Martin R.L., Parker S.P., McAnally K.I. Learning and retention of associations between auditory icons and denotative referents: implications for the design of auditory warnings. Human Factors 2006, 48:288-299.
57. Sutcliffe A. Multimedia and Virtual Reality: Designing Multisensory User Interfaces 2003, Lawrence Erlbaum Associates, Mahwah, New Jersey.
58. Sweller J. Some cognitive processes and their consequences for the organization and presentation of information. Australian Journal of Psychology 1993, 45:1-8.
59. Tan H.Z., Gray R., Young J.J., Traylor R. A haptic back display for attentional and directional cueing. Haptics 2003, 3:1.
60. Van Erp, J.B.F., 2002. Guidelines for the use of vibro-tactile displays in human computer interaction. In: Wall, S.A., (Ed.) Eurohaptics 2002: Conference Proceedings. Edinburgh, pp. 18-22.
61. Van Erp J.B.F., Eriksson L., Levin B., Carlander O., Veltman J.A., Vos W.K. Tactile cueing effects on performance in simulated aerial combat with high acceleration. Aviation Space and Environmental Medicine 2007, 78:1128-1134.
62. Van Erp J.B.F., Spapé M.M.A. Distilling the underlying dimensions of tactile melodies. Proceedings of Eurohaptics 2003 2003, 111-120. Trinity College, Dublin Ireland. I. Oakley, S. O'Modhrain, F. Newell (Eds.).
63. Van Erp J.B.F., Oving A.B. Control performance with three translational degrees of freedom. Human Factors 2002, 44:144-155.
64. Van Erp J.B.F., Van Veen H.A.H.C. Vibrotactile in-vehicle navigation system. Transportation Research Part F: Traffic Psychology and Behaviour 2004, 7:247-256.
65. Van Erp J.B.F., Werkhoven P.J. Validation of principles for tactile navigation displays. Proceedings of the Human Factors and Engineering Society 50th Annual Meeting 2006, 1687-1691. Santa Monica: Human Factors and Ergonomics Society.
66. Von Békésy G. Sensations on the skin similar to directional hearing, beats, and harmonics of the ear. Journal of the Acoustical Society of America 1957, 29:489-501.
67. Wogalter M.S. Factors influencing the effectiveness of warnings. Conference Proceedings of Public Graphics: Visual Information for Everyday Use 1994, 5.1-5.21. Stichting Public Graphics Research, Utrecht, The Netherlands. H. Swaga, T. Boersema, H. Hoonout (Eds.).
68. Wogalter M.S., Mayhorn C.B. The future of risk communication: technology-based warning systems. Handbook of Warnings 2006, 783-793. Lawrence Erlbaum and Associates, Mahwah, New Jersey. M.S. Wogalter (Ed.).
69. Woods, D.D., 1995. Towards a theoretical base for representation design in the computer medium: Ecological perception and aiding human cognition. An Ecological Approach to Human-Machine Systems I: A Global Perspective.