Tactile and multisensory spatial warning signals for drivers

IEEE Transactions on Haptics

Volumn 1, Issue 2, 2008, Pages 121-129

  Spence, Charles ^a   Ho, Cristy ^a,b  

^a UNIVERSITY OF OXFORD   (United Kingdom)

^b Daiwa Anglo Japanese Foundation   (Japan)

Author keywords

Cognitive neuroscience; Driving; Multisensory warning signal; Spatial attention; Tactile display

Indexed keywords

APPLICATION AREA; CAPTURE DRIVERS; COGNITIVE NEUROSCIENCES; COMPLEX INFORMATION; COSTS AND BENEFITS; DRIVER WORKLOAD; FALSE ALARMS; INFORMATION DISPLAY; MULTISENSORY; MULTISENSORY INFORMATION; MULTISENSORY INTERFACES; MULTISENSORY WARNING SIGNAL; SENSORY SIGNALS; SLEEPY DRIVERS; SPATIAL ATTENTION; TACTILE DISPLAY; UNIMODAL; WARNING SIGNALS;

DISPLAY DEVICES; TAXONOMIES;

MICE (COMPUTER PERIPHERALS);

EID: 67349148213     PISSN: 19391412     EISSN: None     Source Type: Journal    
DOI: 10.1109/TOH.2008.14     Document Type: Article

References (108)

1. S. Ashley, "Driving the Info Highway," Scientific Am., vol.284, no.4, pp. 44-50, 2001.
2. M. Auvray, A. Gallace, H.Z. Tan, and C. Spence, "Crossmodal Change Blindness between Vision and Touch," Acta Psychologica, vol.126, pp. 79-97, 2007.
3. M. Auvray, A. Gallace, J. Hartcher-O'Brien, H.Z. Tan, and C. Spence, "Tactile and Visual Distractors Induce Change Blindness for Tactile Stimuli Presented on the Fingertips," Brain Research, vol.1213, pp. 111-119, 2008.
4. J.P. Bliss and S.A. Acton, "Alarm Mistrust in Automobiles: How Collision Alarm Reliability Affects Driving," Applied Ergonomics, vol.34, pp. 499-509, 2003.
5. S. Brewster and L.M. Brown, "Tactons: Structured Tactile Messages for Non-Visual Information Display," Proc. Fifth Australasian User Interface Conf. (AUIC '04), A. Cockburn, ed., vol.28, pp. 15-24, 2004.
6. S. Breznitz, Cry Wolf: The Psychology of False Alarms. Lawrence Erlbaum Assoc., 1983.
7. L.M. Brown, S.A. Brewster, and H.C. Purchase, "Multidimensional Tactons for Non-Visual Information Display in Mobile Devices," Proc. Eighth Conf. Human-Computer Interaction with Mobile Devices and Services (Mobile HCI '06), pp. 231-238, 2006.
8. L.M. Brown and T. Kaaresoja, "Feel Who's Talking: Using Tactons for Mobile Phone Alerts," Proc. ACM Conf. Human Factors in Computing Systems (CHI '06), Apr. 2006.
9. R.L. Brown, W.D. Galloway, and K.R. Gildersleeve, "Effects of Intense Noise on Processing of Cutaneous Information of Varying Complexity," Perceptual and Motor Skills, vol.20, pp. 749-754, 1965.
10. T.L. Brown, J.D. Lee, and D.V. McGehee, "Human Performance Models and Rear-End Collision Avoidance Algorithms," Human Factors, vol.43, pp. 462-482, 2001.
11. M.P. Bussemakers and A. de Haan, "When It Sounds Like a Duck and It Looks Like a Dog. . . Auditory Icons versus Earcons in Multimedia Environments," Proc. Int'l Conf. Auditory Display (ICAD '00), pp. 184-189, 2000.
12. The Handbook of Multisensory Processes, G.A. Calvert, C. Spence, and B.E. Stein, eds. MIT Press, 2004.
13. A. Chan, K.E. MacLean, and J. McGrenere, "Learning and Identifying Haptic Icons under Workload," Proc. First World Haptics Conf. (WHC '05), pp. 432-439, 2005.
14. A.H.S. Chan and K.W.L. Chan, "Synchronous and Asynchronous Presentations of Auditory and Visual Signals: Implications for Control Console Design," Applied Ergonomics, vol.37, pp. 131-140, 2006.
15. J.Y.C. Chen and P.I. Terrence, "Effects of Tactile Cueing on Concurrent Performance of Military and Robotics Tasks in a Simulated Multitasking Environment," Ergonomics, vol.51, pp. 1137-1152, 2008.
16. C.C. Collins, "Tactile Television-Mechanical and Electrical Image Projection," IEEE Trans. Man-Machine Systems, vol.11, pp. 65-71, 1970.
17. J.H. Day, "Can BMW's iDrive Pass Its Road Test Now?" Electronic Design, June 2004.
18. S.R. Dixon, C.D. Wickens, and J.S. McCarley, "On the Independence of Compliance and Reliance: Are Automation False Alarms Worse Than Misses," Human Factors, vol.49, pp. 564-572, 2007.
19. J. Edworthy and E. Hellier, "Complex Nonverbal Auditory Signals and Speech Warnings," Handbook of Warnings, M.S. Wogalter, ed., pp. 199-220, Lawrence Erlbaum Assoc., 2006.
20. W. Epstein, B. Hughes, S. Schneider, and P. Bach-y-Rita, "Is There Anything Out There? A Study of Distal Attribution in Response to Vibrotactile Stimulation," Perception, vol.15, pp. 275-284, 1986.
21. L. Evans, Traffic Safety and the Driver. Van Nostrand Reinhold, 1991.
22. W.N. Evans and J.D. Graham, "Risk Reduction or Risk Compensation? The Case of Mandatory Safety-Belt Use Laws," J. Risk and Uncertainty, vol.4, pp. 61-73, 1991.
23. T. Ferris, R. Penfold, S. Hameed, and N. Sarter, "The Implications of Crossmodal Links in Attention for the Design of Multimodal Interfaces: A Driving Simulation Study," Proc. Human Factors and Ergonomics Soc. 50th Ann. Meeting, pp. 406-409, 2006.
24. G.M. Fitch, R.J. Kiefer, J.M. Hankey, and B.M. Kleiner, "Toward Developing an Approach for Alerting Drivers to the Direction of a Crash Threat," Human Factors, vol.49, pp. 710-720, 2007.
25. A. Gallace, H.Z. Tan, and C. Spence, "Numerosity Judgments for Tactile Stimuli Distributed over the Body Surface," Perception, vol.35, pp. 247-266, 2006.
26. A. Gallace, H.Z. Tan, and C. Spence, "The Failure to Detect Tactile Change: A Tactile Analog of Visual Change Blindness," Psychonomic Bull. and Rev., vol.13, pp. 300-303, 2006.
27. A. Gallace, H.Z. Tan, and C. Spence, "Do "Mudsplashes" Induce Tactile Change Blindness?" Perception and Psychophysics, vol.69, pp. 477-486, 2007.
28. A. Gallace, H.Z. Tan, and C. Spence, "Multisensory Numerosity Judgments for Visual and Tactile Stimuli," Perception and Psychophysics, vol.69, pp. 487-501, 2007.
29. A. Gallace, H.Z. Tan, and C. Spence, "The Body Surface as a Communication System: The State of the Art after 50 Years," Presence: Teleoperators and Virtual Environments, vol.16, pp. 655-676, 2007.
30. M.E. Gast, Autopilot/Flight Director Stall Protection System, US patent 5803408, Patent and Trademark Office, 1998.
31. W.W. Gaver, "Auditory Icons: Using Sound in Computer Interfaces," Human-Computer Interaction, vol.2, pp. 167-177, 1986.
32. G.A. Gescheider and R.K. Niblette, "Cross-Modality Masking for Touch and Hearing," J. Experimental Psychology, vol.74, pp. 313-320, 1967.
33. G.R. Hawkes, "Symp. Cutaneous Sensitivity," Medical Research Laboratories Report 424, 1960.
34. T. Hempel and E. Altinsoy, "Multimodal User Interfaces: Designing Media for the Auditory and the Tactile Channel," Handbook of Human Factors in Web Design, R.W. Proctor and K.-P.L. Vu, eds., pp. 134-155, Lawrence Erlbaum Assoc., 2005.
35. J.R. Hennessy, "Cutaneous Sensitivity Communications," Human Factors, vol.8, pp. 463-469, 1966.
36. J. Hirsch, "Rate Control in Man-Machine Systems," Cutaneous Communication Systems as Devices, pp. 65-71, F. Geldard, ed., Psychonomic Soc., 1974.
37. S. Hirst and R. Graham, "The Format and Presentation of Collision Warnings," Ergonomics and Safety of Intelligent Driver Interfaces, Y.I. Noy, ed., pp. 203-219, Lawrence Erlbaum Assoc., 1997.
38. C. Ho, N.J. Reed, and C. Spence, "Assessing the Effectiveness of "Intuitive" Vibrotactile Warning Signals in Preventing Front-to- Rear-End Collisions in a Driving Simulator," Accident Analysis and Prevention, vol.38, pp. 989-997, 2006.
39. C. Ho, N. Reed, and C. Spence, "Multisensory In-Car Warning Signals for Collision Avoidance," Human Factors, vol.49, pp. 1107-1114, 2007.
40. C. Ho, N. Reed, and C. Spence, ""Intuitive" Vibrotactile Collision Warnings for Drivers," Human Factors Issues in Complex System Performance, D. de Waard, G.R.J. Hockey, P. Nickel, and K.A. Brookhuis, eds., pp. 169-176, Shaker Publishing, 2007.
41. C. Ho and C. Spence, "Assessing the Effectiveness of Various Auditory Cues in Capturing a Driver's Visual Attention," J. Experimental Psychology: Applied, vol.11, pp. 157-174, 2005.
42. C. Ho and C. Spence, The Multisensory Driver: Implications for Ergonomic Car Interface Design. Ashgate Publishing, 2008.
43. C. Ho, V. Santangelo, and C. Spence, "Multisensory Warning Signals: When Spatial Location Matters," Experimental Brain Research, submitted.
44. C. Ho, H.Z. Tan, and C. Spence, "Using Spatial Vibrotactile Cues to Direct Visual Attention in Driving Scenes," Transportation Research Part F: Traffic Psychology and Behaviour, vol.8, pp. 397-412, 2005.
45. C. Ho, H.Z. Tan, and C. Spence, "The Differential Effect of Vibrotactile and Auditory Cues on Visual Spatial Attention," Ergonomics, vol.49, pp. 724-738, 2006b.
46. E. Hoggan and S. Brewster, "Designing Audio and Tactile Crossmodal Icons for Mobile Devices," Proc. Ninth Int'l Conf. Multimodal Interfaces (ICMI '07), pp. 162-169, Nov. 2007.
47. R.J. Jagacinski, D.P. Miller, and R.D. Gilson, "A Comparison of Kinesthetic-Tactual and Visual Displays in a Critical Tracking Task," Human Factors, vol.21, pp. 79-86, 1979.
48. W. Janssen and L. Nilsson, "Behavioural Effects of Driver Support," Driving Future Vehicles, A.M. Parkes and S. Franzen, eds., pp. 147-155, Taylor & Francis, 1993.
49. L. Jones and N. Sarter, "Tactile Displays: Guidance for Their Design and Application," Human Factors, vol.50, pp. 90-111, 2008.
50. L.A. Jones, B. Lockyer, and E. Piateski, "Tactile Display and Vibrotactile Pattern Recognition on the Torso," Advanced Robotics, vol.20, pp. 1359-1374, 2006.
51. N. Kitagawa, M. Zampini, and C. Spence, "Audiotactile Interactions in Near and Far Space," Experimental Brain Research, vol.166, pp. 528-537, 2005.
52. "Lane Departure Warnings," The Times Online, Jan. 2005.
53. P.J. Laurienti, J.H. Burdette, J.A. Maldjian, and M.T. Wallace, "Enhanced Multisensory Integration in Older Adults," Neurobiology of Aging, vol.27, pp. 1155-1163, 2006.
54. J.D. Lee, "Fifty Years of Driving Safety Research," Human Factors, 2008.
55. J.D. Lee, C. Carney, S.M. Casey, and J.L. Campbell, In-Vehicle Display Icons and Other Information Elements. Task B. Conduct Preliminary Assessment of Visual Symbols. Battelle Human Factors Transportation Center, 1998, draft report.
56. J.D. Lee, J.D. Hoffman, and E. Hayes, "Collision Warning Design to Mitigate Driver Distraction," Proc. ACM Conf. Human Factors in Computing Systems (CHI '04), vol.6, pp. 65-72, Apr. 2004.
57. J.D. Lee, D.V. McGehee, T.L. Brown, and D. Marshall, "Effects of Adaptive Cruise Control and Alert Modality on Driver Performance," Transportation Research Record, vol.1980, pp. 49-56, 2006.
58. J.D. Lee, D.V. McGehee, T.L. Brown, and M.L. Reyes, "Collision Warning Timing, Driver Distraction, and Driver Response to Imminent Rear-End Collisions in a High-Fidelity Driving Simulator," Human Factors, vol.44, pp. 314-334, 2002.
59. J.-H. Lee and C. Spence, "Assessing the Benefits of Multimodal Feedback on Dual-Task Performance under Demanding Conditions," Proc. 22nd Ann. Conf. British Computer Soc. Human-Computer Interaction Group, Sept. 2008.
60. J. Luk, J. Pasquero, S. Little, K. MacLean, V. Lévesque, and V. Hayward, "A Role for Haptics in Mobile Interaction: Initial Design Using a Handheld Tactile Display Prototype," Proc. ACM Conf. Human Factors in Computing Systems (CHI '06), CHI Letters, vol.8, no.1, pp. 171-180, 2006.
61. G. Lyons, D. Sanabria, A. Vatakis, and C. Spence, "The Modulation of Crossmodal Integration by Unimodal Perceptual Grouping: A Visuotactile Apparent Motion Study," Experimental Brain Research, vol.174, pp. 510-516, 2006.
62. K.E. MacLean and M. Enriquez, "Perceptual Design of Haptic Icons," Proc. EuroHaptics '03, pp. 351-363, 2003.
63. D.V. McGehee and M. Raby, Snowplow Lane Awareness System, Final Report prepared for the 3M Company and the Minnesota Dept. of Transportation, 2002.
64. J.D. McKeown and S. Isherwood, "Mapping the Urgency and Pleasantness of Speech, Auditory Icons, and Abstract Alarms to Their Referents within the Vehicle," Human Factors, vol.49, pp. 417-428, 2007.
65. A. Montagu, Touching: The Human Significance of the Skin. Columbia Univ. Press, 1971.
66. S.K. Nagel, C. Carl, T. Kringe, R. Märtin, and P. König, "Beyond Sensory Substitution-Learning the Sixth Sense," J. Neural Eng., vol.2, pp. R13-R26, 2005.
67. F.H. Previc, "The Neuropsychology of 3-D Space," Psychological Bull., vol.124, pp. 123-164, 1998.
68. F.H. Previc, "Neuropsychological Guidelines for Aircraft Control Stations," IEEE Eng. in Medicine and Biology Magazine, vol.19, pp. 81-88, 2000.
69. A.H. Rupert, "An Instrumentation Solution for Reducing Spatial Disorientation Mishaps: A More "Natural" Approach to Maintaining Spatial Orientation," IEEE Eng. in Medicine and Biology, vol.19, pp. 71-80, 2000.
70. F. Sagberg, "Road Accidents Caused by Drivers Falling Asleep," Accident Analysis and Prevention, vol.31, pp. 639-649, 1999.
71. F. Sagberg, "Accident Risk of Car Drivers during Mobile Telephone Use," Int'l J. Vehicle Design, vol.26, pp. 57-69, 2001.
72. V. Santangelo, C. Ho, and C. Spence, "Capturing Spatial Attention with Multisensory Cues," Psychonomic Bull. and Rev., vol.15, pp. 398-403, 2008.
73. V. Santangelo and C. Spence, "Multisensory Cues Capture Spatial Attention Regardless of Perceptual Load," J. Experimental Psychology: Human Perception and Performance, vol.33, pp. 1311-1321, 2007a.
74. V. Santangelo and C. Spence, "Assessing the Automaticity of Reflexive Tactile Attentional Orienting," Perception, vol.36, pp. 1497-1505, 2007b.
75. N.B. Sarter, "The Need for Multisensory Interfaces in Support of Effective Attention Allocation in Highly Dynamic Event-Driven Domains: The Case of Cockpit Automation," Int'l J. Aviation Psychology, vol.10, pp. 231-245, 2000.
76. N.B. Sarter, "Multiple-Resource Theory as a Basis for Multimodal Interface Design: Success Stories, Qualifications, and Research Needs," Attention: From Theory to Practice, A.F. Kramer, D.A. Wiegmann, and A. Kirlik, eds., pp. 187-195, Oxford Univ. Press, 2007.
77. K. Sato, T. Goto, Y. Kubota, Y. Amano, and K. Fukui, "A Study on a Lane Departure Warning System Using a Steering Torque as a Warning Signal," Proc. Int'l Symp. Advanced Vehicle Control (AVEC '98), pp. 479-484, 1998.
78. J.J. Scott and R. Gray, "A Comparison of Tactile, Visual and Auditory Warnings for Rear-End Collision Prevention in Simulated Driving," Human Factors, vol.50, pp. 264-275, 2008.
79. M. Sivak, "The Information That Drivers Use: Is It Indeed 90 Percent Visual?" Perception, vol.25, pp. 1081-1089, 1996.
80. A.E. Sklar and N.B. Sarter, "Good Vibrations: Tactile Feedback in Support of Attention Allocation and Human-Automation Coordination in Event-Driven Domains," Human Factors, vol.41, pp. 543-552, 1999.
81. E.B. Slawinski and J.F. McNeil, "Age, Music, and Driving Performance: Detection of External Warning Sounds in Vehicles," Psychomusicology, vol.18, pp. 123-131, 2002.
82. G. Smith, "Good Vibrations," The Guardian, http://www. guardian.co.uk/wheels/story/0,3605,1341281,00.html, Nov. 2004.
83. C. Spence and J. Driver, "Cross-Modal Links in Attention between Audition, Vision, and Touch: Implications for Interface Design," Int'l J. Cognitive Ergonomics, vol.1, pp. 351-373, 1997.
84. C. Spence and J. Driver, "A New Approach to the Design of Multimodal Warning Signals," Eng. Psychology and Cognitive Ergonomics, Vol.4: Job Design, Product Design and Human-Computer Interaction, D. Harris, ed., pp. 455-461, Ashgate Publishing, 1999.
85. C. Spence and A. Gallace, "Recent Developments in the Study of Tactile Attention," Canadian J. Experimental Psychology, vol.61, pp. 196-207, 2007.
86. C. Spence and C. Ho, "Multisensory Driver Interface Design: Past, Present, and Future," Ergonomics, vol.51, pp. 65-70, 2008a.
87. C. Spence and C. Ho, "Crossmodal Information Processing in Driving," Human Factors of Visual Performance in Driving, C. Castro and L. Hartley, eds., pp. 187-200, CRC Press, 2008b.
88. C. Spence and C. Ho, "Multisensory Warning Signals for Event Perception and Safe Driving," Theoretical Issues in Ergonomics Science, vol.9, pp. 523-554, 2008c.
89. C. Spence and L. Read, "Speech Shadowing while Driving: On the Difficulty of Splitting Attention between Eye and Ear," Psychological Science, vol.14, pp. 251-256, 2003.
90. K. Stanney, S. Samman, L. Reeves, K. Hale, W. Buff, C. Bowers, B. Goldiez, D. Nicholson, and S. Lackey, "A Paradigm Shift in Interactive Computing: Deriving Multimodal Design Principles from Behavioral and Neurological Foundations," Int'l J. Human- Computer Interaction, vol.17, pp. 229-257, 2004.
91. B.E. Stein and T.R. Stanford, "Multisensory Integration: Current Issues from the Perspective of the Single Neuron," Nature Rev. Neuroscience, vol.9, pp. 255-266, 2008.
92. T. Suetomi and K. Kido, Driver Behavior under a Collision Warning System-A Driving Simulator Study, vol.1242, pp. 75-81, 970279, SAE Technical Publication, 1997.
93. K. Suzuki and H. Jansson, "An Analysis of Driver's Steering Behaviour during Auditory or Haptic Warnings for the Designing of Lane Departure Warning System," JSAE Rev., vol.24, pp. 65-70, 2003.
94. A.K. Tan and N.D. Lerner, "Acoustic Localization of In-Vehicle Crash Avoidance Warnings as a Cue to Hazard Direction," Report no. DOT-HS-808-534, US Dept. of Transportation, 1996.
95. H.Z. Tan and A. Pentland, "Tactual Displays for Sensory Substitution and Wearable Computers," Fundamentals of Wearable Computers and Augmented Reality, W. Barfield and T. Caudell, eds., pp. 579-598, Lawrence Erlbaum Assoc., 2001.
96. A. Tang, P. McLachlan, K. Lowe, C.R. Saka, and K. MacLean, "Perceiving Ordinal Data Haptically under Workload," Proc. Seventh Int'l Conf. Multimodal Interfaces (ICMI '05), pp. 244-251, 2005.
97. P.I. Terrence, J.C. Brill, and R.D. Gilson, "Body Orientation and the Perception of Spatial Auditory and Tactile Cues," Proc. Human Factors and Ergonomics Soc. 49th Ann. Meeting, pp. 1663-1667, 2005.
98. L. Tijerina, S. Johnston, E. Parmer, H.A. Pham, M.D. Winterbottom, and F.S. Barickman, Preliminary Studies in Haptic Displays for Rear- End Collision Avoidance System and Adaptive Cruise Control Applications. Nat'l Highway Transportation Safety Administration, DOT HS 808 TBD, 2000.
99. T.J. Triggs, W.H. Lewison, and R. Sanneman, "Some Experiments with Flight-Related Electrocutaneous and Vibrotactile Displays," Cutaneous Comm. Systems and Devices, F. Geldard, ed., pp. 57-64, Psychonomic Soc., 1974.
100. D.R. Tufano, "Automative HUDs: The Overlooked Safety Issues," Human Factors, vol.39, pp. 303-311, 1997.
101. J.B.F. Van Erp, L. Eriksson, B. Levin, O. Carlander, J.E. Veltman, and W.K. Vos, "Tactile Cueing Effects on Performance in Simulated Aerial Combat with High Acceleration," Aviation, Space and Environmental Medicine, vol.78, pp. 1128-1134, 2007.
102. J.B.F. Van Erp and H.A.H.C. van Veen, "Vibrotactile In-Vehicle Navigation System," Transportation Research Part F, vol.7, pp. 247- 256, 2004.
103. J.B.F. Van Erp and H.A.H.C. van Veen, "Touch Down: The Effect of Artificial Touch Cues on Orientation in Microgravity," Neuroscience Letters, vol.404, pp. 78-82, 2006.
104. P.F. Waller, "The Older Driver," Human Factors, vol.33, pp. 499- 505, 1991.
105. C.D. Wickens, "Multiple Resources and Performance Prediction," Theoretical Issues in Ergonomics Science, vol.3, pp. 159-177, 2002.
106. G.J.S. Wilde, "The Theory of Risk Homeostasis: Implications for Safety and Health," Risk Analysis, vol.2, pp. 209-225, 1982.
107. Y. Yanagida, M. Kakita, R.W. Lindeman, Y. Kume, and N. Tetsutani, "Vibrotactile Letter Reading Using a Low-Resolution Tactor Array," Proc. 12th Int'l Symp. Haptic Interfaces for Virtual Environment and Teleoperator Systems, pp. 400-406, 2004.
108. C. Spence, J. McDonald, and J. Driver, "Exogenous Spatial Cuing Studies of Human Crossmodal Attention and Multisensory Integration," Crossmodal Space and Crossmodal Attention, C. Spence and J. Driver, eds., pp. 277-320, Oxford Univ. Press, 2004.