Affective multisensory driver interface design

International Journal of Vehicle Noise and Vibration

Volumn 9, Issue 1-2, 2013, Pages 61-74

  Ho, Cristy ^a   Spence, Charles ^a  

^a UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

Affective driver interface design; Cognitive neuroscience approach; Multisensory warning signals; Negative emotion

Indexed keywords

AUTOMOBILE DRIVERS; BRAIN;

COGNITIVE NEUROSCIENCES; DRIVER INTERFACE; DRIVING ENVIRONMENT; DRIVING EXPERIENCES; MULTISENSORY INTEGRATION; MULTISENSORY WARNING SIGNAL; NEGATIVE EMOTION; TECHNOLOGICAL ADVANCES;

SPEED CONTROL;

EID: 84877739316     PISSN: 14791471     EISSN: 1479148X     Source Type: Journal    
DOI: 10.1504/IJVNV.2013.053817     Document Type: Article

References (93)

1. AAMI (2011) 2011 AAMI Crash Index [online] http://www.aami.com.au/sites/ default/files/fm/news/AAMI%20Crash%20Index%202011%20 FINAL.pdf (accessed 4 November 2011).
2. Alais, D. and Burr, D. (2004) 'The ventriloquist effect results from near-optimal bimodal integration', Current Biology, Vol. 14, No. 3, pp.257-262. (Pubitemid 38215356)
3. Baron, R.A. and Kalsher, M.J. (1998) 'Effects of a pleasant ambient fragrance on simulated driving performance: the sweet smell of... safety?', Environment and Behavior, Vol. 30, No. 4, pp.535-552. (Pubitemid 128721995)
4. Bayle, D.J., Henaff, M-A. and Krolak-Salmon, P. (2009) 'Unconsciously perceived fear in peripheral vision alerts the limbic system: a MEG study', PLoS ONE, Vol. 4, No. 12, p.e8207.
5. Brodsky, W. (2002) 'The effects of music tempo on simulated driving performance and vehicular control', Transportation Research Part F: Traffic Psychology and Behaviour, Vol. 4, No. 4, pp.219-241.
6. Czeisler, C.A., Duffy, J.F., Shanahan, T.L., Brown, E.N., Mitchell, J.F. and Rimmer, D.W. et al. (1999) 'Stability, precision, and near-24-hour period of the human circadian pacemaker', Science, Vol. 284, No. 5423, pp.2177-2181. (Pubitemid 29297478)
7. De Cesarei, A., Codispoti, M. and Schupp, H.T. (2009) 'Peripheral vision and preferential emotion processing', Neuro Report, Vol. 20, No. 16, pp.1439-1443.
8. Dobson, R. (2003) 'The future: a thinking car', Sunday Times, 2 February, p.9.
9. Dolan, R.J. and Vuilleumier, P. (2003) 'Amygdala automaticity in emotional processing', Annals of the New York Academy of Sciences, Vol. 985, No. 1, pp.348-355. (Pubitemid 36521126)
10. Dosey, M.A. and Meisels, M. (1969) 'Personal space and self-protection', Journal of Personality and Social Psychology, Vol. 11, No. 2, pp.93-97.
11. Etzel, J.A., Johnsen, E.L., Dickerson, J., Tranel, D. and Adolphs, R. (2006) 'Cardiovascular and respiratory responses during musical mood induction', International Journal of Psychophysiology, Vol. 61, No. 1, pp.57-69. (Pubitemid 44172991)
12. Eyben, F., Wöllmer, M., Poitschke, T., Schuller, B., Blaschke, C., Färber, B. and Nguyen-Thien, N. (2010) 'Emotion on the road - necessity, acceptance, and feasibility of affective computing in the car', Advances in Human-Computer Interaction, 263593.
13. Eysenck, M.W., Derakshan, N., Santos, R. and Calvo, M.G. (2007) 'Anxiety and cognitive performance: attentional control theory', Emotion, Vol. 7, No. 2, pp.336-353. (Pubitemid 46800375)
14. Felipe, N.J. and Sommer, R. (1966) 'Invasions of personal space', Social Problems, Vol. 14, No. 2, pp.206-214.
15. Ferris, T., Penfold, R., Hameed, S. and Sarter, N. (2006) 'The implications of crossmodal links in attention for the design of multimodal interfaces: a driving simulation study', Proceedings of the Human Factors and Ergonomics Society 50th Annual Meeting, pp.406-409. (Pubitemid 351741735)
16. Francis, S., Rolls, E.T., Bowtell, R., McGlone, F., O'Doherty, J., Browning, A. et al. (1999) 'The representation of pleasant touch in the brain and its relationship with taste and olfactory areas', Neuro Report, Vol. 25, No. 3, pp.453-459. (Pubitemid 29333264)
17. Gallace, A. and Spence, C. (2010) 'The science of interpersonal touch: an overview', Neuroscience & Biobehavioral Reviews, Vol. 34, No. 2, pp.246-259.
18. Gomez, P. and Danuser, B. (2007) 'Relationships between musical structure and psychophysiological measures of emotion', Emotion, Vol. 7, No. 2, pp.377-387. (Pubitemid 46800378)
19. Graziano, M.S.A. and Cooke, D.F. (2006) 'Parieto-frontal interactions, personal space, and defensive behavior', Neuropsychologia, Vol. 44, No. 6, pp.845-859.
20. Grimm, M., Kroschel, K., Harris, H., Nass, C., Schuller, B., Rigoll, G. and Moosmayr, T. (2007) 'On the necessity and feasibility of detecting a driver's emotional state while driving', Proceedings of the 2nd International Conference on Affective Computing and Intelligent Interaction, pp.126-138.
21. Haans, A. and IJsselsteijn, W. (2006) 'Mediated social touch: a review of current research and future directions', Virtual Reality, Vol. 9, No. 2, pp.149-159. (Pubitemid 43192966)
22. Haigney, D. and Westerman, S.J. (2001) 'Mobile (cellular) phone use and driving: a critical review of research methodology', Ergonomics, Vol. 44, No. 2, pp.132-143. (Pubitemid 32058492)
23. Harlow, J. (2011) 'It's a brainwave: controlling your car with a hat', Sunday Times, 30 January, p.6.
24. Haufe, S., Treder, M.S., Gugler, M.F., Sagebaum, M. and Blankertz, G.C. (2011) 'EEG potentials predict upcoming emergency brakings during simulated driving', Journal of Neural Engineering, Vol. 8, No. 5, p.056001.
25. Hertenstein, M.J., Keltner, D., App, B., Bulleit, B.A. and Jaskolka, A.R. (2006) 'Touch communicates distinct emotions', Emotion, Vol. 6, No. 3, pp.528-533. (Pubitemid 44325750)
26. Ho, C. and Spence, C. (2005a) 'Assessing the effectiveness of various auditory cues in capturing a driver's visual attention', Journal of Experimental Psychology: Applied, Vol. 11, No. 3, pp.157-174. (Pubitemid 41560356)
27. Ho, C. and Spence, C. (2005b) 'Olfactory facilitation of dual-task performance', Neuroscience Letters, Vol. 389, No. 1, pp.35-40. (Pubitemid 41219430)
28. Ho, C. and Spence, C. (2008) The Multisensory Driver: Implications for Ergonomic Car Interface Design, Ashgate, Aldershot.
29. Ho, C. and Spence, C. (2009) 'Using peripersonal warning signals to orient a driver's gaze', Human Factors, Vol. 51, No. 4, pp.539-556.
30. Ho, C., Reed, N. and Spence, C. (2007) 'Multisensory in-car warning signals for collision avoidance', Human Factors, Vol. 49, No. 6, pp.1107-1114. (Pubitemid 350205846)
31. Horowitz, M.J., Duff, D.F. and Stratton, L.O. (1964) 'Body-buffer zone: exploration of personal space', Archive of General Psychiatry, Vol. 11, pp.651-656.
32. Jäncke, L., Brunner, B. and Esslen, M. (2008) 'Brain activation during fast driving in a driving simulator: the role of the lateral prefrontal cortex', Neuro Report, Vol. 19, No. 11, pp.1127-1130.
33. Johnstone, T., van Reekum, C.M., Oakes, T.R. and Davidson, R.J. (2006) 'The voice of emotion: an FMRI study of neural responses to angry and happy vocal expressions', Social Cognitive and Affective Neuroscience, Vol. 1, No. 3, pp.242-249.
34. Jones, C.M. and Jonsson, I-M. (2005) 'Automatic recognition of affective cues in the speech of car drivers to allow appropriate responses', Proceedings of the 17th Australia Conference on Computer-Human Interaction: Citizens Online: Considerations for Today and the Future, pp.1-10.
35. Jonsson, I-M., Nass, C., Harris, H. and Takayama, L. (2005) 'Matching in-car voice with driver state: impact on attitude and driving performance', Proceedings of the Third International Driving Symposium on Human Factors in Driver Assessment, Training and Vehicle Design, pp.173-180.
36. Kozak, K., Pohl, J., Birk, W., Greenberg, J., Artz, B. and Blommer, M. et al. (2006) 'Evaluation of lane departure warnings for drowsy drivers', Proceedings of the Human Factors and Ergonomics Society 50th Annual Meeting, pp.2400-2404. (Pubitemid 351742146)
37. Krumhansl, C.L. (2002) 'Music: a link between cognition and emotion', Current Directions in Psychological Science, Vol. 11, No. 2, pp.45-50.
38. Larsson, P., Opperud, A., Fredriksson, K. and Västfjäll, D. (2009) 'Emotional and behavioural response to auditory icons and earcons in driver-vehicle interfaces', Proceedings of the 21st International Technical Conference on the Enhanced Safety of Vehicles, Paper No. 09-0104-O.
39. Lavie, N. (1995) 'Perceptual load as a necessary condition for selective attention', Journal of Experimental Psychology: Human Perception & Performance, Vol. 21, No. 3, pp.451-468.
40. Lavie, N. (2005) 'Distracted and confused?: Selective attention under load', Trends in Cognitive Sciences, Vol. 9, No. 2, pp.75-82. (Pubitemid 40164472)
41. LeDoux, J.E. (2000) 'Emotion circuits in the brain', Annual Review of Neuroscience, Vol. 23, pp.155-184.
42. Lee, Y-C., Lee, J.D. and Ng Boyle, L. (2009) 'The interaction of cognitive load and attention-directing cues in driving', Human Factors, Vol. 51, No. 3, pp.271-280.
43. Lieberman, H.R., Wurtman, J.J. and Teicher, M.H. (1989) 'Circadian rhythms of activity in healthy young and elderly humans', Neurobiology of Aging, Vol. 10, No. 3, pp.259-265. (Pubitemid 19180196)
44. Lin, J.Y., Murray, S.O. and Boynton, G.M. (2009) 'Capture of attention to threatening stimuli without perceptual awareness', Current Biology, Vol. 19, No. 13, pp.1118-1122.
45. Lockley, S.W., Evans, E.E., Scheer, F.A.J.L., Brainard, G.C., Czeisler, C.A. and Aeschbach, D. (2006) 'Short-wavelength sensitivity for the direct effects of light on alertness, vigilance, and the waking electroencephalogram in humans', Sleep, Vol. 29, No. 2, pp.161-168. (Pubitemid 44019969)
46. Lundin, R.W. (1985) An Objective Psychology of Music, 3rd ed., R.E. Krieger Pub. Co., Malabar, FL.
47. Manfredi, L., Henson, B., Barnes, C. and Childs, T. (2007) 'An affective engineering study of vibrational cues and affect when touching car interiors', Proceedings of the 10th QMOD Conference. Quality Management and Organizational Development. Our Dreams of Excellence, p.069.
48. Mesken, J., Hagenzieker, M.P., Rothengatter, T. and de Waard, D. (2007) 'Frequency, determinants, and consequences of different drivers' emotions: an on-the-road study using self-reports, (observed) behaviour, and physiology', Transportation Research Part F: Traffic Psychology and Behaviour, Vol. 10, No. 6, pp.458-475. (Pubitemid 47520713)
49. Mitler, M.M., Carskadon, M.A., Czeisler, C.A., Dement, W.C., Dinges, D.F. and Graeber, R.C. (1988) 'Catastrophes, sleep, and public policy: consensus report', Sleep, Vol. 11, No. 1, pp.100-109.
50. Monk, T.H., Buysse, D.J., Reynolds, C.F., Berga, S.L., Jarrett, D.B., Begley, A.E. and Kupfer, D.J. (1997) 'Circadian rhythms in human performance and mood under constant conditions', Journal of Sleep Research, Vol. 6, No. 1, pp.9-18. (Pubitemid 27154249)
51. Montignies, F., Nosulenko, V. and Parizet, E. (2010) 'Empirical identification of perceptual criteria for customer-centred design. Focus on the sound of tapping on the dashboard when exploring a car', International Journal of Industrial Ergonomics, Vol. 40, No. 5, pp.592-603.
52. Nasoz, F., Lisetti, C.L. and Vasilakos, A.V. (2010) 'Affectively intelligent and adaptive car interfaces', Information Sciences, Vol. 180, No. 20, pp.3817-3836.
53. Nasoz, F., Ozyer, O., Lisetti, C.L. and Finkelstein, N. (2002) 'Multimodal affective driver interfaces for future cars', Proceedings of the 10th ACM International Conference on Multimedia, pp.319-322.
54. Nass, C., Jonsson, I-M., Harris, H., Reaves, B., Endo, J., Brave, S. and Takayama, L. (2005) 'Improving automotive safety by pairing driver emotion and car voice emotion', CHI '05 Extended Abstracts on Human Factors in Computing Systems, pp.1973-1976.
55. Obst, P., Armstrong, K., Smith, S. and Banks, T. (2011) 'Age and gender comparisons of driving while sleepy: behaviours and risk perceptions', Transportation Research Part F: Traffic Psychology and Behaviour, Vol. 14, No. 6, pp.539-542.
56. Oehl, M., Siebert, F., Tews, T-K., Höger, R. and Pfister, H-R. (2011) 'Improving human-machine interaction - a non invasive approach to detect emotions in car drivers', in Jacko, J. (Ed.): Human-Computer Interaction: Towards Mobile and Intelligent Interaction Environments, Vol. 6763, pp.577-585, Springer, Berlin.
57. Öhman, A., Carlsson, K., Lundqvist, D. and Ingvar, M. (2007) 'On the unconscious subcortical origin of human fear', Physiology & Behavior, Vol. 92, Nos. 1-2, pp.180-185. (Pubitemid 47374242)
58. Overvliet, K.E. and Soto-Faraco, S. (2011) 'I can't believe this isn't wood! An investigation in the perception of naturalness', Acta Psychologica, Vol. 136, No. 1, pp.95-111.
59. Parkes, A.M. (1991) 'Drivers' business decision making ability whilst using carphones', in Lovesey, E.J. (Ed.): Contemporary Ergonomics 1991: Proceedings of the Ergonomics Society's 1991 Annual Conference, pp.427-432, Taylor & Francis, London.
60. Phelps, E.A. and LeDoux, J.E. (2005) 'Contributions of the amygdala to emotion processing: From animal models to human behavior', Neuron, Vol. 48, No. 2, pp.175-187. (Pubitemid 41476352)
61. Picard, D., Dacremont, C., Valentin, D. and Giboreau, A. (2003) 'Perceptual dimensions of tactile textures', Acta Psychologica, Vol. 114, No. 2, pp.165-184. (Pubitemid 37188965)
62. Pichon, S., de Gelder, B. and Grèzes, J. (2012) 'Threat prompts defensive brain responses independently of attentional control', Cerebral Cortex, Vol. 22, No. 2, pp.274-285.
63. Poliakoff, E., Miles, E., Li, X. and Blanchette, I. (2007) 'The effect of visual threat on spatial attention to touch', Cognition, Vol. 102, No. 3, pp.405-414. (Pubitemid 46107410)
64. Previc, F.H. (2000) 'Neuropsychological guidelines for aircraft control stations', IEEE Engineering in Medicine and Biology Magazine, Vol. 19, No. 2, pp.81-88.
65. Rajaratnam, S.M. and Arendt, J. (2001) 'Health in a 24-h society', Lancet, Vol. 358, pp.999-1005. (Pubitemid 32913531)
66. Reddy, B.S., Basir, O.A. and Leat, S.J. (2007) 'Estimation of driver attention using visually evoked potentials', Proceedings of the 2007 IEEE Intelligent Vehicles Symposium, pp.588-593.
67. Reed, M.P. and Green, P.A. (1999) 'Comparison of driving performance on-road and in a low-cost simulator using a concurrent telephone dialling task', Ergonomics, Vol. 42, No. 8, pp.1015-1037. (Pubitemid 29401736)
68. Rizzolatti, G., Fadiga, L., Fogassi, L. and Gallese, V. (1997) 'The space around us', Science, Vol. 277, No. 5323, pp.190-191.
69. Schiffman, S.S. and Seibert, J.M. (1991) 'New frontiers in fragrance use', Cosmetics and Toiletries, Vol. 106, No. 6, pp.39-45.
70. Schleicher, R., Galley, N., Briest, S. and Galley, L. (2008) 'Blinks and saccades as indicators of fatigue in sleepiness warnings: looking tired?', Ergonomics, Vol. 51, No. 7, pp.982-1010. (Pubitemid 351910910)
71. Shapiro, K.L. and Johnson, T.L. (1987) 'Effects of arousal on attention to central and peripheral visual stimuli', Acta Psychologica, Vol. 66, No. 2, pp.157-172.
72. Shapiro, K.L. and Lim, A. (1989) 'The impact of anxiety on visual attention to central and peripheral events', Behaviour Research and Therapy, Vol. 27, No. 4, pp.345-351. (Pubitemid 19206443)
73. Shapiro, K.L., Egerman, B. and Klein, R.M. (1984) 'Effects of arousal on human visual dominance', Perception & Psychophysics, Vol. 35, No. 6, pp.547-552. (Pubitemid 14031365)
74. Spence, C. (2002) The ICI Report on the Secret of the Senses, The Communication Group, London.
75. Spence, C. (2007) 'Audiovisual multisensory integration', Acoustical Science & Technology, Vol. 28, No. 2, pp.61-70. (Pubitemid 46457224)
76. Spence, C. and Driver, J. (Eds.) (2004) Crossmodal Space and Crossmodal Attention, Oxford University Press, Oxford.
77. Spence, C. and Ho, C. (2008a) 'Multisensory interface design for drivers: past, present and future', Ergonomics, Vol. 51, No. 1, pp.65-70.
78. Spence, C. and Ho, C. (2008b) 'Tactile and multisensory spatial warning signals for drivers', IEEE Transactions on Haptics, Vol. 1, No. 2, pp.121-129.
79. Spence, C. and Soto-Faraco, S. (2009) 'Auditory perception: interactions with vision', in Plack, C. (Ed.): Auditory Perception, pp.271-296, Oxford University Press, Oxford.
80. Susami, K., Oshima, C., Muto, K., Ando, H. and Matsuo, N. (2011) 'Stimulation with an intermittent fragrance relieves the sleepiness of a driver', Poster presented at the 12th International Multisensory Research Forum, Fukuoka, Japan.
81. Van Damme, S., Crombez, G. and Spence, C. (2009) 'Is visual dominance modulated by the threat value of visual and auditory stimuli?', Experimental Brain Research, Vol. 193, No. 2, pp.197-204.
82. Van Damme, S., Gallace, A., Spence, C., Crombez, G. and Moseley, G.L. (2009) 'Does the sight of physical threat induce a tactile processing bias?: Modality-specific attentional facilitation induced by viewing threatening pictures', Brain Research, Vol. 1253, No. 2, pp.100-106.
83. Van Steenbergen, H., Band, G.P.H. and Hommel, B. (2011) 'Threat but not arousal narrows attention: Evidence from pupil dilation and saccade control', Frontiers in Psychology, Vol. 2, No. 281, pp.1-5.
84. Vitaterna, M.H., Takahashi, J.S. and Turek, F.W. (2001) 'Overview of circadian rhythms', Alcohol Research & Health, Vol. 25, No. 2, pp.85-93. (Pubitemid 33709357)
85. Welch, R.B. and Warren, D.H. (1980) 'Immediate perceptual response to intersensory discrepancy', Psychological Bulletin, Vol. 8, No. 3, pp.638-667.
86. Welch, R.B. and Warren, D.H. (1986) 'Intersensory interactions', in Boff, K.R., Kaufman, L. and Thomas, J.P. (Eds.): Handbook of Perception and Performance: Vol. 1. Sensory Processes and Perception, pp.25-1-25-36, Wiley, New York.
87. Wells-Parker, E., Ceminsky, J., Hallberg, V., Snow, R.W., Dunaway, G. and Guiling, S. et al. (2002) 'An exploratory study of the relationship between road rage and crash experience in a representative sample of US drivers', Accident Analysis & Prevention, Vol. 34, No. 3, pp.271-278. (Pubitemid 34097310)
88. Westermann, R., Spies, K., Stahl, G. and Hesse, F.W. (1996) 'Relative effectiveness and validity of mood induction procedures: a meta-analysis', European Journal of Social Psychology, Vol. 26, No. 4, pp.557-580.
89. Whalen, P.J. (1998) 'Fear, vigilance, and ambiguity: initial neuroimaging studies of the human amygdala', Current Directions in Psychological Science, Vol. 7, No. 6, pp.177-188. (Pubitemid 128188166)
90. Wiesenthal, D.L., Hennessy, D.A. and Totten, B. (2003) 'The influence of music on mild driver aggression', Transportation Research Part F: Traffic Psychology and Behaviour, Vol. 6, No. 2, pp.125-134. (Pubitemid 36946061)
91. Wright, K.P. and Czeisler, C.A. (2002) 'Absence of circadian phase resetting in response to bright light behind the knees', Science, Vol. 297, No. 5581, p.571. (Pubitemid 34815335)
92. Yates, A., Ashwin, C. and Fox, E. (2010) 'Does emotion processing require attention? The effects of fear conditioning and perceptual load', Emotion, Vol. 10, No. 6, pp.822-830.
93. Yoshida, M., Kato, C., Kakamu, Y., Kawasumi, M., Yamasaki, H. and Yamamoto, S. et al. (2011) 'Study on stimulation effects for driver based on fragrance presentation', IAPR Conference on Machine Vision Applications, pp.9-26.