Emotion on the road-Necessity, acceptance, and feasibility of affective computing in the car

Advances in Human-Computer Interaction

Volumn 2010, Issue , 2010, Pages

  Eyben, Florian ^a   Wöllmer, Martin ^a   Poitschke, Tony ^a   Schuller, Björn ^a   Blaschke, Christoph ^b   Färber, Berthold ^b   Nguyen Thien, Nhu ^c  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

^b BUNDESWEHR UNIVERSITY MUNICH   (Germany)

^c Advanced Development and Innovation ^*  (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 78349247917     PISSN: 16875893     EISSN: 16875907     Source Type: Journal    
DOI: 10.1155/2010/263593     Document Type: Review

References (95)

1. PROSPER, Prosper final report, project for research on speed adaptation policies on european roads Tech. Rep. Project no. May 2006 GRD2200030217
2. Takeda K., Erdogan H., Hansen J. H. L., Abut H., In-Vehicle Corpus and Signal Processing for Driver Behavior 2009 Berlin, Germany Springer
3. Bubb H., Fahrerassistenz primr ein Beitrag zum Komfort oder fr die Sicherheit? VDI Berichte 2003 1768 25 44
4. Batliner A., Burkhardt F., van Ballegooy M., Nth E., A taxonomy of applications that utilize emotional awareness Proceedings of the 1st International Language Technologies Conference (IS-LTC '06) 2006 Ljubljana, Slovenia 246 250
5. Jones C. M., Jonsson I. M., Automatic recognition of affective cues in the speech of car drivers to allow appropriate responses 122 Proceedings of the 17th Australia Conference on Computer-Human Interaction: Citizens Online (OZCHI '05) 2005 Canberra, Australia 1 10
6. Bower G. H., Mood and memory American Psychologist 1981 36 2 129 148
7. Singer J. A., Salovey P., Mood and memory: evaluating the network theory of affect Clinical Psychology Review 1988 8 2 211 251
8. Zajonc R. B., On the primacy of affect American Psychologist 1984 39 2 117 123
9. Damasio A. R., Descartes' Error: Emotion, Reason and the Human Brain 1994 New York, NY, USA Avon Books
10. LeDoux J. E., Brain mechanisms of emotion and emotional learning Current Opinion in Neurobiology 1992 2 2 191 197
11. Derryberry D., Tucker D. M., Neural mechanisms of emotion Journal of Consulting and Clinical Psychology 1992 60 3 329 338
12. Colquitt J. A., LePine J. A., Noe R. A., Toward an integrative theory of training motivation: a meta-analytic path analysis of 20 years of research Journal of Applied Psychology 2000 85 5 678 707
13. Frijda N., The Emotions 1986 New York, NY, USA Cambridge University Press
14. Birdwhistle R., Kinesics and Context: Essays on Body Motion and Communication 1970 Philadelphia, Pa, USA University of Pennsylvania Press
15. Ekman P., Friesen W. V., Unmasking the Face: A Guide to Recognizing Emotions from Facial Expressions 1975 Englewood Cliffs, NJ, USA Prentice Hall
16. Chovil N., Discourse-oriented facial displays in conversation Research on Language and Social Interaction 1991 25 163 194
17. Goleman D., Emotional Intelligence 1995 New York, NY, USA Bantam Books
18. Groeger J. A., Understanding Driving: Applying Cognitive Psychology to a Complex Everyday Task 2000 Routledge Chapman Hall Frontiers of Cognitive Science
19. Grimm M., Kroschel K., Harris H., Nass C., Schuller B., Rigoll G., Moosmayr T., On the necessity and feasibility of detecting a driver's emotional state while driving 4738 Proceedings of the 2nd International Conference on Affective Computing and Intelligent Interaction 2007 Lisbon, Portugal Springer 126 138 Lecture Notes in Computer Science
20. James L., Nahl D., Road Rage and Agressive Driving 2000 Amherst, NY, USA Prometheus Books
21. Wells-Parker E., Ceminsky J., Hallberg V., Snow R. W., Dunaway G., Guiling S., Williams M., Anderson B., An exploratory study of the relationship between road rage and crash experience in a representative sample of US drivers Accident Analysis and Prevention 2002 34 3 271 278
22. Cai H., Lin Y., Mourant R. R., Study on driver emotion in driver-vehicle-environment systems using multiple networked driving simulators Proceedings of the Driving Simulation Conference May 2007
23. Hennessy D. A., Wiesenthal D. L., The relationship between traffic congestion, driver stress and direct versus indirect coping behaviours Ergonomics 1997 40 3 348 361
24. Deffenbacher J. L., Oetting E. R., Lynch R. S., Development of a driving anger scale Psychological Reports 1994 74 1 83 91
25. Yerkes R. M., Dodson J. D., The relation of strength of stimulus to rapidity of habit-formation Journal of Comparative Neurology and Psychology 1908 18 459 482
26. Lyznicki J. M., Doege T. C., Davis R. M., Williams M. A., Sleepiness, driving, and motor vehicle crashes Journal of the American Medical Association 1998 279 23 1908 1913
27. Braver E. R., Preusser C. W., Preusser D. F., Baum H. M., Beilock R., Ulmer R., Long hours and fatigue: a survey of tractor-trailer drivers Journal of Public Health Policy 1992 13 3 341 366
28. Corfitsen M. T., Tiredness and visual reaction time among young male nighttime drivers: a roadside survey Accident Analysis and Prevention 1994 26 5 617 624
29. Marcus C. L., Loughlin G. M., Effect of sleep deprivation on driving safety in housestaff Sleep 1996 19 10 763 766
30. McCartt A. T., Ribner S. A., Pack A. I., Hammer M. C., The scope and nature of the drowsy driving problem in New York state Accident Analysis and Prevention 1996 28 4 511 517
31. Matthews G., Dorn L., Hoyes T. W., Davies D. R., Glendon A. I., Taylor R. G., Driver stress and performance on a driving simulator Human Factors 1998 40 1 136 149
32. Rakauskas M. E., Gugerty L. J., Ward N. J., Effects of naturalistic cell phone conversations on driving performance Journal of Safety Research 2004 35 4 453 464
33. Banuls R., Montoro L., Barjone P.-E., Motivational and emotional aspects involved in driving Traffic Psychology Today 2001 chapter 8 Berlin, Germany Springer 138 318
34. Ball K., Rebok G., Evaluating the driving ability of older adults Journal of Applied Gerontology 1994 13 1 20 38
35. MacDonald S., Mann R., Chipman M., Driving behaviour under the influence of cannabis and cocaine Traffic Injury Prevention 2008 9 3 190 194
36. Li X., Ji Q., Active affective state detection and user assistance with dynamic bayesian networks IEEE Transactions on Systems, Man, and Cybernetics, Part A 2005 35 1 93 105
37. Dula C. S., Geller E. S., Risky, aggressive, or emotional driving: addressing the need for consistent communication in research Journal of Safety Research 2003 34 5 559 566
38. Stecklov G., Goldstein J. R., Terror attacks influence driving behavior in Israel Proceedings of the National Academy of Sciences of the United States of America 2004 101 40 14551 14556
39. Healey J., Picard R., Smart car: detecting driver stress 4 Proceedings of the 15th International Conference on Pattern Recognition (ICPR '00) 2000 218 221
40. Grimm M., Kroschel K., Schuller B., Rigoll G., Moosmayr T., Acoustic emotion recognition in car environment using a 3d emotion space approach Proceedings of the 33rd Deutsche Jahrestagung fr Akustik (DAGA '07) March 2007 Stuttgart, Germany DEGA 313 314
41. Jonsson I. M., Nass C., Harris H., Takayama L., Matching in-car voice with drivers state: impact on attitude and driving performance Proceedings of the 3rd International Driving Symposium on Human Factors in Driver Assessment, Training and Vehicle Design June 2005 Rockport, Me, USA 173 181
42. Nass C., Jonsson I.-M., Harris H., Improving automotive safety by pairing driver emotion and car voice emotion Proceedings of the Conference on Human Factors in Computing Systems (CHI '05) 2005 Portland, Ore, USA ACM 1973 1976
43. Uchiyama Y., Kojima S., Hongo T., Terashima R., Wakita T., Voice information system that adapts to driver's mental workload RD Review of Toyota CRDL 2004 39 1 16 22
44. Hoch S., Althoff F., McGlaun G., Rigoll G., Bimodal fusion of emotional data in an automotive environment 2 Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP '05) March 2005 Philadelphia, Pa, USA 1085 1088
45. Jones C. M., Jonsson I. M., Performance analysis of acoustic emotion recognition for in-car conversational interfaces Universal Access in Human-Computer Interaction. Ambient Interaction, Part II 2007 4555 Berlin, Germany Springer 411 420 Lecture Notes in Computer Science
46. Jonsson I. M., Zajicek M., Harris H., Nass C., Thank you, i did not see that: in-car speech based information systems for older adults Proceedings of the Conference on Human Factors in Computing Systems (CHI '05) 2005 Portland, Ore, USA 1953 1956
47. Jonsson I. M., Nass C., Endo J., Don't blame me i am only the driver: impact of blame attribution on attitudes and attention to driving task Proceedings of the Conference on Human Factors in Computing Systems (CHI '04) 2004 Vienna, Austria 1219 1222
48. Schuller B., Stadermann J., Rigoll G., Affect-robust speech recognition by dynamic emotional adaptation Proceedings of the International Conference on Speech Prosody 2006 Dresden, Germany ISCA
49. Furui. S., Robust methods in automatic speech recognition and understanding Proceedings of European Conference on Speech Communication and Technology (EUROSPEECH '03) September 2003 Geneva, Switzerland ISCA 1993 1998
50. Athanaselis T., Bakamidis S., Dologlou I., Automatic recognition of emotionally coloured speech Proceedings of the Transactions on Engineering, Computing and Technology (ICCS '06) March 2006 Vienna, Austria 274 277
51. Zeng Z., Tu J., Liu M., Huang T. S., Pianfetti B., Roth D., Levinson S., Audio-visual affect recognition IEEE Transactions on Multimedia 2007 9 2 424 428
52. Fernandez R., A computational model for the automatic recognition of affect in speech, Ph.D. thesis 2004 MIT Media Arts and Science
53. Schuller B., Seppi D., Batliner A., Maier A., Steidl S., Towards more reality in the recognition of emotional speech 4 Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP '07) 2007 Honolulu, Hawaii, USA 941 944
54. Batliner A., Steidl S., Hacker C., Nth E., Private emotions versus social interactiona data-driven approach towards analysing emotion in speech User Modelling and User-Adapted Interaction 2008 18 1-2 175 206
55. Kollias S. D., Karpouzis K., Multimodal emotion recognition and expressivity analysis Proceedings of the IEEE International Conference on Multimedia and Expo (ICME '05) Amsterdam, The Netherlands 779 783
56. Caridakis G., Castellano G., Kessous L., Raouzaiou A., Malatesta L., Asteriadis S., Karpouzis K., Multimodal emotion recognition from expressive faces, body gestures and speech 247 Proceedings the 4th IFIP International Conference on Artificial Intelligence Applications and Innovations (AIAI '07) 2007 375 388 IFIP International Federation for Information Processing
57. Kim J., Andr E., Emotion recognition using physiological and speech signal in short-term observation 4021 Proceedings of the International Tutorial and Research Workshop on Perception and Interactive Technologies (PIT '06) June 2006 Kloster Irsee, Germany 53 64 Lecture Notes in Computer Science
58. Hnig F., Wagner J., Batliner A., Nth E., Stewart B., Weiss S., Classification of user states with physiological signals: on-line generic features vs. specialized 15 Proceedings of the 17th European Signal Processing Conference (EUSIPCO '09) 2009 Glasgow, UK 2357 2316
59. Andr E., Chai J. Y., Workshop: eye gaze in intelligent human machine interaction Proceedings of the International Conference on Intelligent User Interfaces 2010 Hong Kong 431 432
60. Eyben F., Wllmer M., Graves A., Schuller B., Douglas-Cowie E., Cowie R., On-line emotion recognition in a 3-D activation-valence-time continuum using acoustic and linguistic cues Journal on Multimodal User Interfaces 2010 3 1 7 19
61. Steidl S., Schuller B., Batliner A., Seppi D., The hinterland of emotions: facing the open-microphone challenge 1 Proceedings of the 4th International HUMAINE Association Conference on Affective Computing and Intelligent Interaction (ACII '09) 2009 Amsterdam, The Netherlands IEEE 690 697
62. Busso C., Deng Z., Yildirim S., Bulut M., Lee C. M., Kazemzadeh A., Lee S., Neumann U., Narayanan S., Analysis of emotion recognition using facial expressions, speech and multimodal information Proceedings of the 6th International Conference on Multimodal Interfaces October 2004 State College, Pa, USA 205 211
63. Cohen I., Ashutosh G., Huang T. S., Emotion recognition from facial expressions using multilevel hmm Neural Information Processing Systems 2000
64. Schuller B., Mller R., Eyben F., Being bored? Recognising natural interest by extensive audiovisual integration for real-life application Image and Vision Computing 2009 27 12 1760 1774
65. Katsis C. D., Katertsidis N., Ganiatsas G., Fotiadis D. I., Toward emotion recognition in car-racing drivers: a biosignal processing approach IEEE Transactions on Systems, Man, and Cybernetics, Part A 2008 38 3 502 512
66. Paul-Stueve T., Driver Activity Recognition from Sitting Postures 2007 Weimar, Germany Bauhaus-Universitt Weimar
67. Bernsen N. O., Dybkjr L., A multimodal virtual codriver's problems with the driver Proceedings of the ISCA Tutorial and Research Workshop on Spoken Dialogue in Mobile Environments 2002 Bonn, Germany ISCA 15
68. Bachfischer K., Henze S., Wller C., Reichardt D., Levi P., Meyer J.-J. C., Emotional user interfaces in the car Proceedings of the 1st Workshop on Emotion and ComputingCurrent Research and Future Impact June 2006 Bremen, Germany 55 59
69. Sasayuki T., Shin K., Shin Y., A driver-adaptive driver assistance system. A case of human-centered its view aid system Nippon Kikai Gakkai Robotikusu, Mekatoronikusu Koenkai Koen Ronbunshu 2004 2A1 L2-4. (CD-ROM)
70. Tischler M. A., Perter C., Batliner A., Wimmer M., Voskamp J., Application of emotion recognition methods in automotive research 1 Proceedings of the 2nd Workshop on Emotion and ComputingCurrent Research and Future Impact 2007 Osnabrck, Germany 55 60
71. Ablassmeier M., Poitschke T., Rigoll G., A new approach of a context-adaptive search agent for automotive environments Extended Abstracts on Human Factors in Computing Systems (CHI '06) April 2006 New York, NY, USA ACM Press 1613 1618
72. Wang S. B., Demirdjian D., Darrell T., Kjellstrm H., Multimodal communication error detection for driver-car interaction Proceedings of the 4th International Conference on Informatics in Control, Automation and Robotics (ICINCO '07) May 2007 Angers, France 365 371
73. Althoff F., McGlaun G., Schuller P., Lang M., Rigoll G., Callaos N., Porter J. H., Rishe N., Evaluating misinterpretations during human-machine communication in automotive environments 7 Proceedings of the 6th World Multiconference on Systemics, Cybernetics and Informatics (SCI '02) 2002 Orlando, Fla, USA 13 17
74. Amditis A., Polychronopoulos A., Bekiaris E., Antonello P. C., System architecture of a driver's monitoring and hypovigilance warning system 2 Proceedings of the Intelligent Vehicle Symposium March 2003 Athens, Greece IEEE 527 532
75. Lisetti C. L., Nasoz F., Affective intelligent car interfaces with emotion recognition 2 Proceedings of the of the 11th International Conference on Human Computer Interaction (HCI '00) July 2005 Las Vegas, Nev, USA
76. Kostov V., Fukuda S., Emotion in user interface, voice interaction system 2 Proceedings of the IEEE International Conference on Systems, Man and Cybernetics 2000 Nashville, Tenn, USA 798 803
77. Angelucci F., Ricci E., Padua L., Sabino A., Tonali P. A., Music exposure differentially alters the levels of brain-derived neurotrophic factor and nerve growth factor in the mouse hypothalamus Neuroscience Letters 2007 429 2-3 152 155
78. Sheehy N., User-interface requirements for elderly people 2000 School of Psychology, The Queen's University of Belfast
79. Cahn J. E., The generation of affect in synthesized speech Journal of the American Voice I/O Society 1990 8 5 1 19
80. Murray I. R., Arnott J. L., Implementation and testing of a system for producing emotion-by-rule in synthetic speech Speech Communication 1995 16 4 369 390
81. Burkhardt F., Sendlmeier W. F., Verification of acoustical correlates of emotional speech using formant synthesis Proceedings of the ICSA Workshop on Speech and Emotion 2000 Belfast, Northern Ireland ISCA 151 156
82. Mozziconacci S. J. L., Speech variability and emotion: production and perception, Ph.D. thesis 1998 echnical University Eindhoven
83. Kuhn F., Methode zur Bewertung der Fahrerablenkung durch Fahrerinformationssysteme. April 2010, http://www.gui-design.de/download/ wudLCT2005-11Stuttgart.pdf
84. Brooke J., SUSa quick and dirty usability scale 1986 Redhatch Consulting
85. Eilers K., Nachreiner F., Hnecke K., Entwicklung und berprfung einer Skala zur Erfassung subjektiv erlebter Anstrengung Zeitschrift fr Arbeitswissenscahft 1986 40 215 224
86. Wang J., Knipling R., Goodman M., The role of driver inattention in crashes; new statistics from the 1995 crashworthiness data system (CDS) Proceedings of the Annual Conference of the Association for the Advancement of Automotive Medicine 1996 Des Plaines, Ill, USA
87. Ranney T., Mazzae E., Garrott R., Goodman M., NHTSA driver distraction research: past, present and future 2000 Washington, DC, USA National Highway Traffic Safety Administration
88. Alkim T. P., Bootsma G., Hoogendoorn S. P., Field operational test the assisted driver Proceedings of the IEEE Intelligent Vehicles Symposium 2007 Instanbul, Turkey 1198 1203
89. Hochreiter S., Schmidhuber J., Long short-term memory Neural Computation 1997 9 8 1735 1780
90. Graves A., Schmidhuber J., Framewise phoneme classification with bidirectional LSTM and other neural network architectures Neural Networks 2005 18 5-6 602 610
91. Wllmer M., Eyben F., Schuller B., Douglas-Cowie E., Cowie R., Data-driven clustering in emotional space for affect recognition using discriminatively trained LSTM networks Proceedings of the 10th Annual Conference of the International Speech Communication Association (INTERSPEECH '09) September 2009 Brighton, UK 1595 1598
92. Blaschke C., Breyer F., Frber B., Freyer J., Limbacher R., Driver distraction based lane-keeping assistance Transportation Research Part F 2009 12 4 288 299
93. Young K., Regan M., Hammer M., Driver distraction: a review of literature 2003 Monash University Accident Research Center
94. Graves A., Supervised sequence labelling with recurrent neural network, Ph.D. thesis 2008 Technische Universitt Mnchen
95. Shriberg E. E., Spontaneous speech: how people really talk and why engineers should care Proceedings of the 9th European Conference on Speech Communication and Technology (EUROSPEECH '05) 2005 ISCA 1781 1784