Analysis and detection of cognitive load and frustration in drivers' speech

Proceedings of the 11th Annual Conference of the International Speech Communication Association, INTERSPEECH 2010

Volumn , Issue , 2010, Pages 502-505

  Bořil, Hynek ^a   Sadjadi, Seyed Omid ^a   Kleinschmidt, Tristan ^b   Hansen, John H L ^a  

^a The University of Texas at Dallas   (United States)

^b QUEENSLAND UNIVERSITY OF TECHNOLOGY   (Australia)

Author keywords

Automatic classification; Cognitive load; Emotions; Speech production variations

Indexed keywords

ACTIVE SAFETY SYSTEMS; SPEECH; SPEECH COMMUNICATION; COGNITIVE SYSTEMS; SECURITY SYSTEMS;

AUTOMATIC CLASSIFICATION; COGNITIVE LOADS; EMOTION CLASSIFICATION; EMOTION DETECTION; EMOTIONS; SPEECH PRODUCTION; SPOKEN DIALOG SYSTEMS; VEHICLE INTERFACE; COGNITIVE TASK; DRIVER CAPABILITY; EMOTION; EMOTIONAL STATE; PRODUCTION VARIATIONS; SPEECH PRODUCTION VARIATION;

COGNITIVE SYSTEMS; SPEECH RECOGNITION;

EID: 79959827405     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (18)

1. B. Magladry and D. Bruce, In-Vehicle Corpus and Signal Processing for Driver Behavior. USA: Springer, 2008, ch. Improved Vehicle Safety and How Technology Will Get US There, Hopefully). K. Takeda, H. Erdogan, J. H. L. Hansen, H. Abut (Eds.), pp. 1-8.
2. H. Cai, Y. Lin, and R. R. Mourant, "Study on driver emotion in driver-vehicle-environment systems using multiple networked driving simulators," in Proc. Driving Simulation Conference - North America 2009, Iowa City, Iowa, 2007.
3. R. Cowie, E. Douglas-Cowie, N. Tsapatsoulis, G. Votsis, S. Kollias, W. Fellenz, and J. Taylor, "Emotion recognition in human-computer interaction," IEEE Sig. Proc. Mag., vol. 18, no. 1, pp. 32-80, 2001. (Pubitemid 32287669)
4. C. M. Lee and S. S. Narayanan, "Toward detecting emotions in spoken dialogs," IEEE Trans. on Speech & Audio Processing, vol. 13, no. 2, pp. 293-303, 2005. (Pubitemid 40320247)
5. W. Kim and J. H. L. Hansen, "Angry emotion detection from reallife conversational speech by leveraging content structure," in IEEE ICASSP'10, Dallas, TX, 2010, pp. 5166-5169.
6. B. Schuller, S. Steidl, and A. Batliner, "The INTERSPEECH 2009 emotion challenge," in INTERSPEECH'09, Brighton, pp. 312-315.
7. J. H. L. Hansen, "Analysis and compensation of speech under stress and noise for environmental robustness in speech recognition," Speech Comm., vol. 20, no. 1-2, pp. 151-173, 1996. (Pubitemid 126371283)
8. B. Yin, N. Ruiz, F. Chen, and M. A. Khawaja, "Automatic cognitive load detection from speech features," in OZCHI '07: Proc. of the 19th Australasian conference on Computer-Human Interaction. New York, NY, USA: ACM, 2007, pp. 249-255.
9. J. Wang and Y. Gong, "Normalizing multi-subject variation for drivers' emotion recognition," in Proc. IEEE Int. Conf. on Multimedia and Expo 2009, NY, USA, 2009, pp. 354-357.
10. L. J. M. Rothkrantz, R. Horlings, and Z. Dharmawan, "Recognition of emotional states of car drivers by EEG analysis," Neural Network World; International Journal on Neural and Mass - Parallel Computing and Information Systems, vol. 19, no. 1, pp. 119-128, 2009.
11. R. Fernandez and R. W. Picard, "Modeling drivers' speech under stress," Speech Communication, vol. 40, no. 1-2, pp. 145-159, 2003.
12. C. M. Jones and I.-M. Jonsson, Universal Access in HumanComputer Interaction. Ambient Interaction. Berlin/Heidelberg: Springer, 2007, ch. Performance Analysis of Acoustic Emotion Recognition for In-Car Conversational Interfaces. W.B. Kleijn and K.K. Paliwal (Eds.), pp. 411-420.
13. T. Kleinschmidt, P. Boyraz, H. Bořil, S. Sridharan, and J. H. L. Hansen, "Assessment of speech dialog systems using multi-modal cognitive load analysis and driving performance metrics," in IEEE International Conference on Vehicular Electronics and Safety ICVES'09, Pune, India, November 2009, pp. 167-172.
14. H. Bořil, T. Kleinschmidt, P. Boyraz, and J. H. L. Hansen, "Impact of cognitive load and frustration on drivers' speech." The Journal of the Acoust. Soc. of America, vol. 127, no. 3, pp. 1996-1996, 2010.
15. P. Angkititrakul, M. Petracca, A. Sathyanarayana, and J. Hansen, "UTDrive: Driver behavior and speech interactive systems for in-vehicle environments," in Proc. of the IEEE Intelligent Vehicle Symposium, June 2007, pp. 566-569.
16. Z. Callejas and R. López-Cózar, "Influence of contextual information in emotion annotation for spoken dialogue systems," Speech Communication, vol. 50, no. 5, pp. 416 - 433, 2008.
17. J. Volín and D. Studenovský, "Normalization of Czech vowels from continuous read texts," in Proc. of 16th Int. Congress of Phonetic Sciences (ICPhS XVI), Saarbrücken, Germany, 2007, pp. 185-190.
18. S. E. Bou-Ghazale and J. H. L. Hansen, "A comparative study of traditional and newly proposed features for recognition of speech under stress," IEEE Trans. on Speech & Audio Proc., vol. 8, no. 4, pp. 429-442, 2000.