Classification of cognitive Load from Speech using an i-vector framework

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn , Issue , 2014, Pages 751-755

  Van Segbroeck, Maarten ^a   Travadi, Ruchir ^a   Vaz, Colin ^a   Kim, Jangwon ^a   Black, Matthew P ^b,c   Potamianos, Alexandros ^a,c   Narayanan, Shrikanth S ^a,c  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^b UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^c Behavioral Informatix LLC   (United States)

Author keywords

ASR; Behavioral signal processing (BSP); Cognitive load; Computational paralinguistics; I vector; Prosody

Indexed keywords

ARTIFICIAL INTELLIGENCE; HIERARCHICAL SYSTEMS; LEARNING SYSTEMS; SIGNAL PROCESSING; SPEECH COMMUNICATION;

ASR; BEHAVIORAL SIGNAL PROCESSING (BSP); COGNITIVE LOADS; I VECTORS; PARALINGUISTICS; PROSODY;

SPEECH RECOGNITION;

EID: 84910088716     PISSN: 2308457X     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (36)

1. T. F. Yap, "Speech production under cognitive load: Effects and classification, " Ph.D. dissertation, The University of New South Wales, 2012.
2. P. N. Le and E. Choi, "The use of spectral information in the development of novel techniques for speech-based cognitive load classification, " Ph.D. dissertation, School of Electrical Engineering and Telecommunications, The University of New South Wales, Australia, 2012.
3. M. Charfuelan and G.-J. Kruijff, "Analysis of speech under stress and cognitive load in USAR operations, " in Natural Interaction with Robots, Knowbots and Smartphones, 2014, pp. 275-281.
4. K. Huttunen, H. Keränen, E. Väyrynen, R. Pääkkönen, and T. Leino, "Effect of cognitive load on speech prosody in aviation: Evidence from military simulator flights, " Applied Ergonomics, vol. 42, no. 2, pp. 348-357, 2011.
5. P. N. Le, E. Ambikairajah, J. Epps, V. Sethu, and E. H. C. Choi, "Investigation of spectral centroid features for cognitive load classification, " Speech Communication, vol. 53, no. 4, pp. 540-551, 2011.
6. H. Boril, S. O. Sadjadi, T. Kleinschmidt, and J. H. L. Hansen, "Analysis and detection of cognitive load and frustration in drivers' speech, " in Proc. Interspeech, 2010.
7. T. F. Yap, J. Epps, E. H. Choi, and E. Ambikairajah, "Glottal features for speech-based cognitive load classification, " in Proc. IEEE ICASSP, 2010.
8. A. Jameson, J. Kiefer, C. Müller, B. Großmann-Hutter, F. Wittig, and R. Rummer, "Assessment of a user's time pressure and cognitive load on the basis of features of speech, " in Resource-Adaptive Cognitive Processes, 2010, pp. 171-204.
9. S. S. Narayanan and P. G. Georgiou, "Behavioral Signal Processing: Deriving human behavioral informatics from speech and language, " Proc. of IEEE, vol. 101, no. 5, pp. 1203-1233, 2013.
10. M. P. Black, A. Katsamanis, B. Baucom, C.-C. Lee, A. Lammert, A. Christensen, P. G. Georgiou, and S. S. Narayanan, "Toward automating a human behavioral coding system for married couples' interactions using speech acoustic features, " Speech Communication, vol. 55, no. 1, pp. 1-21, 2013.
11. B. Xiao, P. G. Georgiou, Z. E. Imel, D. Atkins, and S. S. Narayanan, "Modeling therapist empathy and vocal entrainment in drug addition counseling, " in Proc. Interspeech, 2013.
12. D. Bone, M. Li, M. P. Black, and S. S. Narayanan, "Intoxicated speech detection: A fusion framework with speakernormalized hierarchical functionals and GMM supervectors, " Computer Speech and Language, vol. 28, no. 2, pp. 375-391, 2014.
13. J. Kim, N. Kumar, A. Tsiartas, M. Li, and S. S. Narayanan, "Intelligibility classification of pathological speech using fusion of multiple high level descriptors, " in Proc. Interspeech, 2012.
14. R. Gupta, K. Audhkhasi, S. Lee, and S. S. Narayanan, "Speech paralinguistic event detection using probabilistic time-series smoothing and masking, " in Proc. Interspeech, 2013.
15. B. Schuller, S. Steidl, A. Batliner, J. Epps, F. Eyben, F. Ringeval, E. Marchi, and Y. Zhang, "The INTERSPECH 2014 computational paralinguistics challenge: Cognitive & physical load, " in Proc. Interspeech, Singapore, Singapore, 2014.
16. M. Daneman and P. A. Carpenter, "Individual differences in working memory and reading, " Journal of Verbal Learning and Verbal Behavior, vol. 19, no. 4, pp. 450-466, 2005.
17. J. R. Stroop, "Studies of interference in serial verbal reactions, " Journal of Experimental Psychology, vol. 18, no. 6, p. 643, 1935.
18. J. Sohn, N. S. Kim, andW. Sung, "A statistical model-based voice activity detection, " Signal Processing Letters, vol. 6, no. 1, pp. 1-3, Jan 1999.
19. W. Wang, P. Lu, and Y. Yan, "An improved hierarchical speaker clustering, " ACTA ACUSTICA, 2008.
20. K. J. Han, S. Kim, and S. S. Narayanan, "Strategies to improve the robustness of agglomerative hierarchical clustering under data source variation for speaker diarization, " IEEE Trans. Audio, Speech, and Language Processing, vol. 16, no. 8, pp. 1590- 1601, 2008.
21. P. P. G. Boersma, "Praat, a system for doing phonetics by computer, " Glot International, vol. 5, no. 9/10, pp. 341-345, 2001.
22. D. Povey, A. Ghoshal, G. Boulianne, L. Burget, O. Glembek, N. Goel, M. Hannemann, P. Motlicek, Y. Qian, P. Schwarz, J. Silovsky, G. Stemmer, and K. Vesely, "The Kaldi speech recognition toolkit, " in Proc. ASRU, 2011.
23. T. Anastasakos, J. McDonough, R. Schwartz, and J. Makhoul, "A compact model for speaker-adaptive training, " in Proc. ICSLP, 1996.
24. N. Dehak, P. J. Kenny, R. Dehak, P. Dumouchel, and P. Ouellet, "Front-end factor analysis for speaker verification, " IEEE Trans. Audio, Speech, and Language Processing, vol. 19, no. 4, pp. 788- 798, 2011.
25. P. Kenny, G. Boulianne, and P. Dumouchel, "Eigenvoice modeling with sparse training data, " IEEE Trans. Audio, Speech, and Language Processing, vol. 13, no. 3, pp. 345-354, 2005.
26. P. Kenny, G. Boulianne, P. Ouellet, and P. Dumouchel, "Joint factor analysis versus eigenchannels in speaker recognition, " IEEE Trans. Audio, Speech, and Language Processing, vol. 15, no. 4, pp. 1435-1447, 2007.
27. H. Hermansky, "Perceptual linear predictive (PLP) analysis of speech, " Journal of the Acoustical Society of America, vol. 87, no. 4, pp. 1738-1752, Apr. 1990.
28. M. Kleinschmidt, "Spectro-temporal Gabor features as a front end for ASR, " in Proc. Forum Acusticum Sevilla, 2002.
29. F. Eyben, M. Wöllmer, and B. Schuller, "OpenSMILE - The Munich versatile and fast open-source audio feature extractor, " in ACM Multimedia, Firenze, Italy, 2010, pp. 1459-1462.
30. B. Schuller, S. Steidl, A. Batliner, F. Schiel, and J. Krajewski, "The INTERSPEECH 2011 Speaker State Challenge, " in Proc. Interspeech, 2011.
31. M. Van Segbroeck, A. Tsiartas, and S. S. Narayanan, "A robust frontend for VAD: Exploiting contextual, discriminative and spectral cues of human voice, " in Proc. Interspeech, 2013.
32. M. Li, A. Tsiartas, M. Van Segbroeck, and S. S. Narayanan, "Speaker verification using simplified and supervised i-vector modeling, " in Proc. IEEE ICASSP, 2013.
33. M. Li and S. S. Narayanan, "Simplified supervised i-vector modeling with application to robust and efficient language identification and speaker verification, " Computer Speech and Language, 2014.
34. N. Dehak, P. A. Torres-Carrasquillo, D. A. Reynolds, and R. Dehak, "Language recognition via i-vectors and dimensionality reduction." in Proc. Interspeech, 2011.
35. B. Schuller, F. Friedmann, and F. Eyben, "The Munich Biovoice Corpus: Effects of physical exercising, heart rate, and skin conductance on human speech production, " in Language Resources and Evaluation Conference, 2014.
36. V. Rozgić, B. Xiao, A. Katsamanis, B. Baucom, P. G. Georgiou, and S. S. Narayanan, "Estimation of ordinal approachavoidance labels in dyadic interactions: Ordinal logistic regression approach, " in Proc. IEEE ICASSP, 2011.