Investigation of spectral centroid features for cognitive load classification

Speech Communication

Volumn 53, Issue 4, 2011, Pages 540-551

  Le, Phu Ngoc ^a,b   Ambikairajah, Eliathamby ^a,b   Epps, Julien ^a,b   Sethu, Vidhyasaharan ^a   Choi, Eric H C ^b  

^a UNIVERSITY OF NEW SOUTH WALES   (Australia)

^b CSIRO   (Australia)

Author keywords

Cognitive load; Frequency scale; Gaussian mixture model; Kullback Leibler distance; Spectral centroid feature

Indexed keywords

COGNITIVE LOADS; FREQUENCY SCALE; GAUSSIAN MIXTURE MODEL; KULLBACK-LEIBLER DISTANCE; SPECTRAL CENTROID FEATURE;

SPEECH RECOGNITION;

COGNITIVE SYSTEMS;

EID: 79952364323     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2011.01.005     Document Type: Article

References (37)

1. Berthold, A., Jameson, A., 1999. Interpreting symptoms of cognitive load in speech input. In: Proc. Internat. Conf. on User Modeling, 1999, pp. 235-244.
2. Boril, H., Sadjadi, O., Kleinschmidt, T., Hansen, J.H.L., 2010. Analysis and detection of cognitive load and frustration in drivers' speech. In: Proc. Interspeech, Makuhari, Chiba, Japan, 2010, pp. 502-505.
3. R. Fernandez, and R.W. Picard Modeling drivers' speech under stress Speech Commun. 40 2003 145 159
4. B. Gajic, and K.K. Paliwal Robust speech recognition in noisy environments based on subband spectral centroid histogram IEEE Trans. Speech Audio Lang. Process. 14 2006 600 608 (Pubitemid 46405358)
5. P.W.M.V. Gerven, F. Pass, and J.J.G.V. Merrienboer Memory load and the cognitive pupillary response in aging Psychophysiology 41 2004 167 174
6. Goldberger, J., Aronowitz, H., 2005. A distance measure between GMMs based on the unscented transform and its application to speaker recognition. In: Proc. Interspeech, Lisboa, Portugal, 2005, pp. 1985-1988. (Pubitemid 43908479)
7. G. Griffin, and C. Williams The effects of different levels of task complexity on three vocal measures Aviation, Space, Environ. Med. 58 1987 1165
8. He, L., Lech, M., Maddage, N.C., Allen, N., 2009. Stress detection using speech spectrograms and sigma-pi neuron units. In: Proc. Fifth Internat. Conf. on Natural Computation, Tianjin, 2009, pp. 260-264.
9. D. Hosseinzadeh, and S. Krishnan On the use of complementary spectral features for speaker recognition EURASIP J. Adv. Signal Process. 2008 1 10
10. Khawaja, M.A., Ruiz, N., Cheng, F., 2007. Potential speech features for cognitive measurement. In: Proc. 19th Australian Conf. on Computer-Human Interaction: Entertaining User Interfaces, Adelaide, Australia, 2007, pp. 57-60.
11. M. Kleinschmidt Methods for capturing spectro-temporal modulations in automatic speech recognition Acoust. United Acta Acoust. 88 2002 416 422 (Pubitemid 34732124)
12. Kua, J.M.K., Thiruvaran, T., Nosratighods, M., Ambikairajah, E., Epps, J., 2010. Investigation of spectral centroid magnitude and frequency for speaker recognition. In: Proc. Odyssey, The Speaker and Language Recognition Workshop, Brno, Czech Republic, 2010, pp. 34-39.
13. Le, P.N., Ambikairajah, E., Choi, E.H.C., Epps, J., 2009. A non-uniform subband approach to speech-based cognitive load classification. In: Proc. Seventh Internat. Conf. on Information, Communications and Signal Processing, Fisherman's Wharf, Macau, 2009, pp. 1-5.
14. Le, P.N., Epps, J., Choi, E.H.C., Ambikairajah, E., 2010. A study of voice source and vocal tract filter based features in cognitive load classification. In: Proc. 20th Internat. Conf. on Pattern Recognition, Istanbul Turkey, 2010, pp. 4516-4519.
15. S. Lively, D. Pisoni, W. Van Summers, and R. Bernacki Effects of cognitive workload on speech production: acoustic analyses and perceptual consequences J. Acoust. Soc. Amer. 93 1993 2962 2973 (Pubitemid 23143522)
16. X. Lu, and J. Dang An investigation of dependencies between frequency components and speaker characteristics for text-independent speaker identification Speech Commun. 2007 312 322
17. E. Mendoza, and G. Carballo Acoustic analysis of induced vocal stress by means of cognitive workload tasks J. Voice 12 1998 263 273 (Pubitemid 28443458)
18. Metametrics, The Lexile Framework for Reading, 2007.
19. C. Muller, B. Grossmann-Hutter, A. Jameson, R. Jummer, and F. Wittig Recognizing time pressure and cognitive load on the basis of speech: an experimental study Lecture Notes Comput. Sci. 2001 24 33 (Pubitemid 33304881)
20. F. Paas, J.E. Tuovinen, H. Tabbers, and P.W.M.V. Gerven Cognitive load measurement as a means to advance cognitive load theory Educ. Psychol. 38 2003 63 71 (Pubitemid 36400005)
21. Paliwal, K.K., 1998. Spectral subband centroid features for speech recognition. In: Proc. ICASSP, Seattle, WA, USA, 1998, pp. 617-620.
22. F.G.W.C. Pass, and J.J.G.V. Merrienboer Variability of worked examples and transfer of geometrical problem-solving skills: a cognitive-load approach J. Educ. Psychol. 86 1994 122 133
23. J. Pelecanos, and S. Sridharan Feature warping for robust speaker verification ODYSSEY 2001 213 218
24. G.E. Peterson, and H.L. Barney Control methods used in a study of the vowels J. Acoust. Soc. Amer. 24 1952 175 184
25. D.A. Reynolds, T.F. Quatieri, and R.B. Dunn Speaker verification using adapted Gaussian mixture models Digital Signal Process. 10 2000 19 41 (Pubitemid 30592166)
26. Scherer, K.R., Grandjean, D., Johnstone, T., Klasmeyer, G., Bänziger, T., 2002. Acoustic correlates of task load and stress. In: Proc. ICSLP, Denver, Colorado, USA, 2002, pp. 2017-2020.
27. Shannon, B.J., Paliwal, K.K., 2003. A comparative study of filter bank spacing for speech recognition. In: Proc. Microelectronic Engineering Research Conference, Brisbane, Australia, 2003, pp. 1-3.
28. Shriberg, E., Bear, J., Dowding, J., 1992. Automatic detection and correction of repairs in human-computer dialog. In: Proc. Fifth DARPA Speech and Natural Language Workshop, Morgan Kaufmann, San Mateo, pp. 419-424.
29. Steeneken, H.J.M., Hansen, J.H.L., 1999. Speech under stress conditions: overview of the effect on speech production and on system performance. In: Proc. ICASSP, Phoenix, AZ, USA, 1999, pp. 2079-2082.
30. D. Talkin A robust algorithm for pitch tracking (RAPT) W.B. Kleijn, K.K. Paliwal, Speech Coding and Synthesis 1995 Elsevier Science B.V. Amsterdam 495 518
31. Thiruvaran, T., Ambikairajah, E., Epps, J., 2006. Speaker identification using FM features. In: Proc. 11th Australia Internat. Conf. on Speech Science and Technology, Canberra, Australia, 2006, pp. 148-152.
32. Yap, T.F., Ambikairajah, E., Choi, E., Chen, F., 2009. Phase-based features for cognitive load measurement system. In: Proc. ICASSP, Taipei, Taiwan, 2009, pp. 4825-4828.
33. Yap, T.F., Ambikairajah, E., Epps, J., Choi, E.H.C., 2010. Cognitive load classification using formant features. In: Proc. ISSPA, Kuala Lumpur, Malaysia, 2010, pp. 221-224.
34. Yap, T.F., Epps, J., Choi, E.H.C., Ambikairajah, E., 2010a. Glottal features for speech-based cognitive load classification. In: Proc. ICASSP, Dallas, Texas, USA, 2010a, pp. 5234-5237.
35. Yap, T.F., Epps, J., Ambikairajah, E., Choi, E.H.C., 2010b. An investigation of formant frequencies for cognitive load classification. In: Proc. InterSpeech, Makuhari, Chiba, Japan, 2010b, pp. 2022-2025.
36. Yin, B., Ruiz, N., Chen, F., Khawaja, M.A., 2007. Automatic cognitive load detection from speech features. In: Proc. CHISIG, Adelaide, Australia, 2007, pp. 249-255.
37. Yin, B., Chen, F., Ruiz, N., Ambikairajah, E., 2008. Speech-based cognitive load monitoring system. In: Proc. ICASSP, Las Vegas, Nevada, USA, 2008, pp. 2041-2044.