TEO-based speaker stress assessment using hybrid classification and tracking schemes

International Journal of Speech Technology

Volumn 15, Issue 3, 2012, Pages 295-311

  Hansen, John H L ^a   Ruzanski, Evan ^a   Bořil, Hynek ^a   Meyerhoff, James ^a  

^a UNIVERSITY OF TEXAS AT DALLAS   (United States)

Author keywords

FLETC Corpus; Stress assessment from speech; TEO operator

Indexed keywords

ACOUSTIC MODEL; ASSESSMENT SCHEME; AUDIO DATA; BINARY DECISION; BIOMETRIC DATA; CLASSIFICATION TASKS; CURRENT STRESS; EUCLIDEAN DISTANCE METRICS; FEATURE SPACE; FLETC CORPUS; HYBRID CLASSIFICATION; LANGUAGE RECOGNITION; NEAREST NEIGHBOR CLUSTERING; NORMALIZATION STRATEGIES; SENTENCE LEVEL; SPEAKER MODEL; SPEAKER RECOGNITION; SPEAKER VARIABILITY; SPEECH DATA; SPEECH PRODUCTION; SPEECH SYSTEMS; STRESS ASSESSMENT; STRESS LEVELS; STRESS-DEPENDENT; STRESS-INDUCED; TEO OPERATOR; TRACKING CAPABILITY; TRACKING SCHEME; TRAINING SCENARIO;

BIOMETRICS; CLASSIFICATION (OF INFORMATION);

SPEECH RECOGNITION;

EID: 84864605091     PISSN: 13812416     EISSN: 15728110     Source Type: Journal    
DOI: 10.1007/s10772-012-9165-1     Document Type: Article

References (36)

1. Boersma, P. (1993). Accurate short-term analysis of the fundamental frequency and the harmonics-to-noise ratio of a sampled sound. Proceedings-Instituut Voor Fonetische Wetenschappen, Universiteit Van Amsterdam, 17, 97-110.
2. Boril, H. (2008). Robust speech recognition: Analysis and equalization of Lombard effect in Czech corpora. Ph.D. thesis, Czech Technical University in Prague, Czech Republic. http://www.utdallas.edu/~hxb076000.
3. Boril, H., & Hansen, J. H. L. (2010). Unsupervised equalization of Lombard effect for speech recognition in noisy adverse environments. IEEE Transactions on Audio, Speech, and Language Processing, 18, 1379-1393.
4. Boril, H., Sadjadi, O., Kleinschmidt, T., & Hansen, J. H. L. (2010). Analysis and detection of cognitive load and frustration in drivers' speech. In Interspeech'10, Makuhari, Chiba, Japan (pp. 502-505).
5. Boril, H., Boyraz, P., & Hansen, J. H. L. (2012). Towards multi-modal driver's stress detection. In J. Hansen, P. Boyraz, K. Takeda & H. Abut (Eds.), Digital signal processing for in-vehicle systems and safety (pp. 3-20). New York: Springer.
6. Bou-Ghazale, S., & Hansen, J. (1998). HMM-based stressed speech modeling with application to improved synthesis and recognition of isolated speech under stress. IEEE Transactions on Speech and Audio Processing, 6, 201-216. (Pubitemid 128720647)
7. Brockwell, P., & Davis, R. (2002). Introduction to time series and forecasting. New York: Springer.
8. Cairns, D. A., & Hansen, J. H. L. (1994). Nonlinear analysis and classification of speech under stressed conditions. The Journal of the Acoustical Society of America, 96, 3392-3400. (Pubitemid 24376418)
9. Davis, S. B., & Mermelstein, P. (1980). Comparison of parametric representations for monosyllabic word recognition in continuously spoken sentences. IEEE Transactions on Acoustics, Speech, and Signal Processing, 28, 357-366. (Pubitemid 11464930)
10. Hansen, J. H. L. (1988). Analysis and compensation of stressed and noisy speech with application to robust automatic recognition. Ph.D. thesis, Dept. of Elect. Eng., Georgia Institute of Technology, Atlanta, GA.
11. Hansen, J. H. L. (1996). Analysis and compensation of speech under stress and noise for environmental robustness in speech recognition. Speech Communication, 20, 151-173. (Pubitemid 126371283)
12. Hansen, J., & Varadarajan, V. (2009). Analysis and compensation of Lombard speech across noise type and levels with application to in-set/out-of-set speaker recognition. IEEE Transactions on Audio, Speech, and Language Processing, 17, 366-378.
13. Hansen, J., Sangwan, A., & Kim, W. (2012). Speech under stress and Lombard effect: impact and solutions for forensic speaker recognition. In H. Patil & A. Neustein (Eds.), Forensic speaker recognition: law enforcement and counter-terrorism (pp. 103-123). New York: Springer.
14. Ikeno, A., Varadarajan, V., Patil, S., & Hansen, J. (2007). UT-Scope: speech under Lombard effect and cognitive stress. In IEEE aerospace conference (pp. 1-7).
15. Kaiser, J. (1990a). On a simple algorithm to calculate the 'energy' of a signal. In Proceedings of IEEE international conference on acoustics, speech, and signal processing 1990 (ICASSP'90), Albuquerque, NM (Vol. 1, pp. 381-384).
16. Kaiser, J. (1990b). On Teager's energy algorithm and its generalization to continuous signals. In Proc. 4th IEEE digital signal processing workshop, Mohonk, NY.
17. Kirschbaum, C., Wolf, O. T., May, M., Wippich, W., & Hellhammer, D. H. (1996). Stress-and treatment-induced elevations of cortisol levels associated with impaired declarative memory in healthy adults. Life Sciences, 58, 1475-1483. (Pubitemid 26122725)
18. Meyerhoff, J. L., Oleshansky, M. A., & Mougey, E. H. (1998). Psychological stress increases plasma levels of prolactin, cortisol and POMC-derived peptides in man. Psychosomatische Medizin, 50, 295-303.
19. Meyerhoff, J. L., Norris, W., Saviolakis, G., Wollert, T., Burge, B., Atkins, V., & Spielberger, C. (2004). Evaluating performance of federal law enforcement personnel during a stressful training scenario. Annals of the New York Academy of Sciences, 1032, 250-253. (Pubitemid 40298486)
20. Mitra, S. K. (2001). Digital signal processing: a computer-based approach (2nd ed.). New York: McGraw Hill.
21. Patil, S. A., & Hansen, J. H. (2010). The physiological microphone (PMIC): a competitive alternative for speaker assessment in stress detection and speaker verification. Speech Communication, 327-340.
22. Rahurkar, M., Hansen, J., Oleshansky, M., Meyerhoff, J., & Koenig, M. (2002). Frequency band analysis for stress detection using a Teager energy operator-based feature. In ICSLP-02, Denver, CO (pp. 2021-2024).
23. Rajasekaran, P., Doddington, G., & Picone, J. (1986). Recognition of speech under stress and in noise. In Proc. of ICASSP'86, Tokyo, Japan (Vol. 11, pp. 733-736).
24. Reynolds, D. A., Quatieri, T. F., & Dunn, R. B. (2000). Speaker verification using adapted Gaussian mixture models. Digital Signal Processing, 10, 19-41. (Pubitemid 30592166)
25. Ruzanski, E., Hansen, J., Meyerhoff, J., Saviolakis, G., & Koenig, M. (2005). Effects of phoneme characteristics on teo feature-based automatic stress detection in speech. In Proceedings of IEEE international conference on acoustics, speech, and signal processing 2005 (ICASSP'05), Philadelphia, PA (Vol. 1, pp. 357-360).
26. Saunders, T., Driskell, J., Johnston, J., & Salas, E. (1996). The effect of stress inoculation training on anxiety and performance. Journal of Occupational Health Psychology, 1, 170-186.
27. Scharf, B. (1970). Critical bands. In V. Tobias (Ed.), Foundation of modern auditory theory. New York: Academic Press.
28. Schwarz, P. (2009). Phoneme recognition based on long temporal context. Ph.D. thesis, Brno University of Technology, Czech Republic.
29. Sun, X. (2002). Pitch determination and voice quality analysis using subharmonic-to-harmonic ratio. In Proceedings of IEEE international conference on acoustics, speech, and signal processing 2002 (ICASSP'02), Orlando, FL (Vol. 1, pp. 333-336).
30. Talkin, D. (1995). A robust algorithm for pitch tracking (RAPT). In W. B. Kleijn & K. K. Paliwal (Eds.), Speech coding and synthesis (pp. 495-518). Amsterdam: Elsevier.
31. Teager, H. M. (1980). Some observations on oral air flow during phonation. IEEE Transactions on Acoustics, Speech, and Signal Processing, 28, 599-601.
32. Teager, H., & Teager, S. (1989). Evidence for nonlinear production mechanisms in the vocal tract. Speech Production and Speech Modelling, 55, 241-261.
33. Theodoridis, S., & Koutroumbas, K. (2003). Pattern recognition (2nd ed.). Amsterdam: Elsevier.
34. Womack, B., & Hansen, J. (1999). N-channel hidden Markov models for combined stress speech classification and recognition. IEEE Transactions on Speech and Audio Processing, 7, 668-677.
35. Yost, W. (1994). Fundamentals of hearing. New York: Academic Press.
36. Zhou, G., Hansen, J., & Kaiser, J. (2001). Nonlinear feature-based classification of speech under stress. IEEE Transactions on Speech and Audio Processing, 9, 201-216. (Pubitemid 32286594)