Analysis and compensation of lombard speech across noise type and levels with application to in-set/out-of-set speaker recognition

IEEE Transactions on Audio, Speech and Language Processing

Volumn 17, Issue 2, 2009, Pages 366-378

  Hansen, John H L ^a   Varadarajan, Vaishnevi ^a,b  

^a UNIVERSITY OF TEXAS AT DALLAS   (United States)

^b CATERPILLAR INC   (United States)

Author keywords

Lombard effect; Speaker recognition and characterization; Speech analysis; Speech in noise; Speech under stress

Indexed keywords

ENERGY HISTOGRAM; EQUAL ERROR RATE; GAUSSIAN MIXTURE MODEL; LOMBARD EFFECT; NOISE LEVELS; NOISE TYPES; SPEAKER MODEL; SPEAKER RECOGNITION; SPEAKER RECOGNITION AND CHARACTERIZATION; SPECTRAL TILT; SPEECH DATA; SPEECH PRODUCTION; SPEECH SYSTEMS; TESTING CONDITIONS; TRAINING AND TESTING; UNDER MATCHED;

COMPUTATIONAL LINGUISTICS; INFORMATION THEORY; SPEECH ANALYSIS; SPEECH PROCESSING; TELECOMMUNICATION EQUIPMENT;

SPEECH RECOGNITION;

EID: 70350454918     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2008.2009019     Document Type: Article

References (32)

1. E. Lombard, "Le signe de l'elevation de la voix, annals maladiers oreille, " Larynx, Nez, Pharynx, vol. 37, pp. 101-119, 1911.
2. H. L. Lane, B. Tranel, and C. Sisson, "Regulation of voice communication by sensory dynamics, " J. Acoust. Soc. Amer., vol. 32, pp. 451-454, 1970.
3. H. L. Lane and B. Tranel, "The Lombard sign and the role of hearing in speech, " J. Speech Hear. Res., vol. 14, pp. 677-709, 1971.
4. J. H. L. Hansen, "Analysis and Compensation of Stressed and Noisy Speech with Application to Robust Automatic Recognition, " Ph.D. dissertation, School of Elect. Eng., Georgia Inst. of Technol., Atlanta, 1988.
5. J. H. L. Hansen and S. Bou-Ghazale, "Getting started with SUSAS: A speech under simulated and actual stress database, " in Proc. EUROSPEECH' 97, Rhodes, Greece, Sep. 1997, vol. 4, pp. 1743-1746.
6. B. J. Stanton, L. H. Jamieson, and G. D. Allen, "Acoustic-phonetic analysis of loud and Lombard speech in simulated cockpit conditions, " in Proc. ICASSP, 1988, pp. 331-334.
7. W.Van Summers, D. B. Pisoni, R. Bernacki, R. Pedlow, and M. Stokes, "Effects of noise on speech production : Acoustical and perceptual analyses, " J. Acous. Soc. Amer., pp. 917-928, Sep. 1988.
8. J. C. Junqua, "The Lombard reflex and its role on human listeners and automatic speech recognizers, " J. Acoust. Soc. Amer., vol. 93, pp. 510-524, Jan. 1993.
9. J. M. Pickett, "Effects of vocal force on the intelligibilty of speech sounds, " J. Acous. Soc. Amer., pp. 902-905, Sep. 1956.
10. J. Dreher and J. Neil, "Effects of ambient noise on speaker intelligibility for words and phrases, " J. Acous. Soc. Amer., pp. 1320-1323, Dec. 1957.
11. P. Ladgefoged, Three Areas of Experimental Phonetics. London, U.K.: Oxford Univ. Press.
12. P. Rajasekaran, G. Doddington, and J. Picone, "Recognition of speech under stress and in noise, " in Proc. IEEE ICASSP'86, pp. 733-736.
13. S. E. Bou-Ghazale and J. H. L. Hansen, "A comparative study of traditional and newly proposed features for recognition of speech under stress, " IEEE Trans. Speech Audio Process., vol. 8, no. 4, pp. 429-442, Jul. 2000.
14. H. Steeneken and J. H. L. Hansen, "Speech under stress conditions: overview of the effect on speech production and on system performance, " in Proc. IEEE ICASSP'99, Phoenix, AZ, Mar. 1999, vol. 4, pp. 2079-2082.
15. J. H. L. Hansen, "Analysis and compensation of speech under stress and noise for environmental robustness in speech recognition, " Speech Commun., Special Iss. Speech Under Stress, vol. 20, no. 2, pp. 151-170, Nov. 1996.
16. J. H. L. Hansen and M. Clements, "Source generator equalization and enhancement of spectral properties for robust speech recognition in noise and stress, " IEEE Trans. Speech Audio Process., vol. 3, no. 5, pp. 407-415, Sep. 1995.
17. J. H. L. Hansen, "Morphological constrained feature enhancement with adaptive cepstral compensation (MCE-ACC) for speech recognition in noise and Lombard Effect, " IEEE Trans. Speech Audio Process., vol. 2, no. 4, pp. 598-614, Oct. 1994.
18. Y. Chen, "Cepstral domain talker stress compensation for robust speech recognition, " IEEE Trans. Acoust. Speech, Signal Process., vol. 36, no. 4, pp. 433-439, Apr. 1988.
19. B. J. Stanton, L. H. Jamieson, and G. D. Allen, "Robust recognition of loud and Lombard speech in the fighter cockpit environment, " in Proc. IEEE ICASSP '89, Glasgow, U.K., May 1989, pp. 675-678.
20. A. Wakao, K. Takeda, and F. Itakura, "Variability of Lombard effects under different noise conditions, " in Proc. ICSLP 96, Philadelphia, PA, Oct. 1996, pp. 418-421.
21. S. E. Bou-Ghazale and J. H. L. Hansen, "Robust speech recognition training via duration and spectral-based stress token generation, " IEEE Trans. Speech Audio Process., vol. 3, pp. 415-421, Sep. 1995.
22. V. Varadarajan, J. H. L. Hansen, and A. Ikeno, "UT-SCOPE - A corpus for speech under cognitive/physical task stress and emotion, " in Proc. LREC Workshop on Speech Under Emotion, Genoa, Italy, May 2006, pp. 72-75.
23. V. Varadarajan and J. H. L. Hansen, "Analysis of the Lombard effect under different types and levels of noise with application to in-set speaker ID systems, " in Proc. Interspeech'06, Sep. 2006, pp. 937-940.
24. D. A. Reynolds, T. F. Quatieri, and R. B. Dunn, "Speaker verification using adapted Gaussian mixture models, " Digital Signal Process., vol. 10, pp. 19-41, 2000.
25. P. Angkititrakul, J. H. L. Hansen, and S. Baghaii, "Cluster- dependent modeling and confidence measure processing for in-set/out-of-set speaker identification, " in Proc. Interspeech 2004/ICSLP 2004, Jeju Island, Korea, p. Thc1604p, 15(1-4).
26. P. Sivakumaran, J. Fortuna, and A. M. Ariyaeeinia, "Score normalization applied to open-set, text-independent speaker identification, " in Eurospeech'03, Geneva, Switzerland, Sep. 2003, pp. 2669-2672.
27. E. Ruzanski, J. H. L. Hansen, J. Meyerhoff, G. Saviolakis, W. Norris, and T. Wollert, "Stress level classification of speech using Euclidean distance metrics in a novel hybrid multi-dimensional feature space, " in Proc. IEEE ICASSP, Toulouse, France, May 2006, vol. 1, pp. I-425-I-428.
28. P. Angkititrakul and J. H. L. Hansen, "Discriminative in-set/out-of-set speaker recognition, " IEEE Trans. Audio, Speech, Lang. Process., vol. 15, no. 2, pp. 498-508, Feb. 2007.
29. J. H. L. Hansen, H. Rongqing, B. Zhou, M. Seadle, J. R. Deller, A. R. Gurijala, M. Kurimo, and P. Angkititrakul, "SPEECHFIND: Spoken document retrieval for a national gallery of the spoken word, " IEEE Trans. Speech Audio Process., vol. 13, pp. 712-730, Sep. 2005.
30. G. Zhou, J. H. L. Hansen, and J. F. Kaiser, "Nonlinear feature based classification of speech under stress, " IEEE Trans. Speech Audio Process., vol. 9, no. 3, pp. 201-216, Mar. 2001.
31. C. E. Mokbel and G. F. A. Chollet, "Automatic word recognition in cars, " IEEE Tranactions on Speech and Audio Processing, vol. 3, no. 5, pp. 346-356, Sep. 1995.
32. "SUSAS-Speech Under Simulated and Actual Stress database, " Linguistics Data Consortium (LDC), Philadelphia, PA [Online]. Available: http://www.ldc.upenn.edu/Catalog/CatalogEntry.jsp?catalogId=LDC99S78.