An ensemble speaker and speaking environment modeling approach to robust speech recognition

IEEE Transactions on Audio, Speech and Language Processing

Volumn 17, Issue 5, 2009, Pages 1025-1037

  Tsao, Yu ^a   Lee, Chin Hui ^b  

^a NATIONAL INSTITUTE OF INFORMATION AND COMMUNICATIONS TECHNOLOGY   (Japan)

^b GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Environment modeling; Noise robustness

Indexed keywords

AUTOMATIC SPEECH RECOGNITION SYSTEM; BASELINE SYSTEMS; CONNECTED DIGITS; ENVIRONMENT MODELING; ENVIRONMENTAL COMPENSATION; GAUSSIAN MIXTURES; MINIMUM CLASSIFICATION ERROR TRAINING; NOISE ROBUSTNESS; OFFLINE; PARTITIONING ALGORITHMS; PERFORMANCE ROBUSTNESS; ROBUST SPEECH RECOGNITION; STOCHASTIC MATCHING; STRUCTURED ENVIRONMENT; TESTING ENVIRONMENT; TWO PHASIS;

ACOUSTIC NOISE; CLUSTERING ALGORITHMS; HIDDEN MARKOV MODELS; PHASE SPACE METHODS; VECTORS;

SPEECH RECOGNITION;

EID: 67651177785     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2009.2016231     Document Type: Article

References (52)

1. L. R. Rabiner, "A tutorial on hidden Markov models and selected applications in speech recognition," Proc. IEEE, vol. 77, no. 2, pp. 257-286, Feb. 1989.
2. B.-H. Juang and L. R. Rabiner, "The segmental K-means algorithm for estimating parametersof hidden Markov models," IEEE Trans. Acoust., Speech, Signal Process., vol. 38, no. 9, pp. 1639-1641, Sep. 1990.
3. B.-H. Juang, W. Chou, and C.-H. Lee, "Statistical and discriminative methods for speech recognition," in C.-H. Lee, K.K. Soong, F.K. Paliwal, Automatic Speech and Speaker Recognition: Advanced Topics. Dordrecht, The Netherlands: Kluwer, 1996, ch. 5.
4. A. Sankar and C.-H. Lee, "A maximum-likelihood approach to stochastic matching for robust speech recognition," IEEE Trans. Speech Audio Process., vol. 4, no. 3, pp. 190-202, May 1996.
5. A. C. Suredran, C.-H. Lee, and M. Rahim, "Nonlinear compensation for stochastic matching," IEEE Trans. Speech Audio Process., vol. 7, no. 6, pp. 643-655, Nov. 1999.
6. D. V. Compernolle, "Noise adaptation in a hidden Markov model speech recognition system," Comput. Speech Lang., vol. 3, pp. 151-167, 1989.
7. S. F. Boll, "Suppression of acoustic noise in speech using spectral subtraction," IEEE Trans. Acoustic., Speech, Signal Process., vol. ASSP-27, no. 2, pp. 113-120, Apr. 1979.
8. H. Kim and R. C. Rose, "Cepstrum-domain acoustic feature compensation based on decomposition of speech and noise for ASR in noisy environments," IEEE Trans. Speech Audio Process., vol. 11, no. 5, pp. 435-446, Sep. 2003.
9. B. Atal, "Effectiveness of linear prediction characteristics of the speech wave for automatic speaker identification and verification," J. Acoust. Soc. Amer., vol. 55, pp. 1304-1312, Jun. 1974.
10. S. Furui, "Cepstral analysis technique for automatic speaker verification," IEEE Trans. Acoust., Speech, Signal Process., vol. ASSP-29, no. 2, pp. 254-272, Apr. 1981.
11. C.-W. Hsu and L.-S. Lee, "Higher order cepstral moment normalization (HOCMN) for robust speech recognition," in Proc. ICASSP'04, 2004, pp. 197-200.
12. Y. H. Suk, S. H. Choi, and H. S. Lee, "Cepstrum third-order normalization method for noisy speech recognition," Electron. Lett., vol. 35, no. 7, pp. 527-528, Apr. 1999.
13. D. Macho, L. Mauuary, B. Noe, Y. M. Cheng, D. Ealey, D. Jouver, H. Kelleher, D. Pearce, and F. Saadoun, "Evaluation of a noise-robust DSR front-end on Aurora databases," in Proc. ICSLP'02, 2002, pp. 17-20.
14. A. Acero, "Acoustical and environmental robustness in automatic speech recognition," Ph.D. dissertation, Elect. Comput. Eng. Dept., Carnegie Mellon Univ., Pittsburgh, PA, 1990.
15. L. Deng, J. Droppo, and A. Acero, "Recursive estimation of nonsta-tionary noise using iterative stochastic approximation for robust speech recognition," IEEE Trans. Speech Audio Process., vol. 11, no. 6, pp. 568-580, Nov. 2003.
16. M. J. F. Gales, "Maximum likelihood linear transformations for HMM-based speech recognition," Cambridge Univ., Cambridge, U.K., 1997, Tech. Rep. TR 291.
17. K. Visweswariah, V. Goel, and R. Gopinath, "Structuring linear transforms for adaptation using training time information," in Proc. ICASSP'02, 2002, pp. 585-588.
18. C.-H. Lee and Q. Huo, "On adaptive decision rules and decision parameter adaptation for automatic speech recognition," Proc. IEEE, vol. 88, no. 8, pp. 1241-1269, Aug. 2000.
19. J.-L. Gauvain and C.-H. Lee, "Maximum a posteriori estimation for multivariate Gaussian mixture observations of Markov chains," IEEE Trans. Speech Audio Process., vol. 2, no. 2, pp. 291-99, Apr. 1994.
20. C. Leggetter and P. Woodland, "Maximum likelihood linear regression for speaker adaptation of continuous density hidden Markov models," Comput. Speech Lang., vol. 9, pp. 171-185, 1995.
21. O. Siohan, C. Chesta, and C.-H. Lee, "Hidden Markov model adaptation using maximum a posteriori linear regression," in Proc. Workshop Robust Methods for Speech Recognition in Adverse Conditions, Tampere, Finland, 1999, pp. 147-150.
22. Y. Gong, "A method of joint compensation of additive and convolutive distortions for speaker-independent speech recognition," IEEE Trans. Speech Audio Process., vol. 13, no. 5, pp. 975-983, Sep. 2005.
23. A. Acero, L. Deng, T. Kristjansson, and J. Zhang, "HMM adaptation using vector Taylor series for noisy speech recognition," in Proc. ICSLP'02, 2000, pp. 869-872.
24. K. Shinoda and C.-H. Lee, "A structural Bayes approach to speaker adaptation," IEEE Trans. Speech Audio Process., vol. 9, no. 3, pp. 276-287, Mar. 2001.
25. O. Siohan, C. Chesta, and C.-H. Lee, "Joint maximum a posteriori adaptation of transformation and HMM parameters," IEEE Trans. Speech Audio Process., vol. 9, no. 4, pp. 417-428, May 2001.
26. R. P. Lippmann, E. A. Martin, and D. B. Paul, "Multi-style training for robust isolated-word speech recognition," in Proc. ICASSP'87, Dallas, TX, Apr. 1987, pp. 705-708.
27. Y. Tsao and C.-H. Lee, "A vector space approach to environment modeling for robust speech recognition," in Proc. ICSLP'06, Sep. 2006, pp. 785-788.
28. K.-T. Chen, W.-W. Liau, H.-M. Wang, and L.-S. Lee, "Fast speaker adaptation using eigenspace-based maximum likelihoods linear regression," in Proc. ICSLP'00, 2000, pp. 742-745.
29. A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," J. Roy. Statist. Soc. B, vol. 39, pp. 1-38, 1977.
30. B.-H. Juang, W. Chou, and C.-H. Lee, "Minimum classification error rate methods for speech recognition," IEEE Trans. Speech Audio Process., vol. 5, no. 3, pp. 257-265, May 1997.
31. Y. Tsao and C.-H. Lee, "Two extensions to ensemble speaker and speaking environment modeling for robust automatic speech recognition," in Proc. ASRU, Dec. 2007, pp. 77-80.
32. S. Chen and D. Donoho, "Basis pursuit," in Proc. Conf. Signals, Syst. Comput., 1994, pp. 41-44.
33. G. Meinardus, G. Nurnberger, M. Sommer, and H. Strauss, "Algorithms for piecewise polynomials and splines with free knots," Math. Comput., vol. 53, pp. 235-247, 1989.
34. Y. Tsao, S.-M. Lee, and L.-S. Lee, "Segmental eigenvoice with delicate eigenspace for improved speaker adaptation," IEEE Trans. Speech Audio Process., vol. 13, no. 3, pp. 399-411, May 2005.
35. R. O. Duda, P. E. Hart, and D. G. Stork, Pattern Classification. New York: Wiley, 2001.
36. V. Valtchev, J. Odell, P. C. Woodland, and S. Young, "MMIE training of large vocabulary recognition systems," Speech Commun., vol. 22, no. 4, pp. 303-314, 1997.
37. D. Povey and P. C. Woodland, "Minimum phone error and i-smoothing for improved discriminative training," in Proc. ICASSP'02, 2002, pp. I-105-I-108.
38. J. Li, "Soft margin estimation for automatic speech recognition," Ph.D. dissertation, School Elect. Comput. Eng., Georgia Inst. Technol., Atlanta, GA, 2008.
39. S. Katagiri, B.-H. Juang, and C.-H. Lee, "Pattern recognition using a family of design algorithms based upon the generalized probabilistic descent method," Proc. IEEE, vol. 86, no. 11, pp. 2345-2373, Nov. 1998.
40. R. Kuhn, J.-C. Junqua, P. Nguyen, and N. Niedzielski, "Rapid speaker adaptation in eigenvoice space," IEEE Trans. Speech Audio Process., vol. 8, no. 6, pp. 695-707, Nov. 2000.
41. T. J. Hazen, "A comparison of novel techniques for rapid speaker adaptation," Speech Commun., vol. 31, pp. 15-33, May 2000.
42. C. Vair, D. Colibro, F. Castaldo, E. Dalmasso, and P. Laface, "Channel factors compensation in model and feature domain for speaker recognition," in Proc. IEEE Odyssey Workshop, Jun. 2006, pp. 1-6.
43. Y. Tsao and C.-H. Lee, "An ensemble modeling approach to joint characterization of speaker and speaking environments," in Proc. Interspeech 2007, Aug. 2007, pp. 1050-1053.
44. B. Mak and T.-C. Lai, "Improving reference speaker weighting adaptation by the use of maximum-likelihood reference speakers," in Proc. ICASSP'06, May 2006, vol. 1, pp. 229-232.
45. H.-G. Hirsch and D. Pearce, "The Aurora experimental framework for the performance evaluation of speech recognition systems under noisy conditions," in Proc. ISCA ITRW ASR'2000, Paris, France, 2000, pp. 181-188.
46. Y. Tsao and C.-H. Lee, "Improving the ensemble speaker and speaking environment modeling approach by enhancing the precision of the online estimation process," in Proc. Interspeech'08, 2008, pp. 1265-1268.
47. M. J. F. Gales, "Cluster adaptive training of hidden Markov models," IEEE Trans. Speech Audio Process., vol. 8,no. , pp. 417-428, Jul. 2000.
48. A. J. Hayter, Probability and Statistics for Engineers and Scientists. Pacific Grove, CA: Duxbury, 2006.
49. A. Agresti and C. A. Franklin, Statistics: The Art and Science of Learning from Data (MyStatLab Series). Upper Saddle River, NJ: Prentice-Hall, 2008.
50. Y. Onishi and K.-I. Iso, "Speaker adaptation by hierarchical eigen-voice," in Proc. ICASSP '03, Apr. 2003, vol. 1, pp. 576-579.
51. J. Wu and Q. Huo, "Several HKU approaches for robust speech recognition and their evaluation on Aurora connected digit recognition tasks," in Proc. Eurospeech'03, 2003, pp. 21-24.
52. Y. Tsao, J. Li, and C.-H. Lee, "A study on separation between acoustic models and its applications," in Proc. Interspeech'05, 2005, pp. 1109-1112.