Cross-validation EM training for robust parameter estimation

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn 4, Issue , 2007, Pages

  Shinozaki, T ^a   Ostendorf, M ^b  

^a KYOTO UNIVERSITY   (Japan)

^b UNIVERSITY OF WASHINGTON   (United States)

Author keywords

Cross validation; EM training; Overtraining

Indexed keywords

ALGORITHMS; BIT ERROR RATE; BROADCASTING; MAXIMUM LIKELIHOOD; PARAMETER ESTIMATION; ROBUST CONTROL;

CROSS-VALIDATION LIKELIHOOD; EM TRAINING; OVERTRAINING;

SPEECH RECOGNITION;

EID: 34547534396     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2007.366943     Document Type: Conference Paper

References (14)

1. T. Hastie, R. Tibshirani, and J. Friedman, The Elements of Statistical Learning, Springer-Verlag, 2001.
2. A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," J. of the Royal Statistical Society, vol. Series B 39, no. 1, pp. 1-38, 1977.
3. H. Melin, J. W. Koolwaaij, J. Lindberg, and F. Bimbot, "A comparative evaluation of variance flooring techniques in HMM-based speaker verification," in Proc. ICSLP, Sydney, 1998, pp. 2379-2382.
4. S. Chen and P. S. Gopalakrishnan, "Clustering via the Bayesian Information Criterion with applications in speech recognition," in Proc. ICASSP, 1998, pp. 645-648.
5. K. Shinoda and T. Watanabe, "Acoustic modeling based on the MDL criterion for speech recognition," in Proc. EuroSpeech, 1997, vol. 1, pp. 99-102.
6. T. Shinozaki, "HMM state clustering based on efficient cross-validation," in Proc. ICASSP, Toulouse, 2006, vol. I, pp. 1157-1160.
7. S. Young et al., The HTK Book, Cambridge University Engineering Department, 2005.
8. X. Anguera, T. Shinozaki, C. Wooters, and J. Hernando, "Model complexity selection and cross-validation EM training for robust speaker diarization," in ICASSP, Hawaii, 2007, Submitted.
9. M. Y. Hwang, X. Lei, W. Wang, and T. Shinozaki, "Investigation on Mandarin broadcast news speech recognition," in Proc. ICSLP,2006.pp. 1233-1236.
10. L. R. Bahl, P. F. Brown, P. V. de Souza, and R. L. Mercer, "Maximum mutual information estimation of hidden Markov model parameters for speech recognition," in Proc. ICASSP, 1986, pp. 49-52.
11. D. Povey and P.C. Woodland, "Minimum phone error and i-smoothing for improved discriminative training," in Proc. ICASSP, 2002, vol. I, pp. 105-108.
12. H. Soltau, B. Kingsbury, L. Mangu, D. Povery, G. Saon, and G. Zweig, "The IBM 2004 conversational telephony system for rich transcription," in Proc. ICASSP, 2005, vol. I, pp. 205-208.
13. C. J. Leggetter and P. C. Woodland, "Flexible speaker adaptation using maximum likelihood linear regression," in Proc. Eurospeech, 1995, pp. 1155-1158.
14. A. Gunawardana and W. Byrne, "Convergence theorems for generalized alternating minimization procedures," Journal of Machine Learning Research, vol. 6, pp. 2049-2073, 2005.