Strategies for model training and adaptation based on data dependency control

APSIPA ASC 2011 - Asia-Pacific Signal and Information Processing Association Annual Summit and Conference 2011

Volumn , Issue , 2011, Pages 1209-1214

  Shinozaki, Takahiro ^a   Furui, Sadaoki ^b  

^a CHIBA UNIVERSITY   (Japan)

^b TOKYO INSTITUTE OF TECHNOLOGY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

CROSS VALIDATION; DATA DEPENDENCIES; DATA EVALUATION; DEPENDENCY STRUCTURES; DOMAIN ADAPTATION; ITERATIVE PARAMETER ESTIMATION; MODEL ESTIMATION; MODEL TRAINING; PARAMETER-TUNING; RECOGNITION PERFORMANCE; SPEECH RECOGNITION SYSTEMS; STRUCTURE OPTIMIZATION; TRAINING SUBSETS; UNSUPERVISED ADAPTATION;

DATA PROCESSING; DECODING; ESTIMATION; ITERATIVE METHODS; PARAMETER ESTIMATION; SPEECH RECOGNITION;

STRUCTURAL OPTIMIZATION;

EID: 84866874722     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (33)

1. S. Arlot and A. Celisse, "A survey of cross-validation procedures for model selection, " Statistics Surveys, vol. 4, pp. 40-79, 2010.
2. I. J. Good, "The population frequencies of species and the estimation of population parameters, " Biometrika, vol. 40, no. 3/4, pp. pp. 237-264, 1953.
3. H. Ney, U. Essen, and R. Kneser, "On the estimation of 'small' probabilities by leaving-one-out, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 17, pp. 1202-1212, December 1995.
4. S. Young, J. Odell, and P. Woodland, "Tree-based state tying for high accuracy acoustic modelling, " in Proc. ARPA Workshop on Human Language Technology, 1994, pp. 307-312.
5. S. Young et al., The HTK Book, Cambridge University Engineering Department, 2005.
6. I. Rogina, "Automatic architecture design by likelihood-based context clustering with crossvalidation, " in Proc. Eurospeech, Rhodes, Greece, 1997, pp. 1223-1226.
7. T. Shinozaki, "HMM state clustering based on efficient cross-validation, " in Proc. ICASSP, Toulouse, 2006, vol. I, pp. 1157-1160.
8. M. Ostendorf and H. Singer, "HMM topology design using maximum likelihood successive state splitting, " Computer Speech and Language, vol. 11, pp. 17-41, 1997.
9. Z. Yu, Y. Zhi-Jie, and F. K. Soong, "Cross-validation based decision tree clustering for hmm-based tts, " in ICASSP, march 2010, pp. 4602-4605.
10. K. Hashimoto, H. Zen, Y. Nankaku, A. Lee, and K. Tokuda, "Bayesian context clustering using cross validation for speech recognition, " IEICE Transactions on Information and Systems, vol. 94, no. 3, pp. 668-678, 2011.
11. H. Zen and M. J. F. Gales, "Decision tree-based context clustering based on cross validation and hierarchical priors, " in Proc. ICASSP, May 2011, pp. 4560-4563.
12. T. Shinozaki, S. Furui, and T. Kawahara, "Gaussian mixture optimization based on efficient cross-validation, " IEEE Journal of Selected Topics in Signal Processing, vol. 4, no. 3, pp. 540-547, June 2010.
13. L. Breiman, "Bagging predictors, " Machine Learning, vol. 24, no. 2, pp. 123-140, 1996.
14. T. Shinozaki, S. Furui, and T. Kawahara, "Aggregated cross-validation and its efficient application to Gaussian mixture optimization, " in Proc. Interspeech, 2008, pp. 2382-2385.
15. S. J. Pan and Q. Yang, "A survey on transfer learning, " IEEE Transactions on Knowledge and Data Engineering, vol. 22, no. 10, pp. 1345-1359, October 2010.
16. R. Nisimura, K. Komatsu, Y. Kuroda, K. Nagatomo, A. Lee, H. Saruwatari, and K. Shikano, "Automatic n-gram language model creation from web resources, " in Proc. Eurospeech, 2001, pp. 2127- 2130.
17. A. Sethy, P. Georgiou, and S. Narayanan, "Text data acquisition for domain-specific language models, " in Proc. EMNLP, 2006, pp. 382- 389.
18. T. Cincarek, T. Tomoki, H Saruwatari, and K. Shikano, "Utterance-based selective training for the automatic creation of task-dependent acoustic models, " IEICE Transactions on Information and Systems, vol. E89-D, no. 3, pp. 962-969, 2006.
19. D. Klakow, "Selecting articles from the language model training corpus, " in ICASSP, 2000, vol. 3, pp. 1695 -1698.
20. T. Shinozaki, Y. Kubota, S. Furui, E. Utsunomiya, and Y. Shindoh, "Sentence selection by direct likelihood maximization for language model adaptation, " in Proc. Interspeech, 2011, To appear.
21. C. J. Leggetter and P. C. Woodland, "Flexible speaker adaptation using maximum likelihood linear regression, " in Proc. Eurospeech, 1995, pp. 1155-1158.
22. J. L. Gauvain and C. H. Lee, "Maximum a posteriori estimation for multivariate Gaussian mixture observations of Markov chains, " IEEE Transactions on Speech and Audio Processing, vol. 2, no. 2, pp. 291- 298, 1994.
23. T. Shinozaki, Y. Kubota, and S. Furui, "Unsupervised acoustic model adaptation based on ensemble methods, " IEEE Journal of Selected Topics in Signal Processing, vol. 4, no. 6, pp. 1007 -1015, Dec. 2010.
24. T. Shinozaki and M. Ostendorf, "Cross-validation and aggregated EM training for robust parameter estimation, " Computer speech and language, vol. 22, no. 2, pp. 185-195, 2008.
25. P. C. Woodland, D. Pye, and M. J. F. Gales, "Iterative unsupervised adaptation using maximum likelihood linear regression, " in Proc. ICSLP, oct 1996, vol. 2, pp. 1133-1136.
26. S. Nakagawa, T. Watanabe, H. nishizaki, and T. Utsuro, "An unsupervised speaker adaptation method for lecture-style spontaneous speech recognition using multiple recognition systems, " IEICE Transactions on Information and Systems, vol. E88-D, no. 3, pp. 463-471, 2005.
27. H. Soltau, B. Kingsbury, L. Mangu, D. Povery, G. Saon, and G. Zweig, "The IBM 2004 conversational telephony system for rich transcription, " in Proc. ICASSP, 2005, vol. I, pp. 205-208.
28. A. Blum and T. Mitchell, "Combining labeled and unlabeled data with co-training, " Proceedings of the eleventh annual conference on Computational learning theory COLT 98, vol. 98, pp. 92-100, 1998.
29. K. Nigam and R. Ghani, "Analyzing the effectiveness and applicability of co-training, " in Proceedings of the ninth international conference on Information and knowledge management. 2000, CIKM '00, pp. 86-93, ACM.
30. A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum likelihood from incomplete data via the EM algorithm, " J. of the Royal Statistical Society,, no. Series B 39, No. 1, pp. 1-38, 1977.
31. L. Rabiner and B. H. Juang, Fundamentals of speech recognition, Prentice-Hall, Inc., Upper Saddle River, NJ, USA, 1993.
32. N. S. Kim and C. K. Un, "Deleted strategy for MMI-based HMM training, " IEEE Transactions on Speech and Audio Processing, vol. 6, no. 3, pp. 299-303, 1998.
33. T. Takenouchi and K. Ikeda, "Theoretical analysis of crossvalidation( cv)-em algorithm, " in Proceedings of the 20th international conference on Artificial neural networks: Part III, 2010, ICANN'10, pp. 321-326.