Semi-supervised training of Gaussian mixture models by conditional entropy minimization

Proceedings of the 11th Annual Conference of the International Speech Communication Association, INTERSPEECH 2010

Volumn , Issue , 2010, Pages 1353-1356

  Huang, Jui Ting ^a   Hasegawa Johnson, Mark ^a  

^a University of Illinois at Urbana Champaign   (United States)

Author keywords

Conditional entropy; Gaussian Mixture Models; Phonetic classification; Semi supervised learning

Indexed keywords

CONJUGATE GRADIENT METHOD; ENTROPY; GAUSSIAN DISTRIBUTION; LINGUISTICS; SPEECH COMMUNICATION; STEREOPHONIC BROADCASTING;

CONDITIONAL ENTROPY; CONVERGENCE RATES; DISCRIMINATIVE TRAINING; GAUSSIAN MIXTURE MODEL; MAXIMUM MUTUAL INFORMATION; PHONETIC CLASSIFICATION; PRECONDITIONED CONJUGATE GRADIENT METHOD; SEMI-SUPERVISED TRAININGS; ENTROPY MINIMIZATION; INFORMATION CRITERION; SEMI-SUPERVISED LEARNING; TRAINING METHODS; UNLABELED DATA;

SEMI-SUPERVISED LEARNING; GAUSSIAN DISTRIBUTION;

EID: 79959857219     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (18)

1. F. Wessel and H. Ney, "Unsupervised training of acoustic models for large vocabulary continuous speech recognition," IEEE Transactions on Speech and Audio Processing, vol. 13, no. 1, pp. 23-31, Jan. 2005. (Pubitemid 40049937)
2. L. Wang, M. Gales, and P. Woodland, "Unsupervised training for mandarin broadcast news and conversation transcription," in Proc. IEEE Conference on Acoustics, Speech, and Signal Processing (ICASSP), vol. 4, 2007, pp. 353-356.
3. L. Lamel, J.-L. Gauvain, and G. Adda, "Lightly supervised and unsupervised acoustic model training," vol. 16, pp. 115-129, 2002.
4. A. Subramanya and J. A. Bilmes, "The semi-supervised switchboard transcription project," in Interspeech, Brighton, UK, September 2009.
5. J. Malkin, A. Subramanya, and J. Bilmes, "On the semi-supervised learning of multi-layered perceptrons," in Interspeech, Brighton, U.K., September 2009.
6. Y. Grandvalet and Y. Bengio, "Semi-supervised learning by entropy minimization," in Advances in Neural Information Processing Systems 17, L. K. Saul, Y. Weiss, and L. Bottou, Eds. Cambridge, MA: MIT Press, 2005, pp. 529-536.
7. F. Jiao, S. Wang, C.-H. Lee, R. Greiner, and D. Schuurmans, "Semi-supervised conditional random fields for improved sequence segmentation and labeling," in ACL-44: Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the Association for Computational Linguistics. Morristown, NJ, USA: Association for Computational Linguistics, 2006, pp. 209-216.
8. J.-T. Huang, X. Li, and A. Acero, "Discriminative training methods for language models using conditional entropy criteria," in Proc. IEEE Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2010.
9. J.-T. Huang and M. Hasegawa-Johnson, "Maximum mutual information estimation with unlabeled data for phonetic classification," in Interspeech, 2008.
10. -, "On the semi-supervised learning of gaussian mixture models," in Proceedings of the NAACL HLT Workshop on Semisupervised Learning for Natural Language Processing, Boulder, Colorado, USA, June 2009.
11. O. Chapelle, B. Schölkopf, and A. Zien, Eds., Semi-Supervised Learning. Cambridge, MA: MIT Press, 2006. [Online]. Available: http://www.kyb.tuebingen.mpg.de/ssl-book
12. T. Joachims, "Transductive inference for text classification using support vector machines," in Proceedings of ICML-99, 16th International Conference on Machine Learning, Bled, SL, 1999, pp. 200-209.
13. D. P. Bertsekas, Nonlinear Programming. Athena Scientific, September 1999.
14. J. R. Shewchuk, "An introduction to the conjugate gradient method without the agonizing pain," Pittsburgh, PA, USA, Tech. Rep., 1994.
15. J. S. Garofolo, L. F. Lamel, W. M. Fisher, J. G. Fiscus, D. S. Pallett, and N. L. Dahlgren, "Darpa timit acoustic phonetic continuous speech corpus," 1993.
16. K.-F. Lee and H.-W. Hon, "Speaker-independent phone recognition using hidden markov models," IEEE Transactions on Speech and Audio Processing, vol. 37, no. 11, pp. 1641-1648, 1989.
17. A. K. Halberstadt, "Heterogeneous acoustic measurements and multiple classifiers for speech recognition," Ph.D. dissertation, Massachusetts Institute of Technology, 1998.
18. D. Povey, "Discriminative training for large vocabulary speech recognition," Ph.D. dissertation, Cambridge University, 2003.