Discriminative estimation of subspace constrained gaussian mixture models for speech recognition

IEEE Transactions on Audio, Speech and Language Processing

Volumn 15, Issue 1, 2007, Pages 172-189

  Axelrod, Scott ^a   Goel, Vaibhava ^b   Gopinath, Ramesh ^b   Olsen, Peder ^b   Visweswariah, Karthik ^b  

^a Falcon Management Corporation   (United States)

^b IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

Covariance modeling; Discriminative estimation of Gaussian mixture models (GMMs); Exponential distributions; Maximum likelihood (ML) estimation; Speech recognition; Subspace constrained Gaussian mixture models (SCGMMs)

Indexed keywords

COVARIANCE MODELING; DISCRIMINATIVE ESTIMATION OF GAUSSIAN MIXTURE MODELS (GMMS); EXPONENTIAL DISTRIBUTIONS; MAXIMUM-LIKELIHOOD (ML) ESTIMATION; SUBSPACE CONSTRAINED GAUSSIAN MIXTURE MODELS (SCGMMS);

ACOUSTICS; BLIND SOURCE SEPARATION; COMMUNICATION CHANNELS (INFORMATION THEORY); COVARIANCE MATRIX; ESTIMATION; FEATURE EXTRACTION; GAUSSIAN DISTRIBUTION; INTERNET; MAXIMUM LIKELIHOOD ESTIMATION; MIXTURES; OBJECT RECOGNITION; SPAMMING; SPEECH ANALYSIS; STEREOPHONIC BROADCASTING; TRELLIS CODES;

SPEECH RECOGNITION;

EID: 34249656385     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASL.2006.872617     Document Type: Article

References (30)

1. M. J. F. Gales, "Semi-tied covariance matrices for hidden Markov models," IEEE Trans. Speech Audio Process., vol. 7, no. 3, pp. 272-281, May 1999.
2. R. Gopinath, "Maximum likelihood modeling with Gaussian distributions for classification," in Proc. ICASSP, 1998, pp. 661-664.
3. P. Olsen and R. A. Gopinath, "Modeling inverse covariance matrices by basis expansion," in Proc. ICASSP, 2002, pp. 945-948.
4. -, "Modeling inverse covariance matrices by basis expansion," IEEE Trans. Speech Audio Process., vol. 12, no. 1, pp. 37-46, Jan. 2004.
5. S. Axelrod, V. Goel, R. Gopinath, P. Olsen, and K. Visweswariah, "Subspace constrained gaussian mixture models for speech recognition," IEEE Trans. Speech Audio Process., vol. 13, no. 6, pp. 1144-1160, Nov. 2003.
6. S. Axelrod, R. A. Gopinath, P. Olsen, and K. Visweswariah, "Dimensional reduction, covariance modeling, and computational complexity in ASR systems," in Proc. ICASSP, 2003, pp. 912-915.
7. K. Visweswariah, S. Axelrod, and R. Gopinath, "Acoustic modeling with mixtures of subspace constrained exponential models," in Proc. Eurospeech, 2003, pp. 2613-2616.
8. V. Vanhoucke and A. Sankar, "Mixtures of inverse covariances," in Proc. ICASSP, 2003, pp. 250-264.
9. A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," J. Royal Stat. Soc., vol. 39, no. B, pp. 1-38, 1977.
10. P. Woodland and D. Povey, "Large scale discriminative training of hidden Markov models for speech recognition," Comput. Speech Lang., vol. 16, pp. 25-47, 2002.
11. A. Nadas, "A decision theoretic formulation of a training problem in speech recognition and a comparison of training by unconditional versus conditional maximum likelihood," IEEE Trans. Acoust., Speech, Signal Process., vol. ASSP-31, no. 4, pp. 814-817, Aug. 1983.
12. B.-H. Juang and S. Katagiri, "Discriminative learning for minimum error classification," IEEE Trans. Signal Process., vol. 40, no. 12, pp. 3043-3054, Dec. 1992.
13. L. Bahl, P. Brown, P. de Souza, and R. Mercer, "Estimating hidden Markov model parameters so as to maximize speech recognition accuracy," IEEE Trans. Speech Audio Process., vol. 1, no. 1, pp. 77-83, Jan. 1993.
14. D. Povey, "Discriminative training for large-vocabulary speech recognition," Ph.D. dissertation, Eng. Dept., Univ. Cambridge, Cambridge, U.K., Mar. 2003.
15. V. Goel, S. Axelrod, R. Gopinath, P. Olsen, and K. Visweswariah, "Discriminative estimation of subspace precision and mean (SPAM) models," in Proc. Eurospeech, 2003, pp. 2617-2620.
16. L. Bahl, P. Brown, P. de Souza, and R. Mercer, "Maximum mutual information estimation of hidden Markov model parameters for speech recognition," in Proc. ICASSP, 1986, pp. 49-52.
17. L. E. Baum and J. A. Eagon, "An inequality with applications to statistical estimation for probabilistic functions of Markov processes and to a model for ecology," Bull. Amer. Math. Soc., vol. 73, pp. 360-363, 1967.
18. P. Gopalakrishnan, D. Kanevsky, A. Nadas, and D. Nahamoo, "An inequality for rational functions with applications to some statistical estimation problems," IEEE Trans. Inf. Theory, vol. 37, no. 1, pp. 107-113, Jan. 1991.
19. Y. Normandin, "Hidden Markov models, maximum mutual information estimation and the speech recognition problem," Ph.D. dissertation, Elect. Eng. Dept., McGill Univ., Montreal, QC, Canada, 1991.
20. A. Gunawardana and W. Byrne, "Discriminative speaker adaptation with conditional maximum likelihood linear regression," in Eur. Conf. Speech Commun. Technol., 2001, pp. 1203-1206.
21. D. Kanevsky, "Extended Baum transformations for general functions," in Proc. ICASSP, May 2004, pp. 821-824.
22. T. Jebara and A. Pentland, "On reversing Jensen's inequality," in Proc. NIPS, 2000, pp. 231-237.
23. S. Axelrod, R. A. Gopinath, and P. Olsen, "Modeling with a subspace constraint on inverse covariance matrices," in Proc. ICSLP, 2002, pp. 2177-2180.
24. K. Visweswariah, P. Olsen, R. A. Gopinath, and S. Axelrod, "Maximum likelihood training of subspaces for inverse covariance modeling," in Proc. ICASSP, 2003, pp. 896-899.
25. Y. Freund and R. Schapire, "A decision-theoretic generalization of online learning and an application to boosting," J. Comput. Syst. Sci., vol. 55, pp. 119-139, 1995.
26. S. Chen and R. A. Gopinath, "Model selection in acoustic modeling," in Proc. Eurospeech, 1999, pp. 1087-1090.
27. L. Bahl, S. Balakrishnan-Aiyer, M. Franz, P. Gopalakrishnan, R. Gopinath, M. Novak, M. Padmanabhan, and S. Roukos, "Performance of the IBM large vocabulary continuous speech recognition system on the ARPA Wall Street Journal task," in Proc. ICASSP, 1995, pp. 41-44.
28. S. Axelrod, V. Goel, B. Kingsbury, K. Visweswariah, and R. Gopinath, "Large vocabulary conversational speech recognition with a subspace constraint on inverse covariance matrices," in Proc. Eurospeech, 2003, pp. 1613-1616.
29. J. Milnor, Singular Point of Complex Hypersurfaces, ser. Ann. Math. Studies. Princeton, NJ: Princeton Univ. Press, 1968.
30. A. Némethi, "Some topological invariants of isolated hypersurface singularities," in Proc. Bolyai Society Math Studies 8, Low Dimensional Topology, 1999 [Online]. Available: www.math.ohio-state.edu/ ñemethi/eger.dvi.