Subspace constrained Gaussian mixture models for speech recognition

IEEE Transactions on Speech and Audio Processing

Volumn 13, Issue 6, 2005, Pages 1144-1160

  Axelrod, Scott ^a,b   Goel, Vaibhava ^a,c   Gopinath, Ramesh A ^a,c   Olsen, Peder A ^a,c   Visweswariah, Karthik ^a,c  

^a IEEE   (United States)

^b Falcon Management Corporation   (United States)

^c IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

Automatic speech recognition; Covariance modeling; Exponential family; Maximum likelihood estimation of SCGMM; Subspace constrained exponential models; Subspace constrained Gaussian mixture models (SCGMMs)

Indexed keywords

AUTOMATIC SPEECH RECOGNITION; COVARIANCE MODELING; EXPONENTIAL FAMILY; MAXIMUM LIKELIHOOD ESTIMATION OF SCGMM; MONOMIALS;

ACOUSTIC FIELDS; AUTOMATION; CONSTRAINT THEORY; MARKOV PROCESSES; MAXIMUM LIKELIHOOD ESTIMATION;

SPEECH RECOGNITION;

EID: 27744444468     PISSN: 10636676     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSA.2005.851965     Document Type: Article

References (43)

1. D. B. Rubin and D. Thayer, "EM algorithm for ML factor analysis," Psychometrika, vol. 57, pp. 69-76, 1976.
2. C. Bishop and M. Tipping, "Probabilistic principal component analysis," J. Roy. Statist. Soc. B, vol. 21, no. 3, pp. 611-622, 1999.
3. L. K. Saul and M. G. Rahim, "Maximum likelihood and minimum classification error factor analysis for automatic speech recognition," IEEE Trans. Speech Audio Process., vol. 8, no. 2, pp. 115-125, Mar. 1999.
4. R. A. Gopinath, B. Ramabhadran, and S. Dharanipragada, "Factor analysis invariant to linear transformations of data," in Proc. ICSLP, 1998.
5. S. Dharanipragada and K. Visweswariah, "Covariance and precision modeling in shared multiple subspaces," in Proc. ICASSP, 2003.
6. R. Gopinath, "Maximum likelihood modeling with gaussian distributions for classification," in Proc. ICASSP, 1998.
7. M. J. F. Gales, "Semi-tied covariance matrices for hidden Markov models," IEEE Trans. Speech Audio Process., vol. 7, no. 3, pp. 272-281, May 1999.
8. P. Olsen and R. A. Gopinath, "Modeling inverse covariance matrices by basis expansion," in Proc. ICASSP, 2002.
9. _, "Modeling inverse covariance matrices by basis expansion," IEEE Trans. Speech Audio Process., vol. 12, no. 1, pp. 37-46, Jan. 2004.
10. R. Fisher, "The use of multiple measurements in taxonomic problems," Ann. Eugen., 1936.
11. _, "The statistitical utilization of multiple measurements," Ann. Eugen., 1938.
12. C. Rao, Linear Statistical Inference and Its Applications. New York: Wiley, 1965.
13. N. Campbell, "Canonical variate analysis - a general formulation," Australian J. Statist., 1984.
14. N. Kumar, "Investigations of Silicon Auditory Models and Generalization of Linear Discriminant Anlysis for Improved Speech Recognition," Ph.D. dissertation, Johns Hopkins University, Baltimore, MD, Mar. 1997.
15. N. Kumar and A. G. Andreou, "Heteroscedastic discriminant analysis and reduced-rank HMM's for improved speech recognition," Speech Commun., vol. 26, pp. 283-297, 1998.
16. S. Axelrod, R. A. Gopinath, and P. Olsen, "Modeling with a subspace constraint on inverse covariance matrices," in Proc. ICSLP, 2002.
17. K. Visweswariah, P. Olsen, R. A. Gopinath, and S. Axelrod, "Maximum likelihood training of subspaces for inverse covariance modeling," in Proc. ICASSP, 2003.
18. S. Axelrod, R. A. Gopinath, P. Olsen, and K. Visweswariah, "Dimensional reduction, covariance modeling, and computational complexity in ASR systems," in Proc. ICASSP, 2003.
19. K. Visweswariah, S. Axelrod, and R. Gopinath, "Acoustic modeling with mixtures of subspace constrained exponential models," in Proc. Eurospeech, 2003.
20. S. Axelrod, V. Goel, B. Kingsbury, K. Visweswariah, and R. Gopinath, "Large vocabulary conversational speech recognition with a subspace constraint on inverse covariance matrices," in Proc. Eurospeech, 2003.
21. V. Vanhoucke and A. Sankar, "Mixtures of inverse covariances," in Proc. ICASSP, 2003.
22. _, "Mixtures of inverse covariances," IEEE Trans. Speech Audio Process., vol. 12, no. 3, pp. 250-264, May 2004.
23. B. Kingsbury, L. Mangu, G. Saon, G. Zweig, S. Axelrod, V. Goel, K. Visweswariah, and M. Picheny, "Toward domain-independent conversational speech recognition," in Proc. Eurospeech, 2003.
24. V. Goel, S. Axelrod, R. Gopinath, P. Olsen, and K. Visweswariah, "Discriminative estimation of subspace precision and mean (SPAM) models," in Proc. Eurospeech, 2003.
25. S. Axelrod, V. Goel, R. A. Gopinath, P. Olsen, and K. Visweswariah, Discriminatively Trained Acoustic Models Comprised of Mixtures of Exponentials With a Tied Subspace Constraint.
26. N. K. Goel and A. G. Andreou, "Heteroscedastic discriminant analysis and reduced-rank HMM's for improved speech recognition," Speech Commun., vol. 26, pp. 283-297, 1998.
27. L. Vandenberghe, S. Boyd, and S.-P. Wu, "Determinant maximization with linear matrix inequality constraints," SIAM J. Matrix Anal. Applic., vol. 19, no. 2, pp. 499-533, April 1998.
28. E. Polak, Computational Methods in Optimization: A Unified Approach. New York: Academic, 1971.
29. J. N. D. C. Liu, "On the limited memory BFGS method for large scale optimization problems," Math. Programm., vol. 45, pp. 503-528, 1989.
30. F. Tisseur and K. Meerbergen, "The quadratic eigenvalue problem," Soc. Ind. Appl. Math., vol. 43, no. 2, pp. 235-286, 2001.
31. S. Deligne, E. Eide, R. Gopinath, D. Kanevsky, B. Maison, P. Olsen, H. Printz, and J. Sedivy, "Low-resource speech recognition of 500 word vocabularies," in Proc. 6th European Conf. Speech Communication and Technology, Aarhus, Denmark, Sep. 2001.
32. L. R. Bahl et al., "Performance of the IBM large vocabulary continuous speech recognition system on the ARPA Wall Street journal task," in Proc. ICASSP, 1995.
33. G. Saon, M. Padmanabhan, R. Gopinath, and S. Chen, "Maximum likelihood discriminant feature spaces," in Proc. ICASSP, 2000.
34. G. Schwarz, "Estimating the dimensions of a model," Ann. Statist., 1978.
35. S. Chen and R. A. Gopinath, "Model selection in acoustic modeling," in Proc. Eurospeech, 1999.
36. E. Bocchieri, "Vector quantization for efficient computation of continuous density likelihoods," in Proc. ICASSP, 1993.
37. H. Hermansky, "Perceptual linear predictive (PLP) analysis of speech," J. Ac-oust. Soc. Amer., vol. 87, no. 4, pp. 1738-1752, Apr. 1990.
38. M. J. F. Gales, "Maximum Likelihood Linear Transformations for HMM-Based Speech Recognition," Cambridge Univ., Tech. Rep. TR 291, 1997.
39. C. J. Leggetter and P. C. Woodland, "Maximum likelihood linear regression for speaker adaptation of continuous density HMMs," Comput. Speech and Lang., vol. 9, no. 2, pp. 171-185, 1995.
40. L. Brown, Fundamentals of Statistical Exponential Familes: Inst. Math. Stat., 1991, vol. 9, Lecture Notes - Monograph Series.
41. L. M. Bregman, "Finding the common point of convex sets by the method of successive projections," Dokl. Akad. Nauk. USSR, vol. 162, pp. 487-490, 1965.
42. _, "The relaxation method of finding the common point of convex sets and its application to the solution of problems in convex programming," USSR Comput. Math. & Math. Phys., vol. 7, no. 3, pp. 200-217, 1967.
43. L. G. Gubin, B. T. Polyak, and E. V. Raik, "The method of projections for finding the common point of convex sets," USSR Comput. Math. Math. Phys., vol. 7, no. 6, pp. 1-24, 1967.