Gaussian mixture models with covariances or precisions in shared multiple subspaces

IEEE Transactions on Audio, Speech and Language Processing

Volumn 14, Issue 4, 2006, Pages 1255-1266

  Dharanipragada, Satya ^a,b   Visweswariah, Karthik ^c  

^a IEEE   (United States)

^b Citadel Investment Group   (United States)

^c IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

Covariance matrices; Density functions; EM algorithm; Factor analysis; Gaussian mixture models (GMMs); Speech recognition

Indexed keywords

COVARIANCE MATRICES; EM ALGORITHM; FACTOR ANALYSIS; GAUSSIAN MIXTURE MODELS (GMM);

ALGORITHMS; MARKOV PROCESSES; MAXIMUM LIKELIHOOD; PROBABILITY DENSITY FUNCTION; SPEECH RECOGNITION;

GAUSSIAN DISTRIBUTION;

EID: 34047259042     PISSN: 15587916     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSA.2005.860835     Document Type: Article

References (33)

1. F. Jelinek, Statistical Methods for Speech Recognition. Cambridge, MA: MIT Press, 1998.
2. D. N. K. S. Nathan, J. R. Bellegarda, and E. Bellegarda, "On-line hand-writing recognition using continuous parameter hidden Markov model," in Proc. ICASSP, vol. 5, pp. 121-124.
3. P. Hedelin and J. Skoglund, "Vector quantization based on Gaussian mixture models," IEEE Trans. Speech Audio Process., vol. 8, no. 4, pp. 385-401, Jul. 2000.
4. A. D. Subramaniam and B. D. Rao, "PDF optimized parametric vector quantization of speech line spectral frequencies," IEEE Trans. Speech Audio Process., vol. 11, no. 2, pp. 130-142, Mar. 2003.
5. H. W. Sorenson and D. L. Aspach, "Nonlinear filtering by approximation of a-posteriori density," Int. J. Contr., vol. 18, pp. 33-51, 1968.
6. _, "Recursive Bayesian estimation using Gaussian sums," Automatica, vol. 7. pp. 465-479, 1971.
7. D. L. Aspach, "Gaussian sum approximations in nonlinear filtering and control," Inf. Sci., vol. 7, pp. 271-290, 1974.
8. A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," J. R. Statist. Soc. B, vol. 39, pp. 1-38, 1977.
9. M. J. F. Gales, "Adapting semi-tied full-covariance matrix HMMs," Cambridge Univ., Cambridge, U.K., Tech. Rep. CUED/F-IN-FENG/TR298, 1997.
10. _, "Semi-tied covariance matrices for hidden Markov models," IEEE Trans. Speech Audio Process., vol. 7, no. 3, pp. 272-281, May 1999.
11. P. Olsen and R. Gopinath, "Modeling inverse covariance matrices by basis expansion," in Proc. ICASSP, vol. 1, 2002, pp. 945-948.
12. S. Axelrod, R. Gopinath, and P. Olsen, "Modeling with a subspace constraint on inverse covariance matrices," in Proc. ICSLP, 2002, pp. 2177-2180.
13. V. Vanhoucke and A. Sankar, "Mixtures of inverse covariances," in Proc. ICASSP, vol. 1, 2003, pp. 900-903.
14. K. V. Mardia, J. T. Kent, and J. M. Bibby, Multivariate Analysis. New York: Academic, 1979.
15. D. B. Rubin and D. T. Thayer, "EM algorithms for ML factor analysis," Psychometrica, vol. 47, no. 1, 1982.
16. Z. Ghahramani and G. Hinton, "The EM algorithm for mixtures of factor analyzers," Univ. Toronto, Toronto, ON, Canada, Tech. Rep. CRG-TR96-1, 1997.
17. R. Gopinath, B. Ramabhadran, and S. Dharanipragada, "Factor analysis invariant to linear transformations of data," in Proc. ICSLP, 1998, pp. 397-400.
18. S. Dharanipragada and K. Visweswariah, "Covariance and precision modeling in shared multiple subspaces," in Proc. ICASSP, vol. 1, 2003, pp. 904-907.
19. K. Visweswariah, P. Olsen, R. Gopinath, and S. Axelrod, "Maximum likelihood training of subspaces for inverse covariance modeling," in Proc. ICASSP, vol. 1, 2003, pp. 896-899.
20. G. McLachian and T. Krishnan, The EM Algorithm and Extensions. New York: Wiley, 1997.
21. D. C. Liu and J. Nocedal, "On the limited memory BFGS method for large scale optimization problems," Math. Progr., vol. 45, pp. 503-528, 1989.
22. C. D. Meyer, Matrix Analysis and Applied Linear Algebra. Philadelphia, PA: SIAM, 2000.
23. M. S. Gockenbach and W. W. Symes. The Hubert Class Library. [Online] Available: hitp://www.trip.caam.rice.edu/txt/hcldoc/html/
24. W. W. More and W. W. Thuente, "Line search algorithms with guaranteed sufficient decrease," ACM Trans. Math. Softw., vol. 20, no. 3, pp. 286-307, 1994.
25. D. A. Harville, Matrix Algebra From a Statisticians Perspective. New York: Springer-Verlag, 1997.
26. V. Vanhoucke, "Mixtures of inverse covariances: covariance modeling for Gaussian mixtures with applications to automatic speech recognition," Ph.D. dissertation, Stanford Univ., Stanford, CA, 2003.
27. S. B. Davis and P. Mermelstein, "Comparison of parametric representations for monosyllabic word recognition in continuously spoken sentences," IEEE Trans. Acoust., Speech. Signal Process., vol. ASSP-28, no. 4, pp. 357-366, Aug. 1980.
28. L. R. Bahl et al., "Performance of the IBM large vocabulary continuous speech recognition system on the ARPA Wall Street Journal task," in Proc. ICASSP, vol. 1, 1995, pp. 41-14.
29. G. D. Forney, "The Viterbi algorithm," Proc. IEEE, vol. 61, no. 3, pp. 268-278, Mar. 1973.
30. G. Schwarz, "Estimating the dimension of a model," Ann. Statist., vol. 6, pp. 461-464, 1978.
31. S. S. Chen and P. S. Gopalakrishnan, "Clustering via the Bayesian information criterion with applications in speech recognition," in Proc. ICASSP, vol. 2, 1998, pp. 645-648.
32. S. Deligne, S. Dharanipragada, R. Gopinath, B. Maison, P. Olsen, and H. Printz, "A robust high accuracy speech recognition system for mobile applications," IEEE Trans. Speech Audio Process., vol. 10, no. 8, pp. 551-561, Nov. 2002.
33. G. Keri, "The Sherman-Morrison formula for the determinant and its application for optimizing quadratic functions on condition sets given by extreme generators," Appl. Opt., pp. 119-138, 2001.