Predictive hidden Markov model selection for speech recognition

IEEE Transactions on Speech and Audio Processing

Volumn 13, Issue 3, 2005, Pages 377-387

  Chien, Jen Tzung ^a   Furui, Sadaoki ^b  

^a NATIONAL CHENG KUNG UNIVERSITY   (Taiwan)

^b TOKYO INSTITUTE OF TECHNOLOGY   (Japan)

Author keywords

Approximate Bayesian; Decision tree state tying; Model selection; Multivariate t distribution; Predictive information criterion; Prior posterior propagation; Speech recognition

Indexed keywords

APPROXIMATION THEORY; DECISION THEORY; INFORMATION ANALYSIS; MARKOV PROCESSES; MATHEMATICAL MODELS; MAXIMUM LIKELIHOOD ESTIMATION; PROBLEM SOLVING; TREES (MATHEMATICS);

APPROXIMATE BAYESIAN; DECISION TREE STATE TYING; MODEL SELECTION; MULTIVARIATE T DISTRIBUTION; PREDICTIVE INFORMATION CRITERION; PRIOR/POSTERIOR SPEECH RECOGNITION;

SPEECH RECOGNITION;

EID: 18744376902     PISSN: 10636676     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSA.2005.845810     Document Type: Article

References (34)

1. H. Akaike, "A new look at the statistical model identification, " IEEE Trans. Autom. Control, vol. AC-19, no. 6, pp. 716-723, Dec. 1974.
2. H. Attias, "Inferring parameters and structure of latent variable methods by variational Bayes," in Proc. 15th Conf. Uncertainty Artificial Intelligence, 1999, pp. 21-30.
3. L. R. Bahl, P. V. de Souza, P. S. Gopalakrishnan, D. Nahamoo, and M. A. Picheny, "Decision trees for phonological rules in continuous speech," in Proc. IEEE Int. Conf. Acoustic, Speech, Signal Process., 1991, pp. 185-188.
4. S.S. Chen and P. S. Gopalakrishnan, "Clustering via the Bayesian information criterion with applications in speech recognition," in Proc. IEEE Int. Conf. Acoustic, Speech, Signal Process., vol. 2,1998, pp. 645-648.
5. J.-T. Chien and J.-C. Junqua, "Unsupervised hierarchical adaptation using reliable selection of cluster-dependent parameters," Speech Commun., vol. 30, no. 4, pp. 235-253, Apr. 2000.
6. J.-T. Chien and G.-H. Liao, "Transformation-based Bayesian predictive classification using online prior evolution," IEEE Trans. Speech Audio Process., vol. 9, pp. 399-410, May 2001.
7. J.-T. Chien, C.-H. Huang, and S.-J. Chen, "Compact decision trees with cluster validity for speech recognition," in Proc. IEEE Int. Conf. Acoustics, Speech, Signal Process., vol. 1, 2002, pp. 873-876.
8. W. Chou and W. Reichl, "Decision tree state tying based on penalized Bayesian information criterion," in Proc. IEEE Int. Conf. Acoustics, Speech, Signal Process., vol. 1, 1999, pp. 345-348.
9. M. H. DeGroot, Optimal Statistical Decisions. New York: McGraw-Hill, 1970.
10. P. M. Djuric and S. M. Kay, "Predictive probability as a criterion for model selection," in Proc. IEEE Int. Conf. Acoustics, Speech, Signal Process., vol. 5, 1990, pp. 2415-2418.
11. _, "Model selection based on Bayesian predictive densities and multiple data records," IEEE Trans. Signal Process., vol. 42, no. 7, pp. 1685-1699, Jul. 1994.
12. M. A. T. Figueiredo and A. K. Jain, "Unsupervised learning of finite mixture models," IEEE Trans. Pattern Anal. Machine Intell., vol. 24, no. 3, pp. 381-396, Mar. 2002.
13. J.-L. Gauvain and C.-H. Lee, "Maximum a posteriori estimation for multivariate Gaussian mixture observations of Markov chains," IEEE Trans. Speech Audio Process., vol. 2, pp. 291-298, Apr. 1994.
14. S. Geisser and W. F. Eddy, "A predictive approach to model selection," J. Amer. Statist. Assoc., vol. 74, no. 365, pp. 153-160, Mar. 1979.
15. S. Haykin, Neural Networks - A Comprehensive Foundation, 2nd ed. Englewood Cliffs, NJ: Prentice-Hall, 1999.
16. Q. Huo and C.-H. Lee, "On-line adaptive learning of the continuous density hidden Markov model based on approximate recursive Bayes estimate," IEEE Trans. Speech Audio Process., vol. 5, pp. 161-172, Mar. 1997.
17. Q. Huo, H. Jiang, and C.-H. Lee, "A Bayesian predictive classification approach to robust speech recognition," in Proc. IEEE Int. Conf. Acoustics, Speech, Signal Process., 1997, pp. 1547-1550.
18. M.-Y. Hwang and X. Huang, "Shared-distribution hidden Markov models for speech recognition," IEEE Trans. Speech Audio Process., vol. 1, pp. 414-420, Oct. 1993.
19. M.-Y. Hwang, X. Huang, and F. A. Alleva, "Predicting unseen triphones with senones," IEEE Trans. Speech Audio Process., vol. 4, pp. 412-419, Nov. 1996.
20. A. Hyvarinen and E. Oja, "Independent component analysis: Algorithms and applications," Neural Networks, vol. 13, pp. 411-430, 2000.
21. H. Jiang, K. Hirose, and Q. Huo, "Robust speech recognition based on a Bayesian prediction approach," IEEE Trans. Speech Audio Process., vol. 7, pp. 426-440, Jul. 1999.
22. D. J. C. Mackay, "Bayesian interpolation," Neural Comput., vol. 4, pp. 405-447, 1992.
23. N. Merhav, "The estimation of the model order in exponential families," IEEE Trans. Inf. Theory, vol. 35, pp. 1109-1114, Sep. 1989.
24. M. Padmanabhan, L. R. Bahl, D. Nahamoo, and M. A. Picheny, "Speaker clustering and transformation for speaker adaptation in speech recognition systems," IEEE Trans. Speech Audio Process., vol. 6, pp. 71-77, Jan. 1998.
25. L. Rabiner and B.-H. Juang, Fundamentals of Speech Recognition. Englewood Cliffs, NJ: Prentice-Hall, 1993.
26. J. Rissanen, "Modeling by shortest data description," Automatica, vol. 14, pp. 465-471, 1978.
27. G. Schwarz, "Estimating the dimension of a model," Ann. Statist., vol. 6, no. 2, pp. 461-464, 1978.
28. K. Shinoda and C.-H. Lee, "A structural Bayes approach to speaker adaptation," IEEE Trans. Speech Audio Process., vol. 9, pp. 276-287, Mar. 2001.
29. K. Shinoda and T. Watanabe, "Acoustic modeling based on the MDL principle for speech recognition," in Proc. Eur. Conf. Speech Commun. Technol., vol. 1, 1997, pp. 99-102.
30. O. Siohan, T. A. Myrvoll, and C.-H. Lee, "Structural maximum a posteriori linear regression for fast HMM adaptation," Comput. Speech Lang., vol. 16, pp. 5-24, 2002.
31. J. P. Ueberla, "Domain adaptation with clustered language models," in Proc. IEEE Int. Conf. Acoustics, Speech, Signal Process., 1997, pp. 807-810.
32. J.-P. Vila, V. Wagner, and P. Neveu, "Bayesian nonlinear model selection and neural networks: A conjugate prior approach," IEEE Trans. Neural Networks, vol. 11, no. 2, pp. 265-278, Mar. 2000.
33. S. J. Young, J. J. Odell, and P. Woodland, "Tree-based state-tying for high accuracy acoustic modeling," in Proc. ARPA Workshop Human Language Technol., 1994, pp. 286-291.
34. Z. Zhang and S. Furui, "Piecewise-linear transformation-based HMM adaptation for noisy speech," in Proc. IEEE Workshop Autom. Speech Recognition Understanding, 2001.