A doubly hierarchical dirichlet process Hidden Markov Model with a non-ergodic structure

IEEE/ACM Transactions on Audio Speech and Language Processing

Volumn 24, Issue 1, 2016, Pages 174-184

  Torbati, Amir H Harati Nejad ^a   Picone, Joseph ^b  

^a JIBO   (United States)

^b Temple University   (United States)

Author keywords

Hidden Markov models; Hierarchical Dirichlet processes; Nonparametric Bayesian models; Speech recognition

Indexed keywords

BAYESIAN NETWORKS; MARKOV PROCESSES; SPEECH RECOGNITION; TARGET TRACKING; TOPOLOGY; TRELLIS CODES; VARIATIONAL TECHNIQUES;

BAYESIAN FRAMEWORKS; GAUSSIAN MIXTURE MODEL; HIERARCHICAL DIRICHLET PROCESS; MIXTURE DISTRIBUTIONS; NON-PARAMETRIC BAYESIAN; NONPARAMETRIC BAYESIAN MODELS; PHONEME CLASSIFICATION; SPEAKER VARIABILITY;

HIDDEN MARKOV MODELS;

EID: 84957065543     PISSN: 23299290     EISSN: None     Source Type: Journal    
DOI: 10.1109/TASLP.2015.2500732     Document Type: Article

References (34)

1. L. Rabiner, "A tutorial on hidden markov models and selected applications in speech recognition," Proc. IEEE, vol. 77, no. 2, pp. 257-286, Feb. 1989.
2. J. B. Kadane and N. A. Lazar, "Methods and criteria for model selection," J. Acoust. Soc. Amer., vol. 99, no. 465, pp. 279-290, 2004.
3. M. Beal, Z. Ghahramani, and C. E. Rasmussen, "The infinite hidden Markov model," in Proc. NIPS, 2002, pp. 577-584.
4. Y. W. Teh, M. Jordan, M. Beal, and D. Blei, "Hierarchical Dirichlet processes," J. Acoust. Soc. Amer., vol. 101, no. 47, pp. 1566-1581, 2006.
5. E. Fox, E. Sudderth, M. Jordan, and A. Willsky, "A sticky HDP-HMM with application to speaker diarization," Ann. Appl. Statist., vol. 5, no. 2A, pp. 1020-1056, 2011.
6. G. A. Fink, "Configuration of hidden markov models from theory to applications," in Markov Models for Pattern Recognition. Berlin, Heidelberg, Germany: Springer, 2008, pp. 127-136.
7. B.-H. Juang and L. Rabiner, "Hidden Markov models for speech recognition," Technometrics, vol. 33, no. 3, pp. 251-272, 1991.
8. S. Young, G. Evermann, M. Gales, T. Hain, D. Kershaw, X. Liu, G. Moore, J. Odell, D. Ollagson, D. Povey, V. Valtchev, and P. Woodland, The HTK Book. Cambridge, U.K.: , 2006.
9. A. Harati Nejad Torbati, J. Picone, and M. Sobel, "A left-to-right HDP-HMM with HDPM emissions," in Proc. CISS, 2014, pp. 1-6.
10. [Online]. Available: Http://www.isip.piconepress.com/projects/npb-acoustic-modeling/downloads/hdphmm
11. Y.-W. Teh, "Dirichlet process," in Encyclopedia of Machine Learning. New York, NY, USA: Springer, 2010, pp. 280-287.
12. J. Sethuraman, "A constructive definition of Dirichlet priors," Statist. Sinica, vol. 4, no. 2, pp. 639-650, 1994.
13. C. E. Rasmussen, "The infinite Gaussian mixture model," in Proc. NIPS, 2000, pp. 554-560.
14. H. Ishwaran and M. Zarepour, "Exact and approximate sum representations for the Dirichlet process," Can. J. Statist., vol. 30, no. 2, pp. 269-283, 2002.
15. D. Povey, A. Ghoshal, G. Boulianne, L. Burget, O. Glembek, N. Goel, M. Hannemann, P. Motlicek, Y. Qian, P. Schwarz, J. Silovsky, G. Stemmer, and K. Vesely, "The Kaldi speech recognition toolkit," in Proc. IEEE Workshop Autom. Speech Recognit. Understand., 2011.
16. S. Young and P. C. Woodland, "State clustering in HMM-based continuous speech recognition," Comput. Speech Lang., vol. 8, no. 4, pp. 369-383, 1994.
17. J. Pitman, Probability. New York, NY, USA: Springer-Verlag, 1993, pp. 480-498.
18. A. Gelman, J. B. Carlin, H. S. Stern, and D. B. Rubin, Bayesian Data Analysis, 2nd Ed. ed. London, U.K.: Chapman & Hall, 2004.
19. P. Diaconis, K. Khare, and L. Saloff-Coste, "Gibbs sampling, conjugate priors and coupling," Sankhya A, vol. 72, no. 1, pp. 136-69, 2010.
20. F. A. Quintana and W. Tam, "Bayesian estimation of beta-binomial models by simulating posterior densities," J. Chilean Statist. Soc., vol. 13, no. 1-2, pp. 43-56, 1996.
21. J. Garofolo, L. Lamel, W. Fisher, J. Fiscus, D. Pallet, N. Dahlgren, and V. Zue, "TIMIT acoustic-phonetic continuous speech corpus," in Linguist. Data Consortium Cat., 1993.
22. C. E. Rasmussen and Z. Ghahramani, "Occam's razor," in Proc. NIPS, 2001, pp. 294-300.
23. A. Gunawardana, M. Mahajan, A. Acero, and J. C. Platt, "Hidden conditional random fields for phone classification," in Proc. INTERSPEECH, 2005, pp. 1117-1120.
24. F. Sha and L. K. Saul, "Large margin Gaussian mixture modeling for phonetic classification and recognition," in Proc. ICASSP, 2006, pp. 265-268.
25. P. Clarkson and P. J. Moreno, "On the use of support vector machines for phonetic classification," in Proc. ICASSP, 1999, pp. 585-588.
26. S. Petrov, A. Pauls, and D. Klein, "Learning structured models for phone recognition," in Proc. EMNLP-CoNLL, 2007, pp. 897-905.
27. K.-F. Lee and H.-W. Hon, "Speaker-independent phone recognition using hidden Markov models," IEEE Trans. Acoust., Speech, Signal Process., vol. 37, no. 11, pp. 1641-1648, Nov. 1989.
28. L. Lamel and J.-L. Gauvain, "High performance speaker-independent phone recognition using CDHMM," in Proc. EUROSPEECH, 1993, pp. 121-124.
29. S. Kapadia, V. Valtchev, and S. Young, "MMI training for continuous phoneme recognition on the TIMIT database," in Proc. ICASSP, 1993, pp. 491-494.
30. A. K. Halberstadt and J. R. Glass, "Heterogeneous acoustic measurements and multiple classifiers for speech recognition," in Proc. ICSLP, 1998, pp. 995-998.
31. J. Morris and E. Fosler-Lussier, "Conditional random fields for integrating local discriminative classifiers," IEEE Trans. Audio., Speech, Lang. Process., vol. 16, no. 3, pp. 617-628, Mar. 2008.
32. D. Palaz, R. Collobert, and M. Magimai-Doss, "End-to-end phoneme sequence recognition using convolutional neural networks," in Proc. NIPS Deep Learn. Workshop, 2013, pp. 1-8.
33. S. N. MacEachern, "Dependent nonparametric processes," in ASA Proc. Sect. Bayesian Statist. Sci., 1999, pp. 50-55.
34. G. Tomlinson and M. Escobar, Analysis of Densities. Toronto, ON, Canada: Univ. of Toronto, 1999.