Variational Kullback-leibler divergence for hidden Markov models

2007 IEEE Workshop on Automatic Speech Recognition and Understanding, ASRU 2007, Proceedings

Volumn , Issue , 2007, Pages 323-328

  Hershey, John R ^a   Olsen, Peder A ^a   Rennie, Steven J ^a  

^a IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

Bhattacharyya divergence; Hidden Markov models (HMMs); Kullback Leibler divergence; Mixture models; Variational methods; Weighted edit distance

Indexed keywords

IMAGE RECOGNITION; MIXTURES; SPEECH RECOGNITION;

BHATTACHARYYA DIVERGENCE; HIDDEN MARKOV MODELS (HMMS); KULLBACK LEIBLER DIVERGENCE; MIXTURE MODEL; VARIATIONAL METHODS; WEIGHTED EDIT DISTANCE;

HIDDEN MARKOV MODELS;

EID: 44849141474     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/asru.2007.4430132     Document Type: Conference Paper

References (13)

1. Solomon Kullback, Information Theory and Statistics, Dover Publications Inc., Mineola, New York, 1968.
2. Peder Olsen and Satya Dharanipragada, "An efficient integrated gender detection scheme and time mediated averaging of gender dependent acoustic models," in Eurospeech, Geneva, Switzerland, September 1-4 2003, vol. 4, pp. 2509-2512.
3. Harry Printz and Peder Olsen, "Theory and practice of acoustic confusability," Computer, Speech and Language, vol. 16, pp. 131-164, January 2002.
4. Jorge Silva and Shrikanth Narayanan, "Average divergence distance as a statistical discrimination measure for hidden Markov models," IEEE Transactions on Audio, Speech, and Language Processing, vol. 14, no. 3, pp. 890-906, May 2006.
5. Qiang Huo and Wei Li, "A DTW-based dissimilarity measure for leftto-right hidden Markov models and its application to word confusability analysis," in Proceedings of Interspeech 2006 - ICSLP, Pittsburgh, PA, 2006, pp. 2338-2341,
6. Jacob Goldberger, Shiri Gordon, and Hayit Greenspan, "An efficient image similarity measure based on approximations of KL-divergence between two gaussian mixtures," in Proceedings of ICCV 2003, Nice, October 2003, vol. 1, pp. 487-493.
7. L. D. Brown, Fundamentals of statistical exponential families, vol 9 of Lecture Notes - Monograph Series, Institute of Math. Stat., 1991.
8. Peder A. Olsen and Karthik Visweswariah, "Fast clustering of gaussians and the virtue of representing gaussians in exponential model format," Proceedings of the International Conference on Spoken Language Processing, October 2004.
9. B. H. Juang and L. R. Rabiner, "A probabilistic distance measure for hidden Markov models," AT&T technical Journal, vol. 64, no. 2, pp. 391-408, 1985.
10. D. Johnson and S. Sinanovic, "Symmetrizing the Kullback Leibler distance," http://www-dsp.rice.edu/~dhj/resistor.pdf.
11. John Hershey and Peder Olsen, "Approximating the Kullback Leibler divergence between gaussian mixture models," in ICASSP, Honolulu, Hawaii, April 2007.
12. Jorge Silva and Shrikanth Narayanan, "Upper bound Kullback-Leibler divergence for hidden Markov models with application as discrimination measure for speech recognition," IEEE International Symposium on Information Theory, 2006.
13. Peder Olsen and John Hershey, "Bhattacharyya error and divergence using variational importance sampling," in ICSLP, Antwerp, Belgium, August 2007.