Upper bound Kullback-Leibler divergence for hidden Markov models with application as discrimination measure for speech recognition

IEEE International Symposium on Information Theory - Proceedings

Volumn , Issue , 2006, Pages 2299-2303

  Silva, Jorge ^a   Narayanan, Shrikanth ^a  

^a University of Southern California

Author keywords

[No Author keywords available]

Indexed keywords

GAUSSIAN MIXTURES MODELS (GMMS); UPPER BOUND KULLBACK LEIBLER;

ALGORITHMS; DATA MINING; MATHEMATICAL MODELS; SPEECH RECOGNITION;

MARKOV PROCESSES;

EID: 39049150766     PISSN: 21578101     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ISIT.2006.261977     Document Type: Conference Paper

References (17)

1. S. Kullback, Information theory and statistics, New York: Wiley, 1958.
2. J. Silva and S. Narayanan, "Average divergence distance as a statistical discrimination measure for hidden Markov models," IEEE Transactions on Audio, Speech and Language Processing, vol. 14, no. 3, pp. 890-906, May 2006.
3. M. N. Do and M. Vetterli, "Rotation invariant texture characterization and retrieval using steerable wavelet-domain hidden Markov model," IEEE Transaction on Multimedia, vol. 4, no. 4, pp. 517-527, December 2002.
4. N. Vasconcelos, "On the efficient evaluation of probabilistic similarity functions for image retrieval," IEEE Transactions on Information Theory, vol. 50, no. 7, pp. 1482-1496, July 2004.
5. Y. Singer and M.K. Warmuth, "Batch and on-line parameter estimation of Gaussian mixtures based on the joint entropy," in Advances in Neural Information Processing System, vol. 11, pp. 578-584, 1998.
6. T. M. Cover and J. A. Thomas, Elements of information theory, Wiley Interscience, 1991.
7. Y. Singer and M.K. Warmuth, "Training algorithm for hidden Markov models using entropy based distance functions," in Advances in Neural Information Processing System, vol. 9, pp. 641-647, 1996.
8. M. N. Do and M. Vetterli, "Fast approximation of Kullback - Leibler distance for dependence trees and hidden Markov models," IEEE Signal Processing Letters, vol. 10, no. 4, pp. 115-118, April 2003.
9. J. Silva and S. Narayanan, "An upper bound for the Kullback-Leibler divergence for left-to-right transient hidden Markov models," IEEE Transactions on Information Theory, vol. submitted for review, June 2005.
10. L. R. Rabiner, "A tutorial on hidden Markov models and selected applications in speech recognition," Proc. IEEE, vol. 77, no. 2, pp. 257-286, February 1989.
11. B. H. Juang and L. R. Rabiner, "A probabilistic distance measure for hidden Markov models," AT&T Technical Journal, vol. 64, no. 2, pp. 391-108, 1985.
12. Y. Ephraim and N. M. Merhav, "Hidden Markov processes," IEEE Transactions on Information Theory, vol. 48, no. 6, pp. 1518-1569, June 2002.
13. J.R. Norris, Markov Chains, Cambridge series in Statistical and Probabilistic Mathematics, 1999.
14. F. Jelinek, Statistical methods for speech recognition, MIT Press, 1997.
15. S. Yildirim and S. Narayanan, "An Information-Theoretic analysis of developmental changes in speech," in Proc. ICASSP, April 2003.
16. M. Vihola, M. Harju, P. Salmela, J. Suontausta, and J. Savela, "Two dissimilarity measures for hmms and their application in phoneme model clustering," in in Proc. ICASSP 2002, 2002, pp. 933-936.
17. M.-Y. Tsai and L.-S. Lee, "Pronunciation variations based on acoustic phonemic distance measures with applications examples of mandarin Chinese," in in ASRU, December 2003.