Approximating the Kullback Leibler divergence between Gaussian mixture models

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn 4, Issue , 2007, Pages

  Hershey, John R ^a   Olsen, Peder A ^a  

^a IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

Gaussian mixture models; Kullback Leibler divergence; Unscented transformation; Variational methods

Indexed keywords

GAUSSIAN MIXTURE MODELS; KULLBACK LEIBLER DIVERGENCE; UNSCENTED TRANSFORMATION; VARIATIONAL METHODS;

CONVERGENCE OF NUMERICAL METHODS; GAUSSIAN DISTRIBUTION; MATHEMATICAL MODELS; PATTERN RECOGNITION; PROBLEM SOLVING;

APPROXIMATION ALGORITHMS;

EID: 34547516258     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2007.366913     Document Type: Conference Paper

References (12)

1. Solomon Kullback, Information Theory and Statistics, Dover Publications Inc., Mineola, New York, 1968.
2. Peder Olsen and Satya Dharanipragada, "An efficient integrated gender detection scheme and time mediated averaging of gender dependent acoustic models," in Proceedings of Eurospeech, Geneva, Switzerland, September 1-4 2003, vol. 4, pp. 2509-2512.
3. Harry Printz and Peder Olsen, "Theory and practice of acoustic confusability," Computer, Speech and Language, vol. 16, pp. 131-164, January 2002.
4. Jorge Silva and Shrikanth Narayanan, "Average divergence distance as a statistical discrimination measure for hidden Markov models," IEEE Transactions on Audio, Speech, and Language Processing, vol. 14, no. 3, pp. 890-906, May 2006.
5. Qiang Huo and Wei Li, "A DTW-based dissimilarity measure for left-to-right hidden Markov models and its application to word confusability analysis," in Proceedings of Interspeech 2006 - ICSLP, Pittsburgh, PA, 2006, pp. 2338-2341.
6. Jacob Goldberger, Shiri Gordon, and Hayit Greenspan, "An efficient image similarity measure based on approximations of KL-divergence between two gaussian mixtures," in Proceedings ofICCV2003, Nice, October 2003, vol. 1, pp. 487-493.
7. Michael I. Jordan, Zoubin Ghahramani, Tommi Jaakkola, and Lawrence K. Saul, "An introduction to variational methods for graphical models," Machine Learning, vol. 37, no. 2, pp. 183-233, 1999.
8. Simon Julier and Jeffrey K. Uhlmann, "A general method for approximating nonlinear transformations of probability distributions," Tech. Rep. RRG, Dept. of Engineering Science, University of Oxford, 1996.
9. Thomas M. Cover and Joy A. Thomas, Elements of Information Theory, John Wiley and Sons, New York, NY, 1991.
10. Minn N. Do, "Fast approximation of Kullback-Leibler distance for dependence trees and hidden Markov models," IEEE Signal Processing Letters, vol. 10, no. 4, pp. 115-118, April 2003.
11. R. E. Blahut, "Computation of channel capacity and rate-distortion functions," IEEE Trans. Inform. Theory, vol. IT-18, pp. 460-473, July 1972.
12. S. Arimoto, "An algorithm for computing the capacity of arbitrary discrete memoryless channels," IEEE Trans. Inform. Theory, vol. 18, pp. 14-20, 1972.