Accelerated Monte Carlo for Kullback-Leibler divergence between Gaussian mixture models

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2008, Pages 4553-4556

  Chen, Jia Yu ^a   Hershey, John R ^a   Olsen, Peder A ^a   Yashchin, Emmanuel ^a  

^a IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

Antithetic variates; Control variates; Gaussian mixture models; Importance sampling; Kullback leibler divergence; Variational methods

Indexed keywords

ANTITHETIC VARIATES; CONTROL VARIATES; GAUSSIAN MIXTURE MODELS; IMPORTANCE SAMPLING; KULLBACK LEIBLER DIVERGENCE; VARIATIONAL METHODS;

ACOUSTICS; APPROXIMATION THEORY; BLIND SOURCE SEPARATION; COMMUNICATION CHANNELS (INFORMATION THEORY); INFORMATION RETRIEVAL SYSTEMS; OBJECT RECOGNITION; POLYNOMIAL APPROXIMATION; PROBABILITY DISTRIBUTIONS; RISK ASSESSMENT; SAMPLING; SIGNAL PROCESSING; SPEECH; STOCHASTIC CONTROL SYSTEMS; TRELLIS CODES;

MONTE CARLO METHODS;

EID: 51449098224     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2008.4518669     Document Type: Conference Paper

References (8)

1. Solomon Kullback, Information Theory and Statistics, Dover Publications Inc., Mineola, New York, 1968.
2. Peder Olsen and Satya Dharanipragada, "An efficient integrated gender detection scheme and time mediated averaging of gender dependent acoustic models," in Proceedings of Eurospeech, Geneva, Switzerland, September 1-4 2003, vol. 4, pp. 2509-2512.
3. Harry Printz and Peder Olsen, "Theory and practice of acoustic confusability," Computer, Speech and Language, vol. 16, pp. 131-164, January 2002.
4. Jorge Silva and Shrikanth Narayanan, "Average divergence distance as a statistical discrimination measure for hidden Markov models," IEEE Transactions on Audio, Speech, and Language Processing, vol. 14, no. 3, pp. 890-906, May 2006.
5. Qiang Huo and Wei Li, "A DTW-based dissimilarity measure for left-to-right hidden Markov models and its application to word confusability analysis," in Proceedings of Interspeech 2006 - ICSLP, Pittsburgh, PA, 2006, pp. 2338-2341.
6. Jacob Goldberger, Shiri Gordon, and Hayit Greenspan, "An efficient image similarity measure based on approximations of KL-divergence between two gaussian mixtures," in Proceedings of ICCV 2003, Nice, October 2003, vol. 1, pp. 487-493.
7. R.Y. Rubinstein, Simulation and the Monte Carlo Method, Wiley, 1981.
8. John Hershey and Peder Olsen, "Approximating the Kullback Leibler divergence between gaussian mixture models," in ICASSP, Honolulu, Hawaii, April 2007.