Audio-visual speaker identification using coupled hidden Markov models

IEEE International Conference on Image Processing

Volumn 3, Issue , 2003, Pages 29-32

  Fu, Tieyan ^a   Liu, Xiao Xing ^b   Liang, Lu Hong ^b   Pi, Xiaobo ^b   Nefian, Ara V ^b  

^a TSINGHUA UNIVERSITY   (China)

^b INTEL CORPORATION   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATABASE SYSTEMS; MARKOV PROCESSES; MATRIX ALGEBRA; ROBUSTNESS (CONTROL SYSTEMS); SIGNAL TO NOISE RATIO; SPEECH ANALYSIS;

PERSON IDENTIFICATION SYSTEMS; SPEAKER IDENTIFICATION;

INFORMATION ANALYSIS;

EID: 0345565778     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (18)

1. A.Senior, C.Neti, and B.Maison. On the use of visual information for improving audio-based speaker recognition. In In Proc. of Audio Visual Speech Processing Conference, 1999.
2. M. Brand, N. Oliver, and A. Pentland. Coupled hidden Markov models for complex action recognition. In IEEE International Conference on Computer Vision and Pattern Recognition, pages 994-999, 1997.
3. T. Chen. Audiovisual speech processing. Signal Processing Magazine, 18:9-21, January 2001.
4. C. Chibelushi, F. Deravi, and S.D. Mason. A review of speech-based bimodal recognition. IEEE Transactions on Multimedia, 4(1):23-37, March 2002.
5. S. Dupont and J. Luettin. Audio-visual speech modeling for continuous speech recognition. IEEE Transactions on Multimedia, 2:141-151, September 2000.
6. S. Young et. al. The HTK Book. Entropic Cambridge Research Laboratory, Cambridge, UK, 1995.
7. J.Luettin, N.Thacker, and S.Beer. Speaker indetification by lipreading. In In Proc. of International Conference on Spoken Language Processing, pages 62-64, 1996.
8. L. Liang, X. Liu, X. Pi, Y. Zhao, and A. V. Nefian. Speaker independent audio-visual continuous speech recognition. In International Conference on Multimedia and Expo, volume 2, pages 25-28, 2002.
9. X. Liu, L. Liang, Y. Zhao, X. Pi, and A. V. Nefian. Audio-visual continuous speech recognition using a coupled hidden Markov model. In International Conference on Spoken Language Processing, 2002.
10. J. Luettin and G. Maitre. Evaluation protocol for the XM2FDB database. In IDIAP-COM 98-05, 1998.
11. A. V. Nefian, L. Liang, X. Pi, X. Liu, and C. Mao. A coupled hidden Markov model for audio-visual speech recognition. In International Conference on Acoustics, Speech and Signal Processing, volume 2, pages 2013-2016, 2002.
12. A.V. Nefian, L. Liang, X. Liu, X. Pi, C. Mao, and K. Murphy. Dynamic Bayesian networks for audio-visual speech recognition. EURASIP Applied Signal Processing, special Issue on Audio Visual Signal Processing, 2002, to appear.
13. C. Neti, G. Potamianos, J. Luettin, I. Matthews, D. Vergyri, J. Sison, A. Mashari, and J. Zhou. Audio visual speech recognition. In Final Workshop 2000 Report, 2000.
14. G. Potamianos, J. Luettin, and C. Neti. Asynchronous stream modeling for large vocabulary audio-visual speech recognition. In IEEE International Conference on Acoustics, Speech and Signal Processing, volume 1, pages 169-172, 2001.
15. D.A. Reynolds, T.F. Quatieri, and R.B. Dunn. Speaker verification using an adapted gaussian mixture model. Digital Signal Processing, 10:19-41, 2000.
16. L.K. Saul and M.L. Jordan. Boltzmann chains and hidden Markov models. In G. Tesauro, David S. Touretzky, and T. Leen, editors, Advances in Neural Information Processing Systems, volume 7. The MIT Press, 1995.
17. S.B.Yacouband, S.Luettin, J.Jonsson, K.Matas, and J.Kittler. Audiovisual person verification. In IEEE International Conference on Computer Vision and Pattern Recognition, pages 580-585, 1999.
18. P. Teissier, J. Rober-Ribes, J.-L. Schwartz, and A. Guerin-Dugue. Comparing models for audio-visual fusion in a noisy vowel recognition task. IEEE Transactions on Speech and Audio and Signal Processing, 7:629-642, 1999.