A bayesian approach to audio-visual speaker identification

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 2688, Issue , 2003, Pages 761-769

  Nefian, Ara V ^a   Liang, Lu Hong ^a   Fu, Tieyan ^b   Liu, Xiao Xing ^a  

^a INTEL CORPORATION   (United States)

^b TSINGHUA UNIVERSITY   (China)

Author keywords

[No Author keywords available]

Indexed keywords

AUDIO ACOUSTICS; AUDIO SYSTEMS; BAYESIAN NETWORKS; BIOMETRICS; CHARACTER RECOGNITION; DATABASE SYSTEMS; FACE RECOGNITION; HIDDEN MARKOV MODELS; LOUDSPEAKERS; MARKOV PROCESSES; SIGNAL TO NOISE RATIO; SPEECH ANALYSIS; TRELLIS CODES;

AUDIO-VISUAL SPEECH; BAYESIAN APPROACHES; CONDITIONAL DEPENDENCE; COUPLED HIDDEN MARKOV MODELS; EMBEDDED HIDDEN MARKOV MODELS; SPEAKER IDENTIFICATION; TEMPORAL SEQUENCES; VISUAL OBSERVATIONS;

SPEECH RECOGNITION;

EID: 35248821400     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/3-540-44887-x_88     Document Type: Article

References (23)

1. P.N. Belhumeur, J.P Hespanha, and D.J. Kriegman. Eigenfaces vs Fisherfaces: Recognition using class specific linear projection. In Proceedings of Fourth Europeean Conference on Computer Vision, ECCV'96, pages 45-58, April 1996.
2. M. Brand, N. Oliver, and A. Pentland. Coupled hidden Markov models for complex action recognition. In IEEE International Conference on Computer Vision and Pattern Recognition, pages 994-999, 1997.
3. G. Chibelushi, F. Deravi, and S.D. Mason. A review of speech-based bimodal recognition. IEEE Transactions on Multimedia, 4(1):23-37, March 2002.
4. S. Dupont and J. Luettin. Audio-visual speech modeling for continuous speech recognition. IEEE Transactions on Multimedia, 2:141-151, September 2000.
5. S. Kuo and O.E. Agazzi. Keyword spotting in poorly printed documents using pseudo 2-D Hidden Markov Models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 16(8):842-848, August 1994.
6. A. Lawrence, C.L. Giles, A.C Tsoi, and A.D. Back. Face recognition : A convolutional neural network approach. IEEE Transactions on Neural Networks, 8(1):98-113, 1997.
7. Jia Lia, A. Najmi, and R.M. Gray. Image classification by a two-dimensional hidden markov model. IEEE Transactions on Signal Processing, 48(2):517-533, February 2000.
8. L. Liang, X. Liu, X. Pi, Y. Zhao, and A. V. Nefian. Speaker independent audiovisual continuous speech recognition. In International Conference on Multimedia and Expo, volume 2, pages 25-28, 2002.
9. R. Lienhart and J. Maydt. An extened set of Haar-like features for rapid objection detection. In IEEE International Conference on Image Processing, volume 1, pages 900-903, 2002.
10. X. Liu, L. Liang, Y. Zhao, X. Pi, and A. V. Nefian. Audio-visual continuous speech recognition using a coupled hidden Markov model. In International Conference on Spoken Language Processing, 2002.
11. J. Luettin and G. Maitre. Evaluation protocol for the XM2FDB database. In IDIAP-COM 98-05, 1998.
12. A. V. Nefian and M. H. Hayes. Face recognition using an embedded HMM. In Proceedings of the IEEE Conference on Audio and Video-based Biometric Person Authentication, pages 19-24, March 1999.
13. A. V. Nefian, L. Liang, X. Pi, X. Liu, and C. Mao. A coupled hidden Markov model for audio-visual speech recognition. In International Conference on Acoustics, Speech and Signal Processing, volume 2, pages 2013-2016, 2002.
14. Ara V. Nefian. Embedded Bayesian networks for face recognition. In IEEE International Conference on Multimedia and Expo, volume 2, pages 25-28, 2002.
15. Ara V. Nefian and Monson H. Hayes III. Maximum likelihood training of the embedded HMM for face detection and recognition. In IEEE International Conference on Image Processing, volume 1, pages 33-36, 2000.
16. C. Neti, G. Potamianos, J. Luettin, I. Matthews, D. Vergyri, J. Sison, A. Mashari, and J. Zhou. Audio visual speech recognition. In Final Workshop 2000 Report, 2000.
17. Jonathon Phillips. Matching pursuit filters applied to face identification. IEEE Transactions on Image Processing, 7(8):1150-1164, August 1998.
18. G. Potamianos, J. Luettin, and C. Neti. Asynchronous stream modeling for large vocabulary audio-visual speech recognition. In IEEE International Conference on Acoustics, Speech and Signal Processing, volume 1, pages 169-172, 2001.
19. D.A. Reynolds, T.F. Quatieri, and R.B. Dunn. Speaker verification using an adapted gaussian mixture model. Digital Signal Processing, 10:19-41, 2000.
20. F. Samaria. Face Recognition Using Hidden Markov Models. PhD thesis, University of Cambridge, 1994.
21. L.K. Saul and M.L. Jordan. Boltzmann chains and hidden Markov models. In G. Tesauro, David S. Touretzky, and T. Leen, editors, Advances in Neural Information Processing Systems, volume 7. The MIT Press, 1995.
22. S.B. Yacouband, S. Luettin, J. Jonsson, K. Matas, and J. Kittler. Audio-visual person verification. In IEEE International Conference on Computer Vision and Pattern Recognition, pages 580-585, 1999.
23. M. Turk and A.P. Pentland. Face recognition using eigenfaces. In Proceedings of International Conference on Pattern Recognition, pages 586-591, 1991.