Multi-level fusion of audio and visual features for speaker identification

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 3832 LNCS, Issue , 2006, Pages 493-499

  Wu, Zhiyong ^a,b   Cai, Lianhong ^a   Meng, Helen ^b  

^a TSINGHUA UNIVERSITY   (China)

^b CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

[No Author keywords available]

Indexed keywords

ACOUSTICS; ARTIFICIAL INTELLIGENCE; DATABASE SYSTEMS; SIGNAL TO NOISE RATIO;

AUDIO-VISUAL CORRELATIVE MODEL (AVCM); BIMODAL SPEAKER IDENTIFICATION; DECISION LEVEL FUSION; DYNAMIC BAYESIAN NETWORK (DBN); MULTI-LEVEL HYBRID FUSION;

FEATURE EXTRACTION;

EID: 33744958808     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: None     Document Type: Conference Paper

References (11)

1. Senior, A., Neti, C., Maison, B.: On the use of visual information for improving audio-based speaker recognition. In: Proc. Audio-visual Speech Processing Conf. (1999) 108-111
2. Nefian, A.V., Liang, L.H., Fu, T.Y., Liu, X.X.: A Bayesian approach to audio-visual speaker identification. In: Proc. 4th International Conf. Audio- and Video-based Biometric Person Authentication, Vol. 2688 (2003) 761-769
3. Chibelushi, C.C., Deravi, F., Mason, J.S.D.: A review of speech-based bimodal recognition. IEEE Trans. Multimedia 4 (2002) 23-37
4. Chibelushi, C.C., Mason, J.S.D., Deravi, F.: Feature-level data fusion for bimodal person recognition. In: Proc. 6th IEEE International Conf. Image Processing and its Applications. IEE, Stevenage (1997) 399-403
5. Chatzis, V., Bors, A.G., Pitas, I.: Multimodal decision-level fusion for person authentication. IEEE Trans. Syst. Man Cybern. A 29 (1999) 674-680
6. Dupont, S., Luettin, J.: Audio-visual speech modeling for continuous speech recognition. IEEE Trans. Multimedia 2 (2000) 141-151
7. Gowdy, J.N., Subramanya, A., Bartels, C., Bilmes, J.: DBN based multi-stream models for audio-visual speech recognition. In: Billene, M. (ed.): Proc. IEEE International Conf. Acoustics, Speech, and Signal Processing, Vol. 1. IEEE, Canada (2004) 993-996
8. Dean, T., Kanazawa, J.: Probabilistic temporal reasoning. In: Proc. 7th National Conf. Artificial Intelligence (1988) 524-528
9. WU, Z.Y.: Audio-visual bimodal modeling for speaker identification and visual-speech synthesis. Ph.D. Dissertation. Department of Computer Science and Technology, Tsinghua University, Beijing, China (2005)
10. Chen, T.: Audiovisual speech processing. IEEE Trans. Signal Processing 18 (2001) 9-21
11. Bilmes, J., Zweig, G.: The graphical models toolkit: An open source software system for speech and time-series processing. In: Proc. IEEE International Conf. Acoustics, Speech and Signal Processing, Vol. 4. IEEE, Florida (2002) 3916-3919