Multimodal information fusion using the iterative decoding algorithm and its application to audio-visual speech recognition

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

Volumn , Issue , 2008, Pages 2241-2244

  Shivappa, Shankar T ^a   Rao, Bhaskar D ^a   Trivedi, Mohan M ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Hidden markov models; Iterative decoding; Multimedia systems; Robustness; Speech recognition

Indexed keywords

FUSION SCHEME; MULTIMEDIA SYSTEMS; ROBUSTNESS;

ACOUSTICS; BOOLEAN FUNCTIONS; CODES (SYMBOLS); COMPUTER NETWORKS; DATA FUSION; DECODING; FUSION REACTIONS; HIDDEN MARKOV MODELS; INFORMATION FUSION; ITERATIVE DECODING; ITERATIVE METHODS; MARKOV PROCESSES; SENSOR NETWORKS; SENSORS; SIGNAL PROCESSING; SPEECH; SPEECH ANALYSIS; TURBO CODES;

SPEECH RECOGNITION;

EID: 51449122700     PISSN: 15206149     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICASSP.2008.4518091     Document Type: Conference Paper

References (10)

1. M. Cooke, J. Barker, S. Cunningham, and X. Shao, "An audiovisual corpus for speech perception and automatic speech recognition," The. Journal of the Acoustical Society of America, vol. 120, pp. 2421-2424, Nov 2006.
2. S. Shivappa, B. Rao, and M. Trivedi, "An iterative decoding algorithm for fusion of multimodal information," EURASIP Journal on Advances in Signal Processing - special issue on Human-Activity Analysis in Multimedia Data, Jan 2008.
3. C. Neti, G. Potamianos, J. Luettin, T. Matthews, H. Glotin, and D. Vergyri, "Large-vocabulary audio-visual speech recognition: A summary of the Johns Hopkins summer 2000 workshop," in Proceedings of IEEE Workshop Multimedia Signal Processing, Cannes, 2001.
4. A. V. Nefian, L. Liang, X. Pi, X. Liu, and K. Murphy, "Dynamic bayesian networks for audio-visual speech recognition," EURASIP Journal on Applied Signal Processing, vol. 2002, no. 11, pp. 1274-1288, 2002.
5. G. Potamianos, C. Neti, J. Luettin, and I. Matthews, Issues in Visual and Audio-Visual Speech Processing, chapter Audio-Visual Automatic Speech Recognition: An Overview, MIT Press, 2004.
6. J. Huang, Z. Eiu, and Y. Wang, "Integration of multimodal features for video scene classification based on hmm," in Proceedings of IEEE Workshop on Multimedia Signal Processing, Copenhagen, Denmark, 1999.
7. S. Dupont and J. Luettin, "Audio-visual speech modeling for continuous speech recognition," IEEE Transactions on Multimedia, vol. 2, no. 3, Sept. 2000.
8. C. Berrou, A. Glavieux, and P. Thitimajshima, "Near shannon limit error-correcting coding and decoding:turbo-codes," in Proceedings of the. IEEE International Conference on Communications, Geneva, Switzerland, May 1993.
9. L. Bahl, J. Cocke, F. Jelinek, and J. Raviv, "Optimal decoding of linear codes for minimizing symbol error rate," IEEE Transactions on Information Theory, vol. TT-20(2), pp. 284-287, Mar. 1974.
10. P. Viola and M. Jones, "Robust real-time object detection," International. Journal of Computer Vision, 2002.