An investigation into audiovisual speech correlation in reverberant noisy environments

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 5641 LNAI, Issue , 2009, Pages 331-343

  Cifani, Simone ^b   Abel, Andrew ^a   Hussain, Amir ^a   Squartini, Stefano ^b   Piazza, Francesco ^b  

^a UNIVERSITY OF STIRLING   (United Kingdom)

^b UNIVERSITÀ POLITECNICA DELLE MARCHE   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

AUDIO-VISUAL CORPORA; AUDIO-VISUAL CORRELATIONS; AUDIO-VISUAL SPEECH; BEAM FORMERS; COMPLEX RELATIONSHIPS; FEATURE EXTRACTION TECHNIQUES; HUMAN COMMUNICATIONS; MULTI-MODAL; MULTIMODAL DATA STREAMS; NOISY ENVIRONMENT; PROCESSING METHOD; SPEECH ENHANCEMENT SYSTEM; VISUAL FEATURE; VISUAL TECHNIQUES;

BEAMFORMING; CORRELATION METHODS; COST BENEFIT ANALYSIS; FEATURE EXTRACTION; MODAL ANALYSIS; PROCESSING; REVERBERATION; SPEECH ENHANCEMENT;

SPEECH COMMUNICATION;

EID: 70350378930     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-03320-9_31     Document Type: Conference Paper

References (22)

1. McGurk, H., MacDonald, J.: Hearing lips and seeing voices. Nature 264, 746-748 (1976)
2. Yehia, H., Rubin, P., Vatikiotis Bateson, E.: Quantitative association of vocal tract and facial behavior. Speech Communication 26(1), 23-43 (1998)
3. Barker, J.P., Berthommier, F.: Evidence of correlation between acoustic and visual features of speech. In: ICPhS 1999, San Francisco (August 1999)
4. Almajai, I., Milner, B.: Maximising Audio-Visual Speech Correlation. Accepted for AVSP 2007, paper P16 (2007)
5. Potamianos, G., Neti, C., Gravier, G., Garg, A., Senior, A.W.: Recent Advances in the Automatic Recognition of Audiovisual Speech. Proceedings - IEEE 91, part 9, 1306-1326 (2003)
6. Girin, L., Feng, G., Schwartz, J.L.: Fusion of auditory and visual information for noisy speech enhancement: a preliminary study of vowel transition. In: ICASSP 1998, Seattle, WA, USA (1998)
7. Almajai, I., Milner, B., Darch, J., Vaseghi, S.: Visually-Derived Wiener Filters for Speech Enhancement. In: ICASSP 2007, vol. 4, pp. IV-585-IV-588 (2007)
8. Young, S.J., Odell, J., Ollason, D., Valtchev, V., Woodland, P.: The HTK Book. Version 2.1 Department of Engineering. Cambridge University, UK (1995)
9. Ahmed, N., Natarajan, T., Rao, K.R.: On image processing and a discrete cosine transform. IEEE Transactions on Computers C-23(1), 90-93 (1974)
10. Chen, W.H., Pratt, W.K.: Scene adaptive coder. IEEE Transactions on Communications 32(3), 225-232 (1984)
11. Brandstein, M.S., Ward, D.B.: Microphone Arrays. Springer, New York (2001)
12. Griffiths, L.J., Jim, C.W.: An alternative approach to linearly constrained adaptive beamforming. IEEE Trans. Antennas Propagat. AP-30, 27-34 (1982)
13. Gannot, S., Burshtein, D., Weinstein, E.: Signal enhancement using beamforming and nonstationarity with applications to speech. IEEE Trans. Signal Processing 49, 1614-1626 (2001)
14. Chatterjee, S., Hadi, A.S., Price, B.: Regression analysis by example. John Wiley and Sons, Canada (2000)
15. Cooke, M., Barker, J., Cunningham, S., Shao, X.: An audio-visual corpus for speech perception and automatic speech recognition. J. Acoust. Soc. Amer. 120(5), 2421-2424 (2006)
16. Cootes, T.F., Edwards, G.J., Taylor, C.J.: Active Appearance Models. IEEE Trans. on Pattern Analysis and Machine Intelligence 23(6), 681-685 (2001)
17. Ringeval, F., Chetouani, M.: A Vowel Based Approach for Acted Emotion Recognition. In: Interspeech 2008 (2008)
18. Wang, D., Lu, L., Zhang, H.J.: Speech Segmentation without Speech Recognition. In: ICASSP 2003, vol. 1, pp. 468-471 (2003)
19. Barker, J., Shao, X.: Audio-Visual Speech Fragment Decoding. Accepted for AVSP 2007, paper L5-2 (2007)
20. Rivet, B., Girin, L., Jutten, C.: Mixing Audiovisual Speech Processing and Blind Source Separation for the Extraction of Speech Signals From Convolutive Mixtures. IEEE Trans. on Audio, Speech, and Lang. Processing 15(1), 96-108 (2007)
21. Hazen, J.T., Saenko, K., La, C.H., Glass, J.R.: A Segment Based Audio-Visual Speech Recognizer: Data Collection, Development, and Initial Experiments. In: ICMI 2004: Proceedings of the 6th international conference on Multimodal interfaces, pp. 235-242 (2004)
22. Hussain, A., Cifani, S., Squartini, S., Piazza, F., Durrani, T.: A Novel Psychoa-coustically Motivated Multichannel Speech Enhancement System. In: Esposito, A., Faundez-Zanuy, M., Keller, E., Marinaro, M. (eds.) COST Action 2102. LNCS, vol. 4775, pp. 190-199. Springer, Heidelberg (2007)