Analysis of correlation between audio and visual speech features for clean audio feature prediction in noise

INTERSPEECH 2006 and 9th International Conference on Spoken Language Processing, INTERSPEECH 2006 - ICSLP

Volumn 5, Issue , 2006, Pages 2470-2473

  Almajai, Ibrahim ^a   Milner, Ben ^a   Darch, Jonathan ^a  

^a UNIVERSITY OF EAST ANGLIA   (United Kingdom)

Author keywords

AAM; Audio visual speech; Correlation; Formants

Indexed keywords

ACOUSTIC NOISE; CORRELATION METHODS; FORECASTING; LINEAR REGRESSION; SPEECH ENHANCEMENT;

ACTIVE APPEARANCE MODELS; AUDIO-VISUAL SPEECH; CORRELATION MEASUREMENT; FORMANTS; MAXIMUM A POSTERIORI; MULTIPLE LINEAR REGRESSIONS; ORIGINAL AUDIO SIGNAL; VISUAL SPEECH FEATURES;

AUDIO ACOUSTICS;

EID: 44949122735     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (13)

1. W.H. Sumby and I. Pollack, "Visual contribution to speech intelligibility in noise", JASA, 26(2):212-215, 1954
2. C. Neti, G. Potamianos, J. Luettin, I. Matthews, H. Glotin, D. Vergyri, J. Sison, A. Mashari and J. Zhou, "Audio-visual speech recognition", Technical Report, Center for Language and Speech Processing, Baltimore, Maryland, 2000
3. G. Meyer, J. Mulligan and S. Wuerger, "Continuous audio-visual digit recognition using N-best decision fusion", Information Fusion, 5:91-101, 2003
4. L. Girin, J.L. Schwartz and G. Feng, "Audio-visual enhancement of speech in noise", JASA, 6(109):3007-3020, 2001
5. F. Berthommier, "Audiovisual speech enhancement based on association between speech envelope and video features", Proc. Eurospeech, 2003
6. H. Yehia, P. Rubin and E. Vatikiotis-Bateson, "Quantitative association of vocal-tract and facial behaviour", Speech Communication, 26(1):23-43, 1998
7. J. Jiang, A. Alwan, P.A. Keating, E.T. Auer and L.E. Bemstein, "On the relationship between face movements, tongue movements and speech acoustics", EURASIP Journal on Applied Sig. Proc., 11:1174-1188, 2002
8. T.F. Cootes and C.J. Taylor, "Statistical models of appearance for computer vision," Draft report, University of Manchester, UK, 2001, http://www.isbe.man.ac.uk
9. X. Shao and B.P. Milner, "Predicting fundamental frequency from MFCCs to enable speech reconstruction", JASA 118(2): 1134-1143, 2005
10. A. Sorin and T. Ramabadran, "Extended advanced front end algorithm description, Version 1.1", ETSI STQ Aurora DSR Working Group, Tech. Rep. ES 202 212, 2003
11. Q. Yan, E. Zavarehei, S. Vaseghi and D. Rentzos, "A formant tracking LP model for speech processing in car/train noise", Proc. ICSLP, 2004.
12. S. Chatterjee, A.S. Hadi, and B. Price, "Regression Analysis By Example", John Wiley and Sons, Canada, 2000
13. B. Theobald. "Visual speech synthesis using shape and appearance models," PhD Thesis. School of Computing Sciences, University of East Anglia, Norwich, UK, 2003.