Visually Derived Wiener Filters for Speech Enhancement

IEEE Transactions on Audio, Speech and Language Processing

Volumn 19, Issue 6, 2011, Pages 1642-1651

  Almajai, Ibrahim ^a   Milner, Ben ^b  

^a UNIVERSITY OF SURREY   (United Kingdom)

^b UNIVERSITY OF EAST ANGLIA   (United Kingdom)

Author keywords

Audio visual; maximum a posteriori; speech enhancement; Wiener filter

Indexed keywords

EID: 85008034388     PISSN: 15587916     EISSN: 15587924     Source Type: Journal    
DOI: 10.1109/TASL.2010.2096212     Document Type: Article

References (19)

1. G. Potamianos, C. Neti, G. Gravier, A. Garg, and A. Senior “Recent advances in the automatic recognition of audio-visual speech,” Proc. IEEE, vol. 91, no. 9, pp. 1306–1326, Sep. 2003.
2. I. Matthews, T. Cootes, J. Bangham, S. Cox, and R. Harvey “Extraction of visual features for lipreading,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 2, pp. 198–213, Feb. 2002.
3. I. Almajai, B. Milner, and J. Darch, “Analysis of correlation between audio and visual speech features for clean audio feature prediction in noise,” in Proc. Interspeech, Sep. 2006, pp. 2470–2473.
4. H. Yehia, P. Rubin, and E. Vatikiotis-Bateson “Quantitative association of vocal tract and facial behavior,” Speech Commun., vol. 26, no. 1, pp. 23–43, Oct. 1998.
5. J. Chang, N. Kim, and S. Mitra “Voice activity detection based on multiple statistical models,” IEEE Trans. Signal Process., vol. 54, no. 6, pp. 1965–1976, Jun. 2006.
6. R. Martin “Noise power spectral density estimation based on optimal smoothing and minimum statistics,” IEEE Trans. Speech Audio Process., vol. 9, no. 5, pp. 504–512, Jul. 2001.
7. M. Berouti, R. Schwartz, and J. Makhoul, “Enhancement of speech corrupted by acoustic noise,” in Proc. ICASSP, Apr. 1979, vol. 4, pp. 208–211.
8. Y. Ephraim, D. Malah, and B.-H. Juang “On the application of hidden Markov models for enhancing noisy speech,” IEEE Trans. Acoust., Speech, Signal Process., vol. 37, no. 12, pp. 1846–1856, Dec. 1989.
9. Y. Ephraim and D. Malah “Speech enhancement using a minimum mean-square error log-spectral amplitude estimator,” IEEE Trans. Acoust., Speech, Signal Process., vol. 33, no. 2, pp. 443–445, Apr. 1985.
10. P. Loizou, Speech Enhancement: Theory and Practice. Boca Raton, FL: CRC, 2007.
11. L. Girin, J.-L. Schwartz, and G. Fang “Audio-visual enhancement of speech in noise,” J. Acoust. Soc. Amer., vol. 109, no. 6, pp. 3007–3020, Jun. 2001.
12. I. Almajai, B. Milner, J. Darch, and S. Vaseghi, “Visually-derived Wiener filters for speech enhancement,” in Proc. ICASSP, Apr. 2007, vol. 4, pp. 585–588.
13. ETSI, “Speech processing, transmission and quality aspects (STQ); distributed speech recognition; extended advanced front-end feature extraction algorithm; compression algorithms; back-end speech reconstruction algorithm,” ETSI STQ-Aurora DSR Working Group, ES 202 212, ver. 1.1.1, Nov. 2003.
14. T. Cootes, G. Edwards, and C. Taylor “Active appearance models,” IEEE Trans. PAMI, vol. 23, no. 6, pp. 681–685, Jun. 2001.
15. G. Meyer, J. Mulligan, and S. Wuerger “Continuous audio-visual digit recognition using N-best decision fusion,” Inf. Fusion, vol. 5, no. 2, pp. 91–101, June 2004.
16. K. Sayood, Introduction to Data Compression. San Rafael, CA: Morgan-Kaufmann, 2000.
17. I. Almajai and B. Milner, “Using audio-visual features for robust voice activity detection in clean and noisy speech,” in Proc. EUSIPCO, Lausanne, Switzerland, Aug. 2008.
18. B. Theobald, J. Bangham, I. Matthews, and G. Cawley “Near-videore-alistic synthetic talking faces: Implementation and evaluation,” Speech Commun., vol. 44, pp. 127–140, Oct. 2004.
19. ITU, “P.835: Subjective test methodology for evaluating speech communication systems that include noise suppression algorithms,” Nov. 2003, Tech. Rep.