Visual voice activity detection as a help for speech source separation from convolutive mixtures

Speech Communication

Volumn 49, Issue 7-8, 2007, Pages 667-677

  Rivet, Bertrand ^a   Girin, Laurent ^a   Jutten, Christian ^a  

^a GRENOBLE INSTITUTE OF TECHNOLOGY   (France)

Author keywords

Convolutive mixtures; Highly non stationary environments; Speech enhancement; Speech source separation; Visual speech processing; Voice activity detector

Indexed keywords

ACOUSTIC SIGNAL PROCESSING; COMPUTATION THEORY; RADIO INTERFERENCE; SPEECH ENHANCEMENT;

CONVOLUTIVE MIXTURES; HIGHLY NON-STATIONARY ENVIRONMENTS; SPEECH SOURCE SEPARATION; VOICE ACTIVITY DETECTOR;

SPEECH SYNTHESIS;

EID: 34447095008     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2007.04.008     Document Type: Article

References (20)

1. Abrard F., and Deville Y. A time-frequency blind signal separation method applicable to underdetermined mixtures of dependent sources. Signal Processing 85 7 (2005) 1389-1403
2. Babaie-Zadeh, M., Mansour, A., Jutten, C., Marvasti, F., 2004. A geometric approach for separating several speech signals. In: Proc. Int. Conf. Independent Component Analysis and Blind Source Separation (ICA), Granada, Spain, pp. 798-806.
3. Bernstein, L.E., Benoît, C., 1996. For speech perception by humans or machines, three senses are better than one. In: Proc. Int. Conf. Spoken Language Processing (ICSLP), Philadelphia, USA, pp. 1477-1480.
4. Capdevielle, V., Servière, C., Lacoume, J.-L., 1995. Blind separation of wide-band sources in the frequency domain. In: Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing (ICASSP), Detroit, USA, 1995, pp. 2080-2083.
5. Cardoso J.-F. Blind signal separation: statistical principles. Proceedings of the IEEE 86 10 (1998) 2009-2025
6. Dansereau, R., 2004. Co-channel audiovisual speech separation using spectral matching constraints. In: Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing (ICASSP), Montréal, Canada, 2004.
7. Dapena, A., Bugallo, M.F., Castedo, L., 2001. Separation of convolutive mixtures of temporally-white signals: a novel frequency-domain approach. In: Proc. Int. Conf. Independent Component Analysis and Blind Source Separation (ICA), San Diego, USA, pp. 315-320.
8. Elisei, F., Odisio, M., Bailly, G., Badin, P., 2001. Creating and controlling video-realistic talking heads. In: Proc. Audio-Visual Speech Processing Workshop (AVSP), Aalborg, Denmark, pp. 90-97.
9. Girin L., Schwartz J.-L., and Feng G. Audio-visual enhancement of speech in noise. J. Acoust. Soc. Am. 109 6 (2001) 3007-3020
10. Lallouache, T., 1990. Un poste visage-parole. Acquisition et traitement des contours labiaux, in: Proc. Journées d'Etude sur la Parole (JEP) (French), Montréal.
11. Le Goff, B., Guiard-Marigny, T., Benoît, C., 1995. Read my lips... and my jaw! How intelligible are the components of a speaker's face? In: Proc. Euro. Conf. on Speech Com. and Tech, Madrid, Spain, pp. 291-294.
12. Liu, P., Wang, Z., 2004. Voice activity detection using visual information. In: Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing (ICASSP), Montreal, 2004, pp. 609-612.
13. Parra L., and Spence C. Convolutive blind separation of non stationary sources. IEEE Trans. Speech Audio Process. 8 3 (2000) 320-327
14. Pham, D.-T., Servière, C., Boumaraf, H., 2003. Blind separation of convolutive audio mixtures using nonstationarity. In: Proc. Int. Conf. Independent Component Analysis and Blind Source Separation (ICA), Nara, Japan.
15. Rajaram, S., Nefian, A.V., Huang, T.S., 2004. Bayesian separation of audio-visual speech sources. In: Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing (ICASSP), Montréal, Canada.
16. Rivet B., Girin L., and Jutten C. Mixing audiovisual speech processing and blind source separation for the extraction of speech signals from convolutive mixtures. IEEE Trans. Audio Speech Lang. Process. 15 1 (2007) 96-108
17. Sodoyer D., Girin L., Jutten C., and Schwartz J.-L. Developing an audio-visual speech source separation algorithm. Speech Comm. 44 1-4 (2004) 113-125
18. Sodoyer, D., Rivet, B., Girin, L., Schwartz, J.-L., Jutten, C., 2006. An analysis of visual speech information applied to voice activity detection. In: Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing (ICASSP), Toulouse, France, pp. 601-604.
19. Sumby W., and Pollack I. Visual contribution to speech intelligibility in noise. J. Acoust. Soc. Am. 26 (1954) 212-215
20. Wang, W., Cosker, D., Hicks, Y., Sanei, S., Chambers, J.A., 2005. Video assisted speech source separation, in: Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing (ICASSP), Philadelphia, USA, 2005.