Mapping sounds onto images using binaural spectrograms

European Signal Processing Conference

Volumn , Issue , 2014, Pages 2470-2474

  Deleforge, Antoine ^a   Drouard, Vincent ^a   Girin, Laurent ^a,b,c   Horaud, Radu ^a  

^a INRIA RHÔNE ALPES   (France)

^b GIPSA LAB   (France)

^c UNIV GRENOBLE ALPES   (France)

Author keywords

[No Author keywords available]

Indexed keywords

ALIGNMENT; LOCATION; MAPPING; REVERBERATION; SPECTROGRAPHS;

AUDIO-VISUAL FUSION; CLOSED-FORM EXPRESSION; GAUSSIAN MIXTURES; MAPPING PARAMETERS; MULTIMODAL PROCESSING; POSTERIOR PROBABILITY; SOURCE DIRECTIONS; SUPERVISED LEARNING APPROACHES;

IMAGE PROCESSING;

EID: 84911874321     PISSN: 22195491     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (18)

1. L. Girin, J.-L. Schwartz, and G. Feng, "Audio-visual enhancement of speech in noise," Journal of Acoustical Society of America, vol. 109, no. 6, pp. 3007-3020, 2001.
2. I. Almajai and B. Milner, "Visually derived wiener filters for speech enhancement," IEEE Transactions on Audio, Speech, and Language Processing, vol. 19, no. 6, pp. 1642-1651, 2011.
3. D. Segev, Y. Y. Schechner, and M. Elad, "Examplebased cross-modal denoising," in IEEE Conference on Computer Vision and Pattern Recognition, 2012, pp. 486-493.
4. B. Rivet, L. Girin, and C. Jutten, "Mixing audiovisual speech processing and blind source separation for the extraction of speech signals from convolutive mixtures," IEEE Transactions on Audio, Speech, and Language Processing, vol. 15, no. 1, pp. 96-108, January 2007.
5. S. M. Naqvi, Y. Miao, and J. A. Chambers, "A multimodal approach to blind source separation of moving sources," IEEE Journal of Selected Topics in Signal Processing, vol. 4, no. 5, pp. 895-910, oct. 2010.
6. M. Heckmann, F. Berthommier, and K. Kroschel, "Noise adaptive stream weighting in audio-visual speech recognition," EURASIP Journal on Applied Signal Processing, vol. 11, pp. 1260-1273, 2002.
7. G. Potamianos, C. Neti, G. Gravier, A. Garg, and A.W. Senior, "Recent advances in the automatic recognition of audiovisual speech," Proceedings of the IEEE, vol. 91, no. 9, pp. 1306-1326, sept. 2003.
8. J. Barker and S. Xu, "Energetic and informational masking effects in an audiovisual speech recognition system," IEEE Transactions on Audio, Speech, and Language Processing, vol. 17, no. 3, pp. 446-458, March 2009.
9. A. Deleforge and R. Horaud, "2D sound-source localization on the binaural manifold," in IEEE International Workshop Machine Learning for Signal Processing., Santander, Spain, 2012.
10. H. Viste and G. Evangelista, "On the use of spatial cues to improve binaural source separation," in Proc. Int. Conf. on Digital Audio Effects, 2003, pp. 209-213.
11. M. I. Mandel, R. J. Weiss, and D. P. W. Ellis, "Modelbased expectation-maximization source separation and localization," IEEE Transactions on Audio, Speech, and Language Processing, vol. 18, no. 2, pp. 382-394, 2010.
12. J.Woodruff and D.Wang, "Binaural localization of multiple sources in reverberant and noisy environments," Audio, Speech, and Language Processing, IEEE Transactions on, vol. 20, no. 5, pp. 1503-1512, 2012.
13. V. Khalidov, F. Forbes, and R. Horaud, "Alignment of Binocular-Binaural Data Using a Moving Audio-Visual Target," in IEEE Workshop on Multimedia Signal Processing, 2013.
14. X. Alameda-Pineda and R. Horaud, "A geometric approach to sound source localization from time-delay estimates," IEEE Transactions on Audio, Speech, and Language Processing, vol. 22, no. 6, pp. 1082-1095, June 2014.
15. A. Deleforge, F. Forbes, and R. Horaud, "High-Dimensional Regression with Gaussian Mixtures and Partially-Latent Response Variables," Statistics and Computing, 2014.
16. P. Viola and M. J Jones, "Robust real-time face detection," International Journal of Computer Vision, vol. 57, no. 2, pp. 137-154, 2004.
17. J. S. Garofolo, L. F. Lamel, W. M. Fisher, J. G. Fiscus, and D. S. Pallett, "The DARPA TIMIT acousticphonetic continuous speech corpus CD-ROM," Tech. Rep. NISTIR 4930, National Institute of Standards and Technology, Gaithersburg, MD, 1993.
18. P. Aarabi, "Self-localizing dynamic microphone arrays," IEEE Transactions on Systems, Man, and Cybernetics, Part C, vol. 32, no. 4, pp. 474-484, 2002.