Example-based cross-modal denoising

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn , Issue , 2012, Pages 486-493

  Segev, Dana ^a   Schechner, Yoav Y ^a   Elad, Michael ^a  

^a TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

Author keywords

[No Author keywords available]

Indexed keywords

CROSS-MODAL; DE-NOISE; DE-NOISING; MULTISENSORY SYSTEMS; NOISE SOURCE; NOISY AUDIO; NONSTATIONARY; TRAINING EXAMPLE; UNIMODAL; VIDEO CHANNELS;

AUDIO ACOUSTICS;

COMPUTER VISION;

EID: 84866696873     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2012.6247712     Document Type: Conference Paper

References (40)

1. Aharon M., Kimmel R.: Representation analysis and synthesis of lip images using dimensionality reduction. IJCV 67:297-312, 2006.
2. Barzelay Z., Schechner Y.Y.: Harmony in motion. Proc. IEEE CVPR, 2007.
3. Bellman R. Dynamic Programming. 1957, Princeton University Press
4. Bregler C., Covell M., Slaney M. Video Rewrite: Driving Visual Speech with Audio. Proc. ACM SIGGRAPH. 353-360, 1997.
5. Bimbot F., Benaroya L., Gribonval R.: Audio source separation with a single sensor. IEEE Trans. ASSP 14:191-199, 2006.
6. Casanovas A. L., Monaci G., Vandergheynst P.: Blind audio-visual source separation using sparse representations. IEEE ICIP 2007.
7. Chang Y. J., Chen T: Multi-View 3D Reconstruction for Scenes under the Refractive Plane with Known Vertical Direction. In Proc. ICCV, 2011.
8. Choudhury T., Rehg J., Pavlovic V., Pentland A.: Boosting and structure learning in dynamic bayesian networks for audio-visual speaker detection. In Proc. ICPR pp. 789-794, 2002.
9. Cohen I., Berdugo B.: Speech enhancement for non-stationary noise environments. Signal Processing 81:2403-2418, 2001.
10. Criminisi A., Perez P., Toyama K.: Region filling and object removal by exemplar-based image inpainting. IEEE Trans. IP 13:1200-1212, 2004.
11. Deligne S., Potamianos G., Neti C.: Audio-visual speech enhancement with AVCDCN (audio-visual codebock dependent cepstral normalization). IEEEWorksh. Sensor Array & Multichannel SP, 68-71, 2002.
12. Driver J.: Enhancement of selective listening by illusory mislocation of speech sounds due to lip-reading. Nature 381:66-68, 1996.
13. Dupont S., Luettin J.:Audio-visual speech modeling for continuous speech recognition. IEEE Trans. Multimedia 2:141-151, 2000.
14. Elad M.: Sparse and Redundant Representations - From Theory to Applications in Signal and Image Processing. Springer New-York, 2010.
15. Elad M., Datsenko D.: Example-based regularization deployed to super-resolution reconstruction of a single image. The Computer Journal, 50:1-16, 2007.
16. Fevotte C., Daudet L., Godsill S. J., Torresani B.: Sparse regression with structured priors: application to audio denoising. IEEE ICASSP, 2006.
17. Fisher III J.W., Darrell T., FreemanW. T., Viola P.: Learning joint statistical models for audio-visual fusion and Segregation. in Proc. NIPS 13, 772-778, 2001.
18. Freeman W. T., Pasztor E. C., Carmichael O. T.: Learning low-level vision. IJCV 40:25-47, 2000.
19. Gutfreund Y., Zheng W., Knudsen E. I.: Gated visual input to the central auditory system. Science 297:1556-1559, 2002.
20. Garofolo J. S.: Getting StartedWith the DARPA TIMIT CDROM: An Acoustic-Phonetic Continuous Speech Database. Gaithersburg, MD: National Inst. of Standards and Technol. (NIST) 1993.
21. Hershey J., Casey M.: Audio-visual sound separation via hidden markov models. in Proc. NIPS pp. 1173-1180, 2001.
22. Karpenko A., Jacobs D. E.,Baek J., Levoy .M,: Digital Video Stabilization and Rolling Shutter Correction using Gyroscopes. Stanford CSTR pp. 2011-03, 2011.
23. Ke Y., Hoiem D., Sukthankar R.: Computer vision for music identification. Proc. IEEE CVPR pp. 597- 604, 2005
24. Khalidov V., Forbes F., Hansard M., Arnaud E., Horaud R.: Audio-Visual clustering for 3D speaker localization. Proc. MLMI Workshop, 2008.
25. Kidron E., Schechner Y. Y., Elad M.: Pixels that sound. Proc. IEEE CVPR pp. 88-95, 2005.
26. Liu Y., Sato Y.: Visual localization of non-stationary sound sources. In Proc. Multimedia, 2009.
27. Luettin J., Thacker N. A., Beet S. W.: Speechreading using Shape and Intensity Information. In ISCA, 1996.
28. Martin R.: An efficient algorithm to estimate the instantaneous SNR of speech signals, Proc. EUROSPEECH:1093-1096, 1993.
29. Monaci G., Sommer F., Vandergheynst P.: Learning bimodal structure in audio-visual data. IEEE Trans. NN, 2009.
30. O'Donovan A., Duraiswami R., Neumann J.: Microphone arrays as generalized cameras for integrated audio visual processing. Proc. IEEE CVPR pp. :1-8, 2007.
31. Potamianos G., Neti C., Gravier G., Garg A., Senior A.: Recent advances in the automatic recognition of audio-visual speech. Proc. IEEE, 91:1306-1326, 2003.
32. Quatieri T. F.: Discrete Time Speech Signal Processing, Principles and Practice. Prentice Hall, chapter 14, 2002.
33. Sarel B., Irani M.: Separating transparent layers of repetitive dynamic behaviors. Proc. IEEE ICCV pp. 26-32, 2005.
34. Schmidt M. N., Olsson R. K.: Single-channel speech separation using sparse non-negative matrix factorization. Conf. Spoken Language Processing, 2006.
35. Segev D., Schechner Y. Y., Elad M.: Crossmodal denoising: supplemental online material. www.ee.technion.ac.il/~yoav/research/CM-denoising.html
36. Smaragdis P., Shashanka R. and Raj B.: A Sparse Non-Parameteric Approach for Single Channel Separation of Known Sounds. In Proc. NIPS pp. 1705-1713, 2009.
37. Sohn J., Kim N.S, Sung W.: A statistical model-based voice activitydetector. IEEE SP Lett 6:1-3, 1999.
38. Song M., Bu J., Chen C., Li N.: Audio-visual based emotion recognition-a new approach. Proc. IEEE CVPR 2004.
39. Stahl V., Fischer A., Bippus R.: Quantile based noise estimation for spectral subtraction and Wiener filtering. Proc. ICASSP pp. 1875-1878, 2000.
40. Vajaria H., Islam T., Sarkar S., Sankar R., Kasturi R.: Audio segmentation and speaker localization in meeting videos. In ICPR pp. 1150-1153, 2006.