Pixels that sound

Proceedings - 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2005

Volumn I, Issue , 2005, Pages 88-95

  Kidron, Einat ^a   Schechner, Yoav Y ^a   Elad, Michael ^a  

^a TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; AUDITION; CORRELATION THEORY; LINEAR PROGRAMMING; MICROPHONES; MODAL ANALYSIS; PROBLEM SOLVING; VISION;

AUDIO-VISUAL EVENTS; CANONICAL CORRELATION ANALYSIS (CCA); SPATIO-TEMPORAL RESOLUTIONS; VISUAL DISTRACTIONS;

COMPUTER VISION;

EID: 24644451644     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2005.274     Document Type: Conference Paper

References (29)

1. F. Bach and M. Jordan. 2002, "Kernel independent component analysis," J. of Mach. Learning Res. 3, pp. 1-48.
2. M. J. Beal, N. Jojic, and H. Attias, 2003, "A graphical model for audiovisual object tracking," IEEE Tran. on PAMI, 25, pp. 828-836.
3. C. Bregler, and Y. Konig, 1994, "Eigenlips for robust speech recognition," In Proc. IEEE ICASSP, vol. 2, pp. 667-672.
4. R. Cutler, and L. Davis, 2000, "Look who's talking: speaker detection using video and audio correlation," Proc. IEEE ICME, vol. 3, pp. 1589-1592.
5. T. De Bie, and B. De Moor, 2003, "On the regularization of canonical correlation analysis," Int. Sympos. ICA and BSS, pp. 785-790.
6. S. Deligne, G. Potamianos, and C. Neti, 2002, 'Audio-visual speech enhancement with AVCDCN (audio-visual codebock dependent cepstral normalization)," IEEE Work-shop on Sensor Array and Multichannel Signal Processing., pp. 68-71.
7. 1 minimization," Proc. Nat. Aca. Sci. 100, pp. 2197-2202.
8. D. L. Donoho, and A. G. Flesia, 2001, "Can recent innovations in harmonic analysis explain key findings in natural image statistics?," Network: Comput. Neural. Syst., 12, pp. 371-393.
9. J. Driver, 1996, "Enhancement of selective listening by illusory mislocation of speech sounds due to lip-reading," Nature 381, pp. 66-68.
10. M. Elad, and M. Zibulevsky, 2004, "A probabilistic study of the average performance of the basis pursuit", submitted to the IEEE Trans. on IT.
11. G. Farnebäck, 1999, "A unified framework for bases, frames, subspace bases, and subspace frames", Proc. Scand. Conf. Image Analysis pp. 341-349.
12. D. E. Feldman, and E. I. Knudsen, 1996, "An anatomical basis for visual calibration of the auditory space map in the barn owl's midbrain," The J. Neuroscience 17 pp. 6820-6837.
13. J. W. Fisher III, and T. Darrell, 2004, "Speaker association with signal-level audiovisual fusion," IEEE Trans. Multimedia 6, pp. 406-413.
14. J. W. Fisher III, T. Darrell, W. Freeman, and P. Viola, 2001, "Learning joint statistical models for audio-visual fusion and Segregation," Advanced in Neural Inf. Process. Syst. 13, pp. 772-778.
15. R. Gribonval, and M. Nielsen, 2003, "Sparse representations in unions of bases," IEEE Trans. IT 49, pp. 3320-3325.
16. Y. Gutfreund, W. Zheng, and E. I. Knudsen, 2002, "Gated visual input to the central auditory system," Science 297, pp. 1556-1559.
17. J. Hershey, and J. Movellan, 1999, "Audio-vision: using audio-visual synchrony to locate sound," Advances in Neural Inf. Process. Syst. 12, pp. 813-819.
18. E. Kidron, Y. Y. Schechner, and M. Elad, 2005, "Pixels that sound," Tech. Rep. CCIT TR-524, Dep. of Electrical Engineering, Technion.
19. H. Knutsson, M. Borga, and T. Landelius, 1995, "Learning canonical correlations," Tech. Rep. LiTH-ISY-R-1761, Computer Vision Laboratory, S-581 83 Linköping Univ., Sweden.
20. D. Li, N. Dimitrova, M. Li, and I. K. Sethi, 2003, "Multimedia content processing through cross-modal association," Proc. ACM Int. Conf. Multimedia, pp. 604-611.
21. T. Melzer, M. Reiter, and H. Bischof, 2003, "Appearance models based on kernel canonical correlation analysis," Patt. Rec. 36, pp. 1961-1971.
22. D. Murphy, T. H. Andersen, and K. Jensen, 2004, "Conducting audio files via computer vision," Lecture Notes in Computer Science, 2915, pp. 529-540
23. H. J. Nock, G. Iyengar, and C. Neti, 2002, "Assessing face and speech consistency for monologue detection in video," Proc. ACM Int. Conf. Multimedia, pp. 303-306.
24. C. Schauer, and H. M. Gross, 2003, "A computational model of early auditory-visual integration," Proc. Patt. Rec. Sympos., Lecture Notes in Computer Science 2781 pp. 362-369.
25. M. Slaney, and M. Covell, 2000, "FaceSync: a linear operator for measuring synchronization of video facial images and audio tracks," Advanc. in Neural Inf. Process. Syst. 13, pp. 814-820.
26. M. Song, J. Bu, C. Chen, and N. Li, 2004, "Audio-visual based emotion recognition-a new approach," Proc. IEEE CVPR, vol. 2, pp. 1020-1025.
27. P. Smaragdis, and M. Casey, 2003, "Audio/Visual independent components," Int. Sympos. ICA and BSS, pp. 709-714.
28. J. Vermaak, M. Gangnet, A. Blake, and P. Perez, 2001, "Sequential Monte Carlo fusion of sound and vision for speaker tracking," Proc. IEEE ICCV, vol. 1, pp. 741-746.
29. E. Wolf, A. Shashua, 2003, "Learning over Sets using Kernel Principal Angles," J. of Mach. Learning Res. 4, pp. 913-931.