Harmony in motion

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn , Issue , 2007, Pages

  Barzelay, Zohar ^a   Schechner, Yoav Y ^a  

^a TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

Author keywords

[No Author keywords available]

Indexed keywords

MICROPHONES; MOTION ESTIMATION; PROBABILISTIC LOGICS; PROBLEM SOLVING;

AUDIO-ASSOCIATED VISUAL OBJECTS; AUDIO-VISUAL ANALYSIS; VISUAL LOCALIZATION;

MODAL ANALYSIS;

EID: 34948829598     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2007.383344     Document Type: Conference Paper

References (32)

1. R R. Bach and M. I. Jordan. Blind one-microphone speech separation: A spectral learning approach. Proc. NIPS (2004).
2. Z. Barzelay and Y. Y. Schechner. Harmony in Motion. Tech. Rep. CCIT #620, Dep. of Electrical Engineering, Technion (2007).
3. J. Bello, L. Daudet, S. Abdallah, C. Duxbury, M. Davies, and M. Sandler. A tutorial on onset detection in music signals. In IEEE Trans. Speech and Audio Process., 5:1035-1047 (2005).
4. S. Birchfield. An implementation of the Kanade-Lucas-Tomasi feature tracker. Available at http://www.ces.clemson.edu/~stb/klt/.
5. A. Bregman. Auditory Scene Analysis. Cambridge, USA: MIT Press (1990).
6. L. S. Brown. Survey of image registration techniques. ACM Comput. Surv., 24:325-376 (1992).
7. J. Chen, T. Mukai, Y. Takeuchi, T. Matsumoto, H. Kudo, T. Yamamura, and N. Ohnishi. Relating audio-visual events caused by multiple movements: in the case of entire object movement. Proc. Inf. Fusion, pp. 213-219 (2002).
8. T. Choudhury, J. Rehg, V. Pavlovic, and A. Pentland. Boosting and structure learning in dynamic bayesian networks for audio-visual speaker detection. In Proc. ICPR., vol. 3, pp. 789-794 (2002).
9. P. Cuadra, A. Master, and C. Sapp Efficient pitch detection techniques for interactive music using harmonic model. Proc. ICMI, (2001).
10. T. Darrell, J. W. Fisher, , P. A. Viola, and W. T. Freeman. Audio-visual segmentation and the cocktail party effect. In Proc. ICMI2000, pp. 1611-3349 (2000).
11. W. Fujisaki and S. Nishida. Temporal frequency characteristics of synchrony-asynchrony discrimination of audio-visual signals. J. Exp. Brain Res., 166:455-464 (2005).
12. Y. Gutfreund, W. Zheng, and E. I. Knudsen. Gated visual input to the central auditory system. Science 297:1556-1559 (2002).
13. D. Hardoon, S. Szedmak, and J. Shawe-Taylor. Canonical correlation analysis: An overview with application to learning methods. Neural Computation, 16:2639-2664 (2004).
14. J. Hershey and M. Casey. Audio-visual sound separation via hidden markov models. Proc. NIPS, pp. 1173-1180 (2001).
15. J. Hershey and J. R. Movellan. Audio vision: Using audio-visual synchrony to locate sounds. Proc. NIPS, pp. 813-819 (1999).
16. M. Irani and P. Anandan. Robust multi-sensor image alignment. Proc. IEEE ICCV,pp. 959-966 (1998).
17. Y. Ke, D. Hoiem, and R. Sukthankar. Computer vision for music identification. Proc. IEEE CVPR, vol. 1, pp. 597-604 (2005).
18. E. Kidron, Y. Y. Schechner, and M. Elad. Pixels that sound. Proc. IEEE CVPR, vol. 1, pp. 88-95 (2005).
19. E. Kidron, Y. Y. Schechner, and M. Elad. Cross-modal localization via sparsity. IEEE Trans. Signal Processing, 55:1390-1404 (2007)
20. A. Klapuri. Sound onset detection by applying psychoacoustic knowledge. Proc. IEEE ICASSP, vol. 6, pp. 3089-3092 (1999).
21. A. Klapuri. A perceptually motivated multiple-f0 estimation method. Proc. IEEE Worksh. App. Sig. Proc. to Audio & Acoustics, pp. 291-294, (2005).
22. S. Mallat and Z. Zhang. Matching pursuits with time-frequency dictionaries. Proc. IEEE Trans. Sig. Process., 41:3397-3415 (1993).
23. G. Monaci and P. Vandergheynst. Audiovisual gestalts. Proc. IEEE Worksh. Percept. Org. in Comp. Vis. (2006).
24. K. Nakadai, K. Hidai, H. Okuno, and H. Kitano. Real-time speaker localization and speech separation by audio-visual integration. IEEE Conf. Robotics & Auto., vol. 1, pp. 1043-1049 (2002).
25. P. Perez, J. Vermaak, and A. Blake. Data fusion for visual tracking with particles. Proc. IEEE, 92:495-513 (2004).
26. S. Rajaram, A. Nefian, and T. Huang. Bayesian separation of audio-visual speech sources. Proc. IEEE ICAASP, vol. 5, pp. 657-660 (2004).
27. S. T. Roweis. One microphone source separation. Proc. NIPS, pp. 793-799 (2001).
28. B. Sarel and M. Irani. Separating transparent layers of repetitive dynamic behaviors. Proc. IEEE ICCV, vol. 1, pp. 26-32 (2005).
29. J. Shi and C. Tomasi. Good features to track. Proc. IEEE CVPR, pp. 593-600 (1994).
30. P. Smaragdis and M. Casey. Audio/visual independent components. Proc. ICA, pp. 709-714 (2003).
31. M. Wu, D. Wang, and G. Brown. A multi-pitch tracking algorithm for noisy speech. Proc. IEEE ICAASP, vol. 2, pp. 229-241 (2002).
32. O. Yilmaz and S. Rickard. Blind separation of speech mixtures via time-frequency masking. IEEE Trans. Sig. Process., 52:1830-1847 (2004).