Alignment of binocular-binaural data using a moving audio-visual target

2013 IEEE International Workshop on Multimedia Signal Processing, MMSP 2013

Volumn , Issue , 2013, Pages 242-247

  Khalidov, Vasil ^a,b   Forbes, Florence ^a   Horaud, Radu ^a  

^a INRIA   (France)

^b IDIAP RESEARCH INSTITUTE   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

3-D TRAJECTORY; 3D POSITIONS; AUDIO-VISUAL; BUILT-IN FEATURE; OBJECT TRAJECTORIES;

ALGORITHMS; CAMERAS; MICROPHONES; MULTIMEDIA SIGNAL PROCESSING;

ESTIMATION;

EID: 84892495409     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/MMSP.2013.6659295     Document Type: Conference Paper

References (17)

1. X. Alameda-Pineda, V. Khalidov, R. P. Horaud, and F. Forbes, "Finding audio-visual events in informal social gatherings," in Proc. of the 13th Int. Conf. on Multimodal Interfaces, November 2011, pp. 247-254.
2. D. Gatica-Perez, G. Lathoud, J.-M. Odobez, and I. McCowan, "Audiovisual probabilistic tracking of multiple speakers in meetings," IEEE Trans. on Audio, Speech, and Language Processing, vol. 15, no. 2, pp. 601-616, 2007.
3. J. Vermaak, M. Ganget, A. Blake, and P. Pérez, "Sequential Monte Carlo fusion of sound and vision for speaker tracking," in Proc. of the 8th Int. Conf. on Computer Vision. IEEE, 2001, pp. 741-746.
4. P. Perez, J. Vermaak, and A. Blake, "Data fusion for visual tracking with particles," Proceedings of IEEE, vol. 92, no. 3, pp. 495-513, 2004.
5. V. Khalidov, F. Forbes, M. Hansard, E. Arnaud, and R. Horaud, "Detecion and localization of 3D audio-visual objects using unsupervised clustering," in Proc. of ICMI, 2008.
6. T. Hospedales and S. Vijayakumar, "Structure inference for Bayesian multisensory scene understanding," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 30, no. 12, pp. 2140-2157, 2008.
7. V. Khalidov, F. Forbes, and R. Horaud, "Conjugate mixture models for clustering multimodal data," Neural Computation, vol. 23, no. 2, pp. 517-557, 2011.
8. V. Willert, J. Eggert, J. Adamy, R. Stahl, and E. Koerner, "A probabilistic model for binaural sound localization," IEEE Trans. on Systems, Man, and Cybernetics - Part B, vol. 36, no. 5, pp. 982-994, 2006.
9. M. Pollefeys and D. Nister, "Direct computation of sound and microphone locations from time-difference-of-arrival data," in IEEE Int. Conf. on Acoustic, Speech, and Signal Processing, 2008, pp. 2445-2448.
10. R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision. Cambridge, UK: Cambridge University Press, 2003.
11. N. Checka, K. Wilson, M. Siracusa, and T. Darrell, "Multiple person and speaker activity tracking with a particle filter," in Proc. of IEEE Conf. on Acoustics, Speech, and Signal Processing, 2004, pp. 881-884.
12. E. Ettinger and Y. Freund, "Coordinate-free calibration of an acoustically driven camera pointing system," in Second ACM/IEEE International Conference on Distributed Smart Cameras, sept. 2008, pp. 1-9.
13. T. Kuhnapfel, T. Tan, S. Venkatesh, and E. Lehmann, "Calibration of audio-video sensors for multi-modal event indexing," in IEEE Int. Conf. on Acoustics, Speech and Signal Processing, vol. 2, 2007, pp. 741-744.
14. Z. Barzelay and Y. Schechner, "Onsets coincidence for cross-modal analysis," IEEE Trans. on Multimedia, vol. 12, no. 2, pp. 108-120, 2010.
15. A. Deleforge and R. P. Horaud, "The cocktail party robot: Sound source separation and localisation with an active binaural head," in IEEE/ACM Int. Conf. on Human Robot Interaction, Boston, Mass, March 2012.
16. J. Spall, Introduction to Stochastic Searchand Optimization: Estimation, Simulation and Control. Wiley, 2003.
17. H. Christensen, N. Ma, S. Wrigley, and J. Barker, "Integrating pitch and localisation cues at a speech fragment level," in Proc. of Interspeech, 2007, pp. 2769-2772.