Finding audio-visual events in informal social gatherings

ICMI'11 - Proceedings of the 2011 ACM International Conference on Multimodal Interaction

Volumn , Issue , 2011, Pages 247-254

  Alameda Pineda, Xavier ^a   Khalidov, Vasil ^b   Horaud, Radu ^a   Forbes, Florence ^a  

^a INRIA RHÔNE ALPES   (France)

^b IDIAP RESEARCH INSTITUTE   (Switzerland)

Author keywords

3D localization; audio visual fusion; event detection; scene analysis

Indexed keywords

3D LOCALIZATION; AUDIO-VISUAL; AUDIO-VISUAL FUSION; AUDIO-VISUAL SENSORS; BINAURAL HEARING; CLUSTERING PROCESS; DATA CLUSTERING; DATA SETS; EM ALGORITHMS; EVENT DETECTION; GAUSSIAN MIXTURE MODEL; HUMANOID ROBOT; METRIC SPACES; MULTI-MODAL; SCENE ANALYSIS; SOCIAL GATHERINGS; VISUAL DATA;

ANTHROPOMORPHIC ROBOTS; AUDITION; BINOCULAR VISION; COMPUTATIONAL EFFICIENCY; INTERACTIVE COMPUTER SYSTEMS; OBJECT RECOGNITION;

CLUSTERING ALGORITHMS;

EID: 83455196939     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2070481.2070527     Document Type: Conference Paper

References (27)

1. X. Alameda-Pineda, J. Sanchez-Riera, V. Franch, J. Wienke, J. Cech, K. Kulkarni, A. Deleforge, and R. Horaud. The Ravel data set. Technical Report RR-7709, INRIA, Aug. 2011.
2. T. J. Anastasio, P. E. Patton, and K. E. Belkacem-Boussaid. Using Bayes' rule to model multisensory enhancement in the superior colliculus. Neural Computation, 12(5):1165-1187, 2000.
3. E. Arnaud, H. Christensen, Y.-C. Lu, J. Barker, V. Khalidov, M. Hansard, B. Holveck, H. Mathieu, R. Narasimha, E. Taillant, F. Forbes, and R. Horaud. The cava corpus: synchronised stereoscopic and binaural datasets with head movements. In ICMI'08, pages 109-116, New York, NY, USA, 2008. ACM.
4. M. Beal, N. Jojic, and H. Attias. A graphical model for audiovisual object tracking. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(7):828-836, 2003.
5. P. Besson and M. Kunt. Hypothesis testing for evaluating a multimodal pattern recognition framework applied to speaker detection. Journal of NeuroEngineering and Rehabilitation, 5(1):11, 2008.
6. P. Besson, V. Popovici, J. Vesin, J. Thiran, and M. Kunt. Extraction of audio features specific to speech production for multimodal speaker detection. Multimedia, IEEE Transactions on, 10(1):63-73, jan. 2008.
7. C. Bishop. Pattern Recognition and Machine Learning. Springer, 2006.
8. N. Checka, K. Wilson, M. Siracusa, and T. Darrell. Multiple person and speaker activity tracking with a particle filter. In Proc. of IEEE Conference on Acoustics, Speech, and Signal Processing, pages 881-884. IEEE, 2004.
9. H. Christensen, N. Ma, S. Wrigley, and J. Barker. Integrating pitch and localisation cues at a speech fragment level. In Proc. of Interspeech, pages 2769-2772, 2007.
10. D. Davies and D. Bouldin. A cluster separation measure. Pattern Analysis and Machine Intelligence, IEEE Transactions on, PAMI-1(2):224-227, January 1979.
11. A. Dempster, N. Laird, and D. Rubin. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society. Series B (Methodological), 39(1):1-38, 1977.
12. J. Fisher III and T. Darrell. Speaker association with signal-level audiovisual fusion. IEEE Transactions on Multimedia, 6(3):406-413, June 2004.
13. D. Gatica-Perez, G. Lathoud, J.-M. Odobez, and I. McCowan. Audiovisual probabilistic tracking of multiple speakers in meetings. IEEE Transactions on Audio, Speech, and Language Processing, 15(2):601-616, 2007.
14. C. Harris and M. Stephens. A combined corner and edge detector. In Proc. of Fourth Alvey Vision Conference, pages 147-151, 1988.
15. C. Hennig. Methods for merging Gaussian mixture components. Advances in Data Analysis and Classification, 4:3-34, 2010. 10.1007/s11634-010-0058-3.
16. T. Hospedales and S. Vijayakumar. Structure inference for Bayesian multisensory scene understanding. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30(12):2140-2157, 2008.
17. A. Ihler, J. Fisher III, and A.Willsky. Nonparametric hypothesis tests for statistical dependency. IEEE Transactions on Signal Processing, 52(8):2234-2249, August 2004.
18. C. Keribin. Consistent estimation of the order of mixture models. Sankhya Series A, 62(1):49-66, 2000.
19. V. Khalidov. Conjugate Mixture Models for the Modeling of Visual and Auditory Perception. PhD thesis, University of Grenoble, Grenoble, France, October 2010.
20. V. Khalidov, F. Forbes, M. Hansard, E. Arnaud, and R. Horaud. Detection and localization of 3D audio-visual objects using unsupervised clustering. In ICMI '08, pages 217-224, New York, NY, USA, 2008. ACM.
21. V. Khalidov, F. Forbes, and R. Horaud. Conjugate mixture models for clustering multimodal data. Neural Computation, 23(2):517-557, February 2011.
22. D. Miller and J. Browning. A mixture model and em-based algorithm for class discovery, robust classification, and outlier rejection in mixed labeled/unlabeled data sets. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(11):1468-1483, nov. 2003.
23. K. Nickel, T. Gehrig, R. Stiefelhagen, and J. McDonough. A joint particle filter for audio-visual speaker tracking. In Proc. of ICMI, pages 61-68, New York, NY, USA, 2005. ACM.
24. K. Nigam, A. McCallum, S. Thrun, and T. Mitchell. Text classification from labeled and unlabeled documents using EM. Machine Learning, 39(2-3):103-134, 2000. (Pubitemid 30594822)
25. S. Ray and B. G. Lindsay. The topography of multivariate normal mixtures. The Annals of Statistics, 33(5):2042-2065, 2005. (Pubitemid 43065069)
26. G. Schwarz. Estimating the dimension of a model. The Annals of Statistics, 6:461-464, 1978.
27. D. N. Zotkin, R. Duraiswami, and L. S. Davis. Joint audio-visual tracking using particle filters. EURASIP Journal on Applied Signal Processing, 11:1154-1164, 2002.