Conjugate mixture models for clustering multimodal data

Neural Computation

Volumn 23, Issue 2, 2011, Pages 517-557

  Khalidov, Vasil ^a   Forbes, Florence ^a   Horaud, Radu ^a  

^a INRIA   (France)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; BRAIN; CLUSTER ANALYSIS; COMPUTER SIMULATION; HEARING; HUMAN; LETTER; PHYSIOLOGY; STATISTICAL MODEL; VISION;

ALGORITHMS; AUDITORY PERCEPTION; BRAIN; CLUSTER ANALYSIS; COMPUTER SIMULATION; HUMANS; MODELS, STATISTICAL; VISUAL PERCEPTION;

EID: 78651517803     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/NECO_a_00074     Document Type: Letter

References (54)

1. Aitkin, M., & Rubin, D. (1985). Estimation and hypothesis testing in finite mixture models. Journal of the Royal Statistical Society. Series B (Methodological), 47(1), 67-75.
2. Allen, P. (1995). Integrating vision and touch for object recognition tasks. In R. C. Luo & M. G. Kay (Eds.), Multisensor integration and fusion for intelligent machines and systems (pp. 407-440). New York: Ablex.
3. Anastasio, T. J., Patton, P. E., & Belkacem-Boussaid, K. E. (2000). Using Bayes' rule to model multisensory enhancement in the superior colliculus. Neural Computation, 12(5), 1165-1187.
4. Arnaud, E., Christensen, H., Lu, Y., Barker, J., Khalidov, V., Hansard, M., et al. (2008). The CAVA corpus: Synchronized stereoscopic and binaural datasets with head movements. In Proceedings of the ACM/IEEE Tenth International Conference on Multimodal Interfaces New York: ACM.
5. Beal, M., Jojic, N., & Attias, H. (2003). A graphical model for audiovisual object tracking. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(7), 828-836.
6. Bishop, C. (2006). Pattern recognition and machine learning. New York: Springer.
7. Boyles, R. (1983). On the convergence of EM algorithms. Journal of the Royal Statistical Society: Series B, 45(1), 47-50.
8. Castellanos, J., & Tardos, J. (1999). Mobile robot localization and map building: A multi-sensor fusion approach. Norwood, MA: Kluwer.
9. Celeux, G., Forbes, F.,&Peyrard, N.(2003). EM procedures using meanfield-like approximations for Markov model-based image segmentation. Pattern Recognition, 36(1), 131-144.
10. Checka, N., Wilson, K., Siracusa, M., & Darrell, T. (2004). Multiple person and speaker activity tracking with a particle filter. In Proc. of IEEE Conference on Acoustics, Speech, and Signal Processing, (pp. 881-884). Piscataway, NJ: IEEE.
11. Chen, Y., & Rui, Y. (2004). Real-time speaker tracking using particle filter sensor fusion. Proceedings of IEEE, 92(3), 485-494.
12. Christensen, H., Ma, N., Wrigley, S., & Barker, J. (2007). Integrating pitch and localisation cues at a speech fragment level. In Proc. of Interspeech (pp. 2769-2772) New York: ACM.
13. Coiras, E., Baralli, F., & Evans, B. (2007). Rigid data association for shallow water surveys. IET Radar, Sonar and Navigation, 1(5), 354-361.
14. Comaniciu, D., & Meer, P. (2002). Mean shift: A robust approach towards feature space analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(5), 603-619.
15. Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977). Maximum likelihood from incomplete data via the EM algorithm (with discussion). Journal of the Royal Statistical Society: Series B, 39(1), 1-38.
16. Dibiase, J., Silverman, H., & Brandstein, M. (2001). Robust localization in reverberant rooms. In M. Brandstein & D. Ward (Eds.), Microphone Arrays: Signal Processing Techniques and Applications. New York: Springer.
17. Ernst, M. O., & Banks, M. S. (2002). Humans integrate visual and haptic information in a statistically optimal fashion. Nature, 415, 429-433.
18. Faugeras, O. D. (1993). Three dimensional computer vision: A geometric viewpoint. Cambridge, MA: MIT Press.
19. Fisher III, J. W., & Darrell, T. (2004). Speaker association with signal-level audiovisual fusion. IEEE Transactions on Multimedia, 6(3), 406-413.
20. Fisher III, J. W., Darrell, T., Freeman, W. T., & Viola, P. (2001). Learning joint statistical models for audio-visual fusion segregation. In T. G. Dietterich, S. Becker, & Z. Ghahramani (Eds.), Advances in neural information processing systems, 14. Cambridge, MA: MIT Press.
21. Forsyth, D., & Ponce, J. (2003). Computer vision: A modern approach. Upper Saddle River, NJ: Prentice Hall.
22. Gatica-Perez, D., Lathoud, G., Odobez, J.-M., & McCowan, I. (2007). Audiovisual probabilistic tracking of multiple speakers in meetings. IEEE Transactions on Audio, Speech, and Language Processing, 15(2), 601-616.
23. Hall, D. L., & McMullen, S. A. H. (2004). Mathematical techniques in multisensor data fusion. New York: Artech House.
24. Hansard, M., & Horaud, R. (2007). Patterns of binocular disparity for a fixating observer. In Proc. of Second International Symposium of Advances in Brain, Vision, and Artificial Intelligence, (pp. 308-317). New York: Springer.
25. Hansard, M., & Horaud, R. (2008). Cyclopean geometry of binocular vision. Journal of the Optical Society of America A, 25(9), 2357-2369.
26. Harris, C., & Stephens, M. (1988). A combined corner and edge detector. In Proc. of Fourth Alvey Vision Conference, (pp. 147-151). Sheffield: University of Sheffield.
27. Hartley, R., & Zisserman, A. (2000). Multiple view geometry in computer vision. Cambridge: Cambridge University Press.
28. Haykin, S., & Chen, Z. (2005). The cocktail party problem. Neural Computation, 17, 1875-1902.
29. Heckmann, M., Berthommier, F., & Kroschel, K. (2002). Noise adaptive stream weighting in audio-visual speech recognition. EURASIP Journal on Applied Signal Processing, 11, 1260-1273.
30. Hospedales, T., & Vijayakumar, S. (2008). Structure inference for Bayesian multi-sensory scene understanding. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30(12), 2140-2157.
31. Jordan, M., Ghahramani, Z., Jaakkola, T., & Saul, L. (1998). An introduction to vari-ational methods for graphical models. In M. Jordan (Eds.), Learning in graphical models, (pp. 105-162). Norwell, MA: Kluwer.
32. Joshi, R., & Sanderson, A. (1999). Multisensor fusion: A minimal representation framework. Singapore: World Scientific.
33. Keribin, C. (2000). Consistent estimation of the order of mixture models. Sankhya: the Indian Journal of Statistics, Series A, 62(1), 49-66.
34. King, A. J. (2004). The superior colliculus. Current Biology, 14, 335-338.
35. King, A. J. (2005). Multisensory integration: strategies for synchronization. Current Biology, 15, 339-341.
36. Kushal, A., Rahurkar, M., Fei-Fei, L., Ponce, J., & Huang, T. (2006). Audiovisual speaker localization using graphical models. In Proc. of the Eighteenth International Conference on Pattern Recognition, (pp. 291-294). Piscataway, NJ: IEEE.
37. Laptev, I. (2005). On space-time interest points. Int. J. Comp. Vis., 64(2-3), 107-123.
38. Majumder, S., Scheding, S., & Durrant-Whyte, H. (2001). Multisensor data fusion for underwater navigation. Robotics and Autonomous Systems, 35, 97-108.
39. McLachlan, G., & Krishnan, T. (1996). The EM algorithm and extensions. Hoboken, NJ: Wiley.
40. McLachlan, G. J., & Peel, D. (2000). Finite mixture models. Hoboken, NJ: Wiley.
41. Mitchell, H. (2007). Multi-sensor data fusion. New York: Springer.
42. Naus, H., & van Wijk, C. (2004). Simultaneous localization of multiple emitters. IEE Proceedings Radar Sonar and Navigation, 151, 65-70.
43. Nefian, A. V., Liang, L., Pi, X., Liu, X., & Murphy, K. (2002). Dynamic Bayesian networks for audio-visual speech recognition. EURASIP Journal of Applied Signal Processing, 2002(1), 1274-1288.
44. Perez, P., Vermaak, J., & Blake, A. (2004). Data fusion for visual tracking with particles. Proceedings of IEEE, 92(3), 495-513.
45. Polyak, B. (1987). Introduction to optimization. New York: Optimization Software.
46. Pouget, A., Deneve, S., & Duhamel, J.-R. (2002). A computational perspective on the neural basis of multisensory spatial representations. Nature Review Neuroscience, 3, 741-747.
47. Quinn, B., McLachlan, G., & Hjort, N.L. (1987). A note on the Aitkin-Rubin approach to hypothesis testing in mixture models. Journal of the Royal Statistical Society. Series B (Methodological), 49(3), 311-314.
48. Schwarz, G. (1978). Estimating the dimension of a model. Annals of Statistics, 6, 461-464.
49. Shao, X., & Barker, J. (2008). Stream weight estimation for multistream audio-visual speech recognition in a multispeaker environment. Speech Communication, 50(4), 337-353.
50. Smith, D., & Singh, S. (2006). Approaches to multisensor data fusion in target tracking: A survey. IEEE Transactions on Knowledge and Data Engineering, 18, 1696-1710.
51. van Kampen, N. (2007). Stochastic processes in physics and chemistry (3rd ed.). Dordrecht: North-Holland.
52. Wang, D., & Brown, G. J., (Eds.). (2006). Computational auditory scene analysis: Principles, algorithms, and applications. Hoboken, NJ: Wiley-IEEE Press.
53. Zhigljavsky, A. (1991). Theory of global random search. Norwell, MA: Kluwer.
54. Zhigljavsky, A., & Žilinskas, A. (2008). Stochastic global optimization. New York: Springer.