Parsimonious reduction of Gaussian mixture models with a variational-Bayes approach

Pattern Recognition

Volumn 43, Issue 3, 2010, Pages 850-858

  Bruneau, Pierrick ^a,b   Gelgon, Marc ^a,b   Picarougne, Fabien ^a  

^a UNIVERSITÉ DE NANTES   (France)

^b INRIA Atlas Project Team   (France)

Author keywords

Bayesian estimation; Mixture models; Model aggregation

Indexed keywords

BAYES APPROACH; BAYESIAN ESTIMATIONS; BAYESIAN MODELLING; COMPUTATIONAL COSTS; CURRENT TRENDS; DISTRIBUTED INFRASTRUCTURE; DISTRIBUTED SYSTEMS; GAUSSIAN MIXTURE MODEL; MIXTURE MODEL; MIXTURE MODELS; MODEL COMPLEXITY; SCALING-UP; STATISTICAL REPRESENTATIONS; VARIATIONAL ESTIMATION;

BAYESIAN NETWORKS; COMMUNICATION CHANNELS (INFORMATION THEORY); ESTIMATION;

MIXTURES;

EID: 70450248402     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2009.08.006     Document Type: Article

References (29)

1. F. Alimoglu, Combining multiple classifiers for pen-based handwritten digit recognition, Technical Report, Institute of Graduate Studies in Science and Engineering, 1996.
2. H. Attias, A variational Bayesian framework for graphical models, Advances in Neural Information Processing Systems, 2000.
3. S. Basu, M. Bilenko, A. Banerjee, R.J. Mooney, Probabilistic semi-supervised clustering with constraints, in: Semi-Supervised Learning, MIT Press, Cambridge, MA, 2006.
4. M. Bechchi, G. Raschia, N. Mouaddib, Merging distributed database summaries, in: Proceedings of the ACM CIKM '07, Lisbon, November 2007, pp. 419-428.
5. Bishop C.M. Pattern Recognition and Machine Learning (2006), Springer, New York
6. Bishop C.M., and Svensén M. Bayesian hierarchical mixtures of experts. In: Meek C., and Kjærulff U. (Eds). UAI (2003), Morgan Kaufmann, Los Altos, CA 57-64
7. Blahut R.E. Principles and Practice of Information Theory (1987), Addison-Wesley, Reading, MA
8. Bock R.K., Chilingarian A., Gaug M., Hakl F., Hengstebeck T., Jirina M., Klaschka J., Kotrc E., Savicky P., Towers S., Vaiciulis A., and Wittek W. Methods for multidimensional event classification: a case study using images from a Cherenkov gamma-ray telescope. Nuclear Instruments and Methods in Physics Research. Section A, Accelerators, Spectrometers, Detectors and Associated Equipment 516 2-3 (2004) 511-528
9. P. Bruneau, M. Gelgon, F. Picarougne, Parsimonious variational-Bayes mixture aggregation with a Poisson prior, in: EUSIPCO'09, 2009, submitted for publication.
10. Constantinopoulos C., and Titsias M.K. Bayesian feature and model selection for Gaussian mixture models. IEEE Transactions on Pattern Analysis and Machine Intelligence 28 6 (2006) 1013-1018
11. Fablet R., Bouthemy P., and Perez P. Non-parametric motion characterization using causal probabilistic models for video indexing and retrieval. IEEE Transactions on Image Processing 11 4 (2002)
12. Freund Y. An adaptive version of the boost by majority algorithm. Machine Learning 43 3 (2001) 293-318
13. J. Goldberger, S. Roweis, Hierarchical clustering of a mixture model, in: NIPS, 2004.
14. G. Griffin, A. Holub, P. Perona, Caltech-256 object category dataset, Technical Report 7694, California Institute of Technology, 2007.
15. R. Hammoud, R. Mohr, Mixture densities for video objects recognition, in: International Conference on Pattern Recognition (ICPR'2000), Barcelona, Spain, September 2000, pp. 71-75.
16. Kittler J., Hatef M., Duin R., and Matas J. On combining classifiers. IEEE Transactions on Pattern Analysis and Machine Intelligence 20 3 (1998) 226-239
17. Korte B., and Vygen J. Combinatorial Optimization: Theory and Algorithms (2002), Springer, Berlin
18. Larlus D., and Jurie F. Latent mixture vocabularies for object categorization and segmentation. Journal of Image & Vision Computing 27 5 (2009) 523-534
19. Lowe D.G. Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision 60 (2004) 91-110
20. Nikseresht A., and Gelgon M. Gossip-based computation of a Gaussian mixture model for distributed multimedia indexing. IEEE Transactions on Multimedia 3 (2008) 385-392
21. Nowak R. Distributed EM algorithms for density estimation and clustering in sensor networks. IEEE Transactions on Signal Processing 51 8 (2003)
22. Oliva A., and Torralba A. Modeling the shape of the scene: a holistic representation of the spatial envelope. International Journal of Computer Vision 42 3 (2001) 145-175
23. Ponce J., Hebert M., Schmid C., and Zisserman A. Towards Category-level Object Recognition (2006), Springer, Berlin
24. Reynolds D.A., and Rose R.C. Text independent speaker identification using Gaussian mixture speaker models. IEEE Transactions on Speech and Audio Processing 3 1 (1995) 72-83
25. Roberts S.J., Husmeier D., Rezek I., and Penny W. Bayesian approaches to Gaussian mixture modelling. IEEE Transactions on Pattern Analysis and Machine Intelligence 20 11 (1998) 1133-1142
26. Runnalls A. A Kullback-Leibler approach to Gaussian mixture reduction. IEEE Transactions on Aerospace and Electronic Systems 43 3 (2007) 989-999
27. Schwarz G. Estimating the dimension of a model. The Annals of Statistics 6 (1978) 461-464
28. N. Vasconcelos, Image indexing with mixture hierarchies, in: Proceedings of IEEE Conference in Computer Vision and Pattern Recognition, vol. 1, 2001, pp. 3-10.
29. N. Vasconcelos, A. Lippman, Learning mixture hierarchies, in: Neural Information Processing Systems (NIPS) Conference, Denver, Colorado, September 1998.