A modified em algorithm for mixture models based on Bregman divergence

Annals of the Institute of Statistical Mathematics

Volumn 59, Issue 1, 2007, Pages 3-25

  Fujimoto, Yu ^a   Murata, Noboru ^a  

^a WASEDA UNIVERSITY   (Japan)

Author keywords

Bregman divergence; EM algorithm; Finite mixture models

Indexed keywords

CONVERGENCE OF NUMERICAL METHODS; MATHEMATICAL MODELS; NONLINEAR SYSTEMS; OPTIMIZATION; PROBLEM SOLVING; STATISTICAL METHODS;

BREGMAN DIVERGENCE; EM ALGORITHMS; FINITE MIXTURE MODELS; NONLINEAR OPTIMIZATION;

ALGORITHMS;

EID: 33847231874     PISSN: 00203157     EISSN: 15729052     Source Type: Journal    
DOI: 10.1007/s10463-006-0097-x     Document Type: Article

References (15)

1. Agresti, A. (2002). Categorical data analysis (pp. 538-575). New York: Wiley-Interscience.
2. Amari, S. (1995). Information geometry of the EM and em algorithms for neural networks. Neural Networks, 8(9), 1379-1408.
3. Amari, S., Nagaoka, H. (2000). Methods of information geometry. Providence, RI: American Mathematical Society.
4. Fujimoto, Y., Murata, N. (2006). Robust estimation for mixture of probability tables based on β-likelihood. In Proceedings of the sixth SIAM conference on data mining (pp. 519-523).
5. Fujisawa, H., Eguchi, S. (2005). Robust estimation in the normal mixture model. Journal of Statistical Planning and Inference, 136, 3989-4011.
6. Hampel, F. R., Ronchetti, E. M., Rousseeuw, P. J., Stahel, W. A. (1986). Robust statistics. New York: Wiley.
7. Hofmann, T. (1999). Probabilistic latent semantic analysis. In Proceedings of uncertainty in artificial intelligence, UAI '99 (pp. 289-296).
8. McLachlan, G. J., Krishnan, T. (1997). The EM algorithm and extensions. New York: John Wiley.
9. Meng, X. L., Rubin, D. B. (1993). Maximum likelihood estimation via the ECM algorithm: a general framework. Biometrika, 80(2), 267-278.
10. Minami, M., Eguchi, S. (2002). Robust blind source separation by beta divergence. Neural Computation, 14, 1859-1886.
11. Murata, N., Takenouchi, T., Kanamori, T., Eguchi, S. (2004). Information geometry of U-Boost and Bregman divergence. Neural Computation, 16(7), 1437-1481.
12. R Development Core Team (2005). R: A language and environment for statistical computing. http://www.R-project.org. R Foundation for Statistical Computing.
13. Takenouchi, T., Eguchi, S. (2004). Robustifying AdaBoost by adding the naive error rate. Neural Computation, 16(4), 767-787.
14. Takenouchi, T. (2005). Robust boosting algorithm for multiclass classification by eta-divergence. In Proceedings of 2nd international symposium on information geometry and its applications (pp. 12-16).
15. Watanabe, M., Yamaguchi, K. (2004). EM algorithm in neural network learning. In N. Murata, S. Ikeda (Eds.) The EM algorithm and related statistical models (pp. 95-125). New York: Marcel Dekker.