A generalization of the deterministic annealing EM algorithm by means of non-extensive statistical mechanics

International Journal of Modern Physics B

Volumn 17, Issue 29, 2003, Pages 5525-5539

  Inoue, Jun Ichi ^a   Tabushi, Katsumi ^a  

^a HOKKAIDO UNIVERSITY   (Japan)

Author keywords

Bayes statistics; EM algorithm; Tsallis entropy

Indexed keywords

ALGORITHM; BAYES THEOREM; CONFERENCE PAPER; ENTROPY; MATHEMATICAL ANALYSIS; MATHEMATICAL PARAMETERS; MECHANICS; NONLINEAR SYSTEM; STATISTICAL MODEL; STATISTICS; TEMPERATURE;

EID: 1642431657     PISSN: 02179792     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0217979203023197     Document Type: Conference Paper

References (12)

1. B. J. Frey, Graphical Models for Machine Learning and Digital Communication, The MIT Press (1998).
2. M. I. Jordan, ed., Learning in Graphical Models, The MIT Press (1998).
3. A. P. Dempster, N. M. Laird and D. B. Rubin, Maximum likelihood from incomplete data via the EM algorithm, in Proc. Royal Stat. Soc., Series B39, 1 (1977).
4. N. Ueda and R. Nakano, Mixture density estimation via EM algorithm with deterministic annealing, in Proc. of IEEE Neural Networks for Signal Processing, 1211 (1994).
5. N. Ueda and R. Nakano, Neural Networks 12, 689 (1998).
6. R. L. Streit and T. E. Luginbuhl, IEEE Trans. on Neural Networks 5, 764 (1994).
7. K. Tabushi and J. Inoue, Improvement of EM algorithm by means of non-extensive statistical mechanics, in Proc. of IEEE Neural Networks for Signal Processing, 133 (2001).
8. C. Tsallis, J. Stat. Phys. 52, 479 (1988).
9. J. L. Marroquin, S. Mitter and T. Poggio, J. American Stat. Assoc. 82, 76 (1987).
10. P. Ruján, Phys. Rev. Lett. 70, 2973 (1993).
11. S. Geman and D. Geman, IEEE Trans. Patt. Anal. and Mach. Intel 6, 727 (1984).
12. H. Nishimori, Statistical Physics of Spin Glasses and Information Processing: An Introduction (Oxford University Press, 2001).