Free energy-based competitive learning for self-organizing maps

Proceedings of the IASTED International Conference on Artificial Intelligence and Applications, AIA 2008

Volumn , Issue , 2008, Pages 414-419

  Kamimura, Ryotaro ^a  

^a TOKAI UNIVERSITY   (Japan)

Author keywords

Competitive learning; Entropy; Free energy; Mutual information; Self organizing maps

Indexed keywords

COMPETITIVE LEARNING; COMPUTATIONAL PROCEDURES; CONNECTION WEIGHTS; ENERGY METHODS; FEATURE MAPS; FREE ENERGY MINIMIZATIONS; INFORMATION-THEORETIC APPROACHES; INPUT PATTERNS; MUTUAL INFORMATION; MUTUAL INFORMATION MAXIMIZATIONS;

ARTIFICIAL INTELLIGENCE; COMPUTATIONAL COMPLEXITY; CONFORMAL MAPPING; EDUCATION; ERRORS; FREE ENERGY; INFORMATION THEORY; OPTIMIZATION; STATISTICAL MECHANICS;

SELF ORGANIZING MAPS;

EID: 62849099253     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (16)

1. R. Kamimura, "Progressive feature extraction by greedy network-growing algorithm," Complex Systems, vol. 14, no. 2, pp. 127-153, 2003.
2. R. Kamimura, T. Kamimura, and O. Uchida, "Flexible feature discovery and structural information control," Connection Science, vol. 13, no. 4, pp. 323-347, 2001.
3. R. Kamimura, "Information theoretic competitive learning in self-adaptive multi-layered networks," Connection Science, vol. 13, no. 4, pp. 323-347, 2003.
4. R. Kamimura, "Teacher-directed learning: information-theoretic competitive learning in supervised multi-layered networks," Connection Science, vol. 15, pp. 117-140, 2003.
5. R. Kamimura, "Information-theoretic competitive learning with inverse euclidean distance," Neural Processing Letters, vol. 18, pp. 163-184, 2003.
6. R. Kamimura, "Improving information-theoretic competitive learning by accentuated information maximization," International Journal of General Systems, vol. 34, no. 3, pp. 219-233, 2006.
7. D. E. Rumelhart and D. Zipser, "Feature discovery by competitive learning," in Parallel Distributed Processing (D. E. Rumelhart and G. E. H. et al., eds.), vol. 1, pp. 151-193, Cambridge: MIT Press, 1986.
8. S. Grossberg, "Competitive learning: from interactive activation to adaptive resonance," Cognitive Science, vol. 11, pp. 23-63, 1987.
9. D. DeSieno, "Adding a conscience to competitive learning," in Proceedings of IEEE International Conference on Neural Networks, (San Diego), pp. 117-124, IEEE, 1988.
10. S. C. Ahalt, A. K. Krishnamurthy, P. Chen, and D. E. Melton, "Competitive learning algorithms for vector quantization," Neural Networks, vol. 3, pp. 277-290, 1990.
11. M. M. V. Hulle, "The formation of topographic maps that maximize the average mutual information of the output responses to noiseless input signals," Neural Computation, vol. 9, no. 3, pp. 595-606, 1997.
12. R. Kamimura, T. Kamimura, and T. R. Shultz, "Information theoretic competitive learning and linguistic rule acquistion," Transactions of the Japanese Society for Artificial Intelligence, vol. 16, no. 2, pp. 287-298, 2001.
13. N. Ueda and R. Nakano, "Deterministic annealing variant of the em algorithm," in Advances in Neural Information Processing Systems, pp. 545-552, 1995.
14. K. Rose, E. Gurewitz, and G. C. Fox, "Statistical mechanics and phase transition in clustering," Physical review letters, vol. 65, no. 8, pp. 945-948, 1990.
15. T. M. Martinez, S. G. Berkovich, and K. J. Schulten, "Neural-gas network for vector quanitization and its application to time-series prediction," IEEE transactions on neural networks, vol. 4, no. 4, pp. 558-569, 1993.
16. L. L. Gatlin, Information Theory and Living Systems. Columbia University Press, 1972.