Interpreting and improving multi-layered networks by free energy-based competitive learning

Conference Proceedings - IEEE International Conference on Systems, Man and Cybernetics

Volumn , Issue , 2008, Pages 1812-1818

  Kamimura, Ryotaro ^a  

^a TOKAI UNIVERSITY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL DATA; COMPETITIVE LEARNING; ENTROPY MINIMIZATION; GENERALIZATION ERROR; GENERALIZATION PERFORMANCE; IN-NETWORK; INPUT PATTERNS; INTERNAL REPRESENTATION; LEARNING METHODS; MULTI-LAYERED; MULTILAYERED NEURAL NETWORKS; RATING ESTIMATION; TRAINING ERRORS;

CONTROL THEORY; CYBERNETICS; ERRORS; FEATURE EXTRACTION; FREE ENERGY; NEURAL NETWORKS;

ENTROPY;

EID: 69949165422     PISSN: 1062922X     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICSMC.2008.4811552     Document Type: Conference Paper

References (24)

1. D. E. Rumelhart and D. Zipser, "Feature discovery by competitive learning," in Parallel Distributed Processing (D. E. Rumelhart and G. E. H. et al., eds.), vol. 1, pp. 151-193, Cambridge: MIT Press, 1986.
2. S. Grossberg, "Competitive learning: from interactive activation to adaptive resonance," Cognitive Science, vol. 11, pp. 23-63, 1987.
3. D. DeSieno, "Adding a conscience to competitive learning," in Proceedings of IEEE International Conference on Neural Networks, (San Diego), pp. 117-124, IEEE, 1988.
4. S. C. Ahalt, A. K. Krishnamurthy, P. Chen, and D. E. Melton, "Competitive learning algorithms for vector quantization," Neural Networks, vol. 3, pp. 277-290, 1990.
5. M. M. V. Hulle, "The formation of topographic maps that maximize the average mutual information of the output responses to noiseless input signals," Neural Computation, vol. 9, no. 3, pp. 595-606, 1997.
6. T. Kohonen, Self-Organization and Associative Memory. New York: Springer-Verlag, 1988.
7. T. Kohonen, Self-Organizing Maps. New York: Springer-Verlag, 1995.
8. R. Hecht-Nielsen, "Applications of counterpropagation networks," Neural Networks, vol. 1, no. 2, pp. 131-139, 1988.
9. R. Kamimura, "Progressive feature extraction by greedy network-growing algorithm," Complex Systems, vol. 14, no. 2, pp. 127-153, 2003.
10. R. Kamimura, T. Kamimura, and O. Uchida, "Flexible feature discovery and structural information control," Connection Science, vol. 13, no. 4, pp. 323-347, 2001.
11. R. Kamimura, "Information theoretic competitive learning in self-adaptive multi-layered networks," Connection Science, vol. 13, no. 4, pp. 323-347, 2003.
12. R. Kamimura, "Teacher-directed learning: information-theoretic competitive learning in supervised multi-layered networks," Connection Science, vol. 15, pp. 117-140, 2003.
13. R. Kamimura, "Information-theoretic competitive learning with inverse euclidean distance," Neural Processing Letters, vol. 18, pp. 163-184, 2003.
14. R. Kamimura, "Improving information-theoretic competitive learning by accentuated information maximization," International Journal of General Systems, vol. 34, no. 3, pp. 219-233, 2006.
15. N. Ueda and R. Nakano, "Deterministic annealing variant of the em algorithm," in Advances in Neural Information Processing Systems, pp. 545-552, 1995.
16. K. Rose, E. Gurewitz, and G. C. Fox, "Statistical mechanics and phase transition in clustering," Physical review letters, vol. 65, no. 8, pp. 945-948, 1990.
17. T. M. Martinez, S. G. Berkovich, and K J. Schulten, "Neural-gas network for vector quantization and its application to time-series prediction," IEEE transactions on neural networks, vol. 4, no. 4, pp. 558-569, 1993.
18. M. M. Miller and B. Denham, "Horserace, issue coverage in prestige newspapers during 1988, 1992 elections," Newspaper Research Journal, vol. 15, no. 4, pp. 20-28, 1994.
19. M. M. Miller, J. L. Andsager, and B. P. Riechert, "Framing the candidates in presidential primaries: issues and images in press releases and news coverage," Journalism and Mass communication quarterly, vol. 75, no. 2, pp. 312-324, 1998.
20. D. Domke, D. P. Fan, S. Michael, D. V. S. Smith, and M. D. Watts, "News media, candidates and issues, and public opinion in the 1996 presidential campaign," Journalism and Mass Communication Quaterly, vol. 74, no. 4, pp. 718-737, 1996.
21. D. Fan, "Computer content analysis of press coverage and prediction of public opinion for the 1995 sovereignty referendum in quebec," Journalism and Mass Communication Quaterly, vol. 74, no. 4, pp. 351-366, 1996.
22. M. D. Watts, D. Domke, D. V. Shah, and D. P. Fan, "Elite cues and media bias in presidential campaigns," Communication Research, vol. 26, no. 2, pp. 144-175, 1999.
23. J. A. Danowski and A. Rebecca, Linking gender language in news about presidential candidates to gender gaps in polls: a time-series analysis of the 1996 campaign. Westport: Ablex Publishing, 1996.
24. M. C. Mozer and P. Smolensky, "Using relevance to reduce network size automatically," Connection Science, vol. 1, no. 1, pp. 3-16, 1989.