Conditional information and information loss for flexible feature extraction

Proceedings of the International Joint Conference on Neural Networks

Volumn , Issue , 2008, Pages 2074-2083

  Kamimura, Ryotaro ^a  

^a TOKAI UNIVERSITY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

CONFORMAL MAPPING; FEATURE EXTRACTION; INFORMATION THEORY; SELF ORGANIZING MAPS; SURVEYS;

ARTIFICIAL DATUMS; COMPETITIVE LEARNINGS; INFORMATION CONTENTS; INFORMATION LOSSES; INPUT PATTERNS; STUDENT SURVEYS;

NEURAL NETWORKS;

EID: 56349140716     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IJCNN.2008.4634083     Document Type: Conference Paper

References (14)

1. D. E. Rumelhart and D. Zipser, "Feature discovery by competitive learning," in Parallel Distributed Processing (D. E. Rumelhart and G. E. H. et al., eds.), vol. 1, pp. 151-193, Cambridge: MIT Press, 1986.
2. S. Grossberg, "Competitive learning: from interactive activation to adaptive resonance," Cognitive Science, vol. 11, pp. 23-63, 1987.
3. D. DeSieno, "Adding a conscience to competitive learning," in Proceedings of IEEE International Conference on Neural Networks, (San Diego), pp. 117-124, IEEE, 1988.
4. S. C. Ahalt, A. K. Krishnamurthy, P. Chen, and D. E. Melton, "Competitive learning algorithms for vector quantization," Neural Networks, vol. 3, pp. 277-290, 1990.
5. L. Xu, "Rival penalized competitive learning for clustering analysis, RBF net, and curve detection," IEEE Transaction on Neural Networks, vol. 4, no. 4, pp. 636-649, 1993.
6. A. Luk and S. Lien, "Properties of the generalized lotto-type competitive learning," in Proceedings of International conference on neural information processing, (San Mateo: CA), pp. 1180-1185, Morgan Kaufmann Publishers, 2000.
7. M. M. V. Hulle, "The formation of topographic maps that maximize the average mutual information of the output responses to noiseless input signals," Neural Computation, vol. 9, no. 3, pp. 595-606, 1997.
8. R. Kamimura, "Progressive feature extraction by greedy network-growing algorithm," Complex Systems, vol. 14, no. 2, pp. 127-153, 2003.
9. R. Kamimura, T. Kamimura, and O. Uchida, "Flexible feature discovery and structural information control," Connection Science, vol. 13, no. 4, pp. 323-347, 2001.
10. R. Kamimura, "Information theoretic competitive learning in self-adaptive multi-layered networks," Connection Science, vol. 13, no. 4, pp. 323-347, 2003.
11. R. Kamimura, "Teacher-directed learning: information-theoretic competitive learning in supervised multi-layered networks," Connection Science, vol. 15, pp. 117-140, 2003.
12. R. Kamimura, "Information-theoretic competitive learning with inverse euclidean distance," Neural Processing Letters, vol. 18, pp. 163-184, 2003.
13. R. Kamimura, "Improving information-theoretic competitive learning by accentuated information maximization," International Journal of General Systems, vol. 34, no. 3, pp. 219-233, 2006.
14. L. L. Gatlin, Information Theory and Living Systems. Columbia University Press, 1972.