Flexible feature discovery and structural information control

Connection Science

Volumn 13, Issue 4, 2001, Pages 323-347

  Kamimura, Ryotaro ^a   Kamimura, Taeko ^b   Uchida, Osamu ^c  

^a TOKAI UNIVERSITY   (Japan)

^b SENSHU UNIVERSITY   (Japan)

^c KANAGAWA INSTITUTE OF TECHNOLOGY   (Japan)

Author keywords

First order information; Flexible feature discovery; Information parameter; Second order information; Structural information

Indexed keywords

FLEXIBLE FEATURE DISCOVERY;

COMPUTER PROGRAMMING LANGUAGES; DATA ACQUISITION; FEATURE EXTRACTION; INFORMATION ANALYSIS;

INFORMATION THEORY;

EID: 0035528493     PISSN: 09540091     EISSN: None     Source Type: Journal    
DOI: 10.1080/09540090110108679     Document Type: Article

References (39)

1. Ahalt, S. C., Krishnamurthy, A. K., Chen, P., and Melton, D. E., 1990, Competitive learning algorithms for vector quantization. Neural Networks, 3: 277-290.
2. Akiyama, Y., and Furuya, T., 1991, An Extension of the Back-propagation Learning which Performs Entropy Maximization as well as Error Minimization. Technical Report NC91-6, IEICE Technical Report.
3. Anderson, J. R., 1980, Cognitive Psychology and its Implication (New York: Worth).
4. Atick, J. J., and Redlich, A. N., 1990, Toward a theory of early visual processing. Neural Computation, 2: 308-320.
5. Atteave, F., 1990, Some informational aspects of visual perception. Psychological Review, 61: 183-193.
6. Barlow, H. B., 1989, Unsupervised learning. Neural Computation, 1: 295-311.
7. Barlow, H. B., Kaushal, T. P., and Mitchison, G. J., 1989, Finding minimum entropy code. Neural Computation, 1: 412-423.
8. Becker, S., 1996, Mutual information maximization: models of cortical self-organization. Network: Computation in Neural Systems, 7: 7-31.
9. Becker, S., and Hinton, G. E., 1993, Learning mixture models of spatial coherence. Neural Computation, 5: 267-277.
10. Comon, P., 1994, Independent component analysis: a new concept. Signal Processing, 36: 287-314.
11. Deco, G., Finnof, W., and Zimmermann, H. G., 1995, Unsupervised mutual information criterion for elimination of overtraining in supervised multiplayer networks. Neural Computation, 7: 86-107.
12. Desieno, D., 1988, Adding a conscience to competitive learning. In Proceedings of IEEE International Conference on Neural Networks, pp. 117-124.
13. Fritzke, B., 1991, Unsupervised clustering with growing cell structures. In Proceedings of IEEE International Joint Conference on Neural Networks, pp. 531-536.
14. Fukushima, K., 1975, Cognition: a self-organizing multi-layered neural network. Biological Cybernetics, 20: 121-136.
15. Gatlin, L. L., 1972, Information Theory and Living Systems (Columbia: Columbia University Press).
16. Grossberg, S., 1987, Competitive learning: from interactive activation to adaptive resonance. Cognitive Science, 11: 23-63.
17. Hagan, M. T., and Demuth, H. B., 1996, Neural Network Design (Boston MA: PWS).
18. Kamimura, R., and Nakanishi, S., 1995a, Hidden information maximization for feature detection and rule discovery. Network, 6: 577-622.
19. Kamimura, R., and Nakanishi, S., 1995b, Improving generalization performance by information minimization. IEICE Transactions on Information and Systems, E78-D (2): 163-173.
20. Kohonen, T., 1982, Self-organized formation of topological correct feature maps. Biological Cybernetics, 43: 59-69.
21. Kohonen, T., 1988, Self-organization and Associative Memory (New York: Springer Verlag).
22. Kohonen, T., 1990, The self-organization map. Proceedings of the IEEE, 78 (9): 1464-1480.
23. Kohonen, T., 1995, Self-organization Maps (Berlin: Springer).
24. Kuno, S., 1996, The Structure of the Japanese Language (Cambridge MA: The MIT Press).
25. Kuno, S., and Kaburaki, E., 1977, Empathy and syntax. Linguistic Inquiry, 8: 627-672.
26. Linsker, R., 1988, Self-organization in a perceptual network. Computer, 21: 105-117.
27. Linsker, R., 1989, How to generate ordered maps by maximizing the mutual information between input and output. Neural Computation, 1: 402-411.
28. Luk, A., and Lien, S., 2000, Properties of the generalized lotto-type competitive learning. In Proceedings of the International Conference on Neural Information Processing (San Mateo CA: Morgan Kaufmann), pp. 1180-1185.
29. Makino, S., 1996, Uchi to Soto no Gengogakku (A Linguistic-Cultural Study of Uchi and Soto) Tokyo: ALC).
30. Peterson, S. E., Robinson, D. L., and Morris, J. D., 1987, Contributions of the pulvinar to visual spatial attention. Neuropsychologia, 25: 97-105.
31. Ritter, H., and Kohonen, T., 1989, Self-organizing semantic map. Biological Cybernetics, 61: 241-254.
32. Rumelhart, D. E., and Zipser, D., 1986, Feature discovery by competitive learning. In D. E. Rumelhart, G. E. Hinton and R. J. Williams, (eds) Parallel Distributed Processing, Vol. 1 (Cambridge MA: MIT Press), pp. 151-193.
33. Saussure, F., 1969, Cours de Linguistique Generale (Paris: Payot).
34. Treisman, A. M., and Gelade, G., 1980, A feature-integration theory of attention. Cognitive Psychology, 12: 97-136.
35. Tsujimura, N., 1996, An Introduction to Japanese Linguistics (Malden MA: Blackwell).
36. Utsugi, A., 1996, Topological selection for self-organization maps. Neural Computation, 7: 727-740.
37. Utsugi, A., 1997, Hyperparameter selection for self-organization maps. Neural Computation, 9: 623-635.
38. von der Malsburg, C. 1973, Self-organization of orientation sensitive cells in the striata cortex. Kybernetik, 14: 85-100.
39. Xu, L., 1993, Rival penalized competitive learning for clustering analysis, RBF net, and curve detection. IEEE Transaction on Neural Networks, 4 (4): 636-649.