Information theoretic competitive learning and linguistic rule acquisition

Transactions of the Japanese Society for Artificial Intelligence

Volumn 16, Issue 2, 2001, Pages 287-298

  Kamimura, Ryotaro ^a   Kamimura, Taeko ^b   Shultz, Thomas R ^c  

^a TOKAI UNIVERSITY   (Japan)

^b SENSHU UNIVERSITY   (Japan)

^c MCGILL UNIVERSITY   (Canada)

Author keywords

Competitive learning; Information maximization; Language acquisition

Indexed keywords

COMPETITIVE LEARNING; ENGINEERING PROBLEMS; INFORMATION MAXIMIZATION; LANGUAGE ACQUISITION;

COMPETITIVE INTELLIGENCE; INFORMATION ANALYSIS; KNOWLEDGE ACQUISITION; MAXIMUM LIKELIHOOD ESTIMATION; PROBLEM SOLVING; THEOREM PROVING;

LEARNING SYSTEMS;

EID: 0012588765     PISSN: 13460714     EISSN: 13468030     Source Type: Journal    
DOI: 10.1527/tjsai.16.287     Document Type: Article

References (29)

1. [Ahalt et al. 90] Ahalt, S.C., andd P. Chen, A.K.K., and Melton, D.E. (1990). Competitive learning algorithms for vector quantization. Neural Networks, 3: 277-290.
2. [Anderson 80] Anderson, J.R. (1980). Cognitive Psychology and its Implication. Worth Publishers, New York.
3. [Atick and Redlich 90] Atick, J.J. and Redlich, A.N. (1990). Toward a theory of early visual processing. Neural Computation, 2: 308-320.
4. [Becker 96] Becker, S. (1996). Mutual information maximization: models of cortical self-organization. Network: Computation in Neural Systems, 7: 7-31.
5. [Becker and Hinten 93] Becker, S. and Hinton, G.E. (1993). Learning mixture models of spatial coherence. Neural Computation, 5: 267-277.
6. [Brown and Hanlon 70] Brown, R. and Hanlon, C. (1970). Derivational complexity and order of acquisition. In Hayes, R., editor, Cognition and Development of Language. Wiley, New York.
7. [Demetras et al. 86] Demetras, M.J., Post, K.N., and Snow, C.E. (1986). Feedback to first language learners: The role of repetitions and clarification questions. Journal of Child Language, 13: 275-292.
8. [Diesieno 88] Diesieno, D. (1988). Adding a conscience to competitive learning. In Proceedings of IEEE International Conference on Neural Networks, pages 117-124. IEEE.
9. [Fukushima 75] Fukushima, K. (1975). Cognitron: a selforganizing multi-layered neural network. Biological Cybernetics, 20: 121-136.
10. [Gatlin 72] Gatlin, L.L. (1972). Information Theory and Living Systems. Columbia University Press.
11. [Grossberg 87] Grossberg, S. (1987). Competitive learning: from interactive activation to adaptive resonance. Cognitive Science, 11: 23-63.
12. [Hagan and Demuth 96] Hagan, M.T. and Demuth, H.B. (1996). Neural Network Design. PWS Publishing Company, Boston, MA.
13. [Kamimura et al. 01] Kamimura, R., Kamimura, T., and Shultz, T.R. (01). Self-organization by information control(in press). In Proceedings of IASTED International Conference on Applied Informatics.
14. [Kamimura and Nakanishi 95] Kamimura, R. and Nakanishi, S. (1995). Hidden information maximization for feature detection and rule discovery. Network, 6: 577-622.
15. [Kohonen 87] Kohonen, T. (1987). Self-Organization and Associative Memory. Springer-Verlag.
16. [Kohonen 95] Kohonen, T. (1995). Self-Organization Maps. Springer-Verlag.
17. [Linsker 88] Linsker, R. (1988). Self-organization in a perceptual network. Computer, 21: 105-117.
18. [Linsker 89] Linsker, R. (1989). How to generate ordered maps by maximizing the mutual information between input and output. Neural Computation, 1: 402-411.
19. [Linsker 92] Linsker, R. (1992). Local synaptic rules suffice to maximize mutual information in a linear network. Neural Computation, 4: 691-702.
20. [Luk and Lien 00] Luk, A. and Lien, S. (00). Properties of the generalized lotto-type competitive learning. In Proceedings of International conference on neural information processing, pages 1180-1185.
21. [Makino 96] Makino, S. (1996). Uchi to Soto no Gengogaku (A Linguistic-cultural Study of Uchi and Soto. ALC, Tokyo.
22. [Marchman 93] Marchman, V.A. (1993). Constraints on plasticity in a connectionist model of the english past tense. Journal of Cognitive Neuroscience, 5(2): 215-234.
23. [Plunkett and Marchman 91] Plunkett, K. and Marchman, V. (1991). U-shaped learning and frequency effects in a multilayered perceptron: Implication for child language acquisition. Cognition, 38: 43-102.
24. [Ritter and Kohonen 89] Ritter, H. and Kohonen, T. (1989). Self-organizing semantic map. Biological Cybernetics, 61: 241-254.
25. [Rumelhart and McClelland 86] Rumelhart, D.E. and Mc-Clelland, J.L. (1986). On learning the past tenses of english verbs. In Rumelhart, D.E., Hinton, G.E., and Williams, R.J., editors, Parallel Distributed Processing, volume 2, pages 216-271. MIT Press, Cambrige.
26. [Rumelhart and Zipser 86] Rumelhart, D.E. and Zipser, D. (1986). Feature discovery by competitive learning. In Rumelhart, D.E., Hinton, G.E., and Williams, R.J., editors, Parallel Distributed Processing, volume 1, pages 151-193. MIT Press, Cambrige.
27. [Saussure 69] Saussure (1969). Cours de Linguitique Generale. Payot, Paris.
28. [von der Malsburg 73] von der Malsburg, C. (1973). Selforganization of orientation sensitive cells in the striata cortex. Kybernetik, 14: 85-100.
29. [Xu 93] Xu, L. (1993). Rival penalized competitive learning for clustering analysis, rbf net, and curve detection. IEEE Transaction on Neural Networks, 4(4): 636-649.