Convergence theorems for the Kohonen feature mapping algorithms with VLRPs

Computers and Mathematics with Applications

Volumn 33, Issue 3, 1997, Pages 45-63

  Feng, J F ^a   Tirozzi, B ^b  

^a BABRAHAM INSTITUTE   (United Kingdom)

^b SAPIENZA UNIVERSITY OF ROME   (Italy)

Author keywords

Global minima; Kohonen feature mapping algorithm; Stochastic differential equation; Supermartingale; Vanishing learning rate parameters (VLRPs)

Indexed keywords

CONVERGENCE OF NUMERICAL METHODS; DIFFERENTIAL EQUATIONS; LEARNING SYSTEMS; NEURAL NETWORKS; SIMULATED ANNEALING;

KOHONEN FEATURE MAPPING ALGORITHMS; SUPERMARTINGALE; VANISHING LEARNING RATES PARAMETERS (VLRP);

LEARNING ALGORITHMS;

EID: 0031074819     PISSN: 08981221     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0898-1221(96)00236-2     Document Type: Article

References (26)

1. S. Albeverio, N. Krüger and B. Tirozzi, An extension of Kohonen phonetic maps for speech recognition, Mathl. Comput. Modelling (to appear).
2. D. Amit, Modeling Brain Function, Cambridge Univ. Press, (1989).
3. J.A. Hertz, A. Krogh and R. Palmer, Introduction to the Theory of Neural Computation, Addison-Wesley, Redwood City, CA, (1991).
4. E. Erwin, K. Obermayer and K. Schulten, Self-organizing maps: Stationary states, metastability and convergence rate, Biol. Cybern. 67, 35-45, (1992).
5. E. Erwin, K. Obermayer and K. Schulten, Self-organizing maps: Ordering, convergence properties and energy functions, Biol. Cybern. 67, 47-55, (1992).
6. C. Bouton and G. Pagès, Self-organization and convergence of the one-dimensional Kohonen algorithm with non uniformly distributed stimuli, Stoch. Proc. Appl. 47, 249-274, (1993).
7. C. Bouton and G. Pagès, Convergence in distribution of the one-dimensional Kohonen algorithms when the stimuli are not uniform, Adv. Appl. Prob. 26, 80-103, (1994).
8. M. Cottrell and J.C. Fort, Etude d'un algorithme d'auto-organisation, Ann. Inst. H. Poincaré 23, 1-20, (1986).
9. T. Martinetz and K. Schulten, Topology representing networks, Neural network 7, 507-522, (1994).
10. A. Benveniste, M. Métivier and P. Priouret, Adaptive Algorithms and Stochastic Approximations, Springer-Verlag, Berlin, (1990).
11. P. Hall and C.C. Heyde, Martingale Limit Theory and its Application, Academic Press, New York, (1980).
12. rd Edition, Springer-Verlag, Berlin, (1989).
13. H. Kushner and D. Clark, Stochastic Approximation Methods for Constrained and Unconstrained Systems, Springer-Verlag, New York, (1978).
14. M.B. Nevel'son and R.Z. Has'minskii, Stochastic Approximation and Recursive Estimation, Translation of Math. Monograph 47, Amer. Math. Soc., Providence, RI, (1976).
15. H. Ritter, T. Martinetz and K. Schulten, Neural Computation and Self-Organizing Maps, Addison-Wesley, Reading, MA, (1992).
16. S. Albeverio, J.F. Feng and M.P. Qian, Role of noises in neural networks, Phys. Rev. E 52, 6593-6606, (1995).
17. J.F. Feng, H. Pan and V.P. Roychowdhury, On neurodynamics with limiter function and Linsker's developmental model, Neural Computation 8, 1003-1019, (1996).
18. S. Amari, Information geometry of the EM and em algorithms for neural network, Neural Networks 8, 1379-1408, (1995).
19. G.J. Goodhill, Topography and ocular dominance:a model exploring positive correlations, Bio. Cyber. 69, 109-118, (1993).
20. G.J. Goodhill and D.J. Willshaw, Elastic net model of ocular dominance: Overall stripe pattern and monocular deprivation, Neural Computation 6, 615-621, (1994).
21. J.F. Feng and B. Tirozzi, A discrete version of the dynamic link network, Neurocomputmg 14 (to appear).
22. M. Lades, J.C. Vorbrüggen, J. Buhrmann, J. Lange, C. von der Malsburg, R.P. Würtz and W. Konen, Distortion invariant object recognition in the dynamic link architecture, IEEE Transactions on Computers 42, 300-311, (1993).
23. C. Bishop, Neural Networks for Pattern Recognition, Oxford University Press, (1995).
24. J.F. Feng and M.P. Qian, Two-stage annealing in retrieving memories I, In Probability and Statistics, (Edited by A. Badrikian, P.-A. Meyer and J.-A. Yan), pp. 149-176, World Scientific, Singapore, (1993).
25. M.I. Freidlin and A.D. Wentzell, Random Perturbations of Dynamic System, Springer-Verlag, Berlin, (1984).
26. S.Y. Chow and H. Teicher, Probability Theory, Springer-Verlag, New York, (1988).