“Neural-Gas” Network for Vector Quantization and its Application to Time-Series Prediction

IEEE Transactions on Neural Networks

Volumn 4, Issue 4, 1993, Pages 558-569

  Martinetz, Thomas M ^a   Berkovich, Stanislav G ^a   Schulten, Klaus J ^a  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; BROWNIAN MOVEMENT; DATA COMPRESSION; DATA PROCESSING; ENCODING (SYMBOLS); ERROR ANALYSIS; MATHEMATICAL TECHNIQUES; OPTIMIZATION; PERFORMANCE; TIME SERIES ANALYSIS; VECTORS;

BACK PROPAGATION; DISTORTION ERROR; MACKEY-GLASS EQUATION; NEURAL GAS NETWORK; RADIAL BASIS FUNCTION NETWORK; REFERENCE (WEIGHT) VECTORS; SOFTMAX ADAPTATION RULE; TIME SERIES PREDICTION; VECTOR QUANTIZATION;

NEURAL NETWORKS;

EID: 0027632248     PISSN: 10459227     EISSN: 19410093     Source Type: Journal    
DOI: 10.1109/72.238311     Document Type: Article

References (33)

1. R. M. Gray, “Vector quantization,” IEEE ASSP Mag., vol. 1, no. 2, pp. 4–29, 1984.
2. S. P. Lloyd, “Least squares quantization in PCM,” IEEE Trans. Inform. Theory, vol. IT-28, p. 2, 1982.
3. J. MacQueen, “Some methods for classification and analysis of multivariate observations,” in Proc. 5th Berkeley Symp. on Mathematics, Statistics, and Probability, L. M. LeCam and J. Neyman, Eds., 1967, pp. 281–297.
4. K. Rose, F. Gurewitz, and G. Fox, “Statistical mechanics and phase transitions in clustering,” Physical Rev. Lett., vol. 65, no. 8, pp. 945–948, 1990.
5. S. Geman and D. Geman, “Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images,” IEEE Trans. Patt. Anal. Machine Intell., vol. PAMI-6, pp. 721–741, 1984.
6. S. J. Nowlan, “Maximum likelihood competitive learning,” in Advances in Neural Information Processing Systems 2, D. Touretzky, Ed. New York: Morgan Kauffman, 1990, pp. 574–582.
7. T. Kohonen, “Self-organized formation of topologically correct feature maps,” Biological Cybern., vol. 43, pp. 59–69, 1982.
8. T. Kohonen, “Analysis of a simple self-organizing process,” Biological Cybern, vol. 44, pp. 135–140, 1982.
9. T. Kohonen, Self-Organization and Associative Memory (Springer Series in Information Sciences 8). Heidelberg: Springer.
10. T. Kohonen, K. M ä kisara, and T. Saramaki, “Phonotopic maps—insightful representation of phonological features for speech recognition,” in Proc. 7th Int. Conf. on Pattern Recognition, Montreal, 1984, pp. 182–185.
11. J. Makhoul, S. Roucos, and H. Gish, “Vector quantization in speech coding,” Proc. IEEE, vol. 73, pp. 1551–1588, 1985.
12. H. Ritter and K. Schulten, “Topology conserving mappings for learning motor tasks,” in Neural Networks for Computing, J. S. Denker, Ed., AIP Conf. Proc. 151, Snowbird, UT, 1986, pp. 376–380.
13. N. M. Nasrabadi and R. A. King, “Image coding using vector quantization: A review,” IEEE Trans. Commun., vol. 36, no. 8, pp. 957–971, 1988.
14. N. M. Nasrabadi and Y. Feng, “Vector quantization of images based upon the Kohonen self-organizing feature maps,” in IEEE Int. Conf on Neural Networks, San Diego, CA, 1988, pp. 1101–1108.
15. J. Naylor and K. P. Li, “Analysis of a neural network algorithm for vector quantization of speech parameters,” in Proc. 1st Annu. INNS Meet., 1988, p. 310.
16. H. Ritter, T. Martinetz, and K. Schulten, “Topology-conserving maps for learning visuomotor-coordination,” Neural Networks, vol. 2, pp. 159–168, 1988.
17. T. Martinetz, H. Ritter, and K. Schulten, “Three-dimensional neural net for learning visuomotor-coordination of a robot arm,” IEEE Trans. Neural Networks, vol. 1, no. 1, pp. 131–136.
18. T. Martinetz, H. Ritter, and K. Schulten, “Learning of visuomotor coordination of a robot arm with redundant degrees of freedom,” in Proc. Int. Conf on Parallel Processing in Neural Systems and Computers 1990, R. Eckmiller, G. Hartmann, and G. Hauske, Eds., pp. 431-134; and Proc. 3rd Int. Symp. on Robotics and Manufacturing, Vancouver, BC, Canada, 1990, 521–526.
19. H. Ritter and K. Schulten, “Convergence properties of Kohonen’s topology conserving maps: Fluctuations, stability and dimension selection,” Biological Cybern., vol. 60, pp. 59–71, 1989.
20. K. Obermayer, H. Ritter, and K. Schulten, “A principle for the formation of the spatial structure of cortical feature maps,” Proc. Nat. Acad. Sci. U.S., vol. 87, pp. 8345–8349, 1990.
21. D. H. Graf and W. R. LaLonde, “A neural controller for collision-free movement of general robot manipulators,” in IEEE Int. Conf. on Neural Networks, San Diego, CA, 1988, pp. 77–84.
22. T. Kohonen, “Self-organizing maps: Optimization approaches,” in Artificial Neural Networks, vol. II, T. Kohonen et al., Eds. Amsterdam: North Holland, 1991, pp. 981–990.
23. E. Erwin, K. Obermayer, and K. Schulten, “Self-organizing maps: Ordering, convergence properties, and energy functions,” Biological Cybern., vol. 67, pp. 47–55, 1992.
24. J. C. Dunn, “A fuzzy relative of the isodata process and its use in detecting compact well-separated clusters,” J. Cybern., vol. 3, no. 3, pp. 32–57, 1974.
25. J. C. Bezdek, “A convergence theorem for the fuzzy isodata clustering algorithm,” IEEE Trans. Patt. Anal. Machine Intell., vol. 2, no. 1, pp. 1–8, 1980.
26. R. Hecht-Nielsen, “Applications of counterpropagation networks,” Neural Networks, vol. 1, no. 2, pp. 131–141, 1988.
27. J. Moody and C. J. Darken, “Fast learning in networks of locally tuned processing units,” Neural Computation, vol. 1, pp. 281–294, 1989.
28. J. Walter, T. Martinetz, and K. Schulten, “Industrial robot learns visuomotor coordination by means of neural-gas network,” in Artificial Neural Networks, vol. I, T. Kohonen et al., Eds. Amsterdam: North Holland, pp. 357–364.
29. P. I. Zador, “Asymptotic quantization error of continuous signals and the quantization dimension,” IEEE Trans. Inform. Theory, vol. IT-28, no. 2, pp. 139–149, 1982.
30. M. Mackey and L. Glass, “Oscillation and chaos in physiological control systems,” Science, vol. 197, p. 287, 1977.
31. J. Walter, H. Ritter, and K. Schulten, “Nonlinear prediction with self-organizing maps,” in IJCNN-90 Conf. Proc., vol. III, San Diego, CA, 1990, pp. 589–594.
32. A. Lapedes and R. Farber, “Nonlinear signal processing using neural networks: Prediction and system modelling,” Technical Report LA-UR-87-2662, Los Alamos National Laboratory, Los Alamos, NM, 1988.
33. G. Sugihara and R. May, “Nonlinear forecasting as a way of distinguishing chaos from measurement error in time-series,” Nature, vol. 344, pp. 734–740, 1990.