Optimal Adaptive K-Means Algorithm with Dynamic Adjustment of Learning Rate

IEEE Transactions on Neural Networks

Volumn 6, Issue 1, 1995, Pages 157-169

  Chinrungrueng, Chedsada ^a   Sequin, Carlo H ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

APPROXIMATION THEORY; COMPUTER ARCHITECTURE; DESCRIBING FUNCTIONS; LEARNING SYSTEMS; NEURAL NETWORKS; OPTIMIZATION; REAL TIME SYSTEMS; STATISTICS; VECTOR QUANTIZATION;

ADAPTIVE K MEANS CLUSTERING ALGORITHMS;

ADAPTIVE ALGORITHMS;

EID: 0029196051     PISSN: 10459227     EISSN: 19410093     Source Type: Journal    
DOI: 10.1109/72.363440     Document Type: Article

References (28)

1. C. V. der Malsburg, “Self-organization of orientation sensitive cells in striate cortex,” Kybernetik, vol. 14, pp. 85-100, 1973.
2. K. Fukushima, “Cogniton: A self-organizing multilayered neural network,” Biol. vol. 20, 121-136, 1975.
3. E. L. Bienenstock, L. N. Cooper, and P. W. Munro, “Theory for the development of neuron selectivity: Orientation specificity and binocular interaction in visual cortex,” J. Neurosci., vol. 2, 32-48, 1982.
4. T. Kohonen, “Clustering, taxonomy, and topological maps of patterns,” in Proc. Sixth Int. Conf. Pattern Recognition, M. Lang, Ed. Silver Spring, MD: IEEE Computer Society Press, 1982.
5. D. E. Rumelhart and D. Zipser, “Feature discovery by competitive learning,” in Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vol. 1. Cambridge, MA: Bradford Books, 1986.
6. S. Grossberg, “Adaptive pattern classification and universal recording 1: Parallel development and coding of neural feature detectors,” Biol. Cybern., vol. 23, pp. 121-134, 1976.
7. J. Moody and C. J. Darken, “Fast learning in network of locally tuned processing units,” Neural Computation, vol. 1, pp. 281-294, 1989.
8. S. J. Nowlan, “Maximum likelihood competitive learning,” in Advances in Neural Information Processing Systems 2. D. S. Touretzky, Ed., Morgan Kaufmann, 1990.
9. S. P. Lloyd, “Least squares quantization in pcm,” IEEE Trans. Inform. Theory, vol. IT-28, no. 2, pp. 129-137, 1982.
10. J. MacQueen, “Some methods for classification and analysis of multivariate observations,” in Proc. 5th Berkeley Symp. Math. Stat. Prob., vol. 281, 1967.
11. W. M. Huang and R. P. Lippman, “Neural net and traditional classifiers,” in Neural Information Processing System, D. Anderson, Ed. 1988.
12. R. M. Gray, “Vector quantization,” IEEE ASSP Mag., pp. 4-29, Apr. 1984.
13. J. Tou and R. C. Gonzalez, Pattern Recognition Principles. Reading, MA: 1974.
14. D. Desieno, “Adding a conscience to competitive learning,” in Proc. 2nd IEEE Int. Conf. Neural Networks (ICNN-88), vol. I, July 1988.
15. C. Darken and J. Moody, “Fast adaptive k-means clustering: Some empirical results,” in Proc. Int. Joint Conf. Neural Networks (IJCNN-90), June 1990.
16. C. Darken and J. Moody, “Learning schedules for stochastics optimization,” in 1990 IEEE Conf. Neural Information Processing Systems—Natural and Synthetic, Nov. 1990.
17. D. E. Rumelhart, G. E. Hinton, and R. J. Williams, “Learning internal representations by error propagation,” in Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vol. 1. Cambridge, MA: Bradford, 1986.
18. R. A. Jacobs, “Increased rate of convergence through learning rate adaptation,” Neural Networks, vol. 1, pp. 331-342, 1989.
19. P. Arabshahi, J. J. Choi, R. J. Marks II, and T. P. Caudell, “Fuzzy control of backpropagation,” in Proc. IEEE Int. Conf. Fuzzy System (FUZZ-IEEE '92), San Diego, CA, Mar. 1992.
20. J. J. Choi, P. Arabshahi, R. J. Marks II, and T. P. Caudell, “Fuzzy parameter adaption in neural systems,” in Proc. Int. Joint Conf. Neural Networks (IJCNN-92), Baltimore, MD, June 1992.
21. G. A. Carpenter and S. Grossberg, “Neural dynamics of category learning and recognition: Attention, memory consolidation, and amnesia,” in Brain Structure, Learning and Memory, R. Newburgh and E. Wegman, Eds. 1986.
22. J. C. Bezdek, E. C.-K. Tsao, and N. R. Pal, “Fuzzy kohonen clustering networks,” in Proc. IEEE Int. Conf. Fuzzy System (FUZZ-IEEE '92), San Diego, CA, Mar. 1992.
23. C. Clunrungrueng and C. H. Séquin, “Optimal adaptive k-means algorithm with dynamic adjustment of learning rate,” Int. Comput. Sci. Inst. (ICSI), Berkeley, CA, Tech. Rep. TR-91-017, Mar. 1991.
24. “Optimal adaptive k-means algorithm with dynamic adjustment of learning rate,” in Proc. Int. Joint Conf Neural Networks (IJCNN-9I-Seattle), July 1991.
25. “K-means competitive learning for non-stationary environments,” in Proc. Int. Joint Conf. Neural Networks (IJCNN-90-Singapore), Nov. 1991.
26. A. Gersho, “Asymptotically optimal block quantization,” IEEE Trans. Inform. Theory, vol. IT-25, no. 4, pp. 373-380, 1979.
27. P. Boucher and M. Goldberg, “Color image compression by adaptive vector quantization,” in Proc. IEEE ICASSP, Mar. 1984, pp. 29.6.1-29.9.4.
28. Y. Linde, A. Buzo, and R. M. Gray, “A algorithm for vector quantizer design.” IEEE Trans. Commun., vol. COM-28, no. 4, pp. 84-95, Jan. 1980.