Constrained Clustering as an Optimization Method

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 15, Issue 8, 1993, Pages 785-794

  Fox, Geoffrey C ^c  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b NUCLEAR RESEARCH CENTER NEGEV   (Israel)

^c SYRACUSE UNIVERSITY   (United States)

Author keywords

Annealing; clustering; maximum entropy; neural networks; nonconvex optimization; self organization

Indexed keywords

CONSTRAINT THEORY; IMAGE PROCESSING; OPTIMIZATION;

CLUSTERING; DETERMINISTIC ANNEALING; TRAVELING SALESMAN PROBLEM;

NEURAL NETWORKS;

EID: 0027649303     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/34.236251     Document Type: Article

References (28)

1. G. Ball and D. Hall, “A clustering technique for summarizing multivariate data,” Behavioral Sci., vol. 12, pp. 153–155, 1967.
2. J. C. Dunn, “A fuzzy relative of the ISODATA process and its use in detecting compact well-separated clusters,” J. Cybern., vol. 3, pp. 32–57, 1974.
3. J. C. Bezdek, “A convergence theorem for the fuzzy ISODATA clustering algorithms,” IEEE Trans. Patt. Anal. Machine Intell., vol. PAMI-2, pp. 1–8, 1980.
4. Y. Linde, A. Buzo, and R. M. Gray, “An algorithm for vector quantizer design,” IEEE Trans. Commun., vol. COM-28, pp. 84–95, 1980.
5. R. O. Duda and P. E. Hart, Patt. Classification Scene Anal. New York: Wiley-Interscience, 1974.
6. A. K. Jain and R. C. Dubes, Algorithms for Clustering Data. Englewood Cliffs, NJ: Prentice Hail, 1988.
7. M. Anderberg, Cluster Analysis for Applications. New York: Academic. 1973.
8. S. Kirkpatrick, C. D. Gelatt, and M. P. Vecchi, “Optimization by simulated annealing,” Sci., vol. 220, pp. 671–680, 1983.
9. S. Geman and D. Geman, “Stochastic relaxation, Gibbs distribution, and the Bayesian restoration of images,” IEEE Trans. Patt. Anal. Machine Intell., vol. PAMI-6, pp. 721–741, 1984.
10. P. J. M. van Laarhoven and E. H. L. Aarts, Simulated Annealing: Theory and Applications, Dordrecht, The Netherlands: D. Reidel, 1987.
11. D. Geman, S. Geman, C. Graffigne, and P. Dong, “Boundary detection by constrained optimization,” IEEE Trans. Patt. Anal. Machine Intell., vol. 12, pp. 609–628, 1990.
12. K. Rose, E. Gurewitz, and G. C. Fox, “Statistical mechanics and phase transitions in clustering,” Phys. Rev. Lett., vol. 65, pp. 945–948, 1990.
13. K. Rose, E. Gurewitz, and G. C. Fox, “Vector quantization by deterministic annealing,” IEEE Trans. Inform. Theory, vol. 38, no. 4, pp. 1249–1257, July 1992.
14. E. T. Jaynes, “Information theory and statistical mechanics,” in Papers on Probability, Statistics and Statistical Physics (R. D. Rosenkrantz, Ed.). Dordrecht, The Netherlands: Kluwer, 1989.
15. C. Shannon and W. Weaver, The Mathematical Theory of Communication. Urbana, IL: Univ. of Illinois Press, 1949.
16. R. Durbin and D. Willshaw, “An analogue approach to the travelling salesman problem using an elastic net method,” Nature, vol. 326, pp. 689–691, 1987.
17. T. Kohonen, Self Organization and Associative Memory. Berlin: Springer-Verlag, 1984.
18. R. Durbin, R. Szeliski, and A. Yuille, “An analysis of the elastic net approach to the travelling salesman problem,” Neural Comput., vol. 1, 348–358, 1989.
19. A. L. Yuille, “Generalized deformable models, statistical physics, and matching problems,” Neural Comput., vol. 2, pp. 1–24, 1990.
20. P. D. Simic, “Statistical mechanics as the underlying theory of elastic and neural optimization,” Network, vol. 1, 89–103, 1990.
21. A. G. Tsirukis, G. V. Reklaitis, and M. F. Tenorio, “Nonlinear optimization using generalized Hopfield networks,” Neural Comput., vol. 1, pp. 511–521, 1989.
22. G. V. Reklaitis, A. Ravindran, and K. M. Ragsdell, Eng. Optimization. New York: Wiley-Interscience, 1983.
23. S. Grossberg, “Adaptive pattern classification and universal recoding: I. Parallel development and coding of neural feature detectors,” Biolog. Cybern., vol. 23, pp. 121–134, 1976.
24. S. Grossberg, “Adaptive pattern classification and universal recoding: II. Feedback, expectation, olfaction, illusions,” Biolog. Cybern., vol. 23, pp. 187–202, 1976.
25. D. E. Rumelhart and D. Zipser, “Feature discovery by competitive learning,” Cognitive Sci., vol. 9, pp. 75–112, 1985.
26. S. Grossberg, “Competitive learning: From interactive activation to adaptive resonance,” Cognitive Sci., vol. 11, pp. 23–63, 1987.
27. P. -C. Chang and R. M. Gray, “Gradient algorithms for designing predictive vector quantizers,” IEEE Trans. Acoustics Speech Signal Processing, vol. ASSP-34, pp. 679–690, 1986.
28. R. Durbin and G. Mitchison, “A dimension reduction framework for understanding cortical maps,” Nature, vol. 343, pp. 644–647, 1990.