Soft learning vector quantization and clustering algorithms based on non-Euclidean norms: Single-norm algorithms

IEEE Transactions on Neural Networks

Volumn 16, Issue 2, 2005, Pages 423-435

  Karayiannis, Nicolaos B ^a   Randolph Gips, Mary M ^b  

^a UNIVERSITY OF HOUSTON   (United States)

^b UNIVERSITY OF HOUSTON CLEAR LAKE   (United States)

Author keywords

Clustering; Generator function; Learning vector quantization (LVQ); Non Euclidean norm; Reformulation; Reformulation function; Weight matrix; Weighted norm

Indexed keywords

COMPUTATIONAL METHODS; CONSTRAINT THEORY; ERROR ANALYSIS; ITERATIVE METHODS; MATRIX ALGEBRA; MEMBERSHIP FUNCTIONS; VECTOR QUANTIZATION;

CLUSTERING ALGORITHMS; GENERATOR FUNCTION; LEARNING VECTOR QUANTIZATION (LVQ) ALGORITHMS; NON-EUCLIDEAN NORM; REFORMULATION FUNCTION; SINGLE-NORM ALGORITHMS;

LEARNING ALGORITHMS;

ALGORITHM; ARTICLE; CLUSTER ANALYSIS; LEARNING; PHYSIOLOGY;

ALGORITHMS; CLUSTER ANALYSIS; LEARNING;

EID: 15344339535     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2004.841778     Document Type: Article

References (39)

1. E. Anderson, "The IRISes of the Gaspe peninsula," Amer. Bull. IRIS Soc., vol. 59, pp. 2-5, 1939.
2. A. Baraldi and E. Alpaydm, "Constructive feedforward ART clustering networks - Part I," IEEE Trans. Neural Netw., vol. 13, no. 3, pp. 645-661, May 2002.
3. A. Baraldi and E. Alpaydm, "Constructive feedforward ART clustering networks - Part II," IEEE Trans. Neural Netw., vol. 13, no. 3, pp. 662-677, May 2002.
4. J. C. Bezdek, Pattern Recognition with Fuzzy Objective Function Algorithms. New York: Plenum, 1981.
5. J. C. Bezdek and N. R. Pal, "Two soft relatives of learning vector quantization," Neural Netw., vol. 8, no. 5, pp. 729-743, 1995.
6. 1 and ℓ∞ norms," IEEE Trans. Syst. , Man, Cybern., vol. 21, no. 3, pp. 545-554, May-Jun. 1991.
7. V. Cherkassky and F. Mulier, Learning From Data: Concepts, Theory, and Methods. New York: Wiley, 1998.
8. D. Dubois and H. Prade, "A review of fuzzy set aggregation connectives," Inform. Sci., vol. 36, no. 1-2, pp. 85-121, 1985.
9. H. Dyckhoff and W. Pedrycz, "Generalized means as a model of compensative connectives," Fuzzy Sets Syst., vol. 14, no. 2, pp. 143-154, 1984.
10. G. Frosini, B. Lazzerini, and F. Marcelloni, "A modified fuzzy c means algorithm for feature selection," in Proc. 19th Int. Conf. North American Fuzzy Information Processing Soc., Atlanta, GA, Jul. 2000, pp. 148-152.
11. I. Gath and A. B. Geva, "Unsupervised optimal fuzzy clustering," IEEE Trans. Pattern Anal. Mach. Intell., vol. 11, no. 7, pp. 773-781, Jul. 1989.
12. D. E. Gustafson and W. Kessel, "Fuzzy clustering with a fuzzy covariance matrix," in Proc. IEEE Conf. Decision Control, San Diego, CA, 1979, pp. 761-766.
13. R. J. Hathaway and J. C. Bezdek, "NERF c-means: Non-Euclidean relational fuzzy clustering," Pattern Recognit., vol. 27, no. 3, pp. 429-437. 1994.
14. R. J. Hathaway and J. C. Bezdek, "Optimization of clustering criteria by reformulation," IEEE Trans. Fuzzy Syst., vol. 3, no. 2, pp. 241-246, May 1995.
15. P norm distances," IEEE Trans. Fuzzy Syst., vol. 8, no. 5, pp. 576-582, Oct. 2000.
16. F. Höppner, F. Klawonn, R. Kruse, and T. Runkler, Fuzzy Cluster Analysis: Methods for Classification, Data Analysis and Image Recognition. New York: Wiley, 1999.
17. 1-norm based fuzzy clustering," Fuzzy Sets Syst., vol. 39, pp. 43-50, 1991.
18. N. B. Karayiannis, "Fuzzy partition entropies and entropy constrained fuzzy clustering algorithms," J. Intell. Fuzzy Syst., vol. 5, no. 2, pp. 103-111, 1997.
19. N. B. Karayiannis, "A methodology for constructing fuzzy algorithms for learning vector quantizatiom," IEEE Trans. Neural Netw., vol. 8, no. 3, pp. 505-518, May 1997.
20. N. B. Karayiannis, "Reformulating learning vector quantization and radial basis neural networks," Fundamenta Informaticae, vol. 37, pp. 137-175. 1999.
21. N. B. Karayiannis, "An axiomatic approach to soft learning vector quantization based on reformulation," IEEE Trans. Neural Netw., vol. 10, no. 5, pp. 1153-1165, Sep. 1999.
22. N. B. Karayiannis, "From aggregation operators to soft learning vector quantization and clustering algorithms," in Kohonen Maps, E. Oja and S. Kaski, Eds. Amsterdam, The Netherlands: Elsevier, 1999, pp. 47-56.
23. N. B. Karayiannis, "Generalized fuzzy c-means algorithms," J. Intell. Fuzzy Syst., vol. 8, no. 1, pp. 63-81, 2000.
24. N. B. Karayiannis, "Soft learning vector quantization and clustering algorithms based on ordered weighted aggregation operators," IEEE Trans. Neural Netw., vol. 11. no. 5, pp. 1093-1105. Sep. 2000.
25. N. B. Karayiannis, "Soft learning vector quantization and clustering algorithms based on mean-type aggregation operators," Int. J. Fuzzy Syst., vol. 4, no. 3, pp. 739-751, 2002.
26. N. B. Karayiannis and J. C. Bezdek, "An integrated approach to fuzzy learning vector quantization and fuzzy c-means clustering," IEEE Trans. Fuzzy Syst., vol. 5, no. 4, pp. 622-628, Nov. 1997.
27. N. B. Karayiannis, J. C. Bezdek, N. R. Pal, R. J. Hathaway, and P.-I. Pai, "Repairs to GLVQ: A new family of competitive learning schemes," IEEE Trans. Neural Netw., vol. 7, no. 5, pp. 1062-1071, Sep. 1996.
28. N. B. Karayiannis and P.-I. Pai, "Fuzzy algorithms for learning vector quantization," IEEE Trans. Neural Netw., vol. 7, no. 5, pp. 1196-1211, Sep. 1996.
29. N. B. Karayiannis and M. M. Randolph-Gips, "Reformulated radial basis neural networks with adjustable weighted norms," in Proc. Int. Joint Conf. Neural Networks, vol. 3, Como, Italy, Jul. 24-27, 2000, pp. 608-613.
30. N. B. Karayiannis and M. M. Randolph-Gips, "Soft learning vector quantization and clustering algorithms based on non-Euclidean norms: Multi-norm algorithms," IEEE Trans. Neural Netw., vol. 14, no. 1, pp. 89-102, Jan. 2003.
31. N. B. Karayiannis and N. Zervos, "Entropy-constrained learning vector quantization algorithms and their application in image compression," J. Electron. Imag., vol. 9, no. 4, pp. 495-508, 2000.
32. A. Keller and F. Klawonn, "Fuzzy clustering with weighting of data variables," Int. J. Uncertainty, Fuzziness and Knowledge-Based Syst. vol. 8, no. 6, pp. 735-746, 2000.
33. F. Klawonn and R. Kruse, "Derivation of fuzzy classification rules from multidimensional data," in Advances in Intelligent Data Analysis, G. E. Lasker and X. Liu, Eds. Windsor, ON, Canada: IIAS, 1995, pp. 90-94.
34. G. J. Klir and B. Yuan, Fuzzy Sets and Fuzzy Logic: Theory and Applications. Englewood Cliffs, NJ: Prentice-Hall, 1995.
35. R. Krishnapuram and J. Kim, "A note on the Gustafson-Kessel and adaptive fuzzy clustering algorithms," IEEE Trans. Fuzzy., vol. 7, no. 4, pp. 453-461, Aug. 1999.
36. R. Krishnapuram and J. Kim, "Clustering algorithms based on volume criteria," IEEE Trans. Fuzzy Syst., vol. 8, no. 2, pp. 228-236, Apr. 2000.
37. J. T. Tou and R. C. Gonzalez, Pattern Recognition Principles. Reading, MA: Addison-Wesley, 1974.
38. E. C.-K. Tsao, J. C. Bezdek, and N. R. Pal, "Fuzzy Kohonen clustering networks," Pattern Recognit., vol. 27, no. 5, pp. 757-764, 1994.
39. R. R. Yager, "On mean type aggregation," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 26, no. 2, pp. 209-221, Apr. 1996.