Modified fuzzy c-means for ordinal valued attributes with particle swarm for optimization

Fuzzy Sets and Systems

Volumn 161, Issue 13, 2010, Pages 1774-1789

  Brouwer, Roelof K ^a   Groenwold, Albert ^a  

^a STELLENBOSCH UNIVERSITY   (South Africa)

Author keywords

Fuzzy c means; Fuzzy clustering; Ordinal features; Particle swarm optimization; Pattern classification

Indexed keywords

ARTIFICIAL DATA; BAYESIAN; CATEGORICAL FEATURES; CLUSTERING METHODS; CLUSTERING PROCESS; COMPUTATIONAL EFFORT; DEGREES OF FREEDOM; FUZZY C MEAN; FUZZY C MEANS CLUSTERING; FUZZY C-MEANS; FUZZY C-MEANS CLUSTERING METHOD; GLOBAL OPTIMIZATION METHOD; IF THERE ARE; INTERVAL SCALE; LOCAL MINIMUMS; LOCAL OPTIMA; MEMBERSHIP MATRIX; MULTISTART; OBJECTIVE FUNCTIONS; OPTIMIZATION PROBLEMS; PARTICLE SWARM; PATTERN CLASSIFICATION; STANDARD METHOD; STOPPING CRITERIA;

CLUSTER ANALYSIS; CLUSTERING ALGORITHMS; FUZZY CLUSTERING; FUZZY SYSTEMS; GLOBAL OPTIMIZATION; MAPPING; NUMERICAL METHODS;

PARTICLE SWARM OPTIMIZATION (PSO);

EID: 77950628260     PISSN: 01650114     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.fss.2009.10.019     Document Type: Article

References (64)

1. D. Adler, Genetic algorithms and simulated annealing: a marriage proposal, in: IEEE ICNN, Vol. 2, 1993, pp. 1104-1109.
2. Aluffi-Pentini F., Parisi V., and Zirilli F. Global optimization and stochastic differential equations. Journal of Optimization Theory and Applications 47 (1985) 1-16 1985/09
3. Babu G.P., and Murti M.N. Clustering with evolution strategies. Pattern Recognition 27 (1994) 321-329
4. D. Barbara, J. Couto, Y. Li, COOLCAT: an entropy-based algorithm for categorical clustering, in: Information and Knowledge Management, 2002, pp. 582-589.
5. Y. Bennani, Adaptive weighting of pattern features during learning, in: IJCNN '99. Internat. Joint Conf. on Neural Networks, 1999, pp. 3008-3013.
6. Bezdek J. Pattern Recognition with Fuzzy Objective Function Algorithms (1981), Plenum, New York
7. J.N. Bhuyan, V.V. Raghavan, V.K. Elayavalli, Genetic algorithms for clustering with an ordered representation, in: Internat. Conf. on Genetic Algorithms, 1991, pp. 408-415.
8. R.K. Brouwer, Clustering with mixed attributes consisting of intervalued and ordinal valued attributes, in: CIRAS, Singapore, 2005.
9. R.K. Brouwer, A method for obtaining a fuzzy set covering for ordinal attributes for use in fuzzy clustering, Report BRO 2005, Thompson Rivers University, Kamloops, Canada, Department of Computing Science, Thompson Rivers University, 2005.
10. R.K. Brouwer, A method for fuzzy clustering with ordinal attributes replaced by fuzzy set parameters, in: 3rd Internat. IEEE Conf. on Intelligent Systems, 2006, pp. 553-558.
11. R.K. Brouwer, A method for fuzzy clustering with ordinal attributes, International Journal of Intelligent Systems 22 (2007) 599-620.
12. Brouwer R.K. Fuzzy clustering of feature vectors with some ordinal valued attributes using gradient descent for learning. IJUFKS 6 (2008) 195-218
13. C. Ching-Yi, Y. Fun, Particle swarm optimization algorithm and its application to clustering analysis, in: IEEE Internat. Conf. on Networking, Sensing and Control, 2004, pp. 789-794.
14. S. Coppock, L. Mazlack, Rough sets used in the measurement of similarity of mixed mode data, in: 22nd Internat. Conf. of the North American Fuzzy Processing Information Society, 2003, pp. 197-201.
15. S. Coppock, L. Mazlack, Soft multi-modal data fusion, in: FUZZ '03 the 12th IEEE Internat. Conf. on Fuzzy Systems, 2003, pp. 636-641.
16. Davies L., and Kaufman M. Genetic Algorithms and Simulated Annealing (1996), Pitman Publishing, Southport, UK
17. L. Davis, M. Steenstrup, Genetic algorithms and simulated annealing: an overview, in: Genetic Algorithms and Simulated Annealing, 1987, pp. 1-11.
18. Dixon L.C.W., Gomulka J., and Szego G.P. Towards a global optimization technique. In: Dixon L.C.W., and Szego G.P. (Eds). Towards Global Optimization Vol. 1 (1975), North-Holland Publishers, Amsterdam, The Netherlands 29-45
19. C. Doring, C. Borgelt, R. Kruse, Fuzzy clustering of quantitative and qualitative data, in: Annu. Meeting of the North American Fuzzy Inform. Process. Soc. NAFIPS '04, Banff, Canada, 2004, pp. 84-89.
20. Dunn J.C. A fuzzy relative of the ISODATA process and its use in detecting compact well-separated clusters. Journal of Cybernetics 3 (1973) 32-57
21. R. Eberhart, J. Kennedy, A new optimizer using particle swarm theory, in: Proc. Sixth Internat. Symp. on Micro Machine and Human Science, 1995, pp. 39-43.
22. Feng H.-M., Chen C.-Y., and Ye F. Adaptive hyper-fuzzy partition particle swarm optimization clustering algorithm. Cybernetics and Systems 37 (2006) 463-479
23. Fourie P.C., and Groenwold A.A. The particle swarm optimization algorithm in size and shape optimization. Structural and Multidisciplinary Optimization 23 (2002) 259-267 2002/05
24. H. Frigui, O. Nasraoui, Simultaneous clustering and attribute discrimination, in: The Ninth IEEE Internat. Conf. on Fuzzy Systems, Vol. 1, 2000, pp. 158-163.
25. H. Frigui, S. Salem, Fuzzy clustering and subset feature weighting, in: FUZZ '03. The 12th IEEE Internat. Conf. on Fuzzy Systems, 2003, pp. 857-862.
26. V. Ganti, J. Gehrke, R. Ramakrishman, CACTUS-clustering categorical data using summaries, in: 5th ACM SGKDD Internat. Conf. on Knowledge Discovery and Data Mining, 1999, pp. 73-88.
27. Gower J.C. A general coefficient of similarity and some of its properties. Biometrics 27 (1971) 857-871
28. L.O. Hall, J.C. Bezdek, S. Boggavarpu, A. Bensaid, Genetic fuzzy clustering, in: NAFIPS/IFIS/NASA '94. Proc. First Internat. Joint Conf. of the North American Fuzzy Information Processing Society Biannual Conf. The Industrial Fuzzy Control and Intelligent Systems Conf., and the NASA Joint Technology, 1994, pp. 411-415.
29. Hall L.O., Ozyurt I.B., and Bezdek J.C. Clustering with a genetically optimized approach. IEEE Transactions on Evolutionary Computation 3 (1999) 103-112
30. Hoppner F., Klawonn F., Kruse R., and Runkler T. Fuzzy Cluster Analysis (1999), Wiley, New York
31. Huang Z. Extensions to the k-means algorithm for clustering large data sets with categorical values. Data Mining and Knowledge Discovery 2 (1998) 283-304 1998/09
32. Huang Z., and Ng M.K. A fuzzy k-modes algorithm for clustering categorical data. IEEE Transactions on Fuzzy Systems 7 (1999) 446-452
33. Hubert L., and Arabie P. Comparing partitions. Journal of Classification 2 (1985) 193-198
34. Ingber L. Simulated annealing: practice versus theory. Mathematical and Computer Modelling 18 (1993) 29-57 1993/12
35. Ingber L., and Rosen B. Genetic algorithms and very fast simulated reannealing: a comparison. Mathematical and Computer Modelling 16 (1992) 87-100 1992/11
36. N. Ishii, W. Yong, Learning feature weights for similarity using genetic algorithms, in: IEEE Internat. Joint Symposia on Intelligence and Systems, 1998, pp. 27-33.
37. Jain A.K., and Dubes R.C. Algorithms for Clustering Data (1988), Prentice-Hall, Upper Saddle River, NJ
38. N. Jankowski, Discrete feature weighting & selection algorithm, in Proc. Internat. Joint Conf. on Neural Networks, 2003, pp. 636-641.
39. Kamel M.S., and Selim S.Z. New algorithms for solving the fuzzy clustering problem. Pattern Recognition 27 (1994) 585-598
40. Kandel A. Fuzzy Mathematical Techniques with Applications (1986), Addison-Wesley, Reading, MA
41. Kaufman L., and Rousseeuw P.J. Finding Groups in Data: An Introduction to Cluster Analysis (1990), Wiley, New York
42. J. Kennedy, R. Eberhart, Particle swarm optimization, in: Proc. IEEE Internat. Conf. on Neural Networks, 1995, pp. 1942-1948.
43. J. Kennedy, R.C. Eberhart, A discrete binary version of the particle swarm algorithm, in: IEEE Internat. Conf. on 'Computational Cybernetics and Simulation', 1997, pp. 4104-4108.
44. Kirkpatrick S., Gelatt J.C.D., and Vecchi M.P. Optimization by simulated annealing. Science 220 (1983) 671-680
45. Kohavi R., and Provost F. Glossary of Terms. Machine Learning 30 (1998) 271-274
46. S. Kok, D.W. Wood, A.A. Groenwold, A particle swarm minimization algorithm with enhanced hill climbing capability, South African Journal of Science and Technology 102 (2006) 543-547.
47. Lawrence D. Genetic Algorithms and Simulated Annealing (1987), Morgan Kaufmann Publishers Inc., Los Altos, CA
48. J. Li, X. Gao, L. Jiao, A GA-based clustering algorithm for large data sets with mixed numeric and categorical values, in: The Internat. Soc. for Optical Eng. Multispectral Image Process. and Pattern Recognition, Vol. 5286, Beijing, China, 2003, pp. 171-174.
49. L. Mahnhoon, R.K. Brouwer, Fuzzy clustering and mapping of ordinal values to numerical, in: FOCI 2007 IEEE Symp. on Foundations of Comput. Intell., 2007, pp. 538-543.
50. L. Mahnhoon, R.K. Brouwer, Likelihood based fuzzy clustering for data sets of mixed features, in: IEEE Symp. on Foundations of Comput. Intell. FOCI 2007, 2007, pp. 544-549.
51. Maulik U., and Bandyopadhyay S. Genetic algorithm-based clustering technique. Pattern Recognition 33 (2000) 1455-1465
52. Pawlak Z. Rough Sets: Theoretical Aspects of Reasoning about Data (1991), Kluwer Academic Publishers, Dordrecht
53. K.V. Price, Genetic annealing, Dr. Dobb's Journal October (1994) 127-134.
54. Ralambondrainy H. A conceptual version of the K-means algorithm. Pattern Recognition Letters 16 (1995) 1147-1157
55. M. Sato-Ilic, Dynamic clustering model for ordinal similarity, in: 1998 Conf. of the North American Fuzzy Inform. Process. Society-NAFIPS (Cat. No.98TH8353), Pensacola Beach, FL, USA, 20-21 August 1998, pp. 91-95.
56. Snyman J.A., and Fatti L.P. A multi-start global minimization algorithm with dynamic search trajectories. Journal of Optimization Theory and Applications 54 (1987) 121-141
57. Stevens S.S. On the theory of scales of measurement. Science 103 (1946) 677-680
58. Storn R., and Price K. Differential evolution-a simple and efficient heuristic for global optimization over continuous spaces. Journal of Global Optimization 11 (1997) 341-359
59. Thompson N.J. J-The Natural Language for Analytic Computing (2003), Research Studies Press, Hertfordshire, UK
60. D.N. Wilkie, S. Kok, A.A.G. Comparison of linear and classical velocity update rules in particle swarm optimization: notes on Diversity, International Journal of Numerical Methods in Engineering 70 (2007) 962-984.
61. W.H. Wolberg, O.L. Mangasarian, Multisurface method of pattern separation for medical diagnosis applied to breast cytology, in: National Academy of Sciences, 1990, pp. 9193-9196.
62. Yip P., and Pao Y. A guided evolutionary simulated annealing approach to the quadratic assignment problem. IEEE Transactions on Systems, Man and Cybernetics 74 (1994)
63. D. Zhang, X. Liu, Z. Guan, A dynamic clustering algorithm based on PSO and its application in fuzzy identification, in: IIH-MSP '06 Internat. Conf. on Intelligent Inform. Hiding and Multimedia Signal Process., 2006, pp. 232-235.
64. J. Zhang, Selecting typical instances in instance-based learning, in: Ninth Internat. Machine Learning Conf., Aberdeen, Scotland, 1992, pp. 470-479.