Metaheuristics for clustering in KDD

2005 IEEE Congress on Evolutionary Computation, IEEE CEC 2005. Proceedings

Volumn 3, Issue , 2005, Pages 2380-2387

  Rayward Smith, V J ^a,b  

^a MONASH UNIVERSITY   (Australia)

^b UNIVERSITY OF EAST ANGLIA   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

HEURISTIC METHODS; KNOWLEDGE ACQUISITION;

CLUSTERING; METAHEURISTICS;

EVOLUTIONARY ALGORITHMS;

EID: 27144533206     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (81)

1. S. H. Al-Harbi, G. P. McKeown, and V. J. Rayward-Smith. A new metric for categorical data. In H. Bozdogan, editor, Statistical Data Mining and Knowledge Discovery. CRC Press, 2003.
2. S. H. Al-Harbi and V. J. Rayward-Smith. The use of a supervised k-means algorithm on real-valued data with applications in health. In P. W. H. Chung, C. J. Hinde, and M. Ali, editors, Developments in Applied Artificial Intelligence, 16th International Conference on Industrial and Engineering Applications of Artificial Intelligence and Expert Systems, volume 2718 of LNCS, pages 575-581. Springer, 2003.
3. K. Al-Sultan. A tabu search approach to the clustering problem. Pattern Recognition, 28(9):1443-1451, 1995.
4. G. P. Babu and M. N. Murty. A near-optimal initial seed value selection in k-means algorithm using a genetic algorithm. Pattern Recognition Letters, 14(10):763-769, 1993.
5. G. P. Babu and M. N. Murty. Simulated annealing for optimal initial seed selection in k-means algorithm. Indian Journal of Pure and Applied Mathematics, 25:8594, 1994.
6. n. Information Science - Applications: An International Journal, 146(1-4):221-237, 2002.
7. S. Basu, M. Bilenko, and R. J. Mooney. Semisupervised clustering for intelligent user management. In Proceedings of the 5th Annual Austin CAS Conference, 2004.
8. J. C. Bezdek and R. J. Hathaway. Optimization of fuzzy clustering criteria using genetic algorithms. In International Conference on Evolutionary Computation, pages 589-594, 1994.
9. J. N. Bhuyan, V. V. Raghavan, and V. K. Elayavalli. Genetic algorithm for clustering with an ordered representation. In Proc. of the Fourth International Conference on Genetic Algorithms, pages 408-415, San Diego, CA, 1991.
10. M. Bilenko, S. Basu, and R. J. Mooney. Integrating constraints and metric learning in semi-supervised clustering. In ICML '04: Twenty-first international conference on machine learning. ACM Press, 2004.
11. R. Calinski and J. Harabasz. A dendrite method for cluster analysis. Communications in Statistics, 1974.
12. A. Casillas, M. T. G. de Lena, and R. Martinez. Sampling and feature selection in a genetic algorithm for document clustering. In Computational Linguistics and Intelligent Text Processing, LNCS, pages 602-612. Springer, 2004.
13. A. E. Cetin and V. Weerackody. Design of vector quantizers using simulated annealing. IEEE Transactions on Circuits and Systems, 35(12), 1988.
14. Y.-C. Chiou and L. W. Lan. Genetic clustering algorithms. European Journal of Operational Research, 135(2):413-427, 2001.
15. S.-C. Chu, J. F. Roddick, C.-J. Su, and J.-S. Pan. Constrained ant colony optimization for data clustering. In PRICAI, pages 534-543, 2004.
16. D. Cohn, R. Caruana, and A. McCallum. Semi-supervised clustering with user feedback, Technical Report TR2003-1892, Cornell University, 2003.
17. K. deJong, W. Spears, and D. Gordon. Using genetic algorithms for concept learning. Machine Learning, 13:161-188, 1993.
18. M. Delgado, A. Skarmeta, and H. M. Barbera. A tabu search approach to the fuzzy clustering problem. In Proceedings FUZZ/IEEE97, 1997.
19. A. Demiriz, K. Bennett, and M. Embrechts. Semi-supervised clustering using genetic algorithms. R.P.I. Math Report no. 9901, Rensselaer Polytechnic Institute, Troy, New York, 1999.
20. J. L. Deneubourg, S. Goss, N. Franks, A. Sendova-Franks, C. Detrain, and L. Chretien. The dynamics of collective sorting robot-like ants and ant-like robots. In Proceedings of the first international conference on simulation of adaptive behavior, pages 356-363. MIT Press, 1990.
21. O. du Merle, P. Hansen, B. Jaumard, and N. Mladenovic. An interior point algorithm for minimum sum-of-squares clustering. SIAM Journal on Scientific Computing, 21(4):1485-1505, 2000.
22. C. Eick and N. M. Zeidat. Using supervised clustering to enhance classifiers. In Proc. 15th International Symposium on Methodologies for Intelligent Systems, pages 248-256, 2005.
23. C. Eick, N. M. Zeidat, and Z. Zhao. Supervised clustering - algorithms and benefits. In Proc. 16th IEEE International Conference on Tools with Artificial Intelligence, pages 774-776, 2004.
24. E. Faulkenauer. Genetic Algorithms and Grouping Problems. John Wiley & Sons, New York, 1998.
25. F.E.B.Otero, M.M.S.Silva, A. Freitas, and J. Nievola. Genetic programming for attribute construction in data mining. In Proceedings 6th European Conference on Genetic Programming, Lecture Notes in Computer Science, 2610, pages 384-393, 2003.
26. D. Fisher. Data mining tasks and methods: Clustering: conceptual clustering. In W. Klösgen and J. M. Zytkow, editors, Handbook of Data Mining and Knowledge Discovery, pages 388-396. Oxford University Press, Inc., 2002.
27. D. B. Fogel and P. Simpson. Evolving fuzzy clusters. In Proceedings of the International Conference on Neural Networks, pages 1829-1834, New York, 1993. IEEE.
28. P. Fränti, J. Kivijärvi, and O. Nevalainen. Tabu search algorithm for codebook generation in vector quantization. Pattern Recognition, 31(8):1139-1148, 1998.
29. A. A. Freitas. A genetic algorithm for generalized rule induction. In R. Roy, T. Furuhashi, and P. K. Chawdhry, editors, Advances in Soft Computing - Engineering Design and Manufacturing (Proc WSC3 3rd On-line World Conf. hosted on the internet), pages 340-353, Berlin, 1999. Springer-Verlag.
30. G. Garai and B. B. Chaudhuri. A novel genetic algorithm for automatic clustering. Pattern Recogn. Lett., 25(2):173-187, 2004.
31. J. Ghosh. Scalable clustering methods for data mining. In N. Ye, editor, Handbook of Data Mining, pages 247-277. Lawrence Erlbaum, 2003.
32. S. K. Gupta, K. S. Rao, and V. Bhatnagar. K-means clustering algorithm for categorical attributes. In Da WaK '99: Proceedings of the First International Conference on Data Warehousing and Knowledge Discovery, pages 203-208. Springer-Verlag, 1999.
33. L. O. Hall, I. B. Özyurt, and J. C. Bezdek. Clustering with a genetically optimized approach. IEEE Transactions on Evolutionary Computation, 3(2):103-112, 1999.
34. J. Han and M. Kamber. Data Mining, Concepts and Techniques. Morgan Kaufmann, London, 2001.
35. J. Han, M. Kamber, and A. Tung. Spatial clustering methods in data mining: A survey. In H. Miller and J. Han, editors, Geographic Data Mining and Knowledge Discovery. Taylor and Francis, 2001.
36. J. Handl and J. Knowles. Evolutionary multiobjective clustering. In X. Y. et al; editor, Proceedings of PPSN VIII, volume 3242 of LNCS, pages 117-128. Springer, 2004.
37. J. Handl and J. D. Knowles. Exploiting the trade-off -the benefits of multiple objectives in data clustering. In C. A. C. Coello, A. H. Aguirre, and E. Zitzler, editors, Evolutionary Multi-Criterion Optimization, Third International Conference, volume 3410 of LNCS, pages 547-560. Springer, 2005.
38. J. Handl, J. D. Knowles, and M. Dorigo. On the performance of ant-based clustering. In A. Abraham, M. Köppen, and K. Franke, editors, Design and Application of Hybrid Intelligent Systems, Proc. Third International Conference on Hybrid Intelligent Systems, volume 105 of Frontiers in Artificial Intelligence and Applications, pages 204-213. IOS Press, 2003.
39. L. Hermes and J. M. Buhmann. Semi-supervised image segmentation by parametric distributional clustering. In A. Rangarajan, M. A. T. Figueiredo, and J. Zerubia, editors, Proceedings of 4th International Workshop on Energy Minimization Methods in Computer Vision and Pattern Recognition, volume 2683 of LNCS, pages 229-245. Springer, 2003.
40. K. A. Hua, S. D. Lang, and W. K. Lee. A decomposition-based simulated annealing technique for data clustering. In Proceedings of the thirteenth ACM SIGACT-SIGMOD-SIGART symposium on Principles of database systems, pages 117-128. ACM Press, 1994.
41. H.-C. Huang, S.-C. Chu, J.-S. Pan, and Z.-M. Lu. A tabu seach based maximum descent algorithm for vq codebook design. Journal Information Science and Engineering, 17(5): 753-762, 2001.
42. Z. Huang. Extensions to the k-means algorithm for clustering large data sets with categorical values. Data Mining and Knowledge Discovery, 2(3):283-304, 1998.
43. B. d. Iglesia, M. S. Philpott, A. Bagnall, and V. J. Rayward-Smith. Data mining rules using multi objective evolutionary algorithms. In R. S. et al. editor, Proceedings of the 2003 Congress on Evolutionary Computation, pages 1552-1559. IEEE Press, Piscataway, NJ, 2003.
44. R. A. Johnson and D. W. Wichern. Applied Multivariate Statistical Analysis (3rd edition). Prentice Hall, Englewood Cliffs, NJ, 1992.
45. D. R. Jones and M. A. Beltramo. Solving partitioning problems with genetic algorithms. In R. K. Belew and L. B. Booker, editors, Proceedings of the 4th International Conference on Genetic Algorithms, pages 442-449. Morgan Kaufmann, 1991.
46. P. M. Kanade and L. O. Hall. Fuzzy ants clustering with centroids. In Proceedings of the International Conference on Fuzzy Systems. IEEE, 2004.
47. L. Kaufman and P. J. Rousseeuw. Finding Groups in Data: An Introduction to Cluster Analysis. John Wiley, New York, 1990.
48. R. W. Klein and R. Dubes. Experiments in projection and clustering by simulated annealing. Pattern Recognition, 22(2):213-220, 1989.
49. K. Krawiec. Genetic Programming-based construction of features for machine learning and knowledge discovery tasks. Genetic Programming and Evoluable Machines, 3(4):329-343, 2002.
50. K. Krishna and M. N. Murty. Genetic k-means algorithm. IEEE Transactions on Systems, Man, and Cybernetics, Part B, 29(3):433-439, 1999.
51. H. Liu and S.-T. Huang. Evolutionary semi-supervised fuzzy clustering. Pattern Recognition Letters, 24(16):3105-3113, 2003.
52. J. Liu and W. Xie. A genetics-based approach to fuzzy clustering. In Proc. of the Inter. Joint Conf. of the 4th Inter. Conf. on Fuzzy Systems and the 2nd Inter. Fuzzy Engineering Symp., pages 2233-2237. IEEE, 1995.
53. E. D. Lumer and B. Faieta. Diversity and adaptation in populations of clustering ants. In From Animals to Animats 3: Proc. of the 3th Int. Conf. on the Simulation of Adaptive Behaviour, pages 501-508, Cambridge, MA, 1994. MIT Press.
54. R. E. Marmelstein and G. B. Lamont. Pattern classification using a hybrid genetic program decision tree approach. In J. R. K. et al. editor, Genetic Programming 1998: Proceedings of the Third Annual Conference, pages 223-231. Morgan Kaufmann, 1998.
55. U. Maulik and S. Bandyopadhyay. Genetic algorithm-based clustering technique. Pattern Recognition, 33:1455-1465, 2000.
56. F. J. McErlean, D. A. Bell, and S. I. McClean. The use of simulated annealing for clustering data in databases. Information Systems, 15(2):233-245, 1990.
57. J. McQueen. Some methods for classification and analysis of multivariate observations. In Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, pages 281-297, Berkley, CA, 1971. University of California Press.
58. N. Mishra, D. Ron, and R. Swaminathan. A new conceptual clustering framework. Machine Learning, 56(1-3):115-151, 2004.
59. S. Mitra, S. Pal, and P. Mitra. Data mining in soft computing framework: A survey. IEEE Transactions on Neural Networks, 13(1):3-14, 2002.
60. N. Monmarche. On data clustering with artificial ants. In A. A. Freitas, editor, Data Mining with Evolutionary Algorithms: Research Directions, pages 23-26, Orlando, Florida, 1999. AAAI Press.
61. C. Mota, H. Ferreira, and A. Rosa. Independent and simultaneous evolution of fuzzy sleep classifiers by genetic algorithms. In Proceedings of the Genetic and Evolutionary Computing Conference GECCO, pages 1622-1629, San Francisco, CA, 1999. Morgan Kaufmann.
62. C. A. Murthy and N. Chowdhury. In search of optimal clusters using genetic algorithms. Pattern Recognition Letters, 17(8):825-832, 1996.
63. S. Nascimento and F. Moura-Pires. A genetic approach to fuzzy clustering with a validity measure fitness function. In IDA '97: Proceedings of the Second International Symposium on Advances in Intelligent Data Analysis, Reasoning about Data, pages 325-335. Springer-Verlag, 1997.
64. R. T. Ng and J. Han. Efficient and effective clustering methods for spatial data mining. In VLDB '94: Proceedings of the 20th International Conference on Very Large Data Bases, pages 144-155. Morgan Kaufmann, 1994.
65. J. Pacheco and O.Valencia. Design of hybrids for the minimum sum-of-squares clustering problem. Computational Statistics and Data Analysis, 43(2):235-248, 2003.
66. R. S. Parpinelli, H. S. Lopes, and A. A. Freitas, Data mining with an ant colony optimization algorithm. IEEE Trans. Evolutionary Computation, 6(4):321-332, 2002.
67. W. Punch, E. Goodman, M. Pei, L. Chia-Shun, P. Hovland, and R. Enbody. Further Research on Feature Selection and Classification Using Genetic Algorithms. In S. Forrest, editor, Proceedings of the 5th Intational Conference on GAs, pages 557-564. Morgan Kaufmann, 1993.
68. V. V. Raghavan and K. Birchard. A clustering strategy based on a formalism of the reproductive process in natural systems. In SIGIR '79: Proceedings of the 2nd annual international ACM SIGIR conference on Information storage and retrieval, pages 10-22. ACM Press, 1979.
69. K. Rose. Deterministic annealing for clustering, compression, classification, regression, and related optimization problems. IEEE Trans. Info. Theory, 86(11):2210-2239, 1998.
70. M. Sarkar. Evolutionary programming-based fuzzy clustering. In L. J. Fogel, P. J. Angeline, and T. Bäck, editors, Proceedings of the Fifth Annual Conference on Evolutionary Programming, pages 247-254. MIT Press, 1996.
71. M. Sarkar, B. Yegnanarayana, and D. Khemani. A clustering algorithm using an evolutionary programming-based approach. Pattern Recognition Letters, 18(10):975-986, 1997.
72. S. Z. Selim and K. Al-Sultan. A simulated annealing algorithm for the clustering problem. Pattern Recognition, 24(10):1003-1008, 1991.
73. A. Skabar. A GA-based neural network weight optimization technique for semi-supervised classifier learning. In A. A. et al. editor, Design and application of hybrid intelligent systems, pages 139-146. IOS Press, 2003.
74. L. Tseng and S. B. Yang. A genetic approach to the automatic clustering problem. Pattern Recognition, 34(2):415-424, 2001.
75. J. Vaisey and A. Gersho. Simulated annealing and codebook design. In Proc. IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP'88), pages 1133-1136, New York, 1988.
76. D.W. van der Merwe and A. P. Engelbrecht. Data clustering using particle swarm optimization. In R. S. et al. editor, Proceedings of the 2003 Congress on Evolutionary Computation CEC2003, pages 215-220, Canberra, 2003. IEEE Press.
77. L. Vermeulen-Jourdan, C. Dhaenens, and E.-G. Talbi. Clustering nominal and numerical data: A new distance concept for a hybrid genetic algorithm. In J. Gottlieb and G. R. Raidl, editors, Proceedings of Evolutionary Computation in Combinatorial Optimization EvoCOP, volume 3004 of LNCS, pages 220-229, Coimbra, Portugal, 2004. Springer Verlag.
78. X. Wang, G. Whitwell, and J. M. Garibaldi. The application of a simulated annealing fuzzy clustering algorithm for cancer diagnosis. In Proc. IEEE 4th International Conference on Intelligent System design and Application, pages 467-472, 2004.
79. E. P. Xing, A. Ng, M. I. Jordan, and S. J. Russell. Distance metric learning with application to clustering with side-information. In S. Becker, S. Thrun, and K. Obermayer, editors, Advances in Neural Information Processing Systems 15, (NIPS2002), pages 505-512. MIT Press, 2003.
80. N. Xiong and E. Frank. Generating linguistic fuzzy rules for pattern classification with genetic algorithms. In Principles and Practice of Knowledge Discovery in Databases (PKDD-99), volume 1704 of Lecture Notes in Computer Science, pages 574-579. Springer, 1999.
81. K. Zeger, J. Vaisey, and A. Gersho. Globally optimal vector quantizer design by stochastic relaxation. IEEE Transactions on Signal Processing, 40(2):310-322, 1992.