Comparison between two coevolutionary feature weighting algorithms in clustering

Pattern Recognition

Volumn 41, Issue 3, 2008, Pages 983-994

  Gancarski P ^a   Blansche A ^a   Wania, A ^b  

^a Faculté de Médecine   (France)

^b UNIVERSITÉ DE STRASBOURG   (France)

Author keywords

Complex data; Cooperative coevolution; Feature weighting; Modular clustering

Indexed keywords

CLUSTERING ALGORITHMS; COMPUTATIONAL COMPLEXITY; COST FUNCTIONS; EVOLUTIONARY ALGORITHMS; IMAGE CLASSIFICATION; KNOWLEDGE ENGINEERING;

COMPLEX DATA; COOPERATIVE COEVOLUTION; FEATURE WEIGHTING METHODS; MODULAR CLUSTERING;

FEATURE EXTRACTION;

EID: 35448929079     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2007.07.008     Document Type: Article

References (42)

1. Jain A.K., Murty M.N., and Flynn P.J. Data clustering: a review. ACM Comput. Surveys 31 3 (1999) 264-323
2. Xu R., and Wunsch D. Survey of clustering algorithms. IEEE Trans. Neural Networks 16 3 (2005) 645-678
3. Bellman R.E. Adaptive Control Processes (1961), Princeton University Press, Princeton, NJ
4. Gnanadesikan R., Kettenring J.R., and Tsao S.L. Weighting and selection of variables for cluster analysis. J. Classification 12 1 (1995) 113-136
5. Parsons L., Haque E., and Liu H. Subspace clustering for high dimensional data: a review. SIGKDD Explorations, Newsletter of the ACM Special Interest Group on Knowledge Discovery and Data Mining 6 1 (2004) 90-106
6. Friedman J.H., and Meulman J.J. Clustering objects on subsets of attributes. J. R. Statist. Soc. 66 4 (2004) 815-849
7. Domeniconi C., Gunopulos D., Ma S., Yan B., Al-Razgan1 M., and Papadopoulos D. Locally adaptive metrics for clustering high dimensional data. Data Mining and Knowledge Discovery 14 1 (2007) 63-97
8. Chan E.Y., Ching W.K., Ng M.K., and Huang J.Z. An optimization algorithm for clustering using weighted dissimilarity measures. Pattern Recognition 37 (2004) 943-952
9. Frigui H., and Nasraoui O. Unsupervised learning of prototypes and attribute weights. Pattern Recognition 34 (2004) 567-581
10. Huang J.Z., Ng M.K., Rong H., and Li Z. Automated variable weighting in k-means type clustering. IEEE Trans. Pattern Anal. Mach. Intell. 27 2 (2005) 657-668
11. Hall L.O., Ozyurt I.B., and Bezdek J.C. Clustering with a genetically optimized approach. IEEE Trans. Evol. Comput. 3 2 (1999) 103-112
12. Phanendra Babu G., and Narasimha Murty M. Clustering with evolution strategies. Pattern Recognition 27 2 (1994) 321-329
13. Krishna K., and Narasimha Murty M. Genetic k-means algorithm. IEEE Trans. Systems, Man Cybern. 29 3 (1999) 433-439
14. Blansché A., and Gançarski P. MACLAW: a modular approach for clustering with local attribute weighting. Pattern Recognition Lett. 27 11 (2006) 1299-1306
15. Handl J., and Knowles J. Feature subset selection in unsupervised learning via multiobjective optimization. Int. J. Comput. Intell. Res. 2 3 (2006) 217-238
16. Wettschereck D., Aha D.W., and Mohri T. A review and empirical evaluation of feature weighting methods for a class of lazy learning algorithms. Artif. Intell. Rev. 11 1-5 (1997) 273-314
17. Wettschereck D., and Aha D.W. Weighting features. In: Veloso M., and Aamodt A. (Eds). Case-Based Reasoning, Research and Development, First International Conference (1995), Springer, Berlin 347-358
18. Modha D., and Spangler S. Feature weighting in k-means clustering. Mach. Learn. 52 3 (2003) 217-237
19. Yeung D.S., and Wang X.Z. Improving performance of similarity-based clustering by feature weight learning. IEEE Trans. Pattern Anal. Mach. Intell. 24 (2002) 556-561
20. N. Howe, C. Cardie, Examining locally varying weights for nearest neighbor algorithms, in: ICCBR, 1997, pp. 455-466.
21. Goldberg D.E. Genetic Algorithms in Search, Optimization and Machine Learning (1989), Addison-Wesley, Longman Publishing Co., Inc., Reading, MA
22. Ross B.J. A Lamarckian evolution strategy for genetic algorithms. In: Chambers L.D. (Ed). Practical Handbook of Genetic Algorithms: Complex Coding Systems vol. 3 (1999), CRC Press, FL 1-16
23. D.E. Goldberg, S. Voessner, Optimizing global-local search hybrids, in: Proceedings of the Genetic and Evolutionary Computation Conference, 1999, pp. 220-228.
24. Potter M.A., and De Jong K.A. A cooperative coevolutionary approach to function optimization. Proceedings of the Third Conference on Parallel Problem Solving from Nature (1994), Springer, Berlin 249-257
25. C.H. Yong, R. Miikkulainen, Cooperative coevolution of multi-agent systems, Technical report, University of Texas at Austin Department of Computer Sciences, 2001.
26. M.A. Potter, K.A. De Jong, Evolving neural networks with collaborative species, in: Proceedings of the 1995 Summer Computer Simulation Conference, The Society of Computer Simulation, 1995, pp. 340-345.
27. Hervas-Martinez C., Garcia-Pedrajas N., and Munoz-Pèrez J. Multi-objective cooperative coevolution of artificial neural networks. Neural Networks 15 10 (2002) 1259-1278
28. Tan K.C., Yang Y.J., and Goh C.K. A distributed cooperative coevolutionary algorithm for multiobjective optimization. IEEE Trans. Evol. Comput. 10 5 (2006) 527-549
29. Delgadoa M.R., Von Zubenb F., and Gomide F. Coevolutionary genetic fuzzy systems: a hierarchical collaborative approach. Fuzzy Sets and Systems 141 (2004) 89-106
30. Jiao L., Liu J., and Zhong W. An organizational coevolutionary algorithm for classification. IEEE Trans. Evol. Comput. 10 1 (2006) 67-80
31. A. Blansché, P. Gançarski, J.J. Korczak, Genetic algorithms for feature weighting: evolution vs. coevolution and darwin vs. lamarck, in: Proceedings of the Fourth Mexican International Conference on AI, Monterrey, Mexique, Lecture Notes in Computer Science, vol. 3789, 2005, pp. 682-691.
32. Kittler J. On combining classifiers. IEEE Trans. Pattern Anal. Mach. Intell. 20 3 (1998) 226-239
33. MacQueen J.B. Some methods for classification and analysis of multivariate observations. Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability (1967), University of California Press, Berkeley, CA 281-297
34. Fisher D.H. Knowledge acquisition via incremental conceptual clustering. Mach. Learn. 2 (1987) 139-172
35. C.L. Blake, C.J. Merz, UCI repository of machine learning databases, 1998. 〈http://www.ics.uci.edu/∼mlearn/MLRepository.html〉.
36. Dempster A., Laird N., and Rubin D. Maximum likelihood from incomplete data via the EM algorithm. J. R. Statist. Soc., Ser. B 39 1 (1977) 1-38
37. Halkidi M., Batistakis Y., and Vazirgiannis M. On clustering validation techniques. J. Intell. Inform. Systems 17 2-3 (2001) 107-145
38. Wemmert C., Gançarski P., and Korczak J.J. A collaborative approach to combine multiple learning methods. Int. J. Artif. Intell. Tools 9 1 (2000) 59-78
39. S. Genaud, P. Gançarski, G. Latu, A. Blansché, C. Rattanapoka, D. Vouriot, Exploitation of a parallel clustering algorithm on commodity hardware with p2p-mpi. J. Supercomputing, 2007, doi: 10.1007/s11227-007-0136-2.
40. Congalton R.G. A review of assessing the accuracy of classifications of remotely sensed data. Remote Sensing Environ. 37 (1991) 35-46
41. V.S.N. Prasad, A.G. Faheema, S. Rakshit, Feature selection in example based image retrieval systems, in: ICVGIP 2002, 2002.
42. M. Dash, H. Liu, Feature selection for clustering, in: Proceedings of Pacific-Asia Conference on Knowledge Discovery and Data Mining (PAKDD), 2000.