A novel ant-based clustering algorithm using Renyi entropy

Applied Soft Computing Journal

Volumn 13, Issue 5, 2013, Pages 2643-2657

  Zhang, Lei ^a   Cao, Qixin ^a   Lee, Jay ^b  

^a SHANGHAI JIAO TONG UNIVERSITY   (China)

^b UNIVERSITY OF CINCINNATI   (United States)

Author keywords

Ant based clustering; Kernel; Renyi entropy; Swarm intelligence; The Friedman test

Indexed keywords

CODES (SYMBOLS); EFFICIENCY; PARAMETER ESTIMATION; SWARM INTELLIGENCE;

ANT-BASED CLUSTERING; ANT-BASED CLUSTERING ALGORITHM; BENCHMARK DATASETS; FRIEDMAN TEST; KERNEL; LINEARLY SEPARABLE; LOCAL NEIGHBORHOODS; RENYI ENTROPY;

CLUSTERING ALGORITHMS;

EID: 84885675910     PISSN: 15684946     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.asoc.2012.11.022     Document Type: Article

References (56)

1. J. Kennedy, R. Eberhart, Particle swarm optimization, Proceedings of IEEE International Conference on Neural Networks (1995) 1942-1948.
2. J. Kennedy, R. Eberhart, A discrete binary version of the particle swarm algorithm, IEEE Iternational Conference on Computational Cybernetics and Simulation 5 (1997) 4104-4108.
3. M. Dorigo, V. Maniezzo, A. Colorni, The ant system: optimization by a colony of cooperating agents, IEEE Transactions on Systems, Man, and Cybernetics - Part B 26 (1) (1996) 1-13.
4. M. Dorigo, L.M. Gambardella, Ant colony system: a cooperative learning approach to the traveling salesman problem, IEEE Transactions on Evolutionary Computation 1 (1) (1997) 53-66. (Pubitemid 127771018)
5. L.F. Giraldo, F. Lozano, N. Quijano, Foraging theory for dimensionality reduction of clustered data, Machine Learning 82 (1) (2011) 71-90.
6. C. Grosan, A. Abraham, M. Chis, Swarm Intelligence in Data Mining, vol. 34, Studies in Computational Intelligence, Springer, 2006, pp. 1-20.
7. D. Martens, B. Baesens, T. Fawcett, Editorial survey: swarm intelligence for data mining, Machine Learning 82 (2011) 1-42.
8. Z.X. Huang, Extensions to the k-means algorithms for clustering large data sets with categorical values, Data mining and Knowledge Discovery 2 (1998) 283-304.
9. T. Kanungo, D.M. Mount, N.S. Netanyahu, An efficient k-means clustering algorithm: analysis and implementation, IEEE Transactions on Pattern Analysis and Machine Intelligence 24 (7) (2002) 881-892. (Pubitemid 34835464)
10. T. Zhang, L.M. Ramakrishna, BRICH: an efficient data clustering method for very large databases, in: ACM SIGMOD International Conference on Management of Data, ACM Press, New York, 1996, pp. 103-114. (Pubitemid 126440760)
11. R.M. Aliguliyev, Performance evaluation of density-based clustering methods, Information Sciences 179 (2009) 3583-3602.
12. L. Duan, L. Xu, F. Guo, A local-density based spatial clustering algorithm with noise, Information Systems 32 (2007) 978-986. (Pubitemid 47017576)
13. S.H. Yue, M.M. Wei, J.S. Wang, A general grid-clustering approach, Pattern Recognition Letters 29 (9) (2008) 1372-1384.
14. D. Brugger, M. Bogdan, W. Rosenstiel, Automatic clustering detection in Kohonen's SOM, IEEE Transactions on Neural Networks 19 (3) (2008) 442-459. (Pubitemid 351411570)
15. S.K. Rangarajan, V.V. Phoha, K.S. Balagani, Adaptive neural network clustering of Web users, Computer37 (4) (2004)34-40.
16. P.S. Shelokar, V.K. Jayaraman, B.D. Kulkarni, An ant colony approach for clustering, AnalyticaChimica Acta 509 (2004) 187-195. (Pubitemid 38344155)
17. L. Chen, L. Tu, H.J. Chen, A novel ant clustering algorithm with digraph Lecture Notes in Computer Science, vol. 3611, Springer, Berlin, Heidelberg, 2005, pp. 1218-1228. (Pubitemid 41449880)
18. S. Ghosh, M. Kothari, A. Halder, A. Ghosh, Use of aggregation pheromone density for image segmentation, Pattern Recognition Letters 30 (2009) 939-949.
19. D. Marco, B. Eric, T. Guy, Ant algorithms and stigmergy, Future Generation Computer System 16 (2000) 851-871.
20. J.L. Deneubourg, S. Goss, N. Frank, The dynamics of collective sorting: robotlike ants and ant-like robots, in: Proceedings of 1st International Conference on Simulation of Adaptive Behavior: From Animals to Animats, MIT Press/Bradford Books, Cambridge, MA, 1991, pp. 356-363.
21. E. Lumer, B. Faieta, Diversity and adaptation in populations of clustering ants, in: 3rd Interantional Conference on Simulation of Adaptive Behavior: From Animals to Animats, MIT Press/Bradford Books, Cambridge, MA, 1994, pp. 501-508.
22. B. Wu, Y. Zheng, S. Liu, Z.Z. Shi, CSIW: a document clustering algorithm based on swarm intelligence, vol. 1, in: Proceeding of the 2002 Congress on Evolutionary Computation, Honolulu, HI, USA, 2002, pp. 477-482.
23. V. Ramos, J.J. Merelo, Self-organized stigmergic document maps: environment as a mechanism for context learning, in: 1st Spanish Conference on Evolutionary and Bio-Inspired Algorithms, Centro Uni. De Merida, Spain, 2002, pp. 284-293.
24. Y. Yang, M. Kamel, F. Jin, Topic discovery from document using ant-based clustering combination Lecture Notes in Computer Science, vol. 3399, Springer Berlin, Heidelberg, 2005, pp. 100-108. (Pubitemid 41241432)
25. Y. Yang, M. Kamel, An aggregated clustering approach using multi-ant colonies algorithms, Pattern Recognition 39 (2006) 1278-1289.
26. J. Handl, B. Meyer, Improved ant-based clustering and sorting in document retrieval interface Lecture Notes in Computer Science, vol. 2439, Springer Berlin, Heidelberg, 2002, pp. 913-923.
27. J. Handl, J. Knowles, M. Dorigo, Ant-based clustering: a comparative study of its relative performance with respect to k-means, average link and 1D-SOM. Technical Report TR/IRIDIA/2003-24, IRIDIA, University Libre de Bruxelles, Belgium, 2003.
28. J. Handl, J. Knowles, M. Dorigo, Strategies for the increased robustness of ant-based clustering, Lecture Notes in Artificial Intelligence, vol. 2977, Springer-Verlag, Berlin Heidelberg, 2004, pp. 90-104.
29. J. Handl, J. Knowles, M. Dorigo, Ant-based clustering and topographic mapping, Artificial Life 12 (1) (2004) 1-36.
30. J. Handl, B. Meyer, Ant-based and swarm-based clustering, Swarm Intelligence 1 (2) (2007) 95-113.
31. CH. Tsang, S. Kwong, Ant colony clustering and feature extraction for anomaly intrusion detection Studies in Computing Intelligence, vol. 3, Springer Berlin, Heidelberg, 2006, pp. 101-123.
32. X.H. Xu, L. Chen, Y.X. Chen, A4C: an adaptive artificial ants clustering algorithm, in: IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology, 2004, pp. 268-274.
33. N. Monmarche, M. Slimane, G. Venturini, AntClass: discovery of clusters in numeric data by a hybridization of an ant colony with the k-means algorithm. Internal Report No. 213 [Online] Available from: http://www.antsearch.univ- tours.fr/public/MonSliVen99b.pdf (1999).
34. H. Jiang, S. Yi, J. Li, F. Yang, X. Hu, Ant clustering algorithm with K-harmonic means clustering, Expert Systems with Applications 37(12) (2010) 8679-8684.
35. Z. Yu, O.C. Au, R. Zou, W. Yu, J. Tian, An adaptive unsupervised approach toward pixel clustering and color image segmentation, Pattern Recognition 43 (2010) 1889-1906.
36. E. Lefever, T. Fayruzov, V. Hoste, M. De Cock, Clustering web people search results using fuzzy ants, Information Sciences 180 (2010)3192-3209.
37. T. Niknam, B. Amiri, An efficient hybrid approach based on PSO, ACO and k-means for cluster analysis, Applied Soft Computing 10 (2010) 183-197.
38. B. Liu, J.H. Pan, R.I. McKay, Entropy-based metrics in swarm clustering, International Journal of Intelligent Systems 24(2009) 989-1011.
39. U. Boryczka, Finding groups in data: cluster analysis with ants, Applied Soft Computing 9 (2009) 61-70.
40. G. Erhan, J.C. Principe, Information theoretic clustering, IEEE Transactions on Pattern Analysis 24 (2) (2002) 158-171. (Pubitemid 34198206)
41. R. Jenssen, K.E. Hild I.I., D. Erdogmus, et al., Clustering using Renyi's entropy, International Joint Conference on Neural Networks 1 (2003) 523-528.
42. A. Renyi, On measure of entropy and information, in Fourth Berkeley Symposium on Mathematical Statistics and Probability (1960) 547-561.
43. J.C. Principe, D.X. Xu, J.W. Fisher, Information theoretic learning, in: S. Haykin (Ed.), Unsupervised Adaptive Filtering, John Wiley & Sons, New York, 2000, pp. 1-62.
44. G. Erhan, J.C. Principe, A new clustering evaluation function using Renyi's information potential, in: International Conference on Acoustics, Speech, and Signal Processing, 2000, pp. 3491-3493.
45. I.T. Jolliffe, Principal Component Analysis, Springer Verlag, 1986.
46. B. Scholkopf, A. Smola, K.R. Muller, Nonlinear component analysis as a kernel eigenvalue problem, Neural Computing 10 (5) (1998) 1299-1319. (Pubitemid 128463674)
47. R. Jenssen, Kernel entropy component analysis, IEEE Transactions on Pattern Analysis and Machine Intelligence 32 (5) (2010) 847-860.
48. L. Zhang, Q.X. Cao, J. Lee, A modified clustering algorithm based on swarm intelligence, in: The First International Conference on Natural Computation, vol. 3, Changsha, China, 2005, pp. 535-542. (Pubitemid 41449616)
49. L. Zhang, Q.X. Cao, A novel ant-based clustering algorithm using the kernel method, Information Sciences 118 (20) (2011) 4658-4672.
50. M. Girolami, Mercer kernel-based clustering in feature space, IEEE Transactions on Neural Networks 13 (2) (2002) 780-784. (Pubitemid 34669666)
51. R. Jenssen, T. Eltoft, A new information theoretic analysis of sum-of-squared-error kernel clustering, Neurocomputing 72 (2008) 23-31.
52. .
53. .
54. M. Filippone, F. Camastra, F. Masulli, S. Rovetta, A survey of kernel and spectral methods for clustering, Pattern Recognition 41 (1) (2008) 176-190. (Pubitemid 47284212)
55. J. Demsar, Statistical comparisons of classifiers over multiple data sets, Journal of Machine Learning Research 7 (2006) 1-30. (Pubitemid 43022939)
56. R.L. Iman, J.M. Davenport, Approximations of the critical region of the Friedman statistic, Communications in Statistics (1980) 571-595.