Particle swarm classification: A survey and positioning

Pattern Recognition

Volumn 46, Issue 7, 2013, Pages 2028-2044

  Nouaouria, Nabila ^a   Boukadoum, Mounir ^a   Proulx, Robert ^b  

^a Department of Computer Science ^*  (Canada)

^b UNIVERSITÉ DU QUÉBEC À MONTRÉAL   (Canada)

Author keywords

Classification; High dimensional data sets; Mixed attribute data sets; Particle swarm optimization

Indexed keywords

ATTRIBUTE DATA; BENCHMARK DATASETS; CLASSIFICATION APPROACH; CLASSIFICATION TECHNIQUE; HIGH DIMENSIONAL DATA; HIGH-DIMENSIONAL; PROBLEM DESCRIPTION; PROBLEM DOMAIN;

ALGORITHMS; DATA MINING; PARTICLE SWARM OPTIMIZATION (PSO); SURVEYS;

CLASSIFICATION (OF INFORMATION);

EID: 84875248556     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2012.12.011     Document Type: Article

References (84)

1. R. Poli Analysis of the publications on the applications of particle swarm optimisation, Journal of Artificial Evolution and Applications 2008 2008 10.1155/2008/685175 Article ID 685175
2. A. Abraham, He Guo, and Hongbo Liu Swarm intelligence: foundations, perspectives and applications in: Studies in Computational Intelligence (SCI) 26 2006 Springer-Verlag Berlin/Heidelberg 3-25
3. J. Kennedy, and R. Eberhart 2001 Morgan Kaufmann
4. D. Merkle, and M. Middendorf Swarm intelligence E.G. Burke, Kendall Introductory Tutorials in Optimisation, Search and Decision Support Methodology 2005 Springer 401 435
5. J. Kennedy, R. Eberhart, Particle swarm optimization, in: Proceedings of the fourth IEEE International Conference on Neural Networks, Perth, Australia, 1995, pp. 1942-1948.
6. I. De Falco, A. Della Cioppa, and E. Tarontino Evaluation of Particle Swarm Optimization Effectiveness in Classification 2006 Springer-Verlag Berlin/Heidelberg LNAI3849, pp. 164-171
7. Y. Owechko, S. Medasani, N. Srinivasa, Classifier swarms for human detection in infrared imagery, in: Proceedings of the 2004, IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW'04), 2004.
8. M. O'Neill, A. Brabazon, Self-organizing swarm (SOSwarm): a particle swarm algorithm for unsupervised Learning, in: proceedings of IEEE Congress on Evolutionary Computation, July 16-21, Vancouver, BC, Canada, 2006, pp. 634-639.
9. I. De Falco, A. Della Cioppa, and E. Tarontino Facing classification problems with particle swarm optimization Applied Soft Computing 7 2007 652 658
10. N. Nouaouria, M. Boukadoum, Particle swarm classification for high dimensional data sets, in: Proceedings of 22th International IEEE Conference on Tools with Artificial Intelligence IEEE-ICTAI, 27-29 October 2010, vol. 1, Arras, France, 2010, pp. 87-93.
11. G.S. Tewolde, D.M. Hanna, Particle swarm optimization for classification of breast cancer data using single and multisurface methods of data separation, in: Proceedings of IEEE EIT, 2007, pp. 443-446.
12. M.G.H. Omran, A. Al-Sharhan, Barebones particle swarm methods for unsupervised image classification, in: Proceedings of IEEE Congress on Evolutionary Computation (CEC), September 2007, Singapore, 2007, pp. 3247-3252.
13. A. Cervantes, I. Galvan, P. Isasi, An adaptive Michigan Approach PSO for nearest prototype classification, in: J. Mira, J.R. Alvarez (Eds.), Proceedings of IWINAC, 2007, Part II, LNCS 4528, Springer-Verlag, Berlin/Heidelberg, 2007, pp. 287-296.
14. A. Cervantes, I. Galvan, and P. Isasi Michigan particle swarm optimization for prototype reduction in classification problems New Generation Computing 27 2009 239 257
15. A. Cervantes, I. Galvan, and P. Isasi AMPSO: a new particle swarm method for nearest neighborhood classification IEEE Transactions on Systems, Man, and Cybernetics - Part B: Cybernetics 39 5 2009
16. Chen Wei, Jun Sun, Yanrui Ding, Wei Fang, and Wenbo Xu Clustering of gene expression data with quantum-behaved particle swarm optimization N.T. Nguyen, IEA/AIE 2008 2008 Springer-Verlag Berlin/Heidelberg 388 396 LNAI 5027
17. Tsai Chi-Yang, and Szu-Wei Yeh A multiple objective particle swarm optimization approach for inventory classification International Journal of Production Economics 114 2008 656 666
18. Lee Ee Ng, Mei Kuan Lim, Tomás Maul, Weng Kin Lai, Investigations into particle swarm optimization for multi-class shape recognition, in: Proceedings of ICONIP 2008, M. Köppen et al. (Eds.): Part II, LNCS 5507, Springer-Verlag, Berlin/Heidelberg, 2008, pp. 599-606,.
19. Liu Ruochen, Xiaojuan Sun, LichengJiao, Particle swarm optimization based clustering: a comparison of different cluster validity indices, in: K. Li et al. (Eds.): Part II, CCIS 98, Proceedings of LSMS/ICSEE 2010, Berlin/Heidelberg, Springer-Verlag, 2010, pp. 66-72.
20. R. Killani, K. S. Rao, S. Satapathy, G. PradhanK. R. Chandran, Effective document clustering with particle swarm optimization, in: B.K. Panigrahi et al. (Eds.): LNCS 6466, Proceedings of SEMCCO 2010, Springer-Verlag, Berlin/Heidelberg: 2010, pp. 623-629.
21. S. Nebti, A. Boukerram, Handwritten digits recognition based on swarm optimization methods, in: F. Zavoral et al. (Eds.): Part I, CCIS 87, Proceedings of NDT 2010, Springer-Verlag, Berlin/Heidelberg, 2010, pp. 45-54.
22. K. Chandramouli, E. Izquierdo, Image classification using chaotic particle swarm optimization, in: Proceedings of International Conference on Image Processing (ICIP '06).
23. M.G.H. Omran, A.P. Engelbrecht, and A. Salman Dynamic clustering using particle swarm optimization with application in unsupervised image classification Enformatika Transactions on Engineering, Computing and Technology 1305-5313 9 2005 199 204
24. Gao1 Haichang, Boqin Feng, Yun Hou, Li Zhu, Training RBF neural network with hybrid particle swarm optimization, in: J. Wang et al. (Eds.): LNCS 3971, Proceedings of ISNN 2006 Springer-Verlag, Berlin/Heidelberg, 2006, pp. 577-583.
25. H. Ichihashi, K. Honda, A. Notsu, K. Ohta, Fuzzy c-means classifier with particle swarm optimization, in:Proceedings of IEEE International Conference on Fuzzy Systems (FUZZ 2008), 2008, pp. 207-215.
26. F. Melgani, and Y. Bazi Classification of electrocardiogram signals with support vector machines and particle swarm optimization IEEE Transactions on Information Technology in Biomedicine 12 5 2008 667 677
27. Hung Chih-Cheng, and Hendri Purnawan A hybrid rough k-means algorithm and particle swarm optimization for image classification A. Gelbukh, E.F. Morales, in: Proceedings of MICAI 2008 Springer-Verlag Berlin/Heidelberg 585 593 LNAI 5317
28. C.R. Hema, M.P. Paulraj, S. Yaacob, A.H. Adom, R. Nagarajan, Particle swarm optimization neural network based classification of mental tasks, in: N.A. Abu Osman, F. Ibrahim, W.A.B. Wan Abas, H.S. Abd Rahman, H.N. Ting (Eds.): 21, Biomed 2008 Proceedings, Springer-Verlag 2008, Berlin/Heidelberg, pp. 883-888.
29. B. Biswal, P.K. Dash, and B.K. Panigrahi Power quality disturbance classification using fuzzy c-means algorithm and adaptive particle swarm optimization IEEE Transactions on Industrial Electronics 56 1 2009
30. B. Dehuri, S. Mishra, and S.B. Cho M. Köppen, A notable swarm approach to evolve neural networkfor classification in data mining, in: Proceedings of ICONIP 2008 Springer-Verlag Berlin/Heidelberg 1121 1128 Part I, LNCS 5506
31. J.E. Fieldsend Optimizing decision trees using multi-objective particle swarm optimization C.A. Coello Coello, Swarm Intelligence for Multi-objective Prob., SCI 242 2009 Springer-Verlag Berlin/Heidelberg 93 114
32. H. Nuzly, N. Kasabov, Z. Michlovsky, and S.M. Shamsuddin String pattern recognition using evolving spiking neural networks and quantum inspired particle swarm optimization C.S. Leung, M. Lee, J.H. Chan, in: Proceedings of ICONIP 2009 Springer-Verlag Berlin/Heidelberg 611 619 Part II, LNCS 5864
33. A.B.S. Serapiao, and J.R.P. Mendes Classification of petroleum well drilling operations with a hybrid particle swarm/ant colony algorithm B.C. Chien, in: Proceedings of IEA/AIE 2009 Springer-Verlag Berlin/Heidelberg 301 310 LNAI 5579
34. Cui Yu, Fei Han, and Shiguang Ju Gene selection and PSO-BP classifier encoding a prior information Y. Tan, Y. Shi, K.C. Tan, in: Proceedings of ICSI 2010 Springer-Verlag Berlin/Heidelberg 335 342 Part II, LNCS 6146
35. J. Dheeb, and T. Selvi Bio inspired swarm algorithm for tumor detection in digital mammogram B.K. Panigrahi, in: Proceedings of SEMCCO 2010 Springer-Verlag Berlin/Heidelberg 404 415 LNCS 6466, pp.
36. F. Al Obeidat, N. Belacel, J.A. Carretero, and P. Mahanti Automatic parameter settings for the proaftn classifier using hybrid particle swarm optimization A. Farzindar, V. Keselj, in: Proceedings of Canadian AI 2010 Springer-Verlag Berlin/Heidelberg 184 195 LNAI 6085, pp.
37. R. Kohavi, and J.H. George The wrapper approach Liu Huan, Motoda Hiroshi, Feature Extraction, Construction and Selection: A Data Mining Perspective 1998 Kluwer Academic Publishers 0792381963
38. J. Fan, and Y. Fan High-dimensional classification using features annealed independence rules Annals of Statistics 36 6 2008 2605 2637
39. I.K. Fodor, A Survey of Dimension Reduction Techniques, Technical Report UCRL-ID-148494, Lawrence Livermore Nat'l Laboratory, Center for Applied Scientific Computing, 2002.
40. H. Liu, A. Abraham, and W. Zhang A fuzzy adaptive turbulent particle swarm optimization International Journal of Innovative Computing and Applications Archive 1 1 2007
41. L.S. Coelho, and V. Mariani A novel chaotic particle swarm optimization approach using Hénon map and implicit filtering local search for economic load dispatch Chaos, Solitons and Fractals 39 2009 510 518
42. Jun-Jie Xue Wang, Sheng Ma, and Dao-Wei Bi Wang Distributed particle swarm optimization and simulated annealing for energy-efficient coverage in wireless sensor networks Sensors 1424-8220 7 2007 628 648
43. V.M. Saffarzadeh, P. Jafarzadeh, and M. Mazloom A hybrid approach using particle swarm optimization and simulated annealing for n-queen problem Journal of World Academy of Science, Engineering and Technology 67 2010 974 978
44. M. Kessentini, H. Sahraoui, M. Boukadoum, and O. Ben Omar Search-based model transformation by example Journal of Software and System Modeling Special issue on Models 2008 1 18
45. M. Clerc L'optimisation par Essaim Particulaire: Versions Paramétriques et Adaptatives 2005 Hermes Science Publications Lavoisier, Paris
46. N. Nouaouria, M. Boukadoum, A particle swarm optimization approach to mixed attribute data-set classification, in: Proceedings of IEEE Symposium on Swarm Intelligence, 978-1-61284-052-9, Paris, France, 2011, pp. 44-51.
47. J. Kennedy, R. Eberhart, A discrete binary version of the particle swarm algorithm, in: IEEE Conference on Systems, Man, and Cybernetics, vol. 5 (1997), pp. 4104-4108.
48. B. Al kazemi. C.K. Mohan, Multi-phase discrete particle swarm optimization, in: Fourth International Workshop on Frontiers in Evolutionary Algorithms, Kinsale, Ireland, 2002.
49. S. Yang, M. Wang, L. Jiao, A quantum particle swarm optimization, in: Proceedings of CEC 2004, the Congress on Evolutionary Computing, vol. 1, 2004, pp. 320-324.
50. G. Pampara, N. Franken. A.P. Engelbrecht, Combining particle swarm optimisation with angle modulation to solve binary problems, in: Proceedings of the IEEE Congress on Evolutionary Computing, vol. 1, 2005, pp. 89-96.
51. H.A. Hassan, I.M. Yassin, A.K. Halim, A. Zabidi, Z.A. Majid, H.Z., Abidin, Logical effort using a novel discrete particle swarm optimization algorithm, in: Proceedings of Fifth International Colloquium on Signal Processing & its Applications (CSPA), 2009, 978-1-4244-4152-5/09.
52. J. Pugh, A. Martinoli, Discrete multi-valued particle swarm optimization, in: Proceedings of IEEE Swarm Intelligence Symposium, vol. 1, 2006, pp. 103-110.
53. J.A. Moreno-Pérez, J.P. Castro-Gutiérrez, F.J. Martinez-Garcia, B. Melian, J.M. Moreno-Vega, J. Ramos, Discrete particle swarm optimization for the p-median problem, in: Proceedings of the Seventh Metaheuristics International Conference, Montréal, Canada, 2007.
54. S. Consoli, J.A. Moreno-Perez, K. Darby-Dowman, N. Mladenovic, Discrete particle swarm optimization for the minimum labelling Steiner tree problem, Natural Computing, 10.1007/s11047-009-9137-9, 2009.
55. N. Nouaouria, M. Boukadoum, A particle swarm optimization approach for case retrieval stage, in: M. Bramer, M. Petridis, A. Hopgood (Eds.), Research and Development in Intelligent Systems XXVII Proceedings of AI-2010, The Thirtieth SGAI International Conference on Innovative Techniques and Applications of Artificial Intelligence, 14-16 December 2010, Cambridge United Kingdom, 2010, pp. 209-222.
56. N. Nouaouria, and M. Boukadoum Improved global-best particle swarm optimization algorithm with mixed-attribute data classification capability, Applied Soft Computing, Manuscript ID: ASOC-D 2012 12-00385
57. A. Asuncion, D.J. Newman, UCI Machine Learning Repository 〈http://www.ics.uci.edu/∼mlearn/MLRepository.html〉. Irvine, CA: University of California, School of Information and Computer Science, 2007.
58. H. Naoum, M. Boukadoum, C. Joseph, D. Starikov, A. Bensaoula, Intelligent classifier module for fluorescence based measurements, in: Proceedings of International Workshop on Signal Processing and its Applications (WoSPA2008), 18-20 March 2008, Sharjah, UAE, 2008.
59. P.W. Frey, and D.J. Slate Letter recognition using Holland-style adaptive classifiers Machine Learning 6 1991 #2
60. A.M. Bagirov, J. Ugon, D. Webb, An incremental approach for the construction of a piecewise linear classifier, in: Proceedings of The XIII International Conference Applied Stochastic Models and Data Analysis (ASMDA-2009), June 30-July 3, 2009, Vilnius, LITHUANIA, 2009, pp. 507-511.
61. A. Astorino, and M. Gaudioso Polyhedral separability through successive LP Journal of Optimization Theory and Applications 112 2 2000 265 293
62. E. Alpaydin, and C. Kaynak Cascading classifiers Kybernetika 34 4 1998 369 374
63. E. Cant-Paz, C. Kamath, Using Evolutionary Algorithms to Induce Oblique Decision Trees, Technical Report UCRL-JC-137202, Center for Applied Scientific Computing Lawrence Livermore National Laboratory, 2000.
64. A. Demiriz, K.P. Bennett, and J. Shawe-Taylor Linear programming boosting via column generation, Machine Learning 46 2002 225-254
65. R. Kohavi, Scaling up the accuracy of Naive-Bayes classifiers: a decision-tree Hybrid, in: E. Simoudis, J. Han, U. Fayyad (Eds.): Proceedings of the Second International Conference on Knowledge Discovery and Data Mining, KDD, AAAI Press, 1996, pp. 202-207.
66. R. Kohavi, B. Becker, D. Sommerfield, Improving simple Bayes, in: M. van Someren, G. Widmer, (Eds.), Proceedings of the Nineth European Conference on Machine Learning, Springer-Verlag, Heidelberg, 1997, pp. 78-87.
67. J. Cheng, R. Greiner, Learning Bayesian belief network classifiers: algorithms and system, in: Proceedings of the 14th Biennial Conference of the Canadian Society on Computational Studies of Intelligence: Advances in Artificial Intelligence, 2001, pp. 141-151.
68. L. Hoegaerts, J. Suykens, J. Vandewalle, B. De Moor, Primal space sparse kernel partial least squares regression for large scale problems, in: IEEE Proceedings of the International Joint Conference on Neural Networks (IJCNN'2004), pp. 561-566.
69. Kai-Min Chung Kao Wei-Chun, L. Assun, and Chih-Jen Lin Decomposition methods for linear support vector machines Neural Computation 16 8 2004 1689 1704
70. H. Abbasian, C. Drummond, N. Japkowicz, and S. Matwin Robustness of classifiers to changing environments Advances in Artificial Intelligence Lecture Notes in Computer Science 6085/2010 2010 232 243 10.1007/978-3-642-13059-5-23
71. T.-S. Lim, W.-Y. Loh, and Y.-S. Shih A comparison of prediction accuracy, complexity, and training time of thirty-three old and new classification algorithms Machine Learning 40 2000 203 228
72. Bose Kooperberg Stone, polychotomous regression Journal of American Statistical Association 92 1997 117 127
73. W.Y. Loh, and Y.S. Shih Split selection methods for classification trees Statistica Sinica 7 1997 815 840
74. K.J. Cios, and L.A. Kurgan CLIP4: Hybrid inductive machine learning algorithm that generates inequality rules Information Sciences Journal 163 2004 2004 37 83
75. M. Rochas, P. Cortez, and J. Nevez Evolutionary neural network learning algorithms for changing environments WSEAS Transactions on Systems 1109-2777 3 2 2004 596 601
76. J. Bacardit, M.V. Butz, Data Mining in Learning Classifier Systems: Comparing XCS with GAssist, in: Learning Classifier Systems, Lecture Notes in Computer Science, 2007, 4399/2007, 282-290, 10.1007/978-3-540-71231-2-19.
77. S. Ray, D. Page, Generalized skewing for functions with continuous and nominal attributes, in: Proceedings of the 22nd International Conference on Machine Learning, Bonn, Germany, 2005.
78. L. Uysal, and H.Altay Gu Instance-based regression by partitioning feature projections Applied Intelligence Journal 21 2004 57-79
79. L. Uysal, and H.A. Guvenir An overview of regression techniques for knowledge discovery Knowledge Engineering Review 14 1999 1 22
80. K.M. Ting, and I.H. Witten Issues in stacked generalization Journal of Artificial Intelligence Research 10 1999 271 289
81. E. Snelson, C.E. Rasmussen, Z. Ghahramani, Warped Gaussian Processes, in: Advances in Neural Information Processing Systems 16 (NIPS-2003). MIT Press, Cambridge, MA, 2003.
82. C.E. Rasmussen, and C.K.I. Williams Gaussian Processes for Machine Learning 2006 MIT Press ISBN-10 0-262-18253-X, ISBN-13 978-0-262-18253-9
83. A.P. Engelbrecht Computational Intelligence: An Introduction 2007 John Willey & Sons Editions
84. R. Horst, and H. Tuy Global optimization: deterministic approaches third ed. 2003 Springer Berlin Revised and Enlarged Edition