A competitive swarm optimizer for large scale optimization

IEEE Transactions on Cybernetics

Volumn 45, Issue 2, 2015, Pages 191-204

  Cheng, Ran ^a   Jin, Yaochu ^a  

^a UNIVERSITY OF SURREY   (United Kingdom)

Author keywords

Competition; competitive swarm optimizer; convergence analysis; large scale optimization; learning; particle swarm optimization

Indexed keywords

COMPETITION; PARTICLE SWARM OPTIMIZATION (PSO);

COMPETITION MECHANISM; CONVERGENCE ANALYSIS; EXPLORATION AND EXPLOITATION; GLOBAL BEST POSITIONS; LARGE-SCALE OPTIMIZATION; LEARNING; META HEURISTIC ALGORITHM; SWARM OPTIMIZER;

OPTIMIZATION;

EID: 85028143019     PISSN: 21682267     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCYB.2014.2322602     Document Type: Article

References (65)

1. J. Kennedy, Swarm Intelligence. Seacaucus, NJ, USA: Springer, 2006.
2. J. Kennedy and R. Eberhart, "Particle swarm optimization," in Proc. IEEE Int. Conf. Neural Netw., vol. 4. Perth, WA, USA, 1995, pp. 1942-1948.
3. Y. Shi and R. Eberhart, "A modified particle swarm optimizer," in Proc. IEEE Int. Conf. Evol. Comput., Anchorage, AK, USA, 1998, pp. 69-73.
4. R. Eberhart and J. Kennedy, "A new optimizer using particle swarm theory," in Proc. Int. Symp. MHS, Nagoya, Japan, 1995, pp. 39-43.
5. J. Kennedy, "The particle swarm: Social adaptation of knowledge," in Proc. IEEE Int. Conf. Evol. Comput., Indianapolis, IN, USA, 1997, pp. 303-308.
6. I. Montalvo, J. Izquierdo, R. Pérez, and P. L. Iglesias, "A diversityenriched variant of discrete PSO applied to the design of water distribution networks," Eng. Optim., vol. 40, no. 7, pp. 655-668, 2008.
7. A. Alfi and M.-M. Fateh, "Parameter identification based on a modified PSO applied to suspension system," J. Softw. Eng. Appl., vol. 3, no. 3, pp. 221-229, 2010.
8. Y.-J. Gong et al., "An efficient resource allocation scheme using particle swarm optimization," IEEE Trans. Evol. Comput., vol. 16, no. 6, pp. 801-816, Dec. 2012.
9. S.-Y. Ho, H.-S. Lin, W.-H. Liauh, and S.-J. Ho, "OPSO: Orthogonal particle swarm optimization and its application to task assignment problems," IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 38, no. 2, pp. 288-298, Mar. 2008.
10. Z. Zhu, J. Zhou, Z. Ji, and Y.-H. Shi, "DNA sequence compression using adaptive particle swarm optimization-based memetic algorithm," IEEE Trans. Evol. Comput., vol. 15, no. 5, pp. 643-658, Oct. 2011.
11. R. C. Eberhart and Y. Shi, "Particle swarm optimization: Developments, applications and resources," in Proc. IEEE Congr. Evol. Comput., vol. 1. Seoul, South Korea, 2001, pp. 81-86.
12. Y. Yang and J. O. Pedersen, "A comparative study on feature selection in text categorization," in Proc. ICML, San Francisco, CA, USA, 1997, pp. 412-420.
13. W.-N. Chen, J. Zhang, Y. Lin, and E. Chen, "Particle swarm optimization with an aging leader and challengers," IEEE Trans. Evol. Comput., vol. 17, no. 2, pp. 241-258, Apr. 2013.
14. Y. Shi and R. C. Eberhart, "Parameter selection in particle swarm optimization," in Evolutionary Programming VII. Berlin, Germany: Springer, 1998, pp. 591-600.
15. Y. Shi and R. C. Eberhart, "Empirical study of particle swarm optimization," in Proc. IEEE Congr. Evol. Comput., Washington, DC, USA, 1999, pp. 1945-1950.
16. Y. Shi and R. C. Eberhart, "Fuzzy adaptive particle swarm optimization," in Proc. IEEE Congr. Evol. Comput., vol. 1. Seoul, South Korea, 2001, pp. 101-106.
17. A. Ratnaweera, S. K. Halgamuge, and H. C. Watson, "Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients," IEEE Trans. Evol. Comput., vol. 8, no. 3, pp. 240-255, Jun. 2004.
18. R. Cheng and M. Yao, "Particle swarm optimizer with time-varying parameters based on a novel operator," Appl. Math. Inf. Sci., vol. 5, no. 2, pp. 33-38, 2011.
19. M. Hu, T. Wu, and J. D. Weir, "An adaptive particle swarm optimization with multiple adaptive methods," IEEE Trans. Evol. Comput., vol. 17, no. 5, pp. 705-720, Oct. 2013.
20. P. N. Suganthan, "Particle swarm optimiser with neighbourhood operator," in Proc. IEEE Congr. Evol. Comput., vol. 3. Washington, DC, USA, 1999, pp. 1958-1962.
21. J. Kennedy, "Small worlds and mega-minds: Effects of neighborhood topology on particle swarm performance," in Proc. IEEE Congr. Evol. Comput., vol. 3. Washington, DC, USA, 1999, pp. 1931-1938.
22. J. Kennedy and R. Mendes, "Population structure and particle swarm performance," in Proc. IEEE Congr. Evol. Comput., vol. 2. Honolulu, HI, USA, 2002, pp. 1671-1676.
23. R. Mendes, J. Kennedy, and J. Neves, "The fully informed particle swarm: Simpler, maybe better," IEEE Trans. Evol. Comput., vol. 8, no. 3, pp. 204-210, Jun. 2004.
24. J. J. Liang, A. Qin, P. N. Suganthan, and S. Baskar, "Comprehensive learning particle swarm optimizer for global optimization of multimodal functions," IEEE Trans. Evol. Comput., vol. 10, no. 3, pp. 281-295, Jun. 2006.
25. B. Qu, P. Suganthan, and S. Das, "A distance-based locally informed particle swarm model for multimodal optimization," IEEE Trans. Evol. Comput., vol. 17, no. 3, pp. 387-402, Jun. 2013.
26. J. Robinson, S. Sinton, and Y. Rahmat-Samii, "Particle swarm, genetic algorithm, and their hybrids: Optimization of a profiled corrugated horn antenna," in Proc. IEEE Antennas Propag. Soc. Int. Symp., vol. 1. 2002, pp. 314-317.
27. C.-F. Juang, "A hybrid of genetic algorithm and particle swarm optimization for recurrent network design," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 34, no. 2, pp. 997-1006, Apr. 2004.
28. N. Holden and A. A. Freitas, "A hybrid particle swarm/ant colony algorithm for the classification of hierarchical biological data," in Proc. IEEE SIS, 2005, pp. 100-107.
29. P. Shelokar, P. Siarry, V. K. Jayaraman, and B. D. Kulkarni, "Particle swarm and ant colony algorithms hybridized for improved continuous optimization," Appl. Math. Comput., vol. 188, no. 1, pp. 129-142, 2007.
30. J. Liang and P. Suganthan, "Dynamic multi-swarm particle swarm optimizer," in Proc. IEEE SIS, 2005, pp. 124-129.
31. Z.-H. Zhan, J. Zhang, Y. Li, and H.-H. Chung, "Adaptive particle swarm optimization," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 39, no. 6, pp. 1362-1381, Dec. 2009.
32. R. Brits, A. P. Engelbrecht, and F. van den Bergh, "Locating multiple optima using particle swarm optimization," Appl. Math. Comput., vol. 189, no. 2, pp. 1859-1883, 2007.
33. M. Daneshyari and G. G. Yen, "Cultural-based multiobjective particle swarm optimization," IEEE Trans. Cybern., vol. 41, no. 2, pp. 553-567, Apr. 2011.
34. N. Higashi and H. Iba, "Particle swarm optimization with Gaussian mutation," in Proc. IEEE SIS, 2003, pp. 72-79.
35. B. Liu, L.Wang, Y.-H. Jin, F. Tang, and D.-X. Huang, "Improved particle swarm optimization combined with chaos," Chaos, Solitons, Fractals, vol. 25, no. 5, pp. 1261-1271, 2005.
36. Z.-H. Zhan, J. Zhang, Y. Li, and Y.-H. Shi, "Orthogonal learning particle swarm optimization," IEEE Trans. Evol. Comput., vol. 15, no. 6, pp. 832-847, Dec. 2011.
37. H. Gao and W. Xu, "A new particle swarm algorithm and its globally convergent modifications," IEEE Trans. Cybern., vol. 41, no. 5, pp. 1334-1351, Oct. 2011.
38. Y. V. Pehlivanoglu, "A new particle swarm optimization method enhanced with a periodic mutation strategy and neural networks," IEEE Trans. Evol. Comput., vol. 17, no. 3, pp. 436-452, Jun. 2013.
39. F. van den Bergh and A. P. Engelbrecht, "A cooperative approach to particle swarm optimization," IEEE Trans. Evol. Comput., vol. 8, no. 3, pp. 225-239, Jun. 2004.
40. S. Baskar and P. N. Suganthan, "A novel concurrent particle swarm optimization," in Proc. IEEE Congr. Evol. Comput., vol. 1. 2004, pp. 792-796.
41. G. G. Yen and M. Daneshyari, "Diversity-based information exchange among multiple swarms in particle swarm optimization," Int. J. Comput. Intell. Appl., vol. 7, no. 1, pp. 57-75, 2008.
42. R. Cheng, C. Sun, and Y. Jin, "A multi-swarm evolutionary framework based on a feedback mechanism," in Proc. IEEE Congr. Evol. Comput., Cancun, Mexico, 2013, pp. 718-724.
43. K. Tang et al., "Benchmark functions for the CEC'2008 special session and competition on large scale global optimization," Nat. Inspired Comput. Appl. Lab., USTC, Hefei, China, Tech. Rep., 2007.
44. Y. Jin and B. Sendhoff, "Fitness approximation in evolutionary computation-A survey," in Proc. GECCO, 2002, pp. 1105-1112.
45. D. Lim, Y. Jin, Y.-S. Ong, and B. Sendhoff, "Generalizing surrogateassisted evolutionary computation," IEEE Trans. Evol. Comput., vol. 14, no. 3, pp. 329-355, Jun. 2010.
46. M. Dorigo and C. Blum, "Ant colony optimization theory: A survey," Theor. Comput. Sci., vol. 344, no. 2, pp. 243-278, 2005.
47. D. Karaboga and B. Akay, "A survey: Algorithms simulating bee swarm intelligence," Artif. Intell. Rev., vol. 31, nos. 1-4, pp. 61-85, 2009.
48. R. Storn and K. Price, "Differential evolution-A simple and efficient heuristic for global optimization over continuous spaces," J. Global Optim., vol. 11, no. 4, pp. 341-359, 1997.
49. M. Clerc and J. Kennedy, "The particle swarm-explosion, stability, and convergence in a multidimensional complex space," IEEE Trans. Evol. Comput., vol. 6, no. 1, pp. 58-73, Feb. 2002.
50. I. C. Trelea, "The particle swarm optimization algorithm: Convergence analysis and parameter selection," Inf. Process. Lett., vol. 85, no. 6, pp. 317-325, 2003.
51. J. L. Fernandez-Martinez and E. Garcia-Gonzalo, "Stochastic stability analysis of the linear continuous and discrete PSO models," IEEE Trans. Evol. Comput., vol. 15, no. 3, pp. 405-423, Jun. 2011.
52. X. Li and Y. Yao, "Cooperatively coevolving particle swarms for large scale optimization," IEEE Trans. Evol. Comput., vol. 16, no. 2, pp. 1-15, Apr. 2011.
53. Z. Yang, K. Tang, and X. Yao, "Multilevel cooperative coevolution for large scale optimization," in Proc. IEEE Congr. Evol. Comput., Hong Kong, 2008, pp. 1663-1670.
54. R. Ros and N. Hansen, "A simple modification in CMA-ES achieving linear time and space complexity," in Parallel Problem Solving from Nature-PPSN X. Berlin, Germany: Springer, 2008, pp. 296-305.
55. S.-T. Hsieh, T.-Y. Sun, C.-C. Liu, and S.-J. Tsai, "Solving large scale global optimization using improved particle swarm optimizer," in Proc. IEEE Congr. Evol. Comput., Hong Kong, 2008, pp. 1777-1784.
56. M. Potter and K. De Jong, "A cooperative coevolutionary approach to function optimization," in Parallel Problem Solving from Nature, PPSN III. Berlin, Germany: Springer, 1994, pp. 249-257.
57. Z. Yang, K. Tang, and X. Yao, "Large scale evolutionary optimization using cooperative coevolution," Inf. Sci., vol. 178, no. 15, pp. 2985-2999, 2008.
58. N. Hansen and A. Ostermeier, "Completely derandomized selfadaptation in evolution strategies," Evol. comput., vol. 9, no. 2, pp. 159-195, 2001.
59. M. A. Montes de Oca, T. Stutzle, M. Birattari, and M. Dorigo, "Frankenstein's PSO: A composite particle swarm optimization algorithm," IEEE Trans. Evol. Comput., vol. 13, no. 5, pp. 1120-1132, Oct. 2009.
60. X. Li, "Niching without niching parameters: Particle swarm optimization using a ring topology," IEEE Trans. Evol. Comput., vol. 14, no. 1, pp. 150-169, Feb. 2010.
61. X. Li and K. Deb, "Comparing lbest PSO niching algorithms using different position update rules," in Proc. IEEE Congr. Evol. Comput., Barcelona, Spain, 2010, pp. 1-8.
62. O. Olorunda and A. Engelbrecht, "Measuring exploration/exploitation in particle swarms using swarm diversity," in Proc. IEEE Congr. Evol. Comput., Hong Kong, 2008, pp. 1128-1134.
63. A. Ismail and A. Engelbrecht, "Measuring diversity in the cooperative particle swarm optimizer," in Swarm Intelligence. Berlin, Germany: Springer, 2012, pp. 97-108.
64. K. Deb, Multi-Objective Optimization Using Evolutionary Algorithms. Hoboken, NJ, USA: Wiley, 2001.
65. H. Ishibuchi, N. Tsukamoto, and Y. Nojima, "Evolutionary manyobjective optimization: A short review," in Proc. IEEE Congr. Evol. Comput., Hong Kong, 2008, pp. 2419-2426.