A new particle swarm algorithm and its globally convergent modifications

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 41, Issue 5, 2011, Pages 1334-1351

  Gao, Hao ^a   Xu, Wenbo ^b  

^a TSINGHUA UNIVERSITY   (China)

^b JIANGNAN UNIVERSITY   (China)

Author keywords

Moderate random search (MRS); Monte Carlo method; mutation; particle swarm optimization (PSO)

Indexed keywords

BENCHMARK FUNCTIONS; CONVERGENCE RATES; GLOBAL OPTIMUM; GLOBAL SEARCH ABILITY; GLOBALLY CONVERGENT; LAST STAGE; MONTE CARLO; MULTI-MODAL; MUTATION; MUTATION STRATEGY; PARTICLE SWARM ALGORITHM; POPULATION-BASED OPTIMIZATION; PSO ALGORITHMS; RANDOM SEARCHES; SEARCH PERFORMANCE; SOLUTION SPACE; UNIMODAL FUNCTIONS;

ALGORITHMS; MONTE CARLO METHODS;

PARTICLE SWARM OPTIMIZATION (PSO);

EID: 80052895087     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2011.2144582     Document Type: Article

References (56)

1. K. Deb, Optimization for Engineering Design: Algorithms and Examples. New Delhi, India: Prentice-Hall, 1995.
2. M. Mitchell, An Introduction to Genetic Algorithms. Cambridge, MA: MIT Press, 1996.
3. Q. H. Nguyen, Y. S. Ong, and M. H. Lim, "A probabilistic memetic framework," IEEE Trans. Evol. Comput., vol. 13, no. 3, pp. 604-623, Jun. 2009.
4. R. Storn and K. Price, "Differential evolution-a simple and efficient heuristic for global optimization over continuous spaces," J. Global Optim., vol. 11, no. 4, pp. 341-359, Dec. 1997. (Pubitemid 127502202)
5. A. Auger and N. Hansen, "Reconsidering the progress rate theory for evolution strategies in finite dimensions," in Proc. Genetic Evol. Comput. Conf., 2006, pp. 445-452. (Pubitemid 44611357)
6. J. Kennedy and R. C. Eberhart, "Particle swarm optimization," in Proc. IEEE Int. Conf. Neural Netw., 1995, vol. 4, pp. 1942-1948.
7. V. S. Pappala, I. Erlich, K. Rohrig, and J. A. Dobschinski, "A stochastic model for the optimal operation of a wind-thermal power system," IEEE Trans. Power Syst., vol. 24, no. 2, pp. 940-950, May 2009.
8. M.M.Mansour, S. F.Mekhamer, EI-Kharbawe, and N. E.-S. , "Amodified particle swarm optimizer for the coordination of directional overcurrent relays," IEEE Trans. Power Del., vol. 22, no. 3, pp. 1400-1410, Jul. 2007.
9. S. Dutta and S. P. Singh, "Optimal rescheduling of generators for congestion management based on particle swarm optimization," IEEE Trans. Power Syst., vol. 23, no. 4, pp. 1560-1569, Nov. 2008.
10. Y. Song, Z. Chen, and Z. Yuan, "New chaotic PSO-based neural network predictive control for nonlinear process," IEEE Trans. Neural Netw., vol. 18, no. 2, pp. 595-601, Mar. 2007.
11. H. L. Wei, S. A. Billings, Y. F. Zhao, and L. Z. Guo, "Lattice dynamical wavelet neural networks implemented using particle swarm optimization for spatio-temporal system identification," IEEE Trans. Neural Netw., vol. 20, no. 1, pp. 181-185, Jan. 2009.
12. C. J. Lin, C. H. Chen, and C. T. Lin, "A hybrid of cooperative particle swarm optimization and cultural algorithm for neural fuzzy networks and its prediction applications," IEEE Trans. Syst., Man, Cybern. C, Appl. Rev., vol. 39, no. 1, pp. 55-68, Jan. 2009.
13. K. D. Sharma, A. Chatterjee, and A. Rakshit, "A hybrid approach for design of stable adaptive fuzzy controllers employing Lyapunov theory and particle swarm optimization," IEEE Trans. Fuzzy Syst., vol. 17, no. 2, pp. 329-342, Apr. 2009.
14. J. H. Jeng, C. C. Tseng, and J. G. Hsieh, "Study on Huber fractal image compression," IEEE Trans. Image Process., vol. 18, no. 5, pp. 995-1003, May 2009.
15. A. Paoli, F. Melgani, and E. Pasolli, "Clustering of hyperspectral images based on multiobjective particle swarm optimization," IEEE Trans. Geosci. Remote Sens., vol. 47, no. 12, pp. 4175-4188, Dec. 2009.
16. M. Clerc and J. Kennedy, "The particle swarm-explosion, stability, and convergence in a multi-dimensional complex space," IEEE Trans. Evol. Comput., vol. 6, no. 1, pp. 58-73, Feb. 2002. (Pubitemid 34404564)
17. F. van Den Bergh and A. P. Engelbrecht, "A study of particle swarm optimization particle trajectories," Inf. Sci., vol. 176, no. 8, pp. 937-971, Apr. 2006. (Pubitemid 43190068)
18. F. van. Den Bergh, "An analysis of particle swarm optimizers," Ph.D. dissertation, Univ. Pretoria, Pretoria, South Africa, Nov., 2001.
19. E. Ozcan and C. K. Mohan, "Particle swarm optimization: Surfing the waves," in Proc. IEEE Congr. Evol. Comput., 1999, vol. 3, pp. 1939-1944.
20. M. Jiang, Y. P. Luo, and S. Y. Yang, "Stochastic convergence analysis and parameter selection of the standard particle swarm optimization algorithm," Inf. Process. Lett., vol. 102, no. 1, pp. 8-16, Apr. 2007. (Pubitemid 46186357)
21. V. Kadirkamanathan, K. Selvarajah, and P. J. Fleming, "Stability analysis of the particle dynamics in particle swarm optimizer," IEEE Trans. Evol. Comput., vol. 10, no. 3, pp. 245-255, Jun. 2006. (Pubitemid 43821758)
22. Y. P. Chen and P. Jiang, "Analysis of particle interaction in particle swarm optimization," Theor. Comput. Sci., vol. 411, no. 21, pp. 2101-2115, May 2010.
23. Y. Shi and R. Eberhart, "A modified particle swarm optimizer," in Proc. IEEE Int. Conf. Evol. Comput., 1998, pp. 69-73.
24. J. Sun and W. B. Xu, "A global search strategy of quantum-behaved particle swarm optimization," in Proc. IEEE Int. Conf. Cybern. Intell. Syst., 2004, vol. 1, pp. 111-116. (Pubitemid 40062286)
25. J. Sun, B. Feng, and W. B. Xu, "Particle swarm optimization with particle having quantum behavior," in Proc. IEEE Congr. Evol. Comput., Jun. 2004, vol. 1, pp. 325-331.
26. J. Kennedy, "In search of the essential particle swarm," in Proc. IEEE Congr. Evol. Comput., 2006, pp. 1694-1701. (Pubitemid 47130701)
27. B. Jiao, Z. G. Lian, and X. S. Gu, "A dynamic inertia weight particle swarm optimization algorithm," Chaos, Solitons Fractals, vol. 37, no. 3, pp. 698-705, Sep. 2008. (Pubitemid 351335358)
28. Z. H. Zhan, J. Zhang, Y. Li, and H. S. Chung, "Adaptive particle swarm optimization," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 39, no. 6, pp. 1362-1381, Dec. 2009.
29. S. H. Ling, H. H. C. Iu, K. Y. Chan, H. K. Lam, B. C. W. Yeung, and F. H. Leung, "Hybrid particle swarm optimization with wavelet mutation and its industrial applications," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 38, no. 3, pp. 743-763, Jun. 2008. (Pubitemid 351796155)
30. H. Wang and Y. Liu, "A hybrid particle swarm algorithm with Cauchy mutation," in Proc. IEEE Conf. Swarm Intell. Symp., 2007, pp. 356-360. (Pubitemid 47431861)
31. J. J. Liang, A. K. Qin, P. N. Suganthan, and S. Baskar, "Comprehensive learning particle swarm optimizer for global optimization of multimodal functions," IEEE Trans. Evol. Comput., vol. 10, no. 3, pp. 281-295, Jun. 2006. (Pubitemid 43821759)
32. M. G. H. Omran, A. P. Engelbrecht, and A. Salman, "Differential evolution based particle swarm optimization," in Proc. IEEE Conf. Swarm Intell. Symp., 2007, pp. 112-119. (Pubitemid 47431828)
33. N. Hiqushi and H. Iba, "Particle swarm optimization with Gaussian mutation," in Proc. IEEE Conf. Swarm Intell. Symp., Apr. 2003, pp. 72-79.
34. P. S. Andrews, "An investigation into mutation operators for particle swarm optimization," in Proc. IEEE Congr. Evol. Comput., Sep. 2006, pp. 1044-1051. (Pubitemid 47130613)
35. A. Ratnaweera, S. K. Halgamuge, and H. C. Watson, "Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients," IEEE Trans. Evol. Comput., vol. 8, no. 3, pp. 240-255, Jun. 2004.
36. H.Wang, Y. Liu, Z.Wu, H. Sun, S. Y. Zeng, and L. S. Kang, "An improved particle swarm optimization with adaptive jumps," in Proc. IEEE Congr. Evol. Comput., 2008, pp. 392-397.
37. J. Chuanwen and E. Bompard, "A hybrid method of chaotic particle swarm optimization and linear interior for reactive power optimization," Math. Comput., vol. 68, no. 1, pp. 57-65, Feb. 2005. (Pubitemid 40146399)
38. S. C. L. Dos, "An efficient particle swarm approach for mixed-integer programming in reliability-redundancy optimization applications," Rel. Eng. Syst. Safety, vol. 94, no. 4, pp. 830-837, Apr. 2009.
39. L. dos Santos Coelho, "Fuzzy identification based on a chaotic particle swarm optimization approach applied to a nonlinear yo-yo motion system," IEEE Trans. Ind. Electron., vol. 54, no. 6, pp. 3234-3245, Dec. 2007.
40. K. Penev and G. Littlefair, "Free search-A comparative analysis," Inf. Sci., vol. 172, no. 1-2, pp. 173-193, Jun. 2005.
41. H. Tizhoosh, "Opposition-based learning: a new scheme for machine intelligence," in Proc. Int. Conf. Comput. Intell. Model. Control Autom., 2005, vol. 1, pp. 695-701.
42. M. G. H. Omran and A. P. Engelbrecht, "Free search differential evolution," in Proc. IEEE Int. Congr. Evol. Comput., May 2009, pp. 110-117.
43. C. Garcia-Martines, M. Lozano, F. Herrera, D. Molina, and A. M. Sanchez, "Global and local real-coded genetic algorithms based on parent-centric crossover operators," Eur. J. Oper. Res., vol. 185, no. 3, pp. 1088-1113, Mar. 2008. (Pubitemid 47498808)
44. S. He, Q. H. Wu, and J. R. Saunders, "Group search optimizer: An optimization algorithm inspired by animal searching behavior," IEEE Trans. Evol. Comput., vol. 13, no. 5, pp. 973-990, Oct. 2009.
45. J. Kennedy and R. C. Eberhart, Swarm Intelligence. San Mateo, CA: Morgan Kaufman, 2001.
46. R. S. Sutton and A. G. Barto, Reinforcement Learning: An introduction. Cambridge, MA: MIT Press, 1998.
47. P. P. Boyle, "A Monte Carlo approach," J. Financial Econ., vol. 4, no. 3, pp. 323-338, May 1977.
48. K. H. Quah and C. Quek, "MCES: A novel Monte Carlo evaluative selection approach for objective feature selections," IEEE Trans. Neural Netw., vol. 18, no. 2, pp. 431-448, Mar. 2007. (Pubitemid 46522567)
49. M. G. Hall and D. C. Alexander, "Convergence and parameter choice for Monte-Carlo simulations of diffusion MRI," IEEE Trans. Med. Imag., vol. 28, no. 9, pp. 1354-1364, Sep. 2009.
50. F. F. C. Veliz, C. L. T. Borges, and A. M. Rei, "A Comparison of load models for composite reliability evaluation by nonsequential Monte Carlo simulation," IEEE Trans. Power Syst., vol. 25, no. 2, pp. 649-656, May 2010.
51. S. Kirkpatric, C. D. Gelatt, and M. P. Vecchi, "Optimization by simulated annealing," Science, vol. 220, no. 4598, pp. 671-680, May 1983.
52. R. Mendes, "Population topologies and their influence in particle swarm performance," Ph.D. dissertation, Univ. Minho, Braga, Portugal, 2004.
53. R. C. Eberhart and Y. Shi, "Comparing inertia weights and Constriction factors in particle swarm optimization," in Proc. IEEE Int. Congr. Evol. Comput., 2000, vol. 1, pp. 84-88.
54. K. L. Chung and P. Erdos, "On the application of the Borel-Cantelli Lemma," Trans. Amer. Math. Soc., vol. 72, no. 1, pp. 179-186, Jan. 1952.
55. X. Yao and Y. Liu, "Evolutionary programming made faster," IEEE Trans. Evol. Comput., vol. 3, no. 2, pp. 82-102, Jul. 1999.
56. M. M. Ali, C. Khompatraporn, and Z. B. Zabinsky, "A numerical evaluation of several stochastic algorithms on selected continuous global optimization test problems," J. Global Optim., vol. 31, no. 4, pp. 635-672, Apr. 2005. (Pubitemid 40963404)