Improving particle swarm optimization performance with local search for high-dimensional function optimization

Optimization Methods and Software

Volumn 25, Issue 5, 2010, Pages 781-795

  Wang, Yong Jun ^a,b  

^a TSINGHUA UNIVERSITY   (China)

^b CHINA NATIONAL PETROLEUM CORPORATION   (China)

Author keywords

Global optimization; Gradient descent method; Particle swarm optimization (PSO); Repulsion technique

Indexed keywords

DESCENT METHOD; EXISTING METHOD; GLOBAL MINIMA; GLOBAL OPTIMIZATION PROBLEMS; GRADIENT BASED; GRADIENT DESCENT METHOD; GRADIENT DESCENT TECHNIQUES; HIGH-DIMENSIONAL; HYBRID ALGORITHMS; LOCAL MINIMUMS; LOCAL OPTIMIZATIONS; LOCAL SEARCH; OBJECTIVE FUNCTIONS; PARALLEL SEARCH; SEARCH PROCEDURES; SIMULATION RESULT; STOCHASTIC OPTIMIZATION TECHNIQUES; TEST PROBLEM; TWO-STAGE HYBRID ALGORITHMS;

ALGORITHMS; FUNCTION EVALUATION; GLOBAL OPTIMIZATION; GRADIENT METHODS;

PARTICLE SWARM OPTIMIZATION (PSO);

EID: 77953502769     PISSN: 10556788     EISSN: 10294937     Source Type: Journal    
DOI: 10.1080/10556780903034514     Document Type: Conference Paper

References (35)

1. R.S. Anerssen, L.S. Jennings, and D.M. Ryan, Optimization, University of Queensland Press, St Lucia, Australia, 1972.
2. J. Barhen, V. Protopopescu, and D, Reister, TRUST: A deterministic algorithm for global optimization, Science 276 (1997), pp. 1094-1097.
3. G.L. Bilbro andW.E. Snyder, Optimization of functions with many minima, Trans. Syst. Man Cybernet. 21(7) (1991), pp. 840-849.
4. K. Chen, T. Li, and T. Cao, Tribe-PSO: A novel global optimization algorithm and its application in molecular docking, Chemometr. Intell. Lab. 82 (2006), pp. 248-259.
5. M. Clerc and J. Kennedy, The particle swarm-explosion, stability, and convergence in a multidimensional complex space, IEEE Tans. Evol. Comput. 6(1) (2002), pp. 58-73.
6. D. Cvijovic and J. Klinowski, Taboo search, an approach to the multiple minima problem, Science 267 (1995), pp. 664-666.
7. P. Daniel and X. Li, Locating and tracking multiple dynamic optima by a particle swarm model using speciation, IEEE Tans. Evol. Comput. 10(4) (2006), pp. 440-458.
8. K. Deb, Optimization for Engineering Design, Algorithms and Examples, Prentice-Hall, New Delhi, India, 1995.
9. K. Deb and D.E. Goldberg, An investigation of niche and species formation in genetic function optimization, in Proceedings of the 3rd International Conference on Genetic Algorithms, J.D. Schaffer, ed., Morgan Kaufman, San Mateo, CA, 1989, pp. 42-125
10. A. Dekkers and E. Aarts, Global optimization and simulated annealing, Math. Program. 50 (1991), pp. 367-393.
11. R.C. Eberhart and J. Kennedy, A new optimizer using particle swarm theory, in Proceedings of 6th Symposium Micro Machine and Human Science, Nagoya, Japan, IEEE Service Center, Piscataway, NJ, 1995, pp. 39-43.
12. J. Kennedy, R.C. Eberhardt, andY.H. Shi, Swarm intelligence, Morgan Kaufmann, San Diego, CA, 2001.
13. R. Ge, A filled function method for finding a global minimizer of a function of several variables, Math. Program. 46 (1990), pp. 191-204.
14. D.E. Goldberg, Genetic Algorithm in Search, Optimization and Machine Learning, AddisonWesley, Reading, MA, 1989.
15. W.E. Hart, Locally-adaptive and memetic evolutionary pattern search algorithms, Evol. Comput. 11(1) (2003), pp. 29-51.
16. A. Hedar and M. Fukushima, Hybrid simulated annealing and direct search method for nonlinear unconstrained global optimization, Optim. Methods Softw. 17(5) (2002), pp. 891-912.
17. J.H. Holland, Genetic algorithms, Sci. Amer. 4 (1992), pp. 44-50.
18. J. Kennedy and R.C. Eberhart, Particle swarm optimization, in Proceedings of IEEE International Conference on Neural Networks, IEEE Service Center, Piscataway, NJ, 1995, pp. 1942-1948.
19. S. Kirkpatrick, C.D. Gelatt, and M.P.Vecchi, Optimization by simulate annealing, Science 220 (1983), pp. 671-680.
20. J. Knnedy, R.C. Eberhart, andY. Shi, Swarm intelligence, Morgan Kaufmann, San Francisco, CA, 2001.
21. A. Levy and A. Montalvo, The tunneling algorithm for the global minimization of functions, SIAM J. Sci. Stat. Comput. 6 (1985), pp. 15-29.
22. B. Liu, L. Wang, Y. Jin, F. Tang, and D. Huang, Improved particle swarm algorithm combined with chaos, Chaos Solutions Factals 25 (2005), pp. 1261-1271. (Pubitemid 40643077)
23. M. Lozano, F. Herrera, N. Krasnogor, and D. Molina, Real-coded memetic algorithms with crossover hill-climbing, Evol. Comput. 12(3) (2004), pp. 273-302.
24. R. Marti, Multi-start methods, in Handbook of MetaHeuristics, F. Glover and G. Kochenberger, eds., Kluwer Academic Publishers, Boston, MA, 2002, pp. 355-368.
25. P. Merz, Advanced fitness landscape analysis and the performance of memetic algorithms, Evol. Comput. 12(3) (2004), pp. 303-325.
26. M.M. Noel and T.C. Jannett, Simulation of a new hybrid particle swarm optimization algorithm, system symposium, in Proceedings of the Thirty-Sixth Southeastern Symposium, IEEE Press, Atlanta, GA, 2004, pp. 150-153.
27. C.O. Ourique, E.C. Biscaia, and J.C. Pinto, The use of particle swarm optimization for dynamical analysis in chemical processes, Comput. Chem. Eng. 26 (2002), pp. 1783-1793.
28. K.E. Parsopoulos and M.N. Vrahatis, On the computation of all global optimizers through particle swarm optimization, IEEE Trans. Evol. Comput. 8 (2004), pp. 211-223.
29. K.E. Parsopoulos,V.P. Plagianakos, G.D. Magoulas, and M.N. Vrahatis, Objective function "Stretching" to alleviate convergence to local minima, Nonlinear Anal. Theory Meth. Appl. 47 (2001), pp. 3419-3424.
30. P. RoyChowdhury, Y.P. Singh, and R.A. Chansarkar, Hybridization of gradient descent algorithms with dynamic tunneling methods for global optimization, IEEE Trans. Syst. Man. Cybernet. 30(3) (2000), pp. 384-390.
31. F. Schoen, Two phase methods for global optimization, in Handbook of Global Optimization, P.M. Pardalos and H.E. Romeijn eds., Kluwer Academic Publishers, Boston, MA, 2002, pp. 151-178.
32. Y. Shi and R.C. Eberhart, A modified particle swarm optimizer, in Proceedings of the IEEE Congress on Evolutionary Computation (CEC 1998), IEEE Press, Piscataway, NJ, 1998, pp. 69-73.
33. Y. Shi and R.C. Eberhart, Empirical study of particle swarm optimization, in Proceedings of the IEEE International Congress on Evolutionary Computation, Washington, DC, IEEE Press, Piscataway, NJ, 1999, pp. 1945-1950.
34. P.N. Suganthan, Particle swarm optimizer with neighborhood operator, in Proceedings of the Congress on Evolutionary Computation[C]. IEEE, Piscataway, NY,Washington, DC, 1999, pp. 1958-1962.
35. K.F.C. Yiu, Y. Liu, and K.L. Teo, A hybrid descent method for global optimization, J. Global Optim. 28 (2004), pp. 229-238.