Accelerating parallel particle swarm optimization via GPU

Optimization Methods and Software

Volumn 27, Issue 1, 2012, Pages 33-51

  Hung, Yukai ^a   Wang, Weichung ^a  

^a NATIONAL TAIWAN UNIVERSITY   (Taiwan)

Author keywords

graphic process unit; parallel computing; particle swarm optimization

Indexed keywords

COMPUTATIONAL COSTS; DERIVATIVE-FREE METHODS; GRAPHICS PROCESSING UNIT; HIGH-DIMENSIONAL; LOAD-BALANCED; MANY-CORE; NUMERICAL RESULTS; OPTIMAL SOLUTIONS; OPTIMIZATION PROBLEMS; PARALLEL EFFICIENCY; PARALLEL PARTICLE SWARM OPTIMIZATION; PARALLELIZATIONS; PARTICLE SWARM; PROBLEM DOMAIN; PROCESS UNIT; RUNNING-IN; TEST PROBLEM; THREAD-POOL MODEL;

COMPUTER GRAPHICS EQUIPMENT; CONSTRAINED OPTIMIZATION; PARALLEL ARCHITECTURES; PARALLEL PROCESSING SYSTEMS; PROBLEM SOLVING; PROGRAM PROCESSORS;

PARTICLE SWARM OPTIMIZATION (PSO);

EID: 84862922608     PISSN: 10556788     EISSN: 10294937     Source Type: Journal    
DOI: 10.1080/10556788.2010.509435     Document Type: Article

References (45)

1. A. Banks, J.Vincent, and C.Anyakoha,A reviewof particle swarm optimization. Part I: Background and development, Nat. Comput. 6(4) (2007), pp. 467-484. (Pubitemid 47629392)
2. A. Banks, J. Vincent, and C. Anyakoha, A review of particle swarm optimization. Part II: Hybridisation, combinatorial, multicriteria and constrained optimization, and indicative applications, Nat. Comput. 7(1) (2008), pp. 109-124. (Pubitemid 351234459)
3. C. Blum and D. Merkle, Swarm Intelligence: Introduction and Applications, Springer-Verlag New York Inc, NewYork, 2008.
4. D. Bratton and J. Kennedy, Defining a Standard for Particle Swarm Optimization, IEEE Swarm Intelligence Symposium, 2007. SIS 2007, IEEE, Piscataway, NJ, 2007, pp. 120-127. (Pubitemid 47431829)
5. J.-F. Chang, S.-C. Chu, and J.-S. Pan, A parallel particle swarm optimization algorithm with communication strategies, J. Inf. Sci. Eng. 21(4) (2005), pp. 809-818. (Pubitemid 40972090)
6. B. Chapman, G. Jost, R.Van der Pas, and D.J.Kuck, Using OpenMP:Portable Shared MemoryParallel Programming, The MIT Press, Cambridge, MA, 2007.
7. A. Chatterjee and P. Siarry, Nonlinear inertia weight variation for dynamic adaptation in particle swarm optimization, Comput. Oper. Res. 33(3) (2006), pp. 859-871. (Pubitemid 41101128)
8. M. Clerc, Particle Swarm Optimization, ISTE Publishing Company, Newport Beach, CA, 2006.
9. M. Clerc and J. Kennedy, The particle swarm-explosion, stability, and convergence in a multidimensional complex space, IEEE Trans. Evol. Comput. 6(1) (2002), pp. 58-73. (Pubitemid 34404564)
10. J. Dean and S. Ghemawat, MapReduce: Simplified Data Processing on Large Clusters, OSDI04: Sixth Symposium on Operating System Design and Implementation, 2004. Available at http://labs.google.com/papers/mapreduceosdi04. pdf.
11. M. Dorigo and T. Stützle, Ant Colony Optimization, The MIT Press, Cambridge, MA, 2004.
12. J.M. Elble, N.V. Sahinidis, and P.Vouzis, GPU computing with Kaczmarz's and other iterative algorithms for linear systems, Parallel Comput. 36(5-6) (2009), pp. 215-231.
13. A.P. Engelbrecht, Fundamentals of Computational Swarm Intelligence, JohnWiley & Sons, Hoboken, NJ, 2006.
14. S.K.S. Fan and J.M. Chang, A Modified Particle Swarm Optimizer Using an Adaptive Dynamic Weight Scheme, Proceedings of the 1st International Conference on Digital Human Modeling, Springer-Verlag, 2007, pp. 56-65.
15. D. Gies and Y. Rahmat-Samii, Particle swarm optimization for reconfigurable phase-differentiated array design, Microw. Opt. Technol. Lett. 38(3) (2003), pp. 168-175.
16. F. Glover and M. Laguna, Tabu Search, Kluwer Academic Publishers, Boston, MA, 1997.
17. D.E. Goldberg, Genetic Algorithms in Search, Optimization and Machine Learning, Addison-Wesley Longman Publishing Co., Inc. Boston, MA, 1989.
18. M. Harris, High Performance Computing with CUDA (Slides for Tutorial Section s05 in sc07.), 2007. Available at http://gpgpu.org/static/sc2007/SC07 CUDA 5 Optimization Harris.pdf.
19. S.-Y. Ho, L.-S. Shu, and J.-H. Chen, Intelligent evolutionary algorithms for large parameter optimization problems, IEEE Trans. Evol. Comput. 8(6) (2004), pp. 522-541. (Pubitemid 40085393)
20. S.Y. Ho, H.S. Lin,W.H. Liauh, and S.J. Ho, OPSO: Orthogonal particle swarm optimization and its application to task assignment problems, IEEE Trans. Syst. Man Cybernet. A 38(2) (2008), pp. 288-298.
21. A. Ide and K. Yasuda, A basic study of adaptive particle swarm optimization, Electr. Eng. Jpn 151(3) (2005), pp. 41-49. (Pubitemid 40519684)
22. V. Kalivarapu and E. Winer, Implementation of Digital Pheromones in PSO Accelerated by Commodity Graphics Hardware, 12th AIAA/ISSMO Multidisciplinary Analysis and Optimization Conference, 2008. Available at http://pdf.aiaa.org/ preview/CDReadyMMAOC08 1876/PV2008 6021.pdf.
23. J.Kennedy, The Behavior ofParticles, Proceedings of the 7th International Conference on Evolutionary Programming VII, Springer-Verlag, London, 1998, pp. 581-589.
24. J. Kennedy, R.C. Eberhart, et al. Particle Swarm Optimization, Proceedings of IEEE International Conference on Neural Networks, Vol. 4, IEEE, Piscataway, NJ, 1995, pp. 1942-1948.
25. S. Kirkpatrick, C.D. Gelatt, and M.P. Vecchi, Optimization by simulated annealing, Science, 220(4598) (1983), pp. 671-680.
26. B.I. Koh, A.D. George, R.T. Haftka, and B.J. Fregly, Parallel asynchronous particle swarm optimization, Int. J. Numer. Methods Eng. 67 (2006), pp. 578-595. (Pubitemid 44083763)
27. K. Krishnakumar, S. Narayanaswamy, and S. Garg, Solving large parameter optimization problems using a genetic algorithm with stochastic coding, in Genetic Algorithms in Engineering and Computer Science,G.Winter, J. Periaux, M. Galan, and P. Cuesta, eds., JohnWiley & Sons, Inc., NewYork, NY, 1996.
28. J.M. Li, D.L. Wan, Z.X. Chi, and X. Hu, A parallel particle swarm optimization algorithm based on fine-grained model with GPU-accelerating, J. Harbin Inst. Technol. 38(12) (2006), pp. 2162-2166. (Pubitemid 46236473)
29. A.W. McNabb, C.K. Monson, and K.D. Seppi, Parallel PSO using MapReduce, IEEE Congress on Evolutionary Computation, 2007, CEC 2007, 2007, pp. 7-14. doi:10.1109/CEC.2007.4424448. (Pubitemid 351371376)
30. R. Mendes, J. Kennedy, and J. Neves, The fully informed particle swarm: Simpler, maybe better, IEEE Trans. Evol. Comput. 8(3) (2004), pp. 204-210.
31. L. Mussi and S. Cagnoni, Particle swarm optimization within the CUDA architecture, 2009. Available at http://www.gpgpgpu.com/gecco2009/1.pdf.
32. NVIDIA Corporation, NVIDIA CUDA CUBLAS Library, 2008.
33. NVIDIA Corporation, NVIDIA CUDA Programming Guide, Version 2.3.1, 2009.
34. B. Oster, Advanced CUDA Training (NVISION 08 Tutorials), 2008.
35. R. Poli, J. Kennedy, and T. Blackwell, Particle swarm optimization, Swarm Intell. 1(1) (2007), pp. 33-57.
36. R. Poli, J. Kennedy, T. Blackwell, and A. Freitas, Particle Swarms: The Second Decade, Hindawi Publishing Corporation, 2008.
37. J.F. Schutte, J.A. Reinbolt, B.J. Fregly, R.T. Haftka, and A.D. George, Parallel global optimization with the particle swarm algorithm, Int. J. Numer. Methods Eng. 61(13) (2004), pp. 2296-2315. (Pubitemid 40008433)
38. Y. Shi and R. Eberhart, A Modified Particle Swarm Optimizer, The 1998 IEEE International Conference on Evolutionary Computation, ICEC'98, 1998, pp. 69-73.
39. Y. Shi and R.C. Eberhart, Parameter Selection in Particle Swarm Optimization, Lecture Notes in Computer Science, 1998, pp. 591-600. (Pubitemid 128118969)
40. S. Tomov, R. Nath, H. Ltaief, and J. Dongarr, A Scalable High Performance Cholesky Factorization for Multicore with GPU Accelerators, Proceedings of IPDPS 2010: 24th IEEE International Parallel and Distributed Processing Symposium, 2010. Available at http://icl.cs.utk.edu/news pub/submissions/tile magma conf.pdf.
41. G. Venter and J. Sobieszczanki-Sobieksi, A parallel particle swarm optimization algorithm accelerated by asynchronous evaluations, J. Aerosp. Comput. Inf. Commun. 3 (2006), pp. 123-137. (Pubitemid 43872680)
42. D.Wang, C.-H.Wu, A. Ip, D.Wang, andY.Yan, Parallel multi-population Particle Swarm Optimization Algorithm for the Uncapacitated Facility Location problem using OpenMP, IEEE Congress on Evolutionary Computation, 2008, pp. 1214-1218.
43. Y. Zhang, D. Gallipoli, and C.E. Augarde, Simulation-based calibration of geotechnical parameters using parallel hybrid moving boundary particle swarm optimization, Comput. Geotech. 36 (2009), 604-615.
44. Y. Zhou andY.Tan, GPU-based Parallel Particle Swarm Optimization, IEEE Congress on Evolutionary Computation, 2009, pp. 1493-1500.
45. W. Zhu and J. Curry, Particle Swarm with Graphics Hardware Acceleration and Local Pattern Search on Bound Constrained Problems, IEEE Swarm Intelligence Symposium (SIS '09), 2009, pp. 1-8.