GPU computing in discrete optimization. Part II: Survey focused on routing problems

EURO Journal on Transportation and Logistics

Volumn 2, Issue 1-2, 2013, Pages 159-186

  Schulz, Christian ^a   Hasle, Geir ^a   Brodtkorb, André R ^a   Hagen, Trond R ^a  

^a SINTEF ICT   (Norway)

Author keywords

Discrete optimization; GPU; Heterogeneous computing; Introduction; Parallel computing; Survey; Transportation; Travelling salesman problem; Tutorial; Vehicle routing problem

Indexed keywords

EID: 85066416810     PISSN: 21924376     EISSN: 21924384     Source Type: Journal    
DOI: 10.1007/s13676-013-0026-0     Document Type: Article

References (99)

1. Aarts E, Lenstra JK (eds) (2003) Local search in combinatorial optimization. Princeton University Press, Oxford
2. Acan A (2002) G A A C O: A G A + A C O hybrid for faster and better search capability. In: Dorigo M, Di Caro G, Sampels M (eds) Ant algorithms. Lecture notes in computer science. In: Proceedings of Third International Workshop, ANTS 2002, vol 2463. Springer, Berlin, pp 300–301
3. Adya S, Markov I (2003) Fixed-outline floorplanning: enabling hierarchical design. IEEE transactions on very large scale integration (VLSI) systems, vol 11, no. 6, pp 1120–1135
4. Alba E (2005) Parallel metaheuristics: a new class of algorithms. In: Wiley series on parallel and distributed computing. Wiley, New York
5. Bai H, OuYang D, Li X, He L, Yu H (2009) MAX–MIN snt system on GPU with CUDA. In: Fourth international conference on innovative computing, information and control (ICICIC), pp 801–804
6. Banzhaf W, Harding S, Langdon W, Wilson G (2008) Accelerating genetic programming through graphics processing units. In: Riolo RL, Soule T, Worzel B (eds) Genetic programming theory and practice, vol VI. Springer, Berlin, pp 229–249
7. Bixby RE (2002) Solving real-world linear programs: a decade and more of progress. Oper Res 50:3–15
8. Bleiweiss A (2008) GPU accelerated pathfinding. In: Proceedings of the 23rd ACM SIGGRAPH/EUROGRAPHICS symposium on graphics hardware, GH ’08, pp 65–74. Eurographics Association, Aire-la-Ville, Switzerland
9. Brodtkorb AR, Hagen TR, Schulz C, Hasle G (2013) GPU computing in discrete optimization—part I: introduction to the GPU. EURO J Transp Logist. doi:10.1007/s13676-013-0025-1
10. Buluç A, Gilbert JR, Budak C (2010) Solving path problems on the GPU. Parallel Comput 36(5–6):241–253
11. Bura W, Boryczka M (2011) The parallel ant vehicle navigation system with CUDA technology. In: Jedrzejowicz P, Nguyen N, Hoang K (eds) Computational collective intelligence. Technologies and applications. Lecture notes in computer science, vol 6923. Springer, Berlin, pp 505–514
12. Burke EK, Riise A (2012) On parallel local search for permutations (Submitted)
13. Catala A, Jaen J, Modioli J (2007) Strategies for accelerating ant colony optimization algorithms on graphical processing units. In: 2007 IEEE congress on evolutionary computation (CEC 2007), pp 492–500
14. Cecilia J, Garcia J, Ujaldon M, Nisbet A, Amos M (2011) Parallelization strategies for ant colony optimisation on GPUs. In: 2011 IEEE international symposium on parallel and distributed processing workshops and Phd forum (IPDPSW), pp 339–346 (2011)
15. Chakroun I, Mezmaz M, Melab N, Bendjoudi A (2012) Reducing thread divergence in a GPU-accelerated branch-and-bound algorithm. Concurr Comput Pract Exp. doi:10.1002/cpe.2931
16. Charles J, Potok T, Patton R, Cui X (2008) Flocking-based document clustering on the graphics processing unit. In: Krasnogor N, Nicosia G, Pavone M, Pelta D (eds) Nature inspired cooperative strategies for optimization (NICSO 2007). Studies in computational intelligence, vol 129, pp 27–37. Springer, Berlin
17. Chen S, Davis S, Jiang H, Novobilski A (2011) CUDA-based genetic algorithm on traveling salesman problem. In: Lee R (ed) Computer and information science 2011. Studies in computational intelligence, vol 364. Springer, Berlin, pp 241–252
18. Chitty DM (2007) A data parallel approach to genetic programming using programmable graphics hardware. In: Thierens D, Beyer HG, Bongard J, Branke J, Clark JA, Cliff D, Congdon CB, Deb K, Doerr B, Kovacs T, Kumar S, Miller JF, Moore J, Neumann F, Pelikan M, Poli R, Sastry K, Stanley KO, Stutzle T, Watson RA, Wegener I (eds) GECCO ’07: proceedings of the 9th annual conference on genetic and evolutionary computation, vol 2. ACM Press, London, pp 1566–1573
19. Choong A, Beidas R, Zhu J (2010) Parallelizing simulated annealing-based placement using GPGPU. In: 2010 international conference on field programmable logic and applications (FPL), pp 31–34
20. Coelho I, Ochi L, Munhoz P, Souza M, Farias R, Bentes C (2012) The single vehicle routing problem with deliveries and selective pickups in a CPU-GPU heterogeneous environment. In: 2012 IEEE 14th international conference on high performance computing and communication, pp 1606–1611
21. Crainic TG, Le Cun B, Roucairol C (2006) Parallel Branch-and-Bound algorithms. Wiley, New York, pp 1–28
22. Crainic TG (2008) Parallel solution methods for vehicle routing problems. In: Golden B, Raghavan S, Wasil E, Sharda R, Voss S (eds) The vehicle routing problem: latest advances and new challenges. Operations research/computer science interfaces series, vol 43. Springer, New York, pp 171–198
23. Cui X, St. Charles J, Beaver J, Potok T (2011) The GPU enhanced parallel computing for large scale data clustering. In: 2011 international conference on cyber-enabled distributed computing and knowledge discovery (CyberC), pp 220–225
24. Czapiński M, Barnes S (2011) Tabu search with two approaches to parallel flowshop evaluation on CUDA platform. J Parallel Distrib Comput 71:802–811
25. Delévacq A, Delisle P, Gravel M, Krajecki M (2013) Parallel ant colony optimization on graphics processing units. Metaheuristics on GPUs. J Parallel Distrib Comput 73(1): 52–61
26. Delling D, Goldberg AV, Nowatzyk A, Werneck RF (2011) PHAST: hardware-accelerated shortest path trees. In: Proceedings of the 2011 IEEE international parallel & distributed processing symposium, IPDPS ’11. IEEE Computer Society, Washington, DC, pp 921–931
27. Diego FJ, Gómez EM, Ortega-Mier M, García-Sánchez A (2012) Parallel CUDA architecture for solving de VRP with ACO. In: Sethi SP, Bogataj M, Ros-McDonnell L (eds) Industrial engineering: innovative networks. Springer, London, pp 385–393
28. Dorigo M, Stützle T (2004) Ant colony optimization. Bradford Company, Scituate
29. Fog A (2013) Optimizing software in C++—an optimization guide for windows, linux and Mac platforms, Copenhagen University College of Engineering. http://www.agner.org/optimize
30. Fok KL, Wong TT, Wong ML (2007) Evolutionary computing on consumer graphics hardware. Intell Syst IEEE 22(2):69–78
31. Folino G, Pizzuti C, Spezzano G (1998) Solving the satisfiability problem by a parallel cellular genetic algorithm. In: Proceedings of Euromicro workshop on computational intelligence, IEEE computer, Society Press, pp 715–722
32. Fujimoto N, Tsutsui S (2011) A highly-parallel TSP solver for a GPU computing platform. In: Dimov I, Dimova S, Kolkovska N (eds) Numerical methods and applications. Lecture notes in computer science, vol 6046. Springer, Berlin, pp 264–271
33. Greeff G (2005) The revised simplex algorithm on a GPU. Technical report, University of Stellenbosch
34. Guntsch M, Middendorf M, Scheuermann B, Diessel O, ElGindy H, Schmeck H, So K (2002) Population based ant colony optimization on FPGA. In: 2002 IEEE international conference on field-programmable technology, 2002 (FPT). Proceedings, pp 125–132
35. Han Y, Roy S, Chakraborty K (2011) Optimizing simulated annealing on GPU: a case study with IC floorplanning. In: 12th international symposium on quality electronic design (ISQED), 2011, pp 1–7
36. Harding S, Banzhaf W (2007a) Fast genetic programming on GPUs. In: Ebner M, O’Neill M, Ekárt A, Vanneschi L, Esparcia-Alcázar AI (eds) Proceedings of the 10th European conference on genetic programming. Lecture notes in computer science, vol 4445. Springer, Valencia, pp 90–101
37. Harding SL, Banzhaf W (2007b) Fast genetic programming and artificial developmental systems on GPUs. In: 21st international symposium on high performance computing systems and applications (HPCS’07). IEEE Computer Society, Canada, p 2
38. Harding S, Banzhaf W (2011) Implementing cartesian genetic programming classifiers on graphics processing units using GPU.NET. In: Harding S, Langdon WB, Wong ML, Wilson G, Lewis T (eds) GECCO 2011 computational intelligence on consumer games and graphics hardware CIGPU. ACM, New York, pp 463–470
39. Harish P, Narayanan PJ (2007) Accelerating large graph algorithms on the GPU using CUDA. In: Proceedings of the 14th international conference on High performance computing, HiPC’07. Springer, Berlin, pp 197–208
40. Janiak A, Janiak W, Lichtenstein M (2008) Tabu search on GPU. J Univers Comput Sci 14(14):2416–2427
41. Katz GJ, Kider Jr JT (2008) All-pairs shortest-paths for large graphs on the GPU. In: Proceedings of the 23rd ACM SIGGRAPH/EUROGRAPHICS symposium on graphics hardware, GH ’08. Eurographics Association, Aire-la-Ville, pp 47–55
42. Kennedy J, Kennedy J, Eberhart R, Shi Y (2001) Swarm intelligence. In: The Morgan Kaufmann series in evolutionary computation. Morgan Kaufmann Publishers, Burlington
43. Kider J, Henderson M, Likhachev M, Safonova A (2010) High-dimensional planning on the GPU. In: 2010 IEEE international conference on robotics and automation (ICRA), pp 2515–2522
44. Krüger F, Maitre O, Jimenez S, Baumes L, Collet P (2010) Speedups between ×70 and ×120 for a generic local search (memetic) algorithm on a single GPGPU chip. In: Di Chio C, Cagnoni S, Cotta C, Ebner M, Ekárt A, Esparcia-Alcazar A, Goh CK, Merelo J, Neri F, Preu M, Togelius J, Yannakakis G (eds) EvoNum 2010, LNCS, vol 6024. Springer, Berlin, pp 501–511
45. Lalami M, El-Baz D, Boyer V (2011a) Multi GPU implementation of the simplex algorithm. In: 2011 IEEE 13th international conference on high performance computing and communications (HPCC), pp 179–186
46. Lalami ME, Boyer V, El-Baz D (2011b) Efficient implementation of the simplex method on a CPU-GPU system. In: Proceedings of the 2011 IEEE international symposium on parallel and distributed processing workshops and PhD forum, IPDPSW ’11. IEEE Computer Society, Washington, DC, pp 1999–2006
47. Langdon W, Banzhaf W (2007) A SIMD interpreter for genetic programming on GPU graphics cards. In: O’Neill M, Vanneschi L, Gustafson S, Esparcia Alcazar AI, De Falco I, Della Cioppa A, Tarantino E (eds) Proceedings of the 11th European conference on genetic programming, EuroGP 2008. Springer, Berlin, pp 73–85
48. Langdon W, Harrison A (2008) GP on SPMD parallel graphics hardware for mega bioinformatics data mining. Soft Comput Fusion Found Methodol Appl 12(12):1169–1183
49. Langdon WB (2011) Graphics processing units and genetic programming: an overview. Soft Comput 15:1657–1669
50. Li J, Wan D, Chi Z, Hu X (2007) An efficient fine-grained parallel particle swarm optimization method based on GPU-acceleration. Int J Innov Comput Inf Control 3(6):1707–1714
51. Li J, Chi Z, Wan D (2008) Parallel genetic algorithm based on fine-grained model with GPU-accelerated. Control Decis 23(6)
52. Li J, Hu X, Pang Z, Qian K (2009a) A parallel ant colony optimization algorithm based on fine-grained model with GPU acceleration. Int J Innov Comput Inf Control 5(11(A)):3707–3716
53. Li J, Zhang L, Liu L (2009b) A parallel immune algorithm based on fine-grained model with GPU-acceleration. In: Proceedings of the 2009 fourth international conference on innovative computing, information and control, ICICIC ’09. IEEE Computer Society, Washington, DC, pp 683–686
54. Luo Z, Yang Z, Liu H, Lv W (2005) GA computation of 3-SAT problem on graphic process unit. Environ Bioindic 1:7–11
55. Luo Z, Liu H (2006) Cellular genetic algorithms and local search for 3-SAT problem on graphic hardware. In: IEEE congress on evolutionary computation, CEC 2006, pp 2988–2992
56. Luong TV, Melab N, Talbi EG (2009) Parallel local search on GPU. Rapport de recherche RR-6915, INRIA
57. Luong TV, Melab N, Talbi EG (2010a) Large neighborhood local search optimization on graphics processing units. In: 2010 IEEE international symposium on parallel distributed processing, workshops and Phd forum (IPDPSW), pp 1–8
58. Luong TV, Melab N, Talbi EG (2010b) Local search algorithms on graphics processing units. A case study: the permutation perceptron problem. In: EvoCOP, pp 264–275
59. Luong TV, Melab N, Talbi EG (2010c) Neighborhood structures for GPU-based local search algorithms. Parallel Process Lett 20(4):307–324
60. Luong TV (2011) Métaheuristiques parallèles sur GPU. Ph.D. thesis, Université des Sciences et Technologie de Lille-Lille I (This thesis is written in English)
61. Luong TV, Melab N, Talbi EG (2011a) GPU-based multi-start local search algorithms. In: Coello C (ed) Learning and intelligent optimization. Lecture notes in computer science, vol 6683. Springer, Berlin, pp 321–335
62. Luong TV, Melab N, Talbi EG (2011b) GPU computing for parallel local search metaheuristic algorithms. IEEE Trans Comput 99(PrePrints). http://doi.ieeecomputersociety.org/10.1109/TC.2011.206
63. Luong TV, Taillard E, Melab N, Talbi EG (2012) Parallelization strategies for hybrid metaheuristics using a single GPU and multi-core resources. In: Coello C, Cutello V, Deb K, Forrest S, Nicosia G, Pavone M (eds) Parallel problem solving from nature-PPSN XII. Lecture notes in computer science, vol 7492. Springer, Berlin, pp 368–377
64. Maitre O, Lachiche N, Collet P (2010) Fast evaluation of GP trees on GPGPU by optimizing hardware scheduling. In: Proceedings of the 13th European conference on genetic programming, EuroGP’10. Springer, Berlin, pp 301–312
65. Melab N, Talbi EG, Cahon S, Alba E, Luque G (2006) Parallel metaheuristics: models and frameworks. In: Talbi EG (ed) Parallel combinatorial optimization. Wiley, New York, pp 149–161
66. Micikevicius P (2004) General parallel computation on commodity graphics hardware: case study with the all-Pairs shortest paths problem. In: PDPTA, pp 1359–1365
67. Mocholí J, Jaén J, Canós J (2005) A grid ant colony algorithm for the orienteering problem. In: The 2005 IEEE congress on evolutionary computation, vol 1, pp 942–949
68. Munawar A, Wahib M, Munetomo M, Akama K (2009) Hybrid of genetic algorithm and local search to solve MAX-SAT problem using nVidia CUDA framework. Genet Program Evolvable Mach, pp 391–415
69. O’Leary DP, Jung JH (2008) Implementing an interior point method for linear programs on a CPU-GPU system. Electronic Transactions on Numerical Analysis 28:174–189
70. O’Neil M.A., Tamir D., Burtscher M. A Parallel GPU Version of the Traveling Salesman Problem. http://www.gpucomputing.net/?q=node/12874. Presentation at ’PDPTA’11 - The 2011 International Conference on Parallel and Distributed Processing Techniques and Applications’
71. Pedemonte M, Nesmachnow S, Cancela H (2011) A survey on parallel ant colony optimization. Applied Soft Computing 11(8):5181–5197
72. Ralphs TK, Ladányi L, Saltzman MJ (2003) Parallel Branch, Cut, and Price for Large-Scale Discrete Optimization. Mathematical Programming 98:253–280
73. Ralphs T.K. (2006) Parallel Branch and Cut. In: E. Talbi (ed.) Parallel Combinatorial Optimization, pp. 53–101. Wiley, New York
74. Robilliard D., Marion-Poty V., Fonlupt C. (2008) Population parallel GP on the G80 GPU. In: Proceedings of the 11th European conference on Genetic programming, EuroGP’08, pp. 98–109. Springer-Verlag, Berlin, Heidelberg
75. Robilliard D., Marion V., Fonlupt C. (2009a) High performance genetic programming on GPU. In: Proceedings of the 2009 workshop on Bio-inspired algorithms for distributed systems, BADS ’09, pp. 85–94. ACM, New York, NY, USA
76. Robilliard D, Marion-Poty V, Fonlupt C (2009b) Genetic programming on graphics processing units. Genet Program Evolvable Mach 10(4):447–471
77. Rocki K, Suda R (2012) Accelerating 2-opt and 3-opt local search using GPU in the travelling salesman problem. In: 2012 international conference on high performance computing and simulation (HPCS), pp 489–495
78. Rostrup S, Srivastava S, Singhal K (2011) Fast and memory-efficient minimum spanning tree on the GPU. In: 2nd international workshop on GPUs and scientific applications (GPUScA 2011). Inderscience, Geneva
79. Sanci S, Isler V (2011) A parallel algorithm for UAV flight route planning on GPU. Int J Parallel Prog 39(6):809–837
80. Scheuermann B, So K, Guntsch M, Middendorf M, Diessel O, ElGindy H, Schmeck H (2004) FPGA implementation of population-based ant colony optimization. Special issue on hardware implementations of soft computing techniques. Appl Soft Comput 4(3):303–322
81. Scheuermann B, Janson S, Middendorf M (2007) Hardware-oriented ant colony optimization. J Syst Architect 53(7):386–402
82. Schulz C (2013) Efficient local search on the GPU—investigations on the vehicle routing problem. J Parallel Distrib Comput 73(1):14–31 (metaheuristics on GPUs)
83. Solomon S, Thulasiraman P, Thulasiram R (2011) Collaborative multi-swarm PSO for task matching using graphics processing units. In: Proceedings of the 13th annual conference on genetic and evolutionary computation, GECCO ’11. ACM, New York, pp 1563–1570
84. Spampinato D, Elster A (2009) Linear optimization on modern GPUs. In: IEEE international symposium on parallel distributed processing, 2009. IPDPS 2009, pp 1 –8
85. Spiessens P, Manderick B (1991) A massively parallel genetic algorithm implementation and first analysis. In: Proceedings of 4th international conference on genetic algorithms
86. Stivala A, Stuckey P, Wirth A (2010) Fast and accurate protein substructure searching with simulated annealing and GPUs. BMC Bioinf 11(1):446
87. Talbi E (2006) Parallel combinatorial optimization. In: Wiley series on parallel and distributed computing. Wiley-Interscience, New York
88. Tran QN (2010) Designing efficient many-core parallel algorithms for all-pairs shortest-paths using CUDA. In: Proceedings of the 2010 seventh international conference on information technology: new generations, ITNG ’10. IEEE Computer Society, Washington, DC, pp 7–12
89. Uchida A, Ito Y, Nakano K (2012) An efficient GPU implementation of ant colony optimization for the traveling salesman problem. In: Third international conference on networking and computing, pp 94–102
90. Wang J, Dong J, Zhang C (2009) Implementation of ant colony algorithm based on GPU. In: Sixth international conference on computer graphics, imaging and visualization, 2009. CGIV ’09, pp 50–53
91. Weiss RM (2010) GPU-accelerated data mining with swarm intelligence. Honors thesis. Department of Computer Science, Macalester College. http://metislogic.net/thesis.pdf
92. Wikipedia (2013) Streaming SIMD extensions. http://en.wikipedia.org/wiki/Streaming_SIMD_Extensions
93. Wong ML, Wong TT, Fok KL (2005) Parallel evolutionary algorithms on graphics processing unit. In: The 2005 IEEE congress on evolutionary computation, 2005. vol 3, pp 2286–2293
94. Wong ML, Wong TT (2006) Parallel hybrid genetic algorithms on consumer-level graphics hardware. In: IEEE congress on evolutionary computation, 2006. CEC 2006, pp 2973–2980
95. Wong ML (2009) Parallel multi-objective evolutionary algorithms on graphics processing units. In: Proceedings of the 11th annual conference companion on genetic and evolutionary computation conference: late breaking papers, GECCO ’09. ACM, New York, pp 2515–2522
96. You YS (2009) Parallel ant system for traveling salesman problem on GPUs. http://www.gpgpgpu.com/gecco2009. Entry in ’GPUs for genetic and evolutionary computation’ competition, GECCO 2009
97. Yu Q, Chen C, Pan Z (2005) Parallel genetic algorithms on programmable graphics hardware. In: Wang L, Chen K, Ong Y (eds) ICNC 2005, LNCS, vol 3612, pp 1051–1059
98. Zhao J, Liu Q, Wang W, Wei Z, Shi P (2011) A parallel immune algorithm for traveling salesman problem and its application on cold rolling scheduling. Inf Sci 181(7):1212–1223
99. Zhu W, Curry J, Marquez A (2010) SIMD tabu search for the quadratic assignment problem with graphics hardware acceleration. Int J Prod Res 48(4):1035–1047