A hybrid particle swarm branch-and-bound (HPB) optimizer for mixed discrete nonlinear programming

IEEE Transactions on Systems, Man, and Cybernetics Part A:Systems and Humans

Volumn 38, Issue 6, 2008, Pages 1411-1424

  Nema, Salam ^a   Goulermas, John ^a   Sparrow, Graham ^b   Cook, Phil ^b  

^a UNIVERSITY OF LIVERPOOL   (United Kingdom)

^b Knowledge Support Systems Ltd   (United Kingdom)

Author keywords

Branch and bound (BB); Hybridization; Mixed discrete nonlinear programming (MDNLP); Particle swarm optimization (PSO)

Indexed keywords

ALGORITHMS; COMBINES; DYNAMIC PROGRAMMING; EVOLUTIONARY ALGORITHMS; GLOBAL OPTIMIZATION; NONLINEAR PROGRAMMING; OPTIMIZATION; PILE FOUNDATIONS; PROBLEM SOLVING;

BENCHMARK PROBLEMS; BRANCH AND BOUNDS; BRANCH-AND-BOUND (BB); COMPUTATIONAL RESOURCES; DETERMINISTIC ALGORITHMS; DISCRETE NONLINEAR PROGRAMMINGS; DISCRETE PROBLEMS; GLOBAL OPTIMIZATION TECHNIQUES; HYBRID PARTICLES; HYBRIDIZATION; LOCAL SEARCHES; MIXED DISCRETE NONLINEAR PROGRAMMING (MDNLP); NEW ALGORITHMS; OPTIMIZER; PENALTY FUNCTIONS; SEQUENTIAL QUADRATIC PROGRAMMINGS;

PARTICLE SWARM OPTIMIZATION (PSO);

EID: 56449104070     PISSN: 10834427     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCA.2008.2003536     Document Type: Article

References (63)

1. K. Rajaraman and P. S. Sastry, "Stochastic optimization over continuous and discrete variables with applications to concept learning under noise," IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 29, no. 6, pp. 542-553, Nov. 1999.
2. S. Leyffer, "Integrating SQP and branch-and-bound for mixed integer nonlinear programming," Comput. Optim. Appl., vol. 18, no. 3, pp. 295-309, Mar. 2001.
3. S. He, E. Prempain, and Q. H. Wu, "An improved particle swarm optimizer for mechanical design optimization problems," Eng. Optim., vol. 36, no. 5, pp. 585-605, Oct. 2004.
4. S. S. Rao and Y. Xiong, "A hybrid genetic algorithm for mixed-discrete design optimization," Trans. ASME, J. Mech. Des., vol. 127, no. 6, pp. 1100-1112, Nov. 2005.
5. S. Kitayama, M. Arakawa, and K. Yamazaki, "Penalty function approach for the mixed discrete nonlinear problems by particle swarm optimization," Struct. Multidiscpl. Optim., vol. 32, no. 3, pp. 191-202, Sep. 2006.
6. C. A. Floudas, Nonlinear and Mixed-Integer Optimization. London, U.K.: Oxford Univ. Press, 1995.
7. S. Kirkpatrick, C. D Gelatt, Jr., and M. P. Vecchi, "Optimization by simulated annealing," Science, vol. 220, no. 4598, pp. 671-680, May 1983.
8. S. Impedovo, M. G. Lucchese, and G. Pirlo, "Optimal zoning design by genetic algorithms," IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 36, no. 5, pp. 833-846, Sep. 2006.
9. Z. Michalewicz, Genetic algorithms + Data Structure = Evolution Programs, 3rd ed. New York: Springer-Verlag, 1996.
10. J. K. Koza, Genetic Programming: On the Programming of Computers by Means of Natural Selection. Cambridge, MA: MIT Press, 1992.
11. K. Rodriguez-Vazquez, C. M. Fonseca, and P. J. Fleming, "Identifying the structure of nonlinear dynamic systems using multiobjective genetic programming," IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 34, no. 4, pp. 531-545, Jul. 2004.
12. T. Back, Evolutionary Algorithms in Theory and Practice. New York: Oxford Univ. Press, 1996.
13. S. L. Cheng and C. Hwang, "Optimal approximation of linear systems by a differential evolution algorithm," IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 31, no. 6, pp. 698-707, Nov. 2001.
14. H. Pierreval and J. L. Paris, "Distributed evolutionary algorithms for simulation optimization," IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 30, no. 1, pp. 15-24, Jan. 2000.
15. W. Zhong, J. Liu, M. Xue, and L. Jiao, "A multiagent genetic algorithm for global numerical optimization," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 34, no. 2, pp. 1128-1141, Apr. 2004.
16. R. Xu, G. K. Venayagamoorthy, and D. C. Wunsch, "Modeling of gene regulatory networks with hybrid differential evolution and particle swarm optimization," Neural Netw., vol. 20, no. 8, pp. 917-927, Oct. 2007.
17. J. Lampinen, I. Zelinka, "Mixed integer-discrete-continuous optimization by differential evolution, Part 1: The optimization method," in Proc. 5th MENDEL, P. Ošmera, Ed., Brno, Czech Republic, 1999, pp. 71-76.
18. J. S. Arora and M. W. Huang, "Methods for optimization of nonlinear problems with discrete variables," Struct. Optim., vol. 8, pp. 69-85, 1994.
19. B. Borchers and J. E. Mitchell, "An improved branch and bound algorithm for mixed integer nonlinear programs," Comput. Oper. Res., vol. 21, no. 4, pp. 359-367, Apr. 1994.
20. H. T. Loh and P. Y. Papalambros, "A sequential linearization approach for solving mixed-discrete nonlinear design optimization problems," Trans. ASME, J. Mech. Des., vol. 113, pp. 325-334, 1991.
21. L. Lamberti and C. Pappalettere, "An efficient sequential linear programming algorithm for engineering optimization," J. Eng. Des. vol. 16, no. 3, pp. 353-371, Jun. 2005.
22. J. F. Fu, R. G. Fenton, and W. L. Cleghorn, "A mixed integer-discrete-continuous programming method and its application to engineering design optimization," Eng. Optim., vol. 17, no. 4, pp. 263-280, 1991.
23. D. K. Shin, Z. Gurdal, and O. H. Griffin, Jr., "A penalty approach for non-linear optimization with discrete design variables," Eng. Optim. vol. 16, no. 1, pp. 29-42, 1990.
24. A. M. Geoffrion, "Lagrangian relaxation for integer programming," Math. Program. Stud., vol. 10, pp. 237-260, 1974.
25. V. Jeet and E. Kutanoglu, "Lagrangian relaxation guided problem space search heuristics for generalized assignment problems," Eur. J. Oper. Res., vol. 182, no. 3, pp. 1039-1056, Nov. 2007.
26. J. Kennedy, and R. Eberhart, "Particle swarm optimization," in Proc. IEEE Int. Conf. Neural Netw., 1995, vol. 4, pp. 1942-1948.
27. J. Kennedy and R. C. Eberhart, Swarm Intelligence. San Mateo, CA: Morgan Kaufmann, 2001.
28. Y. Shi and R. C. Eberhart, "Empirical study of particle swarm optimization," in Proc. IEEE Int. Congr. Evol. Comput., 1999, vol. 3, pp. 101-106.
29. R. C. Eberhart and Y. Shi, "Tracking and optimizing dynamic systems with particle swarms," in Proc. IEEE Congr. Evol. Comput., Seoul, Korea, 2001, pp. 94-97.
30. C. A. C. Coello and E. M. Montes, "Constraint-handling in genetic algorithms through the use of dominance-based tournament selection," Adv. Eng. Inf., vol. 16, no. 3, pp. 193-203, Jul. 2002.
31. X. Hu and R. C. Eberhart, "Solving constrained nonlinear optimization problems with particle swarm optimization," in Proc. 6th World Multi-conference SCI, Orlando, FL, 2002.
32. K. Parsopoulos and M. N. Vrahatis, "Particle swarm optimization method for constrained optimization problems," in Intelligent Technologies - Theory and Applications: New Trends in Intelligent Technologies, ser. Frontiers in Artificial Intelligence and Applications, vol. 76, V. Sincak and J. Vascak, Eds. Amsterdam, The Netherlands: IOS Press, 2002, pp. 214-220.
33. M. Schoenauer and S. Xanthakis, "Constrained GA Optimization," in Proc. 5th Int. Conf. Genetic Algorithms, S. Forrest, Ed., Morgan Kaufmann, 1993, pp. 573-580.
34. D. Waagen, P. Diercks, and J. McDonnell, "The stochastic direction set algorithm: A hybrid technique for finding function extrema," in Proc. 1st Annu. Conf. Evol. Program., D. B. Fogel and W. Atmar, Eds., 1992, pp. 35-42.
35. H. Myung, J.-H. Kim, and D. Fogel, "Preliminary investigation into a two-stage method of evolutionary optimization on constrained problems," in Proc. 4th Annu. Conf. Evol. Program., J. R. McDonnell, G. Reynolds, and B. Fogel, Eds., MIT press, 1995, pp. 449-463.
36. J. Joines and C. Houck, "On the use of non-stationary penalty functions to solve nonlinear constrained optimization problems with GAs," in Proc. 1st IEEE Conf. Evol. Comput., 1994, pp. 579-584.
37. C. Coello, "Use of a self-adaptive penalty approach for engineering optimization problems," Comput. Ind., vol. 41, no. 2, pp. 113-127, Mar. 2000.
38. U. T. Ringertz, "On methods for discrete structural optimization," Eng. Optim., vol. 13, pp. 47-64, 1988.
39. R. E. Gomory, "An algorithm for integer solutions to linear programs," in Recent Advances in Mathematical Programming, G. W. Graves and P. Wolfe, Eds. New York: McGraw-Hill, 1963.
40. J. Bauer, W. Gutkowski, and Z. Iwanow, "A discrete method for lattice structures optimization," Eng. Optim., vol. 5, no. 2, pp. 121-128, 1981.
41. K. E. Parsopoulos and M. N. Vrahatis, "Recent approaches to global optimization problems through particle swarm optimization," Nat. Comput., vol. 1, no. 2/3, pp. 235-306, Jun. 2002.
42. S. S. Rao, Engineering Optimization, 3rd ed. New York: Wiley, 1996.
43. P. E. Gill, W. Murray, and M. H Wright, Practical Optimization. London, U.K.: Academic, 1981.
44. C. H. Tseng, L. W. Wang, and S. F. Ling, "Enhancing branch-and-bound method for structural optimization," J. Struct. Eng. - ASCE, vol. 121, no. 5, pp. 831-837, 1995.
45. M. Duran and I. E. Grossmann, "An outer-approximation algorithm for a class of mixed-integer nonlinear programs," Math. Program., vol. 36, no. 3, pp. 307-339, Dec. 1986.
46. G. G. Dimopoulos, "Mixed-variable engineering optimization based on evolutionary and social metaphors," Comput. Methods Appl. Mech. Eng. vol. 196, no. 4-6, pp. 803-817, Jan. 2007.
47. C.-F. Juang, "A hybrid of genetic algorithm and particle swarm optimization for recurrent network design," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 34, no. 2, pp. 997-1006, Apr. 2004.
48. J. E. Gallardo, C. Cotta, and A. J. Fernandez, "On the hybridization of memetic algorithms with branch-and-bound techniques," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 37, no. 1, pp. 77-83, Feb. 2007.
49. T. A. A. Victoire and A. E. Jeyakumar, "Hybrid PSO-SQP for economic dispatch with valve-point effect," Elect. Power Syst. Res., vol. 71, no. 1, pp. 51-59, 2004.
50. Y. Gao, Z. Ren, and C. Xu, "A branch and bound-PSO hybrid algorithm for solving integer separable concave programming problems," Appl. Math. Sci., vol. 1, no. 11, pp. 517-525, 2007.
51. B. Liu, L. Wang, and Y-H. Jin, "An effective PSO-based memetic algorithm for flow shop scheduling," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 37, no. 1, pp. 18-27, Feb. 2007.
52. K. Deb and M. Goyal, "Optimizing engineering designs using a combined genetic search," in Proc. 7th Int. Conf. Genetic Algorithms, T. Back, Ed., 1997, pp. 512-528.
53. Y. Q. Luo, X. G. Yuan, and Y. J. Liu, "An improved PSO algorithm for solving non-convex NLP/MINLP problems with equality constraints," Comput. Chem. Eng., vol. 31, no. 3, pp. 153-162, Jan. 2007.
54. C. T. Young, Y. Zheng, and C. W. Yeh, "Information-guided genetic algorithm approach to the solution of MINLP problems," Ind. Eng. Chem. Res., vol. 46, no. 5, pp. 1527-1537, 2007.
55. C. J. Shih, "Fuzzy and improved penalty approaches for multiobjective mixed-discrete optimization in structural systems," Comput. Struct. vol. 63, no. 3, pp. 559-565, May 1997.
56. Y.-C. Lin, K.-S. Hwang, and F.-S. Wang, "An evolutionary Lagrange method for mixed-integer constrained optimization problems," Eng. Optim., vol. 35, no. 3, pp. 267-284, Jun. 2003.
57. E. Sandgren, "Nonlinear integer and discrete programming in mechanical design optimization," J. Mech. Des., vol. 112, pp. 223-229, 1990.
58. Y. J. Cao and Q. H. Wu, "A mixed variable evolutionary progranuning for optimization of mechanical design," Int. J. Eng. Intell. Syst. Elect. Eng. Commun., vol. 7, no. 2, pp. 77-82, 1999.
59. K. Deb, "GeneAS: A robust optimal design technique for mechanical component design," in Evolutionary Algorithms in Engineering Applications. Berlin, Germany: Springer-Verlag, 1997, pp. 497-514.
60. C. A. C. Coello, E. M. Montes,"Use of dominance-based tournament selection to handle constraints in genetic algorithms," in Proc. ANNIE. vol. 11, pp. 177-182.
61. K. M. Ragsdell and D. T. Phillips, "Optimal design of a class of welded structures using geometric programming," Trans. ASME, J. Eng. Ind. vol. 98, no. 3, pp. 1021-1025, 1976.
62. H. L. Li and P. Papalambros, "A production system for use of global optimization knowledge," Trans. ASME, J. Mech. Transm. Autom. Des. vol. 107, no. 2, pp. 277-284, 1985.
63. S. Azarm and W. C. Li, "Multi-level design optimization using global monotonicity analysis," Trans. ASME, J. Mech. Transm. Autom. Des. vol. 111, no. 2, pp. 259-263, 1989.