Comparative study of derivative free optimization algorithms

IEEE Transactions on Industrial Informatics

Volumn 7, Issue 4, 2011, Pages 592-600

  Pham, Nam ^a   Malinowski, A ^b   Bartczak, T ^c  

^a AUBURN UNIVERSITY   (United States)

^b BRADLEY UNIVERSITY   (United States)

^c UNIVERSITY OF INFORMATION TECHNOLOGY AND MANAGEMENT   (Poland)

Author keywords

differential evolution algorithm (DE); genetic algorithm (GA); particle swarm optimization (PSO); quasi gradient method; Simplex method

Indexed keywords

BENCHMARK FUNCTIONS; COMPARATIVE STUDIES; CONVERGENCE RATES; CONVERGENCE SPEED; DERIVATIVE-FREE OPTIMIZATION; DIFFERENTIAL EVOLUTION ALGORITHMS; FAST CONVERGENCE; FASTER CONVERGENCE; IMPROVED ALGORITHM; KEY FEATURE; LARGE-SCALE PROBLEM; OPTIMIZATION ALGORITHMS; PARTICLE SWARM ALGORITHM; QUASI-GRADIENT METHOD; SIMPLEX METHODS; SMALL SCALE;

GENETIC ALGORITHMS; GRADIENT METHODS; OPTIMIZATION; PARTICLE SWARM OPTIMIZATION (PSO); REAL VARIABLES;

CONVERGENCE OF NUMERICAL METHODS;

EID: 81255168004     PISSN: 15513203     EISSN: None     Source Type: Journal    
DOI: 10.1109/TII.2011.2166799     Document Type: Article

References (33)

1. J. A. Nelder and R. Mead, "A simplex method for function minimization," Comput. J., vol. 7, pp. 308-313, 1965.
2. K. Bredies, D. A. Lorenz, and P. Mass, "A generalized conditional gradient method and its connection to an iterative shrinkage method," Comput. Optim. Appl., vol. 42, no. 2, pp. 173-193, 2009.
3. K. Levenberg, "A method for the solution of certain problems in least squares," Quart. Appl. Mach., vol. 2, pp. 164-168, 1944.
4. A. Burmen, J. Puhan, and T. Tuma, "Grid restrained Nelder-Mead algorithm," Comput. Optim. Appl., vol. 34, no. 3, pp. 359-375, 2006.
5. C. T. Kelly, "Detection and remediation of stagnation in the Nelder-Mead algorithm using a sufficient decrease condition," SIAM J. Opt., vol. 10, pp. 43-55, 2000.
6. W. Lenwari, M. Sumner, and P. Zanchetta, "The use of genetic algorithms for the design of resonant compensators for active filter," IEEE Trans. Ind. Electron., vol. 56, no. 8, pp. 2852-2861, Aug. 2009.
7. R. Storn and K. Price, "Differential evolution-A simple and efficient heuristic for global optimization over continuous spaces," J. Glob. Optim., vol. 11, no. 4, pp. 341-359, Dec. 1997.
8. K. Price, "An Introduction to Differential Evolution," in New Ideas in Optimization, D. Corne, M. Dorigo, and F. Glover, Eds. London, U.K.: McGraw-Hill, 1999, pp. 79-108.
9. B. Biswal, P. K. Dash, and B. K. Panigrahi, "Power quality disturbance classification using fuzzy C-means algorithm and adaptive particle swarm optimization," IEEE Trans. Ind. Electron., vol. 56, no. 1, pp. 212-220, Jan. 2009.
10. S.-H. Hur, R. Katebi, and A. Taylor, "Modeling and control of a plastic film manufacturing web process," IEEE Trans. Ind. Inform., vol. 7, no. 2, pp. 171-178, May 2011.
11. C. H. Lo, E. H. K. Fung, and Y. K. Wong, "Intelligent automatic fault detection for actuator failures in aircraft," IEEE Trans. Ind. Inform., vol. 5, no. 1, pp. 50-55, Feb. 2009.
12. F. Tao, D. Zhao, Y. Hu, and Z. Zhou, "Resource service composition and its optimal-selection based on particle swarm optimization in manufacturing grid system," IEEE Trans. Ind. Inform., vol. 4, no. 4, pp. 315-327, Nov. 2008.
13. P. Zanchetta, P. W. Wheeler, J. C. Clare, M. Bland, L. Empringham, and D. Katsis, "Control design of a three-phase matrix-converter-based AC-AC mobile utility power supply," IEEE Trans. Ind. Electron., vol. 55, no. 1, pp. 209-217, 2008.
14. K. Hangyu, J. Jing, and S. Yong, "Improving crossover and mutation for adaptive genetic algorithm," Comput. Eng. Appl., vol. 12, pp. 93-96, 2006.
15. L. H. Cheng and W. Y. Ping, "Genetic algorithm with a hybrid crossover operator and its convergence," Comput. Eng. Appl., vol. 16, pp. 22-24, 2006.
16. A. K. Qin, V. L. Huang, and P. N. Suganthan, "Differential evolution algorithm with strategy adaptation for global numerical optimization," IEEE Trans. Evol. Comput., vol. 13, no. 2, pp. 398-417, Apr. 2009.
17. E. M. Montes, C. A. Coello, J. V. Ryes, and L. M. Davila, "Multiple trial vectors in differential evolution for engineering design," Eng. Optim., vol. 39, no. 5, pp. 567-589, Jul. 2007.
18. A. Slowik, "Application of an adaptive differential evolution algorithm with multiple trial vectors to artificial," IEEE Trans. Ind. Electron., vol. 58, no. 8, pp. 3160-3167, Aug. 2011.
19. S. Agrawal, Y. Dashora, M. K. Tiwari, and Y. J. Son, "Interactive particle swarm: A pareto-adaptive metaheuristic to multiobjective optimization," IEEE Trans. System, Man, Cybern, vol. 38, no. 2, pp. 258-277, 2008.
20. S. Wang, J. Watada, and W. Pedrycz, "Value-at-risk-based two-stage fuzzy facility location problems," IEEE Trans. Ind. Inform., vol. 5, no. 4, pp. 465-482, Nov. 2009.
21. G. Guo and Y. Shouyi, "Evolutionary parallel local search for function optimization," IEEE Trans. Syst., Man, Cybern., vol. 33, no. 6, pp. 864-876, 2003.
22. J. C. Lagarias, J. A. Reeds, M. H. Wright, and P. E. Wright, "Convergence properties of the Nelder-Mead simplex method in low dimensions," SIAM J. Opt., vol. 9, no. 1, pp. 112-147, 1998.
23. F. Gao and L. Han, "Implementing the Nelder-Mead simplex algorithm with adaptive parameters," Comput. Optim. Appl., May 4, 2010.
24. Torczon, "V.: Multi-directional search: A direct search algorithm for parallel machines," Ph.D. dissertation, Rice Univ., Houston, TX, 1989.
25. M. Manic and B. M. Wilamowski, "Random weights search in compressed neural networks using overdetermined pseudoinverse," in Proc. IEEE Int. Symp. Ind. Electron. 2003, 2003, vol. 2, pp. 678-683.
26. N. Pham and B. M. Wilamowski, "Improved Nedler Mead's simplex method and applications," J. Comput., vol. 3, no. 3, pp. 55-63, Mar. 2011, 2011.
27. C. J. Chung and R. G. Reynolds, "Function optimization using evolutionary programming with self-adaptive cultural algorithms," in Proc. SEAL'96 Selected Papers from the 1st Asia-Pacific Conf. Simulated Evol. Learning.
28. J. J. More, B. S. Garbow, and K. E. Hillstrom, "Testing unconstrained optimization software," ACM Trans. Math. Softw., vol. 7, no. 1, pp. 136-140, 1981.
29. J. T. Betts, "Solving the nonlinear least square problem: Application of a general method," J. Opt. Theory Appl., vol. 18, no. 4, pp. 469-483, 1976.
30. K. M. Bryden, D. A. Asklock, S. Corn, and S. J.Wilson, "Graph-based evolutionary algorithms," IEEE Trans. Evol. Comput., vol. 10, no. 5, pp. 550-567, Oct. 2006.
31. J. D. Hewlett, B. M.Wilamowski, and G. Dundar, "Optimization using a modified second-order approach with evolutionary enhancement," IEEE Trans. Ind. Electron., vol. 55, no. 9, pp. 3374-3380, Sep. 2008.
32. C. J. Price, I. D. Coope, and D. Byatt, "A convergent variant of the Nelder-Mead algorithm," J. Opt. Theory Appl., vol. 11, no. 3, pp. 5-19, 2002.
33. L. Nazareth and P. Tseng, "Gilding the Lily: A variant of the Nelder-Mead algorithm based on golden-section search," Comput. Optim. Appl, vol. 22, no. 1, pp. 133-144, 2002.