Survey of trust-region derivative free optimization methods

Journal of Industrial and Management Optimization

Volumn 3, Issue 2, 2007, Pages 321-334

  Karasözen, Bülent ^a  

^a MIDDLE EAST TECHNICAL UNIVERSITY   (Turkey)

Author keywords

Derivative free optimization; Multi variate interpolation; Partially separable functions; Trust region methods

Indexed keywords

EID: 56649101679     PISSN: 15475816     EISSN: 1553166X     Source Type: Journal    
DOI: 10.3934/jimo.2007.3.321     Document Type: Article

References (33)

1. A. M. Bagirov, J. Ugon, Piecewise partially separable functions and a derivative-free method for large-scale nonsmooth optimization Journal of Global Optimization 35, (2006), 163-195.
2. F. V. Berghen, H. Bersini, CONDOR a new parallel, constrained extension of Powell's UOBYQA algorithm: Experimental results and comparison with the DFO algorithm, Journal of Computational and Applied Mathematics, 181 (2005), 157-175.
3. A. Bouaricha, J. J. Moré, Impact of Partial Separability on Large-Scale Optimization, Computational Optimization and Applications, 7, (1997), 2740.
4. B. Colson, Ph. L. Toint, Exploiting band structure m unconstrained optimization without derivatives, in "Trends in Industrial and Applied Mathematics" (eds: A.H. Siddiqi, M. Kocvara), Vol. 72 Applied Optimization, Kluwer, 2002, 131-147.
5. B. Colson, Ph. L. Toint, A derivative-free algorithm for sparse unconstrained optimization problems, Optimization and Engineering, 2 (2001), 349-412.
6. B. Colson, Ph. L. Toint, Optimizing partially separable functions without derivatives, Optimization Methods and Software, 20 (2005), 493-508.
7. A. R. Conn, N. I. M. Gould, Ph. L. Toint, "LANCELOT: a FORTRAN Package for Large-Scale Nonlinear Optimization," Springer Verlag, 1992.
8. A. R. Conn, Ph. L. Toint, An algorithm using quadratic interpolation for unconstrained derivative free optimization, in "Nonlinear Optimization and Applications" (eds: G. Di Pillo and F. Gianessi), Plenum Publishing, New York, (1996), 27-47
9. A. R. Conn, K. Scheinberg, Ph. L. Toint, On the convergence of derivative-free methods for unconstrained optimization, in "Approximation Theory and Optimization: Tribute to M.J.D. Powell" (eds: A. Iserles, M. Buhmann), Cambridge University Press, (1997), 83-108.
10. A. R. Conn, K. Scheinberg, Ph. L. Toint, Recent Progress in unconstrained nonlinear optimization without derivatives, Mathematical Programming, 79 (1997), 397-414.
11. K. Scheinberg, Derivative free optimization method, IBM T.J. Watson Research Center, Newyork, Tech. Rep. Report 98/11, (2000).
12. A. R. Conn, K. Scheinberg, L. N. Vincente, Geometry of interpolation sets in derivative free optimization, to appear in Mathematical Programming.
13. A. R. Curtis, M. J. D. Powell, J. K. Reid On the estimation of sparse Jacobian matrices, Journal of Institute of Mathematics and Applications, 79 (1974), 117-119.
14. A. Griewank, Ph. L. Toint Partitioned variable metric updates for large scale optimization problems, Numerische Mathematik, 39 (1982), 119-137.
15. A. Griewank, Ph. L. Toint, On the constrained optimization of partially separable functions, in "Nonlinear Optimization" (ed: M. J. D. Powell), Academic Press, 1982, 301-312.
16. A. Griewank, Ph. L. Toint, Local convergence analysis of partitioned quasi-Newton updates, Numerische Mathematik, 39 (1982), 429-448.
17. A. Griewank, Ph. L. Toint, On the existence of convex decompositions of partially separable functions, Mathematical Programming, 28 (1984), 25-49.
18. T. G. Kolda, R. M. Lewis, V. Torzcon, Optimization by direct search: new perspectives of some classical and modern methods, SIAM Review, 45 (2003), 385-482.
19. P. van der Lee, T. Terlaky, T. Woudstra, A new approach to optimizing energy systems, Computer Methods in Applied Mechanics and Engineering, 190 (2001), 5297-5310.
20. M. Marazzi, J. Nocedal, Wedge trust region methods for derivative free optimization, Mathematical Programming Ser. A, 91 (2002), 289-305.
21. B. Mohammadi, O. Pironneau, "Applied Shape Optimization for Fluids," Oxford University Press, 2001.
22. J.J. Moré, D.C. Sorenson, Computing a trust region step, SIAM. J. Sci. Stat. Comput., 4 (1983), 553-572.
23. M. J. D. Powell, An efficient method for finding the minimum of a function of several variables without calculating derivatives, Computer Journal, 17 (1964), 175-162.
24. M. J. D. Powell, A method for minimizing a sum of squares of nonlinear functions without calculating derivatives, Computer Journal, 7 (1965), 303-307.
25. M.J.D. Powell, A direct search optimization method that models the objective and constraint functions by linear interpolation, in "Advances in Optimization and Numerical Analysis" (eds: S. Gomez and J.P. Hennart), Kluwer Academic Publishers, (1994), 51-67.
26. M. J. D. Powell, On the Lagrange functions of quadratic models that are defined by interpolation, Optimization Methods Software 16 (2001), 289-309.
27. M. J. D. Powell, UOBYQA: Unconstrained optimization by quadratic approximation, Mathematical Programming, 92 (2002), 555-582.
28. M. Schäer, B. Karasözen, Y. Uludaǧ, K. Yapici, Ö Uǧur Numerical Method for Optimizing Stirrer Configurations, Computers & Chemical Engineering, 30, (2005), 183-190.
29. M. Schäfer, B. Karasözen, K. Yapici. Ö. Ugur, Derivative Free Optimization of Stirrer Configurations, in "the Proceedings of the ENUMATH 2005 the 6th European Conference on Numerical Mathematics and Advanced Applications" (eds: A. Bermúdez, A. Gómez, D. Quintela, P. Salgado), Santiago de Compostela, Spain, July 2005, Springer, (2006), 1031-1039.
30. Ph. L. Toint, Using problem structure in derivative-free optimization, SIAG/OPT Views-and-News, 79 (2006), 11-18.
31. A. Waechter, An Interior Point Algorithm for Large-Scale Nonlinear Optimization with Applications in Process Engineering, PhD. thesis, Department of Chemical Engineering, Carnegie Mellon University (2002).
32. D. Winfried, Function and functional optimization by interpolation in data tables, PhD thesis, Harvard University, Cambridge, (1969).
33. D. Winfield, Function minimization by interpolation in a data table, Journal of the Institute of Mathematics and its Applications, 12 (1973), 339-347.