Optimizing partially separable functions without derivatives

Optimization Methods and Software

Volumn 20, Issue 4-5, 2005, Pages 493-508

  Colson, Benoît ^a   Toint, Philippe L ^a  

^a UNIVERSITY OF NAMUR   (Belgium)

Author keywords

Derivative free optimization; Multivariate interpolation; Partially separable functions; Trust region algorithms

Indexed keywords

ALGORITHMS; FUNCTIONS; INTERPOLATION; ITERATIVE METHODS; OPTIMIZATION;

MULTIVARIATE INTERPOLATION; PARTIALLY SEPARABLE FUNCTIONS; TRUST-REGION ALGORITHMS;

NONLINEAR PROGRAMMING;

EID: 27744469963     PISSN: 10556788     EISSN: 10294937     Source Type: Journal    
DOI: 10.1080/10556780500140227     Document Type: Conference Paper

References (30)

1. Audet, C. and Dennis Jr., J.E., 2003, Analysis of generalized pattern searches. SIAM Journal on Optimization, 13(3), 889-903.
2. Coleman, T.F. and Moré, J.J., 1983, Estimation of sparse Jacobian matrices and graph coloring problems. SIAM Journal on Numerical Analysis, 20(1), 187-209.
3. Colson, B. and Toint, Ph.L., 2001, Exploiting band structure in unconstrained optimization without derivatives. Optimization and Engineering, 2(4), 399-412.
4. Colson, B. and Toint, Ph.L., 2002, A derivative-free algorithm for sparse unconstrained optimization problems. In: A.H. Siddiqi and M. Kocvara (Eds) Trends in Industrial and Applied Mathematics, Vol. 72, Applied Optimization (The Netherlands: Kluwer Academic Publishers, Dordrecht), pp. 131-147.
5. Conn, A.R., Gould, N.I.M., Sartenaer, A. and Toint, Ph.L., 1996, Convergence properties of minimization algorithms for convex constraints using a structured trust region. SIAM Journal on Optimization, 6(4), 1059-1086.
6. Conn, A.R., Gould, N.I.M. and Toint, Ph.L., 1992, LANCELOT: a Fortran Package for Large-Scale Nonlinear Optimization (Release A) (Heidelberg, New York, USA: Springer Verlag).
7. Conn, A.R., Gould, N.I.M. and Toint, Ph.L., 2000, Trust-Region Methods (Philadelphia, PA: SIAM Publications).
8. Conn, A.R., Scheinberg, K. and Toint, Ph.L., 1997, On the convergence of derivative-free methods for unconstrained optimization. In: A. Iserles and M. Buhmann (Eds) Approximation Theory and Optimization: Tributes to M. J. D. Powell (Cambridge, England: Cambridge University Press), pp. 83-108.
9. Conn, A.R., Scheinberg, K. and Toint, Ph.L., 1997, Recent progress in unconstrained nonlinear optimization without derivatives. Mathematical Programming, Series B, 79(3), 397-414.
10. Conn, A.R., Scheinberg, K. and Vicente, L.N., 2003, Error estimates and poisedness in multivariate polynomial interpolation. Pré- Publicações do Departamento de Matemática, Universidade de Coimbra, Preprint Number 03-09.
11. Curtis, A.R., Powell, M.J.D. and Reid, J.K., 1974, On the estimation of sparse Jacobian matrices. Journal of Institute of Mathematics and Applications, 13, 117-119.
12. de Boor, C. and Ron, A., 1992, Computational aspects of polynomial interpolation in several variables. Mathematics of Computation, 58(198), 705-727.
13. Gould, N.I.M., Orban, D. and Toint, Ph.L., 2003, CUTEr (and SifDec), a constrained and unconstrained testing environment, revisited. Transactions of the American Mathematical Society on Mathematical Software, 29(4), 373-394. Available online at: http://cuter.rl.ac.uk/cuter-www/.
14. Griewank, A. and Toint, P.L., 1982, Local convergence analysis of partitioned quasi-Newton updates. Numerische Mathematik, 39, 429-448.
15. Griewank, A. and Toint, P.L., 1982, On the unconstrained optimization of partially separable objective functions. In: M.J.D. Powell (Ed) Nonlinear Optimization 1981 (London, England: Academic Press), pp. 301-312.
16. Griewank, A. and Toint, P.L., 1982, Partitioned variable metric updates for large structured optimization problems. Numerische Mathematik, 39, 119-137.
17. Grippo, L., Lampariello, F. and Lucidi, S., 1988, Global convergence and stabilization of unconstrained minimization methods without derivatives. Journal of Optimization Theory and Applications, 56, 385-406.
18. Lewis, R.M., Torczon, V. and Trosset, M.W., 2002, Direct search methods: then and now. Journal of Computational and Applied Mathematics, 124(1-2), 191-207.
19. Lucidi, S. and Sciandrone, M., 1995, Numerical results for unconstrained optimization without derivatives. In: F. Giannessi and G. Di Pillo (Eds) Nonlinear Optimization and Applications (New York, NY, USA: Plenum Publishing), pp. 261-269.
20. Powell, M.J.D., 1964, An efficient method for finding the minimum of a function of several variables without calculating derivatives. Computer Journal, 17, 155-162.
21. Powell, M.J.D., 1965, A method for minimizing a sum of squares of nonlinear functions without calculating derivatives. Computer Journal, 7, 303-307.
22. Powell, M.J.D., 1970, A hybrid method for nonlinear equations. In: P. Rabinowitz (Ed) Numerical Methods for Nonlinear Algebraic Equations (London, England: Gordon and Breach), pp. 87-114.
23. Powell, M.J.D., 2002, Least Frobenius norm updating of quadratic models that satisfy interpolation conditions. Technical Report NA2002/08, Department of Applied Mathematics and Theoretical Physics, Cambridge University, Cambridge, England, UK.
24. Powell, M.J.D., 2002, On trust region methods for unconstrained minimization without derivatives. Technical Report NA2002/02, Department of Applied Mathematics and Theoretical Physics, Cambridge University, Cambridge, England, UK.
25. Powell, M.J.D., 2002, UOBYQA: unconstrained optimization by quadratic interpolation. Mathematical Programming, 92, 555-582.
26. Powell, M.J.D., 2003, On the use of quadratic models in unconstrained minimization without derivatives. Technical Report NA2003/03, Department of Applied Mathematics and Theoretical Physics, Cambridge University, Cambridge, England, UK.
27. Sauer, T., 1995, Computational aspects of multivariate polynomial interpolation. Advances in Computational Mathematics, 3, 219-238.
28. Sauer, Th. and Xu, Y., 1995, On multivariate Lagrange interpolation. Mathematics of Computation, 64, 1147-1170.
29. Toint, Ph.L., 1983, Test problems for partially separable optimization and results for the routine PSPMIN. Technical Report 83/4, Department of Mathematics, FUNDP, Namur, Belgium.
30. Torczon, V., 1997, On the convergence of pattern search algorithms. SIAM Journal on Optimization, 7(1), 1-25.