Recursive trust-region methods for multiscale nonlinear optimization

SIAM Journal on Optimization

Volumn 19, Issue 1, 2008, Pages 414-444

  Gratton, Serge ^a   Sartenaer, Annick ^b   Toint, Philippe L ^b  

^a CNES   (France)

^b UNIVERSITY OF NAMUR   (Belgium)

Author keywords

Convergence theory; Multiscale problems; Nonlinear optimization; Recursive algorithms; Simplified models

Indexed keywords

ALGEBRA; ALGORITHMS; COMPUTATIONAL FLUID DYNAMICS; IMAGE REGISTRATION; MATHEMATICAL MODELS; NONLINEAR EQUATIONS; OPTIMIZATION; PARTIAL DIFFERENTIAL EQUATIONS; RECURSIVE FUNCTIONS;

CONVERGENCE THEORY; MULTISCALE PROBLEMS; NONLINEAR OPTIMIZATION; RECURSIVE ALGORITHMS; SIMPLIFIED MODELS;

CONVERGENCE OF NUMERICAL METHODS;

EID: 61349175317     PISSN: 10526234     EISSN: None     Source Type: Journal    
DOI: 10.1137/050623012     Document Type: Article

References (45)

1. N. M. ALEXANDROV, J. E. DENNIS, R. M. LEWIS, AND V. TORCZON, A trust region framework for managing the use of approximation models, Structural Optimization, 15 (1998), pp. 16-23.
2. N. M. ALEXANDROV AND R. L. LEWIS, An overview of first-order model management for engineering optimization, Optimization and Engineering, 2 (2001), pp. 413-430.
3. N. M. ALEXANDROV, R. L. LEWIS, C. R. GUMBERT, L. L. GREEN, AND P. A. NEWMAN, Approximation and model management in aerodynamic optimization with variable fidelity models, J. Aircraft, 38 (2001), pp. 1093-1101.
4. E. ARIAN, M. FAHL, AND E. W. SACHS, Trust-Region Proper Orthogonal Decomposition for Flow Control, Technical report 2000-25, Institute for Computer Applications in Science and Engineering, NASA Langley Research Center, Hampton, VA, 2000.
5. R. E. BANK, P. E. GILL, AND R. F. MARCIA, Interior point methods for a class of elliptic variational inequalities, in High Performance Algorithms and Software for Nonlinear Optimization, Biegler et al., eds., Springer-Verlag, New York, 2003, pp. 218-235.
6. S. J. BENSON, L. C. MCINNES, J. J. MORÉ, AND J. SARICH, Scalable Algorithms in Optimization: Computational Experiments, Preprint ANL/MCS-P1175-0604, Mathematics and Computer Science, Argonne National Laboratory, Argonne, IL, 2004; in Proceedings of the 10th AIAA/ISSMO Multidisciplinary Analysis and Optimization (MA&O) Conference, Albany, NY, 2004.
7. J. T. BETTS AND S. O. ERB, Optimal low thrust trajectory to the moon, SIAM J. Appl. Dyn. Syst., 2 (2003), pp. 144-170.
8. T. BIEGLER, O. GHATTAS, M. HEINKENSCHLOSS, AND B. VAN BLOEMEN WAANDERS, EDS., High Performance Algorithms and Software for Nonlinear Optimization, Springer-Verlag, New York, 2003.
9. A. BORZI AND K. KUNISCH, A globalisation strategy for the multigrid solution of elliptic optimal control problems, Optim. Methods Softw., 21 (2006), pp. 445-459.
10. J. H. BRAMBLE, Multigrid Methods, Longman Scientific and Technical, Harlow, UK, 1993.
11. A. BRANDT, Multi-level adaptative solutions to boundary value problems, Math. Comp., 31 (1977), pp. 333-390.
12. W. L. BRIGGS, V. E. HENSON, AND S. F. MCCORMICK, A Multigrid Tutorial, 2nd ed., SIAM, Philadelphia, 2000.
13. A. R. CONN, N. I. M. GOULD, AND PH. L. TOINT, Trust-Region Methods, MPS-SIAM Ser. Optim. 1, SIAM, Philadelphia, 2000.
14. M. FAHL AND E. SACHS, Reduced order modelling approaches to PDE-constrained optimization based on proper orthogonal decomposition, in High Performance Algorithms and Software for Nonlinear Optimization, Biegler et al., eds., Springer-Verlag, New York, 2003, pp. 268-281.
15. M. FISHER, Minimization algorithms for variational data assimilation, in Proceedings of the ECMWF Seminar on Recent Developments in Numerical Methods for Atmospheric Modelling, Reading, UK, 1998, pp. 364-385.
16. E. GELMAN AND J. MANDEL, On multilevel iterative methods for optimization problems, Math. Programming, 48 (1990), pp. 1-17.
17. E. M. GERTZ, Combination Trust-Region Line-Search Methods for Unconstrained Optimization, Ph.D. thesis, Department of Mathematics, University of California, San Diego, CA, 1999.
18. G. H. GOLUB AND C. F. VAN LOAN, Matrix Computations, 2nd ed., Johns Hopkins University Press, Baltimore, 1989.
19. N. I. M. GOULD, S. LUCIDI, M. ROMA, AND PH. L. TOINT, Solving the trust-region subproblem using the Lanczos method, SIAM J. Optim., 9 (1999), pp. 504-525.
20. N. I. M. GOULD, C. SAINVITU, AND PH. L. TOINT, A filter-trust-region method for unconstrained optimization, SIAM J. Optim., 16 (2005), pp. 341-357.
21. S. GRATTON, A. SARTENAER, AND PH. L. TOINT, Second-order convergence properties of trust-region methods using incomplete curvature information, with an application to multigrid optimization, 3. Comput. Appl. Math., 24 (2006),pp. 676-692.
22. A. GRIEWANK AND PH. L. TOINT, Local convergence analysis for partitioned quasi-Newton updates, Numer. Math., 39 (1982), pp. 429-448.
23. W. HACKBUSCH, Iterative Solution of Large Sparse Systems of Equations, Appl. Math. Sci. 95, Springer-Verlag, New York, 1994.
24. W. HACKBUSCH AND A. REUSKEN, Analysis of a damped nonlinear multilevel method, Numer. Math., 55 (1989), pp. 225-246.
25. P. W. HEMKER AND G. M. JOHNSON, Multigrid approach to Euler equations, in Multigrid Methods, Frontiers Appl. Math. 3, S. F. McCormick, ed., SIAM, Philadelphia, 1987, pp. 57-72.
26. R. M. LEWIS AND S. G. NASH, Practical aspects of multiscale optimization methods for VLSI-CAD, in Multiscale Optimization and VLSI/CAD, J. Cong and J. R. Shinnerl, eds., Kluwer Academic Publishers, Dordrecht, The Netherlands, 2002, pp. 265-291.
27. R. M. LEWIS AND S. G. NASH, Model problems for the multigrid optimization of systems governed by differential equations, SIAM J. Sci. Comput., 26 (2005), pp. 1811-1837.
28. J. J. MORÉ, Terascale optimal PDE solvers, in ICIAM 2003 Conference, Sydney, Australia, 2003.
29. J. J. MORÉ AND D. C. SORENSEN, On the use of directions of negative curvature in a modified Newton method, Math. Programming, 16 (1979), pp. 1-20.
30. S. G. NASH, A multigrid approach to discretized optimization problems, Optim. Methods Softw., 14 (2000), pp. 99-116.
31. Y. NESTEROV, Introductory Lectures on Convex Optimization, Appl. Optim. 87, Kluwer Academic Publishers, Dordrecht, The Netherlands, 2004.
32. J. NOCEDAL AND Y. YUAN, Combining trust region and line search techniques, in Advances in Nonlinear Programming, Y. Yuan, ed., Kluwer Academic Publishers, Dordrecht, The Netherlands, 1998, pp. 153-176.
33. J. M. ORTEGA AND W. C. RHEINBOLDT, Iterative Solution of Nonlinear Equations in Several Variables, Academic Press, London, 1970.
34. M. J. D. POWELL, A Fortran Subroutine for Unconstrained Minimization Requiring First Derivatives of the Objective Function, Technical report R-6469, AERE Harwell Laboratory, Harwell, Oxfordshire, England, 1970.
35. M. J. D. POWELL, A new algorithm for unconstrained optimization, in Nonlinear Programming, J. B. Rosen, O. L. Mangasarian, and K. Ritter, eds., Academic Press, London, 1970, pp. 31-65.
36. A. SARTENAER, Automatic determination of an initial trust region in nonlinear programming, SIAM J. Sci. Comput., 18 (1997), pp. 1788-1803.
37. T. STEIHAUG, The conjugate gradient method and trust regions in large scale optimization, SIAM J. Numer. Anal., 20 (1983), pp. 626-637.
38. PH. L. TOINT, Towards an efficient sparsity exploiting Newton method for minimization, in Sparse Matrices and Their Uses, I. S. Duff, ed., Academic Press, London, 1981, pp. 57-88.
39. PH. L. TOINT, VE08 AD, a routine for partially separable optimization with bounded variables, Harwell Subroutine Library, 2 (1983).
40. PH. L. TOINT, Non-monotone trust-region algorithms for nonlinear optimization subject to convex constraints, Math. Programming, 77 (1997), pp. 69-94.
41. U. TROTTENBERG, C. W. OOSTERLEE, AND A. SCHÜLLER, Multigrid, Elsevier, Amsterdam, The Netherlands, 2001.
42. M. ULBRICH, Nonmonotone trust-region methods for bound-constrained semismooth equations with applications to nonlinear mixed complementarity problems, SIAM J. Optim., 11 (2001), pp. 889-917.
43. P. WESSELING, An Introduction to Multigrid Methods, J. Wiley and Sons, Chichester, UK, 1992.
44. Y. XIAO AND F. ZHOU, Nonmonotone trust region methods with curvilinear path in unconstrained optimization, Computing, 48 (1992), pp. 303-317.
45. I. YAVNEH AND G. DARDYK, A multilevel nonlinear method, SIAM J. Sci. Comput., 28 (2006), pp. 24-46.