A first-order convergence analysis of trust-region methods with inexact Jacobians

SIAM Journal on Optimization

Volumn 19, Issue 1, 2008, Pages 307-325

  Walther, Andrea ^a  

^a DRESDEN UNIVERSITY OF TECHNOLOGY   (Germany)

Author keywords

Global convergence; Inexact Jacobians; Trust region algorithms

Indexed keywords

CONVERGENCE OF NUMERICAL METHODS; QUADRATIC PROGRAMMING;

APPROXIMATION QUALITIES; CONVERGENCE ANALYSIS; CORRESPONDING CRITERION; EQUALITY CONSTRAINTS; EQUALITY-CONSTRAINED OPTIMIZATIONS; FIRST ORDERS; FIRST-ORDER DERIVATIVES; GLOBAL CONVERGENCE; INEXACT JACOBIANS; MINIMIZATION PROBLEMS; OPTIMALITY; OPTIMIZATION METHODS; OPTIMIZATION PROCESS; SEQUENTIAL QUADRATIC PROGRAMMING ALGORITHMS; TRUST REGIONS; TRUST-REGION ALGORITHMS; TRUST-REGION METHODS;

CONSTRAINED OPTIMIZATION;

EID: 61349174687     PISSN: 10526234     EISSN: None     Source Type: Journal    
DOI: 10.1137/050634530     Document Type: Article

References (29)

1. A. ARORA AND L. BIEGLER, A trust region SQP algorithm for equality constrained parameter estimation with simple parameter bounds, Comput. Optim. Appl., 28 (2004), pp. 51-86.
2. R. BYRD, Robust trust region methods for constrained optimization, in Proceedings of the Third SIAM Conference on Optimization, Houston, 1987.
3. R. BYRD, F. CURTIS, AND J. NOCEDAL, Inexact SQP Methods for Equality Constrained Optimization, Tech. report, Northwestern University, Evanston, IL, 2006.
4. R. BYRD, J. GILBERT, AND J. NOCEDAL, A trust region method based on interior point techniques for nonlinear programming, Math. Program., 89A (2000), pp. 149-185.
5. M. CELIS, J. DENNIS, AND R. TAPIA, A trust region strategy for nonlinear equality constrained optimization, in Numerical Optimization, 1984, P. T. Boggs, R. H. Byrd, and R. B. Schnabel, eds., SIAM, Philadelphia, 1985.
6. A. CONN, N. GOULD, AND P. TOINT, Convergence of quasi-Newton matrices generated by the symmetric rank one update, Math. Program., 50A (1991), pp. 177-196.
7. A. CONN, N. GOULD, AND P. TOINT, Trust-region Methods, SIAM, Philadelphia, 2000.
8. J. DENNIS, M. EL-ALEM, AND M. MACIEL, A global convergence theory for general trust-region-based algorithms for equality constrained optimization, SIAM J. Optim., 7 (1997), pp. 177-207.
9. M. EL-ALEM, A global convergence theory for the Celis-Dennis-Tapia trust-region algorithm for constrained optimization, SIAM J. Numer. Anal., 28 (1991), pp. 266-290.
10. R. FLETCHER, N. GOULD, S. LEYFFER, P. TOINT, AND A. WÄCHTER, Global convergence of a trust-region SQP-filter algorithm for general nonlinear programming, SIAM J. Optim., 13 (2003), pp. 635-659.
11. R. FLETCHER AND S. LEYFFER, Nonlinear programming without a penalty function, Math. Program., 91A (2002), pp. 239-269.
12. R. FLETCHER, S. LEYFFER, AND P. TOINT, On the global convergence of a filter-SQP algorithm, SIAM J. Optim., 13 (2002), pp. 44-59.
13. F. GOMES, M. MACIEL, AND J. MARTINEZ, Nonlinear programming algorithms using trust regions and augmented Lagrangians with nonmonotone penalty parameters, Math. Program., 84A (1999), pp. 161-200.
14. A. GRIEWANK, Evaluating Derivatives: Principles and Techniques of Algorithmic Differentiation, Frontiers in Appl. Math. 19, SIAM, Philadelphia, 2000.
15. A. GRIEWANK AND A. WALTHER, On constrained optimization by adjoint-based quasi-Newton methods, Optim. Methods Softw., 17 (2002), pp. 869-889.
16. A. GRIEWANK, A. WALTHER, AND M. KORZEC, Maintaining factorized KKT systems subject to rank-one updates of Hessians and Jacobians, Optim. Methods Softw., 22 (2007), pp. 279-295.
17. M. HEINKENSCHLOSS AND L. VICENTE, Analysis of inexact trust-region SQP algorithms, SIAM J. Optim., 12 (2001), pp. 283-302.
18. H. JÄGER AND E. SACHS, Global convergence of inexact reduced SQP methods, Optim. Methods Softw., 7 (1997), pp. 83-110.
19. L. JIANG, L. BIEGLER, AND G. FOX, Optimization of pressure swing adsorption systems for air separation, AIChE J., 49 (2003), pp. 1140-1157.
20. M. LALEE, J. NOCEDAL, AND T. PLANTENGA, On the implementation of an algorithm for large-scale equality constrained optimization, SIAM J. Optim., 8 (1998), pp. 682-706.
21. F. LEIBFRITZ AND E. SACHS, Inexact SQP interior point methods and large scale optimal control problems, SIAM J. Control Optim., 38 (1999), pp. 272-293.
22. J. NOCEDAL AND S. WRIGHT, Numerical Optimization, Springer, New York, 1999.
23. E. OMOJOKUN, Trust Region Algorithms for Optimization with Nonlinear Equality and Inequality Constraints, Ph.D. thesis, Department of Computer Science, University of Colorado, 1989.
24. M. POWELL AND Y. YUAN, A trust region algorithm for equality constrained optimization, Math. Program., 49A (1990), pp. 189-211.
25. G. SHULTZ, R. SCHNABEL, AND R. BYRD, A family of trust region based algorithms for unconstrained minimization with strong global convergence properties, SIAM J. Numer. Anal., 22 (1985), pp. 47-67.
26. M. ULBRICH AND S. ULBRICH, Non-monotone trust region methods for nonlinear equality constrained optimization without a penalty function, Math. Program., 95B (2003), pp. 103-135.
27. S. VOLKWEIN AND M. WEISER, Affine invariant convergence analysis for inexact augmented Lagrangian-SQP methods, SIAM J. Control Optim., 41 (2002), pp. 875-899.
28. A. WALTHER AND L. BIEGLER, A Trust-Region Algorithm for Nonlinear Programming Problems with Dense Constraint Jacobians, Tech. report MATH-WR-01-2007, TU Dresden, submitted.
29. R. WALTZ AND J. NOCEDAL, KNITRO User's Manual, Tech. report OTC 05/2003, Optimization Technology Center, Northwestern University, Evanston, IL, 2003.