A global convergence theory for general trust-region-based algorithms for equality constrained optimization

SIAM Journal on Optimization

Volumn 7, Issue 1, 1997, Pages 177-207

  Dennis Jr , J E ^a   El Alem, Mahmoud ^b   Maciel, Maria C ^c  

^a Rice University   (United States)

^b Alexandria University Faculty Of Science   (Egypt)

^c UNIVERSIDAD NACIONAL DEL SUR   (Argentina)

Author keywords

Conjugate gradient; Constrained optimization; Equality constrained; Global convergence; Inexact Newton Method; Nonlinear programming; Trust regions

Indexed keywords

EID: 0031542597     PISSN: 10526234     EISSN: None     Source Type: Journal    
DOI: 10.1137/S1052623492238881     Document Type: Article

References (34)

1. C. BISCHOF, A. CARLE, G. CORLISS, A. GRIEWANK, AND P. HOVLAND, Adifor - generating derivative codes from fortran programs, Sci. Programming, 1 (1992), pp. 11-29.
2. R. H. BYRD, R. B. SCHNABEL, AND G. A. SHULTZ, A trust region algorithm for nonlinearly constrained optimization, SIAM J. Numer. Anal., 24 (1987), pp. 1152-1170.
3. R. CARTER, Multi-Model Algorithms for Optimization, Ph.D. thesis, Department of Mathematical Sciences, Rice University, Houston, TX, 1986.
4. M. R. CELIS, J. E. DENNIS JR., AND R. A. TAPIA, A trust region strategy for nonlinear equality constrained optimization, in Numerical Optimization 1984, SIAM, Philadelphia, PA, 1985.
5. E. CRAIG, The n-step iteration procedures, J. Math. Physics, 34 (1955), pp. 64-73.
6. J. E. DENNIS JR. AND R. M. LEWIS, A Comparison of Nonlinear Programming Approaches to an Elliptic Inverse Problem and a New Domain Decomposition Approach, Tech. report, Department of Computational and Applied Mathematics, Rice University, Houston, TX, 1994, in preparation.
7. J. E. DENNIS JR. AND R. B. SCHNABEL, Numerical Methods for Unconstrained Optimization and Nonlinear Equations, Prentice-Hall, Englewood Cliffs, NJ. 1983. Russian edition, Mir Publishing office, Moscow,1988, O. Burdakov, translator.
8. M. M. EL-ALEM, A Global Convergence Theory for a Class of Trust Region Algorithms for Constrained Optimization, Ph.D. thesis, Department of Mathematical Sciences, Rice University, Houston, TX, 1988.
9. M. M. EL-ALEM, A global convergence theory for the Celis-Dennis-Tapia trust region algorithm for constrained optimization, SIAM J. Numer. Anal., 28 (1991), pp. 266-290.
10. M. M. EL-ALEM, A robust trust-region algorithm with nonmonotonic penalty parameter scheme for constrained optimization, SIAM J. Optim., 5 (1995), pp. 348-378.
11. M. EL-HALLABI AND R. TAPIA, A Global Convergence Theory for Arbitrary Norm Trust Region Methods for Nonlinear Equations, Tech. report TR93-41(replaces 87-25), Department of Computational and Applied Mathematics, Rice University, Houston, TX, submitted.
12. R. FLETCHER, A class of methods for nonlinear programming with termination and convergence properties, in Integer and Nonlinear Programming, J. Abadie, ed., North-Holland, Amsterdam, 1970.
13. R. FLETCHER, An exact penalty function for nonlinear programming with inequalities, Math. Programming, 5 (1973), pp. 129-150.
14. R. FLETCHER, Practical Methods of Optimization, John Wiley & Sons, New York, 1987.
15. P. GILL, W. MURRAY, M. SAUNDERS, AND M. WRIGHT, Some Theoretical Properties of an Augmented Lagrangian Merít Function, Tech. Report SOL 86-6, Stanford University, Stanford, CA, 1986.
16. P. GILL, W. MURRAY, AND M. WRIGHT, Practical Optimization, Academic Press, New York, 1981.
17. M. C. MACIEL, A Global Convergence Theory for a General Class of Trust Region Algorithm for Equality Constrained Optimization, Ph.D. thesis, Department of Computational and Applied Mathematics, Rice University, Houston, TX, 1992.
18. J. J. MORÉ, Recent developments in algorithms and software for trust region methods, in Mathematical Programming. The State of the Art, A. Bachem, M. Grotschel, and B. Korte, eds., Springer-Verlag, New York, 1983, pp. 258-287.
19. J. J. MORÉ AND D. C. SORENSEN, Computing a trust region step, SIAM J. Sci. Statist. Comput., 4 (1983), pp. 553-572.
20. S. G. NASH, Preconditioning of truncated-Newton methods, SIAM J. Sci. Statist. Comput., 6 (1985), pp. 599-616.
21. E. O. OMOJUKUN, Trust Region Strategies for Optimization with Nonlinear Equality and Inequality Constraints, Ph.D. thesis, Department of Computer Science, University of Colorado, Boulder, CO, 1989.
22. M. J. D, POWELL, Convergence properties of a class of minimization algorithms, in Nonlinear Programming 2, O. Mangasarian, R. Meyer, and S. Robinson, eds., Academic Press, New York, 1975, pp. 1 -27.
23. M. J. D. POWELL AND Y. YUAN, A trust region algorithm for equality constrained optimization, Math. Programming, 49 (1991), pp. 189-211.
24. K. SCHITTKOWSKI, On the convergence of a sequential quadratic programming method with an augmented Lagrangian line, search function, Math. Operationsforch. Statist. Ser. Optim., 14 (1983), pp. 197-216.
25. G. A. SHULTZ, R. B, SCHNABEL, AND R. H. BYRD, A family of trust-region-based algorithms for unconstrained minimization with strong global convergence properties, SIAM J. Numer. Anal., 22 (1985), pp. 47-67.
26. D. SORENSEN, Newton's method with a model trust region modification, SIAM J. Numer. Anal., 19 (1982), pp. 409-426.
27. T. STEIHAUG, The conjugate gradient method and trust regions in large scale optimization, SIAM J. Numer. Anal., 20 (1983), pp. 626-637.
28. R. A. TAPIA, Quasi-Newton methods for equality constrained optimization: Equivalence of existing methods and a new implementation, in Nonlinear Programming 3, O. Mangasarian, R. Meyer, and S. Robinson, eds., Academic Press, New York, 1978, pp. 125-164.
29. R. A. TAPIA, On secant update for use in general constrained optimization, Math. Comp., 51 (1988), pp. 181-202.
30. P. L. TOINT, Towards an efficient sparsity exploiting Newton method for minimization, Tech. Report 80/4, Departément de Mathématique, Facultés Universitaires de Namur, Belgium, 1980.
31. A. VARDI, Trust Region Strategies for Unconstrained and Constrained Minimization, Ph.D. thesis, School of Operations Research and Industrial Engineering, Cornell University, Ithaca, NY, 1980.
32. A. VARDI, A trust region algorithm for equality constrained minimization: Convergence properties and implementation, SIAM J. Numer. Anal., 22 (1985), pp. 575-591.
33. K. A. WILLIAMSON, A robust trust region algorithm for nonlinear programming, Ph.D. thesis, Department of Mathematical Sciences, Rice University, Houston, TX, 1990.
34. J. ZHANG, N.-H. KlM, AND L. LASDON, An improved successive linear programming algorithm, Management Sci., 31 (1985), pp. 1312-1331.