An infinite-dimensional convergence theory for reduced SQP methods in Hilbert space

SIAM Journal on Optimization

Volumn 6, Issue 1, 1996, Pages 126-163

  Kupfer, F S ^a  

^a UNIVERSITY OF TRIER   (Germany)

Author keywords

Compact operators; Equality constraints; Infinite dimensional optimization; Null space parametrization; Optimal control; Quasi Newton methods; Reduced successive quadratic programming; Two step superlinear convergence

Indexed keywords

EID: 0030304773     PISSN: 10526234     EISSN: None     Source Type: Journal    
DOI: 10.1137/0806008     Document Type: Article

References (44)

1. W. ALT, The Lagrange-Newton method for infinite-dimensional optimization problems, Numer. Funct. Anal. Optim., 11 (1990), pp. 201-224.
2. P. T. BOGGS, J. W. TOLLE, AND P. WANG, On the local convergence of quasi-Newton methods for constrained optimization, SIAM J. Control Optim., 20 (1982), pp. 161-171.
3. C. G. BROYDEN, J. E. DENNIS, AND J. J. MORÉ, On the local and superlinear convergence of quasi-Newton methods, J. Inst. Math. Appl., 12 (1973), pp. 223-245.
4. R. H. BYRD, An example of irregular convergence in some constrained optimization methods that use the projected Hessian, Math. Programming, 32 (1985), pp. 232-237.
5. _, On the convergence of constrained optimization methods with accurate Hessian information on a subspace, SIAM J. Numer. Anal., 27 (1990), pp. 141-153.
6. R. H. BYRD AND J. NOCEDAL, A tool for the analysis of quasi-Newton methods with application to unconstrained minimization, SIAM J. Numer. Anal., 26 (1989), pp. 727-739.
7. _, An analysis of reduced Hessian methods for constrained optimization, Math. Programming, 49 (1991), pp. 285-323.
8. R. H. BYRD AND R. B. SCHNABEL, Continuity of the null space basis and constrained optimization, Math. Programming, 35 (1986), pp. 32-41.
9. T. F. COLEMAN AND A. R. CONN, On the local convergence of a quasi-Newton method for the nonlinear programming problem, SIAM J. Numer. Anal., 21 (1984), pp. 755-769.
10. T. F. COLEMAN AND D. C. SORENSEN, A note on the computation of an orthonormal basis for the null space of a matrix, Math. Programming, 29 (1984), pp. 234-242.
11. J. E. DENNIS AND J. J. MORÉ, A characterization of superlinear convergence and its application to quasi-Newton methods, Math. Comp., 28 (1974), pp. 549-560.
12. R. FONTECILLA, Local convergence of secant methods for nonlinear constrained optimization, SIAM J. Numer. Anal., 25 (1988), pp. 692-712.
13. D. GABAY, Minimizing a differentiable function over a differential manifold, J. Optim. Theory Appl., 37 (1982), pp. 177-219.
14. _, Reduced quasi-Newton methods with feasibility improvement for nonlinearly constrained optimization, Math. Programming Study, 16 (1982), pp. 18-44.
15. J. C. GILBERT, Sur quelques problèmes d'identification et d'optimisation rencontrés en physique des plasmas, Ph.D. thesis, Université Paris VI, 1986.
16. _, Une méthode de quasi-Newton réduite en optimisation sous contraintes avec priorité à la restauration, in Proc. 7th Internat. Conf. Analysis and Optimization of Systems, A. Bensoussan and J. L. Lions, eds., Springer-Verlag, Heidelberg, 1986, pp. 40-53.
17. _, On the local and global convergence of a reduced quasi-Newton method, Optimization, 20 (1989), pp. 421-450.
18. P. E. GILL, W. MURRAY, M. A. SAUNDERS, G. W. STEWART, AND M. H. WRIGHT, Properties of a representation of a basis for the null space, Math. Programming, 33 (1985), pp. 172-186.
19. J. GOODMAN, Newton's method for constrained optimization, Math. Programming, 33 (1985), pp. 162-171.
20. A. GRIEWANK, Rates of convergence for secant methods on nonlinear problems in Hilbert space, in Numerical Analysis, Proc. Guanajuato, Mexico, 1984, J. P. Hennart, ed., Springer-Verlag, Heidelberg, 1986, pp. 138-157.
21. C. W. GROETSCH, Elements of Applicable Functional Analysis, Marcel Dekker, Inc., New York, 1980.
22. S.-P. HAN, Superlinearly convergent variable metric algorithms for general nonlinear programming problems, Math. Programming, 11 (1976), pp. 263-282.
23. H. HERMES AND J. P. LASALLE, Functional Analysis and Time Optimal Control, Academic Press, New York, 1969.
24. W. HOYER, Variants of the reduced Newton method for nonlinear equality constrained optimization problems, Optimization, 17 (1986), pp. 757-774.
25. D. M. HWANG AND C. T. KELLEY, Sequential quadratic programming for parameter identification problems, in 5th Symp. Control of Distributed Parameter Systems, A. E. Jai and M. Amouroux, eds., 1989, pp. 105-109.
26. L. V. KANTOROVICH AND G. P. AKILOV, Functional Analysis, 2nd ed., Pergamon Press, New York, 1982.
27. C. T. KELLEY AND E. W. SACHS, Quasi-Newton methods and unconstrained optimal control problems, SIAM J. Control Optim., 25 (1987), pp. 1503-1516.
28. C. T. KELLEY, E. W. SACHS, AND B. WATSON, Pointwise quasi-Newton method for unconstrained optimal control problems, II, J. Optim. Theory Appl., 71 (1991), pp. 535-547.
29. C. T. KELLEY AND S. J. WRIGHT, Sequential quadratic programming for certain parameter identification problems, Math. Programming, 51 (1991), pp. 281-305.
30. K. KUNISCH AND E. W. SACHS, Reduced SQP methods for parameter identification problems, SIAM J. Numer. Anal., 29 (1992), pp. 1793-1820.
31. F.-S. KUPFER, Reduced Successive Quadratic Programming in Hilbert Space with Applications to Optimal Control, Ph.D. Thesis, Universität Trier, 1992.
32. F.-S. KUPFER AND E. W. SACHS, A prospective look at SQP methods for semilinear parabolic control problems, in Optimal Control of Partial Differential Equations, Irsee 1990, K.-H. Hoffmann and W. Krabs, eds., Vol. 149, Springer Lect. Notes in Control and Information Sciences, 1991, pp. 143-157.
33. _, Numerical solution of a nonlinear parabolic control problem by a reduced SQP method, Comput. Optim. Appl., 1 (1992), pp. 113-135.
34. K. C. P. MACHIELSEN, Numerical Solution of Optimal Control Problems with State Constraints by Sequential Quadratic Programming in Function Space, CWI Tract 53, Amsterdam, 1988.
35. H. MAURER, First and second order sufficient optimality conditions in mathematical programming and optimal control, Math. Programming Study, 14 (1981), pp. 163-177.
36. J. NOCEDAL AND M. L. OVERTON, Projected Hessian updating algrrithms for nonlinearly constrained optimization, SIAM J. Numer. Anal., 22 (1985), pp. 821-850.
37. M. J. D. POWELL, The convergence of variable metric methods for nonlinearly constrained optimization calculations, in Nonlinear Programming 3, O. L. Mangasarian, R. R. Meyer, and S. M. Robinson, eds., Academic Press, New York, 1978, pp. 27-63.
38. E. W. SACHS, Successive quadratic programming in function space, Tech. report, Universität Trier, Fachbereich IV-Mathematik, 1991.
39. J. STOER AND R. A. TAPIA, The local convergence of sequential quadratic programming methods for solving nonlinear programs, Tech. Report 87-4, Department of Mathematical Sciences, Rice University, Houston, TX, 1987.
40. R. A. TAPIA, Diagonalized multiplier methods and quasi-Newton methods for constrained optimization, J. Optim. Theory Appl., 22 (1977), pp. 135-194.
41. _, Quasi-Newton methods for equality constrained optimization: Equivalence of existing methods and a new implementation, in Nonlinear Programming 3, O. L. Mangasarian, R. R. Meyer, and S. M. Robinson, eds., Academic Press, New York, 1978, pp. 125-164.
42. _, On secant updates for use in general constrained optimization, Math. Comp., 51 (1988), pp. 181-202.
43. Y. YUAN, An only 2-step q-superlinear convergence example for some algorithms that use reduced Hessian approximations, Math. Programming, 32 (1985), pp. 224-231.
44. J. ZHANG AND D. ZHU, A trust region typed dogleg method for nonlinear optimization, Optimization, 21 (1990), pp. 543-557.