Spectral gradient methods for linearly constrained optimization

Journal of Optimization Theory and Applications

Volumn 125, Issue 3, 2005, Pages 629-651

  Martinez J M ^a   Pilotta, E A ^b   Raydan, M ^c  

^a UNIVERSITY OF CAMPINAS   (Brazil)

^b UNIVERSITY OF CÓRDOBA   (Spain)

^c UNIVERSIDAD CENTRAL DE VENEZUELA   (Venezuela)

Author keywords

Exponential penalty methods; Linearly constrained optimization; Nonmonotone line search; Quasi Newton methods; Spectral gradient method

Indexed keywords

GRADIENT METHODS; NEWTON-RAPHSON METHOD; QUADRATIC PROGRAMMING;

EXPONENTIAL PENALTY METHOD; EXPONENTIALS; INNER ITERATION; LINEARLY CONSTRAINED OPTIMIZATION; NONMONOTONE LINE SEARCH; OUTER ITERATION; PENALTY METHODS; QUASI-NEWTON METHODS; SIMPLE++; SPECTRAL GRADIENT METHOD;

CONSTRAINED OPTIMIZATION;

EID: 21444456162     PISSN: 00223239     EISSN: 15732878     Source Type: Journal    
DOI: 10.1007/s10957-005-2093-3     Document Type: Article

References (25)

1. BARZILAI, J., and BORWEIN, J. M., Two-Point Stepsize Gradient Methods, IMA Journal of Numerical Analysis, Vol. 8, pp. 141-148, 1988.
2. RAYDAN, M., On the Barzilai and Borwein Choice of Steplength for the Gradient Method, IMA Journal of Numerical Analysis, Vol. 13, pp. 321-326, 1993.
3. BIRGIN, E. G., CHAMBOULEYRON, I., and MARTÍNEZ, J. M., Estimation of Optical Constants of Thin Films Using Unconstrained Optimization, Journal of Computational Physics, Vol. 151, pp. 862-880, 1999.
4. BIRGIN, E. G., and EVTUSHENKO, Y. G., Automatic Differentiation and Spectral Projected Gradient Methods for Optimal Control Problems, Optimization Methods and Software, Vol. 10, pp. 125-146, 1998.
5. RAYDAN, M., The Barzilai and Borwein Gradient Method for the Large-Scale Unconstrained Minimization Problem, SIAM Journal on Optimization, Vol. 7, pp. 26-33, 1997.
6. BIELSCHOWSKY, R. H., FRIEDLANDER, A., GOMES, F. A. M., MARTÍNEZ, J. M., and RAYDAN, M., An Adaptive Algorithm for Bound-Constrained Quadratic Minimization, Investigación Operativa, Vol. 7, pp. 67-102, 1997.
7. FRIEDLANDER, A., MARTINEZ, J. M., and RAYDAN, M., A New Method for Large-Scale Box Constrained Convex Quadratic Minimization Problems, Optimization Methods and Software, Vol. 5, pp. 57-74, 1995.
8. BIRGIN, E. G., MARTÍNEZ, J. M., and RAYDAN, M., Nonmonotone Spectral Projected Gradient Methods on Convex Sets, SIAM Journal of Optimization, Vol. 10, pp. 1196-1211, 2000.
9. LUENGO, F., GLUNT, W., HAYDEN, T. L., and RAYDAN, M., Preconditioned Spectral Gradient Method, Numerical Algorithms, Vol. 30, pp. 241-258, 2002.
10. MOLINA, B., and RAYDAN, M., The Preconditioned Barzilai-Borwein Method for the Numerical Solution of Partial Differential Equations, Numerical Algorithms, Vol. 13, pp. 45-60, 1996.
11. GRIPPO, L., LAMPARIELLO, F., and LUCIDI, S., A Nonmonotone Line Search Technique for Newton's Method, SIAM Journal on Numerical Analysis, Vol. 23, pp. 707-716, 1986.
12. BIRGIN, E. G., MARTÍNEZ, J. M., and RAYDAN, M., Inexact Spectral Projected Gradient Methods on Convex Sets, IMA Journal of Numerical Analysis, Vol. 23, pp. 539-559, 2003.
13. BERTSEKAS, D. P., Nonlinear Programming, Athena Scientific, Belmont, Massachusetts, 1995.
14. MARTÍNEZ, J. M., BOX-QUACAN and the Implementation of Augmented Lagrangian Algorithms for Minimization with Inequality Constraints, Computational and Applied Mathematics, Vol. 19, pp. 31-56, 2000.
15. MURPHY, R H., A Class of Exponential Penalty Functions, SIAM Journal on Control, Vol. 12, pp. 679-687, 1974.
16. MARTÍNEZ, J. M., PILOTTA, E. A., and RAYDAN, M., Spectral Gradient Methods for Linearly Constrained Optimization, Technical Report, Department of Applied Mathematics, University of Campinas, Campinas, SP, Brazil, 2004; see also www.ime.unicamp.br/~martinez.
17. DUFF, I. S., and REID, J. K., MA27: A Set of Fortran Subroutines for Solving Sparse Symmetric Sets of Linear Equations, Technical Report R-10533, Computer Science and System Division, AERE Harwell, Oxford, England, 1982.
18. GOULD, N. I. M., An Algorithm for Large-Scale Quadratic Programming, IMA Journal of Numerical Analysis, Vol. 11, pp. 299-324, 1991.
19. CONN, A. R., GOULD, N. I. M., and TOINT, P. L., A Globally Convergent Augmented Lagrangian Algorithm for Optimization witn General Constraints and Simple Bounds, SIAM Journal on Numerical Analysis, Vol. 28, pp. 545-572, 1991.
20. CONN, A. R., GOULD, N. I. M., and TOINT, P. L., Lancelot: A Fortran Package for Large-Scale Nonlinear Optimization (Release A), Springer Series in Computational Mathematics, Springer Verlag, New York, NY, Vol. 17, 1992.
21. VANDERBEI, R. J., LOQO: An Interior-Point Code for Quadratic Programming, Technical Report SOR-94-15, Princeton University, Princeton, New Jersey, 1994.
22. VANDERBEI, R. J., and SHANNO, D. F., An Interior-Point Algorithm for Nonconvex Nonlinear Programming, Technical Report SOR-97-21, Statistics and Operations Research, Princeton University, Princeton, New Jersey, 1997.
23. KREJIĆ, N., MARTÍNEZ, J. M., MELLO, M. P., and PILOTTA, E. A., Validation of an Augmented Lagrangian Algorithm with a Gauss-Newton Hessian Approximation Using a Set of Hard-Spheres Problems, Journal of Computational Optimization and Applications, Vol. 16, pp. 247-263, 2000.
24. FLETCHER, R., Practical Methods of Optimization, Wiley, New York, NY, 1987.
25. GILL, P. E., MURRAY, W., and WRIGTH, M. H., Practical Optimization, Academic Press, London, England, 1981.