Conjugate gradient method

Wiley Interdisciplinary Reviews: Computational Statistics

Volumn 1, Issue 3, 2009, Pages 348-353

  Nazareth, J L ^a,b  

^a WASHINGTON STATE UNIVERSITY   (United States)

^b UNIVERSITY OF WASHINGTON   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMIC PROPERTIES; CONJUGATE GRADIENT; EQUATION SOLVING; SUBJECT MATTERS;

ALGORITHMS;

CONJUGATE GRADIENT METHOD;

EID: 78651555653     PISSN: 19395108     EISSN: 19390068     Source Type: Journal    
DOI: 10.1002/wics.13     Document Type: Article

References (26)

1. Luenberger DG. Linear and Nonlinear Programming. 2nd ed.: Addison-Wesley; 1984.
2. Hestenes MR, Stiefel EL. Methods of conjugate gradients for solving linear systems. JRes Natl BurStand B 1952, 49:409-436.
3. Golub GH, O'Leary DP. Some history of the conjugate gradient and Lanczos algorithms: 1948-1976. SIAM Rev 1989, 31:50-102.
4. Reid JK. On the method of conjugate gradients for the solution of large sparse systems of linear equations. Large Sparse Sets of Linear Equations.New York: Academic Press; 1971, 231-254.
5. Barrett R, Berry M, Chan TF, Demmel J, Donato J, et al. Templates for the Solution of Linear Systems. Philadelphia, PA: SIAM; 1993.
6. O'Leary DP. Conjugate gradients and related KMP algorithms: the beginnings. In: Adams L, Nazareth JL, eds. Linear and Nonlinear Conjugate Gradient-related Methods. Philadelphia, PA: SIAM; 1996, 1-8.
7. Fletcher R, Reeves C. Function minimization by conjugate gradients. Comput J 1964, 7:149-154.
8. Davidon WC. Variable metric method for minimization, Argonne National Laboratory, Report ANL-5990 (Rev.), Argonne, Illinois, 1959)., (reprinted, with a new preface, in SIAM J. Optimization, 1, 1-17, 1991).
9. Polyak BT. The conjugate gradient method in extremal problems. USSR Comput Math Math Phys 1969, 9:94-112.
10. Polak E, Ribiere G. Note sur la convergence de methode de directions conjuguees. Revue Francaise d'Informatique et de Recherche Operationnelle 1969, 16:35-43.
11. Dai YH. Analyses of nonlinear conjugate gradient methods. PhD Dissertation, Institute of Computational Mathematics and Scientific/Engineering Computing, ChineseAcademy of Sciences, Beijing, China, 1997.
12. Powell MJD. Restart procedures for the conjugate gradient method. Math Programming 1977, 12:241-254.
13. Hestenes MR. Conjugate Direction Methods in Optimization, Applications of Mathematics Series, 12. New York, Heidelberg: Springer-Verlag; 1980.
14. Adams L, Nazareth JL, eds. Linear and Nonlinear Conjugate Gradient-related Methods. Philadelphia, PA: SIAM; 1996.
15. Nazareth JL. A relationship between the BFGS and conjugate gradient algorithms, Tech. Memo. ANL-AMD 282, Applied Mathematics Division, Argonne National Laboratory, Argonne, Illinois, 1976.
16. Nazareth JL. A relationship between the BFGS and conjugate gradient algorithms and its implications for new algorithms. SIAM J Numer Anal 1979, 16:794-800.
17. Buckley A. Extending the relationship between the conjugate gradient and BFGS algorithms. Math Programming1978, 15:343-348.
18. Kolda TG, O'Leary DP, Nazareth JL. BFGS with update skipping and varying memory. SIAM J Optim 1998, 8:1060-1083.
19. Fletcher R, Powell MJD. A rapidly convergent descent method for minimization. Comput J 1963, 6:163-168.
20. Dennis JE, Schnabel RB. Numerical Methods for Unconstrained Optimization and Nonlinear Equations. New Jersey: Prentice-Hall; 1983.
21. Shanno DF. Conjugate gradient methods with inexact searches. Math Oper Res 1978, 3:244-256.
22. Perry A. A modified CG algorithm. Oper Res 1978, 26:1073-1078.
23. Nazareth JL. Complementary perspectives on optimization algorithms. Pac J Optim 2006, 2:71-79.
24. Nocedal J. Updating quasi-Newton matrices with limited storage. Math Comput 1980, 35:773-782.
25. Buckley A. A combined conjugate-gradient quasi-Newton minimization algorithm. Math Programming 1978, 15:200-210.
26. Nazareth JL. The method of successive affine reduction for nonlinear minimization. Math Programming 1986, 35:97-109.