On a class of limited memory preconditioners for large scale linear systems with multiple right-hand sides

SIAM Journal on Optimization

Volumn 21, Issue 3, 2011, Pages 912-935

  Gratton, S ^a   Sartenaer, A ^b   Tshimanga, J ^a  

^a UNIVERSITÉ DE TOULOUSE   (France)

^b UNIVERSITY OF NAMUR   (Belgium)

Author keywords

Conjugate gradient; Limited memory; Linear systems; Preconditioners

Indexed keywords

CONJUGATE GRADIENT; DATA ASSIMILATION SYSTEMS; LARGE-SCALE LINEAR SYSTEMS; LIMITED MEMORY; MULTIPLE RIGHT-HAND SIDES; NON-LINEAR OPTIMIZATION PROBLEMS; NUMERICAL TESTS; PRECONDITIONERS; SYSTEMS OF EQUATIONS; WORK STUDY;

CONJUGATE GRADIENT METHOD; DATA PROCESSING;

LINEAR SYSTEMS;

EID: 80054775049     PISSN: 10526234     EISSN: None     Source Type: Journal    
DOI: 10.1137/08074008     Document Type: Article

References (40)

1. O. AXELSSON, Optimal preconditioners based on rate of convergence estimates for the conjugate gradient, Numer. Funct. Anal. Optim., 12 (2001), pp. 277-302. (Pubitemid 32850870)
2. A. BJÖRCK, Numerical Methods for Least Squares Problems, SIAM, Philadelphia, 1996.
3. A. BJÖRCK, T. ELFVING, AND Z. STRAKOS, Stability of conjugate gradient and Lanczos methods for linear least squares problems, SIAM J. Matrix Anal. Appl., 19 (1998), pp. 720-736.
4. R. H. BYRD, J. NOCEDAL, AND R. B. SCHNABEL, Representations of quasi-Newton matrices and their use in limited memory methods, Math. Program., 63 (1994), pp. 129-156.
5. B. CARPENTIERI, I. S. DUFF, AND L. GIRAUD, A class of spectral two-level preconditioners, SIAM J. Sci. Comput., 25 (2003), pp. 749-765.
6. K. CHEN, Matrix Preconditioning Techniques and Applications, Cambridge University Press, Cambridge, UK, 2005.
7. P. COURTIER, J.-N. THÉPAUT, AND A. HOLLINGSWORTH, A strategy for operational implementation of 4D-Var, using an incremental approach, Q. J. R. Meteorol. Soc., 120 (1994), pp. 1367-1388.
8. J. DERBER AND F. BOUTTIER, A reformulation of the background error covariance in the ECMWF global data assimilation system, Tellus, 51 (1999), pp. 195-221. (Pubitemid 29335121)
9. M. FISHER, Minimization algorithms for variational data assimilation, in Proceedings of the European Centre for Medium-Range Weather Forecasts Seminar on Recent Developments in Numerical Methods for Atmospheric Modelling, 1998, pp. 364-385.
10. M. FISHER, J. NOCEDAL, Y. TRÉMOLET, AND S. J.WRIGHT, Data assimilation in weather forecasting: A case study in PDE-constrained optimization, Optim. Eng., 10 (2009), pp. 409-426.
11. R. FLETCHER, A new approach to variable metric algorithms, Comput J., 13 (1970), pp. 317-322.
12. J. FRANK AND C. VUIK, On the construction of deflation-based preconditioners, SIAM J. Sci. Comput., 23 (2001), pp. 442-462. (Pubitemid 34307997)
13. L. GIRAUD AND S. GRATTON, On the sensitivity of some spectral preconditioners, SIAM J. Matrix Anal. Appl., 27 (2006), pp. 1089-1105. (Pubitemid 44599418)
14. L. GIRAUD, S. GRATTON, AND E. MARTIN, Incremental spectral preconditioners for sequences of linear systems, Appl. Numer. Math., 57 (2007), pp. 1164-1180. (Pubitemid 47348163)
15. G. H. GOLUB AND C. F. VAN LOAN, Matrix Computations, 3rd ed., Johns Hopkins University Press, Baltimore, MD, 1996.
16. M. R. HESTENES AND E. STIEFEL, Methods of conjugate gradients for solving linear systems, J. Res. Natl. Bur. Stand., 49 (1952), pp. 409-436.
17. R. A. HORN AND C. R. JOHNSON, Matrix Analysis, Cambridge University Press, Cambridge, UK, 1999.
18. B. INGLEBY AND M. HUDDLESTON, Quality control of ocean temperature and salinity profiles-historical and real-time data, J. Marine Syst., 65 (2007), pp. 148-175.
19. I. C. F. IPSEN AND C. D. MEYER, The idea behind Krylov methods, Amer. Math. Monthly, 105 (1998), pp. 889-899. (Pubitemid 128376120)
20. A. C. LORENC, Modelling of error covariances by 4D-VAR data assimilation, Q. J. R. Meteorol. Soc., 129 (2003), pp. 3167-3182. (Pubitemid 38034054)
21. G. MADEC, P.DELECLUSE, M. IMBARD, AND C. LÉVY, OPA 8.1 Ocean General Circulation Model Reference Manual, Report LODYC/IPSL technical note 11, Laboratoire d'Océanographie DYnamique et de Climatologie, Institut Pierre Simon Laplace des Sciences de l'Environnement Global, Paris, France, 1998.
22. J. MANDEL, Balancing domain decomposition, Comm. Numer. Methods Engrg., 9 (1993), pp. 233-241. (Pubitemid 23640986)
23. L. MANSFIELD, On the conjugate gradient solution of the Schur complement system obtained from domain decomposition, SIAM J. Numer. Anal., 27 (1990), pp. 1612-1620.
24. L. MANSFIELD, Damped Jacobi preconditioning and coarse grid deflation for conjugate gradient iteration on parallel computers, SIAM J. Sci. Statist. Comput., 12 (1991), pp. 1314-1323.
25. C. MEYER, Matrix Analysis and Applied Linear Algebra, SIAM, Philadelphia, 2000.
26. J. L. MORALES AND J. NOCEDAL, Automatic preconditioning by limited memory quasi-Newton updating, SIAM J. Optim., 10 (2000), pp. 1079-1096.
27. R. NABBEN AND C. VUIK, A comparison of deflation and coarse grid correction applied to porous media flow, SIAM J. Numer. Anal., 42 (2004), pp. 1631-1647. (Pubitemid 41366168)
28. R. NABBEN AND C. VUIK, A comparison of deflation and the balancing preconditioner, SIAM J. Sci. Comput., 27 (2006), pp. 1742-1759. (Pubitemid 44410012)
29. L. NAZARETH, A relationship between the BFGS and conjugate gradient algorithms and its implications for new algorithms, SIAM J. Numer. Anal., 16 (1979), pp. 794-800.
30. R. A. NICOLAIDES, Deflation of conjugate gradients with applications to boundary value problems, SIAM J. Numer. Anal., 24 (1987), pp. 355-365. (Pubitemid 17550507)
31. J. NOCEDAL AND S. J.WRIGHT, Numerical Optimization, Springer Ser. Oper. Res., Springer-Verlag, Berlin, 1999.
32. A. PADIY, O.AXELSSON, AND B. POLMAN, Generalized augmented matrix preconditioning approach and its application to iterative solution of ill-conditioned algebraic systems, SIAM J. Matrix Anal. Appl., 22 (2000), pp. 793-818.
33. C. C. PAIGE AND M. A. SAUNDERS, LSQR: An algorithm for sparse linear equations and sparse least squares, ACM Trans. Math. Softw., 8 (1982), pp. 43-71.
34. R. B. SCHNABEL, Quasi-Newton Methods using Multiple Secant Equations, Technical report CU-CS-247-83, Department of Computer Sciences, University of Colorado, Boulder, CO, 1983.
35. J. TSHIMANGA, On a Class of Limited Memory Preconditioners for Large-Scale Nonlinear Least-Squares Problems (with Application to Variational Ocean Data Assimilation), Ph.D. thesis, Department of Mathematics, University of Namur, Namur, Belgium, 2007.
36. J. TSHIMANGA, S. GRATTON, A. WEAVER, AND A. SARTENAER, Limited-memory preconditioners with application to incremental four-dimensional variational data assimilation, Q. J. R. Meteorol. Soc., 134 (2008), pp. 751-769.
37. H. WAISMAN, J. FISH, R. S. TUMINARO, AND J. SHADID, The generalized global basis method, Internat. J. Numer. Methods Engrg., 61 (2004), pp. 1243-1269.
38. A. T.WEAVER, J.VIALARD, AND D. L. T. ANDERSON, Three- and four-dimensional variational assimilation with a general circulation model of the tropical pacific ocean. Part I: Formulation, internal diagnostics, and consistency checks, Mon. Weather Rev., 131 (2003), pp. 1360-1378. (Pubitemid 36953817)
39. A. T. WEAVER, C. DELTEL, E. MACHU, S. RICCI, AND N. DAGET, A multivariate balance operator for variational ocean data assimilation, Q. J. R. Meteorol. Soc., 131 (2005), pp. 3605-3625.
40. J. XU, Iterative methods by space decomposition and subspace correction, SIAM Rev., 34 (1992), pp. 581-613.