Subspace methods for large scale nonlinear equations and nonlinear least squares

Optimization and Engineering

Volumn 10, Issue 2, 2009, Pages 207-218

  Yuan, Ya Xiang ^a  

^a INSTITUTE OF GEOLOGY AND GEOPHYSICS   (China)

Author keywords

Line search; Nonlinear equations; Nonlinear least squares; Subspace; Trust region

Indexed keywords

EID: 84865662874     PISSN: 13894420     EISSN: 15732924     Source Type: Journal    
DOI: 10.1007/s11081-008-9064-0     Document Type: Article

References (27)

1. Bouaricha A, Moré JJ (1997) Impact of partial separability on large-scale optimization. Comput Optim Appl 7(1):27-40
2. Conn AR, Gould NJM, Toint PhL (2000) Trust-region methods. MPS-SIAM series on optimization. SIAM, Philadelphia
3. Dennis JE, Schnable RB (1993) Numerical methods for unconstrained optimization and nonlinear equations. SIAM, Philadelphia
4. Fletcher R (1987) Practical methods of optimization, 2nd edn. Wiley, New York
5. Gill PE, Leonard MW (2001) Reduced-Hessian quasi-Newton methods for unconstrained optimization. SIAM J Optim 12:209-237
6. Golub GH, Van Loan ChF (1996) Matrix computations, 3rd edn. Johns Hopkins University Press, Baltimore
7. Gould NIM, Toint PhL (2007) FILTRANE, a Fortran 95 filter-trust-region package for solving nonlinear least-squares and nonlinear feasibility problems. ACM Trans Math Softw 33(1):3-25
8. Gould NIM, Orban D, Toint PhL (2005) Numerical methods for large-scale nonlinear optimization. Acta Numer 299-361
9. Kelly CT (1995) Iterative methods for linear and nonlinear equations. SIAM, Philadelphia
10. Liu DC, Nocedal J (1989) On the limited memory BFGS method for large scale optimization. Math Program 45:503-528
11. Mizutani E, Demmel JW (2003) On structure-exploiting trust-region regularized nonlinear least squares algorithms for neural-network learning. Neural Netw 16(5-6):745-753
12. Nocedal J, Wright SJ (1999) Numerical optimization. Springer, New York
13. Ortega JM, Rheinboldt WC (1970) Iterative solution of nonlinear equations in several variables. Academic Press, New York
14. Powell MJD (1970) A new algorithm for unconstrained optimization. In: Rosen JB, Mangasarian OL, Ritter K (eds) Nonlinear programming. Academic Press, New York, pp 31-66
15. Saad Y (2003) Iterative methods for sparse linear systems 2nd edn. Springer, New York
16. Steihaug T (1983) The conjugate gradient method and trust regions in large scale optimization. SIAM J Numer Anal 20:626-637
17. Stoer J, Yuan Y (1995) A subspace study on conjugate gradient algorithms. Z Angew Math Mech 75:69-77
18. SunWY, Yuan Y (2006) Optimization theory and methods: nonlinear programming. Springer optimization and its application, vol. 1. Springer, Berlin
19. Toint PhL (1981) Towards an efficient sparsity exploiting Newton method for minimization. In: Duff I (ed) Sparse matrices and their uses. Academic Press, New York, pp 57-88
20. Toint PhL (1987) On large scale nonlinear least squares calculations. SIAM J Sci Stat Comput 8(3):416-435
21. Vlček J, Lukšan L (2002) New variable metric methods for unconstrained minimization covering the largescale case, Technical report No. V876, Institute of Computer Science, Academy of Sciences of the Czech Republic, October 2002
22. Wang ZH, Yuan YX (2006) A subspace implementation of quasi-Newton trust region methods for unconstrained optimization. Numer Math 104:241-269
23. Wang ZH, Wen ZW, Yuan YX (2004) A subspace trust region method for large scale unconstrained optimization. In: Yuan YX (ed) Numerical linear algebra and optimization. Science Press, Marrickvill, pp 264-274
24. Yuan YX (1998) Trust region algorithms for nonlinear equations. Information 1:7-20
25. Yuan YX (2000a) A review of trust region algorithms for optimization. In: Ball JM, Hunt JCR (eds) ICM99: proceedings of the fourth international congress on industrial and applied mathematics. Oxford University Press, Oxford, pp 271-282
26. Yuan YX (2000b) On the truncated conjugate gradient method. Math Program 86:561-571
27. Yuan YX (2007) Subspace techniques for nonlinear optimization. In: Jeltsch R, Li DQ, Sloan IH (eds) Some topics in industrial and applied mathematics. Series in contemporary applied mathematics, vol 8. Higher Education Press, Beijing, pp 206-218