The convergence of subspace trust region methods

Journal of Computational and Applied Mathematics

Volumn 231, Issue 1, 2009, Pages 365-377

  Shi, Zhen Jun ^a   Xu, Zhiwei ^b  

^a CENTRAL STATE UNIVERSITY   (United States)

^b UNIVERSITY OF MICHIGAN DEARBORN   (United States)

Author keywords

Convergence rate; Global convergence; Subspace trust region method; Unconstrained optimization

Indexed keywords

CONVERGENCE RATE; CONVERGENCE RATES; GLOBAL CONVERGENCE; LARGE-SCALE PROBLEM; NEW CLASS; OPTIMIZATION PROBLEMS; STRONG CONVERGENCE; SUBSPACE TRUST REGION METHOD; TRUST REGION; TRUST-REGION METHODS; UNCONSTRAINED OPTIMIZATION;

OPTIMIZATION;

STRUCTURES (BUILT OBJECTS);

EID: 67349157002     PISSN: 03770427     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.cam.2009.02.100     Document Type: Article

References (58)

1. Conn A.R., Gould N.I.M., and Toint P.L. Trust-Region Methods (1999), CGT Publications
2. Nocedal J., and Wright J.S. Numerical Optimization (1999), Springer-Verlag, New York Inc.
3. Yuan Y. Numerical Methods for Nonlinear Programming (1993), Shanghai Scientific & Technical Publishers
4. Djuranović-Milivcić N.I. On line search methods. Int. J. Comput. Numer. Anal. Appl. 4 (2003) 251-263
5. Fu J.H., Sun W.Y., and de Sampaio R.J.B. An adaptive approach of conic trust-region method for unconstrained optimization problems. J. Appl. Math. Comput. 19 (2005) 165-177
6. Fu J.H., and Sun W.Y. Nonmonotone adaptive trust-region method for unconstrained optimization problems. Appl. Math. Comput. 163 (2005) 489-504
7. Fan J.Y., Ai W.B., and Zhang Q.Y. A line search and trust region algorithm with trust region radius converging to zero. J. Comput. Math. 22 (2004) 865-872
8. Higham D.J. Trust region algorithms and timestep selection. SIAM J. Numer. Anal. 37 (1999) 194-210
9. Nocedal J. Theory of algorithms for unconstrained optimization. Acta Numer. 1 (1992) 199-242
10. Powell M.J.D. On the global convergence of trust region algorithms for unconstrained minimization. Math. Program. 29 (1984) 297-303
11. Sun W.Y. Nonmonotone trust region method for solving optimization problems. Appl. Math. Comput. 156 (2004) 159-174
12. Sorensen D.C. Newton's method with a model trust region modification. SIAM J. Numer. Anal. 19 (1982) 409-426
13. Steihaug T. The conjugate gradient method and trust regions in large scale optimization. SIAM J. Numer. Anal. 20 (1983) 626-637
14. Yuan Y., and Sun W. Optimization Theory and Methods (1997), Science Press of China
15. Yuan Y. A review of trust region algorithms for optimization. ICIAM 99 (Edinburgh) (2000), Oxford Univ. Press, Oxford 271-282
16. Yuan Y. On the convergence of trust region algorithms. Math. Numer. Sin. 16 (1996) 333-346
17. Armijo L. Minimization of functions having Lipschitz continuous partial derivatives. Pacific J. Math. 16 (1966) 1-3
18. Potra F.A., and Shi Y. Efficient line search algorithm for unconstrained optimization. J. Optim. Theory Appl. 85 3 (1995) 677-704
19. Powell M.J.D. Direct search algorithms for optimization calculations. Acta Numer. 7 (1998) 287-336
20. Shi Z.J. Convergence of line search methods for unconstrained optimization. Appl. Math. Comput. 157 (2004) 393-405
21. Shi Z.J., and Shen J. A gradient-related algorithm with inexact line searches. J. Comput. Appl. Math. 170 (2004) 349-370
22. Shi Z.J., and Shen J. New inexact line search method for unconstrained optimization. J. Optim. Theory Appl. 127 2 (2005) 425-446
23. Shi Z.J. Convergence of quasi-Newton method with new inexact line search. J. Math. Anal. Appl. 315 (2006) 120-131
24. Chen X.D., and Yuan Y. On local solutions of the Celis-Dennis-Tapia subproblem. SIAM J. Optim. 10 (2000) 359-383
25. Calvetti D., and Reichel L. Gauss quadrature applied to trust region computations. Numer. Algorithms 34 (2003) 85-102
26. Elster C., and Neumaier A. A method of trust region type for minimizing noisy functions. Computing 58 (1997) 31-46
27. Shultz G.A., Schnabel R.B., and Byrd R.H. A family of trust-region-based algorithms for unconstrained minimization with strong global convergence. SIAM J. Numer. Anal. 22 (1985) 47-67
28. Sun J. On piecewise quadratic Newton and trust region problems. Math. Program. 76 (1997) 451-467
29. Toint P.L. Global convergence of a class of trust-region methods for nonconvex minimization in Hilbert space. IMA J. Numer. Anal. 8 (1988) 231-252
30. Yuan Y. Trust region algorithms for nonlinear equations. Information 1 1 (1998) 7-20
31. Zhang X.S., Zhang J.L., and Liao L.Z. An adaptive trust region method and its convergence. Sci. China 45 (2002) 620-631
32. Byrd R.H., Khalfan H.F., and Schnabel R.B. Analysis of a symmetric rank-one trust region method. SIAM J. Optim. 6 (1996) 1025-1039
33. Gould N.I.M., Orban D., and Toint P.L. Numerical methods for large-scale nonlinear optimization. Acta Numer. 14 (2005) 299-361
34. Helfrich H.P., and Zwick D. Trust region algorithms for the nonlinear least distance problem Algorithms for constrained approximation and optimization (Stowe, VT, 1993). Numer. Algorithms 9 (1995) 171-179
35. Mauricio D., and Maculan N. A trust region method for zero-one nonlinear programming. RAIRO Rech. Opér. 31 (1997) 331-341
36. Sartenaer A. A class of trust region methods for nonlinear network optimization problems. SIAM J. Optim. 5 2 (1995) 379-407
37. Gould N.I.M., Orban D., Sartenaer A., and Toint P.L. Sensitivity of trust-region algorithms to their parameters. 4OR 3 (2005) 227-241
38. Ni Q. A globally convergent method of moving asymptotes with trust region technique. Optim. Methods Softw. 18 (2003) 283-297
39. Shi Z.J., and Shen J. On memory gradient method with trust region. Numer. Algorithms 41 (2006) 173-196
40. Vicente L.N. Space mapping: Models sensitivities trust-regions methods. Optim. Eng. 4 (2003) 159-175
41. Wang Z.H., and Yuan Y. A subspace implementation of quasi-Newton trust region methods. Numer. Math. 104 2 (2006) 241-269
42. Corradi C. A trust region algorithm for unconstrained optimization. Int. J. Comput. Math. 65 (1997) 109-119
43. Dai Y.H. A new family of trust region algorithms for unconstrained optimization. J. Comput. Math. 21 (2003) 221-228
44. Deng N.Y., Xiao Y., and Zhou F.J. Nonmonotonic trust region algorithm. J. Optim. Theory Appl. 76 (1993) 259-285
45. Hei L. A self-adaptive trust region algorithm. J. Comput. Math. 21 (2003) 229-236
46. Mccartin B.J. A model-trust region algorithm utilizing a quadratic interpolant. J. Comput. Appl. Math. 91 (1998) 249-259
47. Marazzi M., and Nocedal J. Wedge trust region methods for derivative free optimization. Math. Program. 91 (2002) 289-305
48. Sartenaer A. Automatic determination of an initial trust region in nonlinear programming. SIAM J. Sci. Comput. 18 (1997) 1788-1803
49. Xiao Y., and Zhou F.J. Nonmonotone trust region methods with curvilinear path in unconstrained optimization. Computing 48 (1992) 303-317
50. Yuan Y. A dual algorithm for minimizing a quadratic function with two quadratic constraints. J. Comput. Math. 9 (1991) 348-359
51. Zhang J.L., Zhang X.S., and Zhuo X.J. Global convergence of a trust region method without regularity conditions. Math. Numer. Sin. 24 (2002) 437-450 (in Chinese)
52. Zhang H.C. A nonmonotone trust region algorithm for nonlinear optimization subject to general constraints. J. Comput. Math. 21 (2003) 237-246
53. Xu C.X., and Zhang J.Z. Scaled optimal path trust-region algorithm. J. Optim. Theory Appl. 102 (1999) 127-146
54. Yuan Y. Subspace techniques for nonlinear optimization. Some Topics in Industrial and Applied Mathematics. Ser. Contemp. Appl. Math CAM vol. 8 (2007), Higher Ed Press, Beijing 206-218
55. Zhang J.Z., and Xu C.X. Trust region dogleg path algorithms for unconstrained minimization, Management Science in China (Kowloon, 1996). Ann. Oper. Res. 87 (1999) 407-418
56. Zhang J.Z., and Xu C.X. A class of indefinite dogleg path methods for unconstrained minimization. SIAM J. Optim. 9 (1999) 646-667
57. Shi Z.J., Zhang X.S., and Shen J. Convergence analysis of adaptive trust region methods. RAIRO Oper. Res 41 (2007) 105-121
58. Michael G.E. A quasi-Newton trust-region method. Math. Program. 100 3 (2004) 447-470 Ser. A