Numerical experience with a class of self-scaling quasi-newton algorithms

Journal of Optimization Theory and Applications

Volumn 96, Issue 3, 1998, Pages 533-553

  Al Baali, M ^a,b  

^a UNITED ARAB EMIRATES UNIVERSITY   (United Arab Emirates)

^b Department of Mathematics   (Syrian Arab Republic)

Author keywords

Broyden family; Global and superlinear convergence; Inexact line searches; Quasi Newton methods; Self scaling methods; Unconstrained optimization

Indexed keywords

APPROXIMATION ALGORITHMS; NUMERICAL METHODS; OPTIMIZATION;

BROYDEN; BROYDEN FAMILY; GLOBAL CONVER-GENCE; INEXACT LINE SEARCHES; QUASI-NEWTON METHODS; SCALING METHOD; SCALINGS; SELF-SCALING METHOD; SUPERLINEAR CONVERGENCE; UNCONSTRAINED OPTIMIZATION;

NEWTON-RAPHSON METHOD;

EID: 0032373590     PISSN: 00223239     EISSN: None     Source Type: Journal    
DOI: 10.1023/A:1022608410710     Document Type: Article

References (23)

1. OREN, S. S., and LUENBERGER, D. G., Self-Scaling Variable Metric (SSVM) Algorithms, I. Criteria and Sufficient Conditions for Scaling a Class of Algorithms, Management Science, Vol. 20, pp. 845-862, 1974.
2. FLETCHER, R., Practical Methods of Optimization, 2nd Edition, Wiley, Chichester, England, 1987.
3. POWELL, M. J. D., Some Global Convergence Properties of a Variable Metric Algorithm for Minimization without Exact Line Searches, Nonlinear Programming, Edited by R. W. Cottle and C. E. Lemke, SIAM Publications, Philadelphia, Pennsylvania, Vol. 9, pp. 53-72, 1976.
4. ZHANG, Y., and TEWARSON, R. P., Quasi-Newton Algorithms with Updates from the Preconvex Part of Broyden's Family, IMA Journal of Numerical Analysis, Vol. 8, pp. 487-509, 1988.
5. BYRD, R., NOCEDAL, J., and JUAN, Y., Global Convergence of a Class of Quasi-Newton Methods on Convex Problems, SIAM Journal on Numerical Analysis, Vol. 24, pp. 1171-1190, 1987.
6. BYRD, R., LIU, D., and NOCEDAL, J., On the Behavior of Broyden's Class of Quasi-Newton Methods, SIAM Journal on Optimization, Vol. 2, pp. 533-557, 1992.
7. AL-BAALI, M., Global and Superlinear Convergence of a Class of Self-Scaling Methods with Inexact Line Searches, Computational Optimization and Applications, Vol. 9, 1998.
8. NOCEDAL, J., and YUAN, Y., Analysis of a Self-Scaling Quasi-Newton Method, Mathematical Programming, Vol. 61, pp. 19-37, 1993.
9. CARTER, R., Safeguarding Hessian Approximations in Trust Region Algorithms, Report TR87-12, Department of Mathematical Sciences, Rice University, 1987.
10. CONTRERAS, M., and TAPIA, R. A., Sizing the BFGS and DFP Updates: A Numerical Study, Journal of Optimization Theory and Applications, Vol. 78, pp. 93-108, 1993.
11. LUKSǍN, L., Computational Experience with Known Variable Metric Updates, Journal of Optimization Theory and Applications, Vol. 83, pp. 27-47, 1994.
12. WOLKOWICZ, H., and ZHAO, Q., An All-Inclusive Efficient Region of Updates for Least Change Secant Methods, SIAM Journal on Optimization, Vol. 5, pp. 172-191, 1995.
13. OREN, S. S., and SPEDICATO, E., Optimal Conditioning of Self-Scaling Variable Metric Algorithms, Mathematical Programming, Vol. 10, pp. 70-90, 1976.
14. LIU, D. C., and NOCEDAL, J., On the Limited Memory BFGS Method for Large Scale Optimization, Mathematical Programming, Vol. 45, pp. 503-528, 1989.
15. AL-BAALI, M., Analysis of a Family of Self-Scaling Quasi-Newton Methods, Technical Report, Department of Mathematics and Computer Science, United Arab Emirates University, 1993.
16. SIEGEL, D., Modifying the BFGS Update by a New Column Scaling Technique, Mathematical Programming, Vol. 45, pp. 45-78, 1993.
17. AL-BAALI, M., On the Self-Scaling Updating Formulae for Quasi-Newton Methods, Report 87, Department of Systems, University of Calabria, 1990.
18. Hu, Y. F., and STOREY, C., On Optimally and Near-Optimally Conditioned Quasi-Newton Updates, Report A141, Department of Mathematics, University of Loughborough, 1991.
19. AL-BAALI, M., An Efficient Class of Switching Type Algorithms in the Broyden Family, Optimization Methods and Software, Vol. 4, pp. 29-46, 1994.
20. SHANNO, D. F., and PHUA, K. H., Matrix Conditioning and Nonlinear Optimization, Mathematical Programming, Vol. 14, pp. 149-160, 1978.
21. BONGARTZ, I., CONN, A. R., GOULD, N., and TOINT, P. L., CUTE: Constrained and Unconstrained Testing Environment, Unpublished Manuscript, 1993.
22. MORÉ, J. J., GARBOW, B. S., and HILLSTROM, K. E., Testing Unconstrained Optimization Software, ACM Transactions on Mathematical Software, Vol. 7, pp. 17-41, 1981.
23. AL-BAALI, M., and KHALFAN, H. F., Experimental Study of Globally and Superlinearly Convergent Self-Scaling Quasi-Newton Methods, Technical Report, Department of Mathematics and Computer Science, United Arab Emirates University, 1996.