Quasi-Newton methods: A new direction

Proceedings of the 29th International Conference on Machine Learning, ICML 2012

Volumn 1, Issue , 2012, Pages 25-32

  Hennig, Philipp ^a   Kiefel, Martin ^a  

^a MAX PLANCK INSTITUTE FOR INTELLIGENT SYSTEMS   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL COSTS; NON-PARAMETRIC; NUMERICAL OPTIMIZATIONS; OBJECTIVE FUNCTIONS; QUADRATIC APPROXIMATION; QUASI-NEWTON METHODS; STATE OF THE ART;

COMPUTATIONAL EFFICIENCY; LEARNING ALGORITHMS; LEARNING SYSTEMS; NEWTON-RAPHSON METHOD;

OPTIMIZATION;

EID: 84867137465     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (16)

1. Boyd, S.P. and Vandenberghe, L. Convex Optimization. Cambridge Univ Press, 2004.
2. Broyden, C.G. A class of methods for solving nonlinear simultaneous equations. Math. Comp., 19(92):577-593, 1965.
3. Broyden, C.G. Quasi-Newton methods and their application to function minimization. Math. Comp., 21(368):45, 1967.
4. Broyden, C.G. A new double-rank minimization algorithm. Notices American Math. Soc, 16:670, 1969.
5. Davidon, W.C. Variable metric method for minimization. Technical report, Argonne National Laboratories, Ill., 1959.
6. Dennis, J.E. Jr and Morée, J.J. Quasi-Newton methods, motivation and theory. SIAM Review, pp. 46-89, 1977.
7. Fletcher, R. A new approach to variable metric algorithms. The Computer Journal, 13(3):317, 1970.
8. Fletcher, R. and Powell, M.J.D. A rapidly convergent descent method for minimization. The Computer Journal, 6(2):163-168, 1963.
9. Genz, A. Numerical computation of rectangular bivariate and trivariate normal and t probabilities. Statistics and Computing, 14(3):251-260, 2004.
10. Goldfarb, D. A family of variable metric updates derived by variational means. Math. Comp., 24(109): 23-26, 1970.
11. Lütkepohl, H. Handbook of Matrices. Wiley, 1996.
12. Minka, T.P. Deriving quadrature rules from Gaussian processes. Technical report, Statistics Department, Carnegie Mellon University, 2000.
13. Nocedal, J. Updating quasi-Newton matrices with limited storage. Math. Comp., 35(151):773-782, 1980.
14. Nocedal, J. and Wright, S.J. Numerical optimization. Springer Verlag, 1999.
15. Powell, M.J.D. A new algorithm for unconstrained optimization. In Mangasarian, O. L. and Ritter, K. (eds.), Nonlinear Programming. AP, 1970.
16. Shanno, D.F. Conditioning of quasi-Newton methods for function minimization. Math. Comp., 24(111): 647-656, 1970.