An implicit trust-region method on Riemannian manifolds

IMA Journal of Numerical Analysis

Volumn 28, Issue 4, 2008, Pages 665-689

  Baker, C G ^a,b   Absil, P A ^c   Gallivan, K A ^b  

^a SANDIA NATIONAL LABORATORIES   (United States)

^b FLORIDA STATE UNIVERSITY   (United States)

^c UNIVERSITÉ CATHOLIQUE DE LOUVAIN   (Belgium)

Author keywords

Newton's method; Optimization on manifolds; Symmetric generalized eigenvalue problem; Trust region methods

Indexed keywords

EIGENVALUES AND EIGENFUNCTIONS; FUNCTION EVALUATION; GEOMETRY; NEWTON-RAPHSON METHOD;

CONVERGENCE ANALYSIS; GENERALIZED EIGENVALUE PROBLEMS; NEWTON'S METHODS; OPTIMIZATION ON MANIFOLDS; RIEMANNIAN MANIFOLD; STATE-OF-THE-ART ALGORITHMS; SYMMETRIC EIGENVALUE PROBLEMS; TRUST-REGION METHODS;

NUMERICAL METHODS;

EID: 55849094768     PISSN: 02724979     EISSN: 14643642     Source Type: Journal    
DOI: 10.1093/imanum/drn029     Document Type: Article

References (36)

1. ABSIL, P.-A., BAKER, C. G. & GALLIVAN, K. A. (2007) Trust-region methods on Riemannian manifolds. Found. Comput. Math., 7, 303-330.
2. ABSIL, P.-A., MAHONY, R. & SEPULCHRE, R. (2004) Riemannian geometry of Grassmann manifolds with a view on algorithmic computation. Acta Appl. Math., 80, 199-220.
3. ABSIL, P.-A., MAHONY, R. & SEPULCHRE, R. (2008) Optimization Algorithms on Matrix Manifolds. Princeton, NJ: Princeton University Press.
4. ABSIL, P.-A., MAHONY, R., SEPULCHRE, R. & VAN DOOREN, P. (2002) A Grassmann-Rayleigh quotient iteration for computing invariant subspaces. SIAM Rev., 44, 57-73 (electronic).
5. ADLER, R. L., DEDIEU, J.-P., MARGULIES, J. Y., MARTENS, M. & SHUB, M. (2002) Newton's method on Riemannian manifolds and a geometric model for the human spine. IMA J. Numer. Anal., 22, 359-390.
6. BAKER, C. G., ABSIL, P.-A. & GALLIVAN, K. A. (2007) Generic Riemannian trust-region package. Available at http://www.scs.fsu.edu/~cbaker/GenRTR/.
7. BAKER, C. G., HETMANIUK, U. L., LEHOUCQ, R. B. & THORNQUIST, H. K. (2005) The Anasazi block eigensolvers package. Available at http://trilinos.sandia.gov/packages/anasazi/.
8. BERTSEKAS, D. P. (1995) Nonlinear Programming. Belmont, MA: Athena Scientific.
9. BOOTHBY, W. M. (1975) An Introduction to Differentiable Manifolds and Riemannian Geometry. New York: Academic Press.
10. CONN, A. R., GOULD, N. I. M. & TOINT, P. L. (2000) Trust-Region Methods. MPS/SIAM Series on Optimization. Philadelphia, PA: Society for Industrial and Applied Mathematics (SIAM).
11. DEDIEU, J.-P., PRIOURET, P. & MALAJOVICH, G. (2003) Newton's method on Riemannian manifolds: convariant alpha theory. IMA J. Numer. Anal., 23, 395-419.
12. DO CARMO, M. P. (1992) Riemannian Geometry. Mathematics: Theory & Applications. Boston, MA: Birkhäuser Boston Inc. Translated from the second Portuguese edition by Francis Flaherty.
13. EDELMAN, A., ARIAS, T. A. & SMITH, S. T. (1998) The geometry of algorithms with orthogonality constraints. SIAM J. Matrix Anal. Appl., 20, 303-353.
14. GABAY, D. (1982) Minimizing a differentiable function over a differential manifold. J. Optim. Theory Appl., 37, 177-219.
15. GOULD, N. I. M., SAINVITU, C. & TOINT, P. L. (2005) A filter-trust-region method for unconstrained optimization. SIAM J. Optim., 16, 341-357.
16. HELMKE, U. & MOORE, J. B. (1994) Optimization and Dynamical Systems. London: Springer.
17. HEROUX, M., BARTLETT, R., HOWLE, V., HOEKSTRA, R., HU, J., KOLDA, T., LEHOUCQ, R., LONG, K., PAWLOWSKI, R., PHIPPS, E., SALINGER, A., THORNQUIST, H., TUMINARO, R., WILLENBRING, J. & WILLIAMS, A. (2003) An overview of Trilinos. Technical Report SAND2003-2927. Albuquerque, NM: Sandia National Laboratories.
18. HETMANIUK, U. & LEHOUCQ, R. (2006) Basis selection in LOBPCG. J. Comput. Phys., 218, 324-332.
19. KNYAZEV, A. V. (2001) Toward the optimal preconditioned eigensolver: locally optimal block preconditioned conjugate gradient method. SIAM J. Sci. Comput., 23, 517-541.
20. LUENBERGER, D. G. (1972) The gradient projection method along geodesics. Manag. Sci., 18, 620-631.
21. LUNDSTRÖM, E. & ELDÉN, L. (2002) Adaptive eigenvalue computations using Newton's method on the Grassmann manifold. SIAM J. Matrix Anal. Appl., 23, 819-839.
22. NOCEDAL, J. & WRIGHT, S. J. (1999) Numerical Optimization. Springer Series in Operations Research. New York: Springer.
23. NOTAY, Y. (2002) Combination of Jacobi-Davidson and conjugate gradients for the partial symmetric eigenproblem. Numer. Linear Algebra Appl., 9, 21-44.
24. POWELL, M. J. D. (1970a) A hybrid method for nonlinear equations. Numerical Methods for Nonlinear Algebraic Equations (P. Rabinowitz ed.). London: Gordon and Breach, pp. 87-114.
25. POWELL, M. J. D. (1970b) A new algorithm for unconstrained optimization. Nonlinear Programming (J. B. Rosen, O. L. Mangasarian & K. Ritter eds). London: Academic Press, pp. 31-65.
26. POWELL, M. J. D. (1975) Convergence properties of a class of minimization algorithms. Nonlinear Programming (O. L. Mangasarian, R. R. Meyer & S. M. Robinson eds), vol. 2. London: Academic Press, pp. 1-27.
27. SAMEH, A. & TONG, Z. (2000) The trace minimization method for the symmetric generalized eigenvalue problem. J. Comput. Appl. Math., 123, 155-175.
28. SAMEH, A. H. & WISNIEWSKI, J. A. (1982) A trace minimization algorithm for the generalized eigenvalue problem. SIAM J. Numer. Anal., 19, 1243-1259.
29. SHUB, M. (1986) Some remarks on dynamical systems and numerical analysis. Proceedings of the VII ELAM (L. Lara-Carrero & J. Lewowicz eds). Caracas: Equinoccio, University of Simón Bolívar, pp. 69-92.
30. SHULTZ, G. A., SCHNABEL, R. B. & BYRD, R. H. (1985) A family of trust-region-based algorithms for unconstrained minimization with strong global convergence properties. SIAM J. Numer. Anal., 22, 47-67.
31. SLEIJPEN, G. L. G. & VAN DER VORST, H. A. (1996) A Jacobi-Davidson iteration method for linear eigenvalue problems. SIAM J. Matrix Anal. Appl., 17, 401-425.
32. SMITH, S. T. (1993) Geometric optimization methods for adaptive filtering. Ph.D. Thesis, Division of Applied Sciences, Harvard University, Cambridge, MA.
33. SMITH, S. T. (1994) Optimization techniques on Riemannian manifolds. Hamiltonian and Gradient Flows, Algorithms and Control (Anthony Bloch ed.). Fields Institute Communications, vol. 3. Providence, RI: American Mathematical Society, pp. 113-136.
34. STEIHAUG, T. (1983) The conjugate gradient method and trust regions in large scale optimization. SIAM J. Numer. Anal., 20, 626-637.
35. TOINT, P. L. (1981) Towards an efficient sparsity exploiting Newton method for minimization. Sparse Matrices and Their Uses (I. S. Duff ed.). London: Academic Press, pp. 57-88.
36. UDRIŞTE, C. (1994) Convex Functions and Optimization Methods on Riemannian Manifolds. Dordrecht: Kluwer Academic Publishers.