Projection-like retractions on matrix manifolds

SIAM Journal on Optimization

Volumn 22, Issue 1, 2012, Pages 135-158

  Absil, P A ^a   Malick, J́er̂ome ^b  

^a UNIVERSITÉ CATHOLIQUE DE LOUVAIN   (Belgium)

^b CNRS   (France)

Author keywords

Equality constrained optimization; Feasible optimization method; Fixed rank matrices; Matrix manifold; Projection; Retraction; Spectral manifold; Stiefel manifold

Indexed keywords

EQUALITY-CONSTRAINED OPTIMIZATION; OPTIMIZATION METHOD; PROJECTION; RETRACTION; SPECTRAL MANIFOLD; STIEFEL MANIFOLD;

COMPUTER SCIENCE; SOFTWARE ENGINEERING;

ALGORITHMS;

EID: 84861639358     PISSN: 10526234     EISSN: None     Source Type: Journal    
DOI: 10.1137/100802529     Document Type: Article

References (36)

1. P.-A. Absil, C. G. Baker, and K. A. Gallivan, Trust-region methods on Riemannian manifolds, Found. Comput. Math., 7 (2007), pp. 303-330.
2. P.-A. Absil, R. Mahony, and R. Sepulchre, Optimization Algorithms on Matrix Manifolds, Princeton University Press, Princeton, NJ, 2008.
3. P.-A. Absil, R. Mahony, and R. Sepulchre, Optimization on manifolds: Methods and applications, in Recent Trends in Optimization and its Applications in Engineering, M. Diehl, F. Glineur, E. Jarlebring, and W. Michiels, eds., Springer-Verlag, Berlin, 2010, pp. 125-144.
4. R. L. Adler, J.-P. Dedieu, J. Y. Margulies, M. Martens, and M. Shub, Newton's method on Riemannian manifolds and a geometric model for the human spine, IMA J. Numer. Anal., 22 (2002), pp. 359-390.
5. S. Bittanti, A. J. Laub, and J. C. Willems, eds., The Riccati equation, Comm. Control Engrg. Ser., Springer-Verlag, Berlin, 1991.
6. W. M. Boothby, An Introduction to Differentiable Manifolds and Riemannian Geometry, 2nd ed., Academic Press, New York, 2003.
7. A. Daniilidis, W. Hare, and J. Malick, Geometrical interpretation of proximal-type algorithms in structured nonsmooth optimization, Optimization, 55 (2006), pp. 481-503.
8. A. Daniilidis, J. Malick, and H. Sendov, Locally symmetric submanifolds lift to spectral manifolds, preprint UAB 23/2009.
9. C. Eckart and G. Young, The approximation of one matrix by another of lower rank, Psychometrika, 1 (1936), pp. 211-218.
10. A. Edelman, T. A. Arias, and S. T. Smith, The geometry of algorithms with orthogonality constraints, SIAM J. Matrix Anal. Appl., 20 (1998), pp. 303-353.
11. D. Gabay, Minimizing a differentiable function over a differential manifold, J. Optim. Theory Appl., 37 (1982), pp. 177-219.
12. E. Hairer, C. Lubich, and G. Wanner, Geometric numerical integration, in Structure-Preserving Algorithms for Ordinary Differential Equations, 2nd ed., Springer Ser. Comput. Math. 31, Springer-Verlag, Berlin, 2006.
13. U. Helmke and J. B. Moore, Optimization and Dynamical Systems, Commun. Control Engrg. Ser., Springer-Verlag London, London, 1994.
14. H. Herrlich and G. E. Strecker, Category Theory: An Introduction, Ser. Advanced Math., Allyn and Bacon, Boston, MA, 1973.
15. N. J. Higham, Matrix nearness problems and applications, in Applications of Matrix Theory, Inst. Math. Appl. Conf. Ser. New Ser. 22, Oxford University Press, New York, 1989, pp. 1-27.
16. J.-B. Hiriart-Urruty, At what point is the projection mapping differentiable, AmericanMath. Monthly, 1983, pp. 456-458.
17. J.-B. Hiriart-Urruty and C. Lemaréchal, Convex Analysis and Minimization Algorithms, Springer Verlag, Heidelberg, 1993.
18. N.-D. Ho, Nonnegative Matrix Factorization Algorithms and Applications, Ph.D. thesis, Universit é catholique de Louvain, 2008.
19. R. B. Holmes, Smoothness of certain metric projection on Hilbert space, Trans. Amer. Math. Soc., 184 (1973), pp. 87-100.
20. R. A. Horn and C. R. Johnson, Matrix Analysis, Cambridge University Press, Cambridge, UK, 1989.
21. C. Lemaréchal, F. Oustry, and C. Sagastizábal, The U-Lagrangian of a convex function, Trans. Amer. Math. Soc., 352 (2000), pp. 711-729.
22. A. S. Lewis, Convex analysis on the Hermitian matrices, SIAM J. Optim., 6 (1996), pp. 164-177.
23. A. Lewis and J. Malick, Alternating projections on manifolds, Math. Oper. Res., 33 (2007).
24. D. G. Luenberger, The gradient projection method along geodesics, Management Sci., 18 (1972), pp. 620-631.
25. R. Mahony, Optimization Algorithms on Homogeneous Spaces: With Applications in Linear Systems Theory, Ph.D. thesis, Department of Systems Engineering, Australian National University, Acton, Australia, 1994.
26. J. Malick and S. A. Miller, Newton methods for convex minimization: Connection among U-Lagrangian, Riemannian Newton and SQP methods, Math. Program., 104 (2005).
27. J. H. Manton, Optimization algorithms exploiting unitary constraints, IEEE Trans. Signal Process., 50 (2002), pp. 635-650.
28. F. Oustry, The U-Lagrangian of the maximum eigenvalue function, SIAM J. Optim., 9 (1999), pp. 526-549.
29. F. Oustry, A second-order bundle method to minimize the maximum eigenvalue function, Math. Program., 89 (2000), pp. 1-34.
30. M. Shub, Some remarks on dynamical systems and numerical analysis, in Proceedings of the 7th ELAM, L. Lara-Carrero and J. Lewowicz, eds., Equinoccio, U. Simón Bolívar, Caracas, Venezuela, 1986, pp. 69-92.
31. S. T. Smith, Geometric Optimization Methods for Adaptive Filtering, Ph.D. thesis, Division of Applied Sciences, Harvard University, Cambridge, MA, 1993.
32. S. T. Smith, Optimization techniques on Riemannian manifolds, in Hamiltonian and Gradient Flows, Algorithms and Control, A. Bloch, ed., Fields Inst. Commun. 3, American Mathematical Society, Providence, RI, 1994, pp. 113-136.
33. C. Udrişte, Convex Functions and Optimization Methods on Riemannian Manifolds, Math. Appl. 297, Kluwer Academic, Dordrecht, The Netherlands, 1994.
34. B. Vandereycken, P.-A. Absil, and S. Vandewalle, Embedded geometry of the set of symmetric positive semidefinite matrices of fixed rank, in Proceedings of the IEEE 15th Workshop on Statistical Signal Processing, 2009, pp. 389-392.
35. B. Vandereycken, P.-A. Absil, and S. Vandewalle, A Riemannian geometry with complete geodesics for the set of positive semidefinite matrices of fixed rank, http://people.cs. kuleuven.be/bart.vandereycken/papers/TW572 final.pdf (2010).
36. R. Webster, Convexity, Oxford Science Publications, New York, 1994.