Alternating projections on manifolds

Mathematics of Operations Research

Volumn 33, Issue 1, 2008, Pages 216-234

  Lewis, Adrian S ^a   Malick, Jérôme ^b  

^a School of Operations Research and Industrial Engineering   (United States)

^b INRIA RHÔNE ALPES   (France)

Author keywords

Alternating projections; Linear convergence; Low rank approximation; Metric regularity; Nonconvex; Spectral set; Subspace angle

Indexed keywords

ALTERNATING PROJECTIONS; LINEAR CONVERGENCE; LOW-RANK APPROXIMATION; METRIC REGULARITY; NONCONVEX; SPECTRAL SET; SUBSPACE ANGLE;

EID: 48549094732     PISSN: 0364765X     EISSN: 15265471     Source Type: Journal    
DOI: 10.1287/moor.1070.0291     Document Type: Article

References (42)

1. Auslender, L. 1967. Differential Geometry. Harper and Row, New York.
2. Bauschke, H. H., J. M. Borwein. 1993. On the convergence of von Neumann's alternating projection algorithm for two sets. Set Valued Anal. 1(2) 185-212.
3. Bauschke, H. H., J. M. Borwein. 1996. On projection algorithms for solving convex feasibility problems. SIAM Rev. 38(3) 367-426.
4. Bauschke, H. H., P. L. Combettes, D. R. Luke. 2002. Phase retrieval, error reduction algorithm, and Fienup variants: A view from convex optimization. J. Optical Soc. Amer. 19(7) 1334-1345.
5. Borwein, J. M., A. S. Lewis. 2005. Convex Analysis and Nonlinear Optimization, 2nd ed. Springer-Verlag, New York.
6. Chen, X., M. T. Chu. 1996. On the least squares solution of inverse eigenvalue problems. SIAM J. Numer. Anal. 33 2417-2430.
7. Cheney, W., A. Goldstein. 1959. Proximity maps for convex sets. Proc. Amer: Math. Soc. 10(3) 448-450.
8. Chu, M. T. 1995. Constructing a Hermitian matrix from its diagonal entries and eigenvalues. SIAM J. Matrix Anal. Appl. 16 207-217.
9. Chu, M. T., K. R. Driessel. 1990. The projected gradient method for least squares matrix approximations with spectral constraints. SIAM J. Numer: Anal. 27 1050-1060.
10. Combettes, P. L. 1993. Signal recovery by best feasible approximation. IEEE Trans. Image Processing 2(2) 269-271.
11. Combettes, P. L., H. J. Trussell. 1990. Method of successive projections for finding a common point of sets in metric spaces. J. Optim. Theory Appl. 67(3) 487-507.
12. Dennis, J. E., R. B. Schnabel. 1983. Numerical Methods for Unconstrained Optimization and Nonlinear Equations. Prentice-Hall, Englewood Cliffs, NJ.
13. Deutsch, F. 1995. The angle between subspaces of a Hubert space. S. P. Singh, ed. Approximation Theory, Wavelets and Applications. Kluwer, Dordrecht, Netherlands, 107-130.
14. Deutsch, F. 200.1. Best Approximation in Inner Product Spaces. Springer, New York.
15. Dontchev, A. L., A. S. Lewis, T. Rockafellar. 2003. The radius of metric regularity. Trans. Amer: Math. Soc. 355(2) 493-517.
16. Facchinei, F., J.-S. Pang. 2003. Finite-Dimensional Variational Inequalities and Complementarity Problems, Vol. II. Springer, New York.
17. Friedricks, K. 1937. On certain inequalities and characteristic value problems for analytic functions and for functions of two variables. Trans. Amer: Math. Soc. 41 321-364.
18. Golub, G. H., C. F. Van Loan. 1995. Matrix Computations, 3rd ed. Johns Hopkins University Press, Baltimore.
19. Grigoriadis, K. M., E. Beran. 2000. Alternating projection algorithms for linear matrix inequalities problems with rank constraints. Adv. Linear Matrix Inequality Methods in Control, SIAM, Philadelphia, 251-267.
20. Grigoriadis, K. M., R. E. Skelton. 1996. Low-order control design for LMI problems using alternating projection methods. Automatica 32 1117-1125.
21. Hardy, G. H., J. E. Littlewood, G. Pólya. 1952. Inequalities. Cambridge University Press, Cambridge, UK.
22. Higham, N. 2002. Computing a nearest symmetric correlation matrix: A problem from finance. IMA J. Numer: Anal. 22(3) 329-343.
23. Holmes, R. B. 1973. Smoothness of certain metric projections on Hilbert space. Trans. Amer. Math. Soc. 184 87-100.
24. Horn, R. A., Ch. R. Johnson. 1989. Matrix Analysis, New ed. 1999. Cambridge University Press, Cambridge, UK.
25. Lewis, A. S. 1996. Convex analysis on the Hermitian matrices. SIAM J. Optim. 6 164-177.
26. Lewis, A. S. 1996. Group invariance and convex matrix analysis. SIAM J. Matrix Anal. Appl. 17 927-949.
27. Lewis, A. S., D. R. Luke, J. Malick. 2007. Local linear convergence of alternating and averaged projections. Preprint, Cornell University School of ORIE, Ithaca, NY.
28. Nesterov, Y. E., A. S. Nemirovskii. 1994. Interior-Point Polynomial Algorithms in Convex Programming. SIAM, Philadelphia.
29. Nocedal, J., S. J. Wright. 1999. Numerical Optimization. Springer Verlag, New York.
30. Orsi, R. 2006. Numerical methods for solving inverse eigenvalue problems for nonnegative matrices. SIAM J. Matrix Anal. Appl. 28 190-212.
31. Orsi, R., U. Helmke, J. Moore. 2006. A Newton-like method for solving rank constrained linear matrix inequalities. Automatica 42 1875-1882.
32. Oustry, F. 2000. A second-order bundle method to minimize the maximum eigenvalue function. Math. Programming 89 1-34.
33. Poliquin, R. A., R. T. Rockafellar, L. Thibault. 2000. Local differentiability of distance functions. Trans. Amer. Math. Soc. 352 5231-5249.
34. Robinson, S. B. 2003. Constraint nondegeneracy in variational analysis. Math. Oper: Res. 28 201-232.
35. Rockafellar, R. T., R. J.-B. Wets. 1998. Variational Analysis. Springer Verlag, Heidelberg, Germany.
36. Smith, K. T., D. C. Solomon, S. L. Wagner. 1977. Practical and mathematical aspects of the problem of reconstructing objects from radiographs. Bull. Amer: Math. Soc. 83 1227-1270.
37. Tropp, J. A., I. S. Dhillon, R. W. Heath, T. Strohmer. 2005. Designing structured tight frames via an alternating projection method. IEEE Trans. Inform. Theory 51 188-209.
38. von Neumann, J. 1937. Some matrix inequalities and metrization of matric-space. Tomsk University Rev. 1 286-300. Collected Works, Vol. IV. Pergamon, Oxford, UK, 1962, 205-218.
39. von Neumann, J. 1950. Functional operators, Vol. II. The geometry of orthogonal spaces. Annals of Mathematical Studies, Vol. 22. Princeton University Press, Princeton, NJ. [Reprint of mimeographed notes first distributed in 1933.]
40. Weber, C. A., J. P. Allebach. 1986. Reconstruction of frequency-offset Fourier data by alternating projection on constraint sets. Proc. 24th Allerton Conf. Comm., Control and Comput., Monticello, IL, 194-203.
41. Widrow, B., E. Wallach. 1996. Adaptive Inverse Control. Prentice-Hall, Englewood Cliffs, NJ.
42. Yang, K., R. Orsi. 2006. Generalized pole placement via static output feedback: A methodology based on projections. Automatica 42 2143-2150.