Local convergence analysis of projection-type algorithms: Unified approach

Journal of Optimization Theory and Applications

Volumn 115, Issue 1, 2002, Pages 211-230

  Xiu, N H ^a   Zhang, J Z ^b  

^a BEIJING JIAOTONG UNIVERSITY   (China)

^b CITY UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

local convergence; projection methods; Variational inequalities

Indexed keywords

VARIATIONAL TECHNIQUES;

CONDITION; CONVERGENCE ANALYSIS; CONVERGENCE BEHAVIORS; LOCAL CONVERGENCE; PROJECTION METHOD; PROJECTION TYPES; TYPE METHODS; UNIFIED APPROACH; VARIATIONAL INEQUALITIES; VARIATIONAL INEQUALITY PROBLEMS;

ITERATIVE METHODS;

EID: 0036341174     PISSN: 00223239     EISSN: None     Source Type: Journal    
DOI: 10.1023/A:1019637315803     Document Type: Article

References (50)

1. GLOWINSKI, R., Numerical Methods for Nonlinear Variational Inequalities, Springer Verlag, New York, NY, 1984.
2. HARKER, P. T., and PANG, J. S., Finite-Dimensional Variational Inequality and Nonlinear Complementarity Problems: A Survey of Theory, Algorithms, and Applications, Mathematical Programming, Vol. 48, pp. 161-220, 1990.
3. FERRIS, M. C., and KANZOW, C., Complementarity and Related Problems, Handbook on Applied Optimization, Edited by P. M. Pardalos and M. G. C. Resende, Oxford University Press, Oxford, UK, 2000.
4. KORPELEVICH, G. M., The Extragradient Method for Finding Saddle Points and Other Problems, Matecon, Vol. 12, pp. 747-756, 1976.
5. KHOBOTOV, E. N., A Modification of the Extragradient Method for Solving Variational Inequalities and Some Optimization Problems, USSR Computational Mathematics and Mathematical Physics, Vol. 27, pp. 1462-1473, 1987.
6. MARTINET, B., Determination Approchée d'un Point Fixe d'une Application Pseudo-Contractante, Comptes Rendus de l'Académie des Sciences de Paris, Vol. 274, pp. 163-165, 1972.
7. ROCKAFELLAR, R. T., Monotone Operators and the Proximal Point Algorithm, SIAM Journal on Control and Optimization, Vol. 14, pp. 877-898, 1976.
8. MANGASARIAN, O. L., Solution of Symmetric Linear Complementarity Problems by Iterative Methods, Journal of Optimization Theory and Applications, Vol. 22, pp. 465-485, 1977.
9. PANG, J. S., On the Convergence of a Basic Iterative Method for the Implicit Complementarity Problem, Journal of Optimization Theory and Applications, Vol. 37, pp. 149-162, 1982.
10. FUKUSHIMA, M., Equivalent Differentiate Optimization Problems and Descent Methods for Asymmetric Variational Inequality Problems, Mathematical Programming, Vol. 53, pp. 99-110, 1992.
11. CALAMAI, P. H., and MORÉ, J. J., Projected Gradient Methods for Linearly-Constrained Problems, Mathematical Programming, Vol. 39, pp. 93-116, 1987.
12. BURKE, J. V., and MORÉ, J. J., On the Identification of Active Constraints, SIAM Journal on Numerical Analysis, Vol. 25, pp. 1197-1211, 1988.
13. BURKE, J. V., and MORÉ, J. J., Exposing Constraints, SIAM Journal on Optimization, Vol. 4, pp. 573-595, 1994.
14. LUO, Z. Q., and TSENG, P., Error Bounds and Convergence Analysis of Feasible Descent Methods: A General Approach, Annals of Operations Research, Vol. 46, pp. 157-178, 1993.
15. TSENG, P., On Linear Convergence of Iterative Methods for the Variational Inequality Problem, Journal of Computational and Applied Mathematics, Vol. 60, pp. 237-252, 1995.
16. ZHANG, J., and XIU, N., Local Convergence Behavior of Some Projection-Type Methods for Affine Variational Inequalities, Journal of Optimization Theory and Applications, Vol. 108, pp. 205-216, 2001.
17. XIU, N., WANG, C., and ZHANG, J., Convergence Properties of Projection and Contraction Methods for Variational Inequality Problems, Applied Mathematics and Optimization, Vol. 43, pp. 147-168, 2001.
18. FACCHINEI, F., FISCHER, A., and KANZOW, C., On the Accurate Identification of Active Constraints, SIAM Journal on Optimization, Vol. 9, pp. 14-32, 1999.
19. ZARANTONELLO, E. H., Projections on Convex Sets in Hilbert Space and Spectral Theory, Contributions to Nonlinear Functional Analysis, Edited by E. H. Zarantonello, Academic Press, New York, NY, pp. 237-424, 1971.
20. TOINT, PH. L., Global Convergence of a Class of Trust-Region Methods for Nonconvex Minimization in Hubert Space, IMA Journal of Numerical Analysis, Vol. 8, pp. 231-252, 1988.
21. FERRIS, M. C., and PANG, J. S., Nondegenerate Solutions and Related Concepts in Affine Variational Inequalities, SIAM Journal on Control and Optimization, Vol. 34, pp. 244-263, 1996.
22. MARCOTTE, P., and ZHU, D. L., Weak Sharp Solutions of Variational Inequalities, SIAM Journal on Optimization, Vol. 9, pp. 179-189, 1998.
23. ZHU, D. L., and MARCOTTE, P., Convergence Properties of Feasible Descent Methods for Solving Variational Inequalities in Banach Space, Computational Optimization and Applications, Vol. 10, pp. 35-49, 1998.
24. SZNAJDER, R., and GOWDA, M. S., Nondegeneracy Concepts for Zeros of Piece-wise Smooth Functions, Mathematics of Operations Research, Vol. 23, pp. 221-238, 1998.
25. MARCOTTE, P., Application of Khobotov's Algorithm to Variational Inequalities and Network Equilibrium Problems, Information Systems and Operational Research, Vol. 29, pp. 258-270, 1991.
26. SUN, D., An Iterative Method for Solving Variational Inequality Problems and Complementarity Problems, Numerical Mathematics: Journal of Chinese Universities, Vol. 16, pp. 145-153, 1994.
27. IUSEM, A. N., An Iterative Algorithm for the Variational Inequality Problem, Computational and Applied Mathematics, Vol. 13, pp. 103-114, 1994.
28. HE, B., A New Method for a Class of Linear Variational Inequalities, Mathematical Programming, Vol. 66, pp. 137-144, 1994.
29. HE, B., A Class of Projection and Contraction Methods for Monotone Variational Inequalities, Applied Mathematics and Optimization, Vol. 35, pp. 69-76, 1997.
30. HE, B., and STOER, J., Solutions of Projection Problems over Polytopes, Numerische Mathematik, Vol. 61, pp. 73-90, 1992.
31. SOLODOV, M. V., and TSENG, P., Modified Projection-Type Methods for Monotone Variational Inequalities, SIAM Journal on Control and Optimization, Vol. 34, pp. 1814-1830, 1996.
32. SUN, D., A Class of Iterative Methods for Solving Nonlinear Projection Equations, Journal of Optimization Theory and Applications, Vol. 91, pp. 123-140, 1996.
33. SOLODOV, M. V., and SVAITER, B. F., A New Projection Method for Variational Inequality Problems, SIAM Journal on Control and Optimization, Vol. 37, pp. 765-776, 1999.
34. IUSEM, A. N., A Generalized Proximal Point Algorithm for the Variational Inequality Problem in Hilbert Space, SIAM Journal on Optimization, Vol. 8, pp. 197-216, 1998.
35. KIWIEL, K. C., Proximal Minimization Methods with Generalized Bregman Function, SIAM Journal on Control and Optimization, Vol. 35, pp. 1142-1168, 1997.
36. TSENG, P., Alternating Projection-Proximal Methods for Variational Inequality Problems, SIAM Journal on Optimization, Vol. 7, pp. 951-965, 1997.
37. COTTLE, R. W., PANG, J. S., and STONE, R. E., The Linear Complementarity Problem, Academic Press, New York, NY, 1992.
38. CHEN, G., and ROCKAFELLAR, R. T., Convergence Rates in Forward-Backward Splitting, SIAM Journal on Optimization, Vol. 7, pp. 421-444, 1997.
39. FUKUSHIMA, M., The Primal Douglas-Rachford Splitting Algorithm for a Class of Monotone Mappings with Application to the Traffic Equilibrium Problem, Mathematical Programming, Vol. 72, pp. 1-15, 1996.
40. GLOWINSKI, R., and LE TALLEC, P., Augmented Lagrangian and Operator-Splitting Methods in Nonlinear Mechanics, SIAM Studies in Applied Mathematics, Philadelphia, Pennsylvania, 1989.
41. TSENG, P., Further Application of a Splitting Algorithm to Decomposition in Variational Inequalities and Convex Programming, Mathematical Programming, Vol. 48, pp. 249-264, 1990.
42. TSENG, P., Applications of a Splitting Algorithm to Decomposition in Convex Programming and Variational Inequalities, SIAM Journal on Control and Optimization, Vol. 29, 119-138, 1991.
43. TSENG, P., A Modified Forward-Backward Splitting Method for Maximal Monotone Mapping, SIAM Journal on Control and Optimization, Vol. 38, pp. 431-446, 2000.
44. TAJI, K., FUKUSHIMA, M., and IBARAKI, T., A Globally Convergent Newton Method for Solving Strongly Monotone Variational Inequalities, Mathematical Programming, Vol. 58, pp. 369-383, 1993.
45. PENG, J. M., and FUKUSHIMA, M., A Hybrid Newton Method for Solving the Variational Inequality Problem via the D-Gap Function, Mathematical Programming, Vol. 86, pp. 367-386, 1999.
46. BERTSEKAS, D. P., Projected Newton Methods for Optimization Problems with Simple Constraints, SIAM Journal on Control and Optimization, Vol. 20, pp. 221-246, 1982.
47. FACCHINEI, F., JÚDICE, J., and SOARES, J., An Active Set Newton Algorithm for Large-Scale Nonlinear Programs with Box Constraints, SIAM Journal on Optimization, Vol. 8, pp. 158-186, 1998.
48. GAFNI, E. M., and BERTSEKAS, D. P., Two-Metric Projection Methods for Constrained Optimization, SIAM Journal on Control and Optimization, Vol. 22, pp. 936-964, 1984.
49. LIN, C. J., and MORÉ, J. J., Newton's Method for Large Bound-Constrained Optimization Problems, SIAM Journal on Optimization, Vol. 9, pp. 1100-1127, 1999.
50. SCHWARTZ, A., and POLAK, E., Family of Projected Descent Methods for Optimization Problems with Simple Bounds, Journal of Optimization Theory and Applications, Vol. 92, pp. 1-31, 1997.