Subgradient method with entropic projections for convex nondifferentiable minimization

Journal of Optimization Theory and Applications

Volumn 96, Issue 1, 1998, Pages 159-173

  Kiwiel, K C ^a  

^a SYSTEMS RESEARCH INSTITUTE   (Poland)

Author keywords

Convex programming; entropic projections; nondifferentiable optimization; subgradient algorithms

Indexed keywords

CONSTRAINED OPTIMIZATION;

CONSTRAINED MINIMIZATION; ENTROPIC PROJECTION; GLOBAL CONVER-GENCE; INTERIOR POINT; MINIMISATION; NON-DIFFERENTIABLE; NON-DIFFERENTIABLE OPTIMIZATION; ORTHOGONAL PROJECTION; SUB-GRADIENT ALGORITHM; SUB-GRADIENT METHODS;

CONVEX OPTIMIZATION;

EID: 0032331714     PISSN: 00223239     EISSN: None     Source Type: Journal    
DOI: 10.1023/A:1022671302532     Document Type: Article

References (29)

1. HELD, M., WOLFE, P., and CROWDER, H. P., Validation of Subgradient Optimization, Mathematical Programming, Vol. 6, pp. 62-88, 1974.
2. POLYAK, B. T., Minimization of Unsmooth Functional, Zhurnal Vychislitielnoj Matematiki i Matematicheskoj Fiziki, Vol. 9, pp. 509-521, 1969 (Russian); English Translation in USSR Computational Mathematics and Mathematical Physics, Vol. 9, pp. 14-29, 1969.
3. POLYAK, B. T., Minimization of Unsmooth Functional, Zhurnal Vychislitielnoj Matematiki i Matematicheskoj Fiziki, Vol. 9, pp. 509-521, 1969 (Russian); English Translation in USSR Computational Mathematics and Mathematical Physics, Vol. 9, pp. 14-29, 1969.
4. KIM, S., and UM, B. S., An Improved Subgradient Method for Constrained Nondifferentiable Optimization, Operations Research Letters, Vol. 14, pp. 61-64, 1993.
5. KIWIEL, K. C., The Efficiency of Subgradient Projection Methods for Convex Optimization, Part 2: Implementations and Extensions, SIAM Journal on Control and Optimization, Vol. 34, pp. 677-697, 1996.
6. LARSSON, T., PATRIKSSON, M., and STRÖMBERG, A. B., Conditional Subgradient Optimization: Theory and Applications, European Journal of Operations Research, Vol. 88, pp. 382-403, 1996.
7. n, Operations Research Letters, Vol. 8, pp. 219-222, 1989.
8. SHOR, N. Z., Minimization Methods for Nondifferentiable Functions, Naukova Dumka, Kiev, 1979 (Russian); English Translation by Springer Verlag, Berlin, Germany, 1985.
9. TEBOULLE, M., Entropic Proximal Mappings with Applications to Nonlinear Programming, Mathematics of Operations Research, Vol. 17, pp. 670-690, 1992.
10. KIWIEL, K. C., A Subgradient Method with Bregman Projections for Convex Constrained Nondifferentiable Minimization, Technical Report, Systems Research Institute, Warsaw, Poland, 1996.
11. BREGMAN, L. M., Finding a Common Point of Convex Sets by the Method of Successive Projections, Doklady Akademii Nauk SSSR, Vol. 162, pp. 487-490, 1965 (Russian); English Translation in Soviet Mathematical Doklady, Vol. 6, pp. 688-692, 1965.
12. BREGMAN, L. M., Finding a Common Point of Convex Sets by the Method of Successive Projections, Doklady Akademii Nauk SSSR, Vol. 162, pp. 487-490, 1965 (Russian); English Translation in Soviet Mathematical Doklady, Vol. 6, pp. 688-692, 1965.
13. KIWIEL, K. C., Free-Steering Relaxation Methods for Problems with Strictly Convex Costs and Linear Constraints, Mathematics of Operations Research, Vol. 22, pp. 326-379, 1997.
14. CENSOR, Y., and LENT, A., An Iterative Row-Action Method for Interval Convex Programming, Journal of Optimization Theory and Applications, Vol. 34, pp. 321-353, 1981.
15. AUSLENDER, A., and HADDOU, M., An Interior-Proximal Method for Convex Linearly Constrained Problems and Its Extension to Variational Inequalities, Mathematical Programming, Vol. 71, pp. 77-100, 1995.
16. CHEN, G., and TEBOULLE, M., Convergence Analysis of a Proximal-Like Minimization Algorithm Using Bregman Functions, SIAM Journal on Optimization, Vol. 3, pp. 538-543, 1993.
17. ECKSTEIN, B., Nonlinear Proximal Point Algorithms Using Bregman Functions, with Applications to Convex Programming, Mathematics of Operations Research, Vol. 18, pp. 202-226, 1993.
18. IUSEM, A. N., SVAITER, B., and TEBOULLE, M., Entropy-Like Proximal Methods in Convex Programming, Mathematics of Operations Research, Vol. 19, pp. 790-814, 1994.
19. IUSEM, A. N., and TEBOULLE, M., Convergence Rate Analysis of Nonquadratic Proximal and Augmented Lagrangian Methods for Convex and Linear Programming, Mathematics of Operations Research, Vol. 30, pp. 657-677, 1995.
20. KIWIEL, K. C., Proximal Minimization Methods with Generalized Bregman Functions, SIAM Journal on Control and Optimization, Vol. 35, pp. 1142-1168, 1997.
21. POLYAK, R., and TEBOULLE, M., Nonlinear Rescaling and Proximal-Like Methods in Convex Optimization, Mathematical Programming, Vol. 76, pp. 265-284, 1997.
22. TEBOULLE, M., Convergence of Proximal-Like Algorithms, SIAM Journal on Control and Optimization (to appear).
23. BEASLEY, J. E., Lagrangian Relaxation, Modern Heuristic Techniques for Combinatorial Problems, Edited by C. R. Reeves, Blackwell Scientific Publications, Oxford, England, pp. 243-303, 1993.
24. FISHER, M. L., An Applications Oriented Guide to Lagrangian Relaxation, Interfaces, Vol. 15, pp. 10-21, 1985.
25. BAZARAA, M. S., SHERALI, H. D., and SHETTY, C. M., Nonlinear Programming: Theory and Algorithms, 2nd Edition, Wiley, New York, New York, 1993.
26. MINOUX, M., Mathematical Programming: Theory and Algorithms, John Wiley and Sons, Chichester, England, 1986.
27. CAPRARA, A., FISCHETTI, M., and TOTH, P., A Heuristic Algorithm for the Set Covering Problem, Integer Programming and Combinatorial Optimization, Edited by W. H. Cunningham, S. T. McCormick, and M. Queyranne, Lecture Notes in Computer Science, Springer Verlag, Berlin, Germany, Vol. 1084, pp. 72-84, 1996.
28. ROCKAFELLAR, R. T., Convex Analysis, Princeton University Press, Princeton, New Jersey, 1970.
29. KIWIEL, K. C., The Efficiency of Subgradient Projection Methods for Convex Optimization, Part 1: General Level Methods, SIAM Journal on Control and Optimization, Vol. 34, pp. 660-676, 1996.