Constrained discounted Markov Decision Processes and Hamiltonian Cycles

Mathematics of Operations Research

Volumn 25, Issue 1, 2000, Pages 130-140

  Feinberg, Eugene A ^a  

^a STONY BROOK UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL COMPLEXITY; CONSTRAINT THEORY; DECISION THEORY; MATHEMATICAL PROGRAMMING; TRAVELING SALESMAN PROBLEM;

DISCRETE OPTIMIZATION; HAMILTONIAN CYCLES (HC); MARKOV DECISION PROCESS (MDP); STOCHASTIC OPTIMIZATION;

MARKOV PROCESSES;

EID: 0034138636     PISSN: 0364765X     EISSN: None     Source Type: Journal    
DOI: 10.1287/moor.25.1.130.15210     Document Type: Article

References (14)

1. Bertsekas, D. P. 1987. Dynamic Programming: Deterministic and Stochastic Models. Prentice-Hall, Englewood Cliffs, NJ.
2. Blackwell, D. 1962. Discrete dynamic programming. Ann. Math. Statist. 33 719-726.
3. Chen, M., J. A. Filar. 1992. Hamiltonian cycles, quadratic programming, and ranking of extreme points. C. Floudas and P. Pardalos, eds. Global Optimization. Princeton University Press, NJ. 32-39.
4. Feinberg, E. A., A. Shwartz. 1994. Markov decision processes with weighted discounted criteria. Math. Oper. Res. 19 152-168.
5. _, _. 1995. Constrained Markov decision processes with weighted discounted criteria. Math. Oper. Res. 20 302-320.
6. _, _. 1999. Constrained dynamic programming with two discount factors: Applications and an algorithm. IEEE Trans. Automatic Control. 44 628-631.
7. Filar, J. A., D. Krass. 1994. Hamiltonian cycles and Markov chains. Math. Oper. Res. 19 223-237.
8. _, K. Liu. 1996. Hamiltonian cycle problem and singularly perturbed Markov decision process. T. S. Ferguson, L. S. Shapley, and J. B. MacQueen eds. Statistics, Probability and Game Theory. Papers in Honor of David Blackwell. Institute of Mathematical Statistics. Lecture Notes - Monograph Series 30 45-63.
9. Heyman, D. P., M. J. Sobel. 1984. Stochastic Models in Operations Research, Volume II: Stochastic Optimization. McGraw-Hill, NJ.
10. Kallenberg, L. C. M. 1983. Linear Programming and Finite Markovian Control Problems. Math Centre Tracts 148, Mathematisch Centrum, Amsterdam, The Netherlands.
11. Krass, D. 1989. Contributions to the Theory and Applications of Markov Decision Processes. Ph.D. Thesis, Johns Hopkins University, Baltimore, MD.
12. _, J. A. Filar, S. S. Sinha. 1992. A weighted Markov decision process. Oper. Res. 40 1180-1187.
13. Papadimitriou, C. H., N. Tsitsiklis. 1987. Complexity of Markov decision processes. Math. Oper. Res. 12 441-450.
14. Reiman, M I., A. Shwartz. 1997. Call admission: A new approach to quality of service, CC Pub. 216, Technion, and Bell Labs Manuscript.