An efficient heuristic for a partially observable Markov decision process of machine replacement

Computers and Operations Research

Volumn 24, Issue 2, 1997, Pages 117-126

  Sinuany Stern, Zilla ^a   David, Israel ^a   Biran, Sigal ^a  

^a BEN GURION UNIVERSITY OF THE NEGEV   (Israel)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL COMPLEXITY; COMPUTER SIMULATION; GENETIC ALGORITHMS; MARKOV PROCESSES; OPTIMIZATION; PROBABILITY;

GENERIC ALGORITHM; MACHINE REPLACEMENT; PARTIALLY OBSERVABLE MARKOV DECISION PROCESS;

HEURISTIC PROGRAMMING;

EID: 0031077014     PISSN: 03050548     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0305-0548(96)00043-3     Document Type: Article

References (12)

1. Monahan, G. E., A survey of POMDP's: theory. Models and Algorithms, Manag. Sci., 1982, 28, 1-16.
2. Lovejoy, W. S., A survey of algorithmic methods for POMDP's. Ann. Oper. Res., 1991, 28, 47-65.
3. White, C. C., A survey of solution techniques for the POMDP. Ann. Oper. Res., 1991, 32, 215-230.
4. Sinuany-Stern, Z., Replacement policy under partially observed Markov process. Inter. J. Prod. Econ., 1993, 29, 159-166.
5. Derman, C., Finite State Markovian Decision Processes. Academic Press, New York, 1970.
6. White, C. C., Optimal control limit strategies for a partially observed replacement problem. Int. J. Sys. Sci., 1979, 10, 321-331.
7. Lovejoy, W. S., Computationally feasible bounds for POMDP's. Oper. Res., 1991, 39, 162-175.
8. Bertsekas, D. P., Dynamic Programming and Stochastic Control. Academic Press, New York, 1976.
9. Sondik, E. J., The optimal control of POMDP's over the infinite horizon: discounted costs'. Oper. Res., 1978, 26, 282-304.
10. Johnson, E., Computation and structure of optimum reset policy. J. Am. Stat. Assoc., 1967, 62, 1462-1487.
11. Ayers, D. D., A User Manual for Solving POMDP. Dept. of Engineering Economic Systems, Stanford University, Stanford, 1991.
12. Smallwood, R. D. and Sondik, E. J., Optimal control of partially observable processes over the finite horizon. Oper. Res., 1973, 21, 1071-1088.