A simple suboptimal algorithm for system maintenance under partial observability

Annals of Operations Research

Volumn 91, Issue , 1999, Pages 25-40

  David, Israel ^a   Friedman, Lea ^a   Sinuany Stern, Zilla ^a  

^a BEN GURION UNIVERSITY OF THE NEGEV   (Israel)

Author keywords

Dynamic programming: Bayesian programming; Partially observed Markov decision process: algorithms; Reliability maintenance: machine replacement; Suboptimal design

Indexed keywords

EID: 0033433372     PISSN: 02545330     EISSN: 15729338     Source Type: Journal    
DOI: 10.1023/a:1018949723461     Document Type: Article

References (18)

1. C.S. Albright, Structural results for partially observable Markov decision processes, Oper. Res. 27 (1979)1041-1053.
2. D.P. Bertsekas, Dynamic Programming and Stochastic Control, Academic Press, New York, 1976.
3. A.J. Duncan, Quality Control and Industrial Statistics, Irwin, Homewood, IL, 1986, 5th ed.
4. A. Grosfeld-Nir, A two-state partially observable Markov decision process with uniformly distributed observations, Oper. Res. 44(1996)458-463.
5. S.H. Kim and J.B. Ho, A partially observable Markov decision process with lagged information, J. Oper. Res. Soc. 38(1987)439-446.
6. D.E. Lane, A partially observable model of decision making for fishermen, Oper. Res. 37(1989)240-254.
7. W.S. Lovejoy, A survey of algorithmic methods for POMDPs, Ann. Oper. Res. 28 (1991)47-65.
8. W.S. Lovejoy, Computationally feasible bounds for POMDPs, Oper. Res. 39(1991)162-175.
9. G.E. Monahan, A survey of POMDPs: Theory, models and algorithms. Manag. Sci. 28(1982)1-16.
10. Z. Sinuany-Stern, Replacement policy under partially observed Markov process, Inter. J. Prod. Econ. 29(1993)159-166.
11. Z. Sinuany-Stern, I. David and S. Biran, An efficient heuristic for a partially observable Markov decision process of machine replacement, Computers Oper. Res. 24(1997)117-126.
12. C.C. White, A Markov quality control process subject to partial observation, Manag. Sci. 23(1977) 843-852.
13. C.C. White, Optimal control limit strategies for a partially observed replacement problem, Int. J. Sys. Sci. 10(1979)321-331.
14. C.C. White, A survey of solution techniques for the POMDP, Ann. Oper. Res. 32(1991)215-230.
15. C.C. White and D.P. Harrington, Application of Jensen's inequality for adaptive suboptimal design, J. Optim. Theory Appl. 32(1980)89-99.
16. C.C. White and W.T. Scherer, Finite-memory suboptimal design for Partially Observed Markov Decision Processes, Oper. Res. 42(1994)439-455.
17. D.J. White, Real applications of Markov decision processes, Interfaces 15(1985)7-83.
18. D.J. White, Further real applications of Markov decision processes, Interfaces 18(1988)55-61.