Control limits for two-state partially observable Markov decision processes

European Journal of Operational Research

Volumn 182, Issue 1, 2007, Pages 300-304

  Grosfeld Nir, Abraham ^a  

^a ACADEMIC COLLEGE OF TEL AVIV YAFFO   (Israel)

Author keywords

Bayes' formula; Control limit; POMDP

Indexed keywords

COST ACCOUNTING; DECISION THEORY; OPTIMIZATION; PROBABILITY; PROFITABILITY; THEOREM PROVING;

BAYES' FORMULA; CONTROL LIMIT;

MARKOV PROCESSES;

EID: 34147157217     PISSN: 03772217     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ejor.2006.08.033     Document Type: Article

References (15)

1. Albright S.C. Structural results for partially observable markov decision processes. Operations Research 27 (1979) 1041-1053
2. Bertsekas D. Dynamic Programming and Stochastic Control (1976), Academic Press, New York
3. Givon, M., Grosfeld-Nir, A., in press. Using partially observed markov processes to select optimal termination time of TV shows. Omega.
4. Grosfeld-Nir A. A two state partially observable markov decision process with uniformly distributed observations. Operations Research 44 (1996) 458-463
5. Lane D.E. A partially observable model of decision making by fishermen. Operations Research 37 2 (1989) 240-254
6. Lovejoy W. Ordered solutions for dynamic programs. Mathematics of Operations Research 12 (1987) 269-276
7. Lovejoy W. A survey of algorithmic methods for POMDP's. Annals of Operations Research 28 (1991) 47-65
8. Lu J., Mashita T., and Suzuki K. An optimal policy for partially observable Markov decision processes with non-independent monitors. Journal of Quality in Maintenance Engineering 11 #3 (2005) 228-238
9. Monahan G.E. A survey of partially observable markov decision processes: Theory, models and algorithms. Management Science 28 (1982) 1-16
10. Nir (Grosfeld-Nir), A. 1986. Optimal control of a partially observable markov chain. Unpublished Ph.D. Dissertation, Northwestern University.
11. Suzuki K. On a preventive maintenance with monitored system. Journal of the Operations Research Society of Japan 22 (1979) 69-82
12. Treharne J.T., and Sox C.R. Adaptive inventory control for nonstationary demand and partial information. Management Science 48 5 (2002) 607-624
13. White C. Optimal control-limit strategies for a partially observed replacement problem. International Journal of System Science 10 (1979) 321-331
14. White C. A survey of solution techniques for POMDP. Annals of Operations Research 32 (1991) 215-230
15. White D.J. Further real applications of Markov decision processes. Interfaces 18 (1988) 55-61