Markov decision processes with noise-corrupted and delayed state observations

Journal of the Operational Research Society

Volumn 50, Issue 6, 1999, Pages 660-668

  Bander, J L ^a   White, C C ^a  

^a UNIVERSITY OF MICHIGAN   (United States)

Author keywords

Dynamic programming; Markov processes; Optimisation

Indexed keywords

DATA REDUCTION; DECISION THEORY; DYNAMIC PROGRAMMING; MARKOV PROCESSES; PROBABILITY DISTRIBUTIONS;

DELAYED STATE OBSERVATIONS; MARKOV DECISION PROCESSES;

QUALITY CONTROL;

EID: 0032629911     PISSN: 01605682     EISSN: 14769360     Source Type: Journal    
DOI: 10.1057/palgrave.jors.2600745     Document Type: Article

References (14)

1. Brooks DM and Leondes CT (1972). Markov decision processes with state information-lag. Opns Res 20: 904-907.
2. Kim SH (1985). State information lag Markov decision process with control limit rule. Naval Res Logist Q 32: 491-496.
3. Kim SH and Jeong BH (1987). A partially observable Markov decision process with lagged information. J Opl Res Soc 38: 439-446.
4. White III CC (1988). Note on ‘a partially observable Markov decision process with lagged information’. J Opl Res Soc 39: 217-218.
5. White, III CC and Harrington DP (1980). Application of Jensen’s inequality to adaptive suboptimal design. J Opt Theor Appl 32: 89-99.
6. White, III CC (1991). A survey of solution techniques for the partially observed Markov decision process. Annals Opns Res 32: 215-230.
7. Bertsekas DP (1987). Dynamic Programming: Deterministic and Stochastic Models. Prentice-Hall: Englewood Cliffs. Puterman ML (1994). Markov Decision Processes: Discrete Stochastic Dynamic Programming. Wiley: Chichester.
8. Sondik EJ 1971. The Optimal Control of Partially-Observable Markov Processes. PhD thesis, Stanford University.
9. Smallwood RD and Sondik EJ (1973). The optimal control of partially observable Markov processes over a finite horizon. Opns Res 21: 1071-1078.
10. Sondik EJ (1978). The optimal control of partially observable Markov processes over the infinite horizon: Discounted costs. Opns Res 26: 282-304.
11. White, III CC and Scherer WT (1989). Solution procedures for partially observed Markov decision processes. Opns Res 37: 791-797.
12. Platzman LK (1980). Optimal infinite-horizon undiscounted control of finite probabilistic systems. SIAM J Control Opt 18: 362-380.
13. Lovejoy WS (1991). Computationally feasible bounds for partially observed Markov decision processes. Opns Res 39: 162-175.
14. Kaelbling LP, Littman ML and Cassandra AR (1995). Partially observable Markov decision processes for artificial intelligence. In: Dorst L, Lambalgen M, and Voorbraak F (eds). Reasoning with Uncertainty in Robotics: International workshop proceedings/RUR 1995, Amsterdam, The Netherlands, volume 1093 of Lecture Notes in Computer Science, Springer: Berlin, December 1995. 146-163.