Optimal sensor scheduling for hidden Markov model state estimation

International Journal of Control

Volumn 74, Issue 18, 2001, Pages 1737-1742

  Evans, Jamie ^a   Krishnamurthy, Vikram ^a  

^a UNIVERSITY OF MELBOURNE   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; COMPUTATIONAL COMPLEXITY; DYNAMIC PROGRAMMING; ERROR ANALYSIS; MARKOV PROCESSES; MATHEMATICAL MODELS; SENSORS; SIGNAL PROCESSING; STOCHASTIC CONTROL SYSTEMS; STOCHASTIC PROGRAMMING;

HIDDEN MARKOV MODEL; OPTIMAL SENSOR SCHEDULING;

OPTIMAL CONTROL SYSTEMS;

EID: 0035895113     PISSN: 00207179     EISSN: None     Source Type: Journal    
DOI: 10.1080/00207170110089752     Document Type: Article

References (18)

1. Aström, K.J., 1965, Optimal control of Markov processes with incomplete state information. Journal of Mathematical Analysis and Applications, 10, 174-205.
2. Athans, M., 1972, On the determination of optimal costly measurement strategies for linear stochastic systems. Automatica, 8, 397-412.
3. Baras, J.S., and Bensoussan, A., 1989, Optimal sensor scheduling in nonlinear filtering of diffusion processes. SIAM Journal of Control and Optimization, 27, 786-813.
4. Bertsekas, D.P., 1995, Dynamic Programming and Optimal Control (Volumes 1 and 2) (Belmont, MA: Athena Scientific).
5. Bertsekas, D.P., and Shreve, S.E., 1978, Stochastic Optimal Control: The Discrete-Time Case (New York: Academic Press).
6. Cassandra, A.R., 1998, Exact and approximate algorithms for partially observed Markov decision process. PhD thesis, Brown University.
7. Elliott, R.J., Aggoun, L., and Moore, J.B., 1995, Hidden Markov Models: Estimation and Control (New York: Springer-Verlag).
8. Hernández-Lerma, O., and Laserre, J.B., 1996, Discrete-Time Markov Control Processes: Basic Optimality Criteria (New York: Springer-Verlag).
9. Kumar, P.R., and Varaiya, P., 1986, Stochastic Systems: Estimation, Identification and Adaptive Control (Englewood Cliffs, NJ: Prentice-Hall).
10. Lovejoy, W.S., 1991, A survey of algorithmic methods for partially observed Markov decision processes. Annals of Operations Research, 28, 47-66.
11. Meier, L., Peschon, J., and Dressler, R.M., 1967, Optimal control of measurement subsystems. IEEE Transactions on Automatic Control, 12, 528-536.
12. Monahan, G.E., 1982, A survey of partially observable Markov decisioin processes: Theory, models, and algorithms. Management Science, 28, 1-16.
13. Rabiner, L.R., 1989, A tutorial on hidden Markov models and selected applications in speech recognition. Proceedings of the IEEE, 77, 257-285.
14. Segall, A., 1977, Optimal control of noisy finite-state Markov processes. IEEE Transactions on Automatic Control, 22, 179-186.
15. Sinno, D., and Cochran, D., 1998, Dynamic estimation with selectable linear measurements. In Proceedings of the international Conference on Accoustics, Speech, and Signal Processing, Seattle, WA, USA, May, pp. 2193-2196.
16. Smallwood, R.D., and Sondik, E.J., 1973, The optimal control of partially observable Markov processes over a finite horizon. Operations Research, 21, 1071-1088.
17. Sondik, E.J., 1978, The optimal control of partially observable Markov processes over an infinite horizon: Discounted costs. Operations Research, 26, 282-304.
18. Striebel, C., 1965, Sufficient statistics in the optimum control of stochastic systems. Journal of Mathematical analysis and Applications, 12, 576-592.