Optimal sensor querying: General Markovian and LQG models with controlled observations

IEEE Transactions on Automatic Control

Volumn 53, Issue 6, 2008, Pages 1392-1405

  Wu, Wei ^a   Arapostathis, Ari ^a  

^a The University of Texas at Austin   (United States)

Author keywords

Dynamic programming; Kalman filter; Linear quadratic Gaussian (LQG) control; Networked control systems (NCS); Partially observable Markov decision processes (POMDP)

Indexed keywords

COMPUTER NETWORKS; CONTROL SYSTEM ANALYSIS; CONTROL THEORY; DISCRETE TIME CONTROL SYSTEMS; SENSOR NETWORKS; SENSORS; STOCHASTIC CONTROL SYSTEMS; STOCHASTIC MODELS; STOCHASTIC PROGRAMMING;

DYNAMIC PROGRAMMING; KALMAN FILTER; LINEAR QUADRATIC GAUSSIAN (LQG) CONTROL; NETWORKED CONTROL SYSTEMS (NCS); PARTIALLY OBSERVABLE MARKOV DECISION PROCESSES (POMDP);

CONTROL SYSTEMS;

EID: 51449086913     PISSN: 00189286     EISSN: None     Source Type: Journal    
DOI: 10.1109/TAC.2008.925817     Document Type: Article

References (35)

1. W. Wong and R. Brockett, "Systems with finite communication band-width constraints I: State estimation problems," IEEE Trans. Automat. Control, vol. 42, no. 9, pp. 1294-1299, Sep. 1997.
2. W. Wong and R. Brockett, "Systems with finite communication band-width constraints II: Stabilization with limited information feedback," IEEE Trans. Automat. Control, vol. 44, no. 5, pp. 1049-1053, May 1999.
3. S. Tatikonda and S. Mitter, "Control under communication constraints," IEEE Trans. Automat. Control, vol. 49, no. 7, pp. 1056-1068, Jul. 2004.
4. S. Tatikonda and S. Mitter, "Control under noisy channels," IEEE Trans. Automat. Control, vol. 49, no. 7, pp. 1196-1201, Jul. 2004.
5. N. Elia and S. Mitter, "Stabilization of linear systems with limited information," IEEE Trans. Automat. Control, vol. 46, no. 9, pp. 1384-1400, Sep. 2001.
6. G. Nair and R. Evans, "Stabilization with data-rate-limited feedback: Tightest attainable bounds," Syst. Control Lett., vol. 41, pp. 49-76, 2000.
7. D. Liberzon, "On stabilization of linear systems with limited information," IEEE Trans. Automat. Control, vol. 48, no. 2, pp. 304-307, Feb. 2003.
8. G. Nair, R. J. Evans, I. M. Y. Mareels, and W. Moran, "Topological feedback entropy and nonlinear stabilization," IEEE Trans. Automat. Control, vol. 49, no. 9, pp. 1585-1597, Sep. 2004.
9. D. Liberzon and J. P. Hespanha, "Stabilization of nonlinear systems with limited information feedback," IEEE Trans. Automat. Control, vol. 50, no. 6, pp. 910-915, Jun. 2005.
10. L. Meier, J. Peschon, and R. M. Dressler, "Optimal control of measurement subsystems," IEEE Trans. Automat. Control, vol. AC-12, no. 5, pp. 528-536, Oct. 1967.
11. M. Athans, "On the determination of of optimal costly measurement strategies for linear stochastic systems," Automatica., vol. 8, pp. 397-412, 1972.
12. K. Herring and J. Melsa, "Optimum measurements for estimation," IEEE Trans. Automat. Control, vol. AC-19, no. 3, pp. 264-266, Jun. 1974.
13. R. Mehra, "Optimization of measurement schedules and sensor designs for linear dynamic systems," IEEE Trans. Automat. Control, vol. AC-21, no. 1, pp. 55-64, Feb. 1976.
14. E. Mori and J. J. DiStefano, "Optimal nonuniform sampling interval and test-input for identification of physiological system from very limited data," IEEE Trans. Automat. Control, vol. AC-24, no. 6, pp. 893-900, Dec. 1979.
15. D. Avitzour and S. R. Rogers, "Optimal measurement scheduling for prediction and estimation," IEEE Trans. Acoust., Speech, Signal Process., vol. 38, no. 10, pp. 1733-1739, Oct. 1990.
16. M. Shakeri, K. R. Pattipati, and D. L. Kleinman, "Optimal measurement scheduling for state estimation," IEEE Trans. Aerosp. Electron. Syst., vol. 31, no. 2, pp. 716-729, Apr. 1995.
17. B. M. Miller and W. J. Runggaldier, "Optimization of observations: A stochastic control approach," SIAM J. Control Optim., vol. 35, no. 5, pp. 1030-1052, 1997.
18. A. V. Savkin, R. Evans, and E. Skafidas, "The problem of optimal robust sensor scheduling," Syst. Control Lett., vol. 43, pp. 149-157, 2001.
19. V. Krishnamurthy and R. J. Evans, "Hidden Markov model multiarmed bandits: A methodology for beam scheduling in multitarget tracking," IEEE Trans. Signal Processing, vol. 49, no. 12, pp. 2893-2908, Dec. 2001.
20. V. Gupta, T. Chung, B. Hassibi, and R. M. Murray, "On a stochastic sensor selection algorithm with applications in sensor scheduling and dynamic sensor coverage," Automatica., vol. 42, no. 2, pp. 251-260, 2006.
21. E. B. Dynkin and A. A. Yushkevich, Controlled Markov Processes. New York: Springer-Verlag, 1979, vol. 235.
22. A. Arapostathis, V. S. Borkar, E. Fernández-Gaucherand, M. K. Ghosh, and S. I. Marcus, "Discrete-time controlled Markov processes with average cost criterion: A survey," SIAM J. Control Optim., vol. 31, no. 3, pp. 282-344, 1993.
23. R. J. Elliott, L. Aggoun, and J. B. Moore, Hidden Markov Models, Estimation and Control. New York: Springer-Verlag, 1995, vol. 29.
24. S.-P. Hsu, D. M. Chuang, and A. Arapostathis, "On the existence of stationary optimal policies for partially observed MDPs under the long-run average cost criterion," Syst. Control Lett., vol. 55, pp. 165-173, 2006.
25. D. Bertsekas, Dynamic Programming: Deterministic and Stochastic Models. Englewood Cliffs, NJ: Prentice Hall, 1987.
26. D. Liberzon and A. S. Morse, "Basic problems in stability and design of switched systems," IEEE Contr. Syst. Mag., vol. 19, pp. 59-70, Oct. 1999.
27. Z. Sun and D. Zheng, "On reachability and stabilization of switched linear systems," IEEE Trans. Automat. Control, vol. 46, no. 2, pp. 291-295, Feb. 2001.
28. S. S. Ge, Z. Sun, and T. H. Lee, "Reachability and controllability of switched linear discrete-time systems," IEEE Trans. Automat. Control vol. 46, no. 9, pp. 1437-1441, Sep. 2001.
29. Z. Sun and S. S. Ge, "Analysis and synthesis of switched linear control systems," Automatica, vol. 41, no. 2, pp. 181-195, 2005.
30. G. Xie and L. Wang, "Controllability and stabilizability of switched linear-systems," Syst. Control Lett., vol. 48, no. 2, pp. 135-155, 2003.
31. G. Xie and L. Wang, "Reachability realization and stabilizability of switched linear discrete-time systems," J. Math. Anal. Appl., vol. 280, no. 2, pp. 209-220, 2003.
32. G. Xie and L.Wang, "Stabilization of a class switched linear systems," in Proc. IEEE Int. Conf. Syst., Man Cybern., Oct. 2003, vol. 2, pp. 1898-1903.
33. L. Zhang and D. Hristu-Varsakelis, "LQG control under limited communication," in Proc. 44th IEEE Conf. Decision Control Eur. Control Conf., Dec. 2005, pp. 185-190.
34. B. Sinopoli, L. Schenato, M. Franceschetti, K. Poolla, M. I. Jordan, and S. S. Sastry, "Kalman filtering with intermittent observations," IEEE Trans. Automat. Control, vol. 49, no. 9, pp. 1453-1464, Sep. 2004.
35. R. T. Rockafellar, Convex Analysis. Princeton, NJ: Princeton Univ. Press, 1946, vol. 28.