Information space receding horizon control

IEEE SSCI 2011: Symposium Series on Computational Intelligence - ADPRL 2011: 2011 IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning

Volumn , Issue , 2011, Pages 302-309

  Chakravorty, Suman ^a   Erwin, R Scott ^b  

^a TEXAS A AND M UNIVERSITY   (United States)

^b AIR FORCE RESEARCH LABORATORY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

INFINITE HORIZONS; INFORMATION SPACES; OPTIMAL SENSOR; PARTIALLY OBSERVED MARKOV DECISION PROCESS; RECEDING HORIZON; RECEDING HORIZON CONTROL; SENSOR SCHEDULING; SIMULATION-BASED; STOCHASTIC OPTIMIZATION TECHNIQUES;

ARTIFICIAL INTELLIGENCE; DYNAMICAL SYSTEMS; MARKOV PROCESSES; OPTIMIZATION; REINFORCEMENT LEARNING; SCHEDULING; SENSORS;

DYNAMIC PROGRAMMING;

EID: 80052235176     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ADPRL.2011.5967362     Document Type: Conference Paper

References (26)

1. F. Bourgault et al., "Information based adaptive robot exploration," in Proc. of 2002 IEEE/ RSJ Int. conf. on Intell. rob. sys., 2002.
2. A. Makarenko et al., "A decentralized architecture for active sensor networks," in Proceedings of the 2004 IEEE INT. Conf. Rob. Automat., 2004.
3. T. H. Chung et al., "On a decentralized active sensing strategy using mobile sensor platforms in a network," in Proc. IEEE Int. Conf on Dec. Cont., 2004.
4. S. Aranda et al., "On optimal sensor placement and motion coordination for target tracking," in Proc. IEEE Int. conf. Dec. Cont., 2005.
5. H.-L. Choi, Adaptive Sampling and Forecasting with Mobile Sensor Networks, PhD thesis. Cambridge, MA: Department of Aeronautics and Astronautics, MIT, 2008.
6. A. Y. Khapalov, "Optimal measurement trajectories for distributed parameter systems," Systems and Control Letters, vol. 18, pp. 467-477, 1992.
7. D. P. Bertsekas, Dynamic Programming and Optimal Control, vols I and II. Cambridge: Athena Scientific, 2000.
8. P. R. Kumar and P. P. Varaiya, Stochastic Systems: Estimation, Identification and Adaptive Control. Prentic Hall, NJ: Prentice Hall, 1986.
9. L. P. Kaelbling and M. L. Littman, "Planning and acting in partially observable stochastic domains," Artificial Intelligence, vol. 101, pp. 99- 134, 1998. (Pubitemid 128387390)
10. M. Spaan and N. Vlassis, "Perseus: Randomized point-based value iteration for pomdps," Journal of Artificial Intelligence Research, vol. 24, pp. 195-220, 2005. (Pubitemid 43130936)
11. J. Pineau et al., "Anytime point based approximations for large pomdps," Journal of Artificial Intelligence Research, vol. 27, pp. 335-380, 2006.
12. S. Ross et al., "Online planning algorithms for pomdps," Journal of Artificial Intelligence Research, vol. 32, pp. 663-704, 2008.
13. P. Marbach, Simulation based Optimization of Markov Reward Processes, PhD Thesis. Boston, MA: Massachusetts Institute of Technology, 1999.
14. J. Baxter and P. Bartlett, "Infinite horizon policy-gradient estimation," Journal of Artificial Intelligence Research, vol. 15, pp. 319-350, 2001.
15. R. S. Sutton et al., "Policy gradient methods for reinforcement learning with function approximation," in Proc. 1999 Neural Information Proc. Sys., 1999.
16. C. E. Garcia et al., "Model predictive control: Theory and practice," Automatica, vol. 25, pp. 335-348, 1989.
17. S. J. Qin and T. A. Badgwell, "An overview of industrial model predictive control technology," in Fifth International Conference in Chemical Process Control, 1997.
18. D. Q. Mayne et al., "Constrained model predictive control: Stability and optimality," Automatica, vol. 36, pp. 789-814, 2000. (Pubitemid 30587683)
19. A. A. Feldbaum, Optimal Control Systems. New York, NY: Academic Press, 1965.
20. E. Tse and M. Athans, "Adaptive stochastic control for a class of linear systems," IEEE Transactions on Automatic Control, vol. 17, pp. 38-52, 1972.
21. E. Tse et al., "Wide sense adaptive dual control for nonlinear stochastic systems," IEEE Transactions on Automatic Control, vol. 18, pp. 98-108, 1973.
22. B. D. O. Anderson and J. B. Moore, Optimal Filtering. London, UK: Dover Publications, 2001.
23. A. O. Hero III, D. A. Castan, D. Cochran, and K. Kastella, Eds., Foundations and Applications of Sensor Management. Springer US, 1989.
24. I. M. Ross and F. Fahroo, "Pseudospectral knotting methods for solving optimal control methods," J. Guidance, Control and Dynamics, vol. 27, pp. 397-404, 2004.
25. D. J. C. Mckay, "Information-based objective functions for active data selections," Neural Computation, vol. 4, pp. 590-604, 1992.
26. E. Rafajlowicz, "Optimum choice of moving sensor trajectories for distributed parameter system identification," International Journal of Control, vol. 43, pp. 1441-1451, 1986. (Pubitemid 16532030)