Stochastic dynamic programming based approaches to sensor resource management

Proceedings of the 5th International Conference on Information Fusion, FUSION 2002

Volumn 1, Issue , 2002, Pages 608-615

  Washburn, R B ^a   Schneider, M K ^a   Fox, J J ^a  

^a BAE SYSTEMS   (United Kingdom)

Author keywords

dynamic programming; Gittins index; multi armed bandit; Sensor resource management

Indexed keywords

DYNAMIC PROGRAMMING; INFORMATION FUSION; NATURAL RESOURCES MANAGEMENT; SCHEDULING; SENSORS; STOCHASTIC SYSTEMS;

APPROXIMATE DYNAMIC PROGRAMMING; ELECTRONICALLY-SCANNED; GITTINS INDEX; INFORMATION DYNAMICS; MULTI ARMED BANDIT; SENSOR RESOURCE MANAGEMENT; STOCHASTIC DYNAMIC PROGRAMMING; STOCHASTIC SCHEDULING;

RESOURCE ALLOCATION;

EID: 84901445493     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICIF.2002.1021210     Document Type: Conference Paper

References (9)

1. D.P. Bertsekas, Dynamic Programming and Optimal Control, Athena Scientific, Belmont, Massachusetts, 2001.
2. J.C. Gittins, "Bandit processes and dynamic allocation indices," Journal of the Royal Statistical Society, B 41, 148-164, 1979.
3. M.N. Katehakis and A.R Veinott, Jr., "The multiarmed bandit problem: decomposition and computation," Mathematics of Operations Research, Vol. 12, No. 2, pp. 262-268, 1987.
4. Vikram Krishnamurthy and Robin J. Evans, "Hidden Markov Model Multiarm Bandits: A Methodology for Beam Scheduling in Multitarget Tracking," IEEE Trans, on Signal Processing, Vol. 49, 2893-2907, December, 2001.
5. J. Nino-Mora, "Restless bandits, partial conservation laws and indexability," Dept. of Economics and Business, Universität Pompeu Fabra, Barcelona, Spain, December 13, 1999.
6. J.N. Tsitsiklis, "A Lemma on the Multiarmed Bandit Problem," IEEE Transactions on Automatic Control, AC-31, 576-577, 1986.
7. P.P. Varaiya, J.C. Walrand, and C. Buyukkov, "Extensions of the Multiarmed Bandit Problem: The Discounted Case," IEEE Transactions on Automatic Control, AC-30, 426-439, 1985.
8. R. Washburn, A. Chao, D. Castanon, and R. Malho-tra, "Stochastic Dynamic Programming for Far-Sighted Sensor Management," Proc. of the IRIS National Symposium on Sensor and Data Fusion, Vol. 2, 277-295, 1997.
9. P. Whittle, "Restless Bandits: Activity Allocation in a Changing World," in J. Gani (editor), A Celebration of Applied Probability, Journal of Applied Probability, 25A, 287-298, 1988.