Adaptive sensing for search with continuous actions and observations

Proceedings of the IEEE Conference on Decision and Control

Volumn , Issue , 2010, Pages 7443-7448

  Hitchings, Darin ^a   Castañón, David A ^a  

^a Boston University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

STOCHASTIC CONTROL SYSTEMS; STOCHASTIC SYSTEMS;

ADAPTIVE SENSING; CONTINUOUS ACTIONS; DECISION SPACE; ENERGY ALLOCATIONS; LAGRANGIAN RELAXATION; NUMERICAL EXPERIMENTS; ORDERS OF MAGNITUDE; STOCHASTIC CONTROL;

DYNAMIC PROGRAMMING;

EID: 79953129560     PISSN: 07431546     EISSN: 25762370     Source Type: Conference Proceeding    
DOI: 10.1109/CDC.2010.5717913     Document Type: Conference Paper

References (20)

1. B. Koopman, Search and Screening: General Principles with Historical Applications. Pergamon, New York NY, 1980.
2. S. J. Benkoski, M. G. Monticino, and J. R. Weisinger, "A survey of the search theory literature," Naval Research Logistics, vol. 38, no. 4, pp. 469-494, 1991.
3. D. A. Castañón, "Optimal search strategies in dynamic hypothesis testing," IEEE Transactions on Systems, Man and Cybernetics, vol. 25, no. 7, pp. 1130-1138, Jul 1995.
4. J. C. Gittins, "Bandit processes and dynamic allocation indices," Journal of the Royal Statistical Society. Series B, vol. 41, no. 2, pp. 148-177, 1979.
5. W. W. Schmaedeke and K. D. Kastella, "Event-averaged maximum likelihood estimation and information-based sensor management," in Proceedings of Signal Processing, Sensor Fusion, and Target Recognition III, I. Kadar and V. Libby, Eds., vol. 2232. SPIE, 1994, pp. 91-96.
6. K. Kastella, "Discrimination gain for sensor management in multitarget detection and tracking," in Proc. of the IEEE-Systems, Man, and Cybernetics (SMC) and International Association for Mathematics and Computers in Simulation (IMACS) Multiconference, vol. 1, Jul. 1996, pp. 167-172.
7. W. W. Schmaedeke and K. D. Kastella, "Information-based sensor management and IMMKF," in Proceedings of Signal and Data Processing of Small Targets, O. E. Drummond, Ed., vol. 3373. SPIE, 1998, pp. 390-401.
8. C. Kreucher, K. Kastella, and I. Alfred O. Hero, "Sensor management using an active sensing approach," Signal Processing, vol. 85, no. 3, pp. 607-624, 2005.
9. D. A. Castañón and L. Carin, "Stochastic control theory for sensor management," in Foundations and Applications of Sensor Management, A. Hero, D. Castañón, D. Cochran, and K. Kastella, Eds. New York, NY: Springer Verlag, 2008.
10. D. P. Bertsekas, Dynamic Programming and Optimal Control, 3rd ed. Athena Scientific, 2007, vol. 1-2.
11. D. A. Castañón, "Approximate dynamic programming for sensor management," in Proceedings of the 36th IEEE Conference on Decision and Control, 1997, pp. 1202-1207.
12. J. Wintenby and V. Krishnamurthy, "Hierarchical resource management in adaptive airborne surveillance radars," IEEE Transactions on Aerospace and Electronic Systems, vol. 42, no. 2, pp. 401-420, Apr. 2006.
13. E. Chong, C. Kreucher, and A. Hero, "Monte-carlo-based partially observable Markov decision process approximations for adaptive sensing," International Workshop on Discrete Event Systems, pp. 173-180, May 2008.
14. D. A. Castañón, "Stochastic control bounds on sensor network performance," in Proceedings of the 44th IEEE Conference on Decision and Control, Dec. 2005, pp. 4939-4944.
15. D. C. Hitchings and D. A. Castañón, "Receding horizon stochastic control algorithms for sensor management," in Proceedings of the American Control Conference, Baltimore, MD, June 2010.
16. E. Bashan, R. Raich, and A. Hero, "Adaptive sampling: Efficient search schemes under resource constraints," 2007, www.eecs.umich.edu/ bashan/cspl-385.pdf.
17. R. Rangarajan, R. Raich, and A. Hero, "Optimal sequential energy allocation for inverse problems," IEEE Journal on Selected Topics in Signal Processing, vol. 1, no. 1, pp. 67-78, Jun. 2007.
18. E. Bashan, R. Raich, and A. Hero, "Optimal two-stage search for sparse targets using convex criteria," IEEE Transactions on Signal Processing, vol. 56, no. 11, pp. 5389-5402, Nov. 2008.
19. D. Castanon and J. Wohletz, "Model predictive control for stochastic resource allocation," IEEE Transactions on Automatic Control, vol. 54, no. 8, pp. 1739-1750, Aug. 2009.
20. J. Pineau, G. Gordon, and S. Thrun, "Point-based value iteration: An anytime algorithm for POMDPs," in Proceedings of the International Joint Conference on Artificial Intelligence, Aug. 2003, pp. 1025-1032.