Receding horizon stochastic control algorithms for sensor management

Proceedings of the 2010 American Control Conference, ACC 2010

Volumn , Issue , 2010, Pages 6809-6815

  Hitchings, Darin ^a   Castañón, David A ^a  

^a Boston University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

LINEAR PROGRAMMING; STOCHASTIC CONTROL SYSTEMS;

HETEROGENEOUS SENSORS; INFORMATION ACQUISITIONS; MARKOV DECISION PROBLEM; NEAR-OPTIMAL PERFORMANCE; OPTIMIZATION PROBLEMS; REAL-TIME APPLICATION; RECEDING HORIZON CONTROL; STOCHASTIC CONTROL;

STOCHASTIC SYSTEMS;

EID: 77957802651     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/acc.2010.5531634     Document Type: Conference Paper

References (26)

1. B. Koopman, Search and Screening: General Principles with Historical Applications. Pergamon, New York NY, 1980.
2. S. J. Benkoski, M. G. Monticino, and J. R. Weisinger, "A survey of the search theory literature," Naval Research Logistics, vol. 38, no. 4, pp. 469-494, 1991.
3. D. A. Castañón, "Optimal search strategies in dynamic hypothesis testing," Systems, Man and Cybernetics, IEEE Transactions on, vol. 25, no. 7, pp. 1130-1138, Jul 1995.
4. A. Wald, "On the efficient design of statistical investigations," The Annals of Mathematical Statistics, vol. 14, pp. 134-140, 1943.
5. -, "Sequential tests of statistical hypotheses," The Annals of Mathematical Statistics, vol. 16, no. 2, pp. 117-186, 1945. [Online]. Available: http://www.jstor.org/stable/2235829.
6. D. V. Lindley, "On a measure of the information provided by an experiment," Annals of Mathematical Statistics, vol. 27, pp. 986-1005, 1956.
7. J. C. Kiefer, "Optimum experimental designs," Journal of the Royal Statistical Society Series B, vol. 21, pp. 272-319, 1959.
8. H. Chernovv, Sequential Analysis and Optimal Design. SIAM, Philadelphia, PA, 1972.
9. V. V. Fedorov, Theory of Optimal Experiments. Academic Press, New York, 1972.
10. K. Kastella, "Discrimination gain to optimize detection and classification," Systems, Man and Cybernetics, Part A, IEEE Transactions on, vol. 27, no. 1, pp. 112-116, Jan. 1997.
11. C. Kreucher, K. Kastella, and I. Alfred O. Hero, "Sensor management using an active sensing approach," Signal Processing, vol. 85, no. 3, pp. 607-624, 2005.
12. M. Athans, "On the determination of optimal costly measurement strategies for linear stochastic systems," Automatica, vol. 8, no. 4, pp. 397-412, 1972. [Online]. Available: http://www.sciencedirect.com/science/ article/B6V21-47SV18C-5/2/dc50e03b2ec82f34c592d4056c0da466.
13. V. Krishnamurthy and R. Evans, "Hidden markov model multiarm bandits: a methodology for beam scheduling in multitarget tracking," Signal Processing, IEEE Transactions on, vol. 49, no. 12, pp. 2893-2908, Dec 2001.
14. R. Washburn, M. Schneider, and J. Fox, "Stochastic dynamic programming based approaches to sensor resource management," Information Fusion, 2002. Proceedings of the Fifth International Conference on, pp. 608-615 vol.1, 2002.
15. J. C. Gittins, "Bandit processes and dynamic allocation indices," Journal of the Royal Statistical Society. Series B (Methodological), vol. 41, no. 2, pp. 148-177, 1979. [Online]. Available: http://www.jstor.org/stable/2985029.
16. W. Macready and I. Wolpert, D.H., "Bandit problems and the exploration/exploitation tradeoff," Evolutionary Computation, IEEE Transactions on, vol. 2, no. 1, pp. 2-22, Apr. 1998.
17. C. Kreucher and A. O. H. III, "Monte carlo methods for sensor management in target tracking," in IEEE Nonlinear Statistical Signal Processing Workshop, 2006.
18. E. Chong, C. Kreucher, and A. Hero, "Monte-carlo-based partially observable markov decision process approximations for adaptive sensing," Discrete Event Systems, 2008. WODES 2008. 9th International Workshop on, pp. 173-180, May 2008.
19. D. A. Castañón, A. Hero, D. Cochran, and K. Kastella, Foundations and Applications of Sensor Management, 1st ed. Springer, 2008, ch. 1.
20. D. A. Castañón, "Approximate dynamic programming for sensor management," in Proc 36th Conference on Decision and Control. IEEE, 1997, pp. 1202-1207.
21. -, "Stochastic control bounds on sensor network performance," Decision and Control, 2005 and 2005 European Control Conference. CDC-ECC '05. 44th IEEE Conference on, pp. 4939-4944, Dec. 2005.
22. P. C. Gilmore and R. E. Gomory, "A linear programming approach to the cutting-stock problem," Operations Research, vol. 9, no. 6, pp. 849-859, 1961. [Online]. Available: http://www.jstor.org/stable/167051.
23. G. B. Dantzig and P. Wolfe, "The decomposition algorithm for linear programs," Econometrica, vol. 29, no. 4, pp. 767-778, 1961. [Online]. Available: http://www.jstor.org/stable/1911818.
24. K. A. Yost and A. R. Washburn, "The lp/pomdp marriage: Optimization with imperfect information," Naval Research Logistics, vol. 47, no. 8, pp. 607-619, 2000.
25. J. Pineau, G. Gordon, and S. Thrun, "Point-based value iteration: An anytime algorithm for pomdps," in International Joint Conference on Artificial Intelligence (IJCAI), Aug. 2003, pp. 1025-1032.
26. K. Kastella, "Discrimination gain for sensor management in multitarget detection and tracking," in IEEE-SMC and IMACS Multiconference CESA 1996, vol. 1, Jul. 1996, pp. 167-172.