Collaborative distributed sensor management for multitarget tracking using hierarchical Markov decision processes

Proceedings of SPIE - The International Society for Optical Engineering

Volumn 6699, Issue , 2007, Pages

  Akselrod, D ^a   Sinha, A ^a   Kirubarajan, T ^a  

^a MCMASTER UNIVERSITY   (Canada)

Author keywords

Markov decision processes; Multitarget tracking; Sensor fusion; Sensor resource management; UAV control

Indexed keywords

COMPUTER SIMULATION; DECISION MAKING; MARKOV PROCESSES; MATHEMATICAL MODELS; OPTIMIZATION; PROBABILITY; TARGET TRACKING; UNMANNED AERIAL VEHICLES (UAV);

MARKOV DECISION PROCESSES; MULTITARGET TRACKING; SENSOR RESOURCE MANAGEMENT;

SENSOR NETWORKS;

EID: 42149156696     PISSN: 0277786X     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1117/12.735173     Document Type: Conference Paper

References (23)

1. R. W. Beard, T. W. McLain, M. A. Goodrich, and E. P. Anderson, "Coordinated Target Assignment and Intercept for Unmanned Air Vehicles", IEEE Trans on Robotics and Automation, Vol. 18, No. 6, pp. 911-922, Dec. 2002.
2. T. W. McLain, P. R. Chandler, and M. Pachter, "A Decomposition Strategy for Optimal Coordination of Unmanned Air Vehicles", Proc. of American Control Conference, pp. 369-373, Chicago, IL, June 2000.
3. M. Flint, M. Polycarpou, and E. Fernandez-Gaucherand, "Cooperative Control for Multiple Autonomous UAVs Searching for Targets", Proc. of IEEE Conference on Decision and Control, pp. 2823-2828, Las Vegas, Nevada, Dec. 2002.
4. H. Durrant-Whyte and B. Grocholsky, "Management and Control in Decentralised Networks", Proc. of International Conference on Information Fusion, pp. 560-565, Cairns, Queensland, Australia, July 2003.
5. P. Ogren, E. Fiorelli, and N. E. Leonard, "Cooperative Control of Mobile Sensor Networks: Adaptive Gradient Climbing in a Distributed Environmen", IEEE Trans. on Automatic Control, Vol. 49, No. 8, pp. 1292-1302, Aug. 2004.
6. T. Furukawa, F. Bourgault, H. F. Durrant-Whyte, and G. Dissanayake, "Dynamic Allocation and Control of Coordinated UAVs to Engage Multiple Targets in a Time-Optimal Manner", Proc. of IEEE Intl. Conf. on Robotics & Automation, pp. 2353-2358, New Orleans, LA USA, April 2004.
7. A. Sinha, T. Kirubarajan and Y. Bar-Shalom, "Optimal cooperative placement of UAVs for Ground Target Tracking with Doppler Radar", Proc. of SPIE Signal Processing, Sensor Fusion, and Target Recognition, Orlando, FL USA, April 2004.
8. A. Sinha, T. Kirubarajan and Y. Bar-Shalom, "Autonomous ground target tracking by multiple cooperative UAVs, Proc. of IEEE Aerospace Conf., Big Sky, MT USA, March 2005.
9. D. Akselrod, C. V. Goldman, A. Sinha, and T. Kirubarajan, "Collaborative Sensor Management for Multitarget Tracking Using Decentralized Markov Decision Processes", Proc. of SPIE Defense and Security Symposium, Orlando, FL USA, April 2006.
10. Y. Bar-Shalom, and X. Li, Multitarget-Multisensor Tracking: Principles and Techniques, Storrs, CT: YBS Publishing, 1995.
11. L. P. Kaelbling, M. L. Littman and A. W. Moore, "Reinforcement learning: A survey", Journal of Artifcial Intelligence Research, 4:237-285, 1996.
12. R. Bellman, Dynamic Programming, Princeton University Press, Princeton, NJ, 1957.
13. D. P. Bertsekas, Dynamic Programming: Deterministic and Stochastic Models. Prentice-Hall, Englewood Cliffs, NJ, 1987.
14. D. P. Bertsekas, Dynamic Programming and Optimal Control, Athena Scientific, vol. 1, 2, 1995.
15. R. J. Williams and L. C. Baird III, "Tight performance bounds on greedy policies based on imperfect value functions", Tech. Rep. NU-CCS-93-14, Northeastern University, College of Computer Science, Boston, MA, 1993.
16. C. H. Papadimitriou and J. N. Tsitsiklis, "The complexity of Markov chain decision processes", Mathematics of Operations Research, 12(3), 1987.
17. M. L. Littman, T. L. Dean and L. P. Kaelbling, "On the complexity of solving Markov decision problems", Proc. UAI, Montreal, QC, Canada, August 1995.
18. D. Bernstein, R. Givan, N. Immerman, and S. Zilberstein, "The complexity of decentralized control of Markov decision processes", Mathematics of Operations Research, 27 (4), 819-840, 2002.
19. Z. Rabinovich, C. V. Goldman, and J. S. Rosenschein, "The complexity of multiagent systems: The price of silence", Proc. of the Second International Joint Conference on Autonomous Agents and Multi-Agent Systems, pp. 1102-1103, Melbourne, Australia, 2003.
20. C. V. Goldman and S. Zilberstein, "Decentralized control of cooperative systems: Categorization and complexity analysis", Journal of Artificial Intelligence Research, vol. 22 pp. 143174, 2004.
21. C. V. Goldman, S. Zilberstein, "Goal-Oriented Dec-MDPs with Direct Communication", University of Massachusetts Computer Science Technical Report #04-44: 2004.
22. S. W. Yeom, T. Kirubarajan, and Y. Bar-Shalom, Y., "Track Segment Association, Fine-step IMM and Initialization with Doppler for Improved Track Performance", IEEE Trans, on Aerospace and Electronic Systems, Vol. 40, No. 1, pp. 293-309, Jan. 2004.
23. D. P. Bertsekas, Linear Network Optimization: Algorithms and Codes, MIT Press, Cambridge, MA 1991.