A decision policy for the routing and munitions management of multiformations of unmanned combat vehicles in adversarial urban environments

IEEE Transactions on Control Systems Technology

Volumn 17, Issue 3, 2009, Pages 505-519

  Lechévin, Nicolas ^a   Rabbath, Camille Alain ^b   Lauzon, Marc ^b  

^a Numerica Technologies Inc   (Canada)

^b DEFENCE RESEARCH AND DEVELOPMENT CANADA VALCARTIER   (Canada)

Author keywords

Autonomous vehicle; Dynamic programming; Markov decision process; Path planning

Indexed keywords

AUTONOMOUS VEHICLE; BAYESIAN FILTERS; COMBAT VEHICLES; COMPUTATIONAL CAPABILITY; CONTROL AND MANAGEMENT; DECISION POLICY; DYNAMIC PROGRAMMING EQUATIONS; IMPERFECT INFORMATION; INCOMPLETE INFORMATION; LOOK UP TABLE; LOOK-AHEAD; MARKOV DECISION PROCESS; ONLINE IMPLEMENTATION; OPTIMAL ROUTING; OPTIMIZATION PROBLEMS; PATH PLANNING; SIMULATION RESULT; STOCHASTIC DYNAMICS; TACTICAL TARGETS; TIME OPTIMIZATION; TIME WINDOWS; URBAN ENVIRONMENTS; VALUE FUNCTIONS;

AMMUNITION; CONSTRAINED OPTIMIZATION; DECISION TABLES; DYNAMIC PROGRAMMING; DYNAMICS; LEARNING ALGORITHMS; LOCATION; MARKOV PROCESSES; MILITARY VEHICLES; OPTIMIZATION; REMOTELY OPERATED VEHICLES; SYSTEMS ENGINEERING; TABLE LOOKUP;

DECISION MAKING;

EID: 67349226109     PISSN: 10636536     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCST.2008.2000980     Document Type: Article

References (30)

1. J. B. Cruz, Jr., M. A. Simaan, A. Gacic, H. Jiang, B. Letellier, M. Li, and Y. Liu, "Game-theoretic modeling and control of a military air operation," IEEE Trans. Aerosp. Electron. Syst., vol. 37, no. 4, pp. 1393-1403, Jul. 2001.
2. J. B. Cruz, Jr., M. A. Simaan, A. Gacic, and Y. Liu, "Moving horizon nash strategies for a military air operation," IEEE Trans. Aerosp. Electron. Syst., vol. 38, no. 3, pp. 989-997, May 2002.
3. D. Ghose, M. Krichman, J. L. Speyer, and J. Shamma, "Modeling and analysis of air campaign resource allocation: A spatio-temporal decomposition approach," IEEE Trans. Syst., Man, Cybern. - Part A: Syst. Humans, vol. 32, no. 3, pp. 403-418, May 2002.
4. P. Krokhmal, R. Murphey, P. Pardalos, and S. Uryasev, "Use of conditional value-at-risk in stochastic programs with poorly defined distribustions," in Recent Developments in Cooperative Control and Optimization, S. Butenko, R. Murphey, and P. Pardalos, Eds. Boston, MA: Kluwer, 2004, pp. 225-241.
5. G. Arslan, J. R. Marden, and J. S. Shamma, "Autonomous vehicle-target assignment: A game theoretical formulation," presented at the IEEE Conf. Dec. Control, San Diego, CA, Dec. 2006.
6. T. Basar and P. Bernhard, H∞-Optimal Control and Related Minimax Design Problems. Boston, MA: Systems and Control: Foundations and Application, Bikhäuser, 1995.
7. W. M. McEneaney, B. G. Fitzpatrick, and I. G. Lauko, "Stochastic game approach to air operations," IEEE Trans. Aerosp. Electron. Syst., vol. 40, no. 4, pp. 1191-1216, Oct. 2004.
8. W. M. McEneaney and R. Singh, "Unmanned vehicle operations under imperfect information in an adversarial environment," presented at the AIAA-2004-6411, AIAA 3rd "Unmanned Unlimited" Techn. Conf., Workshop Exhibit, Chicago, Illinois, Sep. 2004.
9. W. McEneaney and R. Singh, "Deception in autonomous vehicle decision making in an adversarial environment," presented at the AIAA-2005-6152, AIAA Guid., Nav., Control Conf. Exhibit, San Francisco, CA, Aug. 2005.
10. E. A. Feinberg and A. Schwartz, Handbook of Markov Decision Process - Methods and Applications. Boston, MA: Kluwer, 2002.
11. D. Bertsekas, Dynamic Programming and Optimal Control - Volume I, 3rd ed. Belmont, MA: Athena Scientific, 2005.
12. R. W. Beard, T. W. McLain, M. A. Goodrich, and E. P. Anderson, "Coordinated target assignment and intercept for unmanned air vehicles," IEEE Trans. Robot. Automat., vol. 9, no. 6, pp. 777-790, Jun. 2001.
13. A. Nilim and L. El Ghaoui, "Robust control of markov decision processes with uncertain transition matrices," Operations Res., vol. 53, no. 5, pp. 780-798, 2005.
14. T. Basar and G. J. Olsder, Dynamic Noncooperative Game Theory, 2nd ed. Philadelphia, PA: Society for Industrial and Applied Mathematics, 1999.
15. D. G. Galati and M. A. Simaan, "Effectiveness of the nash strategies in competitive multi-team target assignment problems," presented at the IEEE Conf. Dec. Control, Paradise Island, Bahamas, Dec. 2003.
16. R. Mahler, "Objective functions for bayesian control-theoretic sensor management, II: MHC-like approximation," in Recent Developments in Cooperative Control and Optimization, S. Butenko, R. Murphey, and P. Pardalos, Eds. Norwell, MA: Kluwer, 2004, pp. 273-316.
17. D. Bertsekas and J. Tsitsiklis, Neuro-Dynamics Programming. Belmont, MA: Athena Scientific, 1996.
18. R. Olfati-Saber, J. A. Fax, and R. Murray, "Consensus and cooperation in networked multi-agent systems," Proc. IEEE, vol. 95, no. 1, pp. 215-233, Jan. 2007.
19. W. H. Fleming and W. M. McEneaney, "Robust limits of risk sensitive nonlinear filters," Math. Control, Signals Syst., vol. 14, pp. 109-142, 2001.
20. M. Alighanbari and J. P. How, "Cooperative task assignment of unmanned aerial vehicles in adversarial environments," presented at the Amer. Control Conf., Portland, OR, Jun. 2005.
21. A. Richards and J. P. How, "Aircraft trajectory planning with collision avoidance using mixed integer linear programming," presented at the Amer. Control Conf., Anchorage, Alaska, May 2002.
22. A. Dogan, "Probabilistic path planning for UAVs," presented at the AIAA-2003-6552, 2nd AIAA Unmanned Unlimited Syst., Technol., Operations, San Diego, CA, May 2003.
23. G. C. Chasparis and J. S. Shamma, "Linear-programming-based multivehicle path planning with adversaries," presented at the Amer. Control Conf., Portland, OR, Jun. 2005.
24. M. Flint, E. Fernandez-Gaucherand, and M. Polycarpou, "Stochastic modeling of a cooperative autonomous UAV search problem," Military Oper. Res. J., vol. 8, no. 4, pp. 13-32, 2003.
25. D. J. Bertsimas and G. J. Van Ryzin, "Stochastic and dynamic vehicle routing in the euclidean plane with multiple capacited vehicles," Oper. Res., vol. 41, no. 1, pp. 60-76, 1993.
26. E. Frazzoli and F. Bullo, "Decentralized algorithms for vehicle routing in a stochastic time-varying environment," presented at the IEEE Conf. Dec. Control, Atlantis, Paradise Island, Bahamas, Dec. 2003.
27. R. Olfati-Saber, "Flocking for multi-agent dynamic system: Algorithms and theory," IEEE Trans. Autom. Control, vol. 51, no. 3, pp. 401-420, Mar. 2006.
28. J. Cortes, S. Martinez, and F. Bullo, "Robust rendezvous for mobile autonomous agents via proximity graphs in arbitrary dimensions," IEEE Trans. Autom. Control, vol. 51, no. 8, pp. 1289-1298, Aug. 2006.
29. R. Olfati-Saber, E. Franco, E. Frazzoli, and J. S. Shamma, "Belief consensus and distributed hypothesis testing in sensor networks," in Networked Embedded Sensing and Control, P. J. Antaklis and P. Tabuada, Eds. New York: Springer-Verlag, 2006, vol. 331, LNCIS, pp. 169-182.
30. The Vehicle Routing Problem, P. Toth and D. Vigo, Eds. Philadelphia, PA: SIAM, 2002.