Balancing search and target response in cooperative unmanned aerial vehicle (UAV) teams

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 36, Issue 3, 2006, Pages 571-587

  Jin, Yan ^a   Liao, Yan ^a   Minai, Ali A ^a   Polycarpou, Marios M ^a,b  

^a University of Cincinnati   (United States)

^b UNIVERSITY OF CYPRUS   (Cyprus)

Author keywords

Cooperative search; Path planning; Task allocation; Unmanned aerial vehicle

Indexed keywords

ALGORITHMS; COMPUTER SIMULATION; DYNAMICS; MATHEMATICAL MODELS; MONTE CARLO METHODS; MOTION PLANNING;

COOPERATIVE SEARCH; DYNAMIC MODEL; TARGET RESPONSE; TASK ALLOCATION; UNMANNED AERIAL VEHICLE;

UNMANNED VEHICLES;

AIRCRAFT; ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; COOPERATION; CYBERNETICS; DECISION SUPPORT SYSTEM; HUMAN; MAN MACHINE INTERACTION; METHODOLOGY;

AIRCRAFT; ALGORITHMS; ARTIFICIAL INTELLIGENCE; COOPERATIVE BEHAVIOR; CYBERNETICS; DECISION SUPPORT TECHNIQUES; HUMANS; MAN-MACHINE SYSTEMS; PATTERN RECOGNITION, AUTOMATED;

EID: 33744517415     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2005.861881     Document Type: Article

References (80)

1. Airborne Drones to Guide U.S. Forces in Afghanistan. [Online]. Available: http://www.namibian.com.na/2001/September/world/0116DC7B3A.html
2. A. Joulia and C. Le Tallec, "Multicriteria analysis tool for civil UAV configurations/applications matching," in Proc. AIAA 3rd "Unmanned Unlimited" Technical Conf., Workshop and Exhibit, Chicago, IL, Sep. 2004, pp. 90-100.
3. M. Okrent, "Civil UAV activity within the framework of European Commission research," in Proc. AIAA 3rd "Unmanned Unlimited" Technical Conf., Workshop and Exhibit, Chicago, IL, Sep. 2004, pp. 101-111.
4. S. Tsach, A. Peled, D. Penn, and D. Touitou, "The CAPECON program: Civil applications and economical effectivity of potential UAV configurations," in Proc. AIAA 3rd "Unmanned Unlimited" Technical Conf., Workshop and Exhibit, Chicago, IL, Sep. 2004, pp. 71-89.
5. R. Beard and T. McLain, "Multiple UAV cooperative search under collision avoidance and limited range communication constraints," in Proc. 42nd IEEE Conf. Decision and Control, Maui, HI, Dec. 2003, pp. 25-30.
6. R. Beard, T. McLain, and M. Goodrich, "Coordinated target assignment and intercept for unmanned air vehicles," in Proc. IEEE Int. Conf. Robotics and Automation, Washington DC, May 2002, pp. 2581-2586.
7. J. Bellingham, M. Tillerson, A. Richards, and J. How, "Multi-task allocation and path planning for cooperative UAVS," in Cooperative Control: Models, Applications and Algorithms, S. Butenko, R. Murphey, and P. Pardalos, Eds. Boston, MA: Kluwer, 2003, pp. 23-41.
8. P. Chandler and M. Pachter, "Research issues in autonomous control of tactical UAVS," in Proc. Amer. Control Conf., Philadelphia, PA, 1998, pp. 394-398.
9. P. Chandler, M. Pachter, and S. Rasmussen, "UAV cooperative control," in Proc. Aer. Control Conf., Arlington, VA, 2001, pp. 50-55.
10. J. Finke, K. Passino, S. Ganapathy, and A. Sparks, "Modelling and analysis of cooperative control systems for uninhabited autonomous vehicles," in Cooperative Control, S. Morse, N. Leonard, and V. Kumar, Eds. New York: Springer-Verlag, 2004.
11. D. Jacques, "Search, classification and attack decisions for cooperative wide area search munitions," in Cooperative Control: Models, Applications and Algorithms, S. Butenko, R. Murphey, and P. Pardalos, Eds. Boston, MA: Kluwer, 2003, pp. 75-93.
12. S.-M. Li, J. Boskovic, S. Seereeram, R. Prasanth, R. Anidn, R. Mehra, R. Beard, and T. W. McLain, "Autonomous hierarchical control of multiple unmanned combat air vehicles (UCAVs)," in Proc. Amer. Control Conf., Anchorage, AK, 2002, pp. 274-279.
13. T. McLain, R. Beard, and J. Kelsey, "Experimental demonstration of multiple robot cooperative target intercept," presented at the AIAA Guidance, Navigation, and Control Conf., Monterey, CA, 2002, Paper AIAA-2002-4678.
14. A. Moitra, R. Szczerba, V. Didomizio, L. Hoebel, R. Mattheyses, and B. Yamrom, "A novel approach for the coordination of multi-vehicle teams," in Proc. AIAA Guidance, Navigation, and Control Conf., Monterey, CA, 2001, pp. 608-618.
15. K. Passino, An Introduction to Research Challenges in Cooperative Control for Uninhabited Autonomous Vehicles (preprint).
16. C. Schumacher, P. Chandler, and S. Rasmussen, "Task allocation for wide area search munitions via network flow optimization." in Proc. AIAA Guidance, Navigation, and Control Conf., Monterey, CA, 2001, pp. 619-626.
17. P. Vincent and I. Rubin, "A framework and analysis for cooperative search using UAV swarms," in Proc. ACM Symp. Applied Computing, Nicosia, Cyprus, 2004, pp. 79-86.
18. J.-C. Latombe, Robot Motion Planning, ser. The Kluwer International Series in Engineering and Computer Science, vol. 124. Boston, MA: Kluwer, Aug. 1991.
19. C. Choo, J. Smith, and N. Nasrabadi, "An efficient terrain acquisition algorithm for a mobile robot," in Proc. IEEE Int. Conf. Robotics and Automation, Sacramento, CA, Apr. 1991, pp. 306-311.
20. V. Lumelsky, S. Mukhopadhyay, and K. Sun, "Dynamic path planning in sensor-based terrain acquisition," IEEE Trans. Robot. Autom., vol. 6, no. 4, pp. 462-472, Aug. 1990.
21. A. Sankaranarayanan and I. Masuda, "Sensor based terrain acquisition: A new, hierarchical algorithm and a basic theory," in Proc. IEEE/RSJ Int. Conf. Intelligent Robots and Systems, Raleigh, NC, Jul. 1992, pp. 1515-1523.
22. J. Svennebring and S. Koenig, "Building terrain-covering ant robots: A feasibility study," Auton. Robots, vol. 16, no. 3, pp. 313-332, May 2004.
23. S. Wong and B. MacDonald, "A topological coverage algorithm for mobile robots," in Proc. IEEE/RSJ Int. Conf. Intelligent Robots and Systems, Las Vegas, NV, Oct. 2003, pp. 1685-1690.
24. S. Yang and C. Luo, "A neural network approach to complete coverage path planning," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 34, no. 1, pp. 718-724, Feb. 2004.
25. J. Borenstein and Y. Koren, "Real-time obstacle avoidance for fast mobile robots," IEEE Trans. Syst., Man, Cybern., vol. 19, no. 5, pp. 1179-1187, Sep./Oct. 1989.
26. M. Gill and A. Zomaya, Obstacle Avoidance in Multi-Robot Systems: Experiments in Parallel Genetic Algorithms, ser. Robotics and Intelligent Systems., vol. 20. Singapore: World Scientific, 1998.
27. O. Khatib, "Real-time obstacle avoidance for manipulators and mobile robots," in Proc. Int. Conf. Robotics and Automation, St. Louis, MO, Mar. 1985, pp. 500-505.
28. C. DeBolt, C. O'Donnell, C. Freed, and T. Nguyen, "The BUGS (Basic UXO Gathering Systems) project for UXO clearance & mine countermeasures," in Proc. IEEE Int. Conf. Robotics and Automation, Albuquerque, NM, Apr. 1997, pp. 329-332.
29. RoboMower, [Online]. Available: http://www.friendlyrobotics.com
30. Y.-J. Oh and Y. Watanabe, "Development of small robot for home floor cleaning," in Proc. 41st SICE Annu. Conf., Osaka, Japan, Aug. 2002, pp. 3222-3223. no. 7803950.
31. S. Hert, S. Tiwari, and V. Lumelsky, "A terrain-covering algorithm for an AUV," Auton. Robots, vol. 3, no. 2/3, pp. 91-119, Jun. 1996.
32. S. Spires and S. Goldsmith, "Exhaustive geographic search with mobile robots along space-filling curves," in Proc. 1st Int. Workshop Collective Robotics, Paris, France, 1998, pp. 1-12.
33. I. Wagner, M. Lindenbaum, and A. Bruckstein, "Distributed covering by ant-robots using evaporating traces," IEEE Trans. Robot. Autom., vol. 15, no. 5, pp. 918-933, Oct. 1999.
34. S. Benkoski, M. Monticino, and J. Weisinger, "A survey of the search theory literature," Nav. Res. Logist., vol. 38, no. 4, pp. 469-494, Aug. 1991.
35. M. Polycarpou, Y. Yang, and K. Passino, "A cooperative search framework for distributed agents," in Proc. IEEE Int. Symp. Intelligent Control, Mexico City, Mexico, 2001, pp. 1-6.
36. Y. Yang, A. Minai, and M. Polycarpou, "Analysis of opportunistic method for cooperative search by mobile agents," in Proc. 41st IEEE Conf. Decision and Control, Las Vegas, NV, Dec. 2002, pp. 576-577.
37. Y. Yang, A. Minai, and M. Polycarpou, "Decentralized opportunistic learning in UAV's performing cooperative search," presented at the Proc. AIAA Guidance, Navigation, and Control Conf., Monterey, CA, 2002, Paper AIAA-2002-4590.
38. Y. Yang, M. Polycarpou, and A. Minai, "Opportunistically cooperative neural learning in mobile agents," in Proc. Int. Joint Conf. Neural Networks, Honolulu, HI, May 2002, pp. 2638-2643.
39. M. Flint, E. Fernandez-Gaucherand, and M. Polycarpou, "Cooperative control for UAV's searching risky environments for targets," in Proc. 42nd IEEE Conf. Decision and Control, Maui, HI, Dec. 2003, pp. 3567-3572.
40. M. Flint, M. Polycarpou, and E. Fernandez-Gaucherand, "Cooperative control of multiple autonomous UAV's search for targets," in Proc. 41st IEEE Conf. Decision and Control, Las Vegas, NV, Dec. 2002, pp. 2823-2828.
41. M. Baum and K. Passino, "A search-theoretic approach to cooperative control for uninhabited air vehicles," presented at the Proc. AIAA Conf. Guidance, Navigation, and Control, Monterey, CA, 2002, Paper AIAA-2002-4589.
42. C. Zhang and R. Ordonez, "Decentralized adaptive coordination and control of uninhabited autonomous vehicles via surrogate optimization," in Proc. Amer. Control Conf., Denver, CO, Jun. 2003, pp. 2205-2210.
43. J. Grefenstette, (1997). "The user's guide to samuel-97: An evolutionary learning system." Technical Report. [Online]. Available: citeseer.ist.psu.edu/176572.html
44. J. Marin, R. Radtke, D. Innis, D. Barr, and A. Schultz, "Using a genetic algorithm to develop rules to guide unmanned aerial vehicles," in Proc. IEEE Int. Conf. Systems, Man, and Cybernetics, Tokyo, Japan, Oct. 1999, pp. 1055-1060.
45. J. Hespanha, J. K. Hyoun, and S. Sastry, "Multiple-agent probabilistic pursuit-evasion games," in Proc. 38th IEEE Conf. Decision and Control, Phoenix, AZ, Dec. 1999, pp. 2432-2437.
46. J. Hespanha, M. Prandini, and S. Sastry, "Probabilistic pursuit-evasion games: A one-step Nash approach," in Proc. 39th IEEE Conf. Decision and Control, Sydney, Australia, Dec. 2000, pp. 2272-2277.
47. O. Laporte, "The vehicle routing problem: An overview of exact and approximate algorithms," Eur. J. Oper. Res., vol. 59, no. 3, pp. 345-358, 1992.
48. H. Ozdemir and C. Mohan, "Evolving schedule graphs for the vehicle routing problem with time windows," in Proc. Congr. Evolutionary Computation, La Jolla, CA, Jul. 2000, pp. 888-895.
49. T. Takeno, Y. Tsujimura, and G. Yamazaki, "A single-phase method based on evolution calculation for vehicle routing problem," in Proc. 4th Int. Conf. Computational Intelligence and Multimedia Applications, Yokosuka, Japan, Oct./Nov. 2001, pp. 103-107.
50. K. Uchimura, H. Sakaguchi, and T. Nakashima, "Genetic algorithms for vehicle routing problem in delivery system," in Proc. Vehicle Navigation and Information Systems Conf., Yokohama, Japan, Aug./Sep. 1994, pp. 287-290.
51. K. Tan, L. Lee, Q. Zhu, and K. Ou, "Heuristic methods for vehicle routing problem with time windows," Artif. Intell. Eng., vol. 15, no. 3, pp. 281-295, Jul. 2001.
52. A. Richards, J. Bellingham, M. Tillerson, and J. How, "Co-ordination and control of multiple UAVs," presented at the AIAA Conf. Guidance, Navigation, and Control, Monterey, CA, Aug. 2002, Paper AIAA-2002-4288.
53. K. P. O'Rourke, W. B. Carlton, T. G. Bailey, and R. R. Hill, "Dynamic routing of unmanned aerial vehicles using reactive tabu search," Military Oper. Res., vol. 6, no. 1, pp. 5-30, 2001.
54. J. Ryan, T. Bailey, J. Moore, and W. Carlton, "Reactive tabu search in unmanned aerial reconnaissance simulations," in Proc. 30th Conf. Winter Simulation, Washington, DC, 1998, pp. 873-880.
55. R. Murphy, "An approximate algorithm for a weapon target assignment stochastic program," in Approximation and Complexity in Numerical Optimization: Continuous and Discrete Problems, P. Pardalos, Ed. Boston, MA: Kluwer, 2000, pp. 406-421.
56. A. Gil, K. Passino, A. Sparks, and S. Ganapathy, "Cooperative scheduling of tasks for networked uninhabited autonomous vehicles," in Proc. 42nd IEEE Conf. Decision and Control, Maui, HI, Dec. 2003, pp. 522-527.
57. A. Gil and K. Passino, "Stability analysis of network-based cooperative resource allocation strategies," in Proc. 42nd IEEE Conf. Decision and Control, Maui, HI, Dec. 2003, pp. 1206-1211.
58. R. Beard, T. McLain, M. Goodrich, and E. Anderson, "Coordinated target assignment and intercept for unmanned air vehicles," IEEE Trans. Robot. Autom., vol. 18, no. 6, pp. 911-922, Dec. 2002.
59. P. Chandler, S. Rasmussen, and M. Pachter, "UAV cooperative path planning," in Proc. AIAA Guidance, Navigation, and Control Conf., Denver, CO, 2000, pp. 1255-1265.
60. T. McLain and R. Beard, "Trajectory planning for coordinated rendezvous of unmanned air vehicles," presented at the AIAA Guidance, Navigation, and Control Conf., Denver, CO, 2000, Paper AIAA-2000-4369.
61. T. McLain, P. Chandler, S. Rasmussen, and M. Pachter, "Cooperative control of UAV rendezvous," in Proc. Amer. Control Conf., Arlington, VA, Jun. 2001, pp. 2309-2314.
62. C. Schumacher, P. Chandler, M. Pachter, and L. Pachter, "UAV task assignment with timing constraints via mixed-integer linear programming," in Proc. AIAA 3rd "Unmanned Unlimited" Technical Conf., Workshop and Exhibit, Chicago, IL, Sep. 2004, pp. 238-252.
63. Low Cost Autonomous Attack System (LOCAAS). [Online]. Available: http://www.globalsecurity.org/military/systems/munitions/locass.htm
64. P. Chandler and M. Pachter, "Hierarchical control for autonomous teams," in Proc. AIAA Guidance, Navigation, and Control Conf., Monterey, CA, 2001, pp. 632-642.
65. P. Chandler, M. Pachter, D. Swaroop, J. Fowler, J. Howlett, S. Rasmussen, C. Schumacher, and K. Nygard, "Complexity in UAV cooperative control," in Proc. Amer. Control Conf., Anchorage, AK, 2002, pp. 1831-1836.
66. A. Pongpunwattana, R. Rysdyk, and J. Vagners, "Market-based coevolution planning for multiple autonomous vehicles," presented at the AIAA Conf. Guidance, Navigation, and Control, Austin, TX, May 2003, Paper AIAA-2003-6524.
67. W. Agassounon and A. Martinoli, "Efficiency and robustness of threshold-based distributed allocation algorithms in multi-agent systems," in Proc. 1st Int. Joint Conf. Autonomous Agents and Multi-Agent Systems, Bologna, Italy, Jul. 2002, pp. 1090-1097.
68. B. Gerkey and M. Mataric, "Multi-robot task allocation: Analyzing the complexity and optimality of key architectures," in Proc. IEEE Int. Conf. Robotics and Automation (ICRA), Taipei, Taiwan, R.O.C., Sep. 2003, pp. 3862-3868.
69. A. Elfes, "Using occupancy grids for mobile robot perception and navigation," IEEE Computer, vol. 22, no. 6, pp. 46-57, Jun. 1989.
70. J. Bellingham, M. Tillerson, M. Alighanbari, and J. How, "Cooperative path planning for multiple UAVs in dynamic and uncertain environments," in Proc. 41st IEEE Conf. Decision and Control, Las Vegas, NV, Dec. 2002, pp. 2816-2822.
71. J. Finke, K. Passino, and A. Sparks, "Cooperative control via task load balancing for networked uninhabited autonomous vehicles," in Proc. 42nd IEEE Conf. Decision and Control, Maui, HI, Dec. 2003, pp. 31-36.
72. H. Durrant-Whyte, S. Majumder, M. de Battista, and S. Scheding, "A Bayesian algorithm for simultaneous localization and map building," in Robotics Research: 10th Int. Symp., R. Jarvis, A. Zelinsky, Eds., Lorne, Australia, 2001, pp. 3118-3123.
73. L. Klein, Sensor and Data Fusion: A Tool for Information Assessment and Decision Making. Bellingham, WA: SPIE, 2004.
74. J. Manyika and H. Durrant-Whyte, Data Fusion and Sensor Management: A Decentralized Information-Theoretic Approach, ser. Ellis Horwood Series in Electrical and Electronic Engineering. Upper Saddle River, NJ: Prentice-Hall, 1994.
75. F. Zhao and L. Guibas, Wireless Sensor Networks: An Information Processing Approach, ser. Morgan Kaufmann series in networking. San Mateo, CA: Morgan Kaufmann, Jul. 2004.
76. H. Moravec, "Sensor fusion in certainty grids for mobile robots," Artif. Intell. Mag., vol. 9, no. 2, pp. 61-74, Jul./Aug. 1988.
77. T. Cormen, C. Leiserson, and R. Rivest, Introduction to Algorithms, 2nd ed. Cambridge, MA: MIT Press, Sep. 2001.
78. K. Nygard, P. Chandler, and M. Pachter, "Dynamic network flow optimization models for air vehicle resource allocation," in Proc. Amer. Control Conf., Arlington, VA, Jun. 2001, pp. 1853-1858.
79. MultiUAV Simulation (Version 1.1), AFRL/VACA, Dayton, OH, Oct. 2001.
80. R. Sutton and A. Barto, Reinforcement Learning: An Introduction, ser. Adaptive Computation and Machine Learning. Cambridge, NM: MIT Press, Mar. 1998.