Collision avoidance for unmanned aircraft using Markov Decision Processes

AIAA Guidance, Navigation, and Control Conference

Volumn , Issue , 2010, Pages

  Temizer, Selim ^a   Kochenderfer, Mykel J ^b   Kaelbling, Leslie P ^a   Lozano Pérez, Tomás ^a   Kuchar, James K ^b  

^a Massachusetts Institute of Technology Cambridge   (United States)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AIRBORNE COLLISION AVOIDANCE SYSTEMS; AIRCRAFT CONFIGURATIONS; AIRCRAFT DYNAMICS; AIRCRAFT PERFORMANCE; AUTOMATIC GENERATION; CIVIL AIRSPACE; FIELD OF VIEWS; MARKOV DECISION PROCESSES; PARTIALLY OBSERVABLE MARKOV DECISION PROCESS; SENSOR MODALITY; SENSOR PERFORMANCE; UNMANNED AIRCRAFTS;

AIRCRAFT ACCIDENTS; AIRCRAFT MODELS; COLLISION AVOIDANCE; LEARNING ALGORITHMS; MARKOV PROCESSES; SENSORS;

VEHICLE PERFORMANCE;

EID: 78650942913     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.2514/6.2010-8040     Document Type: Conference Paper

References (32)

1. Abdul-Baki, B., Baldwin, J., and Rudel, M.-P., "Independent Validation and Verification of the TCAS II Collision Avoidance Subsystem," Digital Avionics Systems Conference, 1999.
2. Kaelbling, L. P., Littman, M. L., and Cassandra, A. R., "Planning and Acting in Partially Observable Stochastic Domains," Artificial Intelligence, Vol. 101, 1998, pp. 99-134.
3. Simmons, R. and Koenig, S., "Probabilistic Robot Navigation in Partially Observable Environments," International Joint Conference on Artificial Intelligence, 1995, pp. 1080-1087.
4. Bandera, C., Vico, F. J., Bravo, J. M., Harmon, M. E., and Iii, L. C. B., "Residual Q-Learning Applied to Visual Attention," International Conference on Machine Learning, 1996, pp. 20-27.
5. Darrell, T. and Pentland, A., "Active Gesture Recognition using Partially Observable Markov Decision Processes," International Conference on Pattern Recognition, 1996, pp. 984-988.
6. Horvitz, E. and Paek, T., "DeepListener: Harnessing Expected Utility to Guide Clarification Dialog in Spoken Language Systems," International Conference on Spoken Language Processing, Vol. 1, Beijing, China, October 2000, pp. 226-229.
7. Bagnell, J. A. and Schneider, J. C., "Autonomous Helicopter Control using Reinforcement Learning Policy Search Methods," International Conference on Robotics and Automation, IEEE Press, 2001, pp. 1615-1620.
8. Hauskrecht, M., Planning and Control in Stochastic Domains with Imperfect Information, Ph.D. thesis, Massachusetts Institute of Technology, Cambridge, MA, 1997.
9. Boutilier, C., "A POMDP formulation of preference elicitation problems," Eighteenth National Conference on Artificial intelligence, American Association for Artificial Intelligence, Menlo Park, CA, USA, 2002, pp. 239-246.
10. Pineau, J., Gordon, G., and Thrun, S., "Point-based value iteration: An anytime algorithm for POMDPs," International Joint Conference on Artificial Intelligence (IJCAI), August 2003, pp. 1025-1032.
11. Smith, T. and Simmons, R. G., "Point-Based POMDP Algorithms: Improved Analysis and Implementation," Conference on Uncertainty in Artificial Intelligence, 2005.
12. Kurniawati, H., Hsu, D., and Lee, W., "SARSOP: Efficient point-based POMDP planning by approximating optimally reachable belief spaces," Proc. Robotics: Science and Systems, 2008.
13. Hsu, D., Lee, W., and Rong, N., "A point-based POMDP planner for target tracking," IEEE International Conference on Robotics & Automation, 2008, pp. 2644-2650.
14. Hsu, D., Lee, W., and Rong, N., "What makes some POMDP problems easy to approximate?" Advances in Neural Information Processing Systems (NIPS), 2007.
15. RTCA, Inc., "Minimum Operational Performance Standards for Traffic Alert and Collision Avoidance System II (TCAS II) Airborne Equipment," Tech. Rep. RTCA/DO-185A, SC-147, Washington, DC, December 1997.
16. Kochenderfer, M. J., Edwards, M. W. M., Espindle, L. P., Kuchar, J. K., and Griffith, J. D., "Airspace Encounter Models for Estimating Collision Risk," Journal of Guidance, Control, and Dynamics, Vol. 33, No. 2, 2010, pp. 487-499.
17. Kochenderfer, M. J., Kuchar, J. K., Espindle, L. P., and Griffith, J. D., "Correlated Encounter Model for Cooperative Aircraft in the National Airspace System," Project Report ATC-344, Massachusetts Institute of Technology, Lincoln Laboratory, 2008.
18. Lebron, J. E., Zeitlin, A. D., Spencer, N. A., Andrews, J. W., and Harman, W. H., "System Safety Study of Minimum TCAS II (Traffic Alert and Collision Avoidance System)," Tech. Rep. MTR-83W241, MITRE, Dec. 1983.
19. Drumm, A., "Lincoln Laboratory evaluation of TCAS II Logic Version 6.04a," Project Report ATC-240, Massachusetts Institute of Technology, Lincoln Laboratory, 1996.
20. McLaughlin, M. P., "Safety study of the Traffic Alert and Collision Avoidance System (TCAS II)," Tech. Rep. MTR 97W32, MITRE Corporation, June 1997.
21. Russell, S. J. and Norvig, P., Artificial Intelligence: A Modern Approach (Second Edition), Prentice Hall, 2003.
22. Kuchar, J. K., "Methodology for Alerting-System Performance Evaluation," Journal of Guidance, Control, and Dynamics, Vol. 19, No. 2, 1996, pp. 438-444.
23. Winder, L. F. and Kuchar, J. K., "Evaluation of Collision Avoidance Maneuvers for Parallel Approach," Journal of Guidance, Control, and Dynamics, Vol. 22, No. 6, 1999, pp. 801-807.
24. Tsang, S. M., "Method and Apparatus for Performing Three-Dimensional Alpha/Beta Tracking," U.S. Patent No. 6,236,899 B1, Filed August 18, 1998, and issued May 22, 2001.
25. Gray, R. L., "Method of Kalman Filtering for Estimating the Position and Velocity of a Tracked Object," U.S. Patent No. 5,051,751, Filed February 12, 1991, and issued September 24, 1991.
26. Littman, M. L., Cassandra, A. R., and Kaelbling, L. P., "Learning Policies for Partially Observable Environments: Scaling Up," International Conference on Machine Learning, 1995, pp. 362-370.
27. Mazor, E., Averbuch, A., Bar-Shalom, Y., and Dayan, J., "Interacting Multiple Model Methods in Target Tracking: A Survey," IEEE Transactions on Aerospace Electronic Systems, Vol. 34, January 1998, pp. 103-123.
28. Tanizaki, H., Nonlinear Filters: Estimation and Applications, Springer-Verlag, second (revised and enlarged) ed., 1996.
29. International Civil Aviation Organization, "Surveillance, radar and collision avoidance," International Standards and Recommended Practices, Vol. IV, annex 10, 4th ed., July 2007.
30. Kochenderfer, M. J. and Chryssanthacopoulos, J. P., "A Decision-Theoretic Approach to Developing Robust Collision Avoidance Logic," IEEE International Conference on Intelligent Transportation Systems, Madeira Island, Portugal, 2010.
31. Kochenderfer, M. J., Chryssanthacopoulos, J. P., Kaelbling, L. P., Lozano-Perez, T., and Kuchar, J. K., "Model-Based Optimization of Airborne Collision Avoidance Logic," Project Report ATC-360, Massachusetts Institute of Technology, Lincoln Laboratory, 2010.
32. Ong, S., Png, S., Hsu, D., and Lee, W., "Planning under Uncertainty for Robotic Tasks with Mixed Observability," International Journal of Robotics Research, 2010, To appear.