Unmanned aircraft collision avoidance using continuous-state POMDPs

Robotics: Science and Systems

Volumn 7, Issue , 2012, Pages 1-8

  Bai, Haoyu ^a   Hsu, David ^a   Kochenderfer, Mykel J ^b   Lee, Wee Sun ^a  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84911491157     PISSN: 23307668     EISSN: 2330765X     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (27)

1. J.A. Bagnell, S. Kakade, A. Ng, and J. Schneider. Policy search by dynamic programming. In Advances in Neural Information Processing Systems (NIPS), volume 16. 2003.
2. H.Y. Bai, D. Hsu, W.S. Lee, and V.A. Ngo. Monte Carlo value iteration for continuous-state POMDPs. In D. Hsu et al., editors, Algorithmic Foundations of Robotics IX-Proc. Int. Workshop on the Algorithmic Foundations of Robotics (WAFR). Springer, 2010.
3. T. Billingsley. Safety analysis of TCAS on Global Hawk using airspace encounter models. Master's thesis, Massachusetts Institute of Technology, 2006.
4. A. Brooks, A. Makarendo, S. Williams, and H. Durrant-Whyte. Parametric POMDPs for planning in continuous state spaces. Robotics & Autonomous Systems, 54 (11): 887-897, 2006.
5. E. Brunskill, L. Kaelbling, T. Lozano-Perez, and N. Roy. Continuous-state POMDPs with hybrid dynamics. In Proc. Int. Symp. on Artificial Intelligence & Mathematics, 2008.
6. G. Dowek, A. Geser, and C. Muñoz. Tactical conflict detection and resolution in a 3-D airspace. In USA/Europe Air Traffic Management R&D Seminars, 2001.
7. V.N. Duong and K. Zeghal. Conflict resolution advisory for autonomous airborne separation in low-density airspace. In Proc. IEEE Conf. on Decision & Control, 1997.
8. E.A. Hansen and S. Zilberstein. Heuristic search in cyclic AND/OR graphs. In Proc. AAAI Conf. on Artificial Intelligence, pages 412-418, 1998.
9. R. He, E. Brunskill, and N. Roy. PUMA: Planning under uncertainty with macro-actions. In Proc. AAAI Conf. on Artificial Intelligence, 2010.
10. L.P. Kaelbling, M.L. Littman, and A.R. Cassandra. Planning and acting in partially observable stochastic domains. Artificial Intelligence, 101 (1-2): 99-134, 1998.
11. M.J. Kochenderfer, L.P. Espindle, J.K. Kuchar, and J. D. Griffith. Correlated encounter model for cooperative aircraft in the national airspace system. Project Report ATC-344, Massachusetts Institute of Technology, Lincoln Laboratory, 2008.
12. J.K. Kuchar. Safety analysis methodology for unmanned aerial vehicle (UAV) collision avoidance systems. In USA/Europe Air Traffic Management R&D Seminars, 2005.
13. J.K. Kuchar and A.C. Drumm. The traffic alert and collision avoidance system. Lincoln Laboratory Journal, 16 (2): 277-296, 2007.
14. H. Kurniawati, D. Hsu, and W.S. Lee. SARSOP: Efficient pointbased POMDP planning by approximating optimally reachable belief spaces. In Proc. Robotics: Science and Systems, 2008.
15. C. Papadimitriou and J.N. Tsisiklis. The complexity of Markov decision processes. Mathematics of Operations Research, 12 (3): 441-450, 1987.
16. J. Pineau, G. Gordon, and S. Thrun. Point-based value iteration: An anytime algorithm for POMDPs. In Proc. Int. Jnt. Conf. on Artificial Intelligence, pages 477-484, 2003.
17. J.M. Porta, N. Vlassis, M.T.J. Spaan, and P. Poupart. Pointbased value iteration for continuous POMDPs. J. Machine Learning Research, 7: 2329-2367, 2006.
18. S. Prentice and N. Roy. The belief roadmap: Efficient planning in linear POMDPs by factoring the covariance. In Proc. Int. Symp. on Robotics Research, 2007.
19. S. Ross, J. Pineau, S. Paquet, and B. Chaib-Draa. Online planning algorithms for POMDPs. J. Artificial Intelligence Research, 32 (1): 663-704, 2008.
20. J. Saunders, R. Beard, and J. Byrne. Vision-based reactive multiple obstacle avoidance for micro air vehicles. In Proc. American Control Conf., 2009.
21. D. Silver and J. Veness. Monte-Carlo planning in large POMDPs. In Advances in Neural Information Processing Systems (NIPS), 2010.
22. R.D. Smallwood and E.J. Sondik. The optimal control of partially observable Markov processes over a finite horizon. Operations Research, 21: 1071-1088, 1973.
23. T. Smith and R. Simmons. Point-based POMDP algorithms: Improved analysis and implementation. In Proc. Uncertainty in Artificial Intelligence, 2005.
24. M.T.J. Spaan and N. Vlassis. Perseus: Randomized point-based value iteration for POMDPs. J. Artificial Intelligence Research, 24: 195-220, 2005.
25. S. Temizer, M.J. Kochenderfer, L.P. Kaelbling, T. Lozano-Pérez, and J.K. Kuchar. Collision avoidance for unmanned aircraft using Markov decision processes. In Proc. AIAA Guidance, Navigation, and Control Conference, 2010.
26. S. Thrun. Monte Carlo POMDPs. In Advances in Neural Information Processing Systems (NIPS). The MIT Press, 2000.
27. T.B. Wolf and M.J. Kochenderfer. Aircraft collision avoidance using Monte Carlo real-time belief space search. J. Intelligent & Robotic Systems, 2011. To appear.