Human aware UAS path planning in urban environments using nonstationary MDPs

Proceedings - IEEE International Conference on Robotics and Automation

Volumn , Issue , 2014, Pages 1161-1167

  Allamaraju, Rakshit ^a   Kingravi, Hassan ^a   Axelrod, Allan ^a   Chowdhary, Girish ^a   Grande, Robert ^b   How, Jonathan P ^b   Crick, Christopher ^c   Sheng, Weihua ^d  

^a Distributed Autonomous Systems Laboratory of Mechanical and Aerospace Eningeering   (United States)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^c Department of Computer Science   (United States)

^d Oklahoma State University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ANTENNAS; CLUSTERING ALGORITHMS; MARKOV PROCESSES; POPULATION STATISTICS; REINFORCEMENT LEARNING; UNMANNED AERIAL VEHICLES (UAV); URBAN PLANNING;

BAYESIAN NONPARAMETRICS; GAUSSIAN PROCESSES; HUMAN POPULATION; MARKOV DECISION PROCESSES; MODEL-BASED REINFORCEMENT LEARNING; NONSTATIONARY; PATH-PLANNING ALGORITHM; URBAN ENVIRONMENTS;

MOTION PLANNING;

EID: 84929155218     PISSN: 10504729     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICRA.2014.6907000     Document Type: Conference Paper

References (37)

1. P. Finn, "Domestic use of aerial drones by law enforcement likely to prompt privacy debate," Washington Post, vol. 22, 2011.
2. T. Takahashi, "Drones and privacy," 2012.
3. S. Karaman, M. Walter, A. Perez, E. Frazzoli, and S. Teller, "Anytime motion planning using the RRT∗," in IEEE International Conference on Robotics and Automation (ICRA), pp. 1478-1483, IEEE, 2011.
4. S. Thrun, W. Burgard, D. Fox, et al., Probabilistic robotics, vol. 1. MIT press Cambridge, 2005.
5. M. G. Lagoudakis and R. Parr, "Least-squares policy iteration," J. Mach. Learn. Res., vol. 4, pp. 1107-1149, December 2003.
6. W. Burgard, A. B. Cremers, D. Fox, D. Hahnel, G. Lakemeyer, D. Schulz, W. Steiner, and S. Thrun, "Experiences with an interactive museum tour guide robot," Artificial Intelligence, vol. 114, pp. 3-55, 1999.
7. K. Dautenhahn, M. Walters, S. Woods, K. L. Koay, C. L. Nehaniv, A. Sisbot, R. Alami, and T. Simeon, "How may i serve you? a robot companion approaching a seated person in a helping context," in Proceedings of the 1st ACM SIGCHI/SIGART Conference on HumanRobot Interaction (HRI), 2006.
8. D. Feil-Seifer and M. Mataric, "People-aware navigation for goal-oriented behavior involving a human partner," in Proceedings of the IEEE International Conference on Development and Learning (ICDL), 2011.
9. P. Trautman and A. Krause, "Unfreezing the robot: Navigation in dense, interacting crowds," in IEEE/RSJ International Conference on Intelligent Robots and Systems, 2010.
10. D. Althoff, J. J. Kuffner, D. Wollherr, and M. Buss, "Safety assessment of robot trajectories for navigation in uncertain and dynamic environments," Autonomous Robots, vol. 32, pp. 285-302, 2012.
11. T. Bandyopadhyay, K. S. Won, E. Frazzoli, D. Hsu, W. S. Lee, and D. Rus, "Intention-aware motion planning," in Algorithmic Foundations of Robotics X, pp. 475-491, Springer, 2013.
12. C. Lichtenthaler and T. Lorenz, "Influence of legibility on perceived safety in a virtual human-robot path crossing task," in 21st IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), 2012.
13. M. Deisenroth, J. Peters, and C. Rasmussen, "Approximate dynamic programming with Gaussian processes," in Proceedings of the American Control Conference, 2008.
14. C. Rasmussen and M. Kuss, "Gaussian processes in reinforcement learning," Advances in Neural Information Processing Systems, vol. 16, pp. 751-759, 2004.
15. A. Krause, A. Singh, and C. Guestrin, "Near-optimal sensor placements in gaussian processes: Theory, efficient algorithms and empirical studies," Journal of Machine Learning Research (JMLR), vol. 9, pp. 235-284, June 2008.
16. N. K. Ure, A. Geramifard, G. Chowdhary, and J. P. How, "Adaptive Planning for Markov Decision Processes with Uncertain Transition Models via Incremental Feature Dependency Discovery," in European Conference on Machine Learning (ECML), 2012.
17. N. K. Ure, G. Chowdhary, Y. F. Chen, J. P. How, and J. Vian, "Health-aware decentralized planning and learning for large-scale multiagent missions," in Conference on Guidance Navigation and Control, (Washington DC), AIAA, August 2013.
18. C. E. Rasmussen and C. K. I. Williams, Gaussian Processes for Machine Learning. The MIT Press, December 2005.
19. L. Csató and M. Opper, "Sparse on-line Gaussian processes," Neural Computation, vol. 14, no. 3, pp. 641-668, 2002.
20. F. Pérez-Cruz, S. Van Vaerenbergh, J. J. Murillo-Fuentes, M. Lázaro-Gredilla, and I. Santamaria, "Gaussian processes for nonlinear signal processing," arXiv preprint arXiv:1303.2823, 2013.
21. G. Chowdhary, H. Kingravi, J. P. How, and P. Vela, "Bayesian non-parametric adaptive control of time varying systems using Gaussian processes," in American Control Conference (ACC), IEEE, 2013 (submitted).
22. R. Grande, "Computationally efficient gaussian process changepoint detection and regression."
23. J. Y. Yu and S. Mannor, "Online learning in markov decision processes with arbitrarily changing rewards and transitions," in Game Theory for Networks, 2009. GameNets' 09. International Conference on, pp. 314-322, IEEE, 2009.
24. M. Abdoos, N. Mozayani, and A. L. Bazzan, "Traffic light control in non-stationary environments based on multi agent q-learning," in Intelligent Transportation Systems (ITSC), 2011 14th International IEEE Conference on, pp. 1580-1585, IEEE, 2011.
25. D. Bertsekas, Dynamic Programming and Optimal Control. Athena Scientific, 2005.
26. R. Sutton and A. Barto, Reinforcement learning: An introduction. MIT Press, 1998.
27. L. Busoniu, R. Babuska, B. D. Schutter, and D. Ernst, Reinforcement Learning and Dynamic Programming Using Function Approximators. CRC Press, 2010.
28. C. G. Atkeson and J. C. Santamaria, "A comparison of direct and modelbased reinforcement learning," in IN INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, pp. 3557-3564, IEEE Press, 1997.
29. Y. Mostofi, A. G. Ruiz, A. Ghaffarkhah, and D. Li, "Characterization and modeling of wireless channels for networked robotic and control systems-A comprehensive overview," in IEEE International Conference on Intelligent Robots and Systems, 2009.
30. C. Rasmussen and C. Williams, Gaussian Processes for Machine Learning. The MIT Press, 2006.
31. J. Candela and C. Rasmussen, "A unifying view of sparse approximate Gaussian process regression," Journal of Machine Learning Research, vol. 6, pp. 1939-1959, 2005.
32. J. Joseph, F. Doshi-Velez, A. S. Huang, and N. Roy, "A bayesian nonparametric approach to modeling motion patterns," Autonomous Robots, vol. 31, no. 4, pp. 383-400, 2011.
33. R. Brafman and M. Tennenholtz, "R-Max-A General Polynomial Time Algorithm for Near-Optimal Reinforcement Learning," Journal of Machine Learning Research, vol. 3, pp. 213-231, 2002.
34. I. Chads, G. Chapron, M.-J. Cros, F. Garcia, and R. Sabbadin, "Markov decision processes (MDP) toolbox." http://www7.inra.fr/mia/T/MDPtoolbox/MDPtoolbox.html, 2012.
35. J. P. How, E. Frazzoli, and G. Chowdhary, "Linear Flight Contol Techniques for Unmanned Aerial Vehicles," in Handbook of Unmanned Aerial Vehicles (K. P. Valavanis and G. J. Vachtsevanos, eds.), Springer, 2014. In Press.
36. M. Cutler and J. P. How, "Actuator constrained trajectory generation and control for variable-pitch quadrotors," in AIAA Guidance, Navigation, and Control Conference (GNC), (Minneapolis, Minnesota), August 2012.
37. M. Quigley, B. Gerkey, K. Conley, J. Faust, T. Foote, J. Leibs, E. Berger, R. Wheeler, and A. Ng, "Ros: an open-source robot operating system," in Proceedings of the Open-Source Software Workshop of the International Conference on Robotics and Automation, 2009.