FIRM: Sampling-based feedback motion-planning under motion uncertainty and imperfect measurements

International Journal of Robotics Research

Volumn 33, Issue 2, 2014, Pages 268-304

  Agha mohammadi, Ali Akbar ^a   Chakravorty, Suman ^a   Amato, Nancy M ^a  

^a Department of Electrical and Computer Engineering   (United States)

Author keywords

Belief space; Control; Information; Planning; Uncertainty

Indexed keywords

AGRICULTURAL ROBOTS; CONTROL ENGINEERING; DYNAMICAL SYSTEMS; PLANNING; UNCERTAINTY ANALYSIS;

BELIEF SPACE; COLLISION PROBABILITY; INFORMATION; LINEAR QUADRATIC GAUSSIAN; OPTIMAL SUBSTRUCTURES; PLANNING UNDER UNCERTAINTY; PROBABILISTIC ROADMAP METHODS; UNCERTAINTY;

FEEDBACK;

EID: 84905678644     PISSN: 02783649     EISSN: 17413176     Source Type: Journal    
DOI: 10.1177/0278364913501564     Document Type: Article

References (73)

1. Agha-mohammadi A, Chakravorty S and Amato N (2011) FIRM: Feedback controller-based Information-state RoadMap-a framework for motion planning under uncertainty. In: International conference on intelligent robots and systems (IROS).
2. Agha-mohammadi A, Chakravorty S and Amato N (2012a) Nonholonomic motion planning in belief space via dynamic feedback linearization-based FIRM. In: International conference on intelligent robots and systems (IROS).
3. Agha-mohammadi A, Chakravorty S and Amato N (2012b) On the probabilistic completeness of the sampling-based feedback motion planners in belief space. In: IEEE international conference on robotics and automation (ICRA).
4. Agha-mohammadi A, Chakravorty S and Amato N (2012c) Periodic-feedback motion planning in belief space for nonholonomic and/or non-stoppable robots. Technical Report no. TR12-003, Texas A&M University, USA.
5. Agha-mohammadi A, Chakravorty S and Amato N (2013a) Online replanning in belief space for dynamical systems: Towards handling discrete changes of goal location. In: IEEE international conference on robotics and automation (ICRA): Workshop on combining task and motion planning.
6. Agha-mohammadi A, Chakravorty S and Amato N (2013b) Sampling-based stochastic control with constraints: A unified approach in state and information spaces. In: The American control conference (ACC).
7. Agha-mohammadi A, Agarwal S, Mahadeval A, et al. (2013c) Dynamic real-time replanning in belief space: an experimental study on physical mobile robots. Technical report TR 13-007, Texas A&M University, USA.
8. Alterovitz R, Siméon T and Goldberg K (2007) The stochastic motion roadmap: A sampling framework for planning with Markov motion uncertainty. In: Proceedings of robotics: Science and systems (RSS).
9. Amato N, Bayazit B, Dale L, et al. (1998) OBPRM: An obstaclebased PRM for 3D workspaces. In: International workshop on the algorithmic foundations of robotics, pp. 155-168.
10. Astrom K (1965) Optimal control of Markov decision processes with incomplete state estimation. Journal of Mathematical Analysis and Applications 10: 174-205.
11. Bai H, Hsu D, Lee WS, et al. (2010) Monte Carlo value iteration for continuous-state POMDPs. In: Hsu D, Isler V, Latombe J-C, et al. (eds) Algorithmic Foundations of Robotics IX (Springer Tracts in Advanced Robotics, vol. 68). New York, NY: Springer, pp. 175-191.
12. Bertsekas D (1976) Dynamic Programming and Stochastic Control. Waltham, MA: Academic Press.
13. Bertsekas D (2007) Dynamic Programming and Optimal Control, 3rd edn. Cambridge, MA: Athena Scientific.
14. Bohlin R (2002) Robot path planning. PhD Thesis, Chalmers University of Technology, Sweden.
15. Bry A and Roy N (2011) Rapidly-exploring random belief trees for motion planning under uncertainty. In: International conference on robotics and automation (ICRA), pp. 723-730.
16. Censi A, Calisi D, Luca AD, et al. (2008) A Bayesian framework for optimal motion planning with uncertainty. In: Proceedings of the IEEE international conference on robotics and automation (ICRA), Pasadena, CA.
17. Chakravorty S and Erwin RS (2011) Information space receding horizon control. In: IEEE symposium on adaptive dynamic programming and reinforcement learning (ADPRL).
18. Chakravorty S and Kumar S (2009) Generalized sampling based motion planners with application to nonholonomic systems. In: Proceedings of the IEEE international conference on systems, man, and cybernetics, San Antonio, TX.
19. Chakravorty S and Kumar S (2011) Generalized sampling-based motion planners. IEEE Transactions on Systems, Man, and Cybernetics, Part B 41(3): 855-866.
20. Choset H, Lynch KM, Hutchinson S, et al. (2005) Principles of Robot Motion: Theory, Algorithms, and Implementations. Cambridge, MA: MIT Press.
21. Cormen TH, Leiserson CE, Rivest RL, et al. (2001) Introduction to Algorithms. 2nd edn. Cambridge, MA: MIT Press.
22. Crassidis J and Junkins J (2004) Optimal Estimation of Dynamic Systems. Boca Raton, FL: Chapman & Hall/CRC.
23. Doucet A, de Freitas J and Gordon N (2001) Sequential Monte Carlo Methods in Practice. New York, NY: Springer.
24. Guibas L, Hsu D, Kurniawati H, et al. (2008) Bounded uncertainty roadmaps for path planning. In: International workshop on algorithmic foundations of robotics (WAFR).
25. He R, Brunskill E and Roy N (2010) PUMA: Planning under uncertainty with macro-actions. In: Proceedings of the twentyfourth conference on artificial intelligence (AAAI), Atlanta, GA.
26. He R, Brunskill E and Roy N (2011) Efficient planning under uncertainty with macro-actions. Journal of Artificial Intelligence Research 40: 523-570.
27. Hsu D (2000) Randomized single-query motion planning in expansive spaces. PhD Thesis, Stanford University, CA.
28. Huynh V and Roy N (2009) icLQG: Combining local and global optimization for control in information space. In: IEEE international conference on robotics and automation (ICRA).
29. Kaelbling LP, Littman ML and Cassandra AR (1998) Planning and acting in partially observable stochastic domains. Artificial Intelligence 101: 99-134.
30. Kalmár-Nagy T, D'Andrea R and Ganguly P (2004) Near-optimal dynamics trajectory generation and control of an omnidirectional vehicle. Robotics and Autonomous Systems 46(1): 47-64.
31. Karaman S and Frazzoli E (2011) Sampling-based algorithms for optimal motion planning. The International Journal of Robotics Research 30(7): 846-894.
32. Kavraki L, Kolountzakis M and Latombe J (1998) Analysis of probabilistic roadmaps for path planning. IEEE Transactions on Robotics and Automation 14: 166-171.
33. Kavraki L, Latombe J, Motwani R, et al. (1995) Randomized query processing in robot motion planning. In: Proceedings of the ACM symposium on the theory of computing, pp. 353-362.
34. Kavraki L, Švestka P, Latombe J, et al. (1996) Probabilistic roadmaps for path planning in high-dimensional configuration spaces. IEEE Transactions on Robotics and Automation 12(4): 566-580.
35. Keener JP (2000) Principles of Applied Mathematics: Transformation and Approximation. 2nd edn. Boulder, CO: Westview Press.
36. Kumar PR and Varaiya PP (1986) Stochastic Systems: Estimation, Identification, and Adaptive Control. Englewood Cliffs, NJ: Prentice-Hall.
37. Kurniawati H, Bandyopadhyay T and Patrikalakis N (2012) Global motion planning under uncertain motion, sensing, and environment map. Autonomous Robots 33(3): 255-272.
38. Kurniawati H, Du Y, Hsu D, et al. (2010) Motion planning under uncertainty for robotic tasks with long time horizons. The International Journal of Robotics Research 30: 308-323.
39. Kurniawati H, Du Y, Hsu D, et al. (2011) Motion planning under uncertainty for robotic tasks with long time horizons. The International Journal of Robotics Research 30(3): 308-323.
40. Kurniawati H, Hsu D and LeeW(2008) SARSOP: Efficient pointbased POMDP planning by approximating optimally reachable belief spaces. In: Proceedings of robotics: Science and systems (RSS).
41. Ladd A and Kavraki L (2004) Measure theoretic analysis of probabilistic path planning. IEEE Transactions on Robotics and Automation 20(2): 229-242.
42. Lavalle S and Kuffner J (2001) Randomized kinodynamic planning. The International Journal of Robotics Research 20: 378-400.
43. Lozano-Perez T (1983) Spatial planning: A configuration space approach. IEEE Transactions on Computers 100(2): 108-120.
44. Madani O, Hanks S and Condon A (1999) On the undecidability of probabilistic planning and infinite-horizon partially observable Markov decision problems. In: Proceedings of the sixteenth conference on artificial intelligence (AAAI), pp. 541-548.
45. Melchior N and Simmons R (2007) Particle RRT for path planning with uncertainty. In: International conference on intelligent robots and systems (IROS).
46. Meyn S and Tweedie RL (2009) Markov Chains and Stochastic Stability, 2nd edn. Cambridge: Cambridge University Press.
47. Missiuro P and Roy N (2006) Adapting probabilistic roadmaps to handle uncertain maps. In: International conference on robotics and automation (ICRA).
48. Nakhaei A and Lamiraux F (2008) A framework for planning motions in stochastic maps. In: IEEE international conference on robotics and automation (ICRA).
49. Norris JR (1997) Markov Chains. Cambridge: Cambridge University Press.
50. Ong SCW, Png SW, Hsu D, et al. (2010) Planning under uncertainty for robotic tasks with mixed observability. The International Journal of Robotics Research 29(8): 1053-1068.
51. Papadimitriou C and Tsitsiklis JN (1987) The complexity of Markov decision processes. Mathematics of Operations Research 12(3): 441-450.
52. Patil S, van den Berg J and Alterovitz R (2012) Estimating probability of collision for safe planning under Gaussian motion and sensing uncertainty. In: IEEE international conference on robotics and automation (ICRA).
53. Pineau J, Gordon G and Thrun S (2003) Point-based value iteration: An anytime algorithm for POMDPs. In: International joint conference on artificial intelligence, pp. 1025-1032.
54. Pineau J, Gordon G and Thrun S (2006) Anytime point based approximations for large POMDPs. Journal of Artificial Intelligence Research 27: 335-380.
55. Platt R, Kaelbling L, Lozano-Perez T, et al. (2011) Efficient planning in non-Gaussian belief spaces and its application to robot grasping. In: Proceedings of the international symposium of robotics research (ISRR).
56. Platt R, Tedrake R, Kaelbling L, et al. (2010) Belief space planning assuming maximum likelihood observatoins. In: Proceedings of robotics: Science and systems (RSS).
57. Porta JM, Vlassis N, Spaan MTJ, et al. (2006) Point-based value iteration for continuous POMDPs. Journal of Machine Learning Research 7: 2329-2367.
58. Prentice S and Roy N (2009) The belief roadmap: Efficient planning in belief space by factoring the covariance. The International Journal of Robotics Research 28(11-12): 1448-1465.
59. Simon D (2006) Optimal State Estimation: Kalman, H-infinity, and Nonlinear Approaches. New York, NY: John Wiley and Sons.
60. Smallwood RD and Sondik EJ (1973) The optimal control of partially observable Markov processes over a finite horizon. Operations Research 21(5): 1071-1088.
61. Smith T and Simmons R (2005) Point-based POMDP algorithms: Improved analysis and implementation. In: Proceedings of the international conference on uncertainty in artificial intelligence (UAI).
62. Sniedovich M (2006) Dijkstra's algorithm revisited: The dynamic programming connexion. Control and Cybernetics 35(3): 599-620.
63. Spaan M and Vlassis N (2005) Perseus: Randomized point-based value iteration for POMDPs. Journal of Artificial Intelligence Research 24: 195-220.
64. Sutton R, Precup D and Singh S (1999) Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforcement learning. Artificial Intelligence 112: 181-211.
65. Švestka P and Overmars M (1997) Motion planning for car-like robots using a probabilistic learning approach. The International Journal of Robotics Research 16(2): 119-143.
66. Thrun S, Burgard W and Fox D (2005) Probabilistic Robotics. Cambridge, MA: MIT Press.
67. Toit ND and Burdick JW (2010) Robotic motion planning in dynamic, cluttered, uncertain environments. In: International conference on robotics and automation (ICRA).
68. Van den Berg J, Abbeel P and Goldberg K (2010) LQG-MP: Optimized path planning for robots with motion uncertainty and imperfect state information. In: Proceedings of robotics: Science and systems (RSS).
69. Van den Berg J, Abbeel P and Goldberg K (2011) LQG-MP: Optimized path planning for robots with motion uncertainty and imperfect state information. The International Journal of Robotics Research 30(7): 895-913.
70. Van den Berg J and Overmars M (2007) Kinodynamic motion planning on roadmaps in dynamic environments. In: IEEE/RSJ international conference on intelligent robots and systems (IROS), pp. 4253-4258.
71. Van den Berg J, Patil S and Alterovitz R (2011) Motion planning under uncertainty using differential dynamic programming in belief space. In: Proceedings of the international symposium of robotics research (ISRR).
72. Van den Berg J, Patil S and Alterovitz R (2012) Efficient approximate value iteration for continuous Gaussian POMDPs. In: Proceedings of the AAAI conference on artificial intelligence (AAAI).
73. Vitus MP and Tomlin CJ (2011) Closed-loop belief space planning for linear, Gaussian systems. In: International conference on robotics and automation (ICRA), pp. 2152-2159.