A probabilistic particle-control approximation of chance-constrained stochastic predictive control

IEEE Transactions on Robotics

Volumn 26, Issue 3, 2010, Pages 502-517

  Blackmore, Lars ^a   Ono, Masahiro ^b   Bektassov, Askar ^c   Williams, Brian C ^b  

^a CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

^b Massachusetts Institute of Technology Cambridge   (United States)

^c ENI S P A   (Italy)

Author keywords

Chance constraints; Hybrid discrete continuous systems; Nonholonomic motion planning; Planning under stochastic uncertainty

Indexed keywords

CHANCE CONSTRAINT; DISCRETE-CONTINUOUS SYSTEMS; NONHOLONOMIC MOTION PLANNING; NONHOLONOMICS; STOCHASTIC UNCERTAINTIES;

AIRCRAFT ACCIDENTS; DISCRETE TIME CONTROL SYSTEMS; DYNAMICAL SYSTEMS; INTEGER PROGRAMMING; MOTION PLANNING; NAVIGATION; STOCHASTIC CONTROL SYSTEMS; STOCHASTIC SYSTEMS;

AIRCRAFT CONTROL;

EID: 77953200845     PISSN: 15523098     EISSN: None     Source Type: Journal    
DOI: 10.1109/TRO.2010.2044948     Document Type: Article

References (58)

1. U.S. military specificationMIL-F-8785C, U.S. Dept. Defense, Nov. 1980.
2. C. Andrieu, A. Doucet, S. S. Singh, and V. B. Tadic, "Particle methods for change detection, system identification, and control," in Proc. IEEE, vol.92, no.3, pp. 423-438, Mar. 2004.
3. M. Aoki, Optimization of Stochastic Systems. New York: Academic, 1967.
4. N.M.Barr, D. Gangsaas, and D. R. Schaeffer,"Windmodels for flight simulator certification of landing and approach guidance and control systems," Boeing Commercial Airplane Co., Renton, WA, Paper FAA-RD-74-206, 1974.
5. I. Batina, "Model predictive control for stochastic systems by randomized algorithms," Ph.D. dissertation, Tech. Univ. Eindhoven, Eindhoven, The Netherlands, 2004.
6. A. Bemporad andM.Morari, Robust Model Predictive Control: A Survey. Berlin, Germany: Springer-Verlag, 1999, pp. 207-226.
7. D. P. Bertsekas, Dynamic Programming and Stochastic Control. New York: Academic, 1976.
8. D. P. Bertsekas and J. N. Tsitsiklis, Introduction to Probability.. Belmont, MA: Athena Scientific, 2002.
9. L.Blackmore, "Aprobabilistic particle control approach to optimal, robust predictive control," in Proc. AIAA Guid., Navigat. Control Conf., 2006, pp. 1-15.
10. L. Blackmore, "Robust execution for stochastic hybrid systems," Ph.D. dissertation, Mass. Inst. Technol., Cambridge, MA, 2007.
11. L. Blackmore, A. Bektassov, M. Ono, and B. C. Williams, "Robust, optimal predictive control of jumpMarkov linear systems using particles," in Hybrid Systems: Computation and Control, HSCC (Lecture Notes in Computer Science, 4416), A. Bemporad, A. Bicchi, and G. Buttazzo, Eds. New York: Springer-Verlag, 2007, pp. 104-117.
12. L. Blackmore, H. X. Li, and B. C. Williams, "A probabilistic approach to optimal robust path planning with obstacles," in Proc. Amer. Control Conf., Minneapolis, MN, 2006.
13. L. Blackmore, S. Rajamanoharan, and B. C.Williams, "Active estimation for jump Markov linear systems," IEEE Trans. Autom. Control, vol.53, no.10, pp. 2223-2236, Nov. 2008.
14. G. C. Calafiore and M. C. Campi, "The scenario approach to robust control design," IEEE Trans. Autom. Control, vol.51, no.5, pp. 742-753, May 2006.
15. G. C. Calafiore and L. El Ghaoui, "Linear programming with probability constraints-Part 1," in Proc. Amer. Control Conf., 2007, pp. 2636-2641.
16. G. C. Calafiore and L. El Ghaoui, "Linear programming with probability constraints-Part 2," in Proc. Amer. Control Conf., 2007, pp. 2642-2647.
17. M. C. Campi and G. C. Calafiore, "New results on the scenario design approach," in Proc. Conf. Decis. Control, 2007, pp. 6184-6189.
18. P. C. Chandrasekharan, Robust Control of Linear Dynamical Systems. New York: Academic, 1996.
19. L. Chisci, P. Falugi, and G. Zappa, "Predictive control for constrained systems with polytopic uncertainty," in Proc. Amer. Control Conf., Arlington, VA, 2001.
20. O. L. V. Costa, M. D. Fragoso, and R. P. Marques, Discrete-Time Markovian Jump Linear Systems. New York: Springer-Verlag, 2005.
21. A. Doucet, N. de Freitas, and N. J. Gordon, Sequential Monte Carlo Methods in Practice. New York: Springer-Verlag, 2001.
22. A. Doucet, N. Gordon, and V. Krishnamurthy, "Particle filters for state estimation of jump Markov linear systems," Dept. Eng., Cambridge Univ., Cambridge, U.K., Tech. Rep. CUED/FINFENG/TR 359, 1999.
23. N. Freitas, "Rao-Blackwellised particle filtering for fault diagnosis," in Proc. IEEE Aerosp. Conf., 2001, pp. 4-1767-4-1772.
24. A. Greenfield and A. Brockwell, "Adaptive control of nonlinear stochastic systems by particle filtering," in Proc. Conf. Control Autom., 2003, pp. 887-890.
25. D. H. Van and Hessem, "Stochastic inequality constrained closed-loop model predictive control," Ph.D. dissertation, Tech. Univ. Delft, Delft, The Netherlands, 2004.
26. ILOG CPLEX User's Guide, IBM ILOG, 1999.
27. L. P. Kaelbling, M. L. Littman, and A. R. Cassandra, "Planning and acting in partially observable stochastic domains," Brown Univ., Providence, RI, Tech. Rep. CS-96-108, 1996.
28. P. Kall and S. W. Wallace, Stochastic Programming. New York: Wiley, 1994.
29. A. Lecchini-Visintini,W. Glover, J. Lygeros, and J.Maciejowski, "Monte Carlo optimisation for conflict resolution in air traffic control," IEEE Trans. Intell. Transp. Syst., vol.7, no.4, pp. 470-482, Dec. 2006.
30. A. Lecchini-Visintini, J. Lygeros, and J.M.Maciejowski, "On the approximate domain optimization of deterministic and expected value criteria," in Proc. Conf. Decis. Control, 2008, pp. 1-6.
31. Y. I. Lee and B. Kouvaritakis, "A linear programming approach to constrained robust predictive control," in Proc. Amer. Control Conf., 2000, pp. 1765-1770.
32. P. Li, M. Wendt, and G. Wozny, "A probabilistically constrained model predictive controller," Automatica, vol.38, pp. 1171-1176, 2002.
33. D. McRuer, I. Ashkenas, and D. Graham, Aircraft Dynamics and Automatic Control. Princeton, NJ: Princeton Univ. Press, 1990.
34. R. Morales-Menendez, N. de Freitas, and D. Poole, "Real- timemonitoring of complex industrial processes with particle filters," in Proc. Neural Inf. Process. Syst., 2002, pp. 1-8.
35. Y. Nesterov, "Primal-dual subgradient methods for convex problems," Center Operations Res. Econometrics, Catholic Univ. Louvain, Louvainla-Neuve, Belgium, Tech. Rep., 2005.
36. A. Y. Ng and M. Jordan, "PEGASUS: A policy search method for large MDPs and POMDPs," in Proc. 16th Conf. Uncertainty Artif. Intell., 2000, pp. 1-10.
37. M. Ono and B. C. Williams, "An efficient motion planning algorithm for stochastic dynamic systems with constraints on probability of failure," in Proc. Conf. Decis. Control, 2008, pp. 1-9.
38. H. Pham, "On some recent aspects of stochastic control and their applications," Probability Surv., vol.2, pp. 506-549, 2005.
39. J. Pineau and G. Gordon, "POMDP planning for robust robot control," in Proc. 12th Int. Symp. Robot. Res., 2005, pp. 69-82.
40. J. Pineau, G. Gordon, and S. Thrun, "Policy-contingent abstraction for robust robot control," presented at the Conf. Uncertainty Artif. Intell., Acapulco, Mexico, 2003.
41. A. Prekopa, Stochastic Programming. Norwell, MA: Kluwer, 1995.
42. J. G. Proakis, Digital Communications. New York:McGraw-Hill, 1995.
43. M. L. Puterman, Markov Decision Processes. New York: Wiley, 1994.
44. A. Richards, J. How, T. Schouwenaars, and E. Feron, "Plume avoidance maneuver planning using mixed integer linear programming," in Proc. AIAA Guid., Navigational Control Conf., 2001, pp. 1-10.
45. C. Robert and G. Casella, Monte Carlo StatisticalMethods.. NewYork: Springer-Verlag, 1999.
46. J. S. Rosenthal, "Minorization conditions and convergence rates for Markov Chain Monte Carlo," J. Amer. Stat. Assoc., vol.90, no.430, pp. 558-566, 1995.
47. N. Roy, G. Gordon, and S. Thrun, "Planning under uncertainty for reliable health care robotics," in Proc. Int. Conf. Field Serv. Robot., 2003, pp. 417-426.
48. S. J. Russell and P. Norvig, Eds., Artificial Intelligence: A Modern Approach. Englewood Cliffs, NJ: Prentice-Hall, 2003.
49. T. Schouwenaars, B. De Moor, E. Feron, and J. How, "Mixed integer programming for multi-vehicle path planning," in Proc. Eur. Control Conf., 2001, pp. 2603-2608.
50. A. Schwarm and M. Nikolaou, "Chance-constrained model predictive control," AlChE J., vol.45, pp. 1743-1752, 1999.
51. A. Shapiro, "Stochastic programming approach to optimization under uncertainty," Math. Programming, Ser. B, vol.112, no.1, pp. 183-220, 2008.
52. S. S. Singh, N. Kantas, B. Vo, A. Doucet, and R. Evans, "Simulationbased optimal sensor scheduling with application to observer trajectory planning," Automatica, vol.43, no.5, pp. 817-830, 2007.
53. J.-J. E. Slotine and D. R. Yoerger, "The robust control of robot manipulators," Int. J. Robot. Res., vol.4, pp. 49-64, 1985.
54. R. S. Sutton, On the Significance ofMarkov Decision Processes. Berlin, Germany: Springer-Verlag, 2003, pp. 133-154.
55. S. A. Tarim, S. Manandhar, and T. Walsh, "Stochastic constraint programming: A scenario-based approach," Constraints, vol.11, pp. 53-80, 2006.
56. J. Tugnait, "Detection and estimation for abruptly changing systems," Automatica, vol.18, pp. 607-615, 1982.
57. A. N. Vargas,W. Furloni, and J. B. R. do Val, "Constrained model predictive control of jump linear systems with noise and non-observed Markov state," in Proc. Amer. Control Conf., 2006, pp. 929-934.
58. M. Vidyasagar, "Randomized algorithms for robust controller synthesis using statistical learning theory," Automatica, vol.37, pp. 1515-1528, 2000. (Pubitemid 32737008)