Provably safe and robust learning-based model predictive control

Automatica

Volumn 49, Issue 5, 2013, Pages 1216-1226

  Aswani, Anil ^a   Gonzalez, Humberto ^b   Sastry, S Shankar ^a   Tomlin, Claire ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b WASHINGTON UNIVERSITY IN ST LOUIS   (United States)

Author keywords

Learning control; Predictive control; Robustness; Safety analysis; Statistics

Indexed keywords

DETERMINISTIC GUARANTEE; IDENTIFICATION TOOLS; IMPROVE PERFORMANCE; LEARNING CONTROL; OPTIMIZATION FRAMEWORK; PREDICTIVE CONTROL; SAFETY ANALYSIS; STATE AND INPUT CONSTRAINTS;

LINEAR CONTROL SYSTEMS; MODEL CHECKING; MODEL PREDICTIVE CONTROL; ROBUSTNESS (CONTROL SYSTEMS); STATISTICAL MECHANICS; STATISTICS;

PREDICTIVE CONTROL SYSTEMS;

EID: 84876691099     PISSN: 00051098     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.automatica.2013.02.003     Document Type: Article

References (75)

1. P. Abbeel, A. Coates, and A. Ng Autonomous helicopter aerobatics through apprenticeship learning International Journal of Robotics Research 29 13 2010 1608 1639
2. V. Adetola, and M. Guay Robust adaptive MPC for constrained uncertain nonlinear systems International Journal of Adaptive Control and Signal Processing 25 2 2011 155 167
3. C. Anderson, P. Young, M. Buehner, J. Knight, K. Bush, and D. Hittle Robust reinforcement learning control using integral quadratic constraints for recurrent neural networks IEEE Transactions on Neural Networks 18 4 2007 993 1002
4. Asarin, E., Bournez, O., Dang, T., & Maler, O. (2000). Approximate reachability analysis of piecewise-linear dynamical systems. In HSCC 2000 (pp. 20-31).
5. Asarin, E., Dang, T., & Girard, A. (2003). Reachability analysis of nonlinear systems using conservative approximation. In HSCC 2003 (pp. 20-35).
6. K.J. Aström, and B. Wittenmark Adaptive control 1995 Addison-Wesley
7. Aswani, A., Bickel, P., & Tomlin, C. (2009). Statistics for sparse, high-dimensional, and nonparametric system identification. In ICRA (pp. 2133-2138).
8. A. Aswani, P. Bickel, and C. Tomlin Regression on manifolds: estimation of the exterior derivative Annals of Statistics 39 1 2010 48 81
9. Aswani, A., Bouffard, P., & Tomlin, C. (2012). Extensions of learning-based model predictive control for real-time application to a quadrotor helicopter. In ACC (pp. 4661-4666).
10. Aswani, A., Gonzalez, H., Sastry, S., & Tomlin, C. (2012). Statistical results on filtering and epi-convergence for learning-based model predictive control. Technical report. http://arxiv.org/abs/1208.0864.
11. Aswani, A., Guturu, H., & Tomlin, C. (2009). System identification of hunchback protein patterning in early drosophila embryogenesis. In CDC (pp. 7723-7728).
12. A. Aswani, N. Master, J. Taneja, D. Culler, and C. Tomlin Reducing transient and steady state electricity consumption in hvac using learning-based model-predictive control Proceedings of the IEEE 100 1 2011 240 253
13. Aswani, A., Master, N., Taneja, J., Krioukov, A., Culler, D., & Tomlin, C. (2012). Energy-efficient building HVAC control using hybrid system LBMPC. In IFAC nonlinear model predictive control conference (pp. 496-501).
14. Aswani, A., & Tomlin, C. (2007). Reachability algorithm for biological piecewise-affine hybrid systems. In HSCC 2007 (pp. 633-636).
15. A. Barto, and T. Dietterich Reinforcement learning and its relationship to supervised learning Handbook of learning and approximate dynamic programming 2004 Wiley-IEEE Press
16. C. Berge Topological spaces 1963 Oliver and Boyd, Ltd.
17. P. Bickel On adaptive estimation Annals of Statistics 10 3 1982 647 671
18. L. Biegler, G. Biros, O. Ghattas, M. Heinkenschloss, D. Keyes, and B. Mallick Large-scale inverse problems and quantification of uncertainty 2011 John Wiley & Sons
19. Borelli, F., Bemporad, A., & Morari, M. (2009). Constrained optimal control and predictive control for linear and hybrid systems (in preparation).
20. Bouffard, P., Aswani, A., & Tomlin, C. (2012). Learning-based model predictive control on a quadrotor: onboard implementation and experimental results. In ICRA (pp. 279-284).
21. L. Chisci, J. Rossiter, and G. Zappa Systems with presistent disturbances: predictive control with restricted constraints Automatica 37 2001 1019 1028
22. L. Chisci, and G. Zappa Dual mode predictive tracking of piecewise constant references for constrained linear systems International Journal of Control 76 1 2003 61 72
23. Chutinan, A., & Krogh, B. (1999). Verification of polyhedral-invariant hybrid automata using polygonal flow pipe approximations. In HSCC (pp. 76-90).
24. B. Efron Estimating the error rate of a prediction rule: some improvements on cross-validation Journal of the American Statistical Association 78 1983 316 331
25. A. Epstein, J. Ffowcs Williams, and E. Greitzer Active supression of aerodynamic instabilities in turbomachines Journal of Propulsion and Power 5 2 1989 204 211
26. P. Falcone, F. Borrelli, H. Tseng, J. Asgari, and D. Hrovat Linear time-varying model predictive control and its application to active steering systems International Journal of Robust and Nonlinear Control 18 2008 862 875
27. A. Fiacco Sensitivity analysis for nonlinear programming using penalty methods Mathematical Programming 10 1976 287 311
28. H. Fukushima, T.H. Kim, and T. Sugie Adaptive model predictive control for a class of constrained linear systems based on the comparison model Automatica 43 2 2007 301 308
29. P. Gill, W. Murray, and M. Saunders SNOPT: an SQP algorithm for large-scale constrained optimization SIAM Review 47 1 2005 99 131
30. G. Grimm, M. Messina, S. Tuna, and A. Teel Examples when nonlinear model predictive control is nonrobust Automatica 40 10 2004 1729 1738
31. L. Györfi, M. Kohler, A. Krzyzak, and H. Walk Neural networks estimates A distribution-free theory of nonparametric regression 2002 Springer New York 297 328
32. A.E. Hoerl, and R.W. Kennard Ridge regression: biased estimation for nonorthogonal problems Technometrics 8 1970 27 51
33. Hoffmann, Gabriel M., Waslander, Steven L, & Tomlin, Claire J. (2008). Quadrotor helicopter trajectory tracking control. In 2008 AIAA guidance, navigation and control conference and exhibit. Honolulu, Hawaii, USA, August.
34. R. Jennrich Asymptotic properties of non-linear least squares estimators Annals of Mathematical Statistics 40 1969 633 643
35. Z.-P. Jiang, and Y. Wang Input-to-state stability for discrete-time nonlinear systems Automatica 37 6 2001 857 869
36. Zhong-Ping Jiang, and Yuang Wang A converse Lyapunov thoerem for discrete-time systems with disturbances Systems and Control Letters 45 2002 49 58
37. I. Kolmanovsky, and E. Gilbert Theory and computation of disturbance invariant sets for discrete-time linear systems Mathematical Problems in Engineering 4 1998 317 367
38. M. Kothare, B. Mettler, M. Morari, P. Bendotti, and C.-M. Falinower Level control in the steam generator of a nuclear power plants IEEE Transactions on Control Systems Technology 8 1 2000 55 69
39. Krstić, M., & Kokotović, P. (1995). Lean backstepping design for a jet engine compressor model. In CCA (pp. 1047-1052). September.
40. Kvasnica, M., Grieder, P., & Baotić, M. (2004). Multi-parametric toolbox (MPT).
41. T. Lai, H. Robbins, and C. Wei Strong consistency of least squares estimates in multiple regression II Journal of Multivariate Analysis 9 1979 343 361
42. W. Langson, I. Chryssochoos, S. Raković, and D. Mayne Robust model predictive control using tubes Automatica 40 1 2004 125 133
43. D. Limon, T. Alamo, D. Raimondo, D. de la Peña, J. Bravo, and A. Ferramosca Input-to-state stability: a unifying framework for robust model predictive control Lalo Magni, Davide Raimondo, Frank Allgöwer, Nonlinear model predictive control Lecture notes in control and information sciences Vol. 384 2009 Springer Berlin, Heidelberg 1 26
44. D. Limon, I. Alvarado, T. Alamo, and E.F. Camacho MPC for tracking piecewise constant references for constrained linear systems Automatica 44 9 2008 2382 2387
45. D. Limon, I. Alvarado, T. Alamo, and E. Camacho Robust tube-based MPC for tracking of constrained linear systems with additive disturbances Journal of Process Control 20 3 2010 248 260
46. L. Ljung System identification: theory for the user 1987 Prentice-Hall
47. L. Ljung, H. Hjalmarsson, and H. Ohlsson Four encounters with system identification European Journal of Control 17 5-6 2011 449 471
48. L. Magni, and R. Scattolini Robustness and robust design of MPC for nonlinear discrete-time systems Assessment and future directions of nonlinear model predictive control 2007 Springer 239 254
49. E. Malinvaud The consistency of nonlinear regressions Annas of Mathematical Statistics 41 3 1970 956 969
50. D. Mayne, J. Rawlings, C. Rao, and P. Scokaert Constrained model predictive control: stability and optimality Automatica 36 2000 789 814
51. M. Milanese, and G. Belaforte Estimation theory and uncertainty intervals evaluation in the presence of unknown but bounded errors: linear families of models and estimates IEEE Transactions on Automatic Control 27 2 1982 408 414
52. I. Mitchell, A. Bayen, and C. Tomlin A time-dependent Hamilton-Jacobi formulation of reachable sets for continuous dynamic games IEEE Transactions on Automatic Control 50 7 2005 947 957
53. F. Moore, and E. Greitzer A theory of poststall transients in axial compressors-part I: development of the equations ASME Journal of Engineering for Gas Turbines and Power 108 1986 68 76
54. H. Müller Weighted local regression and kernel methods for nonparametric curve fitting Journal of the American Statistical Association 82 1987 231 238
55. K.S. Narendra, and K. Parthasarathy Identification and control of dynamical systems using neural networks IEEE Transactions on Neural Networks 1 1 1990 4 27
56. S.V. Raković, and M. Baric Parameterized robust control invariant sets for linear systems: theoretical advances and computational remarks IEEE Transactions on Automatic Control 55 7 2010 1599 1614
57. S. Raković, E. Kerrigan, D. Mayne, and J. Lygeros Reachability analysis of discrete-time systems with disturbances IEEE Transactions on Automatic Control 51 4 2006 546 561
58. J.B. Rawlings, and D.Q. Mayne Model predictive control theory and design 2009 Nob. Hill Pub.
59. R. Rockafellar, and R. Wets Variational analysis 1998 Springer-Verlag
60. G. Rovithakis, and M. Christodoulou Adaptive control of unknown plants using dynamical neural networks IEEE Transactions on Systems, Man, and Cybernetics 24 3 1994 400 412
61. W. Rudin Principles of mathematical analysis 2nd ed. 1964 McGraw-Hill
62. D. Ruppert, and M. Wand Multivariate locally weighted least squares regression Annals of Statistics 22 3 1994 1346 1370
63. S. Sastry Nonlinear systems: analysis, stability, and control 1999 Springer
64. S. Sastry, and M. Bodson Adaptive control: stability, convergence, and robustness 1989 Prentice-Hall
65. S. Sastry, and A. Isidori Adaptive control of linearizable systems IEEE Transactions on Automatic Control 34 11 1989 1123 1131
66. R. Schneider Convex bodies: the Brunn-Minkowski theory 1993 Cambridge University Press
67. J. Shao Linear model selection by cross-validation Journal of the American Statistical Association 88 422 1993 486 494
68. Alex J. Smola, and Bernhard Schölkopf A tutorial on support vector regression Statistics and Computing 14 2004 199 222
69. Stursberg, O., & Krogh, B. (2003). Efficient representation and computation of reachable sets for hybrid systems. In HSCC 2003 (pp. 482-497).
70. Tedrake, R. (2009). LQR-trees: feedback motion planning on sparse randomized trees. In Robotics: science and systems (pp. 17-24).
71. Tikhonov, A.N., & Arsenin, V.I.A. (1977). Solutions of ill-posed problems. In Scripta series in mathematics. Winston.
72. V.N. Vapnik An overview of statistical learning theory IEEE Transactions on Neural Networks 10 5 1999 988 999
73. S. Vogel, and P. Lachout On continuous convergence and epi-convergence of random functions. Part I: theory and relations Kybernetika 39 1 2003 75 98
74. J.X. Xu, and Y. Tan Linear and nonlinear iterative learning control 2003 Springer
75. Zakai, Alon, & Ritov, Ya'acov (2008). How local should a learning method be? In COLT (pp. 205-216).