From model-based control to data-driven control: Survey, classification and perspective

Information Sciences

Volumn 235, Issue , 2013, Pages 3-35

  Hou, Zhong Sheng ^a   Wang, Zhuo ^b  

^a BEIJING JIAOTONG UNIVERSITY   (China)

^b 1120 Science and Engineering Offices   (United States)

Author keywords

Classification; Data based control; Data driven control; Perspective; Survey

Indexed keywords

ANALYSIS AND DESIGN; DATA-DRIVEN CONTROL; DATA-DRIVEN OPTIMIZATION; EXISTING PROBLEMS; MODEL-BASED CONTROL; PERSPECTIVE; RESEARCH TOPICS; STATE OF THE ART;

CLASSIFICATION (OF INFORMATION); SURVEYS;

DIGITAL STORAGE;

EID: 84875920126     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2012.07.014     Document Type: Article

References (155)

1. D.W. Aha, D. Kibler, and M. Albert Instance-based learning algorithms Machine Learning 6 1 1991 37 66
2. D.W. Aha Editorial: lazy learning Artificial Intelligence Review 11 1-5 1997 1 6
3. H.S. Ahn, Y.Q. Chen, and K.L. Moore Iterative learning control: brief survey and categorization IEEE Transactions on Systems, Man, and Cybernetics-Part C: Applications and Reviews 37 6 2007 1099 1121
4. A. Al-Tamimi, F.L. Lewis, and M. Abu-Khalaf Model-free Q-learning designs for linear discrete-time zero-sum games with application to H-infinity control Automatica 43 3 2007 473 481
5. P. Albertos, and A. Sala Iterative Identification and Control 2002 Springer-Verlag London, UK
6. B.D.O. Anderson Failures of adaptive control theory and their resolution Communications in Information and Systems 5 1 2005 1 20
7. B.D.O. Anderson, A. Dehghani, Historical, generic and current challenges of adaptive control, in: Proc. of Third IFAC Workshop on Periodic Control Systems, Anichkov Palace, Russia, 2007.
8. B.D.O. Anderson, and A. Dehghani Challenges of adaptive control-past, permanent and future Annual Reviews in Control 32 2008 123 135
9. S. Arimoto, S. Kawamura, and F. Miyazaki Bettering operation of robots by learning Journal of Robotic Systems 1 2 1984 123 140
10. K.J. Astrom, T. Hagglund, and A. Wallenborg Automatic Tuning of PID Controllers 1988 Instrument Society of America North Carolina
11. K.J. Astrom, T. Hagglund, C.C. Hang, and W.K. Ho Automatic tuning and adaptation for PID controllers-a survey Control Engineering Practice 1 4 1993 699 714
12. K.J. Astrom, and T. Hagglund PID Controllers: Theory Design and Tuning second ed. 1995 Instrument Society of America North Carolina
13. C.G. Atkeson, A.W. Moore, and S. Schaal Locally weighted learning for control Artificial Intelligence Review 11 1-5 1997 75 113
14. S. Baldi, G. Battistelli, E. Mosca, and P. Tesi Multi-model unfalsified adaptive switching supervisory control Automatica 46 2 2010 249 259
15. G. Battistelli, J. Hespanha, E. Mosca, P. Tesi, Unfalsified adaptive switching supervisory control of time varying systems, in: Proc. of the 48th IEEE Conference on Decision and Control and Held Jointly with the 28th Chinese Control Conference, Shanghai, China, 2009, pp. 805-810.
16. G. Battistelli, E. Mosca, M.G. Safonov, and P. Tesi Stability of unfalsified adaptive switching control in noisy environments IEEE Transactions on Automatic Control 55 10 2010 2424 2429
17. D.P. Bertsekas, and J.N. Tsitsiklis Neuro-Dynamic Programming 1996 Athena Scientific MA
18. G. Bontempi, M. Birattari, and H. Bersini Lazy learning for modeling and control design International Journal of Control 72 7/8 1999 643 658
19. G. Bontempi, and M. Birattari From linearization to lazy learning: a survey of divide-and-conquer techniques for nonlinear control International Journal of Computational Cognition 3 1 2005 56 73
20. A. Boulkroune, M. M' Saad, and H. Chekireb Design of a fuzzy adaptive controller for MIMO nonlinear time-delay systems with unknown actuator nonlinearities and unknown control direction Information Sciences 180 2010 5041 5059
21. S.J. Bradtke, B.E. Ydstie, A.G. Barto, Adaptive linear quadratic control using policy iteration, in: Proc. of the 1994 American Control Conference, Baltimore, USA, 1994, pp. 3475-3479.
22. M.W. Braun, D.E. Rivera, and A. Stenman A model-on-demand identification methodology for nonlinear process systems International Journal of Control 74 18 2001 1708 1717
23. X.H. Bu, Z.S. Hou, The robust stability of model free adaptive control with data dropouts, in: Proc. of the 8th IEEE International Conference on Control and Automation (ICCA), Xiamen, China, 2010, pp. 1606-1611.
24. X.H. Bu, Z.S. Hou, S.T. Jin, A statistical analysis of model free adaptive control with measurement disturbance, in: Proc. of the 29th Chinese Control Conference (CCC), Beijing, China, 2010, pp. 2175-2181.
25. M.C. Campi, A. Lecchini, and S.M. Savaresi Virtual reference feedback tuning: a direct method for the design of feedback controllers Automatica 38 8 2002 1337 1346
26. M.C. Campi, A. Lecchini, and S.M. Savaresi An application of the virtual reference feedback tuning (VRFT) method to a benchmark active suspension system European Journal of Control 9 2003 66 76
27. M.C. Campi, and S.M. Savaresi Direct nonlinear control design: the virtual reference feedback tuning (VRFT) approach IEEE Transactions on Automatic Control 51 1 2006 14 27
28. Y. Cang, B. Gao, and K.Y. Gu A model-free adaptive control to a blood pump based on heart rate ASAIO Journal 57 4 2011 262 267
29. T.Y. Chai, D.R. Liu (Eds.), Special Issue on Data-driven Based Control, Decision, Scheduling and Fault Diagnosis, Acta Automatica Sinica 35 (6) (2009).
30. T.Y. Chai, Z.S. Hou, F.L. Fewis, A. Hussain (Eds.), Special Section on Data-Based Control, Modeling, and Optimization, IEEE Transactions on Neural Networks 22 (12) (2011).
31. C.J. Chen A discrete iterative learning control for a class of nonlinear time-varying systems IEEE Transactions on Automatic Control 43 5 1998 748 752
32. L. Chen, L.J. Zou, and L. Tu A clustering algorithm for multiple data streams based on spectral component similarity Information Sciences 183 2012 35 47
33. Y.Q. Chen Iterative Learning Control: Convergence Robustness and Applications 1999 Springer-Verlag New York
34. Q.M. Cheng, Y.M. Cheng, M.M. Wang, and Y.F. Wang Simulation study on model-free adaptive control based on grey prediction in ball mill load control Chinese Journal of Scientific Instrument 32 1 2011 87 92
35. R.H. Chi, and Z.S. Hou Dual-stage optimal iterative learning control for nonlinear non-affine discrete-time systems Acta Automatica Sinica 33 10 2007 1061 1065
36. R.H. Chi, Z.S. Hou, Model-free periodic adaptive control for a class of SISO nonlinear discrete-time systems, in: Proc. of the 8th IEEE International Conference on Control and Automation (ICCA), Xiamen, China, 2010, pp. 1623-1628.
37. L.S. Coelho, and A.A.R. Coelho Model-free adaptive control optimization using a chaotic particle swarm approach Chaos, Solitons and Fractals 41 4 2009 2001 2009
38. Y. Fujisaki, Y. Duan, M. Ikcda, System representation and optimal control in input-output data space, in: Proc. of the 10th IFAC Symposium on Large Scale Systems, Osaka, Japan, 2004, pp. 197-202.
39. B. Gao, K.Y. Gu, Y. Zeng, and Y. Chang An anti-suction control for an intra-aorta pump using blood assistant index: a numerical simulation Artificial Organs 2011
40. M. Gevers Modelling, identification and control P. Albertos, A. Sala, Iterative Identification and Control Design 2002 Springer-Verlag 3 16
41. A.E. Graham, A.J. Young, and S.Q. Xie Rapid tuning of controllers by IFT for profile cutting machines Mechatronics 17 2-3 2007 121 128
42. G.O. Guardabassi, and S.M. Savaresi Virtual reference direct design method: an off-line approach to data-based control system design IEEE Transactions on Automatic Control 45 5 2000 954 959
43. W.H. Gui, Data-driven based nonferrous metallurgical process optimal control research and application, in: Technical Report of the 33rd Shuangqing Forum of National Natural Science Foundation of China on Data-driven Based Control, Decision, Scheduling and Fault Diagnosis, Beijing, China, 2008.
44. G. Gybenko Just-in-time learning and estimation S. Bittanti, G. Picci, Identification, Adaptation, Learning: The Science of Learning Models From Data 1996 Springer New York 423 434
45. R. Hildebrand, A. Lecchini, G. Solari, and M. Gevers Prefiltering in iterative feedback tuning: optimization of the prefilter for accuracy IEEE Transactions on Automatic Control 49 10 2004 1801 1806
46. R. Hildebrand, A. Lecchini, G. Solari, and M. Gevers Optimal prefiltering in iterative feedback tuning IEEE Transactions on Automatic Control 50 8 2005 1196 1200
47. H. Hjalmarsson, S. Gunnarsson, M. Gevers, A convergent iterative restricted complexity control design scheme, in: Proc. of the 33rd IEEE Conference on Decision and Control, Orlando, USA, 1994, pp. 1735-1740.
48. H. Hjalmarsson, Control of nonlinear systems using iterative feedback tuning, in: Proc. of the 1998 IEEE American Control Conference, Philadephia, USA, 1998, pp. 2083-2087.
49. H. Hjalmarsson, M. Gevers, S. Gunnarsson, and O. Lequin Iterative feedback tuning: theory and applications IEEE Control Systems Magazine 18 4 1998 26 41
50. H. Hjalmarsson Efficient tuning of linear multivariable controllers using iterative feedback tuning International Journal of Adaptive Control and Signal Processing 13 7 1999 553 572
51. H. Hjalmarsson Iterative feedback tuning-an overview International Journal of Adaptive Control and Signal Processing 16 5 2002 373 395
52. Z.S. Hou, The Parameter Identification, Adaptive Control and Model Free Learning Adaptive Control for Nonlinear Systems, PhD dissertation, Northeastern University, Shengyang, China, 1994.
53. Z.S. Hou, W.H. Huang, The model-free learning adaptive control of a class of SISO nonlinear systems, in: Proc. of the 1997 IEEE American Control Conference, Albuquerque, USA, 1997, pp. 343-344.
54. Z.S. Hou, C.W. Han, W.H. Huang, The model free learning adaptive control of a class of MISO nonlinear discrete time systems, in: Proc. of the 1998 IFAC Low Cost Automation, Shanghai, China, 1998, pp. 227-232.
55. Z.S. Hou Nonparametric Models and Its Adaptive Control Theory 1999 Science Press Beijing
56. Z.S. Hou On model-free adaptive control: the state of the art and perspective Control Theory and Applications 23 4 2006 586 592
57. Z.S. Hou, and J.X. Xu A new feedback-feedforward configuration for the iterative learning control of a class of discrete-time systems Acta Automatica Sinica 33 3 2007 323 326
58. Z.S. Hou, J.X. Xu, and H.W. Zhong Freeway traffic control using iterative learning control based ramp metering and speed signaling IEEE Transactions on Vehicular Technology 56 2 2007 466 477
59. Z.S. Hou, J.X. Xu, and J.W. Yan An iterative learning approach for density control of freeway traffic flow via ramp metering Transportation Research Part C 16 1 2008 71 97
60. Z.S. Hou, and J.X. Xu On data-driven control theory: the state of the art and perspective Acta Automatica Sinica 35 6 2009 650 667
61. Z.S. Hou, and J.W. Yan Model free adaptive control based freeway ramp metering with feed-forward iterative learning controller Acta Automatica Sinica 35 5 2009 588 595
62. Z.S. Hou, and J.W. Yan Convergence analysis of learning-enhanced PID control system Control Theory & Applications 27 6 2010 761 768
63. Z.S. Hou, and X.H. Bu Model free adaptive control with data dropouts Expert Systems with Applications 38 8 2011 10709 10717
64. Z.S. Hou, and S.T. Jin A novel data-driven control approach for a class of discrete-time nonlinear systems IEEE Transactions on Control Systems Technology 19 6 2011 1549 1558
65. Z.S. Hou, and S.T. Jin Data driven model-free adaptive control for a class of MIMO nonlinear discrete-time systems IEEE Transactions on Neural Networks 22 12 2011 2173 2188 Special Issue on Data-based control, modeling, and optimization
66. B. Huang, and R. Kadali Dynamic Modeling Predictive Control and Performance Monitoring: A Data-Driven Subspace Approach 2008 Springer London
67. S. Hur, M. Park, and H. Rhee Design and application of model-on-demand predictive controller to a semibatch copolymerization reactor Industrial & Engineering Chemistry Research 42 4 2003 847 859
68. J.K. Huusom, N.K. Poulsen, and S.B. Jørgensen Improving convergence of iterative feedback tuning Journal of Process Control 19 4 2009 570 578
69. M. Ikeda, Y. Fujisaki, and N. Hayashi A model-less algorithm for tracking control based on input-output data Nonlinear Analysis 47 3 2001 1953 1960
70. R.E. Kalman A new approach to linear filtering and prediction problems, transactions ASME, series D Journal of Basic Engineering 82 1960 34 45
71. R.E. Kalman Contributions to the theory of optimal control Boletin de la Sociedad Matematica Mexicana 5 2009 102 119
72. L.C. Kammer, R.R. Bitmead, and P.L. Bartlett Direct iterative tuning via spectral analysis Automatica 36 9 2000 1301 1307
73. Y. Kansha, Y. Hashimoto, and M.-S. Chiu New results on VRFT design of PID controller Chemical Engineering Research and Design 86 8 2008 925 931
74. A. Karimi, L. Miskovic, D. Bonvin, Convergence analysis of an iterative correlation-based controller tuning method, in: Proc. of the 15th IFAC World Congress, Barcelona, Spain, 2002, pp. 1546-1551.
75. A. Karimi, L. Miskovic, and D. Bonvin Iterative correlation-based controller tuning with application to a magnetic suspension system Control Engineering Practice 11 6 2003 1069 1078
76. A. Karimi, K. Van Heusden, D. Bonvin, Non-iterative data-driven controller tuning using the correlation approach, in: Proc. of the European Control Conference, Kos, Greece, 2007.
77. T. Katayama Subspace Methods For System Identification 2005 Springer Heidelberg
78. J.H. Kim, and F.L. Lewis Model-free H[infinity] control design for unknown linear discrete-time systems via Q-learning with LMI Automatica 46 8 2010 1320 1326
79. S. Kissling, P. Blanc, P. Myszkorowski, and I. Vaclavik Application of iterative feedback tuning (IFT) to speed and position control of a servo drive Control Engineering Practice 17 7 2009 834 840
80. M. Kobayashi, Y. Konishi, and H. Ishigaki A lazy learning control method using support vector regression International Journal of Innovative Computing Information and Control 3 6B 2007 1511 1523
81. H.N. Koivo, J.T. Tanttu, Tuning of PID controllers: survey of SISO and MIMO techniques, in: Proc. of the IFAC Intelligent Tuning and Adaptive Control symposium, Singapore, 1991, pp. 75-80.
82. T.Y. Kuc, J.S. Lee, and K. Nam An iterative learning control theory for a class of nonlinear dynamic systems Automatica 28 6 1992 1215 1221
83. W. Larimore Statistical optimality and canonical variable analysis system identification Signal Processing 52 2 1996 131 144
84. J.M. Lee, and J.H. Lee Approximate dynamic programming-based approaches for input-output data-driven control of nonlinear processes Automatica 41 7 2005 1281 1288
85. J.K. Lim, J.M. Lim, K. Yoshimoto, K.H. Kim, and T. Takahashi Designing guide-path networks for automated guided vehicle system by using the Q-learning technique Computers & Industrial Engineering 44 1 2003 1 17
86. L. Ljung System Identification: Theory for the User 1987 Prentice-Hall Englewood Cliffs
87. X.P. Lu, W. Li, and Y.G. Lin Load control of wind turbine based on model free adaptive controller Transactions of the Chinese Society of Agricultural Machinery 42 2 2011 109 114
88. F.L. Lv, H.B. Chen, C.J. Fan, and S.B. Chen A novel control algorithm for weld pool control Industrial Robot: An International Journal 37 1 2010 89 96
89. I. Markovsky, J. Willems, P. Rapisarda, B. De Moor, Data driven simulation with applications to system identification, in: Proc. of the 16th IFAC World Congress, Prague, Czech Republic, 2005.
90. I. Markovsky, J. Willems, S. Van Huffel, and B. De Moor Exact and approximate modeling of linear systems: a behavioral approach R. Haberman, Monographs on Mathematical Modeling and Computation 2006 SIAM Society for Industrial and Applied Mathematics Philadelphia
91. I. Markovsky, and P. Rapisarda Data-driven simulation and control International Journal of Control 81 12 2008 1946 1959
92. L. Miskovic, A. Karimi, and D. Bonvin Correlation-based tuning of a restricted-complexity controller for an active suspension system European Journal of Control 9 1 2003 77 83
93. L. Miskovic, Data-Driven Controller Tuning Using The Correlation Approach, PhD dissertation, University of Belgrade, 2006.
94. L. Miskovic, A. Karimi, D. Bonvin, and M. Gevers Correlation-based tuning of decoupling multivariable controllers Automatica 43 9 2007 1482 1494
95. M. Moonen, B.D. Moor, L. Vandenberghe, and J. Vandewalle On-and off-line identification of linear state-space models International Journal of Control 49 1 1989 219 232
96. K.L. Moore Iterative Learning Control for Deterministic Systems 1993 Springer-Verlag New York
97. M. Nakamoto, An application of the virtual reference feedback tuning for an MIMO process, in: The SICE 2004 Annual Conference, 2004, pp. 2208-2213.
98. P.V. Overschee, and B.D. Moor Subspace Identification for Linear Systems: Theory Implementation Applications 1996 Kluwer Academic Publishers Dordrecht
99. T.H. Pan, S.Y. Li, and W.J. Cai Lazy learning-based online identification and adaptive PID control: a case study for CSTR process Industrial & Engineering Chemistry Research 46 2 2007 472 480
100. T.H. Pan, and S.Y. Li A hierarchical search and updating database strategy for lazy learning International Journal of Innovative Computing Information and Control 4 6 2008 1383 1392
101. S.E. Papadakis, and V.G. Kaburlasos Piecewise-linear approximation of non-linear models based on probabilistically/possibilistically interpreted intervals' numbers (INs) Information Sciences 180 24 2010 5060 5076
102. K.H. Park, Y.J. Kim, and J.H. Kim Modular Q-learning based multi-agent cooperation for robot soccer Robotics and Autonomous Systems 35 2 2001 109 122
103. U.S. Park, and M. Ikeda Stability analysis and control design of LTI discrete-time systems by the direct use of time series data Automatica 45 5 2009 1265 1271
104. R.E. Precup, S. Preitl, I.J. Rudas, M.L. Tomescu, and J.K. Tar Design and experiments for a class of fuzzy controlled servo systems ASME Transactions on Mechatronics 13 1 2008 22 35
105. F. Previdi, T. Schauer, S.M. Savaresi, and K.J. Hunt Data-driven control design for neuroprotheses: a virtual reference feedback tuning (VRFT) approach IEEE Transactions on Control Systems Technology 12 1 2004 176 182
106. F. Previdi, M. Ferrarin, S.M. Savaresi, and S. Bittanti Closed-loop control of FES supported standing up and sitting down using virtual reference feedback tuning Control Engineering Practice 13 9 2005 1173 1182
107. F. Previdi, F. Fico, D. Belloli, S.M. Savaresi, I. Pesenti, C. Spelta, Virtual Reference Feedback Tuning (VRFT) of velocity controller in self-balancing industrial manual manipulators, in: Proc. of the American Control Conference (ACC), Baltimore, MD, 2010, pp. 1956-1961.
108. C.E. Rohrs, L. Valavani, M. Athans, G. Stein, Robustness of adaptive control algorithms in the presence of unmodeled dynamics, in: Proc. of the 21st IEEE Conference on Decision and Control, Orlando, USA, 1982, pp. 3-11.
109. C.E. Rohrs, L. Valavani, M. Athans, and G. Stein Robustness of continuous-time adaptive control algorithms in the presence of unmodeled dynamics IEEE Transactions on Automatic Control 30 9 1985 881 889
110. M.G. Safonov, and T.C. Tsao The unfalsified control concept: a direct path from experiment to controller B.A. Francis, A.R. Tannenbaum, Feedback Control Nonlinear Systems and Complexity 1995 Springer-Verlag Berlin 196 214
111. M.G. Safonov, and T.C. Tsao The unfalsified control concept and learning IEEE Transactions on Automatic Control 42 6 1997 843 847
112. M.G. Safonov, Data-driven robust control design: unfalsified control, 2003. < http://routh.usc.edu /pub/safonov/safo03i.pdf>.
113. A. Sala, and A. Esparza Extensions to virtual reference feedback tuning: a direct method for the design of feedback controllers Automatica 41 8 2005 1473 1476
114. A. Sala Integrating virtual reference feedback tuning into a unified closed-loop identification framework Automatica 43 1 2007 178 183
115. S. Schaal, and C.G. Atkeson Robot juggling: implementation of memory-based learning IEEE Control Systems Magazine 14 1 1994 57 71
116. C. Schaper, W. Larimore, D. Seborg, and D. Mellichamp Identification of chemical processes using canonical variable analysis Computers and Chemical Engineering 18 1 1994 55 69
117. J. Sivag, A. Datta, and S.P. Bhattacharyya New results on the synthesis of PID controllers IEEE Transactions on Automatic Control 47 2 2002 241 252
118. J. Sjoberg, M. Agarwal, Nonlinear controller tuning based on linearized time-variant model, in: Proc. of the 1997 American Control Conference, 1997, pp. 3336-3340.
119. J. Sjoberg, F. De Bruyne, M. Agarwal, B.D.O. Anderson, M. Gevers, F.J. Kraus, and N. Linard Iterative controller optimization for nonlinear systems Control Engineering Practice 11 9 2003 1079 1086
120. J. Sjoberg, P.-O. Gutman, M. Agarwal, and M. Bax Nonlinear controller tuning based on a sequence of identifications of linearized time-varying models Control Engineering Practice 17 2 2009 311 321
121. R.E. Skelton Model error concepts in control design International Journal of Control 49 5 1989 1725 1753
122. W.D. Smart, L.P. Kaelbling, Practical reinforcement learning in continuous spaces, in: Proc. of the 17th International Conference on Machine Learning, Stanford, CA, 2000, pp. 903-910.
123. J.C. Spall, SPSA Algorithm, < www.jhuapl.edu/spsa/ >.
124. J.C. Spall Multivariate stochastic approximation using a simultaneous perturbation gradient approximation IEEE Transactions on Automatic Control 37 3 1992 332 341
125. J.C. Spall, J.A. Cristion, Model-free control of general discrete-time systems, in: Proc. of the 32rd IEEE Conference on Decision and Control, San Antonio, USA, 1993, pp. 2792-2797.
126. J.C. Spall, and D.C. Chin Traffic-responsive signal timing for system-wide traffic control Transportation Research Part C 5 3-4 1997 153 163
127. J.C. Spall, and J.A. Cristion Model-free control of nonlinear stochastic systems with discrete-time measurements IEEE Transactions on Automatic Control 43 9 1998 1198 1210
128. J.C. Spall Adaptive stochastic approximation by the simultaneous perturbation method IEEE Transactions on Automatic Control 45 10 2000 1839 1853
129. J.C. Spall Feedback and weighting mechanisms for improving Jacobian estimates in the adaptive simultaneous perturbation algorithm IEEE Transactions on Automatic Control 54 6 2009 1216 1229
130. M.X. Sun, and B.J. Huang Iterative Learning Control 1998 National Defence Industry Press Beijing
131. K.K. Tan, T.H. Lee, S.N. Huang, and F.M. Leu Adaptive predictive control of a class of SISO nonlinear systems Dynamics and Control 11 2 2001 151 174
132. M. Uchiyama Formulation of high-speed motion pattern of a mechanical arm by trial Control Engineering 14 6 1978 706 712
133. J. Van Helvoort, Unfalsified Control: Data-Driven Control Design for Performance Improvement, PhD dissertation, Technische Universiteit Eindhoven, Eindhoven, Netherlands, 2007.
134. J. Van Helvoort, B. de Jager, and M. Steinbuch Direct data-driven recursive controller unfalsification with analytic update Automatica 43 12 2007 2034 2046
135. J. Van Helvoort, B. de Jager, and M. Steinbuch Data-driven multivariable controller design using ellipsoidal unfalsified control Systems & Control Letters 57 9 2008 759 762
136. J. Van Helvoort, B. de Jager, and M. Steinbuch Data-driven controller unfalsification with analytic update applied to a motion system IEEE Transactions on Control Systems Technology 16 6 2008 1207 1217
137. K. Van Heusden, A. Karimi, D. Bonvin, Data-driven controller tuning with integrated stability constraint, in: Proc. of the 47th IEEE Conference on Decision and Control, Cancun, Mexico, 2008, pp. 2612-2617.
138. K. Van Heusden, Non-Iterative Data-Driven Model Reference Control, PhD dissertation, Ecole Polytechnique Federale de Lausanne, Lausanne, Switzerland, 2010.
139. M. Verhaegen Identification of the deterministic part of MIMO state space models given in innovations form from input-output data Automatica 30 1 1994 61 74
140. H.B. Wang, and Q.F. Wang Nonparametric model adaptive control for underwater towed heave compensation system Control Theory & Application 27 4 2010 513 516
141. R.R. Wang, M.G. Safonov, The Comparison of Unfalsified Control and Iterative Feedback Tuning, University of Southern California, USA, 2002.
142. R.R. Wang, A. Pau, M. Stefanovic, and M.G. Safonov Cost detectability and stability of adaptive control systems International Journal of Robust and Nonlinear Control 17 5-6 2007 549 561
143. W. Wang, J.T. Zhang, and T.Y. Chai A survey of advanced PID parameter tuning methods Acta Automatica Sinica 26 3 2000 347 355
144. C. Watkins, Learning From Delayed Rewards, PhD dissertation, Cambridge University, Cambridge, England, 1989.
145. C. Watkins, and P. Dayan Q-learning Machine Learning 8 1992 279 292
146. A. Weissensteiner A Q-learning approach to derive optimal consumption and investment strategies IEEE Transactions on Neural Networks 20 8 2009 1234 1243
147. P.J. Werbos A menu of designs for reinforcement learning over time W.T. Miller III R.S. Sutton, P.J. Werbos, Neural Networks for Control 1991 MIT Press MA 67 95
148. P.J. Werbos Approximate dynamic programming for real-time control and neural modeling D.A. White, D.A. Sofge, Handbook of Intelligent Control 1992 Van Nostrand Reinhold New York
149. J.X. Xu Linear and Nonlinear Iterative Learning Control 2003 Springer Verlag Berlin
150. J.X. Xu, and Z.S. Hou On learning control: the state of the art and perspective Acta Automatica Sinica 31 6 2005 943 955
151. J.X. Xu, and Z.S. Hou Notes on data-driven system approaches Acta Automatica Sinica 35 6 2009 668 675
152. S. Yabui, K. Yubai, J. Hirai, Direct design of switching control system by VRFT-application to vertical-type one-link arm, in: Proc. of the 2007 SICE Annual Conference, Kagawa, Japan, 2007, pp. 120-123.
153. B. Zhang, and W.D. Zhang Adaptive predictive functional control of a class of nonlinear systems ISA Transactions 45 2 2006 175 183
154. Z.J. Zhou, C.H. Hu, D.L. Xu, J.B. Yang, and D.H. Zhou New model for system behavior prediction based on belief rule based systems Information Sciences 180 2010 4834 4864
155. J.G. Ziegler, and N.B. Nichols Optimum settings for automatic controllers Transactions of the ASME 64 1942 759 768