Gaussian process approach for modelling of nonlinear systems

Engineering Applications of Artificial Intelligence

Volumn 22, Issue 4-5, 2009, Pages 522-533

  Gregorčič, Gregor ^a   Lightbody, Gordon ^b  

^a AVL LIST GMBH   (Austria)

^b UNIVERSITY COLLEGE CORK   (Ireland)

Author keywords

Gaussian processes; Hydraulic positioning system; Input space dimension; Neural networks; Nonlinear system identification

Indexed keywords

COMPUTATION LOADS; COMPUTATIONAL ISSUES; CONSTRUCTIVE LEARNING; CURSE OF DIMENSIONALITY; FUZZY MODELS; GAUSSIAN PROCESS; GAUSSIAN PROCESSES; HYDRAULIC POSITIONING SYSTEM; INPUT SPACE; INPUT SPACE DIMENSION; MODELLING TECHNIQUES; MULTIPLE MODELS; NON-LINEAR DYNAMIC SYSTEMS; NONLINEAR SYSTEM IDENTIFICATION; PARAMETRIC MODELLING; RADIAL BASIS FUNCTION NEURAL NETWORKS; RESEARCH EFFORTS;

DYNAMICAL SYSTEMS; EDUCATION; GAUSSIAN DISTRIBUTION; GAUSSIAN NOISE (ELECTRONIC); HYDRAULICS; LEARNING ALGORITHMS; NONLINEAR SYSTEMS; RADIAL BASIS FUNCTION NETWORKS;

FUZZY NEURAL NETWORKS;

EID: 67349233057     PISSN: 09521976     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.engappai.2009.01.005     Document Type: Article

References (57)

1. Ažman K., and Kocijan J. Application of Gaussian processes for black-box modelling of biosystems. ISA Transactions 46 4 (2007) 443-457
2. Abonyi J. Fuzzy Model Identification for Control (2003), Birkhäuser, Boston
3. Bailer-Jones C.A.L., Sabin T.J., MacKay D.J.C., and Withers P. Prediction of deformed and annealed microstructures using Bayesian neural networks and Gaussian processes. In: Chandra T., Leclair S.R., Meech J.A., Verma B., Smith M., and Balachandran B. (Eds). Proceedings of the Australasia Pacific Forum on Intelligent Processing and Manufacturing of Materials (1997) 913-919
4. Barnett S. Matrix Methods for Engineers and Scientists (1979), McGraw-Hill, London
5. Bishop C.M., and Tipping M.E. Variational relevance vector machines. In: Boutilier C., and Goldszmidt M. (Eds). Proceedings of the 16 th Conference on Uncertainty in Artificial Intelligence (2000) 46-53
6. Brown M.D., Irwin G.W., and Lightbody G. Local model networks for nonlinear system identification. Proceedings of the 11 th IFAC Symposium on System Identification (Invited Session), Kitakyushu, Japan (1997) 709-714
7. Dodd T.J., and Harris C.J. Identification of nonlinear time series via kernels. International Journal of System Science 33 9 (2002) 737-750
8. Faul S., Gregorčič G., Boylan G., Marnane W., Lightbody G., and Connolly S. Gaussian process modelling of EEG for the detection of neonatal seizures. IEEE Transactions on Biomedical Engineering 54 12 (2007) 2151-2162
9. Gibbs, M.N., 1997. Bayesian Gaussian processes for regression and classification. Ph.D. Thesis, Department of Physics, Cavendish Laboratory, University of Cambridge, Cambridge, UK.
10. Gibbs M., and MacKay D. Variational Gaussian process classifiers. IEEE Transactions on Neural Networks 11 6 (2000) 1458-1464
11. Gregorčič G., and Lightbody G. Internal model control based on a Gaussian process prior model. Proceedings of the 2003 American Control Conference, Denver, Colorado, USA (2003) 4981-4986
12. Gregorčič G., and Lightbody G. Gaussian process approaches to nonlinear modelling for control. In: Ruano A.E. (Ed). Intelligent Control Systems Using Computational Intelligence Techniques, IEE Control Engineering Series, vol. 70 (2005), IEE, London, UK 177-217 (Chapter 6)
13. Gregorčič G., and Lightbody G. Local model network identification with Gaussian processes. IEEE Transactions on Neural Networks 18 9 (2007) 1404-1423
14. Gregorčič, G., Lightbody, G., 2008. Nonlinear system identification: from multiple-model networks to Gaussian processes. Engineering Applications of Artificial Intelligence 21 (7), 1035-1055.
15. Hunt K.J., Johansen T.A., Kalluhl J., Fritz H., and Göttsche T. Speed control design for an experimental vehicle using a generalized gain scheduling approach. IEEE Transactions on Control Systems Technology 8 3 (2000) 381-395
16. Isaaks E.H., and Srivastava R.M. Applied Geostatistics (1998), Oxford University Press, Oxford
17. Johansen T.A., and Foss B.A. Constructing NARMAX models using ARMAX models. International Journal of Control 58 5 (1993) 1125-1153
18. Kalman R.E. A new approach to linear filtering and prediction problems. Transactions of the ASME-Journal of Basic Engineering 82 (1960) 35-45
19. Kocijan J., and Leith D.J. Derivative observations used in predictive control. Proceedings of the 12 th IEEE Mediterranean Electrotechnical Conference, MELECON 2004, Dubrovnik, Croatia (2004) 379-382
20. Kocijan J., Banko B., Likar B., Girard A., Murry-Smith R., and Rasmussen C.A. A case based comparison of identification with neural network and Gaussian process models. In: Ruano A.E. (Ed). Proceedings of the IFAC International Conference on Intelligent Control Systems and Signal Processing ICONS 2003, Faro, Portugal (2003) 137-142
21. Kocijan J., Murray-Smith R., Rasmussen C.E., and Likar B. Predictive control with Gaussian process models. Proceedings of IEEE Region 8 Eurocon 2003: Computer as a Tool, Ljubljana, Slovenia (2003) 352-356
22. Kocijan J., Murray-Smith R., Rasmussen C.E., and Girard A. Gaussian process model based predictive control. Proceedings of the 2004 American Control Conference, Boston, MA, USA (2004) 2214-2218
23. Kocijan J., Girard A., Banko B., and Murray-Smith R. Dynamic systems identification with Gaussian processes. Mathematical and Computer Modelling of Dynamical Systems 11 4 (2005) 411-424
24. Larimore W.E. Optimal reduced rank modeling, prediction, monitoring, and control using canonical variate analysis. Proceedings of the IFAC International Symposium on Advanced Control of Chemical Processes, Banff, Canada (1997) 61-66
25. Leith D.J., and Leithead W.E. Analytic framework for blended multiple model systems using linear local models. International Journal of Control 72 7/8 (1999) 605-619
26. Leith D.J., Leithead W.E., Solak E., and Murray-Smith R. Divide & conquer identification using Gaussian process priors. Proceedings of the 41 st IEEE Conference on Decision and Control, Las Vegas, Nevada, USA (2002) 624-629
27. Ljung L. System Identification: Theory for the User. 2nd ed. (1999), Prentice-Hall, Upper Saddle River, NJ
28. Lundgren A., and Sjöberg J. Gaussian processes framework for validation of linear and nonlinear models. 13 th IFAC Symposium on System Identification SYSID 2003, Rotterdam, The Netherlands (2003) 67-72
29. MacKay D.J.C. Introduction to Monte Carlo methods. In: Jordan M.I. (Ed). Learning in Graphical Models, NATO Science Series (1998), Kluwer Academic Press, Dordrecht 175-204
30. MacKay D.J.C. Introduction to Gaussian processes. In: Bishop C.M. (Ed). Neural Networks and Machine Learning, NATO ASI Series (1998), Kluwer Academic Press, Dordrecht 133-166
31. MacKay D.J.C. Information Theory, Inference and Learning Algorithms (2003), Cambridge University Press, Cambridge
32. Murray-Smith R., and Girard A. Gaussian process priors with ARMA noise models. Proceedings of The Irish Signals and Systems Conference, Maynooth, Ireland (2001) 147-152
33. Murray-Smith, R., Johansen, T.A., (Eds.) 1997. Multiple Model Approaches to Modelling and Control. Taylor & Francis, London.
34. Murray-Smith R., and Sbarbaro D. Nonlinear adaptive control using nonparametric Gaussian process models. International Federation of Automatic Control, 15 th IFAC Triennial World Congress, Barcelona, Spain (2002) 934-939
35. Murray-Smith R., Johansen T.A., and Shorten R. On transient dynamics, off-equilibrium behaviour and identification in blended multiple model structures. Proceedings of the European Control Conference, Karlsruhe, Germany (1999) BA-14
36. Murray-Smith R., Sbarbaro D., Rasmussen C.E., and Girard A. Adaptive, cautious, predictive control with Gaussian process priors. Proceedings of the 13 th IFAC Symposium on System Identification, Rotterdam, The Netherlands (2003) 1195-1200
37. Narendra K.S., and Balakrishnan J. Adaptive control using multiple models. IEEE Transactions on Automatic Control 42 2 (1997) 171-187
38. Narendra K.S., and Parthasarathy K. Identification and control of dynamical systems using neural networks. IEEE Transactions on Neural Networks 1 1 (1990) 4-27
39. Neal, R.M., 1997. Monte Carlo implementation of Gaussian process models for Bayesian regression and classification. Technical Report 9702, Department of Statistics, University of Toronto, January.
40. O'Hagan A. Curve fitting and optimal design for prediction (with discussion). Journal of the Royal Statistical Society B 40 1 (1978) 1-42
41. Platt J.C., Burges C.J.C., Swenson S., Weare C., and Zheng A. Learning a Gaussian process prior for automatically generating music playlists. Advances in Neural Information Processing Systems (2002) 1425-1432
42. Rasmussen, C.E., 1996. Evaluation of Gaussian processes and other methods for non-linear regression. Ph.D. Thesis, University of Toronto, 1996.
43. Seeger, M., 2003. Bayesian Gaussian process models: Pac-Bayesian generalisation error bounds and sparse approximations. Ph.D. Thesis, University of Edinburgh, 2003.
44. Shilton A., Palaniswami M., Ralph D., and Tsoi A.C. Incremental training of support vector machines. IEEE Transactions on Neural Networks 16 1 (2005) 114-131
45. Shorten R., Murray-Smith R., and Bjorgan R. On the interpretation of local models in blended multiple model structures. International Journal of Control 72 7/8 (1999) 620-628
46. Stark J., Broomhead D.S., Davies M.E., and Huke J. Delay embeddings of forced systems: II stochastic forcing. Journal of Nonlinear Science 13 6 (2003) 519-577
47. Strang G. Linear Algebra and its Applications. third ed. (1988), Harcourt College Publishers
48. Stringer J. Hydraulic Systems Analysis: An Introduction (1976), MacMillan Press, London
49. Takagi T., and Sugeno M. Fuzzy identification of systems and its applications to modeling and control. IEEE Transactions on Systems, Man and Cybernetics SMC-15 1 (1985) 116-132
50. Tancret F., Bhadeshia H.K.D.H., and MacKay D.J.C. Comparison of artificial neural networks with Gaussian processes to model the yield strength of nickel-base superalloys. The Iron and Steel Institute of Japan 39 10 (1999) 1020-1026
51. Vivarelli F., and Williams C.K.I. Discovering hidden features with Gaussian processes regression. In: Kearns M.S., Solla S.A., and Cohn D.A. (Eds). Advances in Neural Information Processing Systems vol. 11 (1999), MIT Press, Cambridge, MA 613-619
52. von Mises R. Mathematical Theory of Probability and Statistics (1964), Academic Press, New York
53. Walters R. Hydraulic and Electro-hydraulic Servo Systems (1967), Iliffe, London
54. Williams C.K.I. Regression with Gaussian Processes, Mathematics of Neural Networks: Models, Algorithms and Applications (1997), Kluwer, Dordrecht
55. Williams, C.K.I.. 1998. Prediction with Gaussian processes: from linear regression to linear prediction and beyond. Technical Report NCRG/97/012, Aston University, Birmingham, UK.
56. Williams C.K.I., and Barber D. Bayesian classification with Gaussian processes. IEEE Transactions on Pattern Analysis and Machine Intelligence 20 12 (1998) 1342-1351
57. Williams C.K.I., and Rasmussen C.E. Gaussian processes for regression. In: Touretzky M.E.H., and Mozer M.C. (Eds). Advances in Neural Information Processing Systems vol. 8 (1996), MIT Press, Cambridge, MA 514-520