Gaussian process approaches to nonlinear modelling for control

Intelligent Control Systems Using Computational Intelligence Techniques

Volumn , Issue , 2005, Pages 177-217

  Gregorčič, Gregor ^a   Lightbody, Gordon ^a  

^a UNIVERSITY COLLEGE CORK   (Ireland)

Author keywords

Black box modelling techniques; Fuzzy models; Gaussian process approaches; Gaussian processes; Local model identification; Local model network; Modelling; Neural networks; Nonlinear control systems; Nonlinear modelling; Nonlinear systems; Nonparametric probabilistic models; Off equilibrium dynamics; Probability

Indexed keywords

FUZZY INFERENCE; FUZZY NEURAL NETWORKS; GAUSSIAN NOISE (ELECTRONIC); IDENTIFICATION (CONTROL SYSTEMS); MODELS; NEURAL NETWORKS; NONLINEAR CONTROL SYSTEMS; NONLINEAR SYSTEMS; PROBABILITY; TRANSPARENCY;

BLACK BOX MODELLING; EQUILIBRIUM DYNAMICS; FUZZY MODELS; GAUSSIAN PROCESSES; LOCAL MODEL; LOCAL MODEL NETWORKS; NON-LINEAR MODELLING; NON-PARAMETRIC PROBABILISTIC MODELS;

GAUSSIAN DISTRIBUTION;

EID: 85014137088     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1049/PBCE070E_ch6     Document Type: Chapter

References (55)

1. NARENDRA, K. S., and PARTHASARATHY, K.: ‘Identification and control of dynamical systems using neural networks’, IEEE Transactions on Neural Networks, 1990, 1 (1), pp. 4-27
2. TAKAGI, T., and SUGENO, M.: ‘Fuzzy identification of systems and its applications to modeling and control’, IEEE Transactions on Systems, Man and Cybernetics SMC, 1985, 15 (1), pp. 116-32
3. ABONYI, J.: ‘Fuzzy model identification for control’ (Birkhäuser, Boston, MA, 2003)
4. MURRAY-SMITH, R., and JOHANSEN, T. A. (Eds): ‘Multiple model approaches to modelling and control’ (Taylor & Francis, London, 1997)
5. JOHANSEN, T. A., MURRAY-SMITH, R., and SHORTEN, R.: ‘On transient dynamics, off-equilibrium behaviour and identification in blended multiple model structures’, European Control Conference, Karlsruhe, Germany, 1999
6. O’HAGAN, A.: ‘Curve fitting and optimal design for prediction (with discussion)’, Journal of the Royal Statistical Society B, 1978, 40 (1), pp. 1-42
7. RASMUSSEN, C. E.: ‘Evaluation of Gaussian processes and other methods for non-linear regression’. Ph.D. thesis, University of Toronto, 1996
8. GIBBS, M. N.: ‘Bayesian Gaussian processes for regression and classification’. Ph.D. thesis, University of Cambridge, 1997
9. WILLIAMS, C. K. I.: ‘Prediction with Gaussian processes: from linear regression to linear prediction and beyond’, in JORDAN, M. I. (Ed.): ‘Learning and inference in graphical models’ (Kluwer Academic Press, Dordrecht, 1998)
10. ECONOMOU, C. G., MORARI, M., and PALSSON, B. O.: ‘Internal model control: extension to non-linear systems’, Industrial and Engineering Chemical Process Design and Development, 1986, 25, pp. 403-11
11. GREGORČIČ, G., and LIGHTBODY, G.: ‘Internal model control based on a Gaussian process prior model’. Proceedings of the 2003 American Control Conference, Denver, CO, June 2003, pp. 4981-6
12. GREGORČIČ, G., and LIGHTBODY, G.: ‘An affine local Gaussian process model network’. Proceedings of the IEE International Conference on Systems Engineering, Coventry, UK, September 2003, pp. 206-10
13. MACKAY, D. J. C.: ‘Bayesian methods for adaptive models’. Ph.D. thesis, California Institute of Technology, 1991
14. RASMUSSEN, C. E., and GHAHRAMANI, Z.: ‘Occam’s razor’, in LEEN, T., DIETTERICH, T. G., and TRESP, V. (Eds): ‘Advances in neural information processing systems 13’ (MIT Press, Cambridge, MA, 2001) pp. 294-300
15. JOHANSEN, T. A.: ‘Identification of non-linear systems using empirical data and prior knowledge - an optimization approach’, Automatica, 1996, 32, pp. 337-56
16. JOHANSEN, T. A.: ‘On tikhonov regularization, bias and variance in nonlinear system identification’, Automatica, 1997, 33, pp. 441-6
17. BISHOP, C. M., and TIPPING, M. E.: ‘Bayesian regression and classification’, in SUYKENS, J., HORVATH, G., BASU, S., MICCHELLI, C., and VANDEWALLE, J. (Eds): ‘Advances in learning theory: methods, models and applications’, vol. 190 (IOS Press, NATO Science Series III: Computer and Systems Sciences, 2003) pp. 267-85
18. VON MISES, R.: ‘Mathematical theory of probability and statistics’ (Academic Press, New York, 1964)
19. BARNETT, S.: ‘Matrix methods for engineers and scientists’ (McGraw-Hill, London, 1979)
20. WILLIAMS, C. K. I., and RASMUSSEN, C. E.: ‘Gaussian processes for regression’, in HASSELMO TOURETZKY, M. E., and MOZER, M. C. (Eds):‘Advances in neural information processing systems 8’ (MIT Press, Cambridge, MA, 1996) pp. 514-20
21. MURRAY-SMITH, R., and GIRARD, A.: ‘Gaussian process priors with arma noise models’. Proceedings of The Irish Signals and Systems Conference, Maynooth, June 2001, pp. 147-52
22. MACKAY, D. J. C.: ‘Introduction to Monte Carlo methods’. A review paper in the proceedings of an Erice summer school, 1999
23. MACKAY, D. J. C.: ‘Comparison of approximate methods for handling hyperparameters’, Neural Computation, 1999, 11 (5), pp. 1035-68
24. GREGORČIČ, G., and LIGHTBODY, G.: ‘From multiple model network to Gaussian processes prior models’, in RUANO, A. E. (Ed.): Proceedings of the IFAC international conference on Intelligent Control Systems and Signal Processing ICONS2003, Centre for Intelligent Systems, University of Algarve, Portugal, April 2003, pp. 149-54
25. MACKAY, D. J. C.: ‘Information theory, inference and learning algorithms’ (Cambridge University Press, London, 2003)
26. STRANG, G.: ‘Linear algebra and its applications’ (Harcourt College Publishers, 1988, 3rd edn)
27. MURRAY-SMITH, R., and SBARBARO, D.: ‘Nonlinear adaptive control using nonparametric Gaussian process models’. International federation of automatic control, 15th IFAC Triennial World Congress, 2002
28. MURRAY-SMITH, R., SBARBARO, D., RASMUSSEN, C. E., and GIRARD, A.: ‘Adaptive, cautious, predictive control with Gaussian process priors’, 13th IFAC symposium on System Identification, Rotterdam, 2003
29. LEONARD, J. A., KRAMER, M. A., and UNGAR, L. H.: ‘Using radial basis function to approximate a function and its error bounds’, IEEE Transactions on Neural Networks, 1992, 3 (4), pp. 624-7
30. QAZAZ, S. C., WILLIAMS, C. K. I., and BISHOP, C. M.: ‘An upper bound on the Bayesian error bars for generalized linear regression’. Technical report NCRG/96/005, Neural Computing Research Group, Aston University, Birmingham, UK, 1995
31. WILLIAMS, C. K. I., QAZAZ, C., BISHOP, C. M., and ZHU, H.: ‘On the relationship between Bayesian error bars and the input data density’. Proceedings of the fourth international conference on Artificial Neural Networks, 1995, pp. 165-9
32. KOCIJAN, J., GIRARD, A., BANKO, B., and MURRAY-SMITH, R.: ‘Dynamic systems identification with Gaussian processes’. Proceedings of fourth Mathmod, Vienna, 2003, pp. 776-84
33. BRONSHTEIN, I. N., SEMENDYAYEV, K. A., MUSIOL, G., and MUHLIG, H.:‘Handbook of mathematics’ (Springer, Berlin, 2004, 4th edn)
34. LJUNG, L.: ‘System identification: theory for the user’ (Prentice Hall PTR, Upper Saddle River, NJ, 1999, 2nd edn)
35. LEITH, D. J., LEITHEAD, W. E., SOLAK, E., and MURRAY-SMITH, R.:‘Divide & conquer identification using Gaussian process priors’. Conference on Decision and Control, Las Vegas, 2002
36. GREGORČIČ, G., and LIGHTBODY, G.: ‘A comparison of multiple model and pole-placement self-tuning for the control of highly nonlinear processes’, in FAGAN, A., and FEELY, O. (Eds): Proceedings of the Irish Signals and Systems Conference, Dublin, Ireland, 2000, pp. 303-11
37. BROWN, M. D., LIGHTBODY, G., and IRWIN, G. W.: ‘Nonlinear internal model control using local model networks’, IEE Proceedings: Control Theory and Applications, 1997, 144 (6), pp. 505-14
38. KOCIJAN, J., MURRAY-SMITH, R., RASMUSSEN, C. E., and LIKAR, B.:‘Predictive control with Gaussian process models’. The IEEE Region 8 EUROCON 2003: Computer as a Tool, University of Ljubljana, Slovenia, September 2003, pp. 352-6
39. KOCIJAN, J., MURRAY-SMITH, R., RASMUSSEN, C. E., and GIRARD, A.:‘Gaussian process model based predictive control’. Proceedings of the 2004 American Control Conference, Boston, MA, USA, June 2004, pp. 2214-18
40. GIRARD, A., RASMUSSEN, C., QUINONERO CANDELA, J., and MURRAY-SMITH, R.: ‘Multiple-step ahead prediction for non linear dynamic systems - a Gaussian process treatment wih propagation of the uncertainty’, in BECKER, S., THRUN, S., and OBERMAYER, K. (Eds): ‘Advances in neural information processing systems’ (MIT Press, Cambridge, MA, 2002) pp. 545-52
41. KOCIJAN, J., and LEITH, D. J.: ‘Derivative observations used in predictive control’. Proceedings of the 12th IEEE Mediterranean Electrotechnical Conference, MELECON 2004, Dubrovnik, Croatia, May 2004, pp. 379-82
42. NAHAS, E. P., HENSON, M. A., and SEBORG, D. E.: ‘Non-linear internal model control strategy for neural network models’, Computers and Chemical Engineering, 1992, 16, pp. 1039-57
43. KALMAN, R. E.: ‘A new approach to linear filtering and prediction problems’, Transactions of the ASME - Journal of Basic Engineering, 1960, 82 (Series D), pp. 35-45
44. LARIMORE, W. E.: ‘Optimal reduced rank modeling, prediction, monitoring, and control using canonical variate analysis’. IFAC1997 international symposium on Advanced Control of Chemical Processes, Banff, Canada, 1997, pp. 61-6
45. STARK, J., BROOMHEAD, D. S., DAVIES, M. E., and HUKE, J.: ‘Delay embeddings of forced systems: Ii stochastic forcing’, Journal of Nonlinear Science, 2003, 13 (6), pp. 519-77
46. DODD, T. J., and HARRIS, C. J.: ‘Identification of nonlinear time series via kernels’, International Journal of System Science, 2002, 33 (9) pp. 737-50
47. LEITH, D. J., and LEITHEAD, W. E.: ‘Analytic framework for blended multiple model systems using linear local models’, International Journal of Control, 1999, 72 (7/8), pp. 605-19
48. JORDAN, M. I., and JACOBS, R. A.: ‘Hierarchical mixtures of experts and the EM algorithm’, Neural Computation, 1994, 6, pp. 181-214
49. SHI, J. Q., MURRAY-SMITH, R., and TITTERINGTON, D. M.: ‘Bayesian regression and classification using mixtures of Gaussian processes’, International Journal of Adaptive Control and Signal Processing, 2003, 17 (2), pp. 149-61
50. WATERHOUSE, S., MACKAY, D., and ROBINSON, T.: ‘Bayesian methods for mixtures of experts’, in TOURETZKY, D. S., MOZER, M. C., and HASSELMO, M. E. (Eds): ‘Advances in neural information processing systems’, vol. 8 (The MIT Press, Cambridge, MA, 1996) pp. 351-7
51. UPTON, G., and COOK, I.: ‘Introducing statistics’ (Oxford University Press, Oxford, 2001)
52. BISHOP, C. M.: ‘Mixture density networks’. Technical report NCRG/94/004, Neural Computing Research Group, Aston University, 1994
53. PENNY, W. D., HUSMEIER, D., and ROBERTS, S. J.: ‘The Bayesian paradigm:second generation neural computing’, in LISBOA, P. (Ed.): ‘Artificial neural networks in biomedicine’ (Springer-Verlag, Heidelberg, 1999)
54. KOCIJAN, J., GIRARD, A., and LEITH, D. J.: ‘Incorporating linear local models in Gaussian process model’. Technical report DP-8895, Jožef Stefan Institute, Ljubljana, Slovenia, 2003
55. GREGORČIČ, G.: ‘Data-based modelling of nonlinear systems for control’. Ph.d. thesis, University College Cork, 2004