Sequential Bayesian kernel modelling with non-Gaussian noise

Neural Networks

Volumn 21, Issue 1, 2008, Pages 36-47

  Nikolaev, Nikolay Y ^a   de Menezes, Lilian M ^b  

^a UNIVERSITY OF LONDON   (United Kingdom)

^b CITY UNIVERSITY   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

APPROXIMATION THEORY; COVARIANCE MATRIX; GAUSSIAN DISTRIBUTION; GAUSSIAN NOISE (ELECTRONIC); TIME SERIES ANALYSIS; VECTORS;

BATCH EVALUATION; BAYESIAN INFERENCE; ERROR DISTRIBUTION;

BAYESIAN NETWORKS;

ALGORITHM; ARTICLE; BAYES THEOREM; FORECASTING; KERNEL METHOD; LEARNING; MATHEMATICAL ANALYSIS; NORMAL DISTRIBUTION; PARAMETER; PRIORITY JOURNAL; SIGNAL NOISE RATIO;

BAYES THEOREM; HUMANS; NEURAL NETWORKS (COMPUTER); NOISE; NORMAL DISTRIBUTION; REGRESSION ANALYSIS; TIME FACTORS;

EID: 39649120551     PISSN: 08936080     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neunet.2007.08.001     Document Type: Article

References (34)

1. Attias H. A variational Bayesian framework for graphical models. In: Leen T., et al. (Ed). Advances in neural inf. proc. systems NIPS-12 (2000), MIT Press, Cambridge, MA 209-215
2. Beal, M. 2003. Variational algorithms for approximate Bayesian inference. Ph.D. Thesis. London, UK: Gatsby Computational Neuroscience Unit, University College
3. Bishop C.M., and Tipping M.E. Variational relevance vector machines. In: Boutilier C., and Goldszmidt M. (Eds). Proc. 16th conf. on uncertainty in artificial intelligence (2000), Morgan Kaufmann, San Mateo, CA 46-53
4. Bishop C.M. Pattern recognition and machine learning (2006), Springer, New York
5. Briegel T., and Tresp V. Fisher scoring and a mixture of modes approach for approximate inference and learning in nonlinear state space models. In: Kearns M.S., Solla S.A., and Cohn D.A. (Eds). Advances in neural inf. proc. systems NIPS-11 (1999), MIT Press, Cambridge, MA 403-409
6. Cawley G.C., and Talbot N.L.C. Constructing Bayesian formulations of sparse kernel learning methods. Neural Networks 18 5-6 (2005) 674-683
7. De Gooijer J.G., and Hyndman R.J. 25 years of time series forecasting. International Journal of Forecasting 22 3 (2006) 443-474
8. de Freitas J.F.G., Niranjan M., and Gee A.H. Hierarchical Bayesian-Kalman models for regularisation and ARD in sequential learning. Neural Computation 12 4 (2000) 933-953
9. Engel Y., Mannor S., and Meir R. The kernel recursive least squares algorithm. IEEE Transactions on Signal Processing 52 8 (2004) 2275-2285
10. Faul A., and Tipping M.E. A variational approach to robust regression. In: Dorffner G., Bischof H., and Hornik K. (Eds). Proc. int. conf. artificial neural networks (2001), Springer, Berlin 95-102
11. Ghahramani Z., and Beal M. Propagation algorithms for variational Bayesian learning. In: Leen T.K., Dietterich T., and Tresp V. (Eds). Advances in neural inf. proc. systems NIPS-13 (2001), MIT Press, Cambridge, MA 507-513
12. Harvey A.C. Forecasting, structural time series models and the Kalman filter (1989), Cambridge University Press, Cambridge
13. Hawkins D.M. Diagnostics for use with regression recursive residuals. Technometrics 33 (1991) 221-234
14. In: Haykin S. (Ed). Kalman filtering and neural networks (2001), John Wiley and Sons, New York, NY
15. Huber P.J. Robust statistics (1981), John Wiley and Sons, New York, NY
16. Jordan M.I., Ghahramani Z., Jaakkola T., and Saul L.K. An introduction to variational methods for graphical models. Machine Learning 37 2 (1999) 183-233
17. Ljung L., and Södeström T. Theory and practice of recursive identification (1983), MIT Press, Cambridge, MA
18. MacKay D.J.C. Bayesian interpolation. Neural Computation 4 3 (1992) 415-447
19. MacKay D.J.C. Developments in probabilistic modelling with neural networks- ensemble learning. In: Kappen B., and Gielen S. (Eds). Proc. 3rd annual symposium on neural networks (1995), Springer-Verlag, Berlin 191-198
20. Mardia K.V., Kent J.T., and Bibby J.M. Multivariate analysis (1979), Academic Press, London
21. Möller A.F. A Scaled Conjugate Gradient algorithm for fast supervised learning. Neural Networks 6 4 (1993) 525-533
22. Neal, R. 2006. Software for flexible Bayesian modelling.http://www.cs.toronto.edu/∼radford/fbm.software.html Toronto, CA
23. Nikolaev N., and Iba H. Adaptive learning of polynomial networks: Genetic programming, backpropagation and Bayesian methods (2006), Springer, New York
24. Penny W.D., and Roberts S.J. Variational Bayes for non-Gaussian autoregressive models. In: Widrow B., et al. (Ed). Proc. IEEE workshop on neural networks for signal processing (2000), IEEE Press, New York 135-144
25. Rasmussen C.E., and Williams C.K.I. Gaussian processes for machine learning (2006), MIT Press, Cambridge, MA
26. Roberts S.J., and Penny W.D. Variational bayes for generalised autoregressive models. IEEE Transactions on Signal Processing 50 9 (2002) 2245-2257
27. Sato M., and Oba S. Incremental Sparse Kernel Machine. In: Dorronsoro J.R. (Ed). Proc. int. conf. artificial neural networks. LNCS Vol. 2415 (2002), Springer-Verlag, Berlin 700-706
28. Schölkopf B., and Smola A.J. Learning with kernels (2002), MIT Press, Cambridge, MA
29. Suykens J.A.K., Van Gestel T., De Brabanter J., De Moor B., and Vandewalle J. Least squares support vector machines (2002), World Scientific Publ, Singapore
30. Takens F. Detecting Strange Attractors in Turbulence. In: Rand D.A., and Young L.-S. (Eds). Dynamical systems and turbulence. Lecture notes in mathematics Vol. 898 (1981), Springer-Verlag, Berlin 366-381
31. Tipping M.E. Sparse Bayesian learning and the relevance vector machine. Journal of Machine Learning Research 1 (2001) 211-244
32. Tipping M.E., and Lawrence N.D. Variational inference for Student-t models: Robust Bayesian interpolation and generalised component analysis. Neurocomputing 69 (2005) 123-141
33. Vapnik V. The nature of statistical learning theory (1995), Springer-Verlag, Berlin
34. Wan E.A., and van der Merwe R. The unscented Kalman filter. In: Haykin S. (Ed). Kalman filtering and neural networks (2001), Wiley Publ, New York 221-280