Estimating predictive variances with kernel ridge regression

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 3944 LNAI, Issue , 2006, Pages 56-77

  Cawley, Gavin C ^a   Talbot, Nicola L C ^a   Chapelle, Olivier ^b  

^a UNIVERSITY OF EAST ANGLIA   (United Kingdom)

^b MAX PLANCK INSTITUTE FOR BIOLOGICAL CYBERNETICS   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

CLASSIFICATION (OF INFORMATION); DATA PROCESSING; DATA REDUCTION; PARAMETER ESTIMATION; PROCESS CONTROL; REGRESSION ANALYSIS;

CONDITIONAL MEANS; KERNEL RIDGE REGRESSION; NOISE PROCESS CONTAMINATION; PREDICTIVE VARIANCES;

PREDICTIVE CONTROL SYSTEMS;

EID: 33745816368     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/11736790_5     Document Type: Conference Paper

References (26)

1. Quiñonero-Candela, J.; Evaluating Predictive Uncertainty Challenge (2005) predict.kyb.tuebingen.mpg.de.
2. Saunders, C., Gammerman, A., Vovk, V.: Ridge regression learning algorithm in dual variables. In: Proc., 15th Int. Conf. on Machine Learning, Madison, WI (1998) 515-521
3. Williams, C., Rasmussen, C.: Gaussian Processes for Regression. In Tburetzky, D.S., Mozer, M.C., Hasselmo, M.E., eds.: Advances in Neural Information Processing Systems, NIPS. Volume 8., MIT Press (1995)
4. Suykens, J.A.K., De Brabanter, J., Lukas, L., Vanderwalle, J.: Weighted least squares support vector machines: robustness and sparse approximation. Neuro-computing 48 (2002) 85-105
5. Mercer, J.: Functions of positive and negative type and their connection with the theory of integral equations. Philosophical Transactions of the Royal Society of London, A 209 (1909) 415-446
6. Cristianini, N., Shawe-Taylor, J.: An Introduction to Support Vector Machines (and other kernel-based learning methods). Cambridge University Press, Cambridge, U.K. (2000)
7. Schölkopf, B., Smola, A.J.; Learning with kernels - support vector machines, regularization, optimization and beyond. MIT Press, Cambridge, MA (2002)
8. Hoerl, A.E., Kennard, R.W.: Ridge regression: Biased estimation for nonorthogonal problems. Technometrics 12 (1970) 55-67
9. Bishop, C.M.; Neural Networks for Pattern Recognition. Oxford University Press (1995)
10. Satchwell, C.: Finding error bars (the easy way). Neural Computing Applications Forum 5 (1994)
11. Lowe, D., Zapart, C.: Point-wise confidence interval estimation by neural networks: A comparative study based on automotive engine calibration. Neural Computing and Applications 8 (1999) 77-85
12. Nix, D.A., Weigend, A.S.: Estimating the mean and variance of the target probability distribution. In: Proceedings of the IEEE International Conference on Neural Networks. Volume 1., Orlando, FL (1994) 55-60
13. Williams, P.M.: Using neural networks to model conditional multivariate densities. Neural Computation 8 (1996) 843-854
14. Vapnik, V.: Statistical Learning Theory. John Wiley & Sons (1998)
15. Kirneldorf, G.S., Wahba, G.: Some results on Tchebycheffian spline functions. Journal of Mathematical Analysis and Applications 33 (1971) 82-95
16. Schölkopf, B., Herbrich, R., Smola, A.J.: A generalised representer theorem, In: Proceedings of the Fourteenth International Conference on Computational Learning Theory, Amsterdam, the Netherlands (2001) 416-426
17. Cawley, G.C., Talbot, N.L.C., Foxall, R.J., Dorling, S.R., Mandic, D.P.; Heteroscedastic kernel ridge regression, Neurocomputing 57 (2004) 105-124
18. Foxall, R.J., Cawley, G.C., Talbot, N.L.C., Dorling, S.R., Mandic, D.P.: Heteroscedastic regularised kernel regression for prediction of episodes of poor air quality. In: Proceedings of the European Symposium on Artificial Neural Networks (ESANN-2002), Bruges, Belgium (2002) 19-24
19. Yuan, M., Wahba, G.: Doubly penalized likelihood estimator in heterosceda-stic regression, Statistics and Probability Letters 69 (2004) 11-20
20. Nabney, I.T.: Efficient training of RBF networks for classification, In: Proceedings of the Ninth International Conference on Artificial Neural Networks, Volume 1., Edinburgh, United Kingdom (1999) 210-215
21. Stone, M.: Cross-validatory choice and assessment of statistical predictions. Journal of the Royal Statistical Society, B 36 (1974) 111-147
22. Luntz, A., Brailovsky, V.: On estimation of characters obtained in statistical procedure of recognition (in Russian), Techicheskaya Kibernetica 3 (1969)
23. Cawley, G.C., Talbot, N.L.C.: Efficient leave-one-out cross-validation of kernel Fisher discriminant classifiers. Pattern Recognition 36 (2003) 2585-2592
24. Williams, P.M.: Bayesian regularization and pruning using a Laplace prior. Neural Computation 7 (1995) 117-143
25. Bishop, C.M., Qazaz, C.S.: Bayesian inference of noise levels in regression. In von der Malsburg, C., von Seelen, W., Vorbrüggen, J.C., Sendhoff, B., eds.: Proceedings of the International Conference on Artificial Neural Networks (ICANN-96). Volume 1112 of Lecture Notes in Computer Science., Bochum, Germany, Springer (1996) 59-64
26. Goldberg, P.W., Williams, C.K.I., Bishop, C.M.: Regression with input-dependent noise: A Gaussian process treatment. In Jordan, M., Kearns, M., Solla, S., eds.: Advances in Neural Information Processing Systems. Volume 10. MIT Press (1998) 493-499