Can Gaussian process regression be made robust against model mismatch?

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 3635 LNAI, Issue , 2005, Pages 199-210

  Sollich, Peter ^a  

^a KING'S COLLEGE LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

APPROXIMATION THEORY; COMPUTER SIMULATION; LEARNING SYSTEMS; REGRESSION ANALYSIS; ROBUSTNESS (CONTROL SYSTEMS); SET THEORY;

GAUSSIAN PROCESS (GP) REGRESSION; GENERALIZATION ERROR; HYPERPARAMETERS;

INFORMATION RETRIEVAL SYSTEMS;

EID: 33645970424     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/11559887_12     Document Type: Conference Paper

References (25)

1. C K I Williams and C E Rasmussen. Gaussian processes for regression. In D S Touretzky, M C Mozer, and M E Hasselmo, editors, Advances in Neural Information Processing Systems 8, pages 514-520, Cambridge, MA, 1996. MIT Press.
2. C K I Williams. Computing with infinite networks. In M C Mozer, M I Jordan, and T Petsche, editors, Advances in Neural Information Processing Systems 9, pages 295-301, Cambridge, MA, 1997. MIT Press.
3. D Barber and C K I Williams. Gaussian processes for Bayesian classification via hybrid Monte Carlo. In M C Mozer, M I Jordan, and T Petsche, editors, Advances in Neural Information Processing Systems 9, pages 340-346, Cambridge, MA, 1997. MIT Press.
4. P W Goldberg, C K I Williams, and C M Bishop. Regression with input-dependent noise: A Gaussian process treatment. In M I Jordan, M J Kearns, and S A Solla, editors, Advances in Neural Information Processing Systems 10, pages 493-499, Cambridge, MA, 1998. MIT Press.
5. P Sollich. Learning curves for Gaussian processes. In M S Kearns, S A Solla, and D A Cohn, editors, Advances in Neural Information Processing Systems 11, pages 344-350, Cambridge, MA, 1999. MIT Press.
6. Lehel Csató, Ernest Fokoué, Manfred Opper, Bernhard Schottky, and Ole Winther. Efficient approaches to gaussian process classification. In S.A. Solla, T.K. Leen, and K.-R. Müller, editors, Advances in Neural Information Processing Systems 12, pages 251-257, Cambridge, MA, 2000. MIT Press.
7. D Malzahn and M Opper. Learning curves for Gaussian processes regression: A framework for good approximations. In T K Leen, T G Dietterich, and V Tresp, editors, Advances in Neural Information Processing Systems 13, pages 273-279, Cambridge, MA, 2001. MIT Press.
8. D Malzahn and M Opper. Learning curves for Gaussian processes models: fluctuations and universality. Lect. Notes Comp. Sci., 2130:271-276, 2001.
9. D Malzahn and M Opper. A variational approach to learning curves. In T G Dietterich, S Becker, and Z Ghahramani, editors, Advances in Neural Information Processing Systems 14, pages 463-469, Cambridge, MA, 2002. MIT Press.
10. P Sollich and A Halees. Learning curves for Gaussian process regression: approximations and bounds. Neural Comput., 14(6):1393-1428, 2002.
11. P Sollich. Gaussian process regression with mismatched models. In T G Dietterich, S Becker, and Z Ghahramani, editors, Advances in Neural Information Processing Systems 14, pages 519-526, Cambridge, MA, 2002. MIT Press.
12. C A Michelli and G Wahba. Design problems for optimal surface interpolation. In Z Ziegler, editor, Approximation theory and applications, pages 329-348. Academic Press, 1981.
13. C K I Williams and F Vivarelli. Upper and lower bounds on the learning curve for Gaussian processes. Mach. Learn., 40(1):77-102, 2000.
14. C K I Williams. Prediction with Gaussian processes: From linear regression to linear prediction and beyond. In M I Jordan, editor, Learning and Inference in Graphical Models, pages 599-621. Kluwer Academic, 1998.
15. M Seeger. Gaussian processes for machine learning. International Journal of Neural Systems, 14(2):69-106, 2004.
16. M Opper and R Urbanczik. Universal learning curves of Support Vector Machines. Phys. Rev. Lett., 86(19):4410-4413, 2001.
17. R Dietrich, M Opper, and H Sompolinsky. Statistical mechanics of Support Vector Networks. Phys. Rev. Lett., 82(14):2975-2978, 1999.
18. W Bialek, C G Callan, and S P Strong. Field theories for learning probability distributions. Phys. Rev. Lett., 77(23):4693-4697, 1996.
19. T E Holy. Analysis of data from continuous probability distributions. Phys. Rev. Lett., 79(19):3545-3548, 1997.
20. V Periwal. Reparametrization invariant statistical inference and gravity. Phys. Rev. Lett., 78(25):4671-4674, 1997.
21. V Periwal. Geometric statistical inference. Nucl. Phys. B, 554(3):719-730, 1999.
22. T Aida. Field theoretical analysis of on-line learning of probability distributions. Phys. Rev. Lett., 83(17):3554-3557, 1999.
23. D M Schmidt. Continuous probability distributions from finite data. Phys. Rev. E, 61(2):1052-1055, 2000.
24. T Aida. Reparametrization-covariant theory for on-line learning of probability distributions. Phys. Rev. E, 64:056128, 2001.
25. I Nemenman and W Bialek. Occam factors and model independent Bayesian learning of continuous distributions. Phys. Rev. E, 65:026137, 2002.