Bayesian classification with gaussian processes

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 20, Issue 12, 1998, Pages 1342-1351

  Williams, Christopher K I ^a,b   Barber, David ^a  

^a UNIVERSITY OF EDINBURGH   (United Kingdom)

^b RADBOUD UNIVERSITY NIJMEGEN   (Netherlands)

Author keywords

Bayesian classification; Classification problems; Gaussian processes; Hybrid monte carlo; Markov chain monte carlo; Parameter uncertainty

Indexed keywords

APPROXIMATION THEORY; DATA STRUCTURES; INTEGRAL EQUATIONS; LAPLACE TRANSFORMS; MARKOV PROCESSES; MONTE CARLO METHODS; PARAMETER ESTIMATION; REGRESSION ANALYSIS; SIGNAL FILTERING AND PREDICTION; SPURIOUS SIGNAL NOISE; UNCERTAIN SYSTEMS; VECTORS;

BAYESIAN CLASSIFICATIONS; GAUSSIAN PROCESSES;

PATTERN RECOGNITION;

EID: 0032289422     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/34.735807     Document Type: Article

References (29)

1. D. Barber and C.K.I Williams, "Gaussian Processes for Bayesian Classification via Hybrid Monte Carlo," M.C. Mozer, M.I. Jordan, and T. Petsche, eds., Advances in Neural Information Processing Systems 9. MIT Press, 1997.
2. M.K. Cowles and B.P. Carlin, "Markov-Chain Monte-Carlo Convergence Diagnostics-A Comparative Review," J. Am. Statistics Assoc., vol. 91, pp. 883-904,1996.
3. N.A.C. Cressie, Statistics for Spatial Data. New York, NY: Wiley, 1993.
4. S. Duane, A.D. Kennedy, B.J. Pendleton, and D. Roweth, "Hybrid Monte Carlo," Physics Letters B, vol. 195, pp. 216-222,1987.
5. A. Gelman, J.B. Carlin, H.S. Stern, and D.B. Rubin, Bayesian Data Analysis. London: Chapman and Hall, 1995.
6. M. Gibbs and D.J.C. MacKay, "Efficient Implementation of Gaussian Processes," Draft manuscript, available from http://wol.ra.phy. cam.ac.uk/mackay/homepage.html., 1997.
7. M. Gibbs and D.J.C. MacKay, "Variational Gaussian Process Classifiers," Draft manuscript, available via http://wol.ra.phy.cam.ac.uk/ mackay/homepage.html., 1997.
8. P. J. Green and B. W. Silverman, Nonparametric Regression and Generalized Linear Models. London: Chapman and Hall, 1994.
9. G. Kimeldorf and G. Wahba, "A Correspondence Between Bayesian Estimation of Stochastic Processes and Smoothing by Splines," Annals of Math. Statistics, vol. 41, pp. 495-502,1970.
10. D.J.C. MacKay, "Bayesian Methods for Backpropagation Networks," J.L. van Hemmen, E. Domany, and K. Schulten, eds., Models of Neural Networks II. Springer, 1993.
11. K.V. Mardia and R.J. Marshall, "Maximum Likelihood Estimation for Models of Residual Covariance in Spatial Regression," Biometrika, vol. 71, no. 1, pp. 135-146,1984.
12. P. McCullagh, and J. Neider, Generalized Linear Models. Chapman and Hall, 1983.
13. M. M011er, "A Scaled Conjugate Gradient Algorithm for Fast Supervised Learning," Neural Networks, vol. 6, no. 4, pp. 525-533, 1993.
14. R.M. Neal, "Monte Carlo Implementation of Gaussian Process Models for Bayesian Regression and Classification," Technical Report 9702, Dept. of Statistics, Univ. of Toronto, 1997. Available from http://www.cs.toronto.edu/~radfordJ.
15. R.M. Neal, Bayesian Learning for Neural Networks. New York, Springer, 1996. Lecture Notes in Statistics 118.
16. F. O'Sullivan, B.S. Yandell, and W.J. Raynor, "Automatic Smoothing of Regression Functions in Generalized Linear Models," J. Am. Statistical Assoc., vol. 81, pp. 96-103,1986.
17. C.E. Rasmussen, Evaluation of Gaussian Processes and Other Methods for Non-Linear Regression. PhD thesis, Dept. of Computer Science, Univ. of Toronto, 1996. Available from http://www.cs.utoronto.ca/~carlJ.
18. B. Ripley, Pattern Recognition and Neural Networks. Cambridge, UK: Cambridge Univ. Press, 1996.
19. B.D. Ripley, "Statistical Aspects of Neural Networks," O.E. Barndorff-Nielsen, J.L. Jensen, and W.S. Kendall, eds., Networks and Chaos-Statistical and Probabilistic Aspects, pp. 40-123. Chapman and Hall, 1993.
20. B.D. Ripley, "Flexible Non-Linear Approaches to Classification," V. Cherkassy, J.H. Friedman, and H. Wechsler, eds., From Statistics to Neural Networks, pp. 105-126. Springer, 1994.
21. B.W. Silverman, "Density Ratios, Empirical Likelihood and Cot Death," Applied Statistics, vol. 27, no. 1, pp. 26-33,1978.
22. J. Skilling, "Bayesian Numerical Analysis," W.T. Grandy, Jr. and P. Milonni, eds., Physics and Probability. Cambridge Univ. Press, 1993.
23. V.N. Vapnik, The Nature of Statistical Learning Theory. New York, NY: Springer Verlag, 1995.
24. G. Wahba, "A Comparison of GCV and GML for Choosing the Smoothing Parameter in the Generalized Spline Smoothing Problem," Annals of Statistics, vol. 13, pp. 1,378-1,402,1985.
25. G. Wahba, Spline Models for Observational Data. Soc. Industrial and Applied Mathematics, 1990. CBMS-NSF Regional Conf. Series in Applied Mathematics.
26. G. Wahba, C. Gu, Y. Wang, and R. Chappell, "Soft Classification, a.k.a., Risk Estimation, via Penalized Log Likelihood and Smoothing Spline Analysis of Variance," D.H. Wolpert, ed., The Mathematics of Generalization. Addison-Wesley, 1995. Proc. vol. XX in the Santa Fe Institute Studies in the Sciences of Complexity.
27. C.K.I. Williams, "Computing With Infinite Networks," M.C. Mozer, M.I. Jordan, and T. Petsche, eds., Advances in Neural Information Processing Systems 9. MIT Press, 1997.
28. C.K.I. Williams and C.E. Rasmussen, "Gaussian Processes for Regression," D.S. Touretzky, M.C. Mozer, and M.E. Hasselmo, eds., Advances in Neural Information Processing Systems 8, pp. 514520. MIT Press, 1996.
29. S.J. Yakowitz and F. Szidarovszky, "A Comparison of Kriging With Nonparametric Regression Methods," J. Multivariate Analysis, vol. 16, pp. 21-53,1985.