Gaussian processes for classification: Mean-field algorithms

Neural Computation

Volumn 12, Issue 11, 2000, Pages 2655-2684

  Opper, Manfred ^a   Winther, Ole ^b,c  

^a ASTON UNIVERSITY   (United Kingdom)

^b LUND UNIVERSITY   (Sweden)

^c UNIVERSITY OF COPENHAGEN   (Denmark)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; AMERICAN INDIAN; ANIMAL; ARTICLE; ARTIFICIAL INTELLIGENCE; BAYES THEOREM; BIOLOGICAL MODEL; BRACHYURA; CLASSIFICATION; COMPUTER SIMULATION; DISCRIMINATION LEARNING; ETHNOLOGY; FEMALE; GENETIC PREDISPOSITION; GENETICS; HISTOLOGY; HUMAN; MALE; NON INSULIN DEPENDENT DIABETES MELLITUS; NORMAL DISTRIBUTION; PHYSIOLOGY; SEXUAL DEVELOPMENT; SOUND DETECTION; STATISTICAL MODEL;

ALGORITHMS; ANIMALS; ARTIFICIAL INTELLIGENCE; BAYES THEOREM; BRACHYURA; CLASSIFICATION; COMPUTER SIMULATION; DIABETES MELLITUS, TYPE 2; DISCRIMINATION LEARNING; FEMALE; GENETIC PREDISPOSITION TO DISEASE; HUMANS; INDIANS, NORTH AMERICAN; LIKELIHOOD FUNCTIONS; MALE; MODELS, NEUROLOGICAL; NORMAL DISTRIBUTION; SEX CHARACTERISTICS; SOUND SPECTROGRAPHY;

EID: 0034320350     PISSN: 08997667     EISSN: None     Source Type: Journal    
DOI: 10.1162/089976600300014881     Document Type: Article

References (34)

1. Abrahamsen, P. (1997). A review of gaussian random fields and correlation functions (Tech. Rep. No. 917). Oslo, Norway: Norwegian Computing Center.
2. Anlauf, J. K., & Biehl, M. (1989). The AdaTron: An adaptive perceptron algorithm. Europhys. Lett., 10, 687.
3. Barber, D., & Williams, C. K. I. (1997). Gaussian processes for Bayesian classification via hybrid Monte Carlo. In M. C. Mozer, M. I. Jordan, & T. Petsche (Eds.), Neural information processing systems, 9 pp. 340-346. Cambridge, MA: MIT Press.
4. Boser, B., Guyon, I., & Vapnik, V. N. (1992). A training algorithm for optimal margin classifiers. In Procedings of the 5th Annual Workshop on Computational Learning Theory (pp. 144-152). Pittsburgh: ACM.
5. Csató, L., Fokoué, E., Opper, M., Schottky, B., & Winther, O. (in press). Efficient approaches to gaussian process classification. In S. A. Solla, T. K. Leen, & K.-R. Müller, Advances in neural information processing, 12. Cambridge, MA: MIT Press.
6. Gibbs, M. N., & Mackay, D. J. C., (1997). Variational gaussian process classifiers. Preprint, Cambridge University.
7. Gorman, R. P., & Sejnowski, T. J. (1988). Analysis of hidden units in a layered network trained to classify sonar targets. Neural Networks, 1, 75.
8. Jaakkola, T. S., & Haussler, D. (1999). Probabilistic kernel regression models. In: Proceedings of the 1999 Conference on AI and Statistics.
9. Jordan, M. I., (Ed.). (1999). Learning in graphical models. Cambridge, MA: MIT Press.
10. Larsen, J., & Hansen, L. K. (1996). Linear unlearning for cross-validation. Advances in Computational Mathematics, 5, 269-280.
11. Mackay, D. J. C. (1992). Bayesian interpolation. Neural Computation, 4, 415-447.
12. Mackay, D. J. C. (1997). Gaussian processes: A replacement for neural networks. NIPS tutorial. Available online at: http://wol.ra.phy.cam.ac.uk/pub/ mackay/.
13. Mézard, M., Parisi, G., & Virasoro, M. A. (1987). Spin glass theory and beyond. Singapore: World Scientific.
14. Neal, R. (1996). Bayesian learning for neural networks. Berlin: Springer-Verlag.
15. Neal, R. M. (1997). Monte Carlo implementation of gaussian process models for Bayesian regression and classification. (Tech. Rep. No. 9702). Toronto: Department of Statistics, University of Toronto.
16. Opper, M., & Winther, O. (1996). A mean field approach to Bayes learning in feed-forward neural networks. Phys. Rev. Lett., 76, 1964.
17. Opper, M., & Winther, O. (1999a). Mean field methods for classification with gaussian processes. In M. S. Kearns, S. A. Solla, & D. A. Cohn (Eds.), Advances in neural information processing systems, 11. Cambridge, MA: MIT Press.
18. Opper, M., & Winther, O. (1999b). Gaussian processes and SVM: Mean field results and leave-one-out. In P. Bartlett, B. Schölkopf, D. Schuurmans, & A. Smola (Eds.), Large margin classifiers. Cambridge, MA: MIT Press.
19. Papoulis, A. (1984). Probability, random variables, and stochastic processes (2nd ed.). New York: McGraw-Hill.
20. Parisi, G. (1988). Statistical field theory. Reading, MA: Addison-Wesley.
21. Parisi, G., & Potters, M.(1995). Mean-field equations for spin models with orthogonal interaction matrices. J. Phys. A: Math. Gen., 28, 5267.
22. Press, W. H., Teukolsky, S. A., Vetterling, W. T., & Flannery, B. P. (1992). Numerical recipes in C. Cambridge: Cambridge University Press.
23. Ripley, B. D. (1994). Flexible non-linear approaches to classification. In, V. Cherkassy, J. H. Friedman, & H. Wechsler (Eds.), From statistics to neural networks. Berlin: Springer-Verlag.
24. Ripley, B. D. (1996). Pattern recognition and neural networks. Cambridge: Cambridge University Press.
25. Schölkopf, B., Burges, C. J. C., & Smola, A. J. (Eds.). (1998). Advances in kernel methods: Support vector learning. Cambridge, MA: The MIT Press.
26. Thouless, D. J., Anderson, P. W., & Palmer, R. G. (1977). Solution of a "solvable model of a spin glass." Phil. Mag., 35, 593.
27. Vapnik, V. N. (1995). The nature of statistical learning theory. New York: Springer-Verlag
28. Wahba, G. (1990). Spline models for observational data. Philadelphia: SIAM.
29. Wahba, G. (1998). Support vector machines: Reproducing kernel Hilbert spaces and the randomized GACV. In B. Schölkopf, C. J. C. Burges, & A. J. Smola (Eds.), Advances in kernel methods: Support vector learning. Cambridge, MA: MIT Press.
30. Williams, C. K. I. (1997). Computing with infinite networks. In M. C. Mozer, M. I. Jordan, & T. Petsche (Eds.), Neural information processing systems, 9 (pp. 295-301). Cambridge, MA: MIT Press.
31. Williams, C. K. I., & Barber, D. (1998). Bayesian classification with gaussian processes. IEEE Trans Pattern Analysis and Machine Intelligence, 20, 1342-1351,
32. Williams, C. K. I., & Rasmussen, C. E. (1996). Gaussian processes for regression. In D. S. Touretzky, M. C. Mozer, & M. E. Hasselmo (Eds.), Neural information processing systems, 8 (pp. 514-520). Cambridge, MA: MIT Press.
33. Wong, K. Y. M. (1995). Microscopic equations and stability conditions in optimal neural networks. Europhys. Lett., 30, 245.
34. Xiang, D., & Wahba, G. (1996). A generalized approximate cross validation for smoothing splines with non-gaussian data. Statistica Sinica, 6, 675-692.