Model selection for support vector machine classification

Neurocomputing

Volumn 55, Issue 1-2, 2003, Pages 221-249

  Gold, Carl ^a   Sollich, Peter ^b  

^a CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

^b KING'S COLLEGE LONDON   (United Kingdom)

Author keywords

Bayesian evidence; Classification; Model selection; Probabilistic methods; Support vector machines

Indexed keywords

ALGORITHMS; APPROXIMATION THEORY; MATHEMATICAL MODELS; MONTE CARLO METHODS; PROBABILITY; VECTORS;

MODEL SELECTION;

NEURAL NETWORKS;

ALGORITHM; ANALYTIC METHOD; ANALYTICAL ERROR; CLASSIFICATION; CONTROLLED STUDY; MACHINE; MATHEMATICAL COMPUTING; MATHEMATICAL MODEL; MONTE CARLO METHOD; NORMAL DISTRIBUTION; PRIORITY JOURNAL; PROBABILITY; REVIEW; SYSTEM ANALYSIS; VALIDATION PROCESS;

EID: 0242288807     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0925-2312(03)00375-8     Document Type: Article

References (30)

1. D. Barber, C.K.I. Williams, Gaussian processes for Bayesian classification via hybrid Monte Carlo, in: M.C. Mozer, M.I. Jordan, T. Petsche (Eds.), Advances in Neural Information Processing Systems, Vol. 9, MIT Press, Cambridge, MA, 1997, pp. 340-346.
2. C.J.C. Burges, A tutorial on support vector machines for pattern recognition, Data Mining Knowledge Discovery 2 (2) (1998) 121-167.
3. O. Chapelle, V.N. Vapnik, Model selection for support vector machines, in: S.A. Solla, T.K. Leen, K.-R. Müller (Eds.), Advances in Neural Information Processing Systems, Vol. 12, MIT Press, Cambridge, MA, 2000, pp. 230-236.
4. O. Chapelle, V. Vapnik, O. Bousquet, S. Mukherjee, Choosing multiple parameters for support vector machines, Mach. Learning 46 (1-3) (2002) 131-159.
5. N. Cristianini, C. Campbell, J. Shawe-Taylor, Dynamically adapting kernels in support vector machines, in: M. Kearns, S.A. Solla, D. Cohn (Eds.), Advances in Neural Information Processing Systems, Vol. 11, MIT Press, Cambridge, MA, 1999, pp. 204-210.
6. N. Cristianini, J. Shawe-Taylor, An Introduction to Support Vector Machines, Cambridge University Press, Cambridge, 2000.
7. T. Jaakkola, D. Haussler, Probabilistic kernel regression models, in: D. Heckerman, J. Whittaker (Eds.), Proceedings of the Seventh International Workshop on Artificial Intelligence and Statistics, San Francisco, CA, Morgan Kaufmann, Los Altos, CA, 1999.
8. W. Krauth, Introduction to Monte Carlo algorithms, in: J. Kertesz, I. Kondor (Eds.), Advances in Computer Simulation, Springer, Berlin, 1998.
9. J.T.Y. Kwok, Moderating the outputs of support vector machine classifiers, IEEE Trans. Neural Networks 10 (5) (1999) 1018-1031.
10. J.T.Y. Kwok, The evidence framework applied to support vector machines, IEEE Trans. Neural Networks 11 (5) (2000) 1162-1173.
11. D.J.C. MacKay, Bayesian interpolation, Neural Comput. 4 (1992) 415-447.
12. D.J.C. MacKay, The evidence framework applied to classification networks, Neural Comput. 4 (1992) 720-736.
13. R.M. Neal, Probabilistic inference using Markov chain Monte Carlo methods, Technical Report CRG-TR-93-1, University of Toronto, 1993.
14. R.M. Neal, Bayesian Learning for Neural Networks, Springer, New York, 1996.
15. M. Opper, O. Winther, Gaussian process classification and SVM: mean field results and leave-one-out estimator, in: A.J. Smola, P. Bartlett, B. Schölkopf, D. Schuurmans (Eds.), Advances in Large Margin Classifiers, MIT Press, Cambridge, MA, 2000, pp. 311-326.
16. M. Opper, O. Winther, Gaussian processes for classification: mean-field algorithms, Neural Comput. 12 (11) (2000) 2655-2684.
17. W.H. Press, S.A. Teukolsky, W.T. Vetterling, B.P. Flannery, Numerical Recipes in C, 2nd Edition, Cambridge University Press, Cambridge, 1992.
18. M. Seeger, Bayesian model selection for support vector machines, Gaussian processes and other kernel classifiers, in: S.A. Solla, T.K. Leen, K.R. Müller (Eds.), Advances in Neural Information Processing Systems, Vol. 12, MIT Press, Cambridge, MA, 2000, pp. 603-609.
19. A.J. Smola, B. Schölkopf, K.R. Müller, The connection between regularization operators and support vector kernels, Neural Networks 11 (4) (1998) 637-649.
20. P. Sollich, Probabilistic interpretation and Bayesian methods for support vector machines, in: ICANN99 - Ninth International Conference on Artificial Neural Networks, The Institution of Electrical Engineers, London, 1999, pp. 91-96.
21. P. Sollich, Probabilistic methods for support vector machines, in: S.A. Solla, T.K. Leen, K.-R. Müller (Eds.), Advances in Neural Information Processing Systems, Vol. 12, MIT Press, Cambridge, MA, 2000, pp. 349-355.
22. P. Sollich, Bayesian methods for support vector machines: evidence and predictive class probabilities, Mach. Learning 46 (1-3) (2002) 21-52.
23. M.E. Tipping, The relevance vector machine, in: S.A. Solla, T.K. Leen, K.-R. Müller (Eds.), Advances in Neural Information Processing Systems, Vol. 12, MIT Press, Cambridge, MA, 2000, pp. 652-658.
24. V. Vapnik, The Nature of Statistical Learning Theory, Springer, New York, 1995.
25. V. Vapnik, Statistical Learning Theory, Wiley, New York, 1998.
26. V. Vapnik, O. Chapelle, Bounds on error expectation for support vector machines, Neural Comput. 12 (9) (2000) 2013-2036.
27. G. Wahba, Support vector machines, reproducing kernel Hilbert spaces and the randomized GACV, in: B. Schölkopf, C. Burges, A.J. Smola (Eds.), Advances in Kernel Methods: Support Vector Machines, MIT Press, Cambridge, MA, 1998, pp. 69-88.
28. C.K.I. Williams, Prediction with Gaussian processes: from linear regression to linear prediction and beyond, in: M.I. Jordan (Ed.), Learning and Inference in Graphical Models, Kluwer Academic, Dordrecht, 1998, pp. 599-621.
29. C.K.I. Williams, D. Barber, Bayesian classification with Gaussian processes, IEEE Trans. Pattern Anal. Mach. Intell. 20 (12) (1998) 1342-1351.
30. C.K.I. Williams, M. Seeger, Using the Nyström method to speed up kernel machines, in: T.K. Leen, T.G. Dietterich, V. Tresp (Eds.), Advances in Neural Information Processing Systems, Vol. 13, MIT Press, Cambridge, MA, 2001, pp. 682-688.