Sparse Bayesian Learning and the Relevance Vector Machine

Journal of Machine Learning Research

Volumn 1, Issue 3, 2001, Pages 211-244

  Tipping, Michael E ^a  

^a MICROSOFT RESEARCH   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0001224048     PISSN: 15324435     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (38)

1. J. O. Berger. Statistical decision theory and Bayesian analysis. Springer, second edition, 1985.
2. C. M. Bishop. Neural Networks for Pattern Recognition. Oxford University Press, 1995.
3. C. M. Bishop and M. E. Tipping. Variational relevance vector machines. In C. Boutilier and M. Goldszmidt, editors, Proceedings of the 16th Conference on Uncertainty in Artificial Intelligence, pages 46-53. Morgan Kaufmann, 2000.
4. B. Boser, I. Guyon, and V. N. Vapnik. A training algorithm for optimal margin classifiers. In Proceedings of the Fifth Annual Workshop on Computational Learning Theory, pages 144-152, 1992.
5. C. J. C. Burges. Simplified support vector decision rules. In L. Saitta, editor, Proceedings of the Thirteenth International Conference on Machine Learning, pages 71-77, Bari, Italy, 1996. Morgan Kaufmann.
6. C. J. C. Burges and B. Schölkopf. Improving the accuracy and speed of support vector machines. In M. C. Mozer, M. I. Jordan, and T. Petsche, editors, Advances in Neural Information Processing Systems 9, pages 375-381. MIT Press, 1997.
7. S. Chen, D. L. Donoho, and M. A. Saunders. Atomic decomposition by basis pursuit. Technical Report 479, Department of Statistics, Stanford University, 1995.
8. R. O. Duda and P. E. Hart. Pattern Classification and Scene Analysis. John Wiley, 1973.
9. J. H. Friedman. Multivariate adaptive regression splines. Annals of Statistics, 19(1):1-141, 1991.
10. Y. Grandvalet. Least absolute shrinkage is equivalent to quadratic penalisation. In L. Niklasson, M. Boden, and T. Ziemske, editors, Proceedings of the Eighth International Conference on Artificial Neural Networks (ICANN98), pages 201-206. Springer, 1998.
11. T. S. Jaakkola and M. I. Jordan. Bayesian logistic regression: a variational approach. In D. Madigan and P. Smyth, editors, Proceedings of the 1997 Conference on Artificial Intelligence and Statistics, Ft Lauderdale, FL, 1997.
12. J. T.-K. K wok. The evidence framework applied to support vector machines. IEEE Transactions on Neural Networks, 11(5):1162-1173, 2000.
13. D. J. C. MacKay. Bayesian interpolation. Neural Computation, 4(3):415-447, 1992a.
14. D. J. C. MacKay. The evidence framework applied to classification networks. Neural Computation, 4(5):720-736, 1992b.
15. D. J. C. MacKay. Bayesian methods for backpropagation networks. In E. Domany, J. L. van Hemmen, and K. Schulten, editors, Models of Neural Networks III, chapter 6, pages 211-254. Springer, 1994.
16. D. J. C. MacKay. Introduction to Gaussian processes. In C. M. Bishop, editor, Neural Networks and Machine Learning, pages 133-165. Springer, 1998.
17. D. J. C. MacKay. Comparison of approximate methods for handling hyperparameters. Neural Computation, 11(5):1035-1068, 1999.
18. K. V. Mardia, J. T. Kent, and J. M. Bibby. Multivariate Analysis. Probability and Mathematical Statistics. Academic Press, 1979.
19. I. T. Nabney. Efficient training of RBF networks for classification. In Proceedings of the Ninth International Conference on Artificial Neural Networks (ICANN99), pages 210-215. IEE, 1999.
20. R. M. Neal. Bayesian Learning for Neural Networks. Springer, 1996.
21. J. Platt. Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods. In A. J. Smola, P. Bartlett, B. Schölkopf, and D. Schuurmans, editors, Advances in Large Margin Classifiers. MIT Press, 2000.
22. C. E. Rasmussen. Evaluation of Gaussian processes and other methods for non-linear regression. PhD thesis, Graduate Department of Computer Science, University of Toronto, 1996.
23. G. Ratsch, T. Onoda, and K.-R. Müller. Soft margins for AdaBoost. Machine Learning, 42 (3):287-320, 2001.
24. B. D. Ripley. Pattern Recognition and Neural Networks. Cambridge University Press, 1996.
25. B. Schölkopf. The kernel trick for distances. In Advances in Neural Information Processing Systems 13. MIT Press, 2001.
26. B. Schölkopf, C. J. C. Burges, and A. J. Smola, editors. Advances in Kernel Methods: Support Vector Learning. MIT Press, 1999a.
27. B. Schölkopf, S. Mika, C. J. C. Burges, P. Knirsch, K.-R. Müller, G. Rätsch, and A. J. Smola. Input space versus feature space in kernel-based methods. IEEE Transactions on Neural Networks, 10(5):1000-1017, 1999b.
28. M. Seeger. Bayesian model selection for support vector machines, Gaussian processes and other kernel classifiers. In S. A. Solla, T. K. Leen, and K.-R. Müller, editors, Advances in Neural Information Processing Systems 12, pages 603-609. MIT Press, 2000.
29. A. J. Smola, B. Schölkopf, and K.-R. Müller. The connection between regularization operators and support vector kernels. Neural Networks, 11:637-649, 1998.
30. A. J. Smola, B. Schölkopf, and G. Ratsch. Linear programs for automatic accuracy control in regression. In Proceedings of the Ninth International Conference on Artificial Neural Networks (ICANN99), pages 575-580, 1999.
31. P. Sollich. Probabilistic methods for support vector machines. In S. A. Solla, T. K. Leen, and K.-R. Müller, editors, Advances in Neural Information Processing Systems 12, pages 349-355. MIT Press, 2000.
32. M. E. Tipping. The Relevance Vector Machine. In S. A. Solla, T. K. Leen, and K.-R. Müller, editors, Advances in Neural Information Processing Systems 12, pages 652-658. MIT Press, 2000.
33. M. E. Tipping. Sparse kernel principal component analysis. In Advances in Neural Information Processing Systems 13. MIT Press, 2001.
34. V. N. Vapnik. Statistical Learning Theory. Wiley, 1998.
35. V. N. Vapnik, S. E. Golowich, and A. J. Smola. Support vector method for function approximation, regression estimation and signal processing. In M. C. Mozer, M. I. Jordan, and T. Petsche, editors, Advances in Neural Information Processing Systems 9. MIT Press, 1997.
36. C. K. I. Williams. Prediction with Gaussian processes: from linear regression to linear prediction and beyond. In M. I. Jordan, editor, Learning in Graphical Models, pages 599-621. MIT Press, 1999.
37. C. K. I. Williams and D. Barber. Bayesian classification with Gaussian processes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(12):1342-1351, 1998.
38. P. M. Williams. Bayesian regularisation and pruning using a Laplace prior. Neural Computation, 7(1):117-143, 1995.