Bayesian support vector machines for feature ranking and selection

Studies in Fuzziness and Soft Computing

Volumn 207, Issue , 2006, Pages 403-418

  Chu, Wei ^a   Keerthi, S Sathiya ^b   Ong, Chong Jin ^c   Ghahramani, Zoubin ^a  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

^b YAHOO RESEARCH   (United States)

^c NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 34047174522     PISSN: 14349922     EISSN: None     Source Type: Book Series    
DOI: 10.1007/978-3-540-35488-8_19     Document Type: Article

References (33)

1. H. Almuallim and T. G. Dietterich. Learning with many irrelevant features. In Proc. AAAI-91, pages 547-552. MIT Press, 1991.
2. B. Boser, I. Guyon, and V. N. Vapnik. A training algorithm for optimal margin classifier. In Fifth Annual Workshop on Computational Learning Theory, pages 144-152, Pittsburgh, USA, 1992.
3. C. J. G. Burges. A tutorial on support vector machines for pattern recogintion. Data Mining and Knowledge Discovery, 2 (2):121-167, 1998.
4. W. Chu, S. S. Keerthi, and C. J. Ong. Bayesian trigonometric support vector classifier. Neural Computation, 15(9):2227-2254, 2003.
5. W. Chu, S. S. Keerthi, and C. J. Ong. Bayesian support vector regression using a unified loss function. IEEE transactions on neural networks, 15(l):29-44, 2004.
6. L. Csató, E. Fokoué, M. Opper, B. Schottky, and O. Winther. Efficient approaches to Gaussian process classification. In Advances in Neural Information Processing Systems, volume 12, pages 251-257, 2000.
7. T. Evgeniou, M. Pontil, and T. Poggio. A unified framework for regularization networks and support vector machines. A.I. Memo 1654, MIT, 1999.
8. R. Fletcher. Practical methods of optimization. John Wiley and Sons, 1987.
9. M. N. Gibbs. Bayesian Gaussian Processes for Regression and Classification. Ph.D. thesis, University of Cambridge, 1997.
10. I. Guyon, J. Weston, and S. Barnhill. Gene selection for cancer classification using support vector machines. Machine Learning, 40:389-422, 2002.
11. T. S. Jebara and T. S. Jaakkola. Feature selection and dualities in maximum entropy discrimination. In Uncertainty in Artificial Intelligence: Proceedings of the Sixteenth Conference (UAI-2000), pages 291-300, San Francisco, CA, 2000. Morgan Kaufmann Publishers.
12. G. John, R. Kohavi, and K. Pfleger. Irrelevant features and the subset selection problem. In Proc. ML-94, pages 121-129. Morgan Kaufmann Publishers, 1994.
13. S. S. Keerthi, S. K. Shevade, C. Bhattacharyya, and K. R. K. Murthy. Improvements to Platt's SMO algorithm for SVM classifier design. Neural Computation, 13 (3):637-649, March 2001.
14. H. Kim and Z. Ghahramani. The EM-EP algorithm for Gaussian process classification. In Proc. of the Workshop on Probabilistic Graphical Models for Classification (at ECML), 2003.
15. G. S. Kimeldorf and G. Wahba. Some results on Tchebycheffian spline function. Journal of Mathematical Analysis and Applications, 33:82-95, 1971.
16. K. Kira and L. A. Rendell. The feature selection problem: Traditional methods and a new algorithm. In Proc. AAAI-92, pages 129-134. MIT Press, 1992.
17. P. Langley and S. Sage. Induction of selective Bayesian classifiers. In Proc. UAI-94, pages 399-406. Morgan Kaufmann, 1994.
18. D. J. C. MacKay. A practical Bayesian framework for back propagation networks. Neural Computation, 4(3):448-472, 1992.
19. D. J. C. MacKay. Bayesian methods for backpropagation networks. Models of Neural Networks III, pages 211-254, 1994.
20. T. P. Minka. A family of algorithm for approximate Bayesian inference. Ph.D. thesis, Massachusetts Institute of Technology, January 2001.
21. R. M. Neal. Bayesian Learning for Neural Networks. Lecture Notes in Statistics. Springer, 1996.
22. R. M. Neal. Monte Carlo implementation of Gaussian process models for Bayesian regression and classification. Technical Report No. 9702, Department of Statistics, University of Toronto, 1997a.
23. R. M. Neal. Regression and classification using Gaussian process priors (with discussion). In J. M. Bernerdo, J. O. Berger, A. P. Dawid, and A. P. M. Smith, editors, Bayesian Statistics, volume 6, 1997b.
24. M. Opper and O. Winther. Gaussian processes for classification: Mean field algorithm. Neural Computation, 12(11):2655-2684, 2000.
25. J. C. Platt. Fast training of support vector machines using sequential minimal optimization. In B. Schölkopf, C. J. C. Burges, and A. J. Smola, editors, Advances in Kernel Methods - Support Vector Learning, pages 185-208. MIT Press, 1999.
26. B. Schölkopf, R. Herbrich, and A. J. Smola. A generalized representer theorem. In Proc. of the Annual Conference on Computational Learning Theory, 2001.
27. M. Seeger. Bayesian model selection for support vector machines, Gaussian processes and other kernel classifiers. In Advances in Neural Information Processing Systems, volume 12, 1999.
28. A. J. Smola and B. Schölkopf. A tutorial on support vector regression. Technical Report NC2-TR-1998-030, GMD First, October 1998.
29. V. N. Vapnik. The Nature of Statistical Learning Theory. New York: Springer-Verlag, 1995.
30. G. Wahba. Spline Models for Observational Data, volume 59 of CBMS-NSF Regional Conference Series in Applied Mathematics. SIAM, 1990.
31. J. Weston, S. Mukherjee, O. Chapelle, M. Pontil, and T. Poggio. Feature selection in SVMs. In Todd Leen, Tom Dietterich, and Volker Tresp, editors, Advances in Neural Information Processing Systems, volume 13, 2001. MIT Press.
32. C. K. I. Williams and D. Barber. Bayesian classification with Gaussian processes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(12):1342-1351, 1998.
33. C. K. I. Williams and C. E. Rasmussen. Gaussian processes for regression. In D. S. Touretzky, M. C. Mozer, and M. E. Hasselmo, editors, Advances in Neural Information Processing Systems, volume 8, pages 598-604, 1996. MIT Press.