Multiclass relevance vector machines: Sparsity and accuracy

IEEE Transactions on Neural Networks

Volumn 21, Issue 10, 2010, Pages 1588-1598

  Psorakis, Ioannis ^a   Damoulas, Theodoros ^b   Girolami, Mark A ^c  

^a UNIVERSITY OF OXFORD   (United Kingdom)

^b Department of Computer Science and School of Operations Research and Information Engineering   (United States)

^c UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

Bayesian learning; classification; kernel methods; multiclass discrimination; sparsity

Indexed keywords

BAYESIAN LEARNING; CLASSIFICATION; KERNEL METHODS; MULTI-CLASS; SPARSITY;

BAYESIAN NETWORKS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; BAYES THEOREM; BIOLOGY; CLASSIFICATION; FACTUAL DATABASE; METHODOLOGY;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; BAYES THEOREM; CLASSIFICATION; COMPUTATIONAL BIOLOGY; DATABASES, FACTUAL;

EID: 77957788560     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2010.2064787     Document Type: Article

References (18)

1. E. Alpaydin, Introduction to Machine Learning. Cambridge, MA: MIT Press, 2004.
2. D. Meyer, F. Leisch, and K. Hornik, "The support vector machine under test", Neurocomputing, vol. 55, nos. 1-2, pp. 169-186, Sep. 2003.
3. N. D. Lawrence and R. Herbrich, "A sparse Bayesian compression scheme-the informative vector machine", presented at the NIPS Workshop on Kernel Methods, Vancouver, BC, Canada, Dec. 2001.
4. M. E. Tipping, "Sparse Bayesian learning and the relevance vector machine", J. Mach. Learn. Res., vol. 1, pp. 211-244, Sep. 2001.
5. R. Tibshirani, "Regression shrinkage and selection via the lasso", J. Royal Statist. Soc., Ser. B, vol. 58, no. 1, pp. 267-288, 1996.
6. T. Damoulas, M. A. Girolami, Y. Ying, and C. Campbell, "Inferring sparse kernel combinations and relevance vectors: An application to subcellular localization of proteins", in Proc. 7th Int. Conf. Mach. Learn. Appl., San Diego, CA, Dec. 2008, pp. 577-582.
7. C. M. Bishop, Pattern Recognition and Machine Learning. New York: Springer-Verlag, 2006.
8. J. H. Albert and S. Chib, "Bayesian analysis of binary and polychotomous response data", J. Amer. Statist. Assoc., vol. 88, no. 422, pp. 669-679, Jun. 1993.
9. T. Damoulas and M. A. Girolami, "Combining feature spaces for classification", Pattern Recognit., vol. 42, no. 11, pp. 2671-2683, Nov. 2009.
10. T. Damoulas and M. A. Girolami, "Probabilistic multi-class multi-kernel learning: On protein fold recognition and remote homology detection", Bioinformat., vol. 24, no. 10, pp. 1264-1270, 2008.
11. M. A. Girolami and S. Rogers, "Hierarchic Bayesian models for kernel learning", in Proc. 22nd Int. Conf. Mach. Learn., Bonn, Germany, Aug. 2005, pp. 241-248.
12. M. E. Tipping and A. C. Faul, "Fast marginal likelihood maximization for sparse Bayesian models", in Proc. 9th Int. Workshop Artif. Intell. Statist., Key West, FL, Jan. 2003, pp. 3-6.
13. A. C. Faul and M. E. Tipping, "Analysis of sparse Bayesian learning", in Advances in Neural Information Processing Systems 14, T. G. Dietterich, S. Becker, and Z. Ghahramani, Eds. Cambridge, MA: MIT Press, 2002, pp. 383-389.
14. Crabs Dataset [Online]. Available: http://www.ens.gu.edu.au/STATS/ env2291/DATASETS/CRABS/crabs.html
15. University of California Irvine Machine Learning Repository [Online]. Available: http://archive.ics.uci.edu/ml/index.html
16. S. Manocha and M. A. Girolami, "An empirical analysis of the probabilistic K-nearest neighbour classifier", Pattern Recognit. Lett., vol. 28, no. 13, pp. 1818-1824, Oct. 2007.
17. A. Schmolck and R. Everson, "Smooth relevance vector machine: A smoothness prior extension of the RVM", Mach. Learn., vol. 68, no. 2, pp. 107-135, Aug. 2007.
18. D. G. Tzikas, A. C. Likas, and N. P. Galatsanos, "Sparse Bayesian modeling with adaptive kernel learning", IEEE Trans. Neural Netw., vol. 20, no. 6, pp. 926-937, Jun. 2009.