Approximate model selection for large scale LSSVM

Journal of Machine Learning Research

Volumn 20, Issue , 2011, Pages 165-180

  Ding, Lizhong ^a   Liao, Shizhong ^a  

^a TIANJIN UNIVERSITY   (China)

Author keywords

Least squares support vector machine; Matrix approximation; Model selection; Multilevel circulant matrices

Indexed keywords

BENCHMARK DATASETS; CIRCULANT MATRIX; COMPUTATIONAL COSTS; DECISION FUNCTIONS; LARGE-SCALE APPLICATIONS; LEAST SQUARES SUPPORT VECTOR MACHINES; MATRIX APPROXIMATION; MODEL SELECTION;

APPROXIMATION ALGORITHMS; FAST FOURIER TRANSFORMS; INVERSE PROBLEMS; ITERATIVE METHODS; LEARNING SYSTEMS;

MATRIX ALGEBRA;

EID: 84876851009     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (23)

1. G.C. Cawley and N.L.C. Talbot. Fast exact leave-one-out cross-validation of sparse least-squares support vector machines. Neural Networks, 17:1467-1475, 2004.
2. G.C. Cawley and N.L.C. Talbot. Preventing over-fitting during model selection via Bayesian regularisation of the hyper-parameters. Journal of Machine Learning Research, 8:841-861, 2007.
3. G.C. Cawley and N.L.C. Talbot. On over-fitting in model selection and subsequent selection bias in performance evaluation. Journal of Machine Learning Research, 11:2079-2107, 2010.
4. O. Chapelle and V. Vapnik. Model selection for support vector machines. In Advances in Neural Information Processing Systems 12, pages 230-236. MIT Press, Cambridge, MA, 2000.
5. O. Chapelle, V. Vapnik, O. Bousquet, and S. Mukherjee. Choosing multiple parameters for support vector machines. Machine Learning, 46(1):131-159, 2002.
6. H. Chen, P. Tino, and X. Yao. Probabilistic classification vector machines. IEEE Transactions on Neural Networks, 20(6):901-914, 2009.
7. C. Cortes, M. Mohri, and A. Talwalkar. On the impact of kernel approximation on learning accuracy. In Proceedings of the 13th International Conference on Artificial Intelligence and Statistics (AISTATS 2010), pages 113-120, Sardinia, Italy, 2010.
8. K. Crammer, J. Keshet, and Y. Singer. Kernel design using boosting. In Advances in Neural Information Processing Systems 15, pages 553-560. MIT Press, Cambridge, MA, 2003.
9. P.J. Davis. Circulant Matrices. John Wiley and Sons, New York, NY, 1979.
10. J. Demšar. Statistical comparisons of classi-ers over multiple data sets. Journal of Machine Learning Research, 7:1-30, 2006. ISSN 1532-4435.
11. K. Duan, S.S. Keerthi, and A.N. Poo. Evaluation of simple performance measures for tuning SVM hyperparameters. Neurocomputing, 51:41-59, 2003.
12. I. Guyon, A. Saffari, G. Dror, and G. Cawley. Model selection: Beyond the Bayesian/frequentist divide. Journal of Machine Learning Research, 11:61-87, 2010.
13. A. Luntz and V. Brailovsky. On estimation of characters obtained in statistical procedure of recognition (in Russian). Technicheskaya Kibernetica, 3, 1969.
14. C.A. Micchelli and M. Pontil. Learning the kernel function via regularization. Journal of Machine Learning Research, 6:1099-1125, 2006.
15. G. Rätsch, T. Onoda, and K.R. Müller. Soft margins for AdaBoost. Machine Learning, 42(3): 287-320, 2001.
16. G. Song. Approximation of kernel matrices in machine learning. PhD thesis, Syracuse University, 2010.
17. G. Song and Y. Xu. Approximation of kernel matrices by circulant matrices and its application in kernel selection methods. Frontiers of mathematics in China, 5(1):123-160, 2010a.
18. G. Song and Y. Xu. Approximation of high-dimensional kernel matrices by multilevel circulant matrices. Journal of Complexity, 26(4):375-405, 2010b.
19. J.A.K. Suykens and J. Vandewalle. Least squares support vector machine classifiers. Neural Pro- cessing Letters, 9(3):293-300, 1999.
20. E.E. Tyrtyshnikov. A unifying approach to some old and new theorems on distribution and clustering. Linear Algebra and its Applications, 232:1-43, 1996.
21. T. Van Gestel, J.A.K. Suykens, B. Baesens, S. Viaene, J. Vanthienen, G. Dedene, B. De Moor, and J. Vandewalle. Benchmarking least squares support vector machine classifiers. Machine Learning, 54(1):5-32, 2004.
22. V. Vapnik and O. Chapelle. Bounds on error expectation for support vector machines. Neural Computation, 12(9):2013-2036, 2000.
23. V.N. Vapnik. Statistical Learning Theory. John Wiley & Sons, New York, NY, 1998.