Feature selection for support vector regression using probabilistic prediction

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn , Issue , 2010, Pages 343-351

  Yang, Jian Bo ^a   Ong, Chong Jin ^a  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

Feature ranking; Feature selection; Probabilistic predictions; Random permutation; Support vector regression

Indexed keywords

FEATURE RANKING; FEATURE SELECTION; PROBABILISTIC PREDICTION; RANDOM PERMUTATIONS; SUPPORT VECTOR REGRESSION;

FORECASTING; REGRESSION ANALYSIS; VECTORS;

FEATURE EXTRACTION;

EID: 77956209944     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1835804.1835849     Document Type: Conference Paper

References (25)

1. A. Asuncion and D.J. Newman. UCI machine learning repository, 2007.
2. C. M. Bishop. Neural Networks for Pattern Recognition. Oxford University Press, November 1995.
3. C.-C. Chang and C.-J. Lin. LIBSVM: a library for support vector machines, 2001.
4. W. Chu, S. S. Keerthi, and C. J. Ong. Bayesian support vector regression using a unified loss function. IEEE Transactions on Neural Networks, 15:29-44, 2004.
5. R. O. Duda, P. E. Hart, and D. G. Stork. Pattern Classification (2nd Edition). Wiley-Interscience, November 2000.
6. J. H. Friedman. Multivariate adaptive regression splines. The Annals of Statistics, 19(1):1-67, 1991.
7. J. B. Gao, S. R. Gunn, C. J. Harris, and M. Brown. A probabilistic framework for SVM regression and error bar estimation. Machine Learning, 46(1-3):71-89, 2002.
8. O. Gualdrón, J. Brezmes, E. Llobet, A. Amari, X. Vilanova, B. Bouchikhi, and X. Correig. Variable selection for support vector machine based multisensor systems. Sensors and Actuators B: Chemical, 122:259-268, March 2007.
9. I. Guyon and A. Elisseeff. An introduction to variable and feature selection. Journal of Machine Learning Research, 3:1157-1182, 2003.
10. I. Guyon, S. Gunn, M. Nikravesh, and L. Zadeh, editors. Feature Extraction: Foundations and Applications (Studies in Fuzziness and Soft Computing). Springer Verlag, August 2006.
11. I. Guyon, J. Weston, S. Barnhill, and V. Vapnik. Gene selection for cancer classification using support vector machines. Machine Learning, 46(1-3):389-422, 2002.
12. T. Joachims. Making large-Scale SVM Learning Practical., chapter In B. Scholkopf, C. Burges and A. Smola (Eds), Advances in kernel methods: Support Vector Learning. MIT Press, 1998.
13. Y. Kim and J. Kim. Gradient lasso for feature selection. In Proceedings of the 21st International Conference on Machine Learning, pages 60-67, 2004.
14. M. H. Law and J. T. Kwok. Bayesian support vector regression. In In Proceedings of the Eighth International Workshop on Artificial Intelligence and Statistics, pages 239-244, 2001.
15. C. J. Lin and R. C. Weng. Simple probabilistic predictions for support vector regression. Technical report, Department of Cmputer Science, National Taiwan University, 2004.
16. D. MacKay. The evidence framework applied to classification networks. Neural Computation, 4(5):720-736, 1992.
17. A. Navot, L. Shpigelman, N. Tishby, and E. Vaadia. Nearest neighbor based feature selection for regression and its application to neural activity. In Y. Weiss, B. Schölkopf, and J. Platt, editors, Advances in Neural Information Processing Systems 18, pages 995-1002, Cambridge, MA, 2006. MIT Press.
18. A. Y. Ng. Feature selection, l1 vs. l2 regularization, and rotational invariance. In ICML '04: Proceedings of the twenty-first International Conference on Machine learning, pages 78-85, New York, NY, USA, 2004. ACM.
19. J. C. Platt. Using sparseness and analytic QP to speed training of support vector machines, chapter In M.S. Kearns, S.A. Solla and D. A. Cohn (Eds), Advances in Neural Information Processing Systems, 11. Cambridge, MIT Press, 1998.
20. A. Rakotomamonjy. Variable selection using SVM-based criteria. Journal of Machine Learning Research, 3:1357-1320, 2003.
21. K. Q. Shen, C. J. Ong, X. P. Li, and E. P. Wilder-Smith. Feature selection via sensitivity analysis of SVM probabilistic outputs. Machine Learning, 70(1):1-20, 2008.
22. L. Song, A. Smola, A. Gretton, J. Bedo, and K. Borgwardt. Supervised feature selection via dependence estimation. In ICML '07: Proceedings of the 24th international conference on Machine learning, pages 823-830, New York, NY, USA, 2007. ACM.
23. R. Tibshirani. Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society. Series B, 58(1):267-288, 1996.
24. V. N. Vapnik. Statistical Learning Theory. Wiley-Interscience, September 1998.
25. J. B. Yang, K. Q. Shen, C. J. Ong, and X. P. Li. Feature selection for mlp neural network: The use of random permutation of probabilistic outputs. IEEE Transactions on Neural Network, 20(12):1911 - 1922, December 2009.