Quadratic programming feature selection

Journal of Machine Learning Research

Volumn 11, Issue , 2010, Pages 1491-1516

  Rodriguez Lujan, Irene ^a   Huerta, Ramon ^b   Elkan, Charles ^c   Cruz, Carlos Santa ^a  

^a UNIVERSIDAD AUTÓNOMA DE MADRID   (Spain)

^b UNIVERSITY OF CALIFORNIA SAN DIEGO   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Feature selection; High dimensional data; Large data set; Nystr m method; Quadratic programming

Indexed keywords

CLASSIFICATION ACCURACY; DATA SETS; DIAGONALIZATIONS; FEATURE SELECTION; FEATURE SELECTION METHODS; HIGH DIMENSIONAL DATA; LARGE DATA; LARGE DATASETS; M METHOD; MATRIX; OPTIMIZATION PROBLEMS; QUADRATIC OPTIMIZATION PROBLEMS; REAL WORLD DATA; VERY LARGE DATUM;

CLASSIFICATION (OF INFORMATION); COMPUTATIONAL COMPLEXITY; COMPUTATIONAL EFFICIENCY; COMPUTER SOFTWARE SELECTION AND EVALUATION; OPTIMIZATION; QUADRATIC PROGRAMMING;

FEATURE EXTRACTION;

EID: 77951965521     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Article

References (39)

1. E. Anderson, Z. Bai, J. Dongarra, A. Greenbaum, A. McKenney, J. Du Croz, S. Hammarling, J. Demmel, C. H. Bischof, and Danny C. Sorensen. LAPACK: a portable linear algebra library for high-performance computers. In SC, pages 2-11, 1990.
2. R. Bekkerman, N. Tishby, Y. Winter, I. Guyon, and A. Elisseeff. Distributional word clusters vs. words for text categorization. Journal of Machine Learning Research, 3:1183-1208, 2003.
3. D.P. Bertsekas. Nonlinear Programming. Athena Scientific, September 1999.
4. L. Breiman, J.H. Friedman, R.A. Olshen, and C.J.Stone. Classification and Regression Trees. Chapman & Hall/CRC, January 1984.
5. C. Chang and C. Lin. LIBSVM: a library for support vector machines, 2001. Software available at http://www.csie.ntu.edu.tw/~cjlin/libsvm.
6. T. M. Cover and J. A. Thomas. Elements of information theory. Wiley-Interscience, New York, NY, USA, 1991.
7. T.M. Cover. The best two independent measurements are not the two best. IEEE Trans. Systems, Man, and Cybernetics, 4:116-117, 1974.
8. C. Ding and H. Peng. Minimum redundancy feature selection from microarray gene expression data. J Bioinform Comput Biol, 3(2): 185-205, April 2005.
9. R. O. Duda, P.E. Hart, and D. G. Stork. Pattern Classification (2nd Edition). Wiley-Interscience, November 2000.
10. S. Fine, K. Scheinberg, N. Cristianini, J. Shawe-Taylor, and B. Williamson. Efficient SVM training using low-rank kernel representations. Journal of Machine Learning Research, 2:243-264, 2001.
11. G. Forman. BNS feature scaling: an improved representation over TF-IDF for SVM text classification. In CIKM '08: Proceeding of the 17th ACM conference on Information and knowledge mining, pages 263-270, New York, NY, USA, 2008. ACM.
12. G. Forman. An extensive empirical study of feature selection metrics for text classification. J. Mach. Learn. Res., 3:1289-1305, 2003.
13. C. Fowlkes, S. Belongie, and J. Malik. Efficient spatiotemporal grouping using the Nyström method. In Proc. IEEE Conf. Comput. Vision and Pattern Recognition, pages 231-238, 2001.
14. D. Goldfarb and A. Idnani. A numerically stable dual method for solving strictly convex quadratic programs. Mathematical Programming, 27(1): 1-33, 1983.
15. I. Guyon. An introduction to variable and feature selection. Journal of Machine Learning Research, 3:1157-1182, 2003.
16. M. A. Hall. Correlation-based feature selection for discrete and numeric class machine learning. In Proceedings of the International Conference on Machine Learning, pages 359-366. Morgan Kaufmann, 2000.
17. J. Hua, W. D. Tembe, and E. R. Dougherty. Performance of feature-selection methods in the classification of high-dimension data. Pattern Recogn., 42(3):409-424, 2009.
18. A. K. Jain, R. P. W. Duin, and J. Mao. Statistical pattern recognition: A review. IEEE Trans. Pattern Anal. Mach. Intell., 22(1):4-37, January 2000.
19. G. John, R. Kohavi, and K. Pfleger. Irrelevant features and the subset selection problem. In Machine Learning: Proceedings of the Eleventh International Conference, San Francisco, 1994.
20. R. Kohavi and G. H. John. Wrappers for feature subset selection. Artificial Intelligence, 97(1-2): 273-324, 1997.
21. S. Kumar, M. Mohri, and A. Talwalkar. Sampling techniques for the Nyström method. In Proceeding of the 12th International Conference on Artificial Intelligence and Statistics (AISTATS), 2009.
22. P. Langley. Selection of relevant features in machine learning. In Proceedings of the AAAI Fall symposium on relevance, pages 140-144. AAAI Press, 1994.
23. F. Lauer, C. Y. Suen, and G. Bloch. A trainable feature extractor for handwritten digit recognition. Pattern Recogn., 40(6): 1816-1824, 2007.
24. Y. Lecun, Y. Bengio, and P. Haffner. Gradient-based learning applied to document recognition. In Proceedings of the IEEE, pages 2278-2324, 1998.
25. R. Leitner, H. Mairer, and A. Kercek. Real-time classification of polymers with NIR spectral imaging and blob analysis. Real-Time Imaging, 9:245-251, 2003.
26. T. Li, C. Zhang, and M. Ogihara. A comparative study of feature selection and multiclass classification methods for tissue classification based on gene expression. Bioinformatics, 20:2429-2437, 2004.
27. K. Momen, S. Krishnan, and T. Chau. Real-time classification of forearm electromyographic signals corresponding to user-selected intentional movements for multifunction prosthesis control. Neural Systems and Rehabilitation Engineering, IEEE Transactions on, 15(4):535-542, Dec. 2007.
28. J. Neter and W. Wasserman. Applied Linear Statistical Models. Richard D. Irwin, INC., 1974.
29. H. Peng, F. Long, and C. Ding. Feature selection based on mutual information: criteria of max-dependency, max-relevance, and min-redundancy. IEEE Trans. Pattern Anal. Mach. Intell, 27: 1226-1238, 2005. Software available at http: //research. janelia.org/peng/proj/mRMR/.
30. M. Robnik-Šikonja and I. Kononenko. Theoretical and empirical analysis of ReliefF and RReliefF. Mach. Learn., 53(1-2):23-69, 2003.
31. J. Rodriguez, A. Goni, and A. Illarramendi. Real-time classification of ECGs on a PDA. IEEE Transactions on Information Technology in Biomedicine, 9(1):23-34, 2005.
32. P. Shenoy, K. J. Miller, B. Crawford, and R. N. Rao. Online electromyographic control of a robotic prosthesis. IEEE Trans Biomed Eng, 55(3): 1128-1135, Mar 2008.
33. B. A. Turlach and A. Weingessel. The quadprog package, version 1.4-11, 2000. Available electronically at cran.r-project.org/web/packages/quadprog/ index.html.
34. J. Weston, S. Mukherjee, O. Chapelle, M. Pontil, T. Poggio, and V. Vapnik. Feature selection for SVMs. In Advances in Neural Information Processing Systems 13, pages 668-674. MIT Press, 2001.
35. C. K. I. Williams and M. Seeger. Using the Nyström method to speed up kernel machines. In Advances in Neural Information Processing Systems 13, pages 682-688. MIT Press, 2001.
36. L. Yu and H. Liu. Feature selection for high-dimensional data: A fast correlation-based filter solution. In Proceedings of the Twentieth International Conference on Machine Learning (ICML-03), 2003.
37. Y Zhang, C. Ding, and T. Li. Gene selection algorithm by combining reliefF and mRMR. BMC Genomics, 9(Suppl 2), 2008.
38. J. Zhou, D. P. Foster, R. A. Stine, and L. H. Ungar. Streamwise feature selection. J. Mach. Learn. Res., 7:1861-1885, 2006.
39. S. Zhu, D. Wang, and T. Li. Feature selection for gene expression using model-based entropy. IEEE/ACM Transactions on Computational Biology and Bioinformatics, 99(1), 2008.