Feature selection for regularized least-squares: New computational short-cuts and fast algorithmic implementations

Proceedings of the 2010 IEEE International Workshop on Machine Learning for Signal Processing, MLSP 2010

Volumn , Issue , 2010, Pages 295-300

  Pahikkala, Tapio ^a   Airola, Antti ^a   Salakoski, Tapio ^a  

^a UNIVERSITY OF TURKU   (Finland)

Author keywords

[No Author keywords available]

Indexed keywords

EFFICIENT IMPLEMENTATION; FEATURE SELECTION; FEATURE SELECTION ALGORITHM; LEAST SQUARE; LEAST SQUARES SUPPORT VECTOR MACHINES; LEAVE-ONE-OUT CRITERIONS; LINEAR PREDICTORS; OPTIMAL SEARCH; POWER SET; RIDGE REGRESSION; SEARCH HEURISTICS; TRAINING EXAMPLE;

HEURISTIC ALGORITHMS; LEARNING SYSTEMS; REGRESSION ANALYSIS; SIGNAL PROCESSING;

FEATURE EXTRACTION;

EID: 78449310771     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/MLSP.2010.5589210     Document Type: Conference Paper

References (17)

1. I. Guyon and A. Elisseeff, "An introduction to variable and feature selection," Journal of Machine Learning Research, vol. 3, pp. 1157-1182, 2003.
2. R. Kohavi and G.H. John, "Wrappers for feature subset selection," Artificial Intelligence, vol. 97, no. 1-2, pp. 273-324, 1997.
3. George H. John, Ron Kohavi, and Karl Pfleger, "Irrelevant features and the subset selection problem," in Proceedings of the Eleventh International Conference on Machine Learning, William W. Cohen and Haym Hirsch, Eds., San Fransisco, CA, 1994, pp. 121-129, Morgan Kaufmann Publishers.
4. P. Pudil, J. Novovičová, and J. Kittler, "Floating search methods in feature selection," Pattern Recogn. Lett., vol. 15, no. 11, pp. 1119-1125, 1994.
5. T. Zhang, "Adaptive forward-backward greedy algorithm for sparse learning with linear models," in Advances in Neural Information Processing Systems 21, D. Koller, D. Schuurmans, Y. Bengio, and L. Bottou, Eds., pp. 1921-1928. MIT Press, 2009.
6. G. Van Dijck and M.M. Van Hulle, "Speeding up the wrapper feature subset selection in regression by mutual information relevance and redundancy analysis," in Proceedings of the 16th International Conference on Artificial Neural Networks (ICANN 2006), S.D. Kollias, A. Stafylopatis, W. Duch, and E. Oja, Eds. 2006, vol. 4131 of Lecture Notes in Computer Science, pp. 31-40, Springer.
7. A. E. Hoerl and R. W. Kennard, "Ridge regression: Biased estimation for nonorthogonal problems," Technometrics, vol. 12, pp. 55-67, 1970.
8. J. Suykens, T. Van Gestel, J. De Brabanter, B. De Moor, and J. Vandewalle, Least Squares Support Vector Machines, World Scientific Pub. Co., Singapore, 2002.
9. R. Rifkin, G. Yeo, and T. Poggio, "Regularized least-squares classification," in Advances in Learning Theory: Methods, Model and Applications, J.A.K. Suykens, G. Horvath, S. Basu, C. Micchelli, and J. Vandewalle, Eds., vol. 190 of NATO Science Series III: Computer and System Sciences, chapter 7, pp. 131-154. IOS Press, Amsterdam, 2003.
10. T. Pahikkala, E. Tsivtsivadze, A. Airola, J. Boberg, and T. Salakoski, "Learning to rank with pairwise regularized least-squares," in SIGIR 2007 Workshop on Learning to Rank for Information Retrieval, T. Joachims, H. Li, T-Y. Liu, and C. Zhai, Eds., 2007, pp. 27-33.
11. T. Pahikkala, E. Tsivtsivadze, A. Airola, J. Boberg, and J. Järvinen, "An efficient algorithm for learning to rank from preference graphs," Machine Learning, vol. 75, no. 1, pp. 129-165, 2009.
12. T. Pahikkala, J. Boberg, and T. Salakoski, "Fast n-fold cross-validation for regularized least-squares," in Proceedings of the 9th Scandinavian Conference on Artificial Intelligence (SCAI 2006), T. Honkela, T. Raiko, J. Kortela, and H. Valpola, Eds., 2006, pp. 83-90.
13. R. Rifkin and R. Lippert, "Notes on regularized least squares," Tech. Rep. MIT-CSAIL-TR-2007-025, Massachusetts Institute of Technology, 2007.
14. E.K. Tang, P.N. Suganthan, and X. Yao, "Gene selection algorithms for microarray data based on least squares support vector machine," BMC Bioinformatics, vol. 7, pp. 95, 2006.
15. F. Ojeda, J.A.K. Suykens, and B. De Moor, "Low rank updated LS-SVM classifiers for fast variable selection," Neural Networks, vol. 21, no. 2-3, pp. 437-449, 2008.
16. T. Pahikkala, A. Airola, and T. Salakoski, "Linear time feature selection for regularized least-squares," 2010, http://arxiv.org/abs/1003. 3570.
17. C. Saunders, A. Gammerman, and V. Vovk, "Ridge regression learning algorithm in dual variables," in Proceedings of the Fifteenth International Conference on Machine Learning, San Francisco, CA, USA, 1998, pp. 515-521, Morgan Kaufmann Publishers Inc.