A regularization approach to nonlinear variable selection

Journal of Machine Learning Research

Volumn 9, Issue , 2010, Pages 653-660

  Rosasco, L ^a   Santoro, M ^b   Mosci, S ^b   Verri, A ^b   Villa, S ^b  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b UNIVERSITY OF GENOA   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

EMPIRICAL PROPERTIES; INPUT VARIABLES; ITERATIVE PROCEDURES; NONLINEAR VARIABLES; PARTIAL DERIVATIVES; REGRESSION FUNCTION; REGULARIZATION APPROACH; REGULARIZATION SCHEMES; REGULARIZED LEAST SQUARES; RIDGE REGRESSION; VARIABLE SELECTION; VARIATIONAL PROBLEMS;

REGRESSION ANALYSIS;

ARTIFICIAL INTELLIGENCE;

EID: 84862290026     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (23)

1. F. Bach. Exploring large feature spaces with hierarchical multiple kernel learning. In NIPS, Sep 2008.
2. Mikhail Belkin and Partha Niyogi. Towards a theoretical foundation for laplacian-based manifold methods. Journal of Computer and System Sciences, 74 (8):1289-1308, 2008.
3. E. J. Candès and T. Tao. The dantzig selector: statistical estimation when p is much larger than n. Annals of Statistics, 35:2313-2351, 2005.
4. P. L. Combettes and V. R. Wajs. Signal recovery by proximal forward-backward splitting. Multiscale Model. Simul., 4(4):1168-1200 (electronic), 2005.
5. I. Daubechies, G. Teschke, and L. Vese. Iteratively solving linear inverse problems under general convex constraints. Inverse Problems and Imaging, 1(1):29-46, 2007.
6. C. De Mol, Mosci, M. S. Traskine, and A. Verri. A regularized method for selecting nested groups of relevant genes from microarray data. Journal of Computational Biology, 16(5):677-690, May 2009.
7. E. De Vito, L. Rosasco, A. Caponnetto, U. De Giovannini, and F. Odone. Learning from examples as an inverse problem. Journal of Machine Learning Research, 6:883-904, May 2005.
8. B. Efron, T. Hastie, I. Johnstone, and R. Tibshirani. Least angle regression. Annals of Statistics, 32:407-499, 2004.
9. M.A.T. Figueiredo, R.D. Nowak, and S.J. Wright. Gradient projection for sparse reconstruction: Application to compressed sensing and other inverse problems. Technical report, IEEE Journal of Selected Topics in Signal Processing, 2007.
10. T. Golub, D. Slonim, P. Tamayo, C. Huard, M. Gaasenbeek, J. Mesirov, H. Coller, M. Loh, J. Downing, M. Caligiuri, C. Bloomfield, and E. Lander. Molecular classification of cancer: Class discovery and class prediction by gene expression monitoring. Science, 286:531-537, 1999.
11. I. Guyon, H. Bitter, Z. Ahmed, M. Brown, and J. Heller. Multivariate Non-Linear Feature Selection with Kernel Methods, pages 313-326. Springer Berlin / Heidelberg, 2006.
12. E. T. Hale, W. Yin, and Y. Zhang. Fixed-point continuation for l1-minimization: Methodology and convergence. SIOPT, 19(3):1107-1130, 2008.
13. T. N. Lal, O. Chapelle, J. Weston, and A. Elisseeff. Embedded methods. Foundations and Applications, Studies in Fuzziness and Soft Computing, 207:137-165, 2006.
14. B. Y. Lin and H. H. Zhang. Component selection and smoothing in multivariate nonparametric regression. Annals of Statistics, 34(5):2272-2297, 2006.
15. P.-L. Lions and B. Mercier. Splitting algorithms for the sum of two nonlinear operators. SIAM J. Numer. Anal., 16(6):964-979, 1979.
16. S. Mukherjee and D. Zhou. Learning coordinate covariances via gradients. Journal of Machine Learning Research, 7:319-349, 2006.
17. P. Ravikumar, H. Liu, J. Lafferty, and L. Wasserman. Spam: Sparse additive models. In J.C. Platt, D. Koller, Y. Singer, and S. Roweis, editors, Advances in Neural Information Processing Systems. 2008.
18. L. Rosasco, S. Mosci, M. Santoro, A. Verri, and S. Villa. Iterative projection methods for structured sparsity regularization. Technical Report MITCSAIL- TR-2009-50 / CBCL-282, Massachusetts Institute of Technology, Cambridge, MA, 2009.
19. B. Schölkopf and A. Smola. Learning with Kernels. MIT Press, Cambridge (MA), 2002.
20. R. Tibshirani. Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society, Series B, 56:267-288, 1996.
21. Q. Wu, F. Liang, and S. Mukherjee. Consistency of regularized sliced inverse regression for kernel models. Technical report. Duke University and University of Illinois Urbana-Champaign, 2008.
22. Tong Zhang. Adaptive forward-backward greedy algorithm for sparse learning with linear models. In Advances in Neural Information Processing Systems, pages 1921-1928. 2009.
23. Ding-Xuan Zhou. Derivative reproducing properties for kernel methods in learning theory. J. Comput. Appl. Math., 220:456-463, 2008.