Feature selection guided by structural information

Annals of Applied Statistics

Volumn 4, Issue 2, 2010, Pages 1056-1080

  Slawski, Martin ^a   Castell, Wolfgang zu ^b   Tutz, Gerhard ^c  

^a SAARLAND UNIVERSITY   (Germany)

^b INSTITUTE OF EPIDEMIOLOGY   (Germany)

^c UNIVERSITY OF MUNICH   (Germany)

Author keywords

Elastic net; Generalized linear model; Lasso; Model selection; P and Gt; n; Random fields; Regularization; Signal regression; Sparsity

Indexed keywords

EID: 77955405900     PISSN: 19326157     EISSN: 19417330     Source Type: Journal    
DOI: 10.1214/09-AOAS302     Document Type: Article

References (30)

1. Belkin, M., Niyogi, P. and Sindwhani, V. (2006). Manifold regularization: A geometric framework for learning from labeled and unlabeled examples.J. Mach. Learn. Res. 7 2399-2434.
2. Besag, J. (1974). Spatial interaction and the statistical analysis of lattice systems (with discussion). J. Roy. Statist. Soc. Ser. B 36 192-236.
3. Chung, F. (1997). Spectral Graph Theory. AMS Publications.
4. Daumer, M., Thaler, K., Kruis, E., Feneberg, W., Staude, G. and Scholz, M. (2007). Steps towards a miniaturized, robust and autonomous measurement device for the long-term monitoring of patient activity: ActiBelt. Biomed. Tech. 52 149-155.
5. Donoho, D., Elad, M. and Temlyakov, V. (2006). Stable recovery of sparse overcomplete representations in the presence of noise. IEEE Trans. Inform. Theory 52 6-18.
6. Efron, B., Hastie, T., Johnstone, I. and Tibshirani, R. (2004). Least angle regression (with discussion). Ann. Statist. 32 407-499.
7. Eilers, P. and Marx, B. (1996). Flexible smoothing with B-splines and penalties (with discussion). Statist. Sci. 11 89-121.
8. Eilers, P. and Marx, B. (1999). Generalized linear regression on sampled signals and curves: A P-spline approach. Technometrics 41 1-13.
9. Fan, J. and Li, R. (2001). Variable selection via nonconcave penalized likelihood and its oracle properties. J. Amer. Statist. Assoc. 96 1348-1360.
10. Frank, I. and Friedman, J. (1993). A statistical view of some chemometrics regression tools (with discussion). Technometrics 35 109-148.
11. Friedman, J., Hastie, T., Hoefling, H. and Tibshirani, R. (2007). Pathwise coordinate optimization. Ann. Appl. Statist. 2 302-332.
12. Genkin, A., Lewis, D. and Madigan, D. (2007). Large-scale Bayesian logistic regression for text categorization. Technometrics 49 589-616.
13. 1-penalized estimation. Technical report, Dept. Medical Statistics and Bioinformatics, Univ. Leiden.
14. Hastie, T., Buja, A. and Tibshirani, R. (1995). Penalized discriminant analysis. Ann. Statist. 23 73-102.
15. Hoerl, A. and Kennard, R. (1970). Ridge regression: Biased estimation for nonorthogonal problems. Technometrics 8 27-51.
16. Knight, K. and Fu, W. (2000). Asymptotics for lasso-type estimators. Ann. Statist. 28 1356-1378.
17. Le Cun, Y., Boser, B., Denker, J., Henderson, D., Howard, R., Hubbard, W. and Jackel, L. (1989). Backpropagation applied to handwritten zip code recognition. Neural Comput. 2 541-551.
18. McCullagh, P. and Nelder, J. (1989). Generalized Linear Models. Chapman & Hall, London.
19. Park, T. and Casella, G. (2008). The Bayesian lasso. J. Amer. Statist. Assoc.103 681-686.
20. Rosenberg, S. (1997). The Laplacian on a Riemannian Manifold. Cambridge Univ. Press, Cambridge.
21. Rosset, S., Zhu, J. and Hastie, T. (2004). Boosting as a regularized path to a maximum margin classifier. J. Mach. Learn. Res. 5 941-973.
22. Rue, H. and Held, L. (2001). Gaussian Markov Random Fields. Chapman & Hall/CRC, Boca Raton.
23. Slawski, M., zu Castell, W. and Tutz, G. (2009). Feature selection guided by structural Information. Technical report, Dept. Statistics, Univ. Munich. Available at http://epub.ub.uni-muenchen.de/10251/.
24. Slawski, M., zu Castell, W. and Tutz, G. (2010). Supplement to "Feature selection guided by structural information". DOI: 10.1214/09-AOAS302SUPP.
25. Tibshirani, R. (1996). Regression shrinkage and variable selection via the lasso. J. Roy. Statist. Soc. Ser. B 58 671-686.
26. Tibshirani, R., Saunders, M., Rosset, S., Zhu, J. and Knight, K. (2005). Sparsity and smoothness via the fused lasso. J. Roy. Statist. Soc. Ser. B 67 91-108.
27. Tutz, G. and Gertheiss, J. (2010). Feature extraction in signal regression: A boosting technique for functional data regression. J. Computat. Graph. Statist. 19 154-174.
28. Zhao, P. and Yu, B. (2006). On model selection consistency of the lasso. J. Mach. Learn. Res. 7 2541-2567.
29. Zou, H. (2006). The adaptive lasso and its oracle properties. J. Amer. Statist. Assoc. 101 1418-1429.
30. Zou, H. and Hastie, T. (2005). Regularization and variable selection via the elastic net. J. Roy. Statist. Soc. Ser. B 67 301-320.