Variable selection via A combination of the L0 and L1 penalties

Journal of Computational and Graphical Statistics

Volumn 16, Issue 4, 2007, Pages 782-798

  Liu, Yufeng ^a   Wu, Yichao ^b  

^a University of North Carolina at Chapel Hill   (United States)

^b Princeton University   (United States)

Author keywords

Mixed integer programming; Regression; Regularization; SVM; Variable selection

Indexed keywords

EID: 38049162221     PISSN: 10618600     EISSN: None     Source Type: Journal    
DOI: 10.1198/106186007X255676     Document Type: Article

References (19)

1. Boyd, S., and Vandenberghe, L. (2004), Convex Optimization, New York: Cambridge University Press.
2. Bradley, P., and Mangasarian, O. (1998), "Feature Selection via Concave Minimization and Support Vector Machines," in ICML'98, ed. J. Shavlik, San Francisco: Morgan Kaufmann.
3. Cristianini, N., and Shawe-Taylor, J. (1999), "An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods," New York: Cambridge University Press.
4. Donoho, D. L., and Johnstone, I. (1994), "Ideal Spatial Adaptation by Wavelet Shrinkage," Biometrika, 81, 425-455.
5. Donoho, D. L., Johnstone, I. M., Kerkyacharian, G., and Picard, D. (1995), "Wavelet Shrinkage; Asymptopia?," Journal of the Royal Statistical Society, Ser. B, 35, 109-148.
6. Fan, J., and Li, R. (2001), "Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties," Journal of the American Statistical Association, 96, 1348-1360.
7. Frank, I. E., and Friedman, J. H. (1993), "A Statistical View of Some Chemometrics Regression Tools," Technometrics, 35, 109-135.
8. Fourer, R., Gay, D.M., and Kernighan, B.W. (2003), AMPL: A Modeling Language for Mathematical Programming, Belmont, CA: Duxbury Press.
9. Garfinkel, R. S., and Nemhauser, G. L. (1972), Integer Programming, New York: Wiley.
10. Hoerl, A. E., and Kennard, R. W. (1970), "Ridge Regression: Biased Estimation for Nonorthogonal Problems," Technometries, 12, 55-67.
11. Kim, J., and Pollard, D. (1990), "Cube Root Asymptotics," The Annals of Statistics, 18, 191-219.
12. Knight, K., and Fu, W. J. (2000), "Asymptotics for Lasso-Type Estimators," The Annals of Statistics, 28, 1356-1378.
13. Liu, Y., Shen, X., and Doss, H. (2005), "Multicategory ψ-Learning and Support Vector Machine: Computational Tools," Journal of Computational and Graphical Statistics, 14, 219-236.
14. Liu, Y., and Wu, Y. (2006), "Optimizing ψ-Learning via Mixed Integer Programming," Statistica Sinica, 16, 2, 441-457.
15. Nemhauser, G.L., and Wolsey, L.A. (1999), Integer and Combinatorial Optimization, New York: Wiley.
16. Sigillito, V. G., Wing, S. P., Hutton, L. V., and Baker, K. B. (1989), "Classification of Radar Returns from the Ionosphere Using Neural Networks," Johns Hopkins APL Technical Digest, 10, 262-266.
17. Tibshirani, R. J. (1996), "Regression Shrinkage and Selection via the Lasso," Journal of the Royal Statistical Society, Ser. B, 58, 267-288.
18. Vapnik, V. (1998), Statistical Learning Theory, New York: Wiley.
19. Zhu, J., Hastie, T., Rosset, S., and Tibshirani, R. (2003), "1-norm Support Vector Machines," Neural Information Processing Systems, 16.