Feature Augmentation via Nonparametrics and Selection (FANS) in High-Dimensional Classification

Journal of the American Statistical Association

Volumn 111, Issue 513, 2016, Pages 275-287

  Fan, Jianqing ^a   Feng, Yang ^b   Jiang, Jiancheng ^c   Tong, Xin ^d  

^a Princeton University   (United States)

^b Och Spine at New York Presbyterian Hospitals   (United States)

^c UNIVERSITY OF NORTH CAROLINA AT CHARLOTTE   (United States)

^d UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

Classification; Density estimation; Feature augmentation; Feature selection; High dimensional space; Nonlinear decision boundary; Parallel computing

Indexed keywords

EID: 84969895621     PISSN: 01621459     EISSN: 1537274X     Source Type: Journal    
DOI: 10.1080/01621459.2015.1005212     Document Type: Article

References (41)

1. M.Ackermann,, and K.Strimmer, (2009), “A General Modular Framework for Gene Set Enrichment Analysis,” BMC Bioinformatics, 10, 1471–2105.
2. A.Antoniadis,, S.Lambert-Lacroix,, and F.Leblanc, (2003), “Effective Dimension Reduction Methods for Tumor Classification Using Gene Expression Data,” Bioinformatics, 19, 563–570.
3. E.Bair,, T.Hastie,, D.Paul,, and R.Tibshirani, (2006), “Prediction by Supervised Principal Components,” Journal of American Statistical Association, 101, 119–137.
4. P.J.Bickel,, and E.Levina, (2004), “Some Theory for Fisher’s Linear Discriminant Function, ‘naive Bayes’, and Some Alternatives When There are Many More Variables Than Observations,” Bernoulli, 10, 989–1010.
5. A.-L.Boulesteix, (2004), “PLS Dimension Reduction for Classification With Microarray Data,” Statistical Applications in Genetics and Molecular Biology
6. L.Breiman, (2001), “Random Forests,” Machine Learning, 45, 5–32.
7. P.Bühlmann,, and S.van de Geer, (2011), Statistics for High-Dimensional Data, New York: Springer.
8. T.Cai,, and W.Liu, (2011), “A Direct Estimation Approach to Sparse Linear Discriminant Analysis,” Journal of American Statistical Association, 106, 1566–1577.
9. L.Clemmensen,, T.Hastie,, D.Witten,, and B.Ersboll, (2011), “Sparse Discriminant Analysis,” Technometrics, 53, 406–413.
10. S.Dudoit,, J.Fridlyand,, and T.P.Speed, (2002), “Comparison of Discrimination Methods for the Classification of Tumors Using Gene Expression Data,” Journal of American Statistical Association, 97, 77–87.
11. J.Fan,, and Y.Fan, (2008), “High-Dimensional Classification Using Features Annealed Independence Rules,” Annals of Statistics, 36, 2605–2637.
12. J.Fan,, Y.Feng,, and R.Song, (2011), “Nonparametric Independence Screening in Sparse Ultra-High Dimensional Additive Models,” Journal of American Statistical Association, 106, 544–557.
13. J.Fan,, Y.Feng,, and X.Tong, (2012), “A Road to Classification in High Dimensional Space: The Regularized Optimal Affine Discriminant,” Journal of the Royal Statistical Society, Series B, 74, 745–771.
14. J.Fan,, and R.Li, (2001), “Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties,” Journal of American Statistical Association, 96, 1348–1360.
15. J.Fan,, and J.Lv, (2008), “Sure Independence Screening for Ultrahigh Dimensional Feature Space” (with discussion), Journal of the Royal Statistical Society, Series B, 70, 849–911.
16. J.Friedman,, T.Hastie,, H.Höfling,, and R.Tibshirani, (2007), “Pathwise Coordinate Optimization,” Annals of Applied Statistics, 1, 302–332.
17. J.Friedman,, T.Hastie,, and R.Tibshirani, (2010), “Regularization Paths for Generalized Linear Models via Coordinate Descent,” Journal of Statistical Software, 33, 1–22.
18. W.J.Fu,, R.J.Carroll,, and S.Wang, (2005), “Estimating Misclassification Error With Small Samples via Bootstrap Cross-Validation,” Bioinformatics, 21, 1979–1986.
19. G.J.Gordon,, R.V.Jensen,, L.-L.Hsiao,, S.R.Gullans,, J.E.Blumenstock,, S.Ramaswamy,, W.G.Richards,, D.J.Sugarbaker,, and R.Bueno, (2002), “Translation of Microarray Data Into Clinically Relevant Cancer Diagnostic Tests Using Gene Expression Ratios in Lung Cancer and Mesothelioma,” Cancer Research, 62, 4963–4967.
20. Y.Guo,, T.Hastie,, and R.Tibshirani, (2007), “Regularized Linear Discriminant Analysis and its Application in Microarrays,” Biostatistics, 8, 86–100.
21. T.Hastie,, and R.Tibshirani, (1990), Generalized Addtive Models, London: Chapman & Hall/CRC.
22. T.Hastie,, R.Tibshirani,, and J.H.Friedman, (2009), The Elements of Statistical Learning: Data Mining, Inference, and Prediction (2nd ed.), New York: Springer-Verlag Inc.
23. P.W.X.Huang, (2003), “Linear Regression and Two-Class Classification With Gene Expression Data,” Bioinformatics, 19, 2072–2978.
24. K.-C.Li, (1991), “Sliced Inverse Regression for Dimension Reduction” (with discussion), Journal of American Statistical Association, 86, 316–342
25. Q.Mai,, H.Zou,, and M.Yuan, (2012), “A Direct Approach to Sparse Discriminant Analysis in Ultra-High Dimensions,” Biometrika, 99, 29–42.
26. L.Meier,, V.Geer,, and P.Bühlmann, (2009), “High-Dimensional Additive Modeling,” Annals of Statistics, 37, 3779–3821.
27. D.V.Nguyen,, and D.M.Rocke, (2002), “Tumor Classification by Partial Least Squares Using Microarray Gene Expression Data,” Bioinformatics, 18, 39–50.
28. W.Polonik, (1995), “Measuring Mass Concentrations and Estimating Density Contour Clusters-An Excess Mass Approach,” Annals of Statistics, 23, 855–881.
29. V.Raykar,, R.Duraiswami,, and L.Zhao, (2010), “Fast Computation of Kernel Estimators,” Journal of Computational and Graphical Statistics, 19, 205–220.
30. J.Shao,, Y.Wang,, X.Deng,, and S.Wang, (2011), “Sparse Linear Discriminant Analysis by Thresholding for High Dimensional Data,” Annals of Statistics, 39, 1241–1265.
31. R.Tibshirani, (1996), “Regression Shrinkage and Selection via the Lasso,” Journal of the Royal Statistical Society, Series B, 58, 267–288.
32. X.Tong, (2013), “A Plug-in Approach to Anomaly Detection,” Journal of Machine Learning Research, 14, 3011–3040.
33. A.Tsybakov, (2004), “Optimal Aggregation of Classifiers in Statistical Learning,” Annals of Statistics, 32, 135–166.
34. S.Geer, (2008), “High-Dimensional Generalized Linear Models and the Lasso,” Annals of Statistics, 36, 614–645.
35. D.Witten,, and R.Tibshirani, (2012), “Penalized Classification Using Fisher’s Linear Discriminant,” Journal of the Royal Statistical Society, Series B, 73, 753–772.
36. M.C.Wu,, L.Zhang,, Z.Wang,, D.C.Christiani,, and X.Lin, (2009), “Sparse Linear Discriminant Analysis for Simultaneous Testing for the Significance of a Gene Set/Pathway and Gene Selection,” Bioinformatics, 25, 1145–1151.
37. C.-H.Zhang, (2010), “Nearly Unbiased Variable Selection Under Minimax Concave Penalty,” Annals of Statistics, 38, 894–942
38. C.-H.Zhang,, and J.Huang, (2008), “The Sparsity and Bias of the LASSO Selection in High-Dimensional Linear Regression,” Annals of Statistics, 36, 1567–1594.
39. P.Zhao,, and B.Yu, (2006), “On Model Selection Consistency of Lasso,” Journal of Machine Learning Research, 7, 2541–2563
40. H.Zou, (2006), “The Adaptive Lasso and its Oracle Properties,” Journal of American Statistical Association, 101, 1418–1429
41. H.Zou,, T.Hastie,, and R.Tibshirani, (2006), “Sparse Principal Component Analysis,” Journal of Computational and Graphical Statistics, 15, 265–286.