A road to classification in high dimensional space: The regularized optimal affine discriminant

Journal of the Royal Statistical Society. Series B: Statistical Methodology

Volumn 74, Issue 4, 2012, Pages 745-771

  Fan, Jianqing ^a   Feng, Yang ^b   Tong, Xin ^a  

^a PRINCETON UNIVERSITY   (United States)

^b Och Spine at New York Presbyterian Hospitals   (United States)

Author keywords

Fisher discriminant; High dimensional classification; Independence rule; Linear discriminant analysis; Regularized optimal affine discriminant

Indexed keywords

EID: 84865137728     PISSN: 13697412     EISSN: 14679868     Source Type: Journal    
DOI: 10.1111/j.1467-9868.2012.01029.x     Document Type: Article

References (39)

1. Ackermann, M. and Strimmer, K. (2009) A general modular framework for gene set enrichment analysis. BMC Bioinform., 10, article 47.
2. Antoniadis, A., Lambert-Lacroix, S. and Leblanc, F. (2003) Effective dimension reduction methods for tumor classification using gene expression data. Bioinformatics, 19, 563-570.
3. Bair, E., Hastie, T., Paul, D. and Tibshirani, R. (2006) Prediction by supervised principal components. J. Am. Statist. Ass., 101, 119-137.
4. Bickel, P. and Levina, E. (2004) Some theory for Fisher's linear discriminant function 'naive Bayes', and some alternatives when there are many more variables than observations. Bernoulli, 10, 989-1010.
5. Boulesteix, A.-L. (2004) PLS dimension reduction for classification with microarray data. Statist. Appl. Genet. Molec. Biol., 3, article 33.
6. Boyd, S. and Vandenberghe, L. (2004) Convex Optimization. Cambridge: Cambridge University Press.
7. Breheny, P. and Huang, J. (2011) Coordinate descent algorithms for nonconvex penalized regression, with applications to biological feature selection. Ann. Appl. Statist., 5, 232-253.
8. Domingos, P. and Pazzani, M. (1997) On the optimality of the simple bayesian classifier under zero-one loss. Mach. Learn., 29, 103-130.
9. Donoho, D. L. and Johnstone, I. M. (1994) Ideal spatial adaptation by wavelet shrinkage. Biometrika, 81, 425-455.
10. Dudoit, S., Fridlyand, J. and Speed, T. P. (2002) Comparison of discrimination methods for the classification of tumors using gene expression data. J. Am. Statist. Ass., 97, 77-87.
11. Efron, B., Hastie, T., Johnstone, I. and Tibshirani, R. (2004) Least angle regression. Ann. Statist., 32, 407-499.
12. Fan, J. and Fan, Y. (2008) High dimensional classification using features annealed independence rules. Ann. Statist., 36, 2605-2637.
13. Fan, J. and Li, R. (2001) Variable selection via nonconcave penalized likelihood and its oracle properties. J. Am. Statist. Ass., 96, 1348-1360.
14. Fan, J. and Lv, J. (2008) Sure independence screening for ultrahigh dimensional feature space (with discussion). J. R. Statist. Soc. B, 70, 849-911.
15. Fan, J. and Lv, J. (2010) A selective overview of variable selection in high dimensional feature space. Statist. Sin., 20, 101-148.
16. Golub, T. R., Slonim, D. K., Tamayo, P., Huard, C., Gaasenbeek, M., Mesirov, J. P., Coller, H., Loh, M. L., Downing, J. R., Caligiuri, M. A., Bloomfield, C. D. and Lander, E. S. (1999) Molecular classification of cancer: class discovery and class prediction by gene expression monitoring. Science, 286, 531-537.
17. Gordon, G. J., Jensen, R. V., Hsiao, L.-L., Gullans, S. R., Blumenstock, J. E., Ramaswamy, S., Richards, W. G., Sugarbaker, D. J. and Bueno, R. (2002) Translation of microarray data into clinically relevant cancer diagnostic tests using gene expression ratios in lung cancer and mesothelioma. Cancer Res., 62, 4963-4967.
18. Guo, Y., Hastie, T. and Tibshirani, R. (2005) Regularized discriminant analysis and its application in microarrays. Biostatistics, 1, 1-18.
19. Hastie, T., Tibshirani, R. and Friedman, J. H. (2009) The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd edn. New York: Springer.
20. Huang, X. P. W. (2003) Linear regression and two-class classification with gene expression data. Bioinformatics, 19, 2072-2078.
21. Krzanowski, W. J., Jonathan, P., McCarthy, W. V. and Thomas, M. R. (1995) Discriminant analysis with singular covariance matrices: methods and applications to spectroscopic data. Appl. Statist., 44, 101-115.
22. Lewis, D. D. (1998) Naive (Bayes) at Forty: the Independence Assumption in Information Retrieval, pp. 4-15. New York: Springer.
23. Li, K.-C. (1991) Sliced inverse regression for dimension reduction (with discussion). J. Am. Statist. Ass., 86, 316-342.
24. Nguyen, D. V. and Rocke, D. M. (2002) Tumor classification by partial least squares using microarray gene expression data. Bioinformatics, 18, 39-50.
25. Oberthuer, A., Berthold, F., Warnat, P., Hero, B., Kahlert, Y., Spitz, R., Ernestus, K., König, R., Haas, S., Eils, R., Schwab, M., Brors, B., Westermann, F. and Fischer, M. (2006) Customized oligonucleotide microarray gene expression based classification of neuroblastoma patients outperforms current clinical risk stratification. J. Clin. Oncol., 24, 5070-5078.
26. Rosset, S. and Zhu, J. (2007) Piecewise linear regularized solution paths. Ann. Statist., 35, 1012-1030.
27. Ruszcznski, A. (2006) Nonlinear Optimization. Princeton: Princeton University Press.
28. Shao, J., Wang, Y., Deng, X. and Wang, S. (2011) Sparse linear discriminant analysis by thresholding for high dimensional data. Ann. Statist., 39, 1241-1265.
29. Tibshirani, R. (1996) Regression shrinkage and selection via the lasso. J. R. Statist. Soc. B, 58, 267-288.
30. Tibshirani, R., Hastie, T., Narasimhan, B. and Chu, G. (2002) Diagnosis of multiple cancer types by shrunken centroids of gene expression. Proc. Natn. Acad. Sci. USA, 99, 6567-6572.
31. Tseng, P. (2001) Convergence of a block coordinate descent method for nondifferentiable minimization. J. Optim. Theory. Appl., 109, 475-494.
32. Vapnik, V. N. (1995) The Nature of Statistical Learning Theory. New York: Springer.
33. Wang, S. and Zhu, J. (2007) Improved centroids estimation for the nearest shrunken centroid classifier. Bioinformatics, 23, 972-979.
34. Zhang, C.-H. (2010) Nearly unbiased variable selection under minimax concave penalty. Ann. Statist., 38, 894-942.
35. Zhao, S. D. and Li, Y. (2010) Principled sure independence screening for Cox models with ultra-high-dimensional covariates. J. Multiv. Anal., to be published.
36. Zou, H. (2006) The adaptive lasso and its oracle properties. J. Am. Statist. Ass., 101, 1418-1429.
37. Zou, H. and Hastie, T. (2005) Regularization and variable selection via the elastic net. J. R. Statist. Soc. B, 67, 301-320.
38. Zou, H., Hastie, T. and Tibshirani, R. (2006) Sparse principal component analysis. J. Comput. Graph. Statist., 15, 265-286.
39. Zou, H. and Li, R. (2008) One-step sparse estimates in nonconcave penalized likelihood models. Ann. Statist., 36, 1509-1533.