A direct estimation approach to sparse linear discriminant analysis

Journal of the American Statistical Association

Volumn 106, Issue 496, 2011, Pages 1566-1577

  Cai, Tony ^a   Liu, Weidong ^b  

^a UNIVERSITY OF PENNSYLVANIA   (United States)

^b SHANGHAI JIAO TONG UNIVERSITY   (China)

Author keywords

Classification; Constrained l1; Fisher's rule; Minimization; Naive bayes rule; Sparsity

Indexed keywords

EID: 84862957781     PISSN: 01621459     EISSN: None     Source Type: Journal    
DOI: 10.1198/jasa.2011.tm11199     Document Type: Article

References (24)

1. Anderson, T. W. (2003), An Introduction to Multivariate Statistical Analysis (3rd ed.), New Jersey: Wiley-Interscience. [1566,1568]
2. Becker, S., Candès, E., and Grant, M. (2011), "Templates for Convex Cone Problems With Applications to Sparse Signal Recovery," Mathematical Programming Computation, 3, 165-218. [1571]
3. Bickel, P., and Levina, L. (2004), "Some Theory for Fisher's Linear Discriminant Function, 'Naive Bayes,' and Some Alternatives When There Are ManyMore Variables Than Observations," Bernoulli, 10, 989-1010. [1566]
4. Boyd, S., and Vandenberghe, L (2004), Convex Optimization, Cambridge: Cambridge University Press. [1571]
5. Cai, T., and Liu, W. (2011a), "Adaptive Thresholding for Sparse Covariance Matrix Estimation," Journal of the American Statistical Association, 106, 672-684. [1575]
6. Cai, T., and Liu, W. (2011b), Supplementary Material of "A Direct Estimation Approach to Sparse Linear Discriminant Analysis," Technical report, University of Pennsylvania. [1575]
7. Cai, T., and Zhou, H. (2010), "Optimal Rates of Convergence for Sparse Covariance Matrix Estimation," Technical report, University of Pennsylvania. [1569]
8. Cai, T., Liu, W., and Luo, X. (2011), "A Constrained l1 Minimization Approach to Sparse Precision Matrix Estimation," Journal of the American Statistical Association, 106, 594-607. [1567,1571,1575]
9. Candès, E., and Tao, T. (2007), "The Dantzig Selector: Statistical Estimation When p Is Much Larger Than n," The Annals of Statistics, 35, 2313-2351. [1568,1571]
10. Donoho, D., Elad, M., and Temlyakov, V. (2006), "Stable Recovery of Sparse Overcomplete Representations in the Presence of Noise," IEEE Transactions on Information Theory, 52, 6-18. [1568]
11. Fan, J., and Fan, Y. (2008), "High Dimensional Classification Using Features Annealed Independence Rules," The Annals of Statistics, 36, 2605-2637. [1566,1571,1573,1574]
12. Fang, K. T., and Anderson, T. W. (1990), Statistical Inference in Elliptically Contoured and Related Distributions, New York: Allerton Press Inc. [1570]
13. Friedman, J. H. (1989), "Regularized Discriminant Analysis," Journal of the American Statistical Association, 84, 165-175. [1567]
14. Golub, T. R., Slonim, D. K., Tamayo, P., Huard, C., Gaasenbeek, M., Mesirov, J. P., Coller, H., Loh, M. L., Downing, J. R., Caligiuri, M. A., Bloomfield, C. D., and Lander, E. S. (1999), "Molecular Classification of Cancer: Class Discovery and Class Prediction by Gene Expression Monitoring," Science, 286, 531-537. [1573]
15. Gordon, G. J., Jensen, R. V., Hsiao, L. L., Gullans, S. R., Blumenstock, J. E., Ramaswamy, S., Richards, W. G., Sugarbaker, D. J., and Bueno, R. (2002), "Translation ofMicroarray Data Into Clinically Relevant Cancer Diagnostic Tests Using Gene Expression Ratios in Lung Cancer and Mesothelioma," Cancer Research, 62, 4963-4967. [1573]
16. Guo, Y., Hastie, T., and Tibshirani, R. (2007), "Regularized Linear Discriminant Analysis and Its Application in Microarrays," Biostatistics, 8, 86-100. [1567]
17. Hall, P., Titterington, D. M., and Xue, J. H. (2009), "Median-Based Classifiers for High-Dimensional Data," Journal of the American Statistical Association, 104, 1597-1608. [1567]
18. Ravikumar, P., Wainwright, M., Raskutti, G., and Yu, B. (2008), "High-Dimensional Covariance Estimation by Minimizing l1-Penalized Log-Determinant Divergence," Technical Report 797, UC Berkeley, Statistics Dept. [1567]
19. Rothman, A., Bickel, P., Levina, E., and Zhu, J. (2008), "Sparse Permutation Invariant Covariance Estimation," Electronic Journal of Statistics, 2, 494-515. [1567]
20. Shao, J., Wang, Y., Deng, X., and Wang, S. (2011), "Sparse Linear Discriminant AnalysisWith High Dimensional Data," The Annals of Statistics, 39, 1241-1265. [1566,1568-1571]
21. Tibshirani, R., Hastie, T., Narasimhan, B., and Chu, G. (2002), "Diagnosis of Multiple Cancer Types by Shrunken Centroids of Gene Expression," Proceedings of the National Academy of Sciences of the United States of America, 99, 6567-6572. [1567,1570,1571,1573]
22. Witten, D., and Tibshirani, R. (2009), "Covariance-Regularized Regression and Classification for High Dimensional Problems," Journal of the Royal Statistical Society, Ser. B, 71, 615-636. [1567]
23. Wu, M. C., Zhang, L., Wang, Z., Christiani, D. C., and Lin, X. (2009), "Sparse Linear Discriminant Analysis for Simultaneous Testing for the Significance of a Gene Set/Pathway and Gene Selection," Bioinformatics, 25, 1145-1151. [1567]
24. Yuan, M. (2009), "Sparse Inverse Covariance Matrix Estimation via Linear Programming," Journal of Machine Learning Research, 11, 2261-2286. [1567,1571]