Higher criticism thresholding: Optimal feature selection when useful features are rare and weak

Proceedings of the National Academy of Sciences of the United States of America

Volumn 105, Issue 39, 2008, Pages 14790-14795

  Donoho, David ^a   Jin, Jiashun ^b,c  

^a STANFORD UNIVERSITY   (United States)

^b PURDUE UNIVERSITY   (United States)

^c CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

False discovery rate; Linear classification; Rare weak feature models; Threshold selection

Indexed keywords

ARTICLE; HIGH THROUGHPUT SCREENING; LINEAR REGRESSION ANALYSIS; MATHEMATICAL MODEL; MAXIMUM ALLOWABLE CONCENTRATION; METHODOLOGY; MOLECULAR DYNAMICS; PRIORITY JOURNAL; EPIDEMIOLOGY; GENOMICS; INFORMATION PROCESSING; PROTEOMICS; STATISTICAL MODEL; STATISTICS;

BIAS (EPIDEMIOLOGY); DATA COLLECTION; GENOMICS; LINEAR MODELS; PROTEOMICS;

EID: 54449086895     PISSN: 00278424     EISSN: 10916490     Source Type: Journal    
DOI: 10.1073/pnas.0807471105     Document Type: Article

References (23)

1. Anderson TW (2003) An Introduction to Multivariate Statistical Analysis (Wiley, New York), 3rd Ed.
2. Bickel P, Levina E (2004) Some theory of Fisher's linear discriminant function, 'naive Bayes', and some alternatives when there are many more variables than observations. Bernoulli 10:989-1010.
3. Fan J, Fan Y (2008) High dimensional classification using features annealed independence rules. Ann Statist, in press.
4. q-error. Probab Theory Relat Fields 2:277-303.
5. Donoho D, Johnstone I, Hoch JC, Stern AS (1992) Maximum entropy and the nearly black object. J R Stat Soc B 54:41-81.
6. Ingster YI (1997) Some problems of hypothesis testing leading to infinitely divisible distribution. Math Methods Stat 6:47-69.
7. Donoho D, Jin J (2004) Higher criticism for detecting sparse heterogeneous mixtures. Ann Stat 32:962-994.
8. Jin J (2003) Detecting and estimating sparse mixtures. Ph.D. thesis (Department of Statistics, Stanford University, Stanford).
9. Tibshirani R, Hastie T, Narasimhan B, Chu G (2002) Diagnosis of multiple cancer types by shrunken centroids of gene expression. Proc Natl Acad Sci USA 99:6567-6572.
10. Golub T, et al. (1999) Molecular classification of cancer: Class discovery and class prediction by gene expression monitoring. Science 286:531-536.
11. Hedenfalk I, et al. (2001) Gene-expression profile in hereditary breast cancer. N Engl J Med 344:539-548.
12. Benjamini Y, Hochberg Y (1995) Controlling the false discovery rate: A practical and powerful approach to multiple testing. J R Stat Soc B 57:289-300.
13. Abramovich F, Benjamini Y (1995) Wavelets and Statistics, eds Antoniadis A, Oppenheim G (Springer, New York), pp 5-14.
14. Abramovich F, Benjamini Y, Donoho D, Johnstone I (2006) Adapting to unknown sparsity by controlling the false discovery rate. Ann Stat 34:584-653.
15. Efron B, Tibshirani R, Storey J, Tusher V (2001) Empirical Bayes analysis of amicroarray experiment. J Am Stat Assoc 99:96-104.
16. Dettling M (2004) BagBoosting for tumor classification with gene expression data. Bioinformatics 20:3583-3593.
17. Alon U, et al. (1999) Broad patterns of gene expression revealed by clustering analysis of tumor and normal colon tissues probed by oligonucleotide arrays. Proc Natl Acad Sci USA 96:6745-6750.
18. Singh D, et al. (2002) Gene expression correlates of clinical prostate cancer behavior. Cancer Cell 1:203-209.
19. Dettling M, Bühlmann P (2003) Boosting for tumor classification with gene expression data. Bioinformatics 19:1061-1069.
20. Burges C (1998) A tutorial on support vector machines for pattern recognition. Knowl Discov Data Min 2:121-167.
21. Breiman L (2001) Random forests. Mach Learn 24:5-32.
22. Hall P, Pittelkow Y, Ghosh M (2008) Theoretical measures of relative performance of classifiers for high dimensional data with small sample sizes. J R Stat Soc B 70:158 -173.
23. Donoho D, Maleki A, Ur-Rahman I, Shahram M, Stodden V (2008) 15 years of reproducible research in computational harmonic analysis. Technical report (Department of Statistics, Stanford University, Stanford).