A cross-validation based estimation of the proportion of true null hypotheses

Journal of Statistical Planning and Inference

Volumn 140, Issue 11, 2010, Pages 3132-3147

  Celisse, Alain ^a,c   Robin, Stéphane ^b,c  

^a UNIVERSITÉ LILLE 1   (France)

^b AgroParisTech   (France)

^c Statistics for Systems Biology Group   (France)

Author keywords

Cross validation; Density estimation; False discovery rate; Histograms; Multiple testing

Indexed keywords

EID: 77954176666     PISSN: 03783758     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jspi.2010.04.014     Document Type: Article

References (27)

1. Arlot, S., Celisse, A., 2010. A survey of cross-validation procedures for model selection. Statistics Surveys 4, 40-79, doi: 10.1214/09-SS054.
2. Barron A., Birgé L., Massart P. Risk bounds for model selection via penalization. Probab. Theory Related Fields 1999, 113:301-413.
3. Benjamini Y., Hochberg Y. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J. Roy. Statist. Soc. Ser. B 1995, 57(1):289-300.
4. Benjamini Y., Krieger A.M., Yekutieli D. Adaptive linear step-up procedures that control the false discovery rate. Biometrika 2006, 93(3):491-507.
5. Benjamini Y., Yekutieli D. The control of the false discovery rate in multiple testing under dependency. Ann. Statist. 2001, 29(4):1165-1188.
6. Broberg P. A comparative review of estimates of the proportion unchanged genes and the false discovery rate. BMC Bioinformatics 2005, 6:199.
7. Celisse A., Robin S. Nonparametric density estimation by exact leave-p-out cross-validation. Comput. Statist. Data Anal. 2007, 10.1016/j.csda.2007.10.002.
8. Dudoit S., Popper Shaffer J., Boldrick J.C. Multiple hypothesis testing in microarray experiments. Statist. Sci. 2003, 18(1):71-103.
9. Efron B. Large-scale simultaneous hypothesis testing: the choice of a null hypothesis. J. Amer. Statist. Assoc. 2004, 99(465):96-104.
10. Efron B., Tibshirani R., Storey J.D., Tusher V. Empirical Bayes analysis of a microarray experiment. J. Amer. Statist. Assoc. 2001, 96(456):1151-1160.
11. Genovese C., Wasserman L. A stochastic process approach to false discovery control. Ann. Statist. 2004, 32(3):1035-1061.
12. Hastie, T., Tibshirani, R., Friedman, J., 2001. The Elements of Statistical Learning. Springer Series in Statistics, Springer.
13. Langaas M., Lindqvist B.H., Ferkingstad E. Estimating the proportion of true null hypotheses, with application to DNA microarray data. J. Roy. Statist. Soc. Ser. B 2005, 67(4):555-572.
14. Lebarbier E. Detecting multiple change-points in the mean of Gaussian process by model selection. Signal Process. 2005, 85:717-736.
15. Pounds S., Cheng C. Robust estimation of the false discovery rate. Bioinformatics 2006, 22(16):1979-1987.
16. Rudemo M. Empirical choice of histograms and Kernel density estimators. Scand. J. Statist. 1982, 9:65-78.
17. Ruppert D., Nettleton D., Gene Hwang J.T. Exploring the information in p-values for the analysis and planning of multiple-test experiments. Biometrics 2007, 63:483-495.
18. Scheid S., Spang R. A stochastic downhill search algorithm for estimating the local false discovery rate. IEEE Trans. Comput. Biol. Bioinformatics 2004, 1(3):98-108.
19. Scheid S., Spang R. Twilight; a bioconductor package for estimating the local false discovery rate. Bioinformatics 2005, 21(12):2921-2922.
20. Schweder T., Spjøtvoll E. Plots of p-values to evaluate many tests simultaneously. Biometrika 1982, 69:493-502.
21. Scott D. On optimal and data-based histograms. Biometrika 1979, 66(3):605-610.
22. Shao J. Model selection by cross-validation. J. Amer. Statist. Assoc. 1993, 88(422):486-494.
23. Storey J.D. A direct approach to false discovery rates. J. Roy. Statist. Soc. Ser. B 2002, 64(3):479-498.
24. Storey J.D., Tibshirani R. Statistical significance for genomewide studies. Proc. Nat. Acad. Sci. 2003, 100(16):9440-9445.
25. Storey J., Taylor J.E., Siegmund D. Strong control, conservative point estimation and simultaneous conservative consistency of false discovery rates: a unified approach. J. Roy. Statist. Soc. Ser. B 2004, 66(1):187-205.
26. van der Vaart, A.W., 1998. Asymptotic Statistics, Cambridge Series in Statistical and Probabilistic Mathematics. Cambridge University Press, Cambridge (GB), West Nyack, NY.
27. Yang Y. Consistency of cross validation for comparing regression procedures. Ann. Statist. 2007, 35:2450-2473.