Sequential selection procedures and false discovery rate control

Journal of the Royal Statistical Society. Series B: Statistical Methodology

Volumn 78, Issue 2, 2016, Pages 423-444

  G'Sell, Max Grazier ^a   Wager, Stefan ^b   Chouldechova, Alexandra ^a   Tibshirani, Robert ^b  

^a CARNEGIE MELLON UNIVERSITY   (United States)

^b STANFORD UNIVERSITY   (United States)

Author keywords

False discovery rate; Multiple hypothesis testing; Sequential testing; Stopping rule

Indexed keywords

EID: 84956572956     PISSN: 13697412     EISSN: 14679868     Source Type: Journal    
DOI: 10.1111/rssb.12122     Document Type: Article

References (39)

1. Aharoni, E. and Rosset, S. (2014) Generalized α-investing: definitions, optimality results and application to public databases. J. R. Statist. Soc. B, 76, 771-794.
2. Akaike, H. (1974) A new look at the statistical model identification. IEEE Trans. Autom. Control, 19, 716-723.
3. Barber, R. F. and Candes, E. (2014) Controlling the false discovery rate via knockoffs. Preprint arXiv:1404.5609. Department of Statistics, University of Chicago, Chicago.
4. Benjamini, Y. and Gavrilov, Y. (2009) A simple forward selection procedure based on false discovery rate control. Ann. Appl. Statist., 3, 179-198.
5. Benjamini, Y. and Hochberg, Y. (1995) Controlling the false discovery rate: a practical and powerful approach to multiple testing. J. R. Statist. Soc. B, 57, 289-300.
6. Benjamini, Y. and Yekutieli, D. (2001) The control of the false discovery rate in multiple testing under dependency. Ann. Statist., 29, 1165-1188.
7. Blanchard, G. and Roquain, E. (2008) Two simple sufficient conditions for FDR control. Electron. J. Statist., 2, 963-992.
8. Bogdan, M., van den Berg, E., Sabatti, C., Su, W. and Candes, E. J. (2014) SLOPE-adaptive variable selection via convex optimization. Preprint arXiv:1407.3824. Wrocław University of Technology, Wrocław.
9. Churchill, G. A. and Doerge, R. W. (1994) Empirical threshold values for quantitative trait mapping. Genetics, 138, 963-971.
10. Efron, B., Hastie, T., Johnstone, I. and Tibshirani, R. (2004) Least angle regression (with discussion). Ann. Statist., 32, 407-499.
11. Efron, B., Tibshirani, R. Storey, J. and Tusher, V. (2001) Empirical Bayes analysis of a microarray experiment. J. Am. Statist. Ass., 96, 1151-1160.
12. Fithian, W., Sun, D. and Taylor, J. (2014) Optimal inference after model selection. Preprint arXiv:1410.2597. Department of Statistics, Stanford University, Stanford.
13. Foster, D. P. and Stine, R. A. (2008) α-investing: a procedure for sequential control of expected false discoveries. J. R. Statist. Soc. B, 70, 429-444.
14. Goeman, J. J. and Solari, A. (2010) The sequential rejection principle of familywise error control. Ann. Statist., 38, 3782-3810.
15. G'Sell, M. G., Hastie, T. and Tibshirani, R. (2013a) False variable selection rates in regression. Preprint arXiv:1302.2303. Carnegie Mellon University, Pittsburgh
16. G'Sell, M. G., Taylor, J. and Tibshirani, R. (2013b) Adaptive testing for the graphical lasso. Preprint arXiv:1307.4765. Carnegie Mellon University, Pittsburgh
17. Hocking, R. R. (1976) The analysis and selection of variables in linear regression. Biometrics, 32, 1-49.
18. Lee, J., Sun, D., Sun, Y. and Taylor, J. (2013) Exact post-selection inference with the lasso. Preprint arXiv:1311.6238. Department of Statistics, Stanford University, Stanford.
19. Lee, J. D. and Taylor, J. E. (2014) Exact post model selection inference for marginal screening. In Advances in Neural Information Processing Systems, vol. .
20. Lin, D., Foster, D. and Ungar, L. (2011) VIF regression: a fast regression algorithm for large data. J. Am. Statist. Ass., 106, 232-247.
21. Lockhart, R., Taylor, J., Tibshirani, R. J. and Tibshirani, R. (2014) A significance test for the lasso (with discussion). Ann. Statist., 42, 413-468.
22. Loftus, J. R. and Taylor, J. E. (2014) A significance test for forward stepwise model selection. Preprint arXiv:1405.3920. Department of Statistics, Stanford University, Stanford.
23. Marcus, R., Eric, P. and Gabriel, K. R. (1976) On closed testing procedures with special reference to ordered analysis of variance. Biometrika, 63, 655-660.
24. Meinshausen, N. and Bühlmann, P. (2010) Stability selection (with discussion). J. R. Statist. Soc. B, 72, 417-473.
25. Rényi, A. (1953) On the theory of order statistics. Acta Math. Hung., 4, 191-231.
26. Rhee, S.-Y., Fessel, W. J., Zolopa, A. R., Hurley, L., Liu, T., Taylor, J., Nguyen, D. P., Slome, S., Klein, D., Horberg, M., Flamm, J., Follansbee, S., Schapiro, J. M. and Shafer, R. W. (2005) HIV-1 protease and reverse-transcriptase mutations: correlations with antiretroviral therapy in subtype B isolates and implications for drug-resistance surveillance. J. Infect. Dis., 192, 456-465.
27. Rhee, S.-Y., Taylor, J., Wadhera, G., Ben-Hur, A., Brutlag, D. L. and Shafer, R. W. (2006) Genotypic predictors of human immunodeficiency virus type 1 drug resistance. Proc. Natn. Acad. Sci. USA, 103, 17355-17360.
28. Romano, J. P. and Shaikh, A. M. (2006) Stepup procedures for control of generalizations of the familywise error rate. Ann. Statist., 34, 1850-1873.
29. Schwarz, G. (1978) Estimating the dimension of a model. Ann. Statist., 6, 461-464.
30. Shah, R. and Samworth, R. (2013) Variable selection with error control: another look at stability selection. J. R. Statist. Soc. B, 75, 55-80.
31. Simes, R. J. (1986) An improved Bonferroni procedure for multiple tests of significance. Biometrika, 73, 751-754.
32. Simonsen, K. L. and McIntyre, L. M. (2004) Using alpha wisely: improving power to detect multiple qtl. Statist. Appl. Genet. Molec. Biol., 3.
33. Storey, J. D., Taylor, J. E. and Siegmund, D. (2004) Strong control, conservative point estimation and simultaneous conservative consistency of false discovery rates: a unified approach. J. R. Statist. Soc. B, 66, 187-205.
34. Taylor, J., Lockhart, R., Tibshirani, R. J. and Tibshirani, R. (2014) Post-selection adaptive inference for least angle regression and the lasso. Preprint arXiv:1401.3889.
35. Taylor, J., Loftus, J., Tibshirani, R. and Tibshirani, R. (2013) Tests in adaptive regression via the Kac-Rice formula. Preprint arXiv:1308.3020. Department of Statistics, Stanford University, Stanford.
36. Tibshirani, R. (1996) Regression shrinkage and selection via the lasso. J. R. Statist. Soc. B, 58, 267-288.
37. Via Garca, M. and 1000 Genomes Project Consortium (2012) An integrated map of genetic variation from 1, 092 human genomes. Nature, 491, 56-65.
38. Westfall, P. H. and Young, S. S. (1993) Resampling-based Multiple Testing: Examples and Methods for p-value Adjustment. New York: Wiley.
39. Wu, Y., Boos, D. and Stefanski, L. (2007) Controlling variable selection by the addition of pseudovariables. J. Am. Statist. Ass., 102, 235-243.