Valid post-selection inference

Annals of Statistics

Volumn 41, Issue 2, 2013, Pages 802-837

  Berk, Richard ^a   Brown, Lawrence ^a   Buja, Andreas ^a   Zhang, Kai ^a   Zhao, Linda ^a  

^a UNIVERSITY OF PENNSYLVANIA   (United States)

Author keywords

Family wise error; High dimensional inference; Linear regression; Model selection; Multiple comparison; Sphere packing

Indexed keywords

EID: 84879164483     PISSN: 00905364     EISSN: None     Source Type: Journal    
DOI: 10.1214/12-AOS1077     Document Type: Article

References (34)

1. ANGRIST, J. D. and PISCHKE, J. S. (2009). Mostly Harmless Econometrics. Princeton Univ. Press, Princeton.
2. BAHADUR, R. R. (1966). A note on quantiles in large samples. Ann. Math. Statist. 37 577-580. MR0189095.
3. BERK, R., BROWN, L., BUJA, A., ZHANG, K. and ZHAO, L. (2013). Supplement to "Valid postselection inference." DOI:10.1214/12-AOS1077SUPP.
4. BROWN, L. (1967). The conditional level of Student's t test. Ann. Math. Statist. 38 1068-1071. MR0214210.
5. BUEHLER, R. J. and FEDDERSEN, A. P. (1963). Note on a conditional property of Student's t . Ann. Math. Statist. 34 1098-1100. MR0150864.
6. CLAESKENS, G. and HJORT, N. L. (2003). The focused information criterion (with discussion). J. Amer. Statist. Assoc. 98 900-945. MR2041482.
7. DIJKSTRA, T. K. and VELDKAMP, J. H. (1988). Data-driven selection of regressors and the bootstrap. In On Model Uncertainty and Its Statistical Implications (T. K. Dijkstra, ed.) 17-38. Springer, Berlin.
8. HALL, P. and CARROLL, R. J. (1989). Variance function estimation in regression: The effect of estimating the mean. J. R. Stat. Soc. Ser. B Stat. Methodol. 51 3-14. MR0984989.
9. HASTIE, T., TIBSHIRANI, R. and FRIEDMAN, J. (2009). The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd ed. Springer, New York. MR2722294.
10. HJORT, N. L. and CLAESKENS, G. (2003). Frequentist model average estimators. J. Amer. Statist. Assoc. 98 879-899. MR2041481.
11. IOANNIDIS, J. P. A. (2005). Why most published research findings are false. PLoS Med. 2 e124. DOI:10.1371/journal.pmed.0020124.
12. KABAILA, P. (1998). Valid confidence intervals in regression after variable selection. Econometric Theory 14 463-482. MR1650037.
13. KABAILA, P. (2009). The coverage properties of confidence regions after model selection. International Statistical Review 77 405-414.
14. KABAILA, P. and LEEB, H. (2006). On the large-sample minimal coverage probability of confidence intervals after model selection. J. Amer. Statist. Assoc. 101 619-629. MR2256178.
15. LEEB, H. (2006). The distribution of a linear predictor after model selection: Unconditional finitesample distributions and asymptotic approximations. In Optimality. Institute of Mathematical Statistics Lecture Notes-Monograph Series 49 291-311. IMS, Beachwood, OH. MR2338549.
16. LEEB, H. and PÖTSCHER, B. M. (2003). The finite-sample distribution of post-model-selection estimators and uniform versus nonuniform approximations. Econometric Theory 19 100-142. MR1965844.
17. LEEB, H. and PÖTSCHER, B. M. (2005). Model selection and inference: Facts and fiction. Econometric Theory 21 21-59. MR2153856.
18. LEEB, H. and PÖTSCHER, B. M. (2006a). Performance limits for estimators of the risk or distribution of shrinkage-type estimators, and some general lower risk-bound results. Econometric Theory 22 69-97. MR2212693.
19. LEEB, H. and PÖTSCHER, B. M. (2006b). Can one estimate the conditional distribution of postmodel- selection estimators? Ann. Statist. 34 2554-2591. MR2291510.
20. LEEB, H. and PÖTSCHER, B. M. (2008a). Model selection. In The Handbook of Financial Time Series (T. G. Anderson, R. A. Davis, J. P. Kreiss and T. Mikosch, eds.) 785-821. Springer, New York.
21. LEEB, H. and PÖTSCHER, B. M. (2008b). Can one estimate the unconditional distribution of postmodel- selection estimators? Econometric Theory 24 338-376. MR2422862.
22. LEEB, H. and PÖTSCHER, B. M. (2008c). Sparse estimators and the oracle property, or the return of Hodges' estimator. J. Econometrics 142 201-211. MR2394290.
23. MOORE, D. S. and MCCABE, G. P. (2003). Introduction to the Practice of Statistics, 4th ed. Freeman, New York.
24. OLSHEN, R. A. (1973). The conditional level of the F-test. J. Amer. Statist. Assoc. 68 692-698. MR0359198.
25. PÖTSCHER, B. M. (1991). Effects of model selection on inference. Econometric Theory 7 163-185. MR1128410.
26. PÖTSCHER, B. M. (2006). The distribution of model averaging estimators and an impossibility result regarding its estimation. In Time Series and Related Topics. Institute of Mathematical Statistics Lecture Notes-Monograph Series 52 113-129. IMS, Beachwood, OH. MR2427842.
27. PÖTSCHER, B. M. and LEEB, H. (2009). On the distribution of penalized maximum likelihood estimators: The LASSO, SCAD, and thresholding. J. Multivariate Anal. 100 2065-2082. MR2543087.
28. PÖTSCHER, B. M. and SCHNEIDER, U. (2009). On the distribution of the adaptive LASSO estimator. J. Statist. Plann. Inference 139 2775-2790. MR2523666.
29. PÖTSCHER, B.M. and SCHNEIDER, U. (2010). Confidence sets based on penalized maximum likelihood estimators in Gaussian regression. Electron. J. Stat. 4 334-360. MR2645488.
30. PÖTSCHER, B.M. and SCHNEIDER, U. (2011). Distributional results for thresholding estimators in high-dimensional Gaussian regression models. Electron. J. Stat. 5 1876-1934. MR2970179.
31. SCHEFFÉ, H. (1959). The Analysis of Variance. Wiley, New York. MR0116429.
32. SEN, P. K. (1979). Asymptotic properties of maximum likelihood estimators based on conditional specification. Ann. Statist. 7 1019-1033. MR0536504.
33. SEN, P. K. and SALEH, A. K. M. E. (1987). On preliminary test and shrinkage M-estimation in linear models. Ann. Statist. 15 1580-1592. MR0913575.
34. WYNER, A. D. (1967). Random packings and coverings of the unit n-sphere. Bell System Tech. J. 46 2111-2118. MR0223979.