Inference after variable selection using restricted permutation methods

Canadian Journal of Statistics

Volumn 37, Issue 4, 2009, Pages 625-644

  Wang, Rui ^a   Lagakos, Stephen W ^a  

^a HARVARD SCHOOL OF PUBLIC HEALTH   (United States)

Author keywords

Covariates; Regression; Sample splitting; Variable selector

Indexed keywords

EID: 74049160444     PISSN: 03195724     EISSN: None     Source Type: Journal    
DOI: 10.1002/cjs.10039     Document Type: Article

References (35)

1. H. Akaike (1973). Information Theory and the Maximum Likelihood Principle, in V. Petrov & F. Csáki, editors, International Symposium on Information Theory, Akademiai Kiádo, Budapest, pp. 267-281.
2. L. Breiman (1992). The little bootstrap and other methods for dimensionality selection in regression: X-fixed prediction error. Journal of the American Statistical Association, 419, 739-754.
3. C. Chatfield (1995). Model uncertainty, data mining and statistical inference (with discussion). Journal of the Royal Statistical Society Series A, 158, 419-466.
4. W. G. Cochran (1938). The omission or addition of an independent variable in multiple linear regression. Supplement to the Journal of the Royal Statistical Society, 5, 171-176.
5. D. R. Cox (2007). On a generalization of a result of W. G. Cochran. Biometrika, 94, 755-759.
6. D. L. Danilov & J. R. Magnus (2004). On the harm that ignoring pre-testing can cause. Journal of Econo-metrics, 122, 27-46.
7. Y. K. Dijkstra & J. H. Veldkamp. Data-Driven Selection of Regressors and the Bootstrap, in T. K. Dijkstra, editors, On Model Uncertainty and Its Statistical Implications, Springer-Verlag, Berlin (1988).
8. G. DiRienzo, V. DeGruttola, B. Larder & K. Hertogs (2003). Non-parametric methods to predict HIV drug susceptibility phenotype from genotype. Statistics in Medicine, 22, 2785-2798.
9. B. Efron (1986). How biased is the apparent error rate of a prediction rule? Journal of the American Statistical Association, 81, 461-470.
10. J. J. Faraway (1992). On the cost of data analysis. Journal of Computational and Graphical Statistics, 1, 213-229.
11. D. A. Freedman, W. Navidi & S. C. Peters (1988). On the Impact of Variable Selection in Fitting Regression Equations, in T. K. Dijkstra, Ed., On Model Uncertainty and Its Statistical Implications, Springer-Verlag, Berlin.
12. K. Giri & P. Kabaila (2008). The coverage probability of confidence intervals in 2r factorial experiments after preliminary hypothesis testing. Australian & New Zealand Journal of Statistics, 50, 69-79.
13. S. Gong (1986). Cross-validation, the jack knife, and the boot strap: Excess error estimation inforward logistic regression. Journal of the American Statistical Association, 81, 108-118.
14. M. Huh & M. Jhun (2001). Random permutation testing in multiple linear regression. Communications in Statistics - Theory and Methods, 30, 2023-2032.
15. C. M. Hurvich & C. Tsai (1990). The impact of model selection on inference in linear regression. The American Statistician, 44, 214-217.
16. P. Kabaila (1995). The effect of model selection on confidence regions and prediction regions. Econometric Theory, 11, 537-549.
17. P. Kabaila (1998). Valid confidence intervals in regression after variable selection. Econometric Theory, 14, 463-482.
18. P. Kabaila & H. Leeb (2006). On the large-sample minimal coverage probability of confidence intervals after model selection. Journal of the American Statistical Association, 101, 619-629.
19. H. Leeb (2005). The distribution of a linear predictor after model selection: Conditional finite-sample distributions and asymptotic approximations. Journal of Statistical Planning and Inference, 134, 64-89.
20. H. Leeb (2009).Conditional predictive inference post-model-selection. The Annals of Statistics, forthcoming.
21. H. Leeb & B. M. Pötscher (2003). The Finite-sample distribution of post-model-selection estimators, and uniform versus non-uniform approximations. Econometric Theory, 19, 100-142.
22. H. Leeb & B. M. Pötscher (2005). Model selection and inference: Facts and fictions. Econometric Theory, 21,21-59.
23. I. S. Lossos, D. K. Czerwinski, A. A. Alizadeh, M. A. Wechser, R. Tibshirani, D. Botstein & R. Levy (2004). Prediction of survival in diffuse large-B-cell lymphoma based on the expression of six genes. New England Journal of Medicine, 350, 1828-1837.
24. U. Malhotra, R. J. Bosch, E. Chan, R. Wang, M. A. Fischl, A. C. Collier & M. J. McElrath (2004). Association of T cell proliferative responses and phenotype with virus control in chronic progressive HIV-1 disease. The Journal of Infectious Diseases, 189, 515-519.
25. A. J. Miller (1984). Selection of subsets of regression variables (with discussion). Journal of the Royal Statistical Society Series A, 147, 398-425.
26. B. M. Pötscher (1989). Model selection under nonstationarity: Autoregressive models and stochastic linear regression models. Annals of Statistics, 17, 1257-1274.
27. B. M. Pötscher (1991). Effects of model selection on inference. Econometric Theory, 7, 163-185.
28. B. M. Pötscher (1995). Comment on the effect of model selection on confidence regions and prediction regions. Econometric Theory, 11, 550-559.
29. B. M. Pötscher & A. J. Novák (1998). The distribution of estimators after model selection: Large and small sample results. Journal of Statistical Computation and Simulation, 60, 19-56.
30. G. Schwarz (1978). Estimating the dimension of a model. Annals of Statistics, 6, 461-464.
31. X. Shen, H. Huang & J. Ye (2004). Inference after model selection. Journal of the American Statistical Association, 467, 751-762.
32. R. Shibata (1976). Selection of the order of an autoregressive model by Akaike's information criterion. Biometrika, 63, 117-126.
33. N. S. Shulman, R. J. Bosch, J. W. Mellors, M. A. Albrecht & D. A. Katzenstein (2004). Genetic correlates of Efavirenz hypersusceptibility. AIDS, 18, 1781-1785.
34. M. Veall (1992). Bootstrapping the process of model selection: An econometric example. Journal of Applied Econometrics, 7, 93-99.
35. P. Zhang (1992). Inference after variable selection in linear regression models. Biometrika, 79, 741-746.