The Variable Selection Problem

Journal of the American Statistical Association

Volumn 95, Issue 452, 2000, Pages 1304-1308

  George, Edward I ^a  

^a UNIVERSITY OF TEXAS AT AUSTIN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0442309436     PISSN: 01621459     EISSN: 1537274X     Source Type: Journal    
DOI: 10.1080/01621459.2000.10474336     Document Type: Article

References (58)

1. Akaike, H. (1973), “Information Theory and an Extension of the Maximum Likelihood Principle,” in 2nd International Symposium on Information Theory, eds. B. N. Petrov and F. Csaki, Budapest: Akademia Kiado, pp. 267-281.
2. Benjamini, Y., and Hochberg, Y. (1995), “Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing,” Journal of the Royal Statistical Society, Ser. B, 57, 289-300.
3. Berger, J. O., and Pericchi, L. R. (1996a), “The Intrinsic Bayes Factor for Model Selection and Prediction,” Journal of the American Statistical Association, 91, 109-122.
4. Berger, J. O., and Pericchi, L. R. (1996b), “The Intrinsic Bayes Factor for Linear Models,” in Bayesian Statistics 5, eds. J. M. Bernardo, J. O. Berger, A. P. Dawid, and A. F. M. Smith, London: Oxford University Press, pp. 25-44.
5. Brieman, L. (1992), “The Little Bootstrap and Other Methods for Dimensionality Selection in Regression: X-Fixed Prediction Error,” Journal of the American Statistical Association, 87, 738-754.
6. Berger, J. O., and Pericchi, L. R. (1995), “Better Subset Selection Using the Nonnegative Garrote,” Technometrics, 37, 373-384.
7. Clyde, M. (1999), “Bayesian Model Averaging and Model Search Strategies,” in Bayesian Statistics 6, eds. J. M. Bernardo, J. O. Berger, A. P. Dawid, and A. F. M. Smith, London: Oxford University Press.
8. Clyde, M., and George, E. I. (1999), “Empirical Bayes Estimation in Wavelet Nonparametric Regression,” in Bayesian Inference in Wavelet-Based Models, eds. P. Muller and B. Vidakovic, New York: SpringerVerlag, pp. 309-322.
9. Clyde, M., and George, E. I. (2000), “Flexible Empirical Bayes Estimation for Wavelets,” Journal of the Royal Statistical Society, Ser. B, 681-698.
10. Clyde, M., Parmigiani, G., and Vidakovic, B. (1998), “Multiple Shrinkage and Subset Selection in Wavelets,” Biometrika, 85, 391-402.
11. Dash, M., and Liu, H. (1997), “Feature Selection for Classification,” Intelligent Data Analysis, 1, 131-156.
12. Donoho, D. L., and Johnstone, I. M. (1994), “Ideal Spatial Adaptation by Wavelet Shrinkage,” Biometrika, 81, 425-456.
13. Donoho, D. L., and Johnstone, I. M. (1995), “Adapting to Unknown Smoothness via Wavelet Shrink-age,” Journal of the Royal Statistical Society, Ser. B, 90, 1200-1224.
14. Draper, D. (1995), “Assessment and Propagation of Model Uncertainty” (with discussion), Journal of the Royal Statistical Society, Ser. B, 57, 45-97.
15. Efron, B. (1983), “Estimating the Error Rate of a Predictive Rule: Im-provement Over Cross-Validation,” Journal of the American Statistical Association, 78, 316-331.
16. Efroymson, M. A. (1960), “Multiple Regression Analysis,” in Mathematical Methods for Digital Computers, eds. A. Ralston and H. S. Wilf, New York: Wiley, pp. 191-203.
17. Foster, D. P., and George, E. I. (1994), “The Risk Inflation Criterion for Multiple Regression,” The Annals of Statistics, 22, 1947-1975.
18. Furnival, G. M., and Wilson, R. W. (1974), “Regression by Leaps and Bounds,” Technometrics, 16, 499-511.
19. Garthwaite, P. H., and Dickey, J. M. (1996), “Quantifying and Using Expert Opinion for Variable-Selection Problems in Regression” (with discussion), Chemometrics and Intelligent Laboratory Systems, 35, 1-34.
20. Geisser, S., and Eddy, W. F. (1979), “A Predictive Approach to Model Selection,” Journal of the American Statistical Association, 74, 153-160.
21. George, E. I. (1999), “Bayesian Model Selection,” in Encyclopedia of Statistical Sciences, Update Vol. 3, eds. S. Kotz, C. Read, and D. Banks, New York: Wiley, pp. 39-46.
22. George, E. I., and Foster, D. P. (2000), “Calibration and Empirical Bayes Variable Selection,” Biometrika, 87 (forthcoming).
23. George, E. I., and McCulloch, R. E. (1993), “Variable Selection via Gibbs Sampling,” Journal of the American Statistical Association, 88, 881-889.
24. George, E. I., and McCulloch, R. E. (1997), “Approaches for Bayesian Variable Selection,” Statistica Sinica, 7(2), 339-373.
25. Gong, G. (1986), “Cross-Validation, the Jackknife, and the Bootstrap: Excess Error Estimation in Forward Logistic Regression,” Journal of the American Statistical Association, 393, 108-113.
26. Green, P. (1995), “Reversible Jump Markov Chain Monte Carlo Computation and Bayesian Model Determination,” Biometrika, 82, 711-732.
27. Haughton, D. (1988), “On the Choice of a Model to Fit Data From an Exponential Family,” The Annals of Statistics, 16, 342-355.
28. Hocking (1976), “The Analysis and Selection of Variables in Linear Regression,” Biometrics, 32, 1-49.
29. Hoeting, J. A., Madigan, D., Raftery, A. E., and Volinsky, C. T. (1999), “Bayesian Model Averaging: A Tutorial” (with discussion), Statistical Science, 14, 382-417.
30. Hurvich, C. M., and Tsai, C. L. (1989), “Regression and Time Series Model Selection in Small Samples,” Biometrika, 76, 297-307.
31. Hurvich, C. M., and Tsai, C. L. (1998), “A Cross-Validatory AIC for Hard Wavelet Thresholding in Spatially Adaptive Function Estimation,” Biometrika, 85, 701-710.
32. Johnstone, I. M., and Silverman, B. W. (1998), “Empirical Bayes Ap-proaches to Mixture Problems and Wavelet Regression,” technical re-port, University of Bristol.
33. Kass, R. E., and Wasserman, L. (1995), “A Reference Bayesian Test for Nested Hypotheses and Its Relationship to the Schwarz Criterion,” Journal of the American Statistical Association, 90, 928-934.
34. Laud, P. W., and Ibrahim, J. G. (1995), “Predictive Model Selection,” Journal of the Royal Statistical Society, Ser. B, 57, 247-262.
35. Lindley, D. V. (1968), “The Choice of Variables in Multiple Regression” (with discussion), Journal of the Royal Statistical Society, Ser. B, 30, 31-66.
36. Mallows, C. L. (1973), “SomeComments on Cv" Technometrics, 15, 661-676.
37. Mallows, C. L. (1995), “More Comments on Cp,” Technometrics, 37, 362-372.
38. Miller, A. (1990), Subset Selection in Regression, London: Chapman and Hall.
39. O’Hagan, A. (1995), “Fractional Bayes Factors for Model Comparison” (with discussion), Journal of the Royal Statistical Society, Ser. B, 57, 99-138.
40. Pauler, D. (1998), “The Schwarz Criterion and Related Methods for the Normal Linear Model,” Biometrika, 85, 13-27.
41. Raftery, A. E. (1996), “Approximate Bayes Factors and Accounting for Model Uncertainty in Generalized Linear Models,” Biometrika, 83,251-266.
42. Rao, C. R., and Wu, Y. (1989), “A Strongly Consistent Procedure for Model Selection in a Regression Problem,” Biometrika, 76, 369-374.
43. Rissanen, J. (1978), “Modeling by Shortest Data Description,” Automatica, 14, 465-471.
44. San Martini, A., and Spezzaferri, F. (1984), “A Predictive Model Selection Criterion,” Journal of the Royal Statistical Society, Ser. B, 46, 296-303.
45. Schwarz, G. (1978), “Estimating the Dimension of a Model,” The Annals of Statistics, 6, 461-464.
46. Shao, J. (1997), “An Asymptotic Theory for Linear Model Selection,” Statistica Sinica, 7(2), 221-264.
47. Shao, J. (1993), “Linear Model Selection by Cross-Validation,” Journal of the American Statistical Association, 88, 486-494.
48. Shibata, R. (1981), “An Optimal Selection of Regression Variables,” Biometrika, 68, 45-54.
49. Stone, M. (1977), “An Asymptotic Equivalence of Choice of Model by Cross-Validation and Akaike’s Criterion,” Journal of the Royal Statistical Society, Ser. B, 39, 44-47.
50. Stone, M. (1979), “Comments on Model Selection Criteria of Akaike and Schwarz,” Journal of the Royal Statistical Society, Ser. B, 41, 276-278.
51. Thompson, M. L. (1978), “Selection of Variables in Multiple Regression: Part I. A Review and Evaluation,” International Statistical Review, 46, 1-19.
52. Tibshirani, R. (1996), “Regression Shrinkage and Selection via the Lasso,” Journal of the Royal Statistical Society, Ser. B, 58, 267-288.
53. Tibshirani, R., and Knight, K. (1999), “The Covariance Inflation Criterion for Model Selection,” Journal of the Royal Statistical Society, Ser. B, 61, 529-546.
54. Wei, C. Z. (1992), “On Predictive Least Squares Principles,” The Annals of Statistics, 29, 1-42.
55. Ye, J. (1998), “On Measuring and Correcting the Effects of Data Mining and Model Selection,” Journal of the American Statistical Association, 93, 120-131.
56. Zhang, P. (1992), “Inference After Variable Selection in Linear Regression Models,” Biometrika, 79, 741-746.
57. Zhang, P. (1993), “Model Selection via Multifold Cross-Validation,” The Annals of Statistics, 21, 299-313.
58. Zheng, X., and Loh, W. Y. (1997), “A Consistent Variable Selection Criterion for Linear Models for Linear Models With High-Dimensional Covariates,” Statistica Sinica, 7(2), 311-325.