Optimal model assessment, selection, and combination

Journal of the American Statistical Association

Volumn 101, Issue 474, 2006, Pages 554-568

  Shen, Xiaotong ^a   Huang, Hsin Cheng ^b  

^a UNIVERSITY OF MINNESOTA   (United States)

^b INSTITUTE OF STATISTICAL SCIENCE   (Taiwan)

Author keywords

Data perturbation; Degrees of freedom; Dependent; Modeling uncertainty; Non semiparametric; Parametric; Prediction

Indexed keywords

EID: 33745635949     PISSN: 01621459     EISSN: None     Source Type: Journal    
DOI: 10.1198/016214505000001078     Document Type: Article

References (40)

1. Abramovich, F., Benjamini, Y., Donoho, D., and Johnston, I. (2006), "Adapting to Unknown Sparsity by Controlling the False Discovery Rate," The Annals of Statistics, to appear.
2. Akaike, H. (1973), "Information Theory and the Maximum Likelihood Principle," in International Symposium on Information Theory, eds. V. Petrov and F. Csáki, Budapest: Akademiai Kiádo, pp. 267-281.
3. Bai, Z. D., Rao, C. R., and Wu, Y. (1999), "Model Selection With Data-Oriented Penalty," Journal of Statistical Planning and Inference, 77, 103-117.
4. Bloomfield, P., Royle, J. A., Steinberg, L. J., and Yang, Q. (1996), "Accounting for Meteorological Effects in Measuring Urban Ozone Levels and Trends," Atmospheric Environment, 30, 3067-3077.
5. Breiman, L. (1992), "The Little Bootstrap and Other Methods for Dimensionality Selection in Regression: X-Fixed Prediction Error," Journal of the American Statistical Association. 87. 738-754.
6. Buckland, S. T., Burnham, K. P., and Augustin, N. H. (1997), "Model Selection: An Integral Part of Inference," Biometrics, 53, 603-618.
7. Burnham, K. P., and Andersen, D. R. (2002), Model Selection and Multimodel Inference: A Practical Information-Theoretic Approach (2nd ed.), New York: Springer-Verlag.
8. Claeskens, G., and Hjort, N. L. (2003), "Focused Information Criterion" (with discussion), Journal of the American Statistical Association, 98, 879-899.
9. Cover, T. M., and Thomas, J. A. (1991), Information Theory, New York: Wiley-Interscience.
10. Deutsch, M. C., Granger, W. J., and Terasvirta, T. (1994), "The Combination of Forecasts Using Changing Weights," International Journal of Forecasting, 81, 425-455.
11. Donoho, D. L., and Johnstone, I. M. (1994), "Ideal Spatial Adaptation by Wavelet Shrinkage," Biometrika, 81, 425-455.
12. Efron, B. (1986), "How Biased Is the Apparent Error Rate of a Prediction Rule?" Journal of the American Statistical Association, 81, 461-470.
13. _ (2004), "The Estimation of Prediction Error: Covariance Penalties and Cross-Validation" (with discussion). Journal of the American Statistical Association, 99, 619-642.
14. Freund, Y., and Schapire, R. E. (1996), "Experiments With a New Boosting Algorithm," in Machine Learning: Proceedings of the Thirteen International Conference, San Francisco: Morgan Kauffman, pp. 148-156.
15. George, E. I. (1986), "Minimax Multiple Shrinkage Estimation," The Annals of Statistics. 14, 188-205.
16. George, E. I., and Foster, D. P. (1994), "The Risk Inflation Criterion for Multiple Regression," The Annals of Statistics, 22, 1947-1975.
17. _ (2000), "Calibration and Empirical Bayes Variable Selection." Biometrika, 87, 731-747.
18. Hjort, N. L., and Claeskens, G. (2003), "Frequentist Model Average Estimators" (with discussion), Journal of the American Statistical Association, 98, 879-899.
19. Hoeting, J., Madigan, D., and Raftery, A. E. (1999), "Bayesian Model Averaging: A Tutorial," Statistical Science, 14, 382-401.
20. Hudson, H. M. (1978), "A Natural Identity for Exponential Families With Applications in Multiparameter Estimation," The Annals of Statistics, 6, 673-484.
21. Hurvich, C. M., and Tsai, C. L. (1989), "Regression and Time Series Model Selection in Small Samples," Biometrika, 76, 297-307.
22. Li, K. C. (1985), "From Stein's Unbiased Estimates to the Method of Generalized Cross-Validation," The Annals of Statistics, 13, 1352-1377.
23. _ (1987), "Asymptotic Optimality for Cp, CL, Cross-Validation and Generalized Cross-Validation: Discrete Index Set," The Annals of Statistics, 15, 958-975.
24. Ljung, G. M., and Box, G. E. P. (1978), "On a Measure of Lack of Fit in Time Series Models," Biometrika, 66, 67-72.
25. Kass, R. E., and Wasserman, L. (1995), "A Reference Bayesian Test for Nested Hypotheses and Its Relationship to the Schwarz Criterion," Journal of the American Statistical Association, 90, 928-934.
26. p," Technometrics, 12, 661-675.
27. Rao, J. S. (1999), "Bootstrap Choice of Cost Complexity for Better Subset Selection," Statistica Sinica, 9, 273-288.
28. Rissanen, J. (1996), "Fisher Information and Stochastic Complexity." IEEE Transactions on Information Theory, 42, 40-47.
29. Schwarz, G. (1978), "Estimating the Dimension of a Model," The Annals of Statistics, 6, 461-464.
30. Shao, J., and Rao, J. (2000), "The GIC for Model Selection: A Hypothesis Testing Approach," Journal of Statistical Planning and Inference. 77, 103-117.
31. Shen, X., Huang, H.-C, and Ye, J. (2004a), "Adaptive Model Selection and Assessment for Exponential Family Models," Technometrics, 46, 306-317.
32. _ (2004b), "Inference After Model Selection," Journal of the American Statistical Association, 99, 751-762.
33. Shen, X., and Ye, J. (2002), "Adaptive Model Selection," Journal of the American Statistical Association, 97, 210-221.
34. Spiegelhalter, D. J., Best, N. G., Carlin, B. P., and van der Linde, A. (2002), "Bayesian Measures of Model Complexity and Fit." Journal of the Royal Statistical Society, Set. B, 64, 1-34.
35. Stein, C. (1981), "On Multivariate Normal Mean Problems," The Annals of Statistics. 9, 1135-1151.
36. Tibshirani. R. (1996), "Regression Shrinkage and Selection via the Lasso." Journal of the Royal Statistical Society, Ser. B, 58. 267-288.
37. Tibshirani, R., and Knight, K. (1999), "The Covariance Inflation Criterion for Model Selection," Journal of the Royal Statistical Society, Ser. B, 61, 529-546.
38. Yang, Y. (2001), "Adaptive Regression by Mixing," Journal of the American Statistical Association, 96, 574-588.
39. Ye, J. (1998), "On Measuring and Correcting the Effects of Data Mining and Model Selection," Journal of the American Statistical Association, 93, 120-131.
40. Zhang, C. (2003), "Calibrating the Degrees of Freedom for Automatic Data Smoothing and Effective Curve Checking," Journal of the American Statistical Association, 98, 609-628.