A reality check for data snooping

Econometrica

Volumn 68, Issue 5, 2000, Pages 1097-1126

  White, Halbert ^a  

^a University of California   (United States)

Author keywords

Bootstrap; Data mining; Forecast evaluation; Model selection; Multiple hypothesis testing; Prediction

Indexed keywords

EID: 0000028873     PISSN: 00129682     EISSN: None     Source Type: Journal    
DOI: 10.1111/1468-0262.00152     Document Type: Article

References (23)

1. ALTISSIMO, F., AND V. CORRADI (1996): "A LIL for m-Estimators and Applications to Hypothesis Testing with Nuisance Parameters," University of Pennsylvania Department of Economics Discussion Paper.
2. ANDREWS, D. W. K. (1993): "Tests for Parameter Instability and Structural Change with Unknown Change Point," Econometrica, 61, 821-856.
3. BILLINGSLEY, P. (1968): Convergence of Probability Measures. New York: Wiley.
4. _ (1995): Probability and Measure, Third Edition. New York: Wiley.
5. BROCK, W., J. LAKONISHOK, AND B. LEBARON (1992): "Simple Technical Trading Rules and the Stochastic Properties of Stock Returns," Journal of Finance, 47, 1731-1764.
6. CHATFIELD, C. (1995): "Model Uncertainty, Data Mining and Statistical Inference," Journal of the Royal Statistical Society, Series A, 158, 419-466.
7. CORRADI, V., N. R. SWANSON, AND C. OLIVETTI (1998): "Predictive Ability With Cointegrated Variables," Pennsylvania State University Department of Economics Discussion Paper.
8. COWLES, A. (1933): "Can Stock Market Forecasters Forecast?" Econometrica, 1, 309-324.
9. COX, D. R. (1982): "Statistical Significance Tests," British Journal of Clinical Pharmacology, 14, 325-331.
10. DIEBOLD, F., AND R. MARIANA (1995): "Comparing Predictive Accuracy," Journal of Business and Economic Statistics, 13, 253-265.
11. DUFOUR, J.-M., E. GHYSELS, AND A. HALL (1994): "Generalized Predictive Tests and Structural Change Analysis in Econometrics," International Economic Review, 35, 199-229.
12. ENGLE, R., AND C. W. J. GRANGER (1987): "Co-integration and Error Correction: Representation, Estimation and Testing," Econometrica, 55, 251-276.
13. FITZENBERGER, B. (1997): "The Moving Blocks Bootstrap and Robust Inference for Linear Least Squares and Quantile Regressions," Journal of Econometrics, 82, 235-287.
14. GONÇALVES, S., AND H. WHITE (1999): "The Bootstrap of the Mean for Dependent Heterogeneous Arrays," UCSD Department of Economics Discussion Paper.
15. HALL, P., J. HOROWITZ, AND B.-Y. JING (1995): "On Blocking Rules for the Bootstrap with Dependent Data," Biometrika, 82, 561-574.
16. HAND, D. (1998): "Data Mining: Statistics and More?" The American Statistician, 52, 112-118.
17. HOCHBERG, Y. (1988): "A Sharper Bonferroni Procedure for Multiple Tests of Significance," Biometrika, 75, 800-802.
18. HOMMEL, G. (1989): "A Comparison of Two Modified Bonferroni Procedures," Biometrika, 76, 625-625.
19. HOOVER, K. D., AND S. J. PEREZ (1998): "Data Mining Reconsidered: Encompassing and the General-to-Specific Approach to Specification Search," UC Davis Department of Economics Discussion Paper.
20. JENSEN, D., AND P. COHEN (2000): "Multiple Comparisons in Induction Algorithms," Machine Learning, 38, 309-338.
21. KABAILA, P. (1995): "The Effect of Model Selection on Confidence Regions and Prediction Regions," Econometric Theory, 11, 537-549.
22. WESTFALL, P. H., AND S. S. YOUNG (1993): Resampling-Based Multiple Testing: Examples and Methods for p-Value Adjustment. New York: Wiley.
23. WHITE, H. (1984): Asymptotic Theory for Econometricians. Orlando: Academic Press.