Advances in forecast evaluation

Handbook of Economic Forecasting

Volumn 2, Issue , 2013, Pages 1107-1201

  Clark, Todd ^a   McCracken, Michael ^b  

^a FEDERAL RESERVE BANK OF CLEVELAND   (United States)

^b FEDERAL RESERVE BANK OF ST LOUIS   (United States)

Author keywords

Equal accuracy; Multi step forecasts; Point forecasts; Prediction

Indexed keywords

EID: 84881591973     PISSN: 15740706     EISSN: None     Source Type: Book Series    
DOI: 10.1016/B978-0-444-62731-5.00020-8     Document Type: Chapter

References (93)

1. Amato Jeffery D., Swanson Norman R. The real time predictive content of money for output. Journal of Monetary Economics 2001, 48:3-24.
2. Anatolyev, Stanislav, 2007. Inference about predictive ability when there are many predictors. Manuscript, New Economic School.
3. Andrews Donald W.K. Heteroskedasticity and autocorrelation consistent covariance matrix estimation. Econometrica 1991, 59:1465-1471.
4. Andrews Donald W.K., Monahan J.Christopher An improved heteroskedasticity and autocorrelation consistent covariance matrix estimator. Econometrica 1992, 60:953-966.
5. Aruoba S.Boragan Data revisions are not well-behaved. Journal of Money, Credit, and Banking 2008, 40:319-341.
6. Ashley Richard, Granger Clive W.J., Schmalensee Richard L. Advertising and aggregate consumption: an analysis of causality. Econometrica 1980, 48:1149-1167.
7. Busetti Fabio, Marcucci Juri, Veronese Giovanni Comparing Forecast Accuracy: A Monte Carlo Investigation. The International Journal of Forecasting 2013, 29:13-27.
8. Calhoun, Gray, 2011. Out-of-sample comparisons of overfit models. Manuscript, Iowa State University.
9. Chatfield C. Model uncertainty, data mining and statistical inference. Journal of the Royal Statistical Society, Series A 1995, 158:419-466.
10. Chen Yi-Ting Moment tests for density forecast evaluation in the presence of parameter estimation uncertainty. Journal of Forecasting 2011, 30:409-450.
11. Chen Yu-Chen, Rogoff Kenneth S., Rossi Barbara Can exchange rates forecast commodity prices?. Quarterly Journal of Economics 2010, 125:1145-1194.
12. Chong Yock Y., Hendry David F. Econometric evaluation of linear macroeconomic models. Review of Economic Studies 1986, 53:671-690.
13. Christoffersen Peter, Ghysels Eric, Swanson Norman R. Let's get 'real' about using economic data. Journal of Empirical Finance 2002, 9:343-360.
14. Clark Todd E. Finite-sample properties of tests for equal forecast accuracy. Journal of Forecasting 1999, 18:489-504.
15. Clark Todd E. Can out-of-sample forecast comparisons help prevent overfitting?. Journal of Forecasting 2004, 23:115-139.
16. Clark, Todd E., Doh, Taeyoung, 2011. A Bayesian Evaluation of Alternative Models of Trend Inflation. Manuscript, Federal Reserve Bank of Cleveland.
17. Clark Todd E., McCracken Michael W. Tests of equal forecast accuracy and encompassing for nested models. Journal of Econometrics 2001, 105:85-110.
18. Clark Todd E., McCracken Michael W. Evaluating direct multistep forecasts. Econometric Reviews 2005, 24:369-404.
19. Clark Todd E., McCracken Michael W. The power of tests of predictive ability in the presence of structural breaks. Journal of Econometrics 2005, 124:1-31.
20. Clark Todd E., McCracken Michael W. Tests of equal predictive ability with real-time data. Journal of Business and Economic Statistics 2009, 27:441-454.
21. Clark, Todd E., McCracken, Michael W., 2011. Nested Forecast Model Comparisons: A New Approach to Testing Equal Accuracy. manuscript, Federal Reserve Bank of St. Louis, January.
22. Clark, Todd E., McCracken, Michael W., forthcoming. Tests of Equal Forecast Accuracy for Overlapping Models. Journal of Applied Econometrics.
23. Clark Todd E., McCracken Michael W. Reality Checks and Comparisons of Nested Predictive Models. JBES 2012, 30:53-66.
24. Clark Todd E., McCracken Michael W. Testing for Unconditional predictive ability. Oxford Handbook of Economic Forecasting 2011, 415-440. Oxford University Press, Oxford.
25. Clark Todd E., West Kenneth D. Using out-of-sample mean squared prediction errors to test the martingale difference hypothesis. Journal of Econometrics 2006, 135:155-186.
26. Clark Todd E., West Kenneth D. Approximately normal tests for equal predictive accuracy in nested models. Journal of Econometrics 2007, 138:291-311.
27. Clements Michael P., Galvao Ana Beatriz Real-time Forecasting of Inflation and Output Growth in the Presence of Data Revisions. Journal of Applied Econometrics 2013, 28:458-477.
28. Corradi Valentina, Distaso Walter Multiple forecast model evaluation. Oxford Handbook of Economic Forecasting 2011, 391-414. Oxford University Press, Oxford.
29. Corradi Valentina, Swanson Norman R. Predictive Density Evaluation. Handbook of Economic Forecasting 2006, 197-284. Elsevier, Amsterdam. C.W.J. Granger, G. Elliott, A. Timmermann (Eds.).
30. Corradi Valentina, Swanson Norman R. Nonparametric bootstrap procedures for predictive inference based on recursive estimation schemes. International Economic Review 2007, 48:67-109.
31. Corradi, Valentina, Swanson, Norman R., 2012. A survey of recent advances in forecast accuracy testing, with an extension to stochastic dominance. Recent Advances and Future Directions in Causality, Prediction and Specification Analysis: Essays in Honor of Halbert L. White, Jr.
32. Croushore Dean Forecasting with real-time macroeconomic data. Handbook of Economic Forecasting 2006, 961-982. North-Holland, Amsterdam, The Netherlands. G. Elliott, C. Granger, A. Timmermann (Eds.).
33. Croushore Dean, Stark Tom A real-time data set for macroeconomists: does the data vintage matter?. The Review of Economics and Statistics 2003, 85:605-617.
34. de Jong Robert M., Davidson James The functional central limit theorem and weak convergence to stochastic integrals I: weakly dependent processes. Econometric Theory 2000, 16:621-642.
35. Denton Frank T. Data mining as an industry. Review of Economics and Statistics 1985, 67:124-127.
36. Diebold Francis X., Mariano Roberto S. Comparing predictive accuracy. Journal of Business and Economic Statistics 1995, 13:253-263.
37. Diebold Francis X., Rudebusch Glenn D. Forecasting output with the composite leading index: a real-time analysis. Journal of the American Statistical Association 1991, 86:603-610.
38. Fair Ray C., Shiller Robert J. The informational content of ex ante forecasts. Review of Economics and Statistics 1989, 71:325-331.
39. Fair Ray C., Shiller Robert J. Comparing information in forecasts from econometric models. American Economic Review 1990, 80:375-389.
40. Giacomini Raffaella, Rossi Barbara Detecting and predicting forecast breakdown. Review of Economic Studies 2009, 76:669-705.
41. Giacomini Raffaella, White Halbert Tests of conditional predictive ability. Econometrica 2006, 74:1545-1578.
42. Goyal Amit, Welch Ivo A comprehensive look at the empirical performance of equity premium prediction. Review of Financial Studies 2008, 21:1455-1508.
43. Granziera, Eleonora, Hubrich, Kirstin, Moon, Roger H., 2011. A Predictability test for a Small Number of Nested Models. Manuscript.
44. Hallman Jeffrey J., Porter Richard D., Small David H. Is the price level tied to the M2 monetary aggregate in the long run?. American Economic Review 1991, 81:841-858.
45. Hansen Lars Peter Large sample properties of generalized method of moments estimators. Econometrica 1982, 50:1029-1054.
46. Hansen Bruce E. Convergence to stochastic integrals for dependent heterogeneous processes. Econometric Theory 1992, 8:489-500.
47. Hansen Peter Reinhard A test for superior predictive ability. Journal of Business and Economic Statistics 2005, 23:365-380.
48. Hansen, Peter Reinhard, Timmermann, Allan, 2011. Choice of Sample Split in Out-of-Sample Forecast Evaluation. manuscript, Stanford University.
49. Harvey David I., Leybourne Stephen J., Newbold Paul Testing the equality of prediction mean squared errors. International Journal of Forecasting 1997, 13:281-291.
50. Harvey David I., Leybourne Stephen J., Newbold Paul Tests for forecast encompassing. Journal of Business and Economic Statistics 1998, 16:254-259.
51. Hendry, David F., 2004. Unpredictability and the Foundations of Economic Forecasting. Manuscript, Nuffield College.
52. Hodrick Robert J. Dividend yields and expected stock returns: alternative procedures for inference and measurement. Review of Financial Studies 1992, 5:357-386.
53. Hoogerheide Lennart, Ravazzolo Francesco, van Dijk Herman K. Comment on forecast rationality tests based on multi-horizon bounds. Journal of Business and Economic Statistics 2012, 30:30-33.
54. Hoover Kevin D., Perez S.J. Data mining reconsidered: encompassing and the general-to-specific approach to specification search. Econometrics Journal 1999, 2:167-191.
55. Howrey E.Philip The use of preliminary data in econometric forecasting. Review of Economics and Statistics 1978, 60:193-200.
56. Hubrich Kirstin, West Kenneth D. Forecast evaluation of small nested model sets. Journal of Applied Econometrics 2010, 25:574-594.
57. Inoue Atsushi, Kilian Lutz In-sample or out-of-sample tests of predictability? which one should we use?. Econometric Reviews 2004, 23:371-402.
58. Inoue Atsushi, Rossi Barbara Recursive predictability tests for real-time data. Journal of Business and Economic Statistics 2005, 23:336-345.
59. Kilian Lutz Small-sample confidence intervals for impulse response functions. Review of Economics and Statistics 1998, 80:218-230.
60. Kilian Lutz Exchange rates and monetary fundamentals: what do we learn from long-horizon regressions?. Journal of Applied Econometrics 1999, 14:491-510.
61. Kishor N.Kundan, Koenig Evan F. VAR estimation and forecasting when data are subject to revision. Journal of Business and Economic Statistics 2012, 30:181-190.
62. Koenig Evan F., Dolmas Shelia, Piger Jeremy The use and abuse of real-time data in economic forecasting. The Review of Economics and Statistics 2003, 85:618-628.
63. Kozicki Sharon, Tinsley Peter A. shifting endpoints in the term structure of interest rates. Journal of Monetary Economics 2001, 47:613-652.
64. Leamer Edward E. Specification Searches: Ad Hoc Inference with Experimental Data 1978, Wiley, New York.
65. Lo Andrew W., Craig MacKinlay A. Data-snooping biases in tests of financial asset pricing models. Review of Financial Studies 1990, 3:431-467.
66. Lovell Michael C. Data mining. Review of Economics and Statistics 1983, 65:1-12.
67. Mankiw N.Gregory, Runkle David E., Shapiro Matthew D. Are preliminary announcements of the money stock rational forecasts?. Journal of Monetary Economics 1984, 14:15-27.
68. Mariano Roberto S., Preve Daniel Model-free tests for multiple forecast comparison. Journal of Econometrics 2012, 169:123-130.
69. McCracken Michael W. Robust out-of-sample inference. Journal of Econometrics 2000, 99:195-223.
70. McCracken Michael W. Parameter estimation error and tests of equal forecast accuracy between non-nested models. The International Journal of Forecasting 2004, 20:503-514.
71. McCracken Michael W. Asymptotics for out-of-sample tests of Granger causality. Journal of Econometrics 2007, 140:719-752.
72. Meese Richard, Rogoff Kenneth S. Empirical exchange rate models of the seventies: do they fit out of sample?. Journal of International Economics 1983, 14:3-24.
73. Meese Richard, Rogoff Kenneth S. Was it real? the exchange rate-interest differential relation over the modern floating-rate period. Journal of Finance 1988, 43:933-948.
74. Newey Whitney K., West Kenneth D. A simple, positive semi-definite, heteroskedasticity and autocorrelation consistent covariance matrix. Econometrica 1987, 55:703-708.
75. Newey Whitney K., West Kenneth D. Automatic lag selection in covariance matrix estimation. Review of Economic Studies 1994, 61:631-653.
76. Orphanides Athanasios, van Norden Simon The reliability of inflation forecasts based on output gap estimates in real time. Journal of Money, Credit, and Banking 2005, 37:583-601.
77. Patton Andrew J., Timmermann Allan Forecast rationality tests based on multi-horizon bounds. Journal of Business and Economic Statistics 2012, 30:1-17.
78. Rapach David, Wohar Mark E. In-sample vs. out-of-sample tests of stock return predictability in the context of data mining. Journal of Empirical Finance 2006, 13:231-247.
79. Rossi Barbara, Inoue Atsushi Out-of-Sample Forecast Tests Robust to the Window Size Choice. Journal of Business and Economic Statistics 2012, 30:432-453.
80. Song Kyungchul Testing predictive ability and power robustification. Journal of Business and Economic Statistics 2012, 30:288-296.
81. Stambaugh Robert F. Predictive regressions. Journal of Financial Economics 1999, 54:375-421.
82. Stock James H., Watson Mark W. Evidence on structural instability in macroeconomic time series relations. Journal of Business and Economic Statistics 1996, 14:11-30.
83. Stock James H., Watson Mark W. Forecasting output and inflation: the role of asset prices. Journal of Economic Literature 2003, 41:788-829.
84. Stock James H., Watson Mark W. Has US inflation become harder to forecast?. Journal of Money, Credit, and Banking 2007, 39:3-33.
85. Vuong Quang H. Likelihood ratio tests for model selection and non-nested hypotheses. Econometrica 1989, 57:307-333.
86. West Kenneth D. Asymptotic inference about predictive ability. Econometrica 1996, 64:1067-1084.
87. West Kenneth D. Another heteroskedasticity and autocorrelation consistent covariance matrix estimator. Journal of Econometrics 1997, 76:171-191.
88. West Kenneth D. Forecast evaluation. Handbook of Economic Forecasting 2006, North Holland. G. Elliott, C.W.J. Granger, A. Timmermann (Eds.).
89. West Kenneth D. Comment on forecast rationality tests based on multi-horizon bounds. Journal of Business and Economic Statistics 2012, 30:34-35.
90. West Kenneth D., McCracken Michael W. Regression-based tests of predictive ability. International Economic Review 1998, 39:817-840.
91. White Halbert A reality check for data snooping. Econometrica 2000, 68:1097-1127.
92. Wilson Edwin B. The Periodogram of American business activity. The Quarterly Journal of Economics 1934, 48:375-417.
93. Wright Jonathan H. The limiting distribution of post-sample stability tests for gmm estimation when the potential break date is unknown. Oxford Bulletin of Economics and Statistics 1997, 59:299-303.