Combining forecasting procedures: Some theoretical results

Econometric Theory

Volumn 20, Issue 1, 2004, Pages 176-222

  Yang, Yuhong ^a  

^a Department of Statistics Center for Statistics and Applications in Forensic Evidence Iowa State University 2438 Osborn Dr Ames   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0742271402     PISSN: 02664666     EISSN: None     Source Type: Journal    
DOI: 10.1017/S0266466604201086     Document Type: Article

References (64)

1. Armstrong, J.S. (1989) Combining forecasts: The end of the beginning or the beginning of the end? International Journal of Forecasting 5, 585-588.
2. Barron, A.R. (1993) Universal approximation bounds for superpositions of a sigmoidal function. IEEE Transactions on Information Theory 39, 930-945.
3. Barron, A.R. (1994) Approximation and estimation bounds for artificial neural networks. Machine Learning 14, 115-133.
4. Barron, A.R., L. Birgé, & P. Massart (1999) Risk bounds for model selection via penalization. Probability Theory and Related Fields 113, 301-413.
5. Barron, A.R., J. Rissanen, & B. Yu (1998) The minimum description length principle in coding and modeling. IEEE Transactions on Information Theory 44, 2743-2760.
6. Bates, J.M., & C.W.J. Granger (1969) The combination of forecasts. Operational Research Quarterly 20, 451-468.
7. Box, G.E.P. & G.M. Jenkins (1976) Time Series Analysis: Forecasting and Control, 2nd ed. Holden-Day.
8. Breiman, L. (1996a) Stacked regressions. Machine Learning 24, 49-64.
9. Breiman, L. (1996b) Bagging predictors. Machine Learning 24, 123-140.
10. Buckland, S.T., K.P. Burnham, & N.H. Augustin (1997) Model selection: An integral part of inference. Biometrics 53, 603-618.
11. Catoni, O. (1999) "Universal" Aggregation Rules with Exact Bias Bounds. Preprint no. 510, Laboratoire de Probabilites et Modeles Aleatoires, Université Paris VI & Université Paris VII.
12. Cesa-Bianchi, N., Y. Freund, D.P. Haussler, R. Schapire, & M.K. Warmuth (1997) How to use expert advice? Journal of the Association for Computing Machinery 44, 427-485.
13. Chatfield, C. (1995) Model uncertainty, data mining, and statistical inference (with discussion). Journal of the Royal Statistical Society, Series A 158, 419-466.
14. Clemen, R.T. (1989) Combining forecasts: A review and annotated bibliography. International Journal of Forecasting 5, 559-583.
15. Clemen, R.T., A.H. Murphy, & R.L. Winkler (1995) Screening probability forecasts: Contrasts between choosing and combining. International Journal of Forecasting 11, 133-145.
16. Clemen, R.T. & R.L. Winkler (1986) Combining economic forecasts. Journal of Business and Economic Statistics 4, 39-46.
17. Cover, T.M. (1965) Behavior of sequential predictors of binary sequences. In Transactions of the Fourth Prague Conference on Information Theory, Statistical Decision Functions, and Random Processes, pp. 263-271. Publishing House of the Czechoslovak Academy of Sciences.
18. Csiszár, I. (1975) I-Divergence geometry of probability distributions and minimization problems. Annals of Probability 3, 146-158.
19. Dawid, A.P. (1984) Present position and potential developments: Some personal views. Statistical theory - The prequential approach (with discussion). Journal of the Royal Statistical Society, Series A 147, 278-292.
20. DeVore, R.A. & G.G. Lorentz (1993) Constructive Approximation. Springer.
21. Devroye, L.P. & T.J. Wagner (1980) Distribution-free consistency results in nonparametric discrimination and regression function estimation. Annals of Statistics 8, 231-239.
22. Donoho, D.L. & I.M. Johnstone (1994) Ideal denoising in an orthonormal basis chosen from a library of bases. C.R. Acad. Sci. Paris 319, 1317-1322.
23. Donoho, D.L. & I.M. Johnstone (1998) Minimax estimation via wavelet shrinkage. Annals of Statistics 26, 879-921.
24. Efromovich, S. (1999) How to overcome curse of long-memory? IEEE Transactions on Information Theory 45, 1735-1741.
25. Figlewski, S. & T. Urich (1983) Optimal aggregation of money supply forecasts: Accuracy, profitability, and market efficiency. Journal of Finance 28, 695-710.
26. Foster, D.P. (1991) Prediction in the worst case. Annals of Statistics 19, 1084-1090.
27. Genest, C. & J.V. Zidek (1986) Combining probability distributions: A critique and an annotated bibliography. Statistical Science 1, 114-148.
28. Gouriéroux, C. & A. Monfort (1992) Qualitative threshold ARCH models. Journal of Econometrics 52, 159-199.
29. Hall, P. & J.D. Hart (1990) Nonparametric regression with long-range dependence. Stochastic Processes and Their Applications 36, 339-351.
30. Haussler, D., J. Kivinen, & M.K. Warmuth (1998) Sequential prediction of individual sequences under general loss functions. IEEE Transactions on Information Theory 44, 1906-1925.
31. Hoeting, J.A., D. Madigan, A.E. Raftery, & C.T. Volinsky (1999) Bayesian model averaging: A tutorial (with discussion). Statistical Science 14, 382-401.
32. Holt, C.C. (1957) Forecasting Seasonals and Trends by Exponentially Weighted Moving Averages. Carnegie Institute of Technology. ONR Research Memorandum 52.
33. Johnstone, I. (1999) Function Estimation in Gaussian Noise: Sequence Models. Manuscript.
34. Johnstone, I. & B.W. Silverman (1997) Wavelet threshold estimators for data with correlated noise. Journal of the Royal Statistical Association, Series B 59, 319-351.
35. Juditsky, A. & A. Nemirovski (2000) Functional aggregation for nonparametric estimation. Annals of Statistics 28, 681-712.
36. Kang, H. (1986) Unstable weights in the combination of forecasts. Management of Science 32, 683-695.
37. Leamer, E.E. (1978) Specification Searches: Ad hoc Inference with Nonexperimental Data. Wiley.
38. LeBlanc, M. & R. Tibshirani (1996) Combining estimates in regression and classification. Journal of the American Statistical Association 91, 1641-1650.
39. Littlestone, N. & M.K. Warmuth (1994) The weighted majority algorithm. Information and Computation 108, 212-261.
40. Merhav, N. & M. Feder (1998) Universal prediction. IEEE Transactions on Information Theory 44, 2124-2147.
41. Newbold P. & C.W.J. Granger (1974) Experience with forecasting univariate times series and the combination of forecasts. Journal of the Royal Statistical. Society, Series A 137, 131-165 (with discussion).
42. Ploberger, W. & P.C.B. Phillips (1999) Empirical Limits for Time Series Econometric Models. Cowles Foundation Discussion paper 1220, Yale University.
43. Rissanen, J. (1986) Stochastic complexity and modeling. Annals of Statistics 14, 1080-1100.
44. Schütt, C. (1984) Entropy numbers of diagonal operators between symmetric Banach spaces. Journal of Approximation Theory 40, 121-128.
45. Stone, C.J. (1977) Consistent nonparametric regression. Annals of Statistics 5, 595-620.
46. Stone, C.J. (1985) Additive regression and other nonparametric models. Annals of Statistics 13, 689-705.
47. Taylor, J.W. & D.W. Bunn (1999) Investigating improvements in the accuracy of prediction intervals for combinations of forecasts: A simulation study. International Journal of Forecasting 15, 325-339.
48. Triebel, H. (1975) Interpolation properties of ε-entropy and diameters. Geometric characteristics of embedding for function spaces of Sobolev-Besov type. Mat. Sbornik 98, 27-41; English trans. in Math. USSR Sb. 27, 23-37, 1977.
49. Triebel, H. (1975) Interpolation properties of ε-entropy and diameters. Geometric characteristics of embedding for function spaces of Sobolev-Besov type. Mat. Sbornik 98, 27-41; English trans. in Math. USSR Sb. 27, 23-37, 1977.
50. Wang, Y. (1996) Function estimation via wavelet shrinkage for long-memory data. Annals of Statistics 24, 466-484.
51. Vovk, V.G. (1990) Aggregating strategies. In M. Fulk & J. Case (eds.), Proceedings of the Third Annual Workshop on Computational Learning Theory, pp. 372-383.
52. Winters, P.R. (1960) Forecasting sales by exponentially weighted moving averages. Management of Science 6, 324-342.
53. Wolpert, D. (1992) Stacked generalization. Neural Networks 5, 241-259.
54. Yang, Y. (1997) Nonparametric Regression and Prediction with Dependent Errors. Technical Report 29, Department of Statistics, Iowa State University. A shorter version appeared in Bernoulli 7, 633-655, 2001.
55. Yang, Y. (1997) Nonparametric Regression and Prediction with Dependent Errors. Technical Report 29, Department of Statistics, Iowa State University. A shorter version appeared in Bernoulli 7, 633-655, 2001.
56. Yang, Y. (in press) Aggregating regression procedures for a better performance. Bernoulli, forthcoming.
57. Yang, Y. (2000a) Mixing strategies for density estimation. Annals of Statistics 28, 75-87.
58. Yang, Y. (2000b) Combining different procedures for adaptive regression. Journal of Multivariate Analysis 74, 135-161.
59. Yang, Y. (2000c) Adaptive estimation in pattern recognition by combining different procedures. Statistica Sinica 10, 1069-1089.
60. Yang, Y. (2001) Adaptive regression by mixing. Journal of the American Statistical Association 96, 574-588.
61. Yang, Y. (2003) Regression with multiple candidate models: Selecting or mixing? Statistica Sinica 13, 783-809.
62. Yang, Y. & A.R. Barron (1998) An asymptotic property of model selection criteria. IEEE Transactions on Information Theory 44, 95-116.
63. Yang, Y. & A.R. Barron (1999) Information-theoretic determination of minimax rates of convergence. Annals of Statistics 27, 1564-1599.
64. Zou, H. & Y. Yang (2003) Combining time series models for forecasting. International Journal of Forecasting, forthcoming.