A single-sample estimate of shrinkage in meteorological forecasting

Weather and Forecasting

Volumn 12, Issue 4, 1997, Pages 847-858

  Mielke Jr , Paul W ^a   Berry, Kenneth J ^a   Landsea, Christopher W ^b   Gray, William M ^c  

^a Department of Environmental and Radiological Health Sciences   (United States)

^b ATLANTIC OCEANOGRAPHIC AND METEOROLOGICAL LABORATORY   (United States)

^c Engineering Research Center and Hydraulics Laboratory   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0009471215     PISSN: 08828156     EISSN: None     Source Type: Journal    
DOI: 10.1175/1520-0434(1997)012<0847:ASSEOS>2.0.CO;2     Document Type: Article

References (45)

1. Badescu, V., 1993: Use of Willmott's index of agreement to the validation of meteorological models. Meteor. Mag., 122, 282-286.
2. Barnston, A. G., and H. M. Van den Dool, 1993: A degeneracy in cross-validated skill in regression-based forecasts. J. Climate, 6, 963-977.
3. Browne, M. W., 1970: A critical evaluation of some reduced-rank regression procedures. Research Bulletin 70-21, Educational Testing Service, Princeton, NJ.
4. _, 1975a: Predictive validity of a linear regression equation. Br. J. Math. Statist. Psychol., 28, 79-87.
5. _, 1975b: A comparison of single sample and cross-validation methods for estimating the mean squared error of prediction in multiple linear regression. Br. J. Math. Statist. Psychol., 28, 112-120.
6. _, and R. Cudeck, 1989: Single sample cross-validation indices for covariance structures. Mult. Behav. Res., 24, 445-455.
7. _, and _, 1992: Alternative ways of assessing model fit. Social. Meth. Res., 21, 230-258.
8. Camstra, A., and A. Boomsma, 1992: Cross-validation in regression and covariance structure analysis. Soc. Meth. Res., 21, 89-115.
9. Copas, J. B., 1983: Regression, prediction, and shrinkage. J. Roy. Statist. Soc., 45B, 311-354.
10. Cotton, W. R., G. Thompson, and P. W. Mielke, 1994: Real-time mesoscale prediction on workstations. Bull. Amer. Meteor. Soc., 75, 349-362.
11. Efron, B., 1983: Estimating the error rate of a prediction rule: Improvement on cross-validation. J. Amer. Statist. Assoc., 78, 316-331.
12. Elsner, J. B., and C. P. Schmertmann, 1993: Improving extendedrange seasonal predictions of intense Atlantic hurricane activity. Wea. Forecasting, 8, 345-351.
13. _, and _, 1994: Assessing forecast skill through cross-validation. Wea. Forecasting, 9, 619-624.
14. Geisser, S., 1975: The predictive sample reuse method with applications. J. Amer. Statist. Assoc., 70, 320-328.
15. Glick, N., 1978: Additive estimators for probabilities of correct classification. Pattern Recog., 10, 211-222.
16. Gray, W. M., C. W. Landsea, P. W. Mielke, and K. J. Berry, 1992: Predicting Atlantic seasonal hurricane activity 6-11 months in advance. Wea. Forecasting, 7, 440-455.
17. Hess, J. C., and J. B. Elsner, 1994: Extended-range hindcasts of tropical-origin Atlantic hurricane activity. Geophys. Res. Lett., 21, 365-368.
18. Hora, S. C., and J. B. Wilcox, 1982: Estimation of error rates in several-population discriminant analysis. J. Marketing Res., 19, 57-61.
19. Horst, P., 1966: Psychological Measurement and Prediction. Wadsworth, 455 pp.
20. Huberty, C. J., J. M. Wisenbaker, and J. C. Smith, 1987: Assessing predictive accuracy in discriminant analysis. Mult. Behav. Res., 22, 307-329.
21. Kelly, F. P., T. H. Yonder Haar, and P. W. Mielke, 1989: Imagery randomized block analysis (IRBA) applied to the verification of cloud edge detectors. J. Atmos. Oceanic Technol., 6, 671-679.
22. Lachenbruch, P. A., 1967: An almost unbiased method of obtaining confidence intervals for the probability of misclassification in discriminant analysis. Biometrics, 23, 639-645.
23. _, and M. R. Mickey, 1968: Estimation of error rates in discriminant analysis. Technometrics, 10, 1-11.
24. Lee, T. J., R. A. Pielke, and P. W. Mielke, 1995: Modeling the clearsky surface energy budget during FIFE 1987. J. Geophys. Res., 100, 25585-25593.
25. Livezey, R. E., A. G. Barnston, and B. K. Neumeister, 1990: Mixed analog/persistence prediction of seasonal mean temperatures for the USA. Int. J. Climatol., 10, 329-340.
26. MacCallum, R. C., M. Roznowski, C. M. Mar, and J. V. Reith, 1994: Alternative strategies for cross-validation of covariance structure models. Mult. Behav. Res., 29, 1-32.
27. Maltz, M. D., 1994: Deviating from the mean: The declining significance of significance. J. Res. Crime Deling., 31, 434-463.
28. McCabe, G. J., and D. R. Legates, 1992: General-circulation model simulations of winter and summer sea-level pressures over North America, Int. J. Climatol., 12, 815-827.
29. Michaelsen, J., 1987: Cross-validation in statistical climate forecast models. J. Climate Appl. Meteor., 26, 1589-1600.
30. Mielke, P. W., K. J. Berry, C. W. Landsea, and W. M. Gray, 1996: Artificial skill and validation in meteorological forecasting. Wea. Forecasting, 11, 153-169.
31. Mosier, C. I., 1951: Symposium: The need and means of cross-validation, I. Problems and designs of cross-validation. Educ. Psych. Meas., 11, 5-11.
32. Mosteller, F., and J. W. Tukey, 1977: Data Analysis and Regression. Addison-Wesley, 586 pp.
33. Murphy, A. H., and R. L. Winkler, 1984: Probability forecasting in meteorology. J. Amer. Statist. Assoc., 79, 489-500.
34. Nicholls, N., 1985: Predictability of interannual variations of Australian seasonal tropical cyclone activity. Mon. Wea. Rev., 113, 1144-1149.
35. Picard, R. R., and R. D. Cook, 1984: Cross-validation of regression models. J. Amer. Statist. Assoc., 79, 575-583.
36. _, and K. N. Berk, 1990: Data splitting. Amer. Statist., 44, 140-147.
37. Snee, R. D., 1977: Validation of regression models: Methods and examples. Technometrics, 19, 415-428.
38. Stone, M., 1974: Cross-validatory choice and assessment of statistical predictions. J. Roy. Statist. Soc., 36B, 111-147.
39. _, 1978: Cross-validation: A review. Math. Operationsforsch. Statist., Ser. Statistics, 9, 127-139.
40. Subrahmanyam, M., 1972: A property of simple least squares estimates. Sankhya, 34B, 355-356.
41. Toussaint, G. T., 1974: Bibliography on estimation of missclassification. IEEE Trans. Inf. Theory, 20, 472-479.
42. Tucker, D. F., P. W. Mielke, and E. R. Reiter, 1989: The verification of numerical models with multivariate randomized block permutation procedures. Meteor. Atmos. Phys., 40, 181-188.
43. Watterson, I. G., 1996: Nondimensional measures of climate model performance. Int. J. Climatol., 16, 379-391.
44. Willmott, C. J., 1982: Some comments on the evaluation of model performance. Bull. Amer. Meteor. Soc., 63, 1309-1313.
45. _, S. G. Ackleson, R. E. Davis, J. J. Feddema, K. M. Klink, D. R. Legates, J. O'Donnell, and C. M. Rowe, 1985: Statistics for the evaluation and comparison of models. J. Geophys. Res., 90, 8995-9005.