Predictive model assessment for count data

Biometrics

Volumn 65, Issue 4, 2009, Pages 1254-1261

  Czado, Claudia ^a   Gneiting, Tilmann ^b   Held, Leonhard ^c  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

^b UNIVERSITY OF WASHINGTON   (United States)

^c UNIVERSITY OF ZURICH   (Switzerland)

Author keywords

Calibration; Forecast verification; Model diagnostics; Predictive deviance; Probability integral transform; Proper scoring rule

Indexed keywords

INTEGRAL EQUATIONS; REGRESSION ANALYSIS;

BAYESIAN; COUNT DATUM; FORECAST VERIFICATIONS; INTEGRAL TRANSFORM; MODEL ASSESSMENT; MODEL DIAGNOSTICS; PREDICTIVE DEVIANCE; PREDICTIVE MODELS; PROBABILITY INTEGRAL TRANSFORM; PROPER SCORING RULES;

CALIBRATION;

BAYESIAN ANALYSIS; CALIBRATION; CANCER; COHORT ANALYSIS; FORECASTING METHOD; MODEL VALIDATION; REGRESSION ANALYSIS;

ACCURACY; ARTICLE; CALIBRATION; CANCER INCIDENCE; COHORT ANALYSIS; EVALUATION; GERMANY; HUMAN; LARYNX CANCER; PATENT; PREDICTION; PROBABILITY; REGRESSION ANALYSIS; SCORING SYSTEM; SIMULATION; STATISTICAL MODEL;

EID: 70450231574     PISSN: 0006341X     EISSN: 15410420     Source Type: Journal    
DOI: 10.1111/j.1541-0420.2009.01191.x     Document Type: Article

References (49)

1. Baker, A. and Bray, I. (2005). Bayesian projections: What are the effects of excluding data from younger age groups? American Journal of Epidemiology 162, 798 805.
2. Besag, J. E., Green, P. J., Higdon, D. M., and Mengersen, K. L. (1995). Bayesian computation and stochastic systems (with discussion). Statistical Science 10, 3 41.
3. Bröcker, J. and Smith, L. A. (2007). Scoring probabilistic forecasts: The importance of being proper. Weather and Forecasting 22, 382 388.
4. Brockwell, A. E. (2007). Universal residuals: A multivariate transformation. Statistics and Probability Letters 77, 1473 1478.
5. Candille, G. and Talagrand, O. (2005). Evaluation of probabilistic prediction systems of a scalar variable. Quarterly Journal of the Royal Meteorological Society 131, 2131 2150.
6. Carroll, S. S. and Cressie, N. (1997). Spatial modeling of snow water equivalent using covariances estimated from spatial and geomorphic attributes. Journal of Hydrology 190, 42 59.
7. Christensen, O. F. and Waagepetersen, R. (2002). Bayesian prediction of spatial count data using generalized linear mixed models. Biometrics 58, 280 286.
8. Clements, M. P. (2005). Evaluating Econometric Forecasts of Economic and Financial Variables. Basingstoke, U.K. : Palgrave Macmillan.
9. Clements, M. S., Armstrong, B. K., and Moolgavkar, S. H. (2005). Lung cancer rate predictions using generalized additive models. Biostatistics 6, 576 589.
10. Clements, M. S., Hakulinen, T., and Moolgavkar, S. H. (2006). Re: Bayesian projections: What are the effects of excluding data from younger age groups? American Journal of Epidemiology 164, 292 293.
11. Czado, C., Erhardt, V., Min, A., and Wagner, S. (2007). Zero-inflated generalized Poisson models with regression effects on the mean, dispersion and zero-inflation level applied to patent outsourcing rates. Statistical Modelling 7, 125 153.
12. Dawid, A. P. (1984). Statistical theory: The prequential approach. Journal of the Royal Statistical Society, Series A, General 147, 278 292.
13. Dawid, A. P. and Sebastiani, P. (1999). Coherent dispersion criteria for optimal experimental design. Annals of Statistics 27, 65 81.
14. Diebold, F. X., Gunther, T. A., and Tay, A. S. (1998). Evaluating density forecasts with applications to financial risk management. International Economic Review 39, 863 883.
15. Elsner, J. B. and Jagger, T. H. (2006). Prediction models for annual U.S. hurricane counts. Journal of Climate 19, 2935 2952.
16. Epstein, E. S. (1969). A scoring system for probability forecasts of ranked categories. Journal of Applied Meteorology 8, 985 987.
17. Frühwirth-Schnatter, S. (1996). Recursive residuals and model diagnostics for normal and non-normal state space models. Environmental and Ecological Statistics 3, 291 309.
18. Frühwirth-Schnatter, S. and Wagner, H. (2006). Auxiliary mixture sampling for parameter-driven models of time series of counts with applications to state space modelling. Biometrika 93, 827 841.
19. Frühwirth-Schnatter, S., Frühwirth, R., Held, L., and Rue, H. (2009). Improved auxiliary mixture sampling for hierarchical models of non-Gaussian data. Statistics and Computing, in press.
20. Gelfand, A. E. and Ghosh, S. K. (1998). Model choice: A minimum posterior predictive loss approach. Biometrika 85, 1 11.
21. Gneiting, T. and Raftery, A. E. (2007). Strictly proper scoring rules, prediction, and estimation. Journal of the American Statistical Association 102, 359 378.
22. Gneiting, T., Balabdaoui, F., and Raftery, A. E. (2007). Probabilistic forecasts, calibration and sharpness. Journal of the Royal Statistical Society, Series B, Statistical Methodology 69, 243 268.
23. Good, I. J. (1952). Rational decisions. Journal of the Royal Statistical Society, Series B, Methodological 14, 107 114.
24. Gotway, C. A. and Wolfinger, R. D. (2003). Spatial prediction of counts and rates. Statistics in Medicine 22, 1415 1432.
25. Grammig, J. and Kehrle, K. (2008). A new marked point process model for the federal funds rate target: Methodology and forecast evaluation. Journal of Economic Dynamics and Control 32, 2370 2396.
26. Gschlößl, S. and Czado, C. (2007). Spatial modelling of claim frequency and claim size in non-life insurance. Scandinavian Actuarial Journal 107, 202 225.
27. Gschlößl, S. and Czado, C. (2008). Modelling count data with overdispersion and spatial effects. Statistical Papers 49, 531 552.
28. Hamill, T. M. (2001). Interpretation of rank histograms for verifying ensemble forecasts. Monthly Weather Review 129, 550 560.
29. Handcock, M. S. and Morris, M. (1999). Relative Distribution Methods in the Social Sciences. New York : Springer.
30. Ihaka, R. and Gentleman, R. (1996). R: A language for data analysis and graphics. Journal of Computational and Graphical Statistics 5, 299 314.
31. Jolliffe, I. T. (2007). Uncertainty and inference for verification measures. Weather and Forecasting 22, 637 650.
32. Jolliffe, I. T. and Stephenson, D. B. (2003). Forecast Verification: A Practicioner's Guide in Atmospheric Science. Chichester, U.K. : John Wiley and Sons.
33. Knorr-Held, L. and Rainer, E. (2001). Projections of lung cancer mortality in West Germany: A case study in Bayesian prediction. Biostatistics 2, 109 129.
34. Lawless, J. (1987). Negative binomial and mixed Poisson regression. Canadian Journal of Statistics 15, 209 225.
35. Liesenfeld, R., Nolte, I., and Pohlmeier, W. (2006). Modeling financial transaction price movements: A dynamic integer count data model. Empirical Economics 30, 795 825.
36. McCabe, B. P. M. and Martin, G. M. (2005). Bayesian predictions of low count time series. International Journal of Forecasting 21, 315 330.
37. McCullagh, P. and Nelder, J. A. (1989). Generalized Linear Models, 2nd edition. London : Chapman and Hall.
38. Nelson, K. P. and Leroux, B. G. (2006). Statistical models for autocorrelated count data. Statistics in Medicine 25, 1413 1430.
39. O'Hagan, A. (2003). HSSS model criticism. In Highly Structured Stochastic Systems, P. J. Green, N. L. Hjort, and S. Richardson (eds 423 453. Oxford: Oxford University Press.
40. Pepe, M. S. (2003). The Statistical Evaluation of Medical Tests for Classification and Prediction. Oxford : Oxford University Press.
41. Rubin, D. B. (1984). Bayesianly justifiable and relevant frequency calculations for the applied statistician. Annals of Statistics 12, 1151 1172.
42. Smith, J. Q. (1985). Diagnostic checks of non-standard time series models. Journal of Forecasting 4, 283 291.
43. Spiegelhalter, D. J., Best, N. G., Carlin, B. P., and Van Der Linde, A. (2002). Bayesian measures of model complexity and fit (with discussion). Journal of the Royal Statistical Society, Series B, Statistical Methodology 64, 583 639.
44. Stone, M. (1977). An asymptotic equivalence of choice of model by cross-validation and Akaike's criterion. Journal of the Royal Statistical Society, Series B, Methodological 39, 44 47.
45. Vuong, Q. H. (1989). Likelihood tests for model selection and non-nested hypotheses. Econometrica 57, 307 333.
46. Wang, P., Cockburn, I. M., and Puterman, M. L. (1998). Analysis of patent data - a mixed-Poisson-regression-model approach. Journal of Business and Economic Statistics 16, 27 41.
47. Wecker, W. B. (1989). Assessing the accuracy of time series model forecasts of count observations. Journal of Business and Economic Statistics 7, 418 419.
48. Winkelmann, R. (2008). Econometric Analysis of Count Data, 5th edition. Berlin : Springer.
49. Winkler, R. L. (1996). Scoring rules and the evaluation of probabilities. Test 5, 1 60.