Separating the brier score into calibration and refinement components: A graphical exposition

American Statistician

Volumn 39, Issue 1, 1985, Pages 26-32

  Blattenberger, Gail ^a   Lad, Frank ^b  

^a UNIVERSITY OF UTAH   (United States)

^b FEDERAL RESERVE BOARD   (United States)

Author keywords

Brier score; Calibration; Laws of large numbers; Proper scoring rules; Refinement

Indexed keywords

EID: 33745958247     PISSN: 00031305     EISSN: 15372731     Source Type: Journal    
DOI: 10.1080/00031305.1985.10479382     Document Type: Article

References (16)

1. Brier, G. W. (1950), “Verification of Forecasts Expressed in Terms of Probability,” Monthly Weather Review, 75, 1-3.
2. Dawid, A. P. (1982), “The Well-Calibrated Bayesian,” Journal of the American Statistical Association, 77, 605-613.
3. DeGroot, M., and Fienberg, S. (1982), “Assessing Probability Assessors: Calibration and Refinement,” in Statistical Decision Theory and Related Topics III (Vol. 1), eds. S. S. Gupta and J. O. Berger, New York: Academic Press, pp. 291-314.
4. DeGroot, M., and Fienberg, S. (1983), “The Comparison and Evaluation of Forecasters,” The Statistician, 32, 12-22.
5. de Finetti, B. (1974), Theory of Probability (Vol. 1), New York: John Wiley.
6. Kadane, J. (1982), “Comment,” Journal of the American Statistical Association, 77, 610-611.
7. Lad, F. (1984), “The Calibration Question,” British Journal for the Philosophy of Science, 35, 213-221.
8. Lichtenstein, S., Fischhoff, B., and Phillips, L. (1982), “Calibration of ‘ Probabilities: The State of the Art to 1980,” in Judgment Under Uncertainty: Heuristics and Biases, eds. D. Kahneman, P. Slovic, and A. Tversky, New York: Cambridge University Press.
9. Lindley, D. (1982), “Comment,” Journal of the American Statistical Association, 77, 611-612.
10. Murphy, A. H. (1972), “Scalar and Vector Partitions of the Probability Score. Part I: Two-State Situation,” Journal of Applied Meteorology, 11, 273-282.
11. Murphy, A. H. (1973), “A New Vector Partition of the Probability Score,” Journal of Applied Meteorology, 12, 595-600.
12. Pratt, J. (1962), “Must Subjective Probabilities Be Realized as Relative Frequencies?” unpublished manuscript, Harvard University, Graduate School of Business Administration.
13. Sanders, F. (1963), “On Subjective Probability Forecasting,” Journal of Applied Meteorology, 2, 191-201.
14. Savage, L. J. (1971), “The Elicitation of Personal Probabilities,” Journal of the American Statistical Association, 66, 783-801.
15. Schervish, M. J. (1983), “A General Method for Comparing Probability Assessors,” Technical Report 275, Camegie-Mellon University, Dept, of Statistics.
16. Vardeman, S., and Meeden, G. (1983), “Calibration, Sufficiency, and Domination Considerations for Bayesian Probability Assessors,” Journal of the American Statistical Association, 78, 808-816.