Accuracy assessment of prediction in patient outcomes

Journal of Evaluation in Clinical Practice

Volumn 14, Issue 1, 2008, Pages 1-10

  Bartfay, Emma ^a   Bartfay, Wally J ^a  

^a UNIVERSITY OF ONTARIO INSTITUTE OF TECHNOLOGY   (Canada)

Author keywords

Outcomes; Prediction accuracy; Prognosis; Statistical methods; Validation

Indexed keywords

BRIER SCORE; C INDEX; CALIBRATION; CLINICAL ASSESSMENT; CLINICAL PRACTICE; COVARIANCE; DEATH; DIAGNOSTIC ACCURACY; HEALTH SCIENCE; MEDICAL RESEARCH; MEDICINE; OUTCOME ASSESSMENT; PATIENT CARE; PRIORITY JOURNAL; PROBABILITY; PROGNOSIS; REVIEW; SENSITIVITY AND SPECIFICITY; STATISTICAL ANALYSIS; SURVIVAL; VALIDATION PROCESS;

CHRONIC DISEASE; DECISION SUPPORT TECHNIQUES; HUMANS; MODELS, STATISTICAL; OUTCOME ASSESSMENT (HEALTH CARE); PREDICTIVE VALUE OF TESTS; PROGNOSIS;

EID: 38349054388     PISSN: 13561294     EISSN: 13652753     Source Type: Journal    
DOI: 10.1111/j.1365-2753.2007.00817.x     Document Type: Review

References (42)

1. ASCO Special Article (1998) Cancer care during the last phase of life. Journal of Clinical Oncology, 16, 1986 1996.
2. Weeks, J. C., Cook, E. F., O'Day, S. J., et al. (1998) Relationship between cancer patients' predictions of prognosis and their treatment preferences. Journal of the American Medical Association, 279 (21 1709 1714.
3. Muers, M. F., Shevlin, P. Brown, J. (1996) Prognosis in lung cancer: physicians' opinions compared with outcome and a predictive model. Thorax, 51 (9 894 902.
4. Clark, G. M. (1994) Do we really need prognostic factors for breast cancer? Breast Cancer Research and Treatment, 30 (2 117 126.
5. Simon, R. Altman, D. G. (1994) Statistical aspects of prognostic factor studies in oncology. British Journal of Cancer, 69, 979 985.
6. Mazumdar, M. Glassman, J. R. (2000) Categorizing a prognostic variable: review of methods, code for easy implementation and applications to decision-making about cancer treatment. Statistics in Medicine, 19, 113 132.
7. Altman, D. G. Royston, P. (2000) What do we mean by validating a prognostic model? Statistics in Medicine, 19, 453 473.
8. Mackillop, W. J., Bartfay, E. Groome, P. A. (2001) Measuring the accuracy of prognostic judgements. In Prognostic Factors in Cancer, 2nd edn (eds M. K. Gospodarowicz, D. E. Henson, R. V. P. Hutter, B. O'Sullivan, L. H. Sobin C. H. Wittekind pp. 127 145. Toronto:Wiley-Liss.
9. Christakis, N. A. Lamont, E. B. (2000) Extent and determinants of error in doctors' prognoses in terminally ill patients: prospective cohort study. British Medical Journal, 320, 469 479.
10. Justice, A. C., Covinsky, K. E. Berlin, J. A. (1999) Assessing the generalizability of prognostic information. Annals of Internal Medicine, 130, 515 524.
11. Braitman, L. E. Davidoff, F. (1996) Predicting clinical states in individual patients. Annals of Internal Medicine, 125, 406 412.
12. Hermanek, P. (1999) Prognostic factor research in oncology. Journal of Clinical Epidemiology, 52 (4 371 374.
13. Schwarzer, G., Vach, W. Schumacher, M. (2000) On the misuses of artificial neural networks for prognostic and diagnostic classification in oncology. Statistics in Medicine, 19 (4 541 561.
14. Poses, R. M., Cebul, R. D. Centor, R. M. (1988) Evaluating of physicians' probabilistic judgments. Medical Decision Making, 8, 223 240.
15. van Houwelingen, H. C. (2000) Validation, calibration, revision and combination of prognostic survival models. Statistics in Medicine, 19, 3401 3415.
16. Burke, H. B., Goodman, P. H., Rosen, D. B., Henson, D. E., Weinstein, J. N., Harrell, F. E., Marks, J. R., Winchester, D. P. Bostwick, D. G. (1997) Artificial neural networks improve the accuracy of cancer survival prediction. Cancer, 79, 857 862.
17. Ash, A. S. Shwartz, M. (1994) Evaluating the performance or risk-adjustment methods: dichotomous measures. In Adjustment for Measuring Health Care Outcomes (ed. L. I. Iezzoni), pp. 313 346. Ann Arbor, MI:Health Administration Press.
18. Yates, J. F. (1982) External correspondence: decompositions of the mean probability score. Organizational Behavioral and Human Performance, 30, 132 156.
19. Pritchard, M. L. Woosley, J. T. (1995) Comparison of two prognostic models predicting survival in patients with malignant melanoma. Human Pathology, 26 (9 1028 1031.
20. Knaus, W. A., Harrell, F. E., Jr, Lynn, J., et al. (1995) The SUPPORT prognostic model. Objective estimates of survival for seriously ill hospitalized adults. Study to understand prognoses and preferences for outcomes and risks of treatments. Annals of Internal Medicine, 122 (3 191 203.
21. Christensen, C., Cottrell, J. J., Murakami, J., Mackesy, M. E., Fetzer, A. S. Elstein, A. S. (1993) Forecasting survival in the medical intensive care unit: a comparison of clinical prognoses with formal estimates. Methods of Information in Medicine, 32 (4 302 308.
22. Dorfman, D. D. Alf, E. (1969) Maximum likelihood estimation of parameters of signal detection theory and determination of confidence intervals - rating-method data. Journal of Mathematical Psychology, 6, 487 496.
23. Hanley, J. A. McNeil, B. J. (1982) The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology, 143, 29 36.
24. Harrell, F. E., Jr, Lee, K. L. Mark, D. B 1996) Multivariate prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Statistics in Medicine, 15 (4 361 387.
25. Redelmeier, D. A., Bloch, D. A. Hickam, D. H. (1991) Assessing predictive accuracy: how to compare Brier score. Journal of Clinical Epidemiology, 44 (11 1141 1146.
26. Spiegelhalter, D. J. (1986) Probabilistic prediction in patient management and clinical trials. Statistics in Medicine, 5, 421 433.
27. Murphy, A. H. (1972) Scalar and vector partitions of the probability score: part I. Two-state situation. Journal of Applied Meteorology, 11, 273 282.
28. Murphy, A. H. (1972) Scalar and vector partitions of the probability score: part II. N-state situation. Journal of Applied Meteorology, 1, 1183 1192.
29. Murphy, A. H. (1973) A new vector partitions of the probability score. Journal of Applied Meteorology, 12, 595 600.
30. Arkes, H. R., Dawson, N. V., Speroff, T., et al. (1995) The covariance decomposition of the probability score and its use in evaluating prognostic estimates. Medical Decision Making, 15 (2 120 131.
31. Picard, R. R. Berk, K. N. (1990) Data splitting. American Statistician, 44 (2 140 147.
32. Efron, B. (1983) Estimating the error rate of a prediction rule: improvement on cross-validation. Journal of the American Statistical Association, 78, 316 331.
33. Efron, B. Tibshirani, R. (1993) An Introduction to the Bootstrap. New York:Chapman & Hall.
34. Efron, B. (1986) How biased is the apparent error rate of a prediction rule? Journal of the American Statistical Association, 81, 461 470.
35. Feinstein, A. R. (1996) Multivariable Analysis: An Introduction. New Haven, CT:Yale University Press, pp. 184 187, 578 582.
36. Hirsch, R. P. (1991) Validation samples. Biometrics, 47, 1193 1194.
37. van Houwelingen, J. C. le Cressie, S. (1990) Predictive value of statistical models. Statistics in Medicine, 8, 1303 1325.
38. Harrell, F. E., Jr (2001) Regression Modeling Strategies: With Applications to Linear Models, Logistic Regression, and Survival Analysis. Charlottesville, VA:University of Virginia.
39. Bartfay, E. (2002) Internal validation vs. external validation: a case study. The 2002 Statistical Society of Canada Annual Meeting, Hamilton, ON, Canada. [abstract].
40. Roecker, E. B. (1991) Prediction error and its estimation for subset-selected models. Technometrics, 33, 459 468.
41. Breiman, L. (1992) The little bootstrap and other methods for dimensionality selection in regression: X-fixed prediction error. Journal of the American Statistical Association, 87, 738 754.
42. Ahlburg, D. (1982) How accurate are the US Bureau of the Census projections of total live births? Journal of Forecasting, 1, 365 374.