Overview of Risk Prediction Models in Cardiovascular Disease Research

Annals of Epidemiology

Volumn 19, Issue 10, 2009, Pages 711-717

  Cui, Jisheng ^a  

^a DEAKIN UNIVERSITY   (Australia)

Author keywords

Assessment; Calibration; Discrimination; Risk prediction

Indexed keywords

ACCURACY; ANALYTIC METHOD; AUSTRALIA; CARDIOVASCULAR DISEASE; CARDIOVASCULAR RISK; CHRONIC DISEASE; DIAGNOSTIC TEST; DISCRIMINANT ANALYSIS; GENETIC RISK; HIGH RISK PATIENT; HUMAN; MATHEMATICAL ANALYSIS; MATHEMATICAL MODEL; MATHEMATICAL PARAMETERS; MEDICAL RESEARCH; PATIENT CODING; PREDICTION; PRIORITY JOURNAL; PROBABILITY; PROGNOSIS; REVIEW; RISK ASSESSMENT; RISK FACTOR; ROC CURVE; SENSITIVITY AND SPECIFICITY; STATISTICAL MODEL; STATISTICAL SIGNIFICANCE; STOICHIOMETRY; VALIDATION STUDY;

AREA UNDER CURVE; BIOLOGICAL MARKERS; CARDIOVASCULAR DISEASES; HUMANS; MODELS, STATISTICAL; RISK ASSESSMENT; ROC CURVE;

EID: 69449104962     PISSN: 10472797     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.annepidem.2009.05.005     Document Type: Review

References (88)

1. Kannel W.B., D'Agostino R.B., Sullivan L., and Wilson P.W. Concept and usefulness of cardiovascular risk profiles. Am Heart J 148 1 (2004 Jul) 16-26
2. World Health Organization. Prevention of Cardiovascular Disease. Guidelines for assessment and management of cardiovascular risk (2007), World Health Organization, Geneva
3. Jurgensen J.S. The value of risk scores. Heart 92 12 (2006 Dec) 1713-1714
4. Rose G. Sick individuals and sick populations. Int J Epidemiol 14 1 (1985 Mar) 32-38
5. Ross G. The strategy of preventive medicine (1992), Oxford University, Oxford
6. Manuel D.G., Lim J., Tanuseputro P., Anderson G.M., Alter D.A., Laupacis A., et al. Revisiting Rose: strategies for reducing coronary heart disease. BMJ 332 7542 (2006 Mar 18) 659-662
7. Wolf P.A., D'Agostino R.B., Belanger A.J., and Kannel W.B. Probability of stroke: a risk profile from the Framingham Study. Stroke 22 3 (1991 Mar) 312-318
8. Anderson K.M., Wilson P.W., Odell P.M., and Kannel W.B. An updated coronary risk profile. A statement for health professionals. Circulation 83 1 (1991 Jan) 356-362
9. Anderson K.M., Odell P.M., Wilson P.W., and Kannel W.B. Cardiovascular disease risk profiles. Am Heart J 121 1 Pt 2 (1991 Jan) 293-298
10. Wilson P.W., D'Agostino R.B., Levy D., Belanger A.M., Silbershatz H., and Kannel W.B. Prediction of coronary heart disease using risk factor categories. Circulation 97 18 (1998 May 12) 1837-1847
11. Kannel W.B., D'Agostino R.B., Silbershatz H., Belanger A.J., Wilson P.W., and Levy D. Profile for estimating risk of heart failure. Arch Intern Med 159 11 (1999 Jun 14) 1197-1204
12. D'Agostino R.B., Russell M.W., Huse D.M., Ellison R.C., Silbershatz H., Wilson P.W., et al. Primary and subsequent coronary risk appraisal: new results from the Framingham study. Am Heart J 139 2 Pt 1 (2000 Feb) 272-281
13. D'Agostino Sr. R.B., Vasan R.S., Pencina M.J., Wolf P.A., Cobain M., Massaro J.M., et al. General cardiovascular risk profile for use in primary care: the Framingham Heart Study. Circulation 117 6 (2008 Feb 12) 743-753
14. Kannel W.B., McGee D., and Gordon T. A general cardiovascular risk profile: the Framingham Study. Am J Cardiol 38 1 (1976 Jul) 46-51
15. Ridker P.M., Buring J.E., Rifai N., and Cook N.R. Development and validation of improved algorithms for the assessment of global cardiovascular risk in women: the Reynolds Risk Score. JAMA 297 6 (2007 Feb 14) 611-619
16. Wang T.J., Gona P., Larson M.G., Tofler G.H., Levy D., Newton-Cheh C., et al. Multiple biomarkers for the prediction of first major cardiovascular events and death. N Engl J Med 355 25 (2006 Dec 21) 2631-2639
17. Brindle P., Emberson J., Lampe F., Walker M., Whincup P., Fahey T., et al. Predictive accuracy of the Framingham coronary risk score in British men: prospective cohort study. BMJ 327 7426 (2003 Nov 29) 1267
18. Pyorala K. Assessment of coronary heart disease risk in populations with different levels of risk. Eur Heart J 21 5 (2000 Mar) 348-350
19. Menotti A., Puddu P.E., and Lanti M. Comparison of the Framingham risk function-based coronary chart with risk function from an Italian population study. Eur Heart J 21 5 (2000 Mar) 365-370
20. Thomsen T.F., McGee D., Davidsen M., and Jorgensen T. A cross-validation of risk-scores for coronary heart disease mortality based on data from the Glostrup Population Studies and Framingham Heart Study. Int J Epidemiol 31 4 (2002 Aug) 817-822
21. Hense H.W., Schulte H., Lowel H., Assmann G., and Keil U. Framingham risk function overestimates risk of coronary heart disease in men and women from Germany-results from the MONICA Augsburg and the PROCAM cohorts. Eur Heart J 24 10 (2003 May) 937-945
22. Diverse Population Collaborative Group. Prediction of mortality from coronary heart disease among diverse populations: is there a common predictive function?. Heart 88 (2002) 222-228
23. Conroy R.M., Pyorala K., Fitzgerald A.P., Sans S., Menotti A., De Backer G., et al. Estimation of ten-year risk of fatal cardiovascular disease in Europe: the SCORE project. Eur Heart J 24 11 (2003 Jun) 987-1003
24. De Backer G., Ambrosioni E., Borch-Johnsen K., Brotons C., Cifkova R., Dallongeville J., et al. European guidelines on cardiovascular disease prevention in clinical practice. Third Joint Task Force of European and Other Societies on Cardiovascular Disease Prevention in Clinical Practice. Eur Heart J 24 17 (2003 Sep) 1601-1610
25. Sans S., Fitzgerald A.P., Royo D., Conroy R., and Graham I. Calibrating the SCORE cardiovascular risk chart for use in Spain. Rev Esp Cardiol 60 5 (2007 May) 476-485
26. Hippisley-Cox J., Coupland C., Vinogradova Y., Robson J., May M., and Brindle P. Derivation and validation of QRISK, a new cardiovascular disease risk score for the United Kingdom: prospective open cohort study. BMJ 335 7611 (2007 Jul 21) 136
27. Hippisley-Cox J., Coupland C., Vinogradova Y., Robson J., and Brindle P. Performance of the QRISK cardiovascular risk prediction algorithm in an independent UK sample of patients from general practice: a validation study. Heart 94 1 (2008 Jan) 34-39
28. Assmann G., Cullen P., and Schulte H. Simple scoring scheme for calculating the risk of acute coronary events based on the 10-year follow-up of the prospective cardiovascular Munster (PROCAM) study. Circulation 105 3 (2002 Jan 22) 310-315
29. Voss R., Cullen P., Schulte H., and Assmann G. Prediction of risk of coronary events in middle-aged men in the Prospective Cardiovascular Munster Study (PROCAM) using neural networks. Int J Epidemiol 31 6 (2002 Dec) 1253-1262 discussion 62-64
30. Assmann G., Schulte H., Cullen P., and Seedorf U. Assessing risk of myocardial infarction and stroke: new data from the Prospective Cardiovascular Munster (PROCAM) study. Eur J Clin Invest 37 12 (2007 Dec) 925-932
31. Woodward M., Brindle P., and Tunstall-Pedoe H. Adding social deprivation and family history to cardiovascular risk assessment: the ASSIGN score from the Scottish Heart Health Extended Cohort (SHHEC). Heart 93 2 (2007 Feb) 172-176
32. Ferrario M., Chiodini P., Chambless L.E., Cesana G., Vanuzzo D., Panico S., et al. Prediction of coronary events in a low incidence population. Assessing accuracy of the CUORE Cohort Study prediction equation. Int J Epidemiol 34 2 (2005 Apr) 413-421
33. Wu Y., Liu X., Li X., Li Y., Zhao L., Chen Z., et al. Estimation of 10-year risk of fatal and nonfatal ischemic cardiovascular diseases in Chinese adults. Circulation 114 21 (2006 Nov 21) 2217-2225
34. Saito I., Sato S., Nakamura M., Kokubo Y., Mannami T., Adachi H., et al. A low level of C-reactive protein in Japanese adults and its association with cardiovascular risk factors: the Japan NCVC-Collaborative Inflammation Cohort (JNIC) study. Atherosclerosis 194 1 (2007 Sep) 238-244
35. Sritara P., Cheepudomwit S., Chapman N., Woodward M., Kositchaiwat C., Tunlayadechanont S., et al. Twelve-year changes in vascular risk factors and their associations with mortality in a cohort of 3499 Thais: the Electricity Generating Authority of Thailand Study. Int J Epidemiol 32 3 (2003 Jun) 461-468
36. Jackson R. Updated New Zealand cardiovascular disease risk-benefit prediction guide. BMJ 320 7236 (2000 Mar 11) 709-710
37. Knuiman M.W., Vu H.T., and Bartholomew H.C. Multivariate risk estimation for coronary heart disease: the Busselton Health Study. Aust N Z J Public Health 22 7 (1998 Dec) 747-753
38. Knuiman M.W., and Vu H.T. Prediction of coronary heart disease mortality in Busselton, Western Australia: an evaluation of the Framingham, national health epidemiologic follow up study, and WHO ERICA risk scores. J Epidemiol Community Health 51 5 (1997 Oct) 515-519
39. Marschner I.C., Colquhoun D., Simes R.J., Glasziou P., Harris P., Singh B.B., et al. Long-term risk stratification for survivors of acute coronary syndromes. Results from the Long-term Intervention with Pravastatin in Ischemic Disease (LIPID) Study. LIPID Study Investigators. J Am Coll Cardiol 38 1 (2001 Jul) 56-63
40. Cui J., Forbes A., Kirby A., Marschner I., Simes J., West M., et al. Parametric conditional frailty models for recurrent cardiovascular events in the LIPID Study. Clin Trials 5 (2008) 565-574
41. Gail M.H., Brinton L.A., Byar D.P., Corle D.K., Green S.B., Schairer C., et al. Projecting individualized probabilities of developing breast cancer for white females who are being examined annually. J Natl Cancer Inst 81 24 (1989 Dec 20) 1879-1886
42. Costantino J.P., Gail M.H., Pee D., Anderson S., Redmond C.K., Benichou J., et al. Validation studies for models projecting the risk of invasive and total breast cancer incidence. J Natl Cancer Inst 91 18 (1999 Sep 15) 1541-1548
43. Spiegelman D., Colditz G.A., Hunter D., and Hertzmark E. Validation of the Gail, et al. model for predicting individual breast cancer risk. J Natl Cancer Inst 86 8 (1994 Apr 20) 600-607
44. Rockhill B., Spiegelman D., Byrne C., Hunter D.J., and Colditz G.A. Validation of the Gail, et al. model of breast cancer risk prediction and implications for chemoprevention. J Natl Cancer Inst 93 5 (2001 Mar 7) 358-366
45. Bondy M.L., Lustbader E.D., Halabi S., Ross E., and Vogel V.G. Validation of a breast cancer risk assessment model in women with a positive family history. J Natl Cancer Inst 86 8 (1994 Apr 20) 620-625
46. Altman D.G., and Royston P. What do we mean by validating a prognostic model?. Stat Med 19 4 (2000 Feb 29) 453-473
47. D'Agostino Sr. R.B., Grundy S., Sullivan L.M., and Wilson P. Validation of the Framingham coronary heart disease prediction scores: results of a multiple ethnic groups investigation. JAMA 286 2 (2001 Jul 11) 180-187
48. Altman D.G., and Bland J.M. Quartiles, quintiles, centiles, and other quantiles. BMJ 309 6960 (1994 Oct 15) 996
49. Liu J., Hong Y., D'Agostino Sr. R.B., Wu Z., Wang W., Sun J., et al. Predictive value for the Chinese population of the Framingham CHD risk assessment tool compared with the Chinese Multi-Provincial Cohort Study. JAMA 291 21 (2004 Jun 2) 2591-2599
50. May M., Lawlor D.A., Brindle P., Patel R., and Ebrahim S. Cardiovascular disease risk assessment in older women: can we improve on Framingham? British Women's Heart and Health prospective cohort study. Heart 92 10 (2006 Oct) 1396-1401
51. Kaplan E., and Meier P. Non-parametric estimation from incomplete observations. J Am Stat Assoc 53 (1958) 457-481
52. Hosmer D., and Lemeshow S. Applied logistic regression (1989), Wiley, New York
53. Lemeshow S., and Hosmer Jr. D.W. A review of goodness of fit statistics for use in the development of logistic regression models. Am J Epidemiol 115 1 (1982 Jan) 92-106
54. Cook N.R. Use and misuse of the receiver operating characteristic curve in risk prediction. Circulation 115 7 (2007 Feb 20) 928-935
55. Harrell Jr. F.E., Califf R.M., Pryor D.B., Lee K.L., and Rosati R.A. Evaluating the yield of medical tests. JAMA 247 18 (1982) 2543-2546
56. Bamber D. The area above the ordinal dominance graph and the area below the receiver operating characteristic graph. J Math Psychol 12 (1975) 387-415
57. Pencina M.J., and D'Agostino R.B. Overall C as a measure of discrimination in survival analysis: model specific population value and confidence interval estimation. Stat Med 23 13 (2004 Jul 15) 2109-2123
58. Zou K.H., O'Malley A.J., and Mauri L. Receiver-operating characteristic analysis for evaluating diagnostic tests and predictive models. Circulation 115 5 (2007 Feb 6) 654-657
59. Lusted L.B. Signal detectability and medical decision-making. Science 171 977 (1971 Mar 26) 1217-1219
60. Lloyd C. Using smooth receiver operating characteristic curves to summarize and compare diagnostic systems. J Am Stat Assoc 93 (1998) 1356-1364
61. Zhou X., Obuchowski N., and McClish D. Statistical Methods in Diagnostic Medicine (2002), Wiley & Sons, New York
62. Pepe M. The Statistical Evaluation of Medical Tests for Classification and Prediction (2003), Oxford University Press, Oxford
63. Campbell G. Advances in statistical methodology for the evaluation of diagnostic and laboratory tests. Stat Med 13 5-7 (1994 Mar 15-Apr 15) 499-508
64. Shapiro D.E. The interpretation of diagnostic tests. Stat Methods Med Res 8 2 (1999 Jun) 113-134
65. Lloyd-Jones D.M., and Tian L. Predicting cardiovascular risk: so what do we do now?. Arch Intern Med 166 13 (2006 Jul 10) 1342-1344
66. Greenland P., and O'Malley P.G. When is a new prediction marker useful? A consideration of lipoprotein-associated phospholipase A2 and C-reactive protein for stroke risk. Arch Intern Med 165 21 (2005 Nov 28) 2454-2456
67. Ware J.H. The limitations of risk factors as prognostic tools. N Engl J Med 355 25 (2006 Dec 21) 2615-2617
68. Cui J., Forbes A., Kirby A., Simes J., and Tonkin A. Laboratory and Non-laboratory Based Risk Prediction Models for Secondary Prevention of Cardiovascular Disease: The LIPID Study. Eur J Cardiovasc Prev Rehabil (2009) (in press)
69. Baker S.G. The central role of receiver operating characteristic (ROC) curves in evaluating tests for the early detection of cancer. J Natl Cancer Inst 95 7 (2003 Apr 2) 511-515
70. Gail M.H., and Pfeiffer R.M. On criteria for evaluating models of absolute risk. Biostatistics 6 2 (2005 Apr) 227-239
71. Smulders Y.M., Thijs A., and Twisk J.W. New cardiovascular risk determinants do exist and are clinically useful. Eur Heart J 29 4 (2008 Feb) 436-440
72. Wang T.J. New cardiovascular risk factors exist, but are they clinically useful?. Eur Heart J 29 4 (2008 Feb) 441-444
73. Ridker P.M., and Cook N.R. Biomarkers for prediction of cardiovascular events. N Engl J Med 356 14 (2007 Apr 5) 1472-1473 author reply 4-5
74. Gerszten R.E., and Wang T.J. The search for new cardiovascular biomarkers. Nature 451 7181 (2008 Feb 21) 949-952
75. Elmore J.G., and Fletcher S.W. The risk of cancer risk prediction: "What is my risk of getting breast cancer"?. J Natl Cancer Inst 98 23 (2006 Dec 6) 1673-1675
76. Pepe M.S., Janes H., Longton G., Leisenring W., and Newcomb P. Limitations of the odds ratio in gauging the performance of a diagnostic, prognostic, or screening marker. Am J Epidemiol 159 9 (2004 May 1) 882-890
77. Wald N.J., Hackshaw A.K., and Frost C.D. When can a risk factor be used as a worthwhile screening test?. BMJ 319 7224 (1999 Dec 11) 1562-1565
78. Cui J., Antoniou A.C., Dite G.S., Southey M.C., Venter D.J., Easton D.F., et al. After BRCA1 and BRCA2-what next? Multifactorial segregation analyses of three-generation, population-based Australian families affected by female breast cancer. Am J Hum Genet 68 2 (2001 Feb) 420-431
79. Cui J., and Hopper J.L. Distribution of family history of a disease as a function of mode of inheritance, genetic relative hazard, allele frequency and disease status of the proband, with application to female breast cancer. J Epidemiol Biostat 6 4 (2001) 331-342
80. Cui J., Staples M.P., Hopper J.L., English D.R., McCredie M.R., and Giles G.G. Segregation analyses of 1,476 population-based Australian families affected by prostate cancer. Am J Hum Genet 68 5 (2001 May) 1207-1218
81. Pepe M.S., Feng Z., Huang Y., Longton G., Prentice R., Thompson I.M., et al. Integrating the predictiveness of a marker with its performance as a classifier. Am J Epidemiol 167 3 (2008 Feb 1) 362-368
82. Huang Y., Sullivan Pepe M., and Feng Z. Evaluating the predictiveness of a continuous marker. Biometrics 63 4 (2007 Dec) 1181-1188
83. Bura E., and Gastwirth J. The binary regression quantile plot: assessing the importance of predictors in binary regression visually. Biometrical Journal 43 1 (2001) 5-21
84. Copas J. The effectiveness of risk scores: the logit rank plot. Journal of the Royal Statistical Society. Series C 48 (1999) 165-183
85. Cook N.R., Buring J.E., and Ridker P.M. The effect of including C-reactive protein in cardiovascular risk prediction models for women. Ann Intern Med 145 1 (2006 Jul 4) 21-29
86. Pencina M.J., D'Agostino Sr. R.B., D'Agostino Jr. R.B., and Vasan R.S. Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond. Stat Med 27 2 (2008 Jan 30) 157-172 discussion 207-12
87. Pepe M.S., Feng Z., and Gu J.W. Comments on 'Evaluating the added predictive ability of a new marker: From area under the ROC curve to reclassification and beyond' by M.J. Pencina et al., Statistics in Medicine. Stat Med 27 2 (2008 Jan 30) 173-181
88. Cook N.R. Comments on 'Evaluating the added predictive ability of a new marker: From area under the ROC curve to reclassification and beyond' by M.J. Pencina et al., Statistics in Medicine. Stat Med 27 2 (2008 Jan 30) 191-195