Prediction models for cardiovascular disease risk in the general population: Systematic review

BMJ (Online)

Volumn 353, Issue , 2016, Pages

  Damen, Johanna A A G ^a   Hooft, Lotty ^a   Schuit, Ewoud ^a,b   Debray, Thomas P A ^a   Collins, Gary S ^c   Tzoulaki, Ioanna ^d   Lassale, Camille M ^d   Siontis, George C M ^e   Chiocchia, Virginia ^c   Roberts, Corran ^c   Schlüssel, Michael Maia ^c   Gerry, Stephen ^c   Black, James A ^f   Heus, Pauline ^a   Van Der Schouw, Yvonne T ^a   Peelen, Linda M ^a   Moons, Karel G M ^a  

^a UNIVERSITY MEDICAL CENTER UTRECHT   (Netherlands)

^b STANFORD UNIVERSITY SCHOOL OF MEDICINE   (United States)

^c UNIVERSITY OF OXFORD   (United Kingdom)

^d IMPERIAL COLLEGE LONDON   (United Kingdom)

^e UNIVERSITY OF BERN   (Switzerland)

^f UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

AGE; CARDIOVASCULAR DISEASE; CARDIOVASCULAR RISK; HUMAN; ISCHEMIC HEART DISEASE; OUTCOME ASSESSMENT; PRACTICE GUIDELINE; PREDICTION; PRIORITY JOURNAL; REVIEW; RISK ASSESSMENT; SEX; SMOKING; SYSTEMATIC REVIEW; CARDIOVASCULAR DISEASES; FEMALE; MALE; PREDICTIVE VALUE; PROCEDURES; RISK FACTOR; THEORETICAL MODEL;

CARDIOVASCULAR DISEASES; FEMALE; HUMANS; MALE; MODELS, THEORETICAL; PREDICTIVE VALUE OF TESTS; RISK ASSESSMENT; RISK FACTORS;

EID: 84969929958     PISSN: 09598146     EISSN: 17561833     Source Type: Journal    
DOI: 10.1136/bmj.i2416     Document Type: Review

References (74)

1. Eckel RH, Jakicic JM, Ard JD, et al. American College of Cardiology/ American Heart Association Task Force on Practice Guidelines. 2013 AHA/ACC guideline on lifestyle management to reduce cardiovascular risk: a report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines. Circulation 2014;129(Suppl 2):S76-99. doi:10.1161/01. cir.0000437740.48606.d1.
2. Alwan A. Global status report on noncommunicable diseases 2010: World Health Organization, 2011. http://apps.who.int/iris/ bitstream/10665/44579/1/9789240686458-eng.pdf.
3. Anderson KM, Odell PM, Wilson PW, Kannel WB. Cardiovascular disease risk profiles. Am Heart J 1991;121:293-8. doi:10.1016/0002-8703(91)90861-B.
4. Anderson KM, Wilson PW, Odell PM, Kannel WB. An updated coronary risk profile. A statement for health professionals. Circulation 1991;83:356-62. doi:10.1161/01.CIR.83.1.356.
5. Wilson PW, D'Agostino RB, Levy D, Belanger AM, Silbershatz H, Kannel WB. Prediction of coronary heart disease using risk factor categories. Circulation 1998;97:1837-47. doi:10.1161/01.CIR.97.18.1837.
6. Conroy RM, Pyörälä K, Fitzgerald AP, et al. SCORE project group. Estimation of ten-year risk of fatal cardiovascular disease in Europe: the SCORE project. Eur Heart J 2003;24:987-1003. doi:10.1016/ S0195-668X(03)00114-3.
7. Hippisley-Cox J, Coupland C, Robson J, Brindle P. Derivation, validation, and evaluation of a new QRISK model to estimate lifetime risk of cardiovascular disease: cohort study using QResearch database. BMJ 2010;341:c6624. doi:10.1136/bmj.c6624.
8. Hippisley-Cox J, Coupland C, Vinogradova Y, Robson J, May M, Brindle P. Derivation and validation of QRISK, a new cardiovascular disease risk score for the United Kingdom: prospective open cohort study. BMJ 2007;335:136. doi:10.1136/bmj.39261.471806.55.
9. Hippisley-Cox J, Coupland C, Vinogradova Y, et al. Predicting cardiovascular risk in England and Wales: prospective derivation and validation of QRISK2. BMJ 2008;336:1475-82. doi:10.1136/ bmj.39609.449676.25.
10. Goff DC Jr, , Lloyd-Jones DM, Bennett G, et al. American College of Cardiology/American Heart Association Task Force on Practice Guidelines. 2013 ACC/AHA guideline on the assessment of cardiovascular risk: a report of the American College of Cardiology/ American Heart Association Task Force on Practice Guidelines. Circulation 2014;129(Suppl 2):S49-73. doi:10.1161/01. cir.0000437741.48606.98.
11. Lipid modification: cardiovascular risk assessment and the modification of blood lipids for the primary and secondary prevention of cardiovascular disease. NICE guidelines [CG181], National Institute for Health and Clinical Excellence 2014. https://www.nice.org.uk/ guidance/cg181.
12. Beswick AD, Brindle P, Fahey T, Ebrahim S. A Systematic Review of Risk Scoring Methods and Clinical Decision Aids Used in the Primary Prevention of Coronary Heart Disease (Supplement).Royal College of General Practitioners, 2008, http://www.ncbi.nlm.nih.gov/books/ NBK55818/.
13. Matheny M, McPheeters ML, Glasser A, et al. Systematic Review of Cardiovascular Disease Risk Assessment Tools. Rockville MD, 2011. http://www.ncbi.nlm.nih.gov/books/NBK56166/.
14. Wessler BS, Lai Yh L, Kramer W, et al. Clinical Prediction Models for Cardiovascular Disease: Tufts Predictive Analytics and Comparative Effectiveness Clinical Prediction Model Database. Circ Cardiovasc Qual Outcomes 2015;8:368-75. doi:10.1161/ CIRCOUTCOMES.115.001693.
15. Moons KG, de Groot JA, Bouwmeester W, et al. Critical appraisal and data extraction for systematic reviews of prediction modelling studies: the CHARMS checklist. PLoS Med 2014;11:e1001744. doi:10.1371/journal.pmed.1001744.
16. Moons KG, Altman DG, Vergouwe Y, Royston P. Prognosis and prognostic research: application and impact of prognostic models in clinical practice. BMJ 2009;338:b606. doi:10.1136/bmj.b606.
17. Moons KG, Kengne AP, Woodward M, et al. Risk prediction models: I. Development, internal validation, and assessing the incremental value of a new (bio)marker. Heart 2012;98:683-90. doi:10.1136/ heartjnl-2011-301246.
18. Royston P, Moons KG, Altman DG, Vergouwe Y. Prognosis and prognostic research: Developing a prognostic model. BMJ 2009;338:b604. doi:10.1136/bmj.b604.
19. Steyerberg EW, Vergouwe Y. Towards better clinical prediction models: seven steps for development and an ABCD for validation. Eur Heart J 2014;35:1925-31. doi:10.1093/eurheartj/ehu207.
20. Altman DG, Royston P. What do we mean by validating a prognostic model?Stat Med 2000;19:453-73. doi:10.1002/ (SICI)1097-0258(20000229)19:4<453::AID-SIM350>3.0.CO;2-5.
21. Altman DG, Vergouwe Y, Royston P, Moons KG. Prognosis and prognostic research: validating a prognostic model. BMJ 2009;338:b605. doi:10.1136/bmj.b605.
22. Royston P, Altman DG. External validation of a Cox prognostic model: principles and methods. BMC Med Res Methodol 2013;13:33. doi:10.1186/1471-2288-13-33.
23. Moons KG, Royston P, Vergouwe Y, Grobbee DE, Altman DG. Prognosis and prognostic research: what, why, and how?BMJ 2009;338:b375. doi:10.1136/bmj.b375.
24. Harrell FE Jr, , Lee KL, Mark DB. Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med 1996;15:361-87. doi:10.1002/ (SICI)1097-0258(19960229)15:4<361::AID-SIM168>3.0.CO;2-4.
25. Steyerberg EW, Borsboom GJ, van Houwelingen HC, Eijkemans MJ, Habbema JD. Validation and updating of predictive logistic regression models: a study on sample size and shrinkage. Stat Med 2004;23:2567-86. doi:10.1002/sim.1844.
26. Steyerberg EW, Pencina MJ, Lingsma HF, Kattan MW, Vickers AJ, Van Calster B. Assessing the incremental value of diagnostic and prognostic markers: a review and illustration. Eur J Clin Invest 2012;42:216-28. doi:10.1111/j.1365-2362.2011.02562.x.
27. Usher-Smith JA, Silarova B, Schuit E, Moons KG, Griffin SJ. Impact of provision of cardiovascular disease risk estimates to healthcare professionals and patients: a systematic review. BMJ Open 2015;5:e008717. doi:10.1136/bmjopen-2015-008717.
28. van Dieren S, Beulens JW, Kengne AP, et al. Prediction models for the risk of cardiovascular disease in patients with type 2 diabetes: a systematic review. Heart 2012;98:360-9. doi:10.1136/ heartjnl-2011-300734.
29. Bouwmeester W, Zuithoff NP, Mallett S, et al. Reporting and methods in clinical prediction research: a systematic review. PLoS Med 2012;9:1-12. doi:10.1371/journal.pmed.1001221.
30. Collins GS, Reitsma JB, Altman DG, Moons KG. Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis (TRIPOD): the TRIPOD statement. Ann Intern Med 2015;162:55-63. doi:10.7326/M14-0697.
31. Siontis GC, Tzoulaki I, Siontis KC, Ioannidis JP. Comparisons of established risk prediction models for cardiovascular disease: systematic review. BMJ 2012;344:e3318. doi:10.1136/bmj.e3318.
32. Steyerberg EW, Moons KG, van der Windt DA, et al. PROGRESS Group. Prognosis Research Strategy (PROGRESS) 3: prognostic model research. PLoS Med 2013;10:e1001381. doi:10.1371/journal.pmed.1001381.
33. Peduzzi P, Concato J, Feinstein AR, Holford TR. Importance of events per independent variable in proportional hazards regression analysis. II. Accuracy and precision of regression estimates. J Clin Epidemiol 1995;48:1503-10. doi:10.1016/0895-4356(95)00048-8.
34. Peduzzi P, Concato J, Kemper E, Holford TR, Feinstein AR. A simulation study of the number of events per variable in logistic regression analysis. J Clin Epidemiol 1996;49:1373-9. doi:10.1016/ S0895-4356(96)00236-3.
35. Steyerberg EW, Vickers AJ, Cook NR, et al. Assessing the performance of prediction models: a framework for traditional and novel measures. Epidemiology 2010;21:128-38. doi:10.1097/ EDE.0b013e3181c30fb2.
36. D'Agostino RB Sr, , Vasan RS, Pencina MJ, et al. General cardiovascular risk profile for use in primary care: the Framingham Heart Study. Circulation 2008;117:743-53. doi:10.1161/ CIRCULATIONAHA.107.699579.
37. National Cholesterol Education Program (NCEP) Expert Panel on Detection, Evaluation, and Treatment of High Blood Cholesterol in Adults (Adult Treatment Panel III). Third Report of the National Cholesterol Education Program (NCEP) Expert Panel on Detection, Evaluation, and Treatment of High Blood Cholesterol in Adults (Adult Treatment Panel III) final report. Circulation 2002;106:3143-421.http://circ.ahajournals.org/content/106/25/3143.citation.
38. Assmann G, Cullen P, Schulte H. Simple scoring scheme for calculating the risk of acute coronary events based on the 10-year follow-up of the prospective cardiovascular Münster (PROCAM) study. Circulation 2002;105:310-5. doi:10.1161/hc0302.102575.
39. Wolf PA, D'Agostino RB, Belanger AJ, Kannel WB. Probability of stroke: a risk profile from the Framingham Study. Stroke 1991;22:312-8. doi:10.1161/01.STR.22.3.312.
40. Chambless LE, Folsom AR, Sharrett AR, et al. Coronary heart disease risk prediction in the Atherosclerosis Risk in Communities (ARIC) study. J Clin Epidemiol 2003;56:880-90. doi:10.1016/ S0895-4356(03)00055-6.
41. Friedland DR, Cederberg C, Tarima S. Audiometric pattern as a predictor of cardiovascular status: development of a model for assessment of risk. Laryngoscope 2009;119:473-86. doi:10.1002/ lary.20130.
42. Keys A, Aravanis C, Blackburn H, et al. Probability of middle-aged men developing coronary heart disease in five years. Circulation 1972;45:815-28. doi:10.1161/01.CIR.45.4.815.
43. Leaverton PE, Sorlie PD, Kleinman JC, et al. Representativeness of the Framingham risk model for coronary heart disease mortality: a comparison with a national cohort study. J Chronic Dis 1987;40: 775-84. doi:10.1016/0021-9681(87)90129-9.
44. Barzi F, Patel A, Gu D, et al. Asia Pacific Cohort Studies Collaboration. Cardiovascular risk prediction tools for populations in Asia. J Epidemiol Community Health 2007;61:115-21. doi:10.1136/ jech.2005.044842.
45. Woodward M, Brindle P, Tunstall-Pedoe H. SIGN group on risk estimation. Adding social deprivation and family history to cardiovascular risk assessment: the ASSIGN score from the Scottish Heart Health Extended Cohort (SHHEC). Heart 2007;93:172-6. doi:10.1136/hrt.2006.108167.
46. Levy D, Wilson PW, Anderson KM, Castelli WP. Stratifying the patient at risk from coronary disease: new insights from the Framingham Heart Study. Am Heart J 1990;119:712-7, discussion 717. doi:10.1016/ S0002-8703(05)80050-X.
47. Chien KL, Hsu HC, Su TC, et al. Constructing a point-based prediction model for the risk of coronary artery disease in a Chinese community: a report from a cohort study in Taiwan. Int J Cardiol 2012;157:263-8. doi:10.1016/j.ijcard.2012.03.017.
48. Collins GS, Moons KG. Comparing risk prediction models. BMJ 2012;344:e3186. doi:10.1136/bmj.e3186.
49. WHO. 2015. Cardiovascular diseases (CVDs) Fact sheet N° 317. http:// www.who.int/mediacentre/factsheets/fs317/en/. Last access: 09-12-2015
50. Hajifathalian K, Ueda P, Lu Y, et al. A novel risk score to predict cardiovascular disease risk in national populations (Globorisk): a pooled analysis of prospective cohorts and health examination surveys. Lancet Diabetes Endocrinol 2015;3:339-55. doi:10.1016/ S2213-8587(15)00081-9.
51. Liu J, Hong Y, D'Agostino RB Sr, et al. Predictive value for the Chinese population of the Framingham CHD risk assessment tool compared with the Chinese Multi-Provincial Cohort Study. JAMA 2004;291: 2591-9. doi:10.1001/jama.291.21.2591.
52. Wu Y, Liu X, Li X, et al. USA-PRC Collaborative Study of Cardiovascular and Cardiopulmonary Epidemiology Research Group China Multicenter Collaborative Study of Cardiovascular Epidemiology Research Group. Estimation of 10-year risk of fatal and nonfatal ischemic cardiovascular diseases in Chinese adults. Circulation 2006;114:2217-25. doi:10.1161/ CIRCULATIONAHA.105.607499.
53. Gijsberts CM, Groenewegen KA, Hoefer IE, et al. Race/Ethnic Differences in the Associations of the Framingham Risk Factors with Carotid IMT and Cardiovascular Events. PLoS One 2015;10:e0132321. doi:10.1371/journal.pone.0132321.
54. Collins GS, Mallett S, Omar O, Yu LM. Developing risk prediction models for type 2 diabetes: a systematic review of methodology and reporting. BMC Med 2011;9:103. doi:10.1186/1741-7015-9-103.
55. Collins GS, Omar O, Shanyinde M, Yu LM. A systematic review finds prediction models for chronic kidney disease were poorly reported and often developed using inappropriate methods. J Clin Epidemiol 2013;66:268-77. doi:10.1016/j.jclinepi.2012.06.020.
56. Glasziou P, Altman DG, Bossuyt P, et al. Reducing waste from incomplete or unusable reports of biomedical research. Lancet 2014;383:267-76. doi:10.1016/S0140-6736(13)62228-X.
57. Moons KG, Altman DG, Reitsma JB, et al. Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis (TRIPOD): explanation and elaboration. Ann Intern Med 2015;162: W1-73. doi:10.7326/M14-0698.
58. Khan KS, Romero R. Chief Editors of Journals participating in CROWN Initiative. The CROWN initiative: journal editors invite researchers to develop core outcomes in women's health. Am J Obstet Gynecol 2014;211:575-6. doi:10.1016/j.ajog.2014.09.015.
59. Debray TP, Koffijberg H, Nieboer D, Vergouwe Y, Steyerberg EW, Moons KG. Meta-analysis and aggregation of multiple published prediction models. Stat Med 2014;33:2341-62. doi:10.1002/sim.6080.
60. Abbasi A, Peelen LM, Corpeleijn E, et al. Prediction models for risk of developing type 2 diabetes: systematic literature search and independent external validation study. BMJ 2012;345:e5900. doi:10.1136/bmj.e5900.
61. Ettema RG, Peelen LM, Schuurmans MJ, Nierich AP, Kalkman CJ, Moons KG. Prediction models for prolonged intensive care unit stay after cardiac surgery: systematic review and validation study. Circulation 2010;122:682-9, 7, 689. doi:10.1161/CIRCULATIONAHA.109.926808.
62. Debray TP, Vergouwe Y, Koffijberg H, Nieboer D, Steyerberg EW, Moons KG. A new framework to enhance the interpretation of external validation studies of clinical prediction models. J Clin Epidemiol 2015;68:279-89. doi:10.1016/j.jclinepi.2014.06.018.
63. Debray TP, Riley RD, Rovers MM, Reitsma JB, Moons KG. Cochrane IPD Meta-analysis Methods group. Individual participant data (IPD) meta-analyses of diagnostic and prognostic modeling studies: guidance on their use. PLoS Med 2015;12:e1001886. doi:10.1371/ journal.pmed.1001886.
64. Debray TP, Koffijberg H, Vergouwe Y, Moons KG, Steyerberg EW. Aggregating published prediction models with individual participant data: a comparison of different approaches. Stat Med 2012;31:2697-712. doi:10.1002/sim.5412.
65. Debray TP, Moons KG, Ahmed I, Koffijberg H, Riley RD. A framework for developing, implementing, and evaluating clinical prediction models in an individual participant data meta-analysis. Stat Med 2013;32:3158-80. doi:10.1002/sim.5732.
66. Snell KI, Hua H, Debray TP, et al. Multivariate meta-analysis of individual participant data helped externally validate the performance and implementation of a prediction model. J Clin Epidemiol 2016;69:40-50. doi:10.1016/j.jclinepi.2015.05.009.
67. Royston P, Parmar MK, Sylvester R. Construction and validation of a prognostic model across several studies, with an application in superficial bladder cancer. Stat Med 2004;23:907-26. doi:10.1002/ sim.1691.
68. Sauerbrei W, Royston P. A new strategy for meta-analysis of continuous covariates in observational studies. Stat Med 2011;30:3341-60. doi:10.1002/sim.4333.
69. Nicolaie MA, van Houwelingen JC, de Witte TM, Putter H. Dynamic prediction by landmarking in competing risks. Stat Med 2013;32:2031-47. doi:10.1002/sim.5665.
70. Teramukai S, Okuda Y, Miyazaki S, Kawamori R, Shirayama M, Teramoto T. Dynamic prediction model and risk assessment chart for cardiovascular disease based on on-treatment blood pressure and baseline risk factors. Hypertens Res 2016;39:113-8. doi:10.1038/ hr.2015.120.
71. van Klaveren D, Vergouwe Y, Farooq V, Serruys PW, Steyerberg EW. Estimates of absolute treatment benefit for individual patients required careful modeling of statistical interactions. J Clin Epidemiol 2015;68:1366-74. doi:10.1016/j. jclinepi.2015.02.012.
72. Wolfson J, Bandyopadhyay S, Elidrisi M, et al. A Naive Bayes machine learning approach to risk prediction using censored, time-to-event data. Stat Med 2015;34:2941-57. doi:10.1002/ sim.6526.
73. Guo Y, Wei Z, Keating BJ, Hakonarson H. Genetic Consortium for Anorexia Nervosa Wellcome Trust Case Control Consortium 3 Price Foundation Collaborative Group. Machine learning derived risk prediction of anorexia nervosa. BMC Med Genomics 2016;9:4. doi:10.1186/s12920-016-0165-x.
74. Moons KG, Kengne AP, Grobbee DE, et al. Risk prediction models: II. External validation, model updating, and impact assessment. Heart 2012;98:691-8. doi:10.1136/heartjnl-2011-301247.