Developing and validating risk prediction models in an individual participant data meta-analysis

BMC Medical Research Methodology

Volumn 14, Issue 1, 2014, Pages

  Ahmed, Ikhlaaq ^a   Debray, Thomas Pa ^b   Moons, Karel Gm ^b   Riley, Richard D ^a  

^a UNIVERSITY OF BIRMINGHAM   (United Kingdom)

^b UNIVERSITY MEDICAL CENTER UTRECHT   (Netherlands)

Author keywords

Individual participant (patient) data; Meta analysis; Prognosis; Prognostic factor; Reporting; Review

Indexed keywords

HUMAN; META ANALYSIS; METHODOLOGY; OUTCOME ASSESSMENT; PROGNOSIS; REVIEW; RISK ASSESSMENT; RISK FACTOR; STATISTICAL ANALYSIS; STATISTICAL MODEL;

DATA INTERPRETATION, STATISTICAL; HUMANS; MODELS, STATISTICAL; OUTCOME ASSESSMENT (HEALTH CARE); PROGNOSIS; RISK ASSESSMENT; RISK FACTORS;

EID: 84892152641     PISSN: None     EISSN: 14712288     Source Type: Journal    
DOI: 10.1186/1471-2288-14-3     Document Type: Article

References (43)

1. Steyerberg EW, Clinical prediction models: a practical approach to development, validation, and updating New York: Springer 2009
2. Prognosis and prognostic research: developing a prognostic model. Royston P, Moons KGM, Altman DG, Vergouwe Y, BMJ 2009 338 b604 1373 1377
3. Prognosis research strategy (PROGRESS) 3: prognostic model research. Steyerberg EW, Moons KG, van der Windt DA, Hayden JA, Perel P, Schroter S, Riley RD, Hemingway H, Altman DG, PLoS Med 2013 10 2 1001381 10.1371/journal.pmed. 1001381 23393430
4. Prognosis research strategy (PROGRESS) 2: prognostic factor research. Riley RD, Hayden JA, Steyerberg EW, Moons KGM, Abrams KR, Kyzas PA, Malats N, Briggs A, Schroter S, Altman DG, et al. PLoS Med 2013 10 2 1001380 10.1371/journal.pmed.1001380 23393429
5. Early prediction of hypocalcemia after thyroidectomy using parathyroid hormone: an analysis of pooled individual patient data from nine observational studies. Noordzij JP, Lee SL, Bernet VJ, Payne RJ, Cohen SM, McLeod IK, Hier MP, Black MJ, Kerr PD, Richards ML, et al. J Am Coll Surg 2007 205 6 748 754 10.1016/j.jamcollsurg.2007.06.298 18035257 (Pubitemid 350116625)
6. Projecting individualized probabilities of developing breast cancer for white females who are being examined annually. Gail MH, Brinton LA, Byar DP, Corle DK, Green SB, Schairer C, Mulvihill JJ, J Natl Cancer Inst 1989 81 24 1879 1886 10.1093/jnci/81.24.1879 2593165 (Pubitemid 20026073)
7. Validation studies on a model for breast cancer risk. Gail MH, Benichou J, J Natl Cancer Inst 1994 86 8 573 575 10.1093/jnci/86.8.573 8179704
8. A prognostic index in primary breast cancer. Haybittle JL, Blamey RW, Elston CW, Johnson J, Doyle PJ, Campbell FC, Nicholson RI, Griffiths K, Br J Cancer 1982 45 3 361 366 10.1038/bjc.1982.62 7073932 (Pubitemid 12122304)
9. Prognosis and prognostic research: application and impact of prognostic models in clinical practice. Moons KG, Altman DG, Vergouwe Y, Royston P, BMJ 2009 338 606 10.1136/bmj.b606 19502216
10. Risk prediction models: II. External validation, model updating, and impact assessment. Moons KG, Kengne AP, Grobbee DE, Royston P, Vergouwe Y, Altman DG, Woodward M, Heart 2012 98 9 691 698 10.1136/heartjnl-2011-301247 22397946
11. Prognosis and prognostic research: validating a prognostic model. Altman DG, Vergouwe Y, Royston P, Moons KGM, BMJ 2009 338 605 10.1136/bmj.b605 19477892
12. Risk prediction models: I. Development, internal validation, and assessing the incremental value of a new (bio)marker. Moons KG, Kengne AP, Woodward M, Royston P, Vergouwe Y, Altman DG, Grobbee DE, Heart 2012 98 9 683 690 10.1136/heartjnl-2011-301246 22397945
13. Harrell FE, Regression modeling strategies, with applications to linear models, logistic regression, and survival analysis New York: Springer 2001
14. External validation is necessary in, prediction research: a clinical example. Bleeker SE, Moll HA, Steyerberg EW, Donders ART, Derksen-Lubsen G, Grobbee DE, Moons KGM, J Clin Epidemiol 2003 56 9 826 832 10.1016/S0895-4356(03) 00207-5 14505766 (Pubitemid 37162656)
15. Assessing the generalizability of prognostic information. Justice AC, Covinsky KE, Berlin JA, Ann Intern Med 1999 130 6 515 524 10.7326/0003-4819-130- 6-199903160-00016 10075620 (Pubitemid 29135805)
16. A framework for developing, implementing, and evaluating clinical prediction models in an individual participant data meta-analysis. Debray TP, Moons KG, Ahmed I, Koffijberg H, Riley RD, Stat Med 2013 32 18 3158 3180 10.1002/sim.5732 23307585
17. Construction and validation of a prognostic model across several studies, with an application in superficial bladder cancer. Royston P, Parmar MKB, Sylvester R, Stat Med 2004 23 907 926 10.1002/sim.1691 15027080 (Pubitemid 38344230)
18. Predicting outcome after traumatic brain injury: development and international validation of prognostic scores based on admission characteristics. Steyerberg EW, Mushkudiani N, Perel P, Butcher I, Lu J, McHugh GS, Murray GD, Marmarou A, Roberts I, Habbema JDF, et al. PLoS Med 2008 5 8 1251 1261
19. Generalisability of The Health Improvement Network (THIN) database: demographics, chronic disease prevalence and mortality rates. Blak BT, Thompson M, Dattani H, Bourke A, Inform Prim Care 2011 19 4 251 255 22828580
20. Derivation and validation of QRISK, a new cardiovascular disease risk score for the United Kingdom: prospective open cohort study. Hippisley-Cox J, Coupland C, Vinogradova Y, Robson J, May M, Brindle P, BMJ 2007 335 7611 136 10.1136/bmj.39261.471806.55 17615182 (Pubitemid 47172233)
21. Meta-analysis of individual participant data: rationale, conduct, and reporting. Riley RD, Lambert PC, Abo-Zaid G, BMJ 2010 340 221 10.1136/bmj.c221 20139215
22. Evidence synthesis combining individual patient data and aggregate data: a systematic review identified current practice and possible methods. Riley RD, Simmonds MC, Look MP, J Clin Epidemiol 2007 60 5 431 439 17419953
23. An evaluation of metabolic risks for coronary death in the Asia Pacific region. Asia Pacific Cohort Studies Collaboration, Diabetes Res Clin Pract 2006 74 3 274 281 16730387
24. Multivariate prognostic factor analysis in locally advanced and metastatic esophago-gastric cancer-pooled analysis from three multicenter, randomized, controlled trials using individual patient data. Chau I, Norman AR, Cunningham D, Waters JS, Oates J, Ross PJ, J Clin Oncol 2004 22 12 2395 2403 10.1200/JCO.2004.08.154 15197201 (Pubitemid 41121931)
25. Ankle brachial index combined with Framingham risk score to predict cardiovascular events and mortality: a meta-analysis. Fowkes G, Fowkes FGR, Murray GD, Butcher I, Heald CL, Lee RJ, Chambless LE, Folsom AR, Hirsch AT, Dramaix M, et al. JAMA 2008 300 2 197 208 18612117 (Pubitemid 351969304)
26. Pleural fluid pH as a predictor of pleurodesis failure: analysis of primary data. Heffner JE, Nietert PJ, Barbieri C, Chest 2000 117 1 87 95 10.1378/chest.117.1.87 10631204 (Pubitemid 30053625)
27. Identification of patients at risk for ischaemic cerebral complications after carotid endarterectomy with TCD monitoring. Horn J, Naylor AR, Laman DM, Chambers BR, Stork JL, Schroeder TV, Nielsen M-Y, Dunne VG, Ackerstaff RGA, Eur J Vasc Endovasc Surg 2005 30 3 270 274 10.1016/j.ejvs.2005.04.033 15963744 (Pubitemid 41086298)
28. Proposal of human spinal cord reirradiation dose based on collection of data from 40 patients. Nieder C, Grosu AL, Andratschke NH, Molls M, Int J Radiat Oncol Biol Phys 2005 61 3 851 855 10.1016/j.ijrobp.2004.06.016 15708265 (Pubitemid 40247981)
29. Interferon-alpha for chronic hepatitis C: an analysis of pretreatment clinical predictors of response. Pagliaro L, Craxi A, Cammaa C, Tine F, Di Marco V, Lo Iacono O, Almasio P, Hepatology 1994 19 4 820 828 8138252 (Pubitemid 24109340)
30. Predicting HIV RNA virologic outcome at 52-weeks follow-up in antiretroviral clinical trials. The INCAS and AVANTI study groups. Raboud JM, Rae S, Montaner JS, JAIDS 2000 24 5 433 439 11035613
31. Predictors of pain and/or fever at 3 to 7 days for children with acute otitis media not treated initially with antibiotics: a meta-analysis of individual patient data. Rovers MM, Glasziou P, Appelman CL, Burke P, McCormick DP, Damoiseaux RA, Little P, Le SN, Hoes AW, Pediatrics 2007 119 3 579 585 10.1542/peds.2006-2092 17332211 (Pubitemid 46407555)
32. Prognosis of acute myeloid leukemia patients up to 60 years of age exhibiting trisomy 8 within a non-complex karyotype: individual patient data-based meta-analysis of the German acute myeloid leukemia intergroup. Schaich M, Schlenk RF, Al-Ali HK, Dohner H, Ganser A, Heil G, Illmer T, Krahl R, Krauter J, Sauerland C, et al. Haematologica 2007 92 6 763 770 10.3324/haematol.11100 17550848 (Pubitemid 350155301)
33. Predicting recurrence and progression in individual patients with stage Ta T1 bladder cancer using EORTC risk tables: a combined analysis of 2596 patients from seven EORTC trials. Sylvester RJ, Van Der Meijden APM, Oosterlinck W, Witjes JA, Bouffioux C, Denis L, Newling DWW, Kurth K, Eur Urol 2006 49 3 466 475 10.1016/j.eururo.2005.12.031 16442208 (Pubitemid 43259554)
34. Pooling of prognostic studies in cancer of the pancreatic head and periampullary region: the Triple-P study. Triple-P study group. Terwee CB, Nieveen Van Dijkum EJ, Gouma DJ, Bakkevold KE, Klinkenbijl JH, Wade TP, van Wagensveld BA, Wong A, van der Meulen JH, Eur J Surg 2000 166 9 706 712 10.1080/110241500750008466 11034467
35. Potential demographic and baselines variables for risk stratification of high-risk post-myocardial infarction patients in the era of implantable cardioverter-defibrillator-a prognostic indicator. Yap YG, Duong T, Bland M, Malik M, Torp-Pedersen C, Kober L, Connolly SJ, Gallagher MM, Camm AJ, Int J Cardiol 2008 126 1 101 107 10.1016/j.ijcard.2007.03.122 17499864 (Pubitemid 351509633)
36. Individual participant data meta-analyses should not ignore clustering. Abo-Zaid G, Guo B, Deeks JJ, Debray TPA, Steyerberg EW, Moons KGM, Riley RD, J Clin Epidemiol 2013 66 8 865 873 10.1016/j.jclinepi.2012.12.017 23651765
37. Individual participant data meta-analysis of prognostic factor studies: state of the art? Abo-Zaid G, Sauerbrei W, Riley RD, BMC Med Res Methodol 2012 12 56 10.1186/1471-2288-12-56 22530717
38. Reporting performance of prognostic models in cancer: a review. Mallett S, Royston P, Waters R, Dutton S, Altman DG, BMC Med 2010 8 21 10.1186/1741-7015-8-21 20353579
39. Reporting and methods in clinical prediction research: a systematic review. Bouwmeester W, Zuithoff NP, Mallett S, Geerlings MI, Vergouwe Y, Steyerberg EW, Altman DG, Moons KG, PLoS Med 2012 9 5 1 12
40. Collins G, BMJ Group Blogs 2011 http://blogs.bmj.com/bmj/2011/08/03/gary- collins-opening-up-multivariable-prediction-models/
41. Flexible parametric proportional-hazards and proportional-odds models for censored survival data, with application to prognostic modelling and estimation of treatment effects. Royston P, Parmar MKB, Stat Med 2002 21 2175 2197 10.1002/sim.1203 12210632 (Pubitemid 34830755)
42. Royston P, Lambert PC, Flexible Parametric Survival Analysis Using Stata: Beyond the Cox Model College Station, TX: CRC Press 2011
43. Assessment of publication bias, selection bias and unavailable data in meta-analyses using individual participant data: a database survey. Ahmed I, Sutton AJ, Riley RD, BMJ 2012 344 7762 10.1136/bmj.d7762 22214758