Assessing risk prediction models using individual participant data from multiple studies

American Journal of Epidemiology

Volumn 179, Issue 5, 2014, Pages 621-632

  Pennells, Lisa ^a   Kaptoge, Stephen ^a   White, Ian R ^a   Thompson, Simon G ^a   Wood, Angela M ^a   Tipping, Robert W ^b   Folsom, Aaron R ^b   Couper, David J ^b   Ballantyne, Christie M ^b   Coresh, Josef ^b   Goya Wannamethee, S ^b   Morris, Richard W ^b   Kiechl, Stefan ^b   Willeit, Johann ^b   Willeit, Peter ^b   Schett, Georg ^b   Ebrahim, Shah ^b   Lawlor, Debbie A ^b   Yarnell, John W ^b   Gallacher, John ^b   Cushman, Mary ^b   Psaty, Bruce M ^b   Tracy, Russ ^b   Tybjærg Hansen, Anne ^b   Frikke Schmidt, Ruth ^b   Benn, Marianne ^b   Nordestgaard, Børge G ^b   Price, Jackie F ^b   Lee, Amanda J ^b   McLachlan, Stela ^b   Khaw, Kay Tee ^b   Wareham, Nicholas J ^b   Brenner, Hermann ^b   Schöttker, Ben ^b   Müller, Heiko ^b   Rothenbacher, Dietrich ^b   Jansson, Jan Håkan ^b   Wennberg, Patrik ^b   Salomaa, Veikko ^b   Harald, Kennet ^b   Jousilahti, Pekka ^b   Vartiainen, Erkki ^b   Woodward, Mark ^b   D'Agostino, Ralph B ^b   Wolf, Philip A ^b   Vasan, Ramachandran S ^b   Benjamin, Emelia J ^b   Bladbjerg, Else Marie ^b   Jørgensen, Torben ^b   Møller, Lars ^b   Jespersen, Jørgen ^b   Kiyohara, Yutaka ^b   Arima, Hisatomi ^b   Doi, Yasufumi ^b   Ninomiya, Toshiharu ^b   Dekker, Jacqueline M ^b   Nijpels, Giel ^b   Stehouwer, Coen D A ^b   Kauhanen, Jussi ^b   Salonen, Jukka T ^b   Meade, Tom W ^b   Cooper, Jackie A ^b   Shea, Steven ^b   Döring, Angela ^b   Koenig, Wolfgang ^b   Meisinger, Christa ^b   Kuller, Lewis H ^b   Grandits, Greg ^b   Gillum, Richard F ^b   Mussolino, Michael ^b   Rimm, Eric B ^b   Hankinson, Sue E ^b   Manson, JoAnn E ^b   Pai, Jennifer K ^b   Kirkland, Susan ^b   Shaffer, Jonathan A ^b   Shimbo, Daichi ^b   Bakker, Stephan J L ^b   Gansevoort, Ron T ^b   Hillege, Hans L ^b   Amouyel, Philippe ^b   Arveiler, Dominique ^b   Evans, Alun ^b   Ferrières, Jean ^b   Sattar, Naveed ^b   Westendorp, Rudi G ^b   Buckley, Brendan M ^b   Cantin, Bernard ^b   Lamarche, Benoît ^b   Després, Jean Pierre ^b   Dagenais, Gilles R ^b   Barrett Connor, Elizabeth ^b   Wingard, Deborah L ^b   Bettencourt, Richele ^b   Gudnason, Vilmundur ^b   Aspelund, Thor ^b   Sigurdsson, Gunnar ^b   Thorsson, Bolli ^b   Kavousi, Maryam ^b   Witteman, Jacqueline C ^b   Hofman, Albert ^b   Franco, Oscar H ^b   Howard, Barbara V ^b   Zhang, Ying ^b   Best, Lyle ^b   Umans, Jason G ^b   Onat, Altan ^b   Sundström, Johan ^b   Byberg, Liisa ^b   Michaëlsson, Karl ^b   Michael Gaziano, J ^b   Stampfer, Meir ^b   Ridker, Paul M ^b   Marmot, Michael ^b   Clarke, Robert ^b   Collins, Rory ^b   Fletcher, Astrid ^b   Brunner, Eric ^b   Shipley, Martin ^b   Kivimäki, Mika ^b   Buring, Julie ^b   Cook, Nancy ^b   Ford, Ian ^b   Shepherd, James ^b   Cobbe, Stuart M ^b   Robertson, Michele ^b   Alexander, Myriam ^b   Butterworth, Adam S ^b   Angelantonio, Emanuele D ^b   Gao, Pei ^b   Haycock, Philip ^b   Walker, Matthew ^b   Watson, Sarah ^b   Wormser, David ^b   Danesh, John ^b   more..

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

^b NONE

Author keywords

C index; Coronary heart disease; D measure; Individual participant data; Inverse variance; Meta analysis; Risk prediction; Weighting

Indexed keywords

C REACTIVE PROTEIN; CHOLESTEROL; HIGH DENSITY LIPOPROTEIN CHOLESTEROL;

CARDIOVASCULAR DISEASE; DATA SET; EPIDEMIOLOGY; META-ANALYSIS; PREDICTION; PROTEIN; REGRESSION ANALYSIS; RISK ASSESSMENT; RISK FACTOR; VARIANCE ANALYSIS; WEIGHT;

ADULT; ARTICLE; CALCULATION; CARDIOVASCULAR RISK; CASE CONTROL STUDY; CHOLESTEROL BLOOD LEVEL; DIABETES MELLITUS; FEMALE; FOLLOW UP; HEART INFARCTION; HUMAN; ISCHEMIC HEART DISEASE; MAJOR CLINICAL STUDY; MALE; MEDICAL HISTORY; PREDICTION; PROSPECTIVE STUDY; RISK; RISK FACTOR; RISK PREDICTION MODEL; SMOKING; SYSTOLIC BLOOD PRESSURE;

ENGLAND; HERTFORDSHIRE; ROYSTON; UNITED KINGDOM;

C INDEX; CORONARY HEART DISEASE; D MEASURE; INDIVIDUAL PARTICIPANT DATA; INVERSE VARIANCE; META-ANALYSIS; RISK PREDICTION; WEIGHTING;

C-REACTIVE PROTEIN; CORONARY DISEASE; DATA INTERPRETATION, STATISTICAL; FEMALE; HUMANS; MALE; META-ANALYSIS AS TOPIC; MIDDLE AGED; MODELS, STATISTICAL; PROPORTIONAL HAZARDS MODELS; PROSPECTIVE STUDIES; RISK ASSESSMENT; RISK FACTORS;

EID: 84896692640     PISSN: 00029262     EISSN: 14766256     Source Type: Journal    
DOI: 10.1093/aje/kwt298     Document Type: Article

References (43)

1. Justice AC, Covinsky KE, Berlin JA. Assessing the generalizability of prognostic information. Ann Intern Med. 1999;130(6): 515-524.
2. Royston P, Parmar MK, Sylvester R. Construction and validation of a prognostic model across several studies, with an application in superficial bladder cancer. Stat Med. 2004;23(6): 907-926.
3. Thompson S, Kaptoge S, White I, et al. Statistical methods for the time-to-event analysis of individual participant data from multiple epidemiological studies. Int J Epidemiol. 2010;39(5): 1345-1359.
4. The Fibrinogen Studies Collaboration. Measures to assess the prognostic ability of the stratified Cox proportional hazards model. Stat Med. 2009;28(3): 389-411.
5. Asia Pacific Cohort Studies Collaboration. Determinants of cardiovascular disease in the Asia Pacific region: protocol for a collaborative overview of cohort studies. Cardiovasc Dis Prev. 1999;2: 281-289.
6. Beral V, Bull D, Doll R, et al. Breast cancer and abortion: collaborative reanalysis of data from 53 epidemiological studies, including 83 000 women with breast cancer from 16 countries. Lancet. 2004;363(9414): 1007-1016.
7. Bingham S, Riboli E. Diet and cancer-the European Prospective Investigation into Cancer and Nutrition. Nat Rev Cancer. 2004;4(3): 206-215.
8. Thompson D, Easton DF, Breast Cancer Linkage Consortium. Cancer incidence in BRCA1 mutation carriers. J Natl Cancer Inst. 2002;94(18): 1358-1365.
9. Elliott P, Peakman TC. The UK Biobank sample handling and storage protocol for the collection, processing and archiving of human blood and urine. Int J Epidemiol. 2008;37(2): 234-244.
10. Lewington S, Whitlock G, Clarke R, et al. Blood cholesterol and vascular mortality by age, sex, and blood pressure: a meta-analysis of individual data from 61 prospective studies with 55,000 vascular deaths. Lancet. 2007;370(9602): 1829-1839.
11. Smith-Warner SA, Spiegelman D, Ritz J, et al. Methods for pooling results of epidemiologic studies: the Pooling Project of Prospective Studies of Diet and Cancer. Am J Epidemiol. 2006;163(11): 1053-1064.
12. Uitterlinden AG, Ralston SH, Brandi ML, et al. The association between common vitamin D receptor gene variations and osteoporosis: a participant-level meta-analysis. Ann Intern Med. 2006;145(4): 255-264.
13. Matsushita K, Mahmoodi BK,Woodward M, et al. Comparison of risk prediction using the CKD-EPI equation and the MDRD study equation for estimated glomerular filtration rate. JAMA. 2012;307(18): 1941-1951.
14. Danesh J, Erqou S,Walker M, et al. The Emerging Risk Factors Collaboration: analysis of individual data on lipid, inflammatory and other markers in over 1.1 million participants in 104 prospective studies of cardiovascular diseases. Eur J Epidemiol. 2007;22(12): 839-869.
15. Wormser D, Kaptoge S, Di AE, et al. Separate and combined associations of body-mass index and abdominal adiposity with cardiovascular disease: collaborative analysis of 58 prospective studies. The Emerging Risk Factors Collaboration. Lancet. 2011;377(9771): 1085-1095.
16. The Emerging Risk Factors Collaboration. Lipid-related markers and cardiovascular disease prediction. JAMA. 2012;307(23): 2499-2506.
17. Kaptoge S, Di Angelantonio E, Pennells L, et al. C-reactive protein, fibrinogen, and cardiovascular disease prediction. The Emerging Risk Factors Collaboration. N Engl J Med. 2012;367(14): 1310-1320.
18. Cox DR. Regression models and life-tables [with discussion]. J R Stat Soc Ser B. 1972;34(2): 187-220.
19. White IR. Multivariate random-effects meta-analysis. Stata J. 2009;9(1): 40-56.
20. Jackson D, Riley R, White IR. Multivariate metaanalysis: potential and promise. Stat Med. 2011;30(20): 2481-2498.
21. Leandro G. Meta-Analysis in Medical Research: The Handbook for the Understanding and Practice of Meta-Analysis. Oxford, United Kingdom: Blackwell Publishing Ltd; 2005.
22. Harrell FE Jr, Lee KL, Mark DB. Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med. 1996;15(4): 361-387.
23. Harrell FE Jr, Califf RM, Pryor DB, et al. Evaluating the yield of medical tests. JAMA. 1982;247(18): 2543-2546.
24. Royston P, Sauerbrei W. A new measure of prognostic separation in survival data. Stat Med. 2004;23(5): 723-748.
25. Gonen M, Heller G. Concordance probability and discriminatory power in proportional hazards regression. Biometrika. 2005;92(4): 965-970.
26. Uno H, Cai T, Pencina MJ, et al. On the C statistics for evaluating overall adequacy of risk prediction procedures with censored survival data. Stat Med. 2011;30(10): 1105-1117.
27. Newson R. Confidence intervals for rank order statistics and their differences. Stata J. 2006;6(3): 309-334.
28. Higgins JP, Thompson SG. Quantifying heterogeneity in a meta-analysis. Stat Med. 2002;21(11): 1539-1558.
29. Riley RD, Higgins JP, Deeks JJ. Interpretation of random effects meta-analyses. BMJ. 2011;342: d549.
30. Thompson SG, Higgins JP. How should meta-regression analyses be undertaken and interpreted? Stat Med. 2002;21(11): 1559-1573.
31. Korn EL, Graubard BI, Midthune D. Time-to-event analysis of longitudinal follow-up of a survey: choice of the time-scale. Am J Epidemiol. 1997;145(1): 72-80.
32. Pencina MJ, Larson MG, D’Agostino RB. Choice of time scale and its effect on significance of predictors in longitudinal studies. Stat Med. 2007;26(6): 1343-1359.
33. Thiebaut AC, Benichou J. Choice of time-scale in Cox’s model analysis of epidemiologic cohort data: a simulation study. Stat Med. 2004;23(24): 3803-3820.
34. Ganna A, Reilly M, de FU, et al. Risk prediction measures for case-cohort and nested case-control designs: an application to cardiovascular disease. Am J Epidemiol. 2012;175(7): 715-724.
35. Janes H, Pepe MS. Matching in studies of classification accuracy: implications for analysis, efficiency, and assessment of incremental value. Biometrics. 2008;64(1): 1-9.
36. Pencina MJ, D’Agostino RB Sr, D’Agostino RB Jr, et al. Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond. Stat Med. 2008;27(2): 157-172.
37. Pencina MJ, D’Agostino RB Sr, Steyerberg EW. Extensions of net reclassification improvement calculations to measure usefulness of new biomarkers. Stat Med. 2011;30(1): 11-21.
38. Royston P. Explained variation for survival models. Stata J. 2006;6(1): 83-96.
39. Hosmer DW Jr, Lemeshow S. Applied Logistic Regression. New York, NY: John Wiley & Sons, Inc; 1989.
40. Parzen M, Lipsitz SR. A global goodness-of-fit statistic for Cox regression models. Biometrics. 1999;55(2): 580-584.
41. Steyerberg EW. Clinical Prediction Models: A Practical Approach to Development, Validation, and Updating. New York, NY: Springer Science+Business Media, LLC; 2009.
42. Phillips AN, Thompson SG, Pocock SJ. Prognostic scores for detecting a high risk group: estimating the sensitivity when applied to new data. Stat Med. 1990;9(10): 1189-1198.
43. Sterne JA, White IR, Carlin JB, et al. Multiple imputation for missing data in epidemiological and clinical research: potential and pitfalls. BMJ. 2009;338: b2393.