One-stage individual participant data meta-analysis models: estimation of treatment-covariate interactions must avoid ecological bias by separating out within-trial and across-trial information

Statistics in Medicine

Volumn 36, Issue 5, 2017, Pages 772-789

  Hua, Hairui ^a   Burke, Danielle L ^b   Crowther, Michael J ^c,d   Ensor, Joie ^b   Tudur Smith, Catrin ^e   Riley, Richard D ^b  

^a Boehringer Ingelheim Shanghai Pharmaceuticals Co Ltd   (China)

^b KEELE UNIVERSITY   (United Kingdom)

^c UNIVERSITY OF LEICESTER   (United Kingdom)

^d KAROLINSKA INSTITUTE   (Sweden)

^e UNIVERSITY OF LIVERPOOL   (United Kingdom)

Author keywords

ecological bias; effect modifier; meta analysis; stratified precision medicine; treatment covariate interaction

Indexed keywords

AGE; ARTICLE; ECOLOGICAL FALLACY; EPILEPSY; HUMAN; INDIVIDUAL PARTICIPANT DATA; INTERMETHOD COMPARISON; MATHEMATICAL MODEL; META ANALYSIS (TOPIC); PREDICTION; STATISTICAL PARAMETERS; STATISTICAL SIGNIFICANCE; TREATMENT COVARIATE INTERACTION; EPIDEMIOLOGY; FEMALE; MALE; PROCEDURES; RANDOMIZED CONTROLLED TRIAL (TOPIC); SEX FACTOR; STATISTICAL BIAS; STATISTICAL MODEL; STATISTICS AND NUMERICAL DATA; TREATMENT OUTCOME;

ANTICONVULSIVE AGENT;

AGE FACTORS; ANTICONVULSANTS; BIAS; CONFOUNDING FACTORS (EPIDEMIOLOGY); EPILEPSY; FEMALE; HUMANS; MALE; META-ANALYSIS AS TOPIC; MODELS, STATISTICAL; RANDOMIZED CONTROLLED TRIALS AS TOPIC; SEX FACTORS; TREATMENT OUTCOME;

EID: 85006253383     PISSN: 02776715     EISSN: 10970258     Source Type: Journal    
DOI: 10.1002/sim.7171     Document Type: Article

References (59)

1. Hingorani AD, Windt DA, Riley RD, Abrams K, Moons KG, Steyerberg EW, Schroter S, Sauerbrei W, Altman DG, Hemingway H. Prognosis research strategy (PROGRESS) 4: stratified medicine research. BMJ 2013; 346:e5793.
2. Hudis CA. Trastuzumab--mechanism of action and use in clinical practice. New England Journal of Medicine 2007; 357:39–51.
3. Brookes ST, Whitley E, Peters TJ, Mulheran PA, Egger M, Davey SG. Subgroup analyses in randomised controlled trials: quantifying the risks of false-positives and false-negatives. Health Technology Assessment 2001; 5:1–56.
4. Thompson SG, Higgins JP. Treating individuals 4: can meta-analysis help target interventions at individuals most likely to benefit? Lancet 2005; 365:341–346.
5. Thompson SG, Higgins JPT. How should meta-regression analyses be undertaken and interpreted? Statistics in Medicine 2002; 21:1559–1574.
6. Lambert PC, Sutton AJ, Abrams KR, Jones DR. A comparison of summary patient-level covariates in meta-regression with individual patient data meta-analysis. Journal of Clinical Epidemiology 2002; 55:86–94.
7. Simmonds MC, Higgins JP. Covariate heterogeneity in meta-analysis: criteria for deciding between meta-regression and individual patient data. Statistics in Medicine 2007; 26:2982–2999.
8. Berlin JA, Santanna J, Schmid CH, Szczech LA, Feldman HI, Anti-Lymphocyte Antibody Induction Therapy Study G. Individual patient- versus group-level data meta-regressions for the investigation of treatment effect modifiers: ecological bias rears its ugly head. Statistics in Medicine 2002; 21:371–387.
9. Riley RD, Lambert PC, Staessen JA, Wang J, Gueyffier F, Thijs L, Boutitie F. Meta-analysis of continuous outcomes combining individual patient data and aggregate data. Statistics in Medicine 2008; 27:1870–1893.
10. Simmonds MC, Higgins JPT, Stewart LA, Tierney JF, Clarke MJ, Thompson SG. Meta-analysis of individual patient data from randomized trials: a review of methods used in practice. Clinical Trials 2005; 2:209–217.
11. Riley RD, Lambert PC, Abo-Zaid G. Meta-analysis of individual participant data: rationale, conduct, and reporting. BMJ 2010; 340:c221.
12. Fisher DJ, Copas AJ, Tierney JF, Parmar MK. A critical review of methods for the assessment of patient-level interactions in individual participant data meta-analysis of randomized trials, and guidance for practitioners. Journal of Clinical Epidemiology 2011; 64:949–967.
13. Debray TP, Moons KG, van Valkenhoef G, Efthimiou O, Hummel N, Groenwold RH, Reitsma JB. GetReal Methods Review Group. Get real in individual participant data (IPD) meta-analysis: a review of the methodology. Research Synthesis Methods 2015 6:293–309.
14. Thompson SG, Kaptoge S, White I, Wood A, Perry P, Danesh J. Statistical methods for the time-to-event analysis of individual participant data from multiple epidemiological studies. International Journal of Epidemiology 2010; 39:1345–1359.
15. Stijnen T, Hamza TH, Özdemir P. Random effects meta-analysis of event outcome in the framework of the generalized linear mixed model with applications in sparse data. Statistics in Medicine 2010; 29:3046–3067.
16. Hamza TH, van Houwelingen HC, Stijnen T. The binomial distribution of meta-analysis was preferred to model within-study variability. Journal of Clinical Epidemiology 2008; 61:41–51.
17. Debray TP, Moons KG, Abo-Zaid GM, Koffijberg H, Riley RD. Individual participant data meta-analysis for a binary outcome: one-stage or two-stage? PLoS One 2013; 8 e60650.
18. Mathew T, Nordstrom K. Comparison of one-step and two-step meta-analysis models using individual patient data. Biometrical Journal 2010; 52:271–287.
19. Stewart GB, Altman DG, Askie LM, Duley L, Simmonds MC, Stewart LA. Statistical analysis of individual participant data meta-analyses: a comparison of methods and recommendations for practice. PLoS One 2012; 7 e46042.
20. Riley RD, Steyerberg EW. Meta-analysis of a binary outcome using individual participant data and aggregate data. Research Synthesis Methods 2010; 1:2–9.
21. Higgins JP, Whitehead A, Turner RM, Omar RZ, Thompson SG. Meta-analysis of continuous outcome data from individual patients. Statistics in Medicine 2001; 20:2219–2241.
22. Simmonds MC. Statistical Methodology of Individual Patient Data. Ph.D. Thesis, University of Cambridge 2005.
23. Riley RD, Dodd SR, Craig JV, Thompson JR, Williamson PR. Meta-analysis of diagnostic test studies using individual patient data and aggregate data. Statistics in Medicine 2008; 27:6111–6136.
24. Neuhaus JM, Kalbfleisch JD. Between- and within-cluster covariate effects in the analysis of clustered data. Biometrics 1998; 54:638–645.
25. Mancl LA, Leroux BG, DeRouen TA. Between-subject and within-subject statistical information in dental research. Journal of Dental Research 2000; 79:1778–1781.
26. Begg MD, Parides MK. Separation of individual-level and cluster-level covariate effects in regression analysis of correlated data. Statistics in Medicine 2003; 22:2591–2602.
27. Dwyer T, Blizzard L. A discussion of some statistical methods for separating within-pair associations from associations among all twins in research on fetal origins of disease. Paediatric and Perinatal Epidemiology 2005; 19(Suppl 1):48–53.
28. Sahgal A, Aoyama H, Kocher M, Neupane B, Collette S, Tago M, Shaw P, Beyene J, Chang EL. Phase 3 trials of stereotactic radiosurgery with or without whole-brain radiation therapy for 1 to 4 brain metastases: individual patient data meta-analysis. International Journal of Radiation Oncology, Biology, Physics 2015; 91:710–717.
29. Krumholz HM. Why data sharing should be the expected norm. BMJ 2015; 350:h599.
30. Simmonds M, Stewart G, Stewart L. A decade of individual participant data meta-analyses: A review of current practice. Contemporary Clinical Trials 2015; 45:76–83.
31. van Middelkoop M, Dziedzic KS, Doherty M, Zhang W, Bijlsma JW, McAlindon TE, Lohmander SL, Bierma-Zeinstra SM. Individual patient data meta-analysis of trials investigating the effectiveness of intra-articular glucocorticoid injections in patients with knee or hip osteoarthritis: an OA Trial Bank protocol for a systematic review. Systematic Review 2013; 2:54.
32. Tudur-Smith C, Williamson PR, Marson AG. Investigating heterogeneity in an individual patient data meta-analysis of time to event outcomes. Statistics in Medicine 2005; 24:1307–1319.
33. Simmonds MC, Tierney J, Bowden J, Higgins JP. Meta-analysis of time-to-event data: a comparison of two-stage methods. Research Synthesis Methods 2011; 2:139–149.
34. Barrett JK, Farewell VT, Siannis F, Tierney J, Higgins JP. Two-stage meta-analysis of survival data from individual participants using percentile ratios. Statistics in Medicine 2012; 31:4296–4308.
35. Bowden J, Tierney JF, Simmonds M, Copas AJ, Higgins JP. Individual patient data meta-analysis of time-to-event outcomes: one-stage versus two-stage approaches for estimating the hazard ratio under a random effects model. Research Synthesis Methods 2011; 2:150–162.
36. Katsahian S, Latouche A, Mary JY, Chevret S, Porcher R. Practical methodology of meta-analysis of individual patient data using a survival outcome. Contemporary Clinical Trials 2008; 29:220–230.
37. Crowther MJ, Riley RD, Staessen JA, Wang J, Gueyffier F, Lambert PC. Individual patient data meta-analysis of survival data using Poisson regression models. BMC Medical Research Methodology 2012; 12:34.
38. Simmonds MC, Higgins JP, Stewart LA. Random-effects meta-analysis of time-to-event data using the expectation-maximisation algorithm and shrinkage estimators. Research Synthesis Methods 2013; 4:144–155.
39. Rondeau V, Michiels S, Liquet B, Pignon JP. Investigating trial and treatment heterogeneity in an individual patient data meta-analysis of survival data by means of the penalized maximum likelihood approach. Statistics in Medicine 2008; 27:1894–1910.
40. Crowther MJ, Look MP, Riley RD. Multilevel mixed effects parametric survival models using adaptive Gauss-Hermite quadrature with application to recurrent events and individual participant data meta-analysis. Statistics in Medicine 2014; 33:3844–3858.
41. Sargent DJ. A general framework for random effects survival analysis in the Cox proportional hazards setting. Biometrics 1998; 54:1486–1497.
42. Abo-Zaid G, Guo B, Deeks JJ, Debray TPA, Steyerberg EW, Moons KGM, Riley RD. Individual participant data meta-analyses should not ignore clustering. Journal of Clinical Epidemiology 2013; 66:865–873.
43. Hemingway H, Croft P, Perel P, Hayden JA, Abrams K, Timmis A, Briggs A, Udumyan R, Moons KG, Steyerberg EW, Roberts I, Schroter S, Altman DG, Riley RD. Prognosis research strategy (PROGRESS) 1: a framework for researching clinical outcomes. BMJ 2013; 346 e5595.
44. Fox J, Weisberg S. Cox proportional-hazards regression for survival data in R. 2011.
45. Cleves M, Gould WW, Gutierrez RG, Marchenko Y. An Introduction to Survival Analysis Using Stata (2nd edn). Stata Press: College Station, Texas, 2008.
46. Ripatti S, Palmgren J. Estimation of multivariate frailty models using penalized partial likelihood. Biometrics 2000; 56:1016–1022.
47. Crowther MJ, Lambert PC. Simulating biologically plausible complex survival data. Statistics in Medicine 2013; 32:4118–4134.
48. Burton A, Altman DG, Royston P, Holder RL. The design of simulation studies in medical statistics. Statistics in Medicine 2006; 25:4279–4292.
49. Thurman DJ, Beghi E, Begley CE, Berg AT, Buchhalter JR, Ding D, Hesdorffer DC, Hauser WA, Kazis L, Kobau R, Kroner B, Labiner D, Liow K, Logroscino G, Medina MT, Newton CR, Parko K, Paschal A, Preux PM, Sander JW, Selassie A, Theodore W, Tomson T, Wiebe S. Epidemiology ICo. Standards for epidemiologic studies and surveillance of epilepsy. Epilepsia 2011; 52(Suppl 7):2–26.
50. Tudur Smith C, Williamson PR, Marson AG. Investigating heterogeneity in an individual patient data meta-analysis of time to event outcomes. Statistics in Medicine 2005; 24:1307–1319.
51. Williamson PR, Clough HE, Hutton JL, Marson AG, Chadwick DW. Statistical issues in the assessment of the evidence for an interaction between factors in epilepsy trials. Statistics in Medicine 2002; 21:2613–2622.
52. Marson AG, Williamson PR, Hutton JL, Clough HE, Chadwick DW. Carbamazepine versus valproate monotherapy for epilepsy. Cochrane Database of Systematic Reviews 2000, Issue 3. Art. No.: CD001030.
53. Ciardiello F, Arnold D, Casali PG, Cervantes A, Douillard JY, Eggermont A, Eniu A, McGregor K, Peters S, Piccart M, Popescu R, Van Cutsem E, Zielinski C, Stahel R. Delivering precision medicine in oncology today and in future-the promise and challenges of personalised cancer medicine: a position paper by the European Society for Medical Oncology (ESMO). Annals of Oncology 2014; 25:1673–1678.
54. Greenland S, Morgenstern H. Ecological bias, confounding, and effect modification. International Journal of Epidemiology 1989; 18:269–274.
55. Lau J, Ioannidis JP, Schmid CH. Summing up evidence: one answer is not always enough. Lancet 1998; 351:123–127.
56. Sutton AJ, Kendrick D, Coupland CA. Meta-analysis of individual- and aggregate-level data. Statistics in Medicine 2008; 27:651–669.
57. Jackson C, Best N, Richardson S. Improving ecological inference using individual-level data. Statistics in Medicine 2006; 25:2136–2159.
58. Sun X, Briel M, Walter SD, Guyatt GH. Is a subgroup effect believable? Updating criteria to evaluate the credibility of subgroup analyses. BMJ 2010; 340:c117.
59. Riley RD, Price MJ, Jackson D, Wardle M, Gueyffier F, Wang J, Staessen JA, White IR. Multivariate meta-analysis using individual participant data. Research Synthesis. Method 2015; 6:157–174.