Optimal information size in trial sequential analysis of time-to-event outcomes reveals potentially inconclusive results because of the risk of random error

Journal of Clinical Epidemiology

Volumn 66, Issue 6, 2013, Pages 654-659

  Miladinovic, Branko ^a   Mhaskar, Rahul ^a   Hozo, Iztok ^b   Kumar, Ambuj ^a   Mahony, Helen ^a   Djulbegovic, Benjamin ^a,c  

^a UNIVERSITY OF SOUTH FLORIDA   (United States)

^b INDIANA UNIVERSITY NORTHWEST   (United States)

^c H LEE MOFFITT CANCER CENTER AND RESEARCH INSTITUTE   (United States)

Author keywords

Bias; Cumulative meta analysis; Optimal information size; Random error; Time to event outcomes; Trial sequential analysis

Indexed keywords

ARTICLE; FALSE NEGATIVE RESULT; FALSE POSITIVE RESULT; HUMAN; INFORMATION; META ANALYSIS (TOPIC); MULTIPLE MYELOMA; OUTCOME ASSESSMENT; OVERALL SURVIVAL; PRIORITY JOURNAL; PROGRESSION FREE SURVIVAL; RANDOM ERROR; RISK ASSESSMENT; RISK FACTOR; SEQUENTIAL ANALYSIS; SYSTEMATIC REVIEW (TOPIC); TIME TO EVENT OUTCOME; TRIAL SEQUENTIAL ANALYSIS;

BIAS (EPIDEMIOLOGY); DATA INTERPRETATION, STATISTICAL; HUMANS; META-ANALYSIS AS TOPIC; MULTIPLE MYELOMA; OUTCOME ASSESSMENT (HEALTH CARE); RANDOMIZED CONTROLLED TRIALS AS TOPIC; SAMPLE SIZE; SURVIVAL ANALYSIS;

EID: 84876897491     PISSN: 08954356     EISSN: 18785921     Source Type: Journal    
DOI: 10.1016/j.jclinepi.2012.11.007     Document Type: Article

References (46)

1. J. Lau, C.H. Schmid, and T.C. Chalmers Cumulative meta-analysis of clinical trials builds evidence for exemplary medical care J Clin Epidemiol 48 1995 45 57 discussion 59-60
2. J. Wetterslev, K. Thorlund, J. Brok, and C. Gluud Trial sequential analysis may establish when firm evidence is reached in cumulative meta-analysis J Clin Epidemiol 61 2008 64 75
3. J. Brok, K. Thorlund, C. Gluud, and J. Wetterslev Trial sequential analysis reveals insufficient information size and potentially false positive results in many meta-analyses J Clin Epidemiol 61 2008 763 769
4. J. Brok, K. Thorlund, J. Wetterslev, and C. Gluud Apparently conclusive meta-analyses may be inconclusive - trial sequential analysis adjustment of random error risk due to repetitive testing of accumulating data in apparently conclusive neonatal meta-analyses Int J Epidemiol 38 2009 287 298
5. K. Thorlund, P.J. Devereaux, J. Wetterslev, G. Guyatt, J.P. Ioannidis, and L. Thabane Can trial sequential monitoring boundaries reduce spurious inferences from meta-analyses? Int J Epidemiol 38 2009 276 286
6. J. Pogue, and S. Yusuf Overcoming the limitations of current meta-analysis of randomised controlled trials Lancet 351 1998 47 52
7. G.H. Guyatt, A.D. Oxman, R. Kunz, J. Brozek, P. Alonso-Coello, and D. Rind GRADE guidelines 6. Rating the quality of evidence - imprecision J Clin Epidemiol 64 2011 1283 1293
8. J. Wetterslev, K. Thorlund, J. Brok, and C. Gluud Estimating required information size by quantifying diversity in random-effects model meta-analyses BMC Med Res Methodol 9 2009 86
9. Thorlund K, Engstrøm J, Wetterslev J, Brok J, Imberger G, Gluud C. User manual for trial sequential analysis (TSA). Copenhagen Trial Unit Centre for Clinical Intervention Research 2012. Available at www.ctu.dk/tsa. Accessed April 10, 2012.
10. Higgins JPT, Green S. Cochrane Collaboration. Cochrane handbook for systematic reviews of interventions. Cochrane book series. 2008, Chichester, England; Hoboken, NJ: Wiley-Blackwell. xxi, p.649.
11. M.K. Parmar, V. Torri, and L. Stewart Extracting summary statistics to perform meta-analyses of the published literature for survival endpoints Stat Med 17 1998 2815 2834
12. P.R. Williamson, C.T. Smith, J.L. Hutton, and A.G. Marson Aggregate data meta-analysis with time-to-event outcomes Stat Med 21 2002 3337 3351
13. J.F. Tierney, L.A. Stewart, D. Ghersi, S. Burdett, and M.R. Sydes Practical methods for incorporating summary time-to-event data into meta-analysis Trials 8 2007 16
14. P. Guyot, A. Ades, M.J. Ouwens, and N.J. Welton Enhanced secondary analysis of survival data: reconstructing the data from published Kaplan-Meier survival curves BMC Med Res Methodol 12 2012 9
15. I. Breitkreutz, H.M. Lokhorst, M.S. Raab, B. Holt, F.W. Cremer, and D. Herrmann Thalidomide in newly diagnosed multiple myeloma: influence of thalidomide treatment on peripheral blood stem cell collection yield Leukemia 21 6 2007 1294 1299
16. A. Kumar, S. Galeb, and B. Djulbegovic Treatment of patients with multiple myeloma: an overview of systematic reviews Acta Haematol 125 1-2 2011 8 22
17. R. Mhaskar, J. Redzepovic, K. Wheatley, O.A. Clark, B. Miladinovic, and A. Glasmacher Bisphosphonates in multiple myeloma: a network meta-analysis Cochrane Database Syst Rev 5 2012 CD003188
18. A. Kumar, T. Loughran, M. Alsina, B.G. Durie, and B. Djulbegovic Management of multiple myeloma: a systematic review and critical appraisal of published studies Lancet Oncol 4 5 2003 293 304
19. J.M. Lachin, and M.A. Foulkes Evaluation of sample size and power for analyses of survival with allowance for nonuniform patient entry, losses to follow-up, noncompliance, and stratification Biometrics 42 3 1986 507 519
20. J.A. Child, G.J. Morgan, F.E. Davies, R.G. Owen, S.E. Bell, and K. Hawkins High-dose chemotherapy with hematopoietic stem-cell rescue for multiple myeloma N Engl J Med 348 2003 1875 1883
21. Wijermans P, Schaafsma M, Termorshuizen F, Ammerlaan R, Wittebol S, Sinnige H, et al. Phase III study of the value of thalidomide added to melphalan plus prednisone in elderly patients with newly diagnosed multiple myeloma: the HOVON 49 Study. J Clin Oncol 28(19):3160-6.
22. Miladinovic B, Hozo I, Djulbegovic B. Trial sequential boundaries for cumulative meta-analyses. Stata J, 2012. (in press).
23. Stata Version 11.2 [computer program] 2010 Stata Corporation College Station, TX
24. D.L. DeMets, and K.K. Lan Interim analysis: the alpha spending function approach Stat Med 13 1994 1341 1352 discussion 1353-6
25. Fayers PM, Palumbo A, Hulin C, Waage A, Wijermans P, Beksac M, et al. Thalidomide for previously untreated elderly patients with multiple myeloma: meta-analysis of 1685 individual patient data from 6 randomized clinical trials. Blood 118:1239-1247.
26. Y. He, K. Wheatley, O. Clark, A. Glasmacher, H. Ross, and B. Djulbegovic Early versus deferred treatment for early stage multiple myeloma Cochrane Database Syst Rev 1 2003 CD004023
27. L.K. Hicks, A.E. Haynes, D.E. Reece, I.R. Walker, J.A. Herst, and R.M. Meyer A meta-analysis and systematic review of thalidomide for patients with previously untreated multiple myeloma Cancer Treat Rev 34 5 2008 442 452
28. Kapoor P, Rajkumar SV, Dispenzieri A, Gertz MA, Lacy MQ, Dingli D, et al. Melphalan and prednisone versus melphalan, prednisone and thalidomide for elderly and/or transplant ineligible patients with multiple myeloma: a meta-analysis. Leukemia 25(4):689-96.
29. J. Koreth, C.S. Cutler, B. Djulbegovic, R. Behl, R.L. Schlossman, and N.C. Munshi High-dose therapy with single autologous transplantation versus chemotherapy for newly diagnosed multiple myeloma: a systematic review and meta-analysis of randomized controlled trials Biol Blood Marrow Transplant 13 2 2007 183 196
30. A. Kumar, M.A. Kharfan-Dabaja, A. Glasmacher, and B. Djulbegovic Tandem versus single autologous hematopoietic cell transplantation for the treatment of multiple myeloma: a systematic review and meta-analysis J Natl Cancer Inst 101 2009 100 106
31. Kumar A, Hozo I, Wheatley K, Djulbegovic B. Thalidomide versus bortezomib based regimens as first-line therapy for patients with multiple myeloma: a systematic review. Am J Hematol 86(1):18-24.
32. Mhaskar R, Redzepovic J, Wheatley K, Clark OA, Miladinovic B, Glasmacher A, et al. Bisphosphonates in multiple myeloma. Cochrane Database Syst Rev 3:CD003188.
33. Myeloma Trialists Collaborative Group Combination chemotherapy versus melphalan plus prednisone as treatment for multiple myeloma: an overview of 6,633 patients from 27 randomized trials. Myeloma Trialists' Collaborative Group J Clin Oncol 16 1998 3832 3842
34. The Myeloma Trialists Collaborative Group Interferon as therapy for multiple myeloma: an individual patient data overview of 24 randomized trials and 4012 patients Br J Haematol 113 4 2001 1020 1034
35. Wang L, Ran X, Wang B, Sheng Z, Liu L. Novel agents-based regimens as induction treatment prior to autologous stem-cell transplantation in newly diagnosed multiple myeloma: a meta-analysis of randomized controlled trials. Hematol Oncol 30(2):57-61.
36. K. Bauer, M. Rancea, B. Schmidtke, S. Kluge, I. Monsef, and K. Hubel Thirteenth biannual report of the Cochrane Haematological Malignancies Group - focus on multiple myeloma J Natl Cancer Inst 103 2011 E1 E19
37. S. Pampallona, A. Tsiatis, and K. Kim Interim monitoring of group sequential trials using spending functions for the type I and type II error probabilities Drug Inf J 35 4 2001 1113 1121
38. K. Thorlund, G. Imberger, M. Walsh, R. Chu, C. Gluud, and J. Wetterslev The number of patients and events required to limit the risk of overestimation of intervention effects in meta-analysis - a simulation study PLoS One 6 10 2011 e25491
39. J.S. de Bono, and A. Ashworth Translating cancer research into targeted therapeutics Nature 467 2010 543 549
40. E.C. Kohn, Y. Lu, H. Wang, Q. Yu, S. Yu, and H. Hall Molecular therapeutics: promise and challenges Semin Oncol 31 1 Suppl 3 2004 39 53
41. M.C. Deley, K.V. Ballman, J. Marandet, and D. Sargent Taking the long view: how to design a series of Phase III trials to maximize cumulative therapeutic benefit Clin Trials 9 2012 283 292
42. S.J. Pocock, and M.D. Hughes Estimation issues in clinical trials and overviews Stat Med 9 1990 657 671
43. J. Grossman, M.K. Parmar, D.J. Spiegelhalter, and L.S. Freedman A unified method for monitoring and analysing controlled trials Stat Med 13 1994 1815 1826
44. B. Miladinovic, I. Hozo, A. Kumar, R. Mhaskar, H. Georgiev, and B. Djulbegovic Confidence interval estimation following trial sequential analysis: a comparison of methods using cancer trials, in 2012 Cochrane Colloquium 2012 Wiley Auckland, New Zealand
45. Higgins J, Comment on 'Trial sequential analysis: methods and software for cumulative meta-analysis' by Wetterslev and colleagues. Cochrane Methods. Cochrane Database Syst Rev. 2012; Suppl 1(Sept 2012):32-33.
46. Wetterslev J, Engstrom J, Gluud C, Thorlund K. Response to comment by Higgins. Cochrane methods. Cochrane Database Syst Rev. 2012; Suppl 1(Sept 2012):33-35.