Trial sequential analysis may be insufficient to draw firm conclusions regarding statistically significant treatment differences using observed intervention effects: A case study of meta-analyses of multiple myeloma trials

Contemporary Clinical Trials

Volumn 34, Issue 2, 2013, Pages 257-261

  Miladinovic, Branko ^a   Kumar, Ambuj ^a   Hozo, Iztok ^b   Mahony, Helen ^a   Djulbegovic, Benjamin ^a,c  

^a UNIVERSITY OF SOUTH FLORIDA   (United States)

^b INDIANA UNIVERSITY NORTHWEST   (United States)

^c H LEE MOFFITT CANCER CENTER AND RESEARCH INSTITUTE   (United States)

Author keywords

Bias; Cumulative meta analysis; Random error; Spending functions; Time to event outcomes; Trial sequential analysis

Indexed keywords

BORTEZOMIB; INTERFERON; MELPHALAN; PREDNISONE; THALIDOMIDE;

ARTICLE; CASE STUDY; CLINICAL TRIAL; ERROR; FALSE POSITIVE RESULT; HUMAN; INTERVENTION STUDY; META ANALYSIS (TOPIC); MULTIPLE MYELOMA; RANDOM ERROR; RANDOMIZED CONTROLLED TRIAL (TOPIC); SEQUENTIAL ANALYSIS;

BIAS (EPIDEMIOLOGY); DATA INTERPRETATION, STATISTICAL; HUMANS; META-ANALYSIS AS TOPIC; MULTIPLE MYELOMA; RANDOMIZED CONTROLLED TRIALS AS TOPIC; RISK; SAMPLE SIZE;

EID: 84872425219     PISSN: 15517144     EISSN: 15592030     Source Type: Journal    
DOI: 10.1016/j.cct.2012.12.006     Document Type: Article

References (46)

1. Lau J., Schmid C.H., Chalmers T.C. Cumulative meta-analysis of clinical trials builds evidence for exemplary medical care. J Clin Epidemiol 1995, 48:45-57. [discussion 9-60].
2. Whitehead A. A prospectively planned cumulative meta-analysis applied to a series of concurrent clinical trials. Stat Med 1997, 16:2901-2913.
3. Pogue J.M., Yusuf S. Cumulating evidence from randomized trials: utilizing sequential monitoring boundaries for cumulative meta-analysis. Control Clin Trials 1997, 18:580-593. [discussion 661-6].
4. Thorlund K., Imberger G., Walsh M., Chu R., Gluud C., Wetterslev J., et al. The number of patients and events required to limit the risk of overestimation of intervention effects in meta-analysis-a simulation study. PLoS One 2011, 6:e25491.
5. Guyatt G.H., Oxman A.D., Kunz R., Brozek J., Alonso-Coello P., Rind D., et al. GRADE guidelines 6. Rating the quality of evidence-imprecision. J Clin Epidemiol 2011, 64:1283-1293.
6. Wetterslev J., Thorlund K., Brok J., Gluud C. Trial sequential analysis may establish when firm evidence is reached in cumulative meta-analysis. J Clin Epidemiol 2008, 61:64-75.
7. DeMets D.L., Lan G. The alpha spending function approach to interim data analyses. Cancer Treat Res 1995, 75:1-27.
8. Brok J., Thorlund K., Gluud C., Wetterslev J. Trial sequential analysis reveals insufficient information size and potentially false positive results in many meta-analyses. J Clin Epidemiol 2008, 61:763-769.
9. Brok J., Thorlund K., Wetterslev J., Gluud C. Apparently conclusive meta-analyses may be inconclusive-trial sequential analysis adjustment of random error risk due to repetitive testing of accumulating data in apparently conclusive neonatal meta-analyses. Int J Epidemiol 2009, 38:287-298.
10. Thorlund K., Devereaux P.J., Wetterslev J., Guyatt G., Ioannidis J.P., Thabane L., et al. Can trial sequential monitoring boundaries reduce spurious inferences from meta-analyses?. Int J Epidemiol 2009, 38:276-286.
11. Nuesch E., Juni P. Commentary: which meta-analyses are conclusive?. Int J Epidemiol 2009, 38:298-303.
12. Afshari A., Wetterslev J., Brok J., Moller A. Antithrombin III in critically ill patients: systematic review with meta-analysis and trial sequential analysis. BMJ 2007, 335:1248-1251.
13. Afshari A., Brok J., Moller A.M., Wetterslev J. Inhaled nitric oxide for acute respiratory distress syndrome and acute lung injury in adults and children: a systematic review with meta-analysis and trial sequential analysis. Anesth Analg 2011, 112:1411-1421.
14. Devereaux P.J., Beattie W.S., Choi P.T., Badner N.H., Guyatt G.H., Villar J.C., et al. How strong is the evidence for the use of perioperative beta blockers in non-cardiac surgery? Systematic review and meta-analysis of randomised controlled trials. BMJ 2005, 331:313-321.
15. Hemmingsen B., Lund S.S., Gluud C., Vaag A., Almdal T., Hemmingsen C., et al. Intensive glycaemic control for patients with type 2 diabetes: systematic review with meta-analysis and trial sequential analysis of randomised clinical trials. BMJ 2011, 343:d6898.
16. Bangalore S., Kumar S., Wetterslev J., Messerli F.H. Angiotensin receptor blockers and risk of myocardial infarction: meta-analyses and trial sequential analyses of 147 020 patients from randomised trials. BMJ 2011, 342:d2234.
17. Bangalore S., Wetterslev J., Pranesh S., Sawhney S., Gluud C., Messerli F.H. Perioperative beta blockers in patients having non-cardiac surgery: a meta-analysis. Lancet 2008, 372:1962-1976.
18. Shadish W.R., Cook T.D., Campbell D.T. Experimental and quasi-experimental designs for generalized causal inference 2001, Houghton Mifflin, Boston.
19. Higgins J.P., Whitehead A., Simmonds M. Sequential methods for random-effects meta-analysis. Stat Med 2011, 30(9):903-921.
20. Inthout J., Ioannidis J.P., Borm G.F. Obtaining evidence by a single well-powered trial or several modestly powered trials. Stat Methods Med Res 2012, [Electronic publication ahead of print, PMID: 23070590].
21. Kumar A., Galeb S., Djulbegovic B. Treatment of patients with multiple myeloma: an overview of systematic reviews. Acta Haematol 2011, 125:8-22.
22. Mhaskar R., Redzepovic J., Wheatley K., Clark O.A., Miladinovic B., Glasmacher A., et al. Bisphosphonates in multiple myeloma: a network meta-analysis. Cochrane Database Syst Rev 2012, 5:CD003188.
23. Kumar A., Loughran T., Alsina M., Durie B.G., Djulbegovic B. Management of multiple myeloma: a systematic review and critical appraisal of published studies. Lancet Oncol 2003, 4:293-304.
24. Lachin J.M. A review of methods for futility stopping based on conditional power. Stat Med 2005, 24:2747-2764.
25. Lachin J.M., Foulkes M.A. Evaluation of sample size and power for analyses of survival with allowance for nonuniform patient entry, losses to follow-up, noncompliance, and stratification. Biometrics 1986, 42:507-519.
26. Wetterslev J., Thorlund K., Brok J., Gluud C. Estimating required information size by quantifying diversity in random-effects model meta-analyses. BMC Med Res Methodol 2009, 9:86.
27. Fedorov V., Jones B. The design of multicentre trials. Stat Methods Med Res 2005, 14:205-248.
28. Miladinovic B, Hozo I, Djulbegovic B. Trial sequential boundaries for cumulative meta-analyses. The Stata Journal. in press.
29. Stata Version 11.2 [computer program] 2010, Stata Corporation, College Station, TX. 11.2 ed.
30. DeMets D.L., Lan K.K. Interim analysis: the alpha spending function approach. Stat Med 1994, 13:1341-1352. [discussion 53-6].
31. Fayers P.M., Palumbo A., Hulin C., Waage A., Wijermans P., Beksac M., et al. Thalidomide for previously untreated elderly patients with multiple myeloma: meta-analysis of 1685 individual patient data from 6 randomized clinical trials. Blood. 2011, 118:1239-1247.
32. He Y., Wheatley K., Clark O., Glasmacher A., Ross H., Djulbegovic B. Early versus deferred treatment for early stage multiple myeloma. Cochrane Database Syst Rev 2003, CD004023.
33. Hicks L.K., Haynes A.E., Reece D.E., Walker I.R., Herst J.A., Meyer R.M., et al. A meta-analysis and systematic review of thalidomide for patients with previously untreated multiple myeloma. Cancer Treat Rev 2008, 34:442-452.
34. Kapoor P., Rajkumar S.V., Dispenzieri A., Gertz M.A., Lacy M.Q., Dingli D., et al. Melphalan and prednisone versus melphalan, prednisone and thalidomide for elderly and/or transplant ineligible patients with multiple myeloma: a meta-analysis. Leukemia. 2011, 25(4):689-696.
35. Koreth J., Cutler C.S., Djulbegovic B., Behl R., Schlossman R.L., Munshi N.C., et al. High-dose therapy with single autologous transplantation versus chemotherapy for newly diagnosed multiple myeloma: a systematic review and meta-analysis of randomized controlled trials. Biol Blood Marrow Transplant 2007, 13:183-196.
36. Kumar A., Kharfan-Dabaja M.A., Glasmacher A., Djulbegovic B. Tandem versus single autologous hematopoietic cell transplantation for the treatment of multiple myeloma: a systematic review and meta-analysis. J Natl Cancer Inst 2009, 101:100-106.
37. The Myeloma Trialists Collaborative Group Interferon as therapy for multiple myeloma: an individual patient data overview of 24 randomized trials and 4012 patients. Br J Haematol 2001, 113:1020-1034.
38. Wang L., Ran X., Wang B., Sheng Z., Liu L. Novel agents-based regimens as induction treatment prior to autologous stem-cell transplantation in newly diagnosed multiple myeloma: a meta-analysis of randomized controlled trials. Hematol Oncol. 2012, 30(2):57-61. http://dx.doi.org/10.1002/hon.1007 [Electronic publication ahead of print 2011 Aug 2].
39. Kumar A., Hozo I., Wheatley K., Djulbegovic B. Thalidomide versus bortezomib based regimens as first-line therapy for patients with multiple myeloma: a systematic review. Am J Hematol. 2011, 86(1):18-24.
40. Facon T., Mary J.Y., Hulin C., Benboubker L., Attal M., Pegourie B., et al. Melphalan and prednisone plus thalidomide versus melphalan and prednisone alone or reduced-intensity autologous stem cell transplantation in elderly patients with multiple myeloma (IFM 99-06): a randomised trial. Lancet 2007, 370:1209-1218.
41. Waage A., Gimsing P., Fayers P., Abildgaard N., Ahlberg L., Bjorkstrand B., et al. Melphalan and prednisone plus thalidomide or placebo in elderly patients with multiple myeloma. Blood 2010, 116:1405-1412.
42. Hulin C., Facon T., Rodon P., Pegourie B., Benboubker L., Doyen C., et al. Efficacy of melphalan and prednisone plus thalidomide in patients older than 75years with newly diagnosed multiple myeloma: IFM 01/01 trial. J Clin Oncol 2009, 27:3664-3670.
43. Palumbo A., Davies F., Kropff M., Blade J., Delforge M., Leal da Costa F., et al. Consensus guidelines for the optimal management of adverse events in newly diagnosed, transplant-ineligible patients receiving melphalan and prednisone in combination with thalidomide (MPT) for the treatment of multiple myeloma. Ann Hematol 2010, 89:803-811.
44. Zonder J.A., Crowley J., Hussein M.A., Bolejack V., Moore D.F., Whittenberger B.F., et al. Lenalidomide and high-dose dexamethasone compared with dexamethasone as initial therapy for multiple myeloma: a randomized Southwest Oncology Group trial (S0232). Blood 2010, 116:5838-5841.
45. Higgins J. Comment on 'Trial sequential analysis: methods and software for cumulative meta-analysis' by Wetterslev and colleagues. Cochrane Methods Cochrane Database Syst Rev 2012, (Suppl. 1):32-33.
46. Egger M., Smith G.D. Misleading meta-analysis. BMJ 1995, 311:753-754.