Challenges in the design and interpretation of noninferiority trials

New England Journal of Medicine

Volumn 377, Issue 14, 2017, Pages 1357-1367

  Mauri, Laura ^a,b,d   D’Agostino, Ralph B ^c,d  

^a BRIGHAM AND WOMEN S HOSPITAL   (United States)

^b HARVARD MEDICAL SCHOOL   (United States)

^c Boston University   (United States)

^d HARVARD CLINICAL RESEARCH INSTITUTE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

APIXABAN; PLACEBO; RIVAROXABAN; WARFARIN;

AORTIC VALVE PROSTHESIS; CEREBROVASCULAR ACCIDENT; CLINICAL OUTCOME; CLINICAL TRIAL (TOPIC); COMPARATIVE STUDY; CONCEPTUAL FRAMEWORK; CONTROLLED CLINICAL TRIAL (TOPIC); CORONARY ARTERY BYPASS GRAFT; CORONARY ARTERY DISEASE; EMBOLISM; HUMAN; HYPOTHESIS; PATIENT SAFETY; PERCUTANEOUS CORONARY INTERVENTION; PRIORITY JOURNAL; RANDOMIZED CONTROLLED TRIAL (TOPIC); RESEARCH SUBJECT; REVIEW; RISK ASSESSMENT; STATISTICAL ANALYSIS; STUDY DESIGN; THROMBOEMBOLISM; TRANSCATHETER AORTIC VALVE IMPLANTATION; TREATMENT INDICATION; VALIDITY; METHODOLOGY; PROCEDURES; STANDARDS;

DATA INTERPRETATION, STATISTICAL; HUMANS; RANDOMIZED CONTROLLED TRIALS AS TOPIC; RESEARCH DESIGN;

EID: 85030467573     PISSN: 00284793     EISSN: 15334406     Source Type: Journal    
DOI: 10.1056/NEJMra1510063     Document Type: Review

References (41)

1. D’Agostino RB Sr, Massaro JM, Sullivan LM. Non-inferiority trials: design concepts and issues — the encounters of academic consultants in statistics. Stat Med 2003;22:169-86.
2. Blackwelder WC. “Proving the null hypothesis” in clinical trials. Control Clin Trials 1982;3:345-53.
3. Fleming TR, Odem-Davis K, Rothmann MD, Li Shen Y. Some essential considerations in the design and conduct of noninferiority trials. Clin Trials 2011;8:432-9.
4. Center for Drug Evaluation and Research. Points to consider: clinical development and labeling of anti-infective drug products — guidance for industry. Rockville, MD: Food and Drug Administration, 1992.
5. Center for Drug Evaluation and Research, Center for Biologics Evaluation and Research. Non-inferiority clinical trials to establish effectiveness — guidance for industry. Silver Spring, MD: Food and Drug Administration, November 2016.
6. Schulz-Schüpke S, Byrne RA, Ten Berg JM, et al. ISAR-SAFE: a randomized, double-blind, placebo-controlled trial of 6 vs. 12 months of clopidogrel therapy after drug-eluting stenting. Eur Heart J 2015;36: 1252-63.
7. Center for Drug Evaluation and Research. Antibacterial drug products: use of noninferiority trials to support approval — guidance for industry. Silver Spring, MD: Food and Drug Administration, November 2010.
8. May GS, Furberg CD, Eberlein KA, Geraci BJ. Secondary prevention after myocardial infarction: a review of short-term acute phase trials. Prog Cardiovasc Dis 1983;25:335-59.
9. Randomised trial of intravenous streptokinase, oral aspirin, both, or neither among 17,187 cases of suspected acute myocardial infarction: ISIS-2. Lancet 1988; 2:349-60.
10. LeLorier J, Grégoire G, Benhaddad A, Lapierre J, Derderian F. Discrepancies between meta-analyses and subsequent large randomized, controlled trials. N Engl J Med 1997;337:536-42.
11. Granger CB, Alexander JH, McMurray JJV, et al. Apixaban versus warfarin in patients with atrial fibrillation. N Engl J Med 2011;365:981-92.
12. Connolly SJ, Ezekowitz MD, Yusuf S, et al. Dabigatran versus warfarin in patients with atrial fibrillation. N Engl J Med 2009;361:1139-51.
13. Patel MR, Mahaffey KW, Garg J, et al. Rivaroxaban versus warfarin in nonvalvular atrial fibrillation. N Engl J Med 2011; 365:883-91.
14. Hart RG, Pearce LA, Aguilar MI. Meta-analysis: antithrombotic therapy to prevent stroke in patients who have nonvalvular atrial fibrillation. Ann Intern Med 2007;146:857-67.
15. Leon MB, Smith CR, Mack M, et al. Transcatheter aortic-valve implantation for aortic stenosis in patients who cannot undergo surgery. N Engl J Med 2010;363: 1597-607.
16. Popma JJ, Adams DH, Reardon MJ, et al. Transcatheter aortic valve replacement using a self-expanding bioprosthesis in patients with severe aortic stenosis at extreme risk for surgery. J Am Coll Cardiol 2014;63:1972-81.
17. Smith CR, Leon MB, Mack MJ, et al. Transcatheter versus surgical aortic-valve replacement in high-risk patients. N Engl J Med 2011;364:2187-98.
18. Leon MB, Smith CR, Mack MJ, et al. Transcatheter or surgical aortic-valve replacement in intermediate-risk patients. N Engl J Med 2016;374:1609-20.
19. Reardon MJ, Van Mieghem NM, Popma JJ, et al. Surgical or transcatheter aortic-valve replacement in intermediate-risk patients. N Engl J Med 2017;376:1321-31.
20. ClinicalTrials.gov. PARTNER 3: the safety and effectiveness of the SAPIEN 3 transcatheter heart valve in low risk patients with aortic stenosis. 2017 (https:// clinicaltrials.gov/show/NCT02675114).
21. ClinicalTrials.gov. Medtronic transcatheter aortic valve replacement in low risk patients. 2017 (https://clinicaltrials.gov/ct2/show/NCT02701283).
22. Little RJ, D’Agostino R, Cohen ML, et al. The prevention and treatment of missing data in clinical trials. N Engl J Med 2012; 367:1355-60.
23. Freitag G, Lange S, Munk A. Non-parametric assessment of non-inferiority with censored data. Stat Med 2006;25:1201-17.
24. Caracciolo EA, Davis KB, Sopko G, et al. Comparison of surgical and medical group survival in patients with left main equivalent coronary artery disease: long-term CASS experience. Circulation 1995; 91:2335-44.
25. Serruys PW, Morice MC, Kappetein AP, et al. Percutaneous coronary intervention versus coronary-artery bypass grafting for severe coronary artery disease. N Engl J Med 2009;360:961-72.
26. Levine GN, Bates ER, Blankenship JC, et al. 2011 ACCF/AHA/SCAI guideline for percutaneous coronary intervention: a report of the American College of Cardiology Foundation/American Heart Association Task Force on Practice Guidelines and the Society for Cardiovascular Angiography and Interventions. J Am Coll Cardiol 2011;58(24):e44-e122.
27. Windecker S, Kolh P, Alfonso F, et al. 2014 ESC/EACTS guidelines on myocardial revascularization: the Task Force on Myocardial Revascularization of the European Society of Cardiology (ESC) and the European Association for Cardio-Thoracic Surgery (EACTS) developed with the special contribution of the European Association of Percutaneous Cardiovascular Interventions (EAPCI). Eur Heart J 2014;35: 2541-619.
28. Stone GW, Sabik JF, Serruys PW, et al. Everolimus-eluting stents or bypass surgery for left main coronary artery disease. N Engl J Med 2016;375:2223-35.
29. Mäkikallio T, Holm NR, Lindsay M, et al. Percutaneous coronary angioplasty versus coronary artery bypass grafting in treatment of unprotected left main stenosis (NOBLE): a prospective, randomised, open-label, non-inferiority trial. Lancet 2016;388:2743-52.
30. Nissen SE, Yeomans ND, Solomon DH, et al. Cardiovascular safety of celecoxib, naproxen, or ibuprofen for arthritis. N Engl J Med 2016;375:2519-29.
31. Ford I, Norrie J. Pragmatic trials. N Engl J Med 2016;375:454-63.
32. Porter ME. A strategy for health care reform — toward a value-based system. N Engl J Med 2009;361:109-12.
33. Larmore C, Effron MB, Molife C, et al. “Real-world” comparison of prasugrel with ticagrelor in patients with acute coronary syndrome treated with percutaneous coronary intervention in the United States. Catheter Cardiovasc Interv 2016;88:535-44.
34. Kereiakes DJ, Yeh RW, Massaro JM, et al. Stent thrombosis in drug-eluting or bare-metal stents in patients receiving dual antiplatelet therapy. JACC Cardiovasc Interv 2015;8:1552-62.
35. Thourani VH, Kodali S, Makkar RR, et al. Transcatheter aortic valve replacement versus surgical valve replacement in intermediate-risk patients: a propensity score analysis. Lancet 2016;387:2218-25.
36. Barker KB, Menon SM, D’Agostino RB Sr, Xu S, Jin B, eds. Biosimilar clinical development: scientific considerations and new methodologies. Boca Raton, FL: Taylor & Francis Group, 2017.
37. Cohen SB, Genovese MC, Choy EH, et al. Randomized, double-blind, phase 3 study of efficacy and safety of ABP 501 compared with adalimumab in subjects with moderate to severe rheumatoid arthritis. abstract. Arthritis Rheumatol 2015;67: Suppl 10 (http://acrabstracts.org/abstract/ randomized-double-blind-phase-3-study-of-efficacy-and-safety-of-abp-501-compared -with-adalimumab-in-subjects-with -moderate-to-severe-rheumatoid-arthritis/).
38. FDA approves Amjevita, a biosimilar to Humira. News release of the Food and Drug Administration, Silver Spring, MD, September 23, 2016 (https://www.fda.gov/newsevents/newsroom/press announcements/ucm522243.htm).
39. Rehal S, Morris TP, Fielding K, Carpenter JR, Phillips PP. Non-inferiority trials: are they inferior? A systematic review of reporting in major medical journals. BMJ Open 2016;6(10):e012594.
40. Piaggio G, Elbourne DR, Pocock SJ, Evans SJ, Altman DG. Reporting of noninferiority and equivalence randomized trials: extension of the CONSORT 2010 statement. JAMA 2012;308:2594-604.
41. Points to consider on switching between superiority and non-inferiority. London: European Medicines Agency, July 2000.