Impact of allocation concealment on conclusions drawn from meta-analyses of randomized trials

International Journal of Epidemiology

Volumn 36, Issue 4, 2007, Pages 847-857

  Pildal, J ^a   Hrobjartsson A ^a   Jorgensen K J ^a   Hilden, J ^b   Altman, D G ^c   Gotzsche P C ^a  

^a Rigshospitalet   (Denmark)

^b UNIVERSITY OF COPENHAGEN   (Denmark)

^c UNIVERSITY OF OXFORD   (United Kingdom)

Author keywords

Bias (epidemiology); Double blind method; Meta analysis; Methods; Randomized controlled trials

Indexed keywords

CONCEALMENT BEHAVIOR; EPIDEMIOLOGY;

ARTICLE; CLINICAL RESEARCH; COCHRANE LIBRARY; DATA ANALYSIS; MEDICAL LITERATURE; MEDLINE; METHODOLOGY; PRIORITY JOURNAL; RANDOMIZATION; STATISTICAL ANALYSIS; SYSTEMATIC ERROR;

BIAS (EPIDEMIOLOGY); DATA INTERPRETATION, STATISTICAL; DOUBLE-BLIND METHOD; HUMANS; META-ANALYSIS AS TOPIC; RANDOMIZED CONTROLLED TRIALS AS TOPIC; SENSITIVITY AND SPECIFICITY; SINGLE-BLIND METHOD; TREATMENT OUTCOME;

EID: 34548595472     PISSN: 03005771     EISSN: 14643685     Source Type: Journal    
DOI: 10.1093/ije/dym087     Document Type: Article

References (94)

1. Jüni P, Altman DG, Egger M. Systematic reviews in health care: assessing the quality of controlled clinical trials. BMJ 2001; 323:41-46.
2. Devereaux PJ, Manns BJ, Ghali WA et al. Physician interpretations and textbook definitions of blinding terminology in randomized controlled trials. JAMA 2001;285:2000-3.
3. Haahr MT, Hrobjartsson A. Who is blinded in randomized clinical trials? A study of 200 trials and a survey of authors. Clin Trials 2006; 3:360-65.
4. Schulz KF, Chalmers I, Hayes RJ, Altman DG. Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials. JAMA 1995;273:408-12.
5. Moher D, Pham B, Jones A et al. Does quality of reports of randomised trials affect estimates of intervention efficacy reported in meta-analyses? Lancet 1998;352:609-13.
6. Kjaergard LL, Villumsen J, Gluud C. Reported methodologic quality and discrepancies between large and small randomized trials in meta-analyses. Ann Intern Med 2001;135:982-89.
7. Egger M, Juni P, Bartlett C, Holenstein F, Sterne J. How important are comprehensive literature searches and the assessment of trial quality in systematic reviews? Empirical study. Health Technol Assess 2003; 7:1-76.
8. Balk EM, Bonis PA, Moskowitz H et al. Correlation of quality measures with estimates of treatment effect in meta-analyses of randomized controlled trials. JAMA 2002;287:2973-82.
9. Als-Nielsen B, Chen W, Gluud LL, Sierma V, Hilden J, Gluud C. Are trial size and reported methodological quality associated with treatment effects? Program & Abstract Book, 12th Cochrane Colloquium 2004;102-3.
10. Als-Nielsen B, Gluud LL, Gluud C. Methodological quality and treatment effects in randomised trials: A review of six empirical studies. Program & Abstract Book, 12th Cochrane Colloquium 2004;88-89.
11. Deeks JJ, Altman DG, Bradburn MJ. Statistical methods for examining heterogeneity and combining results from several studies in meta-analysis. In: Egger M, Davey Smith G, Altman DG (eds). Systematic Reviews in Health Care: Meta-Analysis in Context. 2nd edn, London: BMJ Publication Group, 2001.
12. Sterne JA, Juni P, Schulz KF, Altman DG, Bartlett C, Egger M. Statistical methods for assessing the influence of study characteristics on treatment effects in 'meta-epidemiological' research. Stat Med 2002;21:1513-24.
13. Higgins JP, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. BMJ 2003;327:557-60.
14. Soares-Weiser K, Brezis M, Tur-Kaspa F. Leibovici L. Antibiotic prophylaxis for cirrhotic patients with gastrointestinal bleeding. The Cochrane Library, Issue 2. Oxford: Update Software, 2003.
15. Guidugli F, Castro AA, Atallah AN. Antibiotics for preventing leptospirosis. The Cochrane Library, Issue 2. Oxford: Update Software, 2003.
16. Liberati A, D'Amico R, Pifferi S et al. Antibiotics for preventing respiratory tract infections in adults receiving intensive care. The Cochrane Library, Issue 2. Oxford: Update Software, 2003.
17. Sheikh A. Hurwitz B, Cave J. Antibiotics versus placebo for acute bacterial conjunctivitis. The Cochrane Library, Issue 2. Oxford: Update Software, 2003.
18. Sandercock P, Mielke O, Liu M, Counsell C. Anticoagulants for preventing recurrence following presumed non-cardioembolic ischaemic stroke or transient ischaemic attack. The Coehrane Library, Issue 2. Oxford: Update Software, 2003.
19. Sacaltchuk J. Hay P, Trefiglio R. Antidepressants versus psychological treatments and their combination for bulimia nervosa. The Cochrane Library, Issue 2. Oxford: Update. Software, 2003.
20. Sandercock P, Gubitz G, Foley P, Counsell C. Antiplatelet therapy for acute ischaemic stroke. The Cochrane Library, Issue 2. Oxford: Update Software, 2003.
21. Brocklehurst p, Volmink J. Antiretrovirals for reducing the risk of mother-to-child transmission of HIV infection. The Cochrane Library, Issue 2. Oxford: Update Software, 2003.
22. Marshall M, Lockwood A. Assertive community treatment for people with severe mental disorders. The Cochrane Library, Issue 2. Oxford: Update Software, 2003.
23. King JF, Flenady VJ, Papatsonis DNM, Dekker GA, Carbonne B. Calcium channel blockers for inhibiting preterm labour. The Cochrane Library, Issue 2. Oxford: Update Software, 2003.
24. Wong R, Malthaner R. Combined chemotherapy and radiotherapy (without surgery) compared with radiotherapy alone in localized carcinoma of the esophagus. The Cochrane Library, Issue 2. Oxford: Update Software, 2003.
25. Filippini G, Brusaferri F, Sibley WA et al. Corticosteroids or ACTH for acute exacerbations in multiple sclerosis. The Cochrane Library, Issue 2. Oxford: Update Software, 2003.
26. Phelps DL, Lakatos L, Watts JL. D-Penicillamine for preventing retinopathy of prematurity in preterm infants. The Cochrane Library, Issue 2. Oxford: Update Software, 2003.
27. Rowe BH, Spooner C, Ducharme FM, Bretzlaff JA, Bota GW. Early emergency department treatment of acute asthma with systemic corticosteroids. The Cochrane Library, Issue 2. Oxford: Update Software, 12003.
28. Amaragiri SV, Lees TA. Elastic compression stockings for prevention of deep vein thrombosis. The Cochrane Library, Issue 2. Oxford: Update Software, 2003.
29. Smith LA, Oldman AD, McQuay HJ, Moore RA. Eletriptan for acute migraine. The Cochrane Library, Issue 2. Oxford: Update Software, 2003.
30. Jolliffe JA, Rees K, Taylor RS, Thompson D, Oldridge N, Ebrahim S. Exercise-based rehabilitation for coronary heart disease. The Cochrane Library, Issue 2. Oxford: Update Software, 2003.
31. Jeffery GM, Hickey BE, Hider P. Follow-up strategies for patients treated for non-metastatic colorectal cancer. The Cochrane Library, Issue 2. Oxford: Update Software, 2003.
32. Farquhar C, Basser R, Hetrick S, Lethaby A, Marjoribanks J. High dose chemotherapy and autologous bone marrow or stem cell transplantation versus conventional chemotherapy for women with metastatic breast cancer. The Cochrane Library, Issue 2. Oxford: Update Software, 2003.
33. Myers RP, Regimbeau C, Thevenot T et al. Interferon for acute hepatitis C. The Cochrane Library, Issue 2. Oxford: Update Software, 2003.
34. Acuin J, Smith A, Mackenzie I. Interventions for chronic suppurative otitis media. The Cochrane Library, Issue 2. Oxford: Update Software, 2003.
35. Chaisewikul R, Privitera MD, Hutton JL, Marson AG. Levetiracetam add-on for drug-resistant localization related (partial) epilepsy. The Cochrane Library, Issue 2. Oxford: Update Software, 2003.
36. Fouque D, Wang P, Laville M, Boissel JP. Low protein diets for chronic renal failure in non diabetic adults. The Cochrane Library, Issue 2 Oxford: Update Software, 2003.
37. Durkan A, Hodson E, Willis N, Craig J. Non-corticosteroid treatment for nephrotic syndrome in children. The Cochrane Library, Issue 2. Oxford: Update Software, 2003.
38. Wilkinson D, Ramjee G, Tholandi M, Rutherford G. Nonoxynol-9 for preventing vaginal acquisition of HIV infection by women from men. The Cochrane Library, Issue 2. Oxford: Update Software, 2003.
39. Whitelaw A. Postnatal phenobarbitone for the prevention of intraventricular hemorrhage in preterm infants. The Cochrane Library, Issue 2. Oxford: Update Software, 2003.
40. Smyth A, Walters S. Prophylactic antibiotics for cystic fibrosis. The Cochrane Library, Issue 2. Oxford: Update Software, 2003.
41. McGuire W, Clerihew I, Austin N. Prophylactic intravenous antifungal agents to prevent mortality and morbidity in very low birth weight infants. The Cochrane Library, Issue 2. Oxford: Update Software, 2003.
42. Askie LM, Henderson-Smart DJ. Restricted versus liberal oxygen exposure for preventing morbidity and mortality in preterm or low birth weight infants. The Cochrane Library, Issue 2. Oxford: Update Software, 2003.
43. Miller RG, Mitchell JD, Lyon M, Moore DH. Riluzole for amyotrophic lateral sclerosis (ALS)/motor neuron disease (MND). The Cochrane Library, Issue 2. Oxford: Update Software, 2003.
44. Oldman AD, Smith LA, McQuay HJ, Moore RA. Rizatriptan for acute migraine. The Cochrane Library, Issue 2. Oxford: Update Software, 2003.
45. Sinclair JC. Servo-control for maintaining abdominal skin temperature at 36C in low birth weight infants. The Cochrane Library, Issue 2. Oxford: Update Software, 2003.
46. Gibson JNA, Grant IC, Waddell G. Surgery for lumbar disc prolapse. The Cochrane Library, Issue 2. Oxford: Update Software, 2003.
47. Jette NJ, Marson AG, Hutton JL. Topiramate add-on for drug-resistant partial epilepsy. The Cochrane Library, Issue 2. Oxford: Update Software, 2003.
48. McGuire W, McEwan P. Transpyloric versus gastric tube feeding for preterm infants. The Cochrane Library, Issue 2. Oxford: Update Software, 2003.
49. Carroli G, Bergel E. Umbilical vein injection for management of retained placenta. The Cochrane Library, Issue 2. Oxford: Update Software, 2003.
50. Soares KVS, McGrath JJ. Vitamin E for neuroleptic-induced tardive dyskinesia. The Cochrane Library, Issue 2. Oxford: Update Software, 2003.
51. Chadwick DW, Marson AG. Zonisamide add-on for drug-resistant partial epilepsy. The Cochrane Library, Issue 2. Oxford: Update Software, 2003.
52. Tournaye H, Verheyen G, Albano C et al. Intracytoplasmic sperm injection versus in vitro fertilization: A randomized controlled trial and a meta-analysis of the literature. Fertil Steril 2002;78 1030-37.
53. van der Vyver M, Halpern S, Joseph G. Patient-controlled epidural analgesia versus continuous infusion for labour analgesia: A meta-analysis. Br J Anaesth 2002;89:459-65.
54. Sylvester RJ, van der Meijden AP, Lamm DL. Intravesical bacillus Calmette-Guerin reduces the risk of progression in patients with superficial bladder cancer: A meta-analysis of the published results of randomized clinical trials. J. Urol 2002;168:1964-70.
55. Weisman SM, Graham DY. Evaluation of the benefits and risks of low-dose aspirin in the secondary prevention of cardiovascular and cerebrovascular events. Arch Intern Med 2002;162:2197-202.
56. Fiddian P, Sabin CA, Griffiths PD. Valacyclovir provides optimum acyclovir exposure for prevention of cytomegalovirus and related outcomes after organ transplantation. J Infect Dis 2002;186 (Suppl 1):S110-15.
57. Eberhart LH, Morin AM, Kranke P, Geldner G, Wulf H. Transient neurologic symptoms after spinal anesthesia. A quantitative systematic overview (meta-analysis) of randomized controlled studies. Anaesthesist 2002;51:539-46.
58. Eccleston C, Morley S, Williams A, Yorke L, Mastroyannopoulou K. Systematic review of randomised controlled trials of psychological therapy for chronic pain in children and adolescents, with a subset meta-analysis of pain relief. Pain 2002;99:157-65.
59. Akai M, Kawashima N, Kimura T, Hayashi K. Electrical stimulation as an adjunct to spinal fusion: A meta-analysis of controlled clinical trials. Bioelectromagnetics 2002;23:496-504.
60. Grant AM. Open mesh versus non-mesh repair of groin hernia: meta-analysis of randomised trials based on individual patient data. Hernia 2002;6:130-36.
61. Roffi M, Chew DP, Mukherjee D et al. Platelet glycoprotein IIb/ IIIa inhibition in acute coronary syndromes. Gradient of benefit related to the revascularization strategy. Eur Heart J 2002;23 1441-48.
62. Papadimitropoulos E, Wells G, Shea B et al. Meta-analyses of therapies for postmenopausal osteoporosis. VIII. Meta-analysis of the efficacy of vitamin D treatment in preventing osteoporosis in postmenopausal women. Endocr Rev 2002;23:560-69.
63. Cranney A, Tugwell P, Zytaruk N et al. Meta-analyis of therapies for postmenopausal osteoporosis. VI. Meta-analysis of calcitonin for the treatment of postmenopausal osteoporosis. Endocr Rev 2002;23 540-51.
64. Cranney A, Tugwell P, Adachi J et al. Meta-analyses of therapies for postmenopausal osteoporosis. III. Meta-analysis of risedronate for the treatment of postmenopausal osteoporosis. Endocr Rev 2002; 23:517-23.
65. Cranney A, Wells G, Willan A et al. Meta-analyses of therapies for postmenopausal osteoporosis. II. Meta-analysis of alendronate for the treatment of postmenopausal women. Endocr Rev 2002;23:508-16.
66. Chang CH, Chen KY, Lai MY, Chan KA. Meta-analysis: Ribavirin-induced haemolytic anaemia in patients with chronic hepatitis C. Aliment Pharmacol Ther 2002;16:1623-32.
67. San Miguel R, Guillen F, Cabases JM, Buti M. Meta-analysis: Combination therapy with interferon-alpha 2a/2b and ribavirin for patients with chronic hepatitis C previously non-responsive to interferon. Aliment Pharmacol Ther 2002;16:1611-21.
68. Barker FG 2nd. Efficacy of prophylactic antibiotic therapy in spinal surgery: A meta-analysis. Neurosurgery 2002;51:391-400; discussion 400-1.
69. Kern JW, Shoemaker WC. Meta-analysis of hemodynamic optomization in high-risk patients. Crit Care Med 2002;30:1686-92.
70. Edmonds ML, Camargo CA Jr, Pollack CV Jr, Rowe BH. The effectiveness of inhaled corticosteroids in the emergency department treatment of acute asthma: A meta-analysis. Ann Emerg Med 2002;40:145-54.
71. Salas M, Ward A, Caro J. Are proton pump inhibitors the first choice for acute treatment of gastric ulcers? A meta analysis of randomized clinical trials. BMC Gastroenterol 2002;2:17-23.
72. Bow EJ, Laverdiere M, Lussier N, Rotstein C, Cheang MS, Ioannou S. Antifungal prophylaxis for severely neutropenic chemotherapy recipients: a meta analysis of randomized-controlled clinical trials. Cancer 2002;94:3230-46.
73. Haugh M, Helou S, Boissel JP, Cribier BJ. Terbinafine in fungal infections of the nails: A meta-analysis of randomized clinical trials. Br J Dermatol 2002;147:118-21.
74. Crystal E, Connolly SJ, Sleik K, Ginger TJ, Yusuf S. Interventions on prevention of postoperative atrial fibrillation in patients undergoing heart surgery: A meta-analysis. Circulation 2002;106:75-80.
75. Camma C, Schepis F, Orlando A et al. Transarterial chemoembolization for unresectable hepatocellular carcinoma: meta-analysis of randomized controlled trials. Radiology 2002; 224:47-54.
76. D'Souza AL, Rajkumar C, Cooke J, Bulpitt CJ. Probiotics in prevention of antibiotic associated diarrhoea: Meta-analysis. BMJ 2002;324 1361-66.
77. Newby LK, Califf RM, White HD et al. The failure of orally administered glycoprotein IIb/IIIa inhibitors to prevent recurrent cardiac events. Am J Med 2002;112:647-58.
78. The Artemether-Quinine Meta-analysis Study Group. A meta-analysis using individual patient data of trials comparing artemether with quinine in the treatment of severe falciparum malaria. Trans R Soc Trop Med Hyg 2001;95:637-50.
79. Singer MA, Nelson RL. Primary repair of penetrating colon injuries: A systematic review. Dis Colon Rectum 2002;45:1579-87.
80. Turpie AG, Bauer KA, Eriksson BI, Lassen MR. Fondaparinux vs enoxaparin for the prevention of venous thromboembolism in major orthopedic surgery: A meta-analysis of 4 randomized double-blind studies. Arch Intern Med 2002;162:1833-40.
81. Berghmans T, Paesmans M, Lafitte JJ, Mascaux C, Meert AP, Sculier JP. Role of granulocyte and granulocyte-macrophage colony-stimulating factors in the treatment of small-cell lung cancer: A systematic review of the literature with methodological assessment and meta-analysis. Lung Cancer 2002;37:115-23.
82. Sewnath ME, Karsten TM, Prins MH, Rauws EJ, Obertop H, Gouma DJ. A meta-analysis on the efficacy of preoperative biliary drainage for tumors causing obstructive jaundice. Ann Surg 2002;236:17-27.
83. Chaiyakunapruk N, Veenstra DL, Lipsky BA, Saint S. Chlorhexidine compared with povidone-iodine solution for vascular catheter-site care: a meta-analysis. Ann Intern Med 2002;136:792-801.
84. Chaiyakunapruk N, Veenstra DL, Lipsky BA, Saint S. Effectiveness of inhaled corticosteroids in the emergency department treatment of acute asthma: A meta-analysis. Ann Emerg Med 2002;40:145-54.
85. Schulz KF, Chalmers I, Altman DG. The landscape and lexicon of blinding in randomized trials. Ann Intern Med 2002;136:254-9.
86. Kjaergard LL, Gluud C. Funding, disease area, and internal validity of hepatobiliary randomized clinical trials. Am J Gastroenterol 2002;97:2708-713.
87. Mulward S, Gøtzsche PC. Sample size of randomized double-blind trials 1976-1991. Dan Med Bull 1996;43:96-8.
88. Chan AW, Hróbjartsson A, Haahr MT, Gøtzsche PC, Altman DG. Empirical evidence for selective reporting of outcomes in randomized trials: Comparison of protocols to published articles. JAMA 2004;291:2457-465.
89. Kyriakidi M, Ioannidis JP. Design and quality considerations for randomized controlled trials in systemic sclerosis. Arthritis Rheum 2002;47:73-81.
90. Matzen P. How evidence-based is medicine? A systematic literature review. Ugeskr Laeger 2003;165:1431-5.
91. Altman DG, Schulz KF, Moher D et al. The revised CONSORT statement for reporting randomized trials: Explanation and elaboration. Ann Intern Med 2001;134:663-694.
92. Moja LP, Telaro E, D'Amico R, Moschetti I, Coe L, Liberati A. Assessment of methodological quality of primary studies by systematic reviews: results of the metaquality cross sectional study. BMJ 2005;330 1053-55.
93. Jüni P, Egger M. Allocation concealment in clinical trials. JAMA 2002;288:2407-8; author reply 2408-9.
94. Pildal J, Chan AW, Hróbjartsson A, Forfang E, Altman DG, Gøtzsche PC. Comparison of descriptions of allocation concealment in trial protocols and the published reports: Cohort study. BMJ 2005;330 1049-53.