Assessment of publication bias, selection bias, and unavailable data in meta-analyses using individual participant data: A database survey

BMJ (Online)

Volumn 344, Issue 7838, 2012, Pages

  Ahmed, Ikhlaaq ^a   Sutton, Alexander J ^b   Riley, Richard D ^a  

^a UNIVERSITY OF BIRMINGHAM   (United Kingdom)

^b UNIVERSITY OF LEICESTER   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

ANTINEOPLASTIC AGENT; FIBRINOGEN RECEPTOR; FIBRINOGEN RECEPTOR ANTAGONIST;

ANGIOPLASTY; ARTICLE; CANCER CHEMOTHERAPY; DATA BASE; DRUG MEGADOSE; EPIDEMIOLOGICAL DATA; HEALTH SURVEY; HEART INFARCTION; HUMAN; INFORMATION PROCESSING; MEDICAL INFORMATION; MEDICAL LITERATURE; META ANALYSIS (TOPIC); NONHODGKIN LYMPHOMA; PRIORITY JOURNAL; PUBLICATION; PUBLISHING; RANDOMIZED CONTROLLED TRIAL (TOPIC); ST SEGMENT ELEVATION MYOCARDIAL INFARCTION; SYSTEMATIC REVIEW; BIBLIOGRAPHIC DATABASE; EPIDEMIOLOGY; PEER REVIEW; STATISTICS;

DATABASES, BIBLIOGRAPHIC; META-ANALYSIS AS TOPIC; PEER REVIEW, RESEARCH; PUBLICATION BIAS; RANDOMIZED CONTROLLED TRIALS AS TOPIC; SELECTION BIAS;

EID: 84857135675     PISSN: 09598146     EISSN: 17561833     Source Type: Journal    
DOI: 10.1136/bmj.d7762     Document Type: Article

References (70)

1. Simes RJ. Publication bias: the case for an international registry of clinical trials. J Clin Oncol 1986;4:1529-41. (Pubitemid 17183579)
2. Sterne JA, Egger M, Smith GD. Systematic reviews in health care: investigating and dealing with publication and other biases in meta-analysis. BMJ 2001;323:101-5. (Pubitemid 32681979)
3. Sutton AJ, Duval SJ, Tweedie RL, Abrams KR, Jones DR. Empirical assessment of effect of publication bias on meta-analyses. BMJ 2000;320:1574-7. (Pubitemid 30336090)
4. Rothstein HR, Sutton AJ, Borenstein M (eds) . Publication bias in meta-analysis . Wiley, 2005.
5. Smith R. What is publication? A continuum. BMJ 1999;318:142.
6. Ioannidis JPA. Effect of the statistical significance of results on the time to completion and publication of randomized efficacy trials. JAMA 1998;279:281-6.
7. Clarke M, Stewart LA. Time lag bias in publishing clinical trials [letter]. JAMA 1998;279:1952-3.
8. Egger M, Zellweger-Zahner T, Schneider M, Junker C, Lengeler C, Antes G. Language bias in randomised controlled trials published in English and German. Lancet 1997;350:326-9. (Pubitemid 27351115)
9. Kirkham JJ, Dwan KM, Altman DG, Gamble C, Dodd S, Smyth R, et al. The impact of outcome reporting bias in randomised controlled trials on a cohort of systematic reviews. BMJ 2010;340:c365.
10. Turner EH, Matthews AM, Linardatos E, Tell RA, Rosenthal R. Selective publication of antidepressant trials and its influence on apparent efficacy. N Engl J Med 2008;358:252-60.
11. Song F, Parekh S, Hooper L, Loke YK, Ryder J, Sutton AJ. Dissemination and publication of research findings: an updated review of related biases. Health Technol Assess 2010;14:iii, ix-xi, 1-193.
12. Egger M, Davey Smith G, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. BMJ 1997;315:629-34. (Pubitemid 27387172)
13. Sterne JAC, Sutton AJ, Ioannidis JPA, Terrin N, Jones DR, Lau J, et al. Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials. BMJ 2011;342:d4002.
14. Moreno SG, Sutton AJ, Turner EH, Abrams KR, Cooper NJ, Palmer TM, et al. Novel methods to deal with publication biases: secondary analysis of antidepressant trials in the FDA trial registry database and related journal publications. BMJ 2009;339:b2981.
15. Stewart LA, Tierney JF. To IPD or not to IPD? Advantages and disadvantages of systematic reviews using individual patient data. Eval Health Prof 2002;25:76-97. (Pubitemid 34157785)
16. Riley RD, Lambert PC, Abo-Zaid G. Meta-analysis of individual participant data: conduct, rationale and reporting. BMJ 2010;340:c221.
17. Riley RD. Commentary: Like it and lump it? Meta-analysis using individual participant data. Int J Epidemiol 2010;39:1359-61.
18. Stewart L, Tierney J, Burdett S. Do systematic reviews based on individual patient data offer a means of circumventing biases associated with trial publications? In: Rothstein HR, Sutton AJ, Borenstein M, eds. Publication bias in meta-analysis: prevention, assessment and adjustments . John Wiley, 2006.
19. Broeze KA, Opmeer BC, van der Veen F, Bossuyt PM, Bhattacharya S, Mol BW. Individual patient data meta-analysis: a promising approach for evidence synthesis in reproductive medicine. Hum Reprod Update 2010;16:561-7.
20. Simmonds MC, Higgins JPT, Stewart LA, Tierney JF, Clarke MJ, Thompson SG. Meta-analysis of individual patient data from randomized trials: a review of methods used in practice. Clin Trials 2005;2:209-17. (Pubitemid 40910470)
21. Zheng MH, Shi KQ, Fan YC, Chen YP. Meta-analysis using individual participant data is the gold standard for diagnostic studies. Hepatology 2011;53:1062 [author reply 1062-3].
22. Stewart LA, Parmar MK. Meta-analysis of the literature or of individual patient data: is there a difference? Lancet 1993;341:418-22. (Pubitemid 23048157)
23. Burdett S, Stewart LA, Tierney JF. Publication bias and meta-analyses: a practical example. Int J Technol Assess Health Care 2003;19:129-34. (Pubitemid 36356333)
24. Riley RD, Simmonds MC, Look MP. Evidence synthesis combining individual patient data and aggregate data: a systematic review identified current practice and possible methods. J Clin Epidemiol 2007;60:431-9.
25. Clarke MJ, Stewart LA. Obtaining data from randomised controlled trials: how much do we need for reliable and informative meta-analyses? In: Chalmers I, Altman DG, eds. Systematic reviews . BMJ Publishing, 1995:37-47.
26. Margitic SE, Morgan TM, Sager MA, Furberg CD. Lessons learned from a prospective meta-analysis. J Am Geriatr Soc 1995;43:435-9.
27. Sterne JA, Gavaghan D, Egger M. Publication and related bias in meta-analysis: power of statistical tests and prevalence in the literature. J Clin Epidemiol 2000;53:1119-29.
28. Shepperd S, Doll H, Broad J, Gladman J, Iliffe S, Langhorne P, et al. Early discharge hospital at home. Cochrane Database Syst Rev 2009;(1):CD000356.
29. Rosenfeld E, Beyerlein A, Hadders-Algra M, Kennedy K, Singhal A, Fewtrell M, et al. IPD meta-analysis shows no effect of LC-PUFA supplementation on infant growth at 18 months. Acta Paediatr 2009;98:91-7.
30. Geddes JR, Calabrese JR, Goodwin GM. Lamotrigine for treatment of bipolar depression: independent meta-analysis and meta-regression of individual patient data from five randomised trials. Br J Psychiatry 2009;194:4-9.
31. Cranney A, Wells GA, Yetisir E, Adami S, Cooper C, Delmas PD, et al. Ibandronate for the prevention of nonvertebral fractures: a pooled analysis of individual patient data. Osteoporosis Int 2009;20:291-7.
32. Young J, De Sutter A, Merenstein D, van Essen GA, Kaiser L, Varonen H, et al. Antibiotics for adults with clinically diagnosed acute rhinosinusitis: a meta-analysis of individual patient data. Lancet 2008;371:908-14. (Pubitemid 351375274)
33. Wang D, Connock M, Barton P, Fry-Smith A, Aveyard P, Moore D. 'Cut down to quit' with nicotine replacement therapies in smoking cessation: a systematic review of effectiveness and economic analysis. Health Technol Assess 2008;12:i-156. (Pubitemid 351193698)
34. Vale C, Tierney JF, Stewart LA, Brady M, Dinshaw K, Jakobsen A, et al. Reducing uncertainties about the effects of chemoradiotherapy for cervical cancer: a systematic review and meta-analysis of individual patient data from 18 randomized trials. J Clin Oncol 2008;26:5802-12.
35. Uronis HE, Currow DC, McCrory DC, Samsa GP, Abernethy AP. Oxygen for relief of dyspnoea in mildly- or non-hypoxaemic patients with cancer: a systematic review and meta-analysis. Br J Cancer 2008;98:294-9. (Pubitemid 351161251)
36. Shepperd S, Doll H, Angus RM, Clarke MJ, lliffe S, Kalra L, et al. Admission avoidance hospital at home. Cochrane Database Syst Rev 2008;(4):CD007491.
37. Pollack MH, Endicott J, Liebowitz M, Russell J, Detke M, Spann M, et al. Examining quality of life in patients with generalized anxiety disorder: Clinical relevance and response to duloxetine treatment. J Psychiatr Res 2008;42:1042-9.
38. Pignon JP, Tribodet H, Scagliotti GV, Douillard JY, Shepherd FA, Stephens RJ, et al. Lung adjuvant cisplatin evaluation: a pooled analysis by the LACE collaborative group. J Clin Oncol 2008;26:3552-9.
39. Piccart-Gebhart MJ, Burzykowski T, Buyse M, Sledge G, Carmichael J, Luck HJ, et al. Taxanes alone or in combination with anthracyclines as first-line therapy of patients with metastatic breast cancer. J Clin Oncol 2008;26:1980-6.
40. Pearse RM, Belsey JD, Cole JN, Bennett ED. Effect of dopexamine infusion on mortality following major surgery: Individual patient data meta-regression analysis of published clinical trials. Crit Care Med 2008;36:1323-9. (Pubitemid 351482684)
41. Papakostas GI, Trivedi MH, Alpert JE, Seifert CA, Krishen A, Goodale EP, et al. Efficacy of bupropion and the selective serotonin reuptake inhibitors in the treatment of anxiety symptoms in major depressive disorder: a meta-analysis of individual patient data from 10 double-blind, randomized clinical trials. J Psychiatr Res 2008;42:134-40. (Pubitemid 350061259)
42. Mehta SR, Boden WE, Eikelboom JW, Flather M, Steg PG, Avezum A, et al. Antithrombotic therapy with fondaparinux in relation to interventional management strategy in patients with ST-and non-ST-segment elevation acute coronary syndromes: an individual patient-level combined analysis of the fifth and sixth organization to assess strategies in ischemic syndromes (OASIS 5 and 6) randomized trials. Circulation 2008;118:2038-46.
43. Koopman L, Hoes AW, Glasziou PP, Appelman CL, Burke P, McCormick DP, et al. Antibiotic therapy to prevent the development of asymptomatic middle ear effusion in children with acute otitis media: a meta-analysis of individual patient data. Arch Otolaryngol Head Neck Surg 2008;134:128-32. (Pubitemid 351287490)
44. Harris ST, Blumentals WA, Miller PD. Ibandronate and the risk of non-vertebral and clinical fractures in women with postmenopausal osteoporosis: Results of a meta-analysis of phase III studies. Cur Med Res Opin 2008;24:237-45. (Pubitemid 351160255)
45. Halkes PHA, Gray LJ, Bath PMW, Diener HC, Guiraud-Chaumeil B, Yatsu FM, et al. Dipyridamole plus aspirin versus aspirin alone in secondary prevention after TIA or stroke: a meta-analysis by risk. J Neurol Neurosurg Psychiatry 2008;79:1218-23.
46. Group EBCTC. Adjuvant chemotherapy in oestrogen-receptor-poor breast cancer: patient-level meta-analysis of randomised trials. Lancet 2008;371:29-40.
47. Greb A, Bohlius J, Schiefer D, Schwarzer G, Schulz H, Engert A. High-dose chemotherapy with autologous stem cell transplantation in the first line treatment of aggressive non-Hodgkin lymphoma (NHL) in adults. Cochrane Database System Rev 2008(1):CD004024.
48. Fruh M, Rolland E, Pignon JP, Seymour L, Ding K, Tribodet H, et al. Pooled analysis of the effect of age on adjuvant cisplatin-based chemotherapy for completely resected non-small-cell lung cancer. J Clin Oncol 2008;26:3573-81.
49. Ford AC, Moayyedi P, Jarbol DE, Logan RFA, Delaney BC. Meta-analysis: Helicobacter pylori 'test and treat' compared with empirical acid suppression for managing dyspepsia. Aliment Pharmacol Ther 2008;28:534-44.
50. De Luca G, Gibson CM, Bellandi F, Murphy S, Maioli M, Noc M, et al. Early glycoprotein IIb-IIIa inhibitors in primary angioplasty (EGYPT) cooperation: an individual patient data meta-analysis. Heart 2008;94:1548-58.
51. De Backer TLM, Vander Stichele R, Lehert P, Van Bortel L. Naftidrofuryl for intermittent claudication. Cochrane Database Syst Rev 2008;(2):CD001368.
52. Burdett S, Stephens R, Stewart L, Tierney J, Auperin A, Le CT, et al. Chemotherapy in addition to supportive care improves survival in advanced non-small-cell lung cancer: A systematic review and meta-analysis of individual patient data from 16 randomized controlled trials. J Clin Oncol 2008;26:4617-25.
53. Timmer JR, Ottervanger JP, De Boer MJ, Boersma E, Grines CL, Westerhout CM, et al. Primary percutaneous coronary intervention compared with fibrinolysis for myocardial infarction in diabetes mellitus: results from the primary coronary angioplasty vs thrombolysis-2 trial. Arch Intern Med 2007;167:1353-9. (Pubitemid 47052432)
54. Sakamoto J, Hamada C, Yoshida S, Kodaira S, Yasutomi M, Kato T, et al. An individual patient data meta-analysis of adjuvant therapy with uracil-tegafur (UFT) in patients with curatively resected rectal cancer. Br J Cancer 2007;96:1170-7. (Pubitemid 46625067)
55. Papakostas GI, Montgomery SA, Thase ME, Katz JR, Krishen A, Tucker VL. Comparing the rapidity of response during treatment of major depressive disorder with bupropion and the SSRIs: a pooled survival analysis of 7 double-blind, randomized clinical trials. J Clin Psychiatry 2007;68:1907-12.
56. Lee DP, Herity NA, Hiatt BL, Fearon WF, Rezaee M, Carter AJ, et al. TIrofiban given in the emergency room before primary angioplasty. Adjunctive platelet glycoprotein IIb/IIIa receptor inhibition with tirofiban before primary angioplasty improves angiographic outcomes: results of the TIrofiban Given in the Emergency Room before Primary Angioplasty (TIGER-PA) pilot trial. Circulation 2003;107:1497-501. (Pubitemid 36378487)
57. Prati F, Petronio S, Van Boven AJ, Tendera M, De Luca L, de Belder MA, et al. Evaluation of infarct-related coronary artery patency and microcirculatory function after facilitated percutaneous primary coronary angioplasty: the FINESSE-ANGIO (facilitated intervention with enhanced reperfusion speed to stop events-angiographic) Study. JACC Cardiovasc Interv 2010;3:1284-91.
58. Riley RD, Higgins JP, Deeks JJ. Interpretation of random effects meta-analyses. BMJ 2011;342:d549.
59. Moreno SG, Sutton AJ, Ades AE, Stanley TD, Abrams KR, Peters JL, et al. Assessment of regression-based methods to adjust for publication bias through a comprehensive simulation study. BMC Med Res Methodol 2009;9:2.
60. Trivella M, Pezzella F, Pastorino U, Harris AL, Altman DG. Microvessel density as a prognostic factor in non-small-cell lung carcinoma: a meta-analysis of individual patient data. Lancet Oncol. 2007;8:488-99. (Pubitemid 46805904)
61. Riley RD, Gates SG, Neilson J, Alfirevic Z. Statistical methods used within Cochrane pregnancy and childbirth reviews: a review found improvements are necessary. J Clin Epidemiol 2011;64:608-18.
62. Higgins JPT, Green S, eds. Cochrane handbook for systematic reviews of interventions. John Wiley, 2008.
63. Group EBCTC. Effects of radiotherapy and of differences in the extent of surgery for early breast cancer on local recurrence and 15-year survival: an overview of the randomised trials. Lancet 2005;366:2087-106.
64. Mathew T, Nordstrom K. On the equivalence of meta-analysis using literature and using individual patient data. Biometrics 1999;55:1221-3.
65. Riley RD, Lambert PC, Staessen JA, Wang J, Gueyffier F, Thijs L, et al. Meta-analysis of continuous outcomes combining individual patient data and aggregate data. Stat Med 2008;27:1870-93. (Pubitemid 351634244)
66. Sutton AJ, Kendrick D, Coupland CA. Meta-analysis of individual- and aggregate-level data. Stat Med 2008;27:651-69. (Pubitemid 351278811)
67. McCormack K, Scott N, Grant A. Are trials with individual patient data available different from trials without individual patient data available? 9th Annual Cochrane Colloquium Abstracts, Lyon. 2001.
68. Vickers AJ. Making raw data more widely available. BMJ 2011;342:d2323.
69. Horton R, Smith R. Time to register randomised trials. The case is now unanswerable. BMJ 1999;319:865-6. (Pubitemid 29457408)
70. Schulz KF, Altman DG, Moher D. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. BMJ 2010;340:c332