Bench-to-bedside review: Avoiding pitfalls in critical care meta-analysis - Funnel plots, risk estimates, types of heterogeneity, baseline risk and the ecologic fallacy

Critical Care

Volumn 12, Issue 4, 2008, Pages

  Reade, Michael C ^a,b   Delaney, Anthony ^c   Bailey, Michael J ^d   Angus, Derek C ^a  

^a UNIVERSITY OF PITTSBURGH SCHOOL OF MEDICINE   (United States)

^b UNIVERSITY OF MELBOURNE   (Australia)

^c UNIVERSITY OF SYDNEY   (Australia)

^d MONASH UNIVERSITY   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

ATTRIBUTABLE RISK; BIOINFORMATICS; BRAIN HEMORRHAGE; CLINICAL TRIAL; CRITICALLY ILL PATIENT; CULTURAL FACTOR; HAZARD RATIO; HUMAN; INTENSIVE CARE; META ANALYSIS; OBSERVATIONAL STUDY; PATIENT INFORMATION; PLOTS AND CURVES; PRIORITY JOURNAL; PROBABILITY; PUBLISHING; QUALITY CONTROL; REVIEW; RISK FACTOR; STATISTICAL ANALYSIS; STATISTICAL SIGNIFICANCE; SURVIVAL; SYSTEMATIC REVIEW; TREATMENT PLANNING; VALIDITY; VOLUNTARY REPORTING; HOSPITAL INFORMATION SYSTEM; METHODOLOGY; STANDARD;

CRITICAL CARE; HUMANS; META-ANALYSIS AS TOPIC; POINT-OF-CARE SYSTEMS; RESEARCH DESIGN; RISK FACTORS;

EID: 65349150992     PISSN: 13648535     EISSN: 1466609X     Source Type: Journal    
DOI: 10.1186/cc6941     Document Type: Review

References (40)

1. Komarek A Lesaffre E Legrand C Baseline and treatment effect heterogeneity for survival times between centers using a random effects accelerated failure time model with flexible error distribution Stat Med 2007, 26:5457-5472 10.1002/sim.3083 17910009
2. Rivers E Nguyen B Havstad S Ressler J Muzzin A Knoblich B Peterson E Tomlanovich M Early goal-directed therapy in the treatment of severe sepsis and septic shock N Engl J Med 2001, 345:1368-1377 10.1056/ NEJMoa010307 11794169
3. van den BG Wouters P Weekers F Verwaest C Bruyninckx F Schetz M Vlasselaers D Ferdinande P Lauwers P Bouillon R Intensive insulin therapy in the critically ill patients N Engl J Med 2001, 345:1359-1367 10.1056/NEJMoa011300 11794168
4. Peake S Webb S Delaney A Early goal-directed therapy of septic shock: We honestly remain skeptical Crit Care Med 2007, 35:994-995 10.1097/ 01.CCM.0000257481.37623.3B 17421118
5. Angus DC Abraham E Intensive insulin therapy in critical illness Am J Respir Crit Care Med 2005, 172:1358-1359 10.1164/rccm.2508009 16301298
6. Bunn F Lefebvre C Li L Po ALW Roberts I Schierhout G Human albumin administration in critically ill patients: Systematic review of randomised controlled trials. Cochrane Injuries Group Albumin Reviewers BMJ 1998, 317:235-240 28613 9677209
7. Finfer S Bellomo R Boyce N French J Myburgh J Norton R A comparison of albumin and saline for fluid resuscitation in the intensive care unit N Engl J Med 2004, 350:2247-2256 10.1056/NEJMoa040232 15163774
8. Cook DJ Reeve BK Guyatt GH Heyland DK Griffith LE Buckingham L Tryba M Stress ulcer prophylaxis in critically ill patients. Resolving discordant meta-analyses JAMA 1996, 275:308-314 10.1001/jama.275.4.308 8544272
9. Cook D Guyatt G Marshall J Leasa D Fuller H Hall R Peters S Rutledge F Griffith L McLellan A Wood G Kirby A A comparison of sucralfate and ranitidine for the prevention of upper gastrointestinal bleeding in patients requiring mechanical ventilation. Canadian Critical Care Trials Group N Engl J Med 1998, 338:791-797 10.1056/NEJM199803193381203 9504939
10. Peelen L de Keizer NF Peek N Bosman RJ Scheffer GJ de JE Influence of entry criteria on mortality risk and number of eligible patients in recent studies on severe sepsis Crit Care Med 2005, 33:2178-2183 10.1097/ 01.CCM.0000181733.16353.2C 16215367
11. Easterbrook PJ Berlin JA Gopalan R Matthews DR Publication bias in clinical research Lancet 1991, 337:867-872 10.1016/0140-6736(91)90201-Y 1672966
12. McAuley L Pham B Tugwell P Moher D Does the inclusion of grey literature influence estimates of intervention effectiveness reported in meta-analyses? Lancet 2000, 356:1228-1231 10.1016/S0140-6736(00)02786-0 11072941
13. Egger M Davey SG Schneider M Minder C Bias in meta-analysis detected by a simple, graphical test BMJ 1997, 315:629-634 2127453 9310563
14. Sterne JA Egger M Smith GD Systematic reviews in health care: investigating and dealing with publication and other biases in meta-analysis BMJ 2001, 323:101-105 1120714 11451790 10.1136/ bmj.323.7304.101
15. Alderson P Green S Cochrane Collaboration Open Learning Material for Reviewers Oxford, UK: Cochrane Collaboration 2002 http://www.cochrane-net.org/openlearning/index.htm
16. Delaney A Bagshaw SM Ferland A Manns B Laupland KB Doig CJ A systematic evaluation of the quality of meta-analyses in the critical care literature Crit Care 2005, 9:R575-R582 1297628 16277721 10.1186/cc3803
17. Deeks JJ Issues in the selection of a summary statistic for meta-analysis of clinical trials with binary outcomes Stat Med 2002, 21:1575-1600 10.1002/sim.1188 12111921
18. Egger M Smith GD Phillips AN Meta-analysis: Principles and procedures BMJ 1997, 315:1533-1537 2127925 9432252
19. Simpson EH The interpretation of interaction in contingency tables J R Stat Soc 1951, 13:238-241
20. Hanley JA Theriault G Simpson's paradox in meta-analysis Epidemiology 2000, 11:613-614 10.1097/00001648-200009000-00022 10955419
21. Bernard GR Vincent JL Laterre PF LaRosa SP Dhainaut JF Lopez-Rodriguez A Steingrub JS Garber GE Helterbrand JD Ely EW Efficacy and safety of recombinant human activated protein C for severe sepsis N Engl J Med 2001, 344:699-709 10.1056/NEJM200103083441001 11236773
22. Abraham E Laterre PF Garg R Levy H Talwar D Trzaskoma BL Francois B Guy JS Bruckmann M Rea-Neto A Rossaint R Perrotin D Sablotzki A Arkins N Uttebback BG Macias WL Drotrecogin alfa (activated) for adults with severe sepsis and a low risk of death N Engl J Med 2005, 353:1332-1341 10.1056/NEJMoa050935 16192478
23. Higgins JP Thompson SG Deeks JJ Altman DG Measuring inconsistency in meta-analyses BMJ 2003, 327:557-560 192859 12958120 10.1136/ bmj.327.7414.557
24. Thompson SG Higgins JP How should meta-regression analyses be undertaken and interpreted? Stat Med 2002, 21:1559-1573 10.1002/sim.1187 12111920
25. Schmid CH Stark PC Berlin JA Landais P Lau J Meta-regression detected associations between heterogeneous treatment effects and study-level, but not patient-level, factors J Clin Epidemiol 2004, 57:683-697 10.1016/ j.jclinepi.2003.12.001 15358396
26. Geddes J Meta-analysis in the assessment of treatment outcome J Psychopharmacol 2006, 20:67-71 10.1177/1359786806066056 16785273
27. Cook DI Gebski VJ Keech AC Subgroup analysis in clinical trials Med J Aust 2004, 180:289-291 15012568
28. Robinson WS Ecological correlations and the behavior of individuals Am Sociol Rev 1950, 15:351-357 10.2307/2087176
29. Sharp SJ Thompson SG Altman DG The relation between treatment benefit and underlying risk in meta-analysis BMJ 1996, 313:735-738 2352108 8819447
30. Sharp SJ Thompson SG Analysing the relationship between treatment effect and underlying risk in meta-analysis: Comparison and development of approaches Stat Med 2000, 19:3251-3274 10.1002/ 1097-0258(20001215)19:23<3251::AID-SIM625>3.0.CO;2-2 11113958
31. Stewart LA Clarke MJ Practical methodology of meta-analyses (overviews) using updated individual patient data. Cochrane Working Group Stat Med 1995, 14:2057-2079 10.1002/sim.4780141902 8552887
32. Lambert PC Sutton AJ Abrams KR Jones DR A comparison of summary patient-level covariates in meta-regression with individual patient data meta-analysis J Clin Epidemiol 2002, 55:86-94 10.1016/ S0895-4356(01)00414-0 11781126
33. Chalmers I The Cochrane collaboration: Preparing, maintaining, and disseminating systematic reviews of the effects of health care Ann N Y Acad Sci 1993, 703:156-163 10.1111/j.1749-6632.1993.tb26345.x 8192293
34. Lyman GH Kuderer NM The strengths and limitations of meta-analyses based on aggregate data BMC Med Res Methodol 2005, 5:14 1097735 15850485 10.1186/1471-2288-5-14
35. Simmonds MC Higgins JP Stewart LA Tierney JF Clarke MJ Thompson SG Meta-analysis of individual patient data from randomized trials: A review of methods used in practice Clin Trials 2005, 2:209-217 10.1191/ 1740774505cn087oa 16279144
36. Cochrane Collaboration http://www.cochrane.org
37. Mayer SA Brun NC Begtrup K Broderick J Davis S Diringer MN Skolnick BE Steiner T Efficacy and safety of recombinant activated factor VII for acute intracerebral hemorrhage N Engl J Med 2008, 358:2127-2137 10.1056/ NEJMoa0707534 18480205
38. Moher D Cook DJ Eastwood S Olkin I Rennie D Stroup DF Improving the quality of reports of meta-analyses of randomised controlled trials: The QUOROM statement. Quality of reporting of meta-analyses Lancet 1999, 354:1896-1900 10.1016/S0140-6736(99)04149-5 10584742
39. Education Queensland Exploring Data http://exploringdata.cqu.edu.au/ sim_par.htm
40. Hintze J NCSS, PASS and GESS [computer program] Kaysville, UT: NCSS 2006