Graphical displays for meta-analysis: An overview with suggestions for practice

Research Synthesis Methods

Volumn 1, Issue 1, 2010, Pages 66-80

  Anzures Cabrera, Judith ^a   Higgins, Julian P T ^b  

^a ROCHE PRODUCTS LTD   (United Kingdom)

^b MEDICAL RESEARCH COUNCIL   (United Kingdom)

Author keywords

Forest plot; Funnel plot; Galbraith plot; Graphical displays; L'Abbe plot; Meta analysis

Indexed keywords

EID: 79957558500     PISSN: 17592879     EISSN: 17592887     Source Type: Journal    
DOI: 10.1002/jrsm.6     Document Type: Article

References (77)

1. Barnard FR. One Picture is Worth Ten Thousand Words. Printers' Ink: New York, 1927; 114-115.
2. Borenstein M, Hedges LV, Higgins JPT, Rothstein H. Introduction to Meta-analysis. Wiley: Chichester, 2009.
3. Light RJ, Singer JD, Willett JB. The visual presentation and interpretation of meta-analyses. In The Handbook of Research Synthesis, Cooper H, Hedges LV (eds), Chapter 28. Russell Sage Foundation: New York, 1994; 439-445.
4. Ferrer RL. Graphical methods for detecting bias in meta-analysis. Family Medicine 1998; 30:579-583.
5. DuMouchel W, Normand SL. Computer-modeling and graphical strategies for meta-analysis. Meta-analysis in Medicine and Health Policy, Stangl DK, Berry DA (eds). Marcel Dekker: New York, 2000; 127-178.
6. Bax L, Ikeda N, Fukui N, Yaju Y, Tsuruta H, Moons KG. More than numbers: the power of graphs in meta-analysis. American Journal of Epidemiology 2009; 169:249-255.
7. Borman GD, Grigg JA. Visual and narrative interpretation. In The Handbook of Research Synthesis and Meta-analysis (2nd edn), Cooper H, Hedges LV, Valentine JC (eds), Chapter 26. Russell Sage Foundation: New York, 2009; 497-519.
8. Higgins J.Cochrane Statistical Methods Group. Considerations and recommendations for figures in Cochrane reviews: graphs of statistical data, 2003. Available from: http://www.cochrane.org/resources/handbook/ (accessed 1 January 2010).
9. DerSimonian R, Kacker R. Random-effects model for meta-analysis of clinical trials: an update. Contemporary Clinical Trials 2007; 28:105-114.
10. Lewis S, Clarke M. Forest plots: trying to see the wood and the trees. British Medical Journal 2001; 322:1479-1480.
11. Egger M, Davey Smith G, Phillips AN. Meta-analysis: principles and procedures. British Medical Journal 1997; 315:1533-1537.
12. Moja L, Moschetti I, Liberati A. Understanding systematic reviews: the meta-analysis graph (also called 'forest plot'). Internal and Emergency Medicine 2007; 2:140-142.
13. Ried K. Interpreting and understanding meta-analysis graphs. A practical guide. Australian Family Physician 2006; 35:635-638.
14. Schriger DL, Altman DG, Vetter JA, Heafner T, Moher D. Forest plots in reports of systematic reviews: a cross-sectional study reviewing current practice. International Journal of Epidemiology 2010; DOI: 10.1093/ije/dyp370.
15. Galbraith RF. A note on graphical presentation of estimated odds ratios from several clinical trials. Statistics in Medicine 1988; 7:889-894.
16. Sanders S, Glasziou PP, Del Mar CB, Rovers M. Antibiotics for acute otitis media in children. Cochrane Database of Systematic Reviews 2004; (1):CD000219.
17. DuMouchel W. Predictive cross-validation of Bayesian meta-analyses. Bayesian Statistics 5, Bernardo JM, Berger JO, Dawid AP, Smith AFM (eds). Oxford University Press: Oxford, 1996; 107-127.
18. Elvik R. Evaluating the statistical conclusion validity of weighted mean results in meta-analysis by analysing funnel graph diagrams. Accident Analysis and Prevention 1998; 30:255-266.
19. Ye Z, Liu EHC, Higgins JPT, Keavney Bd, Lowe GDO, Collins R, Danesh J. Seven haemostatic gene polymorphisms in coronary disease: meta-analysis of 66 155 cases and 91 307 controls. The Lancet 2006; 367:651-658.
20. Sutton AJ, Abrams KR. Bayesian methods in meta-analysis and evidence synthesis. Statistical Methods in Medical Research 2001; 10:277-303.
21. Van Houwelingen HC, Arends LR, Stijnen T. Advanced methods in meta-analysis: multivariate approach and meta-regression. Statistics in Medicine 2002; 21:589-624.
22. Smith TC, Spiegelhalter DJ, Thomas A. Bayesian approaches to random-effects meta-analysis: a comparative study. Statistics in Medicine 1995; 14:2685-2699.
23. Higgins JPT, Thompson SG, Spiegelhalter DJ. A re-evaluation of random-effects meta-analysis. Journal of the Royal Statistical Society Series A 2009; 172:137-159.
24. Lau J, Antman EM, Jimenez-Silva J, Kupelink B, Mosteller SF, Chalmers TC. Cumulative meta-analysis of therapeutic trials for myocardial infarction. New England Journal of Medicine 1992; 327:248-254.
25. Antman EM, Lau J, Kupelnick B, Mosteller F, Chalmers TC. A comparison of results of meta-analyses of randomized control trials and recommendations of clinical experts: treatments for myocardial infarction. Journal of the American Medical Association 1992; 268:240-248.
26. Lau J, Schmid CH, Chalmers TC. Cumulative meta-analysis of clinical trials: builds evidence for exemplary medical care. Journal of Clinical Epidemiology 1995; 48:45-57.
27. Pogue J, Yusuf S. Overcoming the limitations of current meta-anlysis of randomised controlled trials. The Lancet 1998; 351:47-52.
28. Ioannidis JPA, Contopoulos-Ioannidis DG, Lau J. Recursive cumulative meta-analysis: a diagnostic for the evolution of total randomized evidence from group and individual patient data. Journal of Clinical Epidemiology 1999; 52:281-291.
29. Bax L, Yu LM, Ikeda N, Tsuruta H, Moons KG. Development and validation of MIX: comprehensive free software for meta-analysis of causal research data. BMC Medical Research Methodology 2006; 6:50.
30. Barrowman NJ, Myers RA. Raindrop plots: a new way to display collections of likelihoods and distributions. American Statistician 2003; 57:268-274.
31. Light RJ, Pillemer DB. Summing Up: The Science of Reviewing Research. Harvard University Press: Cambridge, MA, 1984.
32. Sterne JAC, Egger M, Davey Smith G. Investigating and dealing with publication bias and other biases. Systematic Reviews in Health Care: Meta-analysis in Context, Egger M, Davey Smith G, Altman DG (eds). BMJ Publication Group: London, 2001; 189-208.
33. Egger M, Davey Smith G, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. British Medical Journal 1997; 315:629-634.
34. Renehan AG, Tyson M, Egger M, Heller RF, Zwahlen M. Body-mass index and incidence of cancer: a systematic review and meta-analysis of prospective observational studies. The Lancet 2008; 371:569-578.
35. Lau J, Ioannidis JPA, Terrin N, Schmid CH, Olkin I. The case of the misleading funnel plot. British Medical Journal 2006; 333:597-600.
36. Tang JL, Liu JL. Misleading funnel plot for detection of bias in meta-analysis. Journal of Clinical Epidemiology 2000; 53:477-484.
37. Munafo MR, Clark TG, Flint J. Assessing publication bias in genetic association studies: evidence from a recent meta-analysis. Psychiatry Research 2004; 129:39-44.
38. Sterne JAC, Egger M. Funnel plots for detecting bias in meta-analysis: guidelines on choice of axis. Journal of Clinical Epidemiology 2001; 54:1046-1055.
39. Terrin N, Schmid CH, Lau J. In an empirical evaluation of the funnel plot, researchers could not visually identify publication bias. Journal of Clinical Epidemiology 2005; 58:894-901.
40. Peters JL, Sutton AJ, Jones DR, Abrams KR, Rushton L. Contour-enhanced meta-analysis funnel plots help distinguish publication bias from other causes of asymmetry. Journal of Clinical Epidemiology 2008; 61:991-996.
41. Sterne JAC, Egger M, Moher D. Addressing reporting biases. In Cochrane Handbook for Systematic Reviews of Interventions Higgins JPT, Green S (eds), Chapter 10. Wiley: Chichester, U.K., 2008; 297-333.
42. Duval S, Tweedie R. Trim and fill: a simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics 2001; 56:455-463.
43. Higgins JPT, Altman DG (eds). Assessing risk of bias in included studies. In Cochrane Handbook for Systematic Reviews of Interventions. Higgins JPT, Green S (eds), Chapter 8. Wiley: Chichester, U.K., 2008; 187-241.
44. Galbraith RF. Some applications of radial plots. Journal of the American Statistical Association 1994; 89:1232-1242.
45. Whitehead A, Whitehead J. A general parametric approach to the meta-analysis of randomised clinical trials. Statistics in Medicine 1991; 10:1665-1677.
46. Thompson SG. Controversies in meta-analysis: the case of the trials of serum cholesterol reduction. Statistical Methods in Medical Research 1993; 2:173-192.
47. Copas J, Lozada-Can C. The radial plot in meta-analysis: approximations and applications. Journal of the Royal Statistical Society Series C (Applied Statistics) 2009; 58:329-344.
48. L'Abbé KA, Detsky AS, O'Rourke K. Meta-analysis in clinical research. Annals of Internal Medicine 1987; 107:224-233.
49. Van Houwelingen HC, Zwinderman KH, Stijnen T. A bivariate approach to meta-analysis. Statistics in Medicine 1993; 12:2273-2284.
50. Marret E, Remy C, Bonnet F. Postoperative Pain Forum Group. Meta-analysis of epidural analgesia versus parenteral opioid analgesia after colorectal surgery. British Journal of Surgery 2007; 94:665-673.
51. Jimenez FJ, Guallar E, Martinmoreno JM. A graphical display useful for meta-analysis. European Journal of Public Health 1997; 7:101-105.
52. Deeks JJ. Issues in the selection of a summary statistic for meta-analysis of clinical trials with binary outcomes. Statistics in Medicine 2002; 21:1575-1600.
53. Irwig L, Macaskill P, Glasziou P, Fahey M. Meta-analytic methods for diagnostic test accuracy. Journal of Clinical Epidemiology 1995; 48:119-130.
54. Langlotz CP, Sonnad SS. Meta-analysis of diagnostic procedures: a brief overview. Academic Radiology 1998; 5:S269-S273.
55. Higgins JPT, Thompson SG. Quantifying heterogeneity in a meta-analysis. Statistics in Medicine 2002; 21:1539-1558.
56. Walker AM, Martin-Moreno JM, Artalejo FR. Odd man out: a graphical approach to meta-analysis. American Journal of Public Health 1988; 78:961-966.
57. Pladevall-Vila M, Delclos GL, Varas C, Guyer H, Brugués-Tarradellas J, Anglada-Arisa A. Controversy of oral contraceptives and risk of rheumatoid arthritis: meta-analysis of conflicting studies and review of conflicting meta-analyses with special emphasis on analysis of heterogeneity. American Journal of Epidemiology 1996; 144:1-14.
58. Rifat SL. Graphic representations of effect estimates: an example from a meta-analytic review. Journal of Clinical Epidemiology 1990; 43:1267-1269.
59. Hardy RJ, Thompson SG. Detecting and describing heterogeneity in meta-analysis. Statistics in Medicine 1998; 17:841-856.
60. Wang MC, Bushman BJ. Using the normal quantile plot to explore meta-analytic data sets. Psychological Methods 1998; 3:46-54.
61. Carlin JB. Meta-analysis for 2 x 2 tables: a Bayesian approach. Statistics in Medicine 1992; 11:141-158.
62. Greenland S. Quantitative methods in the review of epidemiologic literature. Epidemiologic Reviews 1987; 9:1-30.
63. Baujat B, Mahe C, Pignon JP, Hill C. A graphical method for exploring heterogeneity in meta-analyses: application to a meta-analysis of 65 trials. Statistics in Medicine 2002; 21:2641-2652.
64. Thompson SG, Higgins JPT. How should meta-regression analyses be undertaken and interpreted? Statistics in Medicine 2002; 21:1559-1574.
65. Thompson SG. Why and how sources of heterogeneity should be investigated. In Systematic Reviews in Health Care: Meta-analysis in Context, Egger M, Davey Smith G, Altman DG (eds), Chapter 9. BMJ Books: London, 2001; 157-175.
66. Bailar III JC. The practice of meta-analysis. Journal of Clinical Epidemiology 1995; 48:149-157.
67. Berkey CS, Hoaglin DC, Mosteller F, Colditz GA. A random-effects regression model for meta-analysis. Statistics in Medicine 1995; 14:395-411.
68. Sutton AJ, Abrams KR. Bayesian methods in meta-analysis and evidence synthesis. Statistical Methods in Medical Research 2001; 10:277-303.
69. Lau J, Ioannidis JPA, Schmid CH. Summing up evidence: one answer is not always enough. The Lancet 1998; 351:123-127.
70. Lewington S, Clarke R, Qizilbash N, Peto R, Collins R. Age-specific relevance of usual blood pressure to vascular mortality: a meta-analysis of individual data for one million adults in 61 prospective studies. The Lancet 2002; 360:1903-1913.
71. Olkin I. Diagnostic statistical procedures in medical meta-analyses. Statistics in Medicine 1999; 18:2331-2341.
72. Copas J, Shi JQ. Meta-analysis, funnel plots and sensitivity analysis. Biostatistics 2000; 1:247-262.
73. Hardy RJ, Thompson SG. A likelihood approach to meta-analysis with random effects. Statistics in Medicine 1996; 15:619-629.
74. Borenstein M, Hedges L, Higgins J, Rothstein H. Comprehensive Meta-analysis Version 2 [Computer program]. Biostat: Englewood, NJ, 2005.
75. Review Manager (RevMan) [ Computer program] Version 5.0. Nordic Cochrane Centre: Copenhagen.
76. Sterne JAC (ed.). Meta-Analysis in Stata: An Updated Collection from the Stata Journal. Stata Press: College Station, TX, 2009.
77. Cleveland WS. The Elements of Graphing Data. Hobart Press: Summit, NJ, 1994.