More than numbers: The power of graphs in meta-analysis

American Journal of Epidemiology

Volumn 169, Issue 2, 2009, Pages 249-255

  Bax, Leon ^a,b,e   Ikeda, Noriaki ^b   Fukui, Naohito ^c   Yaju, Yukari ^d   Tsuruta, Harukazu ^b   Moons, Karel G M ^e  

^a KITASATO UNIVERSITY SCHOOL OF MEDICINE   (Japan)

^b KITASATO UNIVERSITY   (Japan)

^c Japan Clinical Research Support Unit   (Japan)

^d UNIVERSITY OF TOKYO   (Japan)

^e UNIVERSITY MEDICAL CENTER UTRECHT   (Netherlands)

Author keywords

Epidemiologic methods; Evaluation studies; Meta analysis; Publication bias; Review

Indexed keywords

COMPARATIVE STUDY; EPIDEMIOLOGY; GRAPHICAL METHOD; HETEROGENEITY; HISTOGRAM; LITERATURE REVIEW; META-ANALYSIS;

ARTICLE; CONTENT VALIDITY; HISTOGRAM; MEDICAL RESEARCH; PLOTS AND CURVES; QUANTITATIVE ANALYSIS; RATING SCALE;

COMMUNICATION; COMPUTER GRAPHICS; CONFIDENCE INTERVALS; DATA INTERPRETATION, STATISTICAL; EFFECT MODIFIERS (EPIDEMIOLOGY); EPIDEMIOLOGIC METHODS; HUMANS; JOURNALISM, MEDICAL; META-ANALYSIS AS TOPIC; PUBLICATION BIAS; SOFTWARE;

EID: 58449092284     PISSN: 00029262     EISSN: 14766256     Source Type: Journal    
DOI: 10.1093/aje/kwn340     Document Type: Article

References (43)

1. Galbraith RF. A note on graphical presentation of estimated odds ratios from several clinical trials. Stat Med. 1988;7(8):889-894.
2. Lewis S, Clarke M. Forest plots: trying to see the wood and the trees. BMJ. 2001;322(7300):1479-1480.
3. L'Abbé KA, Detsky AS, O'Rourke K. Meta-analysis in clinical research. Ann Intern Med. 1987;107(2):224-233.
4. Light RJ, Pillemer DB. Summing Up. Cambridge, MA: Harvard University Press; 1985.
5. Thompson SG. Why sources of heterogeneity in meta-analysis should be investigated. BMJ. 1994;309(6965):1351-1355.
6. Rothstein H, Sutton AJ, Borenstein M. Publication Bias in Meta-Analysis: Prevention, Assessment and Adjustments. Chichester, United Kingdom: John Wiley & Sons Ltd; 2005.
7. Song F, Eastwood AJ, Gilbody S, et al. Publication and related biases. Health Technol Assess. 2000;4(10):1-115.
8. Baujat B, Mahé C, Pignon JP, et al. A graphical method for exploring heterogeneity in meta-analyses: application to a meta-analysis of 65 trials. Stat Med. 2002;21(18):2641-2652.
9. Egger M, Davey Smith G, Schneider M, et al. Bias in meta-analysis detected by a simple, graphical test. BMJ. 1997;315(7109):629-634.
10. Lau J, Ioannidis JP, Terrin N, et al. The case of the misleading funnel plot. BMJ. 2006;333(7568):597-600.
11. Song F. Exploring heterogeneity in meta-analysis: is the L'Abbé plot useful? J Clin Epidemiol. 1999;52(8):725-730.
12. Song F, Khan KS, Dinnes J, et al. Asymmetric funnel plots and publication bias in meta-analyses of diagnostic accuracy. Int J Epidemiol. 2002;31(1):88-95.
13. Souza JP, Pileggi C, Cecatti JG. Assessment of funnel plot asymmetry and publication bias in reproductive health meta-analyses: an analytic survey [electronic article]. Reprod Health. 2007;4:3.
14. Sterne JA, Egger M. Funnel plots for detecting bias in meta-analysis: guidelines on choice of axis. J Clin Epidemiol. 2001;54(10):1046-1055.
15. Tang JL, Liu JL. Misleading funnel plot for detection of bias in meta-analysis. J Clin Epidemiol. 2000;53(5):477-484.
16. Terrin N, Schmid CH, Lau J. In an empirical evaluation of the funnel plot, researchers could not visually identify publication bias. J Clin Epidemiol. 2005;58(9):894-901.
17. Wang MC, Bushman BJ. Using the normal quantile plot to explore meta-analytic data sets. Psychol Methods. 1998;3(1):46-54.
18. Colditz GA, Brewer TF, Berkey CS, et al. Efficacy of BCG vaccine in the prevention of tuberculosis. Meta-analysis of the published literature. JAMA. 1994;271(9):698-702.
19. Freiman JA, Chalmers TC, Smith H Jr, et al. The importance of beta, the type II error and sample size in the design and interpretation of the randomized control trial. Survey of 71 "negative" trials. N Engl J Med. 1978;299(13):690-694.
20. Lewis JA, Ellis SH. A statistical appraisal of post-infarction beta-blocker trials. Primary Cardiol. 1982(suppl 1):31-37.
21. Moja L, Moschetti I, Liberati A, et al. Understanding systematic reviews: the meta-analysis graph (also called "forest plot"). Intern Emerg Med. 2007;2(2):140-142.
22. Ried K. Interpreting and understanding meta-analysis graphs - a practical guide. Aust Fam Physician. 2006;35(8):635-638.
23. Sterne JA, Gavaghan D, Egger M. Publication and related bias in meta-analysis: power of statistical tests and prevalence in the literature. J Clin Epidemiol. 2000;53(11):1119-1129.
24. Duval S, Tweedie R. A non-parametric "trim and fill" method of accounting for publication bias in meta-analysis. J Am Stat Assoc. 2000;95:89-98.
25. Duval S, Tweedie R. Trim and fill: a simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics. 2000;56(2):455-463.
26. Peters JL, Sutton AJ, Jones DR, et al. Performance of the trim and fill method in the presence of publication bias and between-study heterogeneity. Stat Med. 2007;26(25):4544-4562.
27. Sterne JA. High false-positive rate for trim and fill method [letter]. BMJ. 2000;320:1574-1577. (http://www.bmj.com/cgi/eletters/320/7249/ 1574#EL1).
28. Bax L, Yu LM, Ikeda N, et al. A systematic comparison of software dedicated to meta-analysis of causal studies [electronic article]. BMC Med Res Methodol. 2007;7:40.
29. Tukey JW. Exploratory Data Analysis. Reading, MA: Addison-Wesley; 1977.
30. Bax L, Yu LM, Ikeda N, et al. Development and validation of MIX: comprehensive free software for meta-analysis of causal research data [electronic article]. BMC Med Res Methodol. 2006;6:50.
31. Greenland S. Quantitative methods in the review of epidemiologic literature. Epidemiol Rev. 1987;9:1-30.
32. Sutton AJ, Abrams KR, Jones DR, et al. Methods for Meta-Analysis in Medical Research. Chichester, United Kingdom: John Wiley & Sons Ltd; 2000.
33. Harbord RM, Egger M, Sterne JA. A modified test for small-study effects in meta-analyses of controlled trials with binary endpoints. Stat Med. 2006;25(20):3443-3457.
34. Macaskill P, Walter SD, Irwig L. A comparison of methods to detect publication bias in meta-analysis. Stat Med. 2001;20(4):641-654.
35. Begg CB, Mazumdar M. Operating characteristics of a rank correlation test for publication bias. Biometrics. 1994;50(4):1088-1101.
36. Bax L, Yu LM, Ikeda N, et al. MIX: Comprehensive Free Software for Meta-Analysis of Causal Research Data. Version 1.7. Sagamihara, Japan: Kitasato Clinical Research Center; 2008. (http://mix-for-meta-analysis.info). (Accessed May 20, 2008).
37. 19937-1. Hiroshima, Japan: Department of Mathematics, Hiroshima University; 2002. (http://www.math.sci. hiroshima-u.ac.jp/~m-mat/MT/emt.html). (Accessed February 12, 2008).
38. SPSS, Inc. SPSS for Windows. Chicago, IL: SPSS, Inc; 2005.
39. McGraw KO, Wong SP. Forming inferences about some intra-class correlation coefficients. Psychol Methods. 1996;1(1):30-46.
40. Portney LG, Watkins MP. Foundations of Clinical Research: Applications to Practice. 2nd ed. Upper Saddle River, NJ: Prentice Hall Health; 1999.
41. R Development Core Team. R: A Language and Environment for Statistical Computing. Vienna, Austria: R Foundation for Statistical Computing; 2007.
42. Higgins JP, Thompson SG. Quantifying heterogeneity in a meta-analysis. Stat Med. 2002;21(11):1539-1558.
43. Higgins JP, Thompson SG, Deeks JJ, et al. Measuring inconsistency in meta-analyses. BMJ. 2003;327(7414):557-560.