Dealing with clinical heterogeneity in meta-analysis. Assumptions, methods, interpretation

International Journal of Methods in Psychiatric Research

Volumn 22, Issue 1, 2013, Pages 1-15

  Kriston, Levente ^a  

^a UNIVERSITY MEDICAL CENTER HAMBURG EPPENDORF   (Germany)

Author keywords

Clinical heterogeneity; Meta analysis

Indexed keywords

ARTICLE; BAYES THEOREM; CLINICAL TRIAL (TOPIC); DECISION MAKING; HUMAN; META ANALYSIS; META ANALYSIS (TOPIC); METHODOLOGY; PSYCHOTHERAPY; STATISTICS;

BAYES THEOREM; CLINICAL TRIALS AS TOPIC; DECISION MAKING; HUMANS; META-ANALYSIS AS TOPIC; PSYCHOTHERAPY; RESEARCH DESIGN; STATISTICS AS TOPIC;

EID: 84875614691     PISSN: 10498931     EISSN: 15570657     Source Type: Journal    
DOI: 10.1002/mpr.1377     Document Type: Article

References (56)

1. Ades A.E., Lu G., Higgins J.P.T. (2005) The interpretation of random-effects meta-analysis in decision models. Medical Decision Making, 25(6), 646-654, DOI: 10.1177/0272989X05282643
2. Altman D.G., Bland J.M. (1995) Absence of evidence is not evidence of absence. British Medical Journal, 311(7003), 485, DOI: 10.1136/bmj.311.7003.485
3. Beck A.T. (2009) Analyzing effectiveness of long-term psychodynamic psychotherapy. Journal of the American Medical Association, 301(9), 931. DOI: 10.1001/jama.2009.178
4. Bhar S.S., Thombs B.D., Pignotti M., Bassel M., Jewett L., Coyne J.C., Beck A.T. (2010) Is longer-term psychodynamic psychotherapy more effective than shorter-term therapies? Review and critique of the evidence. Psychotherapy and Psychosomatics, 79(4), 208-216, DOI: 10.1159/000313689
5. Borenstein M., Hedges L.V., Higgins J.P.T. (2008) Introduction to Meta-analysis, Chichester, John Wiley & Sons.
6. Caldwell D.M., Welton N.J., Ades A.E. (2010) Mixed treatment comparison analysis provides internally coherent treatment effect estimates based on overviews of reviews and can reveal inconsistency. Journal of Clinical Epidemiology, 63(8), 875-882, DOI: 10.1016/j.jclinepi.2009.08.025
7. Clarkin J.F., Levy K.N., Lenzenweger M.F., Kernberg O.F. (2007) Evaluating three treatments for borderline personality disorder: a multiwave study. The American Journal of Psychiatry, 164(6), 922-928.
8. Cochran W.G. (1954) The combination of estimates from different experiments. Biometrics, 10(1), 101-129, DOI: 10.2307/3001666
9. Cohen J. (1988) Statistical Power Analysis for the Behavioral Sciences, 2nd edition, Hillsdale, NJ, Lawrence Erlbaum Associates.
10. Counsell C. (1997) Formulating questions and locating primary studies for inclusion in systematic reviews. Annals of Internal Medicine, 127(5), 380-387.
11. Craig P., Dieppe P., Macintyre S., Michie S., Nazareth I., Petticrew M. (2008) Developing and evaluating complex interventions: the new Medical Research Council guidance. British Medical Journal, 337, a1655, DOI: 10.1136/bmj.a1655
12. DerSimonian R., Laird N. (1986) Meta-analysis in clinical trials. Controlled Clinical Trials, 7(3), 177-188.
13. DerSimonian R., Kacker R. (2007) Random-effects model for meta-analysis of clinical trials: an update. Contemporary Clinical Trials, 28(2), 105-114, DOI: 10.1016/j.cct.2006.04.004
14. Egger M., Smith G.D., Altman D.G. (2001) Systematic Reviews in Health Care: Meta-analysis in Context, London, BMJ.
15. Fonagy P. (2010a) The changing shape of clinical practice: driven by science or by pragmatics? Psychoanalytic Psychotherapy, 24(1), 22-43, DOI: 10.1080/02668731003590139
16. Fonagy P. (2010b) Psychotherapy research: do we know what works for whom? The British Journal of Psychiatry, 197(2), 83-85, DOI: 10.1192/bjp.bp.110.079657
17. Goodyear-Smith F.A., van Driel M.L., Del Mar C., Arroll B. (2012) Analysis of decisions made in meta-analyses of depression screening and the risk of confirmation bias: a case study. BMC Medical Research Methodology, 12(1), 76, DOI: 10.1186/1471-2288-12-76
18. Gøtzsche P.C. (2000) Why we need a broad perspective on meta-analysis. British Medical Journal, 321(7261), 585-586, DOI: 10.1136/bmj.321.7261.585
19. Greenland S. (1994) Invited commentary: a critical look at some popular meta-analytic methods. American Journal of Epidemiology, 140(3), 290-296.
20. Higgins J.P.T., Green S. (2011) Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0. The Cochrane Collaboration. http://www.cochrane-handbook.org [March 2011]
21. Higgins J.P.T., Thompson S.G., Deeks J.J., Altman D.G. (2002) Statistical heterogeneity in systematic reviews of clinical trials: a critical appraisal of guidelines and practice. Journal of Health Services Research & Policy, 7(1), 51-61, DOI: 10.1258/1355819021927674
22. Higgins J.P.T., Thompson S.G., Deeks J.J., Altman D.G. (2003) Measuring inconsistency in meta-analyses. British Medical Journal, 327(7414), 557-560, DOI: 10.1136/bmj.327.7414.557
23. Higgins J.P.T., Thompson S.G. Spiegelhalter D.J. (2009) A re-evaluation of random-effects meta-analysis. Journal of the Royal Statistical Society, Series A, 172(1), 137-159, DOI: 10.1111/j.1467-985X.2008.00552.x
24. Ioannidis J.P.A. (2009) Integration of evidence from multiple meta-analyses: a primer on umbrella reviews, treatment networks and multiple treatments meta-analyses. Canadian Medical Association Journal, 181(8): 488-493, DOI: 10.1503/cmaj.081086
25. Kriston L., Hölzel L., Härter M. (2009) Analyzing effectiveness of long-term psychodynamic psychotherapy. Journal of the American Medical Association, 301(9), 930-931, DOI: 10.1001/jama.2009.178
26. Kriston L., von Wolff A., Hölzel L.P. (2011) Contradictory high-level evidence for new generation antidepressants. [German]. Psychopharmakotherapie, 18(1), 35-37.
27. Lau J., Ioannidis J.P.A., Schmid C.H. (1998) Summing up evidence: one answer is not always enough. Lancet, 351(9096), 123-127, DOI: 10.1016/S0140-6736(97)08468-7
28. Leichsenring F., Rabung S. (2008) Effectiveness of long-term psychodynamic psychotherapy. Journal of the American Medical Association, 300(13), 1551-1565, DOI: 10.1001/jama.300.13.1551
29. Leichsenring F., Rabung S. (2011) Long-term psychodynamic psychotherapy in complex mental disorders: update of a meta-analysis. The British Journal of Psychiatry, 199(1), 15-22, DOI: 10.1192/bjp.bp.110.082776
30. Linde K., Willich S.N. (2003) How objective are systematic reviews? Differences between reviews on complementary medicine. Journal of the Royal Society of Medicine, 96(1), 17-22, DOI: 10.1258/jrsm.96.1.17
31. Lipsey M.W., Wilson D.B. (1993) The efficacy of psychological, educational, and behavioral treatment. Confirmation from meta-analysis. American Psychologist, 48(12), 1181-1209.
32. Lipsey M.W., Wilson D.B. (2001) Practical Meta-analysis, Thousand Oaks, CA, Sage Publications.
33. Littell J.H., Shlonsky A. (2010) Making sense of meta-analysis: a critique of "effectiveness of long-term psychodynamic psychotherapy". Clinical Social Work Journal, 39(4), 340-346, DOI: 10.1007/s10615-010-0308-z
34. Lu G., Ades A.E. (2004) Combination of direct and indirect evidence in mixed treatment comparisons. Statistics in Medicine, 23(20), 3105-3124, DOI: 10.1002/sim.1875
35. Lunn D.J., Thomas A., Best N., Spiegelhalter D. (2000) WinBUGS - a Bayesian modelling framework: concepts, structure, and extensibility. Statistical Computing, 10(4): 325-337, DOI: 10.1023/A:1008929526011
36. Moher D., Liberati A., Tetzlaff J., Altman D.G., the PRISMA Group. (2009) Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Annals of Internal Medicine, 151(4), 264-269, DOI: 10.1059/0003-4819-151-4-200908180-00135
37. O'Rourke K., Detsky A.S. (1989) Meta-analysis in medical research: strong encouragement for higher quality in individual research efforts. Journal of Clinical Epidemiology, 42(10), 1021-1024, DOI: 10.1016/0895-4356(89)90168-6
38. Pawson R., Greenhalgh T., Harvey G., Walshe K. (2005) Realist review - a new method of systematic review designed for complex policy interventions. Journal of Health Services Research & Policy, 10(Suppl 1), 21-34, DOI: 10.1258/1355819054308530
39. Pladevall-Vila M., Delclos G.L., Varas C., Guyer H., Brugués-Tarradellas J., Anglada-Arisa A. (1996) Controversy of oral contraceptives and risk of rheumatoid arthritis: meta-analysis of conflicting studies and review of conflicting meta-analyses with special emphasis on analysis of heterogeneity. American Journal of Epidemiology, 144(1), 1-14.
40. Riley R.D., Higgins J.P.T., Deeks J.J. (2011) Interpretation of random effects meta-analyses. British Medical Journal, 342, d549, DOI: 10.1136/bmj.d549
41. Rosenberg M.S., Adams D.C., Gurevitch J. (2000) MetaWin: Statistical Software for Meta-analysis, version 2.0, Sunderland, MA, Sinauer.
42. Rouder J.N., Morey R.D. (2011) A Bayes factor meta-analysis of Bem's ESP claim. Psychonomic Bulletin & Review, 18(4), 682-689, DOI: 10.3758/s13423-011-0088-7
43. Rubin D.B. (1992) Meta-analysis: literature synthesis or effect-size surface estimation? Journal of Educational and Behavioral Statistics, 17(4), 363-374, DOI: 10.3102/10769986017004363
44. Smit Y., Huibers M.J.H., Ioannidis J.P.A., van Dyck R., van Tilburg W., Arntz A. (2012) The effectiveness of long-term psychoanalytic psychotherapy - a meta-analysis of randomized controlled trials. Clinical Psychology Review, 32(2), 81-92, DOI: 10.1016/j.cpr.2011.11.003
45. Smith M.L., Glass G.V., Miller T.I. (1980) The Benefits of Psychotherapy, Baltimore, MD, John Hopkins University Press.
46. Smith T.C., Spiegelhalter D.J., Thomas A. (1995) Bayesian approaches to random-effects meta-analysis: a comparative study. Statistics in Medicine, 14(24), 2685-2699, DOI: 10.1002/sim.4780142408
47. Smith G.D., Egger M., Phillips A.N. (1997) Meta-analysis. Beyond the grand mean? British Medical Journal, 315(7122), 1610-1614, DOI: 10.1136/bmj.315.7122.1610
48. Sutton A.J., Abrams K.R. (2001) Bayesian methods in meta-analysis and evidence synthesis. Statistical Methods in Medical Research, 10(4), 277-303, DOI: 10.1177/096228020101000404
49. Svartberg M., Stiles T.C., Seltzer M.H. (2004) Randomized, controlled trial of the effectiveness of short-term dynamic psychotherapy and cognitive therapy for cluster C personality disorders. The American Journal of Psychiatry, 161(5), 810-817, DOI: 10.1176/appi.ajp.161.5.810
50. Thombs B.D., Bassel M., Jewett L.R. (2009) Analyzing effectiveness of long-term psychodynamic psychotherapy. Journal of the American Medical Association, 301(9), 930, DOI: 10.1001/jama.2009.177
51. Thompson S.G. (1994) Why sources of heterogeneity in meta-analysis should be investigated. British Medical Journal, 309(6965), 1351-1355, DOI: 10.1136/bmj.309.6965.1351
52. Thompson S.G., Sharp S.J. (1999) Explaining heterogeneity in meta-analysis: a comparison of methods. Statistics in Medicine, 18(20), 2693-2708, DOI: 10.1002/(SICI)1097-0258(19991030)18:20<2693::AID-SIM235>3.0.CO;2-V
53. Vavken P., Dorotka R. (2009) A systematic review of conflicting meta-analyses in orthopaedic surgery. Clinical Orthopaedics, 467(10), 2723-2735, DOI: 10.1007/s11999-009-0765-2
54. Wachter K.W., Straf M.L., National Research Council (US) Committee on National Statistics. (1990) The Future of Meta-analysis, New York, Russell Sage Foundation.
55. Whitlock E.P., Lin J.S., Chou R., Shekelle P., Robinson K.A. (2008) Using existing systematic reviews in complex systematic reviews. Annals of Internal Medicine, 148(10), 776-782.
56. Yusuf S., Wittes J., Probstfield J., Tyroler H.A. (1991) Analysis and interpretation of treatment effects in subgroups of patients in randomized clinical trials. Journal of the American Medical Association, 266(1), 93-98, DOI: 10.1001/jama.1991.03470010097038