Meta-Analysis: Summarising Findings on Addiction Intervention Effects

Addiction Research Methods

Volumn , Issue , 2010, Pages 319-336

  Finney, John W ^a   Moyer, Anne ^b  

^a VA PALO ALTO HEALTH CARE SYSTEM   (United States)

^b STONY BROOK UNIVERSITY   (United States)

Author keywords

Calculating aggregated effect sizes across studies; Coding study characteristics; CONSORT statement for reporting primary randomised clinical trials (RCTs); Meta analyses of addiction interventions; Meta analysis summarising findings on addiction intervention effects; Meta analytic methods; Meta analytic review deeper understanding of research area; Quantitative summaries of diverse literatures each outcome synthesised in a 'common currency'; Research questions and study eligibility criteria

Indexed keywords

EID: 84885514832     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1002/9781444318852.ch20     Document Type: Chapter

References (79)

1. Agosti, V. (1995) The efficacy of treatments in reducing alcohol consumption: a meta-analysis. International Journal of the Addictions, 30, 1067-1077.
2. Altman, D. G., Schulz, K. F., Moher, D., Egger, M., Davidoff, F., Elbourne, D., Gøtzsche, P. C. & Lang, T., for the CONSORT Group (Consolidated Standards of Reporting Trials) (2001) The revised CONSORT statement for reporting randomized trials: explanation and elaboration. Annals of Internal Medicine, 134, 663-694.
3. Arends, L. R., Voko, Z. & Stijnen, T. (2003) Combining multiple outcome measures in a meta-analysis: an application. Statistics in Medicine, 22, 1335-1353.
4. Baker, S. G. & Kramer, B. S. (2002) The transitive fallacy for randomized trials: if A bests B and B bests C in separate trials, is A better than C? BMC Medical Research Methodology, 2(13).
5. Baldwin, S. A., Murray, D. M. & Shadish, W. R. (2005) Empirically supported treatments or type I errors? Problems with the analysis of data from group-administered treatments. Journal of Consulting and Clinical Psychology, 73, 924-935.
6. Becker, B. J. (1988) Synthesizing standardized mean-change measures. British Journal of Mathematical and Statistical Psychology, 41, 257-278.
7. Berlin, J. A., Santanna, J., Schmid, C. H., Szczech, L. A., Feldman, H. I. & the Anti-Lymphocyte Antibody Induction Therapy Study Group. (2002) Individual patient-versus group-level data meta-regressions for the investigation of treatment effect modifiers: ecological bias rears its ugly head. Statistics in Medicine, 21, 371-387.
8. Berner,M. M., Kriston, L., Bentele, M. & Harter,M. (2007) The Alcohol Use Disorders Identification Test for detecting at-risk drinking: a systematic review and meta-analysis. Journal of Studies on Alcohol and Drugs, 63, 461-473.
9. Boynton, M. H. (2008) Top ten tips for graduate students who want to conduct a meta-analysis. Psychological Science Agenda, 22(4). Available online: http://www.apa.org/science/psa/apr08ssc.html (accessed 6 October 2009).
10. Bucher, H. C., Guyatt, G. H., Griffith, L. E. & Walter, S. D. (1997) The results of direct and indirect treatment comparisons in meta-analysis of randomized controlled trials. Clinical Epidemiology, 50, 683-691.
11. Cook, T. D. & Campbell, D. T. (1979) Quasi-Experimentation: Design and Analysis Issues for Field Settings. Chicago: Rand McNally.
12. Duval, S. & Tweedie, R. (2000) Trim and fill: a simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics, 56, 455-463.
13. Feinn, R. & Kranzler, H. R. (2005) Does effect size in naltrexone trials for alcohol dependence differ for single-site vs. multiple-center studies? Alcoholism: Clinical and Experimental Research, 29, 983-988.
14. Finney, J. W., Hahn, A. C. & Moos, R. H. (1996) The effectiveness of inpatient and outpatient treatment for alcohol abuse: the need to focus on mediators and moderators of setting effects. Addiction, 91, 1773-1796.
15. Finney, J. W. & Moos, R. H. (1996) The effectiveness of inpatient and outpatient treatment for alcohol abuse: effect sizes, research design issues, and explanatory mechanisms [Response to commentaries]. Addiction, 91, 1813-1820.
16. Gandini, S., Botteri, E., Iodice, S., Boniol, M., Lowenfels, A. B., Maisonneuve, P. & Boyle, P. (2008) Tobacco smoking and cancer: a meta-analysis. International Journal of Cancer, 122, 155-164.
17. Gehr, B. T., Weiss, C.&Porzsolt, F. (2006) The fading of reported effectiveness: a meta-analysis of randomised controlled trials. BMC Medical Research Methodology, 6(25).
18. Glass, G. V. (1976) Primary, secondary and meta-analysis of research. Educational Researcher, 10, 3-8.
19. Grissom, R. J. (1996) The magical number .7 ± .2: meta-meta-analysis of the probability of superior outcomes in comparison involving therapy, placebo, and control. Journal of Consulting and Clinical Psychology, 64, 973-982.
20. Hedges, L. V. (2007) Effect sizes in cluster-randomized designs. Journal of Educational and Behavioral Statistics, 32, 341-370.
21. Hedges, L. V. & Olkin, I. (1985) Statistical Methods for Meta-analysis. New York: Academic Press.
22. Hedges, L. V. & Pigott, T. D. (2001) The power of statistical tests in meta-analysis. Psychological Methods, 6, 203-217.
23. Hedges, L. V.&Pigott, T. D. (2004) The power of statistical tests for moderators in meta-analysis. Psychological Methods, 9, 426-445.
24. Hedges, L. V.&Vevea, J. L. (1998) Fixed- and random-effects models in meta-analysis. Psychological Methods, 3, 486-504.
25. Herzog, T. A., Lazev, A. B., Irvin, J. E., Juliano, L. M., Greenbaum, P. E. & Brandon, T. H. (2002) Testing for group membership effects during and after treatment: the example of group therapy for smoking cessation. Behavior Therapy, 33, 29-43.
26. Hettema, J., Steele, J.&Miller, W. R. (2005) Motivational interviewing. Annual Review of Clinical Psychology, 1, 91-111.
27. Higgins, J. P. T.&Thompson, G. S. (2002) Quantifying heterogeneity in a meta-analysis. Statistics in Medicine, 21, 1539-1558.
28. Hsu, L. M. (2004) Biases of success rate differences shown in binomial effect size displays. Psychological Methods, 9, 183-197.
29. Huedo-Medina, T. B., Sánchez-Meca, J., Marín-Martínez, F. & Botella, J. (2006) Assessing heterogeneity in meta-analysis: Q statistic or I2 index? Psychological Methods, 11, 193-206.
30. Irvin, J. E., Bowers, C. A., Dunn, M. E. & Wang, M. C. (1999) Efficacy of relapse prevention: a meta-analytic review. Journal of Consulting and Clinical Psychology, 67, 563-570.
31. Kraemer, H. C., Gardner, C., Brooks, J. O. & Yesavage, J. A. (1998) Advantages of excluding underpowered studies in meta-analysis: inclusionist versus exclusionist viewpoints. Psychological Methods, 3, 23- 31.
32. Laupacis, A., Sackett, D. L. & Roberts, R. S. (1988) An assessment of clinically useful measures of the consequences of treatment. New England Journal of Medicine, 3318, 1728-1733.
33. Lipsey, M. W. & Wilson, D. B. (2001) Practical Meta-analysis. Thousand Oaks, CA: Sage.
34. Lu, G. & Ades, A. E. (2004) Combination of direct and indirect evidence in mixed treatment comparison. Statistics in Medicine, 23, 3105-3124.
35. Lumley, T. (2002) Network meta-analysis for indirect treatment comparisons. Statistics in Medicine, 21, 2313-2324.
36. Marsch, L. A. (1998) The efficacy of methadone maintenance interventions in reducing illicit opiate use, HIV risk behavior and criminality: a meta-analysis. Addiction, 93, 515-532.
37. McGrath, R. E. & Meyer, G. J. (2006) When effect sizes disagree: the case of r and d. Psychological Methods, 11, 386-401.
38. Moher, D., Cook, D. J., Eastwood, S., Olkin, I., Rennie, D. & Stroup, D. F. (1999) Improving the quality of reports of meta-analyses of randomised controlled trials: the QUOROM statement. Quality of reporting of meta-analyses. Lancet, 354, 1896-1900.
39. Moher, D., Tsertsvadze, A., Tricco, A. C., Eccles, M., Grimshaw, J., Sampson, M. & Barrowman, N. (2008) When and how to update systematic reviews. Cochrane Database of Systematic Reviews, January, 23(1), MR000023.
40. Morris, S. B. (2000) Distribution of standardized mean change effect size for meta-analysis on repeated measures. British Journal of Mathematical and Statistical Psychology, 53, 17-29.
41. Morris, S. B. & DeShon, R. P. (2002) Combining effect size estimates in meta-analysis with repeated measures and independent-groups designs. Psychological Methods, 7, 105-125.
42. Moyer, A. & Finney, J. W. (2005) Rating methodological quality: toward improved assessment and investigation. Accountability in Research, 12, 299-313.
43. Moyer, A., Finney, J. W., Swearingen, C. E. & Vergun, P. (2002) Brief interventions for alcohol problems: a meta-analytic review of controlled investigations in treatment-seeking and non-treatment-seeking populations. Addiction, 97, 279-292.
44. Ogilvie, D., Fayter, D., Petticrew, M., Sowden, A., Thomas, S., Whitehead, M. & Worthy, G. (2008) The harvest plot: a method for synthesising evidence about the differential effects of interventions. BMC Medical Research Methodology, 8(8).
45. Orwin, R. G. & Vevea, J. L. (2009) Evaluating coding decisions. In: H. Cooper, L. V. Hedges & J. C. Valentine (eds) The Handbook of Research Synthesis and Meta-Analysis. New York: Russell Sage Foundation, pp. 173-203.
46. Peters, G. J., Kok, G. & Abraham, C. (2008) Social cognitive determinants of ecstasy use to target in evidencebased interventions: a meta-analytical review. Addiction, 103, 109-118.
47. Peters, J. L., Sutton, A. J., Jones, D. R., Abrams, K. R. & Rushton, L. (2007) Performance of the trim and fill method in the presence of publication bias and between-study heterogeneity. Statistics in Medicine, 26, 4544-4562.
48. Pigott, T. D. (2001) Missing predictors in models of effect size. Evaluation and the Health Professions, 24, 277-307.
49. Pigott, T. D. (2009) Handling missing data. In: H. Cooper, L. V. Hedges&J. C. Valentine (eds) The Handbook of Research Synthesis and Meta-Analysis. New York: Russell Sage Foundation, pp. 399-416.
50. Psaty, B. M., Lumley, T., Furberg, C. D., Schellenbaum, G., Pahor, M., Alderman, M. H. & Weiss, N. H. (2003) Health outcomes associated with various hypertensive therapies used as first-line agents: a network meta-analysis. JAMA: The Journal of the American Medical Association, 289, 2534-2544.
51. Ray, J. W. & Shadish, W. R. (1996) How interchangeable are different estimators of effect size? Journal of Consulting and Clinical Psychology, 64(6), 1316-1325.
52. Robinson, W. (1950) Ecological correlations and the behavior of individuals. American Sociological Review, 15, 351-357.
53. Rooney, B. L. & Murray, D. M. (1996) A meta-analysis of smoking prevention programs after adjustment for errors in the unit of analysis. Health Education Quarterly, 23, 48-64.
54. Rosenthal, R. & Rubin, D. B. (1982) A simple, general purpose display of magnitude of experimental effect. Journal of Educational Psychology, 74, 166-169.
55. Rothstein, H. R., Sutton, A. J. & Borenstein, M. (eds) (2005) Publication Bias in Meta-analysis: Prevention, Assessment and Adjustments. Chichester: John Wiley.
56. Sanchez-Meca, J., Marin-Martinez, F. & Chacon-Moscoso, S. (2003) Effect-size indices for dichotomized outcomes in meta-analysis. Psychological Methods, 8, 448-467.
57. Santaguida, P. L., Helfand, M. & Raina, P. (2005) Challenges in systematic reviews that evaluate drug efficacy or effectiveness. Annals of Internal Medicine, 142, 1006-1072.
58. Schafer, J. L. & Graham, J. W. (2002) Missing data: our view of the state of the art. Psychological Methods, 7, 147-177.
59. Scott, J. C., Woods, S. P., Matt, G. E., Meyer, R. A., Heaton, R. K., Atkinson, J. H. & Grant, I. (2007) Neurocognitive effects of methamphetamine: a critical review and meta-analysis. Neuropsychology Review, 17, 275-297.
60. Song, F., Altman, D. G., Glenny, A. M. & Deeks, J. J. (2003) Validity of indirect comparison for estimating efficacy of competing interventions: empirical evidence from published meta-analyses. British Medical Journal, 326, 472.
61. Stanton, M. D. & Shadish, W. R. (1997) Outcome, attrition and family-couples treatment for drug abuse: a meta-analysis and review of the controlled, comparative studies. Psychological Bulletin, 122, 170-191.
62. Streeton, C. & Whelan, G. (2001) Naltreone, a relapse prevention maintenance treatment of alcohol dependence: a meta-analysis of randomized controlled trials. Alcohol and Alcoholism, 36, 544-552.
63. Sutton, A. J.&Higgins, J. P. (2008) Recent developments in meta-analysis. Statistics in Medicine, 27, 625-650.
64. Swearingen, C. E., Moyer, A. & Finney, J. W. (2003) Alcoholism treatment outcome studies, 1970-1998: an expanded look at the nature of the research. Addictive Behaviors, 28, 415-436.
65. Thompson, K. N. & Schumacker, R. E. (1997) An evaluation of Rosenthal and Rubin's binomial effect size display. Journal of Educational and Behavioral Statistics, 22, 109-117.
66. Tonigan, J. S., Toscova, R. & Miller, W. R. (1996) Meta-analysis of the literature on Alcoholic Anonymous: sample and study characteristics moderate findings. Journal of Studies on Alcohol, 57, 65-72.
67. Trikalinos, T. A., Churchill, R., Ferri,M., Leucht, S., Tuunainen, A., Wahlbeck, K.&Ioannidis, J. P. A., for the EU-PSI Project (2004) Effect sizes in cumulative meta-analyses of mental health randomized trials evolved over time. Journal of Clinical Epidemiology, 57, 1124-1130.
68. Viechtbauer, W. (2007) Hypothesis tests for population heterogeneity in meta-analysis. British Journal of Mathematical and Statistical Psychology, 60, 29-60.
69. Wetterslev, J., Thorlund, K., Brok, J. & Gluud, C. (2008) Trial sequential analysis may establish when firm evidence is reached in cumulative meta-analysis. Journal of Clinical Epidemiology, 61, 64-75.
70. White, H. (2009) Scientific communication and literature retrieval. In: H. Cooper, L. V. Hedges & J. C. Valentine (eds) The Handbook of Research Synthesis and Meta-Analysis. New York: Russell Sage Foundation, pp. 51-71.
71. Wilson, D. B. & Lipsey, M. W. (2001) The role of method in treatment effectiveness research: evidence from meta-analysis. Psychological Methods, 6, 413-429.
72. Borenstein, M., Hedges, L. V., Higgins, J. P. T. & Rothstein, H. R. (2009) Introduction to Meta-analysis (Statistics in Practice). Hoboken, NJ: John Wiley & Sons.
73. Cooper, H., Hedges, L. V. & Valentine, J. C. (eds) (2009). The Handbook of Research Synthesis and Metaanalysis, 2nd edn. New York: Russell Sage Foundation.
74. Higgins, J. P. T. & Green, S. (eds) (2009) Cochrane Handbook for Systematic Reviews of Interventions, Version 5.0.2 [updated September 2009]. The Cochrane Collaboration. Available online: www.cochranehandbook.org (accessed 6 October 2009).
75. Lipsey, M. W. & Wilson, D. B. (2001) Practical Meta-analysis. Thousand Oaks, CA: Sage.
76. Bax, L., Yu, L. M., Ikeda, N., Tsuruta, N. & Moons, K. G. M. (2006) MIX: Comprehensive Free Software for Meta-analysis of Causal ResearchData, Version 1.7. Available online: http://www.mix-for-meta-analysis.info (accessed 6 October 2009).
77. Borenstein, M., Hedges, L. V., Higgins, J. & Rothstein, H. (2005) Comprehensive Meta-analysis, Version 2. Englewood, NJ: Biostat.
78. Shadish, W. R., Robinson, L. & Lu, C. (1999) ES: Effect Size Calculator. St Paul, MN: Assessment Systems Corp. Available online: http://www.assess.com/xcart/product.php?productid=226&cat=0&page=1 (accessed 6 October 2009).
79. Wilson, D. B. (2009) Macros for use with SPSS software and effect size calculation software. Available online: http://mason.gmu.edu/d̃wilsonb/ma.html (accessed 6 October 2009).