Methods for Synthesizing Findings on Moderation Effects Across Multiple Randomized Trials

Prevention Science

Volumn 14, Issue 2, 2013, Pages 144-156

  Brown, C Hendricks ^a   Sloboda, Zili ^b   Faggiano, Fabrizio ^c   Teasdale, Brent ^d   Keller, Ferdinand ^e   Burkhart, Gregor ^f   Vigna Taglianti, Federica ^g   Howe, George ^h   Masyn, Katherine ⁱ   Wang, Wei ^j   Muthén, Bengt ^k   Stephens, Peggy ^l   Grey, Scott ^m   Perrino, Tatiana ^a  

^a UNIVERSITY OF MIAMI MILLER SCHOOL OF MEDICINE   (United States)

^b JBS International   (United States)

^c UNIVERSITY OF EASTERN PIEDMONT   (Italy)

^d GEORGIA STATE UNIVERSITY   (United States)

^e UNIVERSITY OF ULM   (Germany)

^f EUROPEAN MONITORING CENTRE FOR DRUGS AND DRUG ADDICTION   (Portugal)

^g Piedmont Centre for Drug Addiction Epidemiology   (Italy)

^h GEORGE WASHINGTON UNIVERSITY   (United States)

ⁱ HARVARD UNIVERSITY   (United States)

^j UNIVERSITY OF SOUTH FLORIDA   (United States)

^k UNIVERSITY OF CALIFORNIA   (United States)

^l UNIVERSITY OF AKRON   (United States)

^m KENT STATE UNIVERSITY   (United States)

more..

Author keywords

Integrative data analysis; Meta analysis; Parallel data analysis; Subgroup analyses; Variation in impact

Indexed keywords

EID: 84875602649     PISSN: 13894986     EISSN: None     Source Type: Journal    
DOI: 10.1007/s11121-011-0207-8     Document Type: Article

References (75)

1. Asparouhov, T., & Muthén, B. O. (2008). Multilevel mixture models. In G. R. Hancock & K. M. Samuelsen (Eds.), Advances in latent variable mixture models (pp. 27-51). Charlotte, NC: Information Age.
2. Barker, L. E., Luman, E. T., McCauley, M. M., & Chu, S. Y. (2002). Assessing equivalence: An alternative to the use of difference tests for measuring disparities in vaccination coverage. American Journal of Epidemiology, 156, 1056-1061.
3. Bauer, D. J., & Hussong, A. M. (2009). Psychometric approaches for developing commensurate measures across independent studies: Traditional and new models. Psychological Methods, 14, 101-125.
4. Benjamini, Y., & Hochberg, Y. (1995). Controlling the false discovery rate-a practical and powerful approach to multiple testing. Journal of the Royal Statistical Society Series B-(Statistical Methodology), 57, 289-300.
5. Berlin, J. A., Santanna, J., Schmid, C. H., Szczech, L. A., & Feldman, H. I. (2002). Individual patient-versus group-level data meta-regressions for the investigation of treatment effect modifiers: Ecological bias rears its ugly head. Statistics in Medicine, 21, 371-387.
6. Bridge, J. A., Iyengar, S., Salary, C. B., Barbe, R. P., Birmaher, B., Pincus, H. A., et al. (2007). Clinical response and risk for reported suicidal ideation and suicide attempts in pediatric antidepressant treatment: A meta-analysis of randomized controlled trials. Journal of the American Medical Association, 297, 1683-1696.
7. Brown, C. H. (1993). Analyzing preventive trials with generalized additive models. American Journal of Community Psychology, 21, 635-664.
8. Brown, C. H., & Liao, J. (1999). Principles for designing randomized preventive trials in mental health: An emerging developmental epidemiology paradigm. American Journal of Community Psychology, 27, 673-710.
9. Brown, E. C., Hawkins, J. D., Arthur, M. W., Briney, J. S., & Abbott, R. D. (2007). Effects of Communities That Care on prevention services systems: Findings from the community youth development study at 1. 5 years. Prevention Science, 8, 180-191.
10. Brown, C. H., Wang, W., Kellam, S. G., Muthén, B. O., Petras, H., Toyinbo, P., et al. (2008a). Methods for testing theory and evaluating impact in randomized field trials: Intent-to-treat analyses for integrating the perspectives of person, place, and time. Drug and Alcohol Dependence, 95, S74-S104.
11. Brown, C. H., Wang, W., & Sandler, I. (2008b). Examining how context changes intervention impact: The use of effect sizes in multilevel meta-analysis. Child Development Perspectives, 2, 198-205.
12. Coie, J. D., Watt, N. F., West, S. G., Hawkins, J. D., Asarnow, J. R., Markman, H. J., et al. (1993). The science of prevention: A conceptual framework and some directions for a national research program. American Psychologist, 48, 1013-1022.
13. Cook, T. D. (1992). Meta-analysis for explanation: A casebook. New York: Russell Sage.
14. Cooper, H. (1999). Synthesizing research: A guide for literature reviews (3rd ed.). Thousand Oaks, CA: Sage.
15. Cooper, H. M. (2010). Research synthesis and meta-analysis: A step-by-step approach (4th ed.). Los Angeles: Sage.
16. Cooper, H., & Patall, E. A. (2009). The relative benefits of meta-analysis conducted with individual participant data versus aggregated data. Psychological Methods, 14, 165-176.
17. Cooper, H. M., Hedges, L. V., & Valentine, J. C. (2009). The handbook of research synthesis and meta-analysis (2nd ed.). New York: Russell Sage.
18. Curran, P. J., & Hussong, A. M. (2009). Integrative data analysis: The simultaneous analysis of multiple data sets. Psychological Methods, 14, 81-100.
19. Curran, P. J., Hussong, A. M., Cai, L., Huang, W., Chassin, L., Sher, K. J., et al. (2008). Pooling data from multiple longitudinal studies: The role of item response theory in integrative data analysis. Developmental Psychology, 44, 365-380.
20. DerSimonian, R., & Laird, N. (1986). Meta-analysis in clinical trials. Controlled Clinical Trials, 7, 177-188.
21. Dillman Carpentier, F. R., Mauricio, A. M., Gonzales, N. A., Millsap, R. E., Meza, C. M., Dumka, L. E., et al. (2007). Engaging Mexican origin families in a school-based preventive intervention. Journal of Primary Prevention, 28, 521-546.
22. Dishion, T. J., Spracklen, K. M., Andrews, D. W., & Patterson, G. R. (1996). Deviancy training in male adolescents friendships. Behavior Therapy, 27, 373-390.
23. Dishion, T. J., McCord, J., & Poulin, F. (1999). When interventions harm. Peer groups and problem behavior. American Psychologist, 54, 755-764.
24. Dishion, T. J., Burraston, B., & Poulin, F. (2001). Peer group dynamics associated with iatrogenic effects in group interventions with high-risk young adolescents. In C. Erdley & D. W. Nangle (Eds.), Damon's new directions in child development: The role of friendship in psychological adjustment (pp. 79-92). San Francisco: Jossey-Bass.
25. Dolan, L. J., Kellam, S. G., Brown, C. H., Werthamer-Larsson, L., Rebok, G. W., Mayer, L. S., et al. (1993). The short-term impact of two classroom-based preventive interventions on aggressive and shy behaviors and poor achievement. Journal of Applied Developmental Psychology, 14, 317-345.
26. Durlak, J. A., & Wells, A. M. (1997). Primary prevention mental health programs for children and adolescents: A meta-analytic review. American Journal of Community Psychology, 25, 115-152.
27. Elliott, D. S., & Mihalic, S. (2004). Issues in disseminating and replicating effective prevention programs. Prevention Science, 5, 47-53.
28. Ennett, S. T., Tobler, N. S., Ringwalt, C. L., & Flewelling, R. L. (1994). How effective is drug abuse resistance education? A meta-analysis of Project DARE outcome evaluations. American Journal of Public Health, 84, 1394-1401.
29. Faggiano, F., Vigna-Taglianti, F., Versino, E., Zambon, A., Borraccino, A., & Lemma, P. (2005). School-based prevention for illicit drugs' use. Cochrane Database of Systematic Reviews, 2, Art. No.: CD003020.
30. Faggiano, F., Vigna-Taglianti, F. D., Versino, E., Zambon, A., Borraccino, A., & Lemma, P. (2008). School-based prevention for illicit drugs use: A systematic review. Preventive Medicine, 46, 385-396.
31. Flay, B. R., Biglan, A., Boruch, R. F., Castro, F. G., Gottfredson, D., Kellam, S., et al. (2005). Standards of evidence: Criteria for efficacy, effectiveness and dissemination. Prevention Science, 6, 151-175.
32. Fournier, J. C., DeRubeis, R. J., Hollen, S. D., Dimdjian, S., Amsterdam, J. D., Shelton, R. C., et al. (2010). Antidepressant drug effects and depression severity: Patient-level meta-analysis. Journal of the American Medical Association, 303, 47-53.
33. Glass, G. V. (1976). Primary, secondary, and meta-analysis of research. Educational Researcher, 5, 3-8.
34. Glass, G. V. (1977). Integrating findings: The meta-analysis of research. Review of Research in Education, 5, 351-379.
35. Glass, T. A., & McAtee, M. J. (2006). Behavioral science at the crossroads in public health: Extending horizons, envisioning the future. Social Science & Medicine, 62, 1650-1671.
36. Glass, G. V., & Smith, M. L. (1978). Meta-analysis of research on the relationship of class-size and achievement: The Class Size and Instruction Project. National Institute of Education (DHEW), Washington, DC.
37. Glass, G. V., McGaw, B., & Smith, M. L. (1981). Meta-analysis in social research. Beverly Hills, CA: Sage.
38. Hastie, T., & Tibshirani, R. (1990). Generalized additive models (1st ed.). London: Chapman and Hall.
39. Hedges, L. V., & Olkin, I. (1985). Statistical methods for meta-analysis. Orlando, FL: Academic.
40. Higgins, J. P. T., & Green, S. (Eds.). (2008). Cochrane Handbook for Systematic Reviews of Interventions Version 5. 0. 2 [updated September 2009]: The Cochrane Collaboration. Retrieved from http://www. cochrane-handbook. org.
41. Higgins, J. P., Whitehead, A., Turner, R. M., Omar, R. Z., & Thompson, S. G. (2001). Meta-analysis of continuous outcome data from individual patients. Statistics in Medicine, 20, 2219-2241.
42. Hofer, S. M., & Piccinin, A. M. (2009). Integrative data analysis through coordination of measurement and analysis protocol across independent longitudinal studies. Psychological Methods, 14, 150-164.
43. Horowitz, J. L., & Garber, J. (2006). The prevention of depressive symptoms in children and adolescents: A meta-analytic review. Journal of Consulting and Clinical Psychology, 74, 401-415.
44. Howe, G. W., Reiss, D., & Yuh, J. (2002). Can prevention trials test theories of etiology? Development and Psychopathology, 14, 673-693.
45. Hussong, A., Cai, L., Curran, P., Flora, D., Chassin, L., & Zucker, R. (2008). Disaggregating the distal, proximal, and time-varying effects of parent alcoholism on children's internalizing symptoms. Journal of Abnormal Child Psychology, 36, 335-346.
46. Ialongo, N. S., Werthamer, L., Kellam, S. G., Brown, C. H., Wang, S., & Lin, Y. (1999). Proximal impact of two first-grade preventive interventions on the early risk behaviors for later substance abuse, depression, and antisocial behavior. American Journal of Community Psychology, 27, 599-641.
47. Ialongo, N., Poduska, J., Werthamer, L., & Kellam, S. (2001). The distal impact of two first-grade preventive interventions on conduct problems and disorder in early adolescence. Journal of Emotional & Behavioral Disorders, 9, 146-160.
48. Jané-Llopis, E., Hosman, C., Jenkins, R., & Anderson, P. (2003). Predictors of efficacy in depression prevention programmes. Meta-analysis. British Journal of Psychiatry, 183, 384-397.
49. Kellam, S. G., & Langevin, D. J. (2003). A framework for understanding "evidence" in prevention research and programs. Prevention Science, 4, 137-153.
50. Kellam, S. G., Koretz, D., & Moscicki, E. K. (1999). Core elements of developmental epidemiologically based prevention research. American Journal of Community Psychology, 27, 463-482.
51. Kellam, S. G., Brown, C. H., Poduska, J. M., Ialongo, N. S., Wang, W., Toyinbo, P., et al. (2008). Effects of a universal classroom behavior management program in first and second grades on young adult behavioral, psychiatric, and social outcomes. Drug and Alcohol Dependence, 95, S5-S28.
52. Klein, A., & Moosbrugger, H. (2000). Maximum likelihood estimation of latent interaction effects with the LMS method. Psychometrika, 65, 457-474.
53. Klein, A. G., & Muthén, B. (2006). Modeling heterogeneity of growth depending on initial status. Journal of Educational and Behavioral Statistics, 31, 357-375.
54. Kraemer, H. C., Wilson, G. T., Fairburn, C. G., Agras, W. S., Kraemer, H. C., Wilson, G. T., et al. (2002). Mediators and moderators of treatment effects in randomized clinical trials. Archives of General Psychiatry, 59, 877-883.
55. Lipsey, M. W. (2003). Those confounded moderators in meta-analysis: Good, bad, and ugly. Annals of the American Academy of Political and Social Science, 587, 69-81.
56. Mosteller, F., & Colditz, G. A. (1996). Understanding research synthesis (meta-analysis). Annual Review of Public Health, 17, 1-23.
57. Muthén, B. (2001). Latent variable mixture modeling. In G. A. Marcoulides & R. E. Schumacker (Eds.), New developments and techniques in structural equation modeling (pp. 1-33). Hillsdale, NJ: Lawrence Erlbaum Associates.
58. Muthén, B., & Asparouhov, T. (2003a). Advances in latent variable modeling, Part I: Integrating multilevel and structural equation modeling using Mplus. Manucript in Preparation.
59. Muthén, B., & Asparouhov, T. (2003b). Modeling interactions between latent and observed continuous variables using maximum-likelihood estimation in Mplus. Mplus Web Notes, #6. Retrieved from http://www. statmodel. com/download/webnotes/webnote6. pdf.
60. Muthén, B. O., & Asparouhov, T. (2008). Growth mixture modeling: Analysis with non-Gaussian random effects. In G. Fitzmaurice, M. Davidian, G. Verbeke, & G. Molenberghs (Eds.), Longitudinal data analysis: A handbook of modern statistical methods (pp. 143-165). Boca Raton, FL: Chapman & Hall/CRC.
61. Muthén, B. O., & Asparouhov, T. (2009). Multilevel regression mixture analysis. Journal of the Royal Statistical Society, 172, 639-657.
62. Muthén, L. K., & Muthén, B. O. (1999). Mplus user's guide version 2 (2nd ed.). Los Angeles: Authors.
63. Muthén, B., & Muthén, L. K. (2000). Integrating person-centered and variable-centered analyses: Growth mixture modeling with latent trajectory classes. Alcoholism: Clinical & Experimental Research, 24, 882-891.
64. Muthén, L. K., & Muthén, B. O. (2007). Mplus: Statistical analysis with latent variables: User's guide (4th ed.). Los Angeles: Authors.
65. Muthén, B. O., & Shedden, K. (1999). Finite mixture modeling with mixture outcomes using the EM algorithm. Biometrics, 55, 463-469.
66. O'Connell, M. E., Boat, T., & Warner, K. E. (Eds.). (2009). Mental, emotional, and behavioral disorders among young people: Progress and possibilities. Washington, DC: National Academy.
67. Shadish, W. R., & Sweeney, R. B. (1991). Mediators and moderators in meta-analysis: There's a reason we don't let dodo birds tell us which psychotherapies should have prizes. Journal of Consulting and Clinical Psychology, 59, 883-893.
68. Shrout, P. E. (2009). Short and long views of integrative data analysis: Comments on contributions to the special issue. Psychological Methods, 14, 177-181.
69. Sloboda, Z., Stephens, R. C., Stephens, P. C., Grey, S. F., Teasdale, B., Hawthorne, R. D., et al. (2009). The Adolescent Substance Abuse Prevention Study: A randomized field trial of a universal substance abuse prevention program. Drug and Alcohol Dependence, 102, 1-10.
70. Smith, M. L., & Glass, G. V. (1977). Meta-analysis of psychotherapy outcome studies. American Psychologist, 32, 752-760.
71. Tein, J.-Y., Sandler, I. N., MacKinnon, D. P., & Wolchik, S. A. (2004). How did it work? Who did it work for? Mediation in the context of a moderated prevention effect for children of divorce. Journal of Consulting & Clinical Psychology, 72, 617-624.
72. Tobler, N. S. (1986). Meta-analysis of 143 adolescent drug prevention programs: Quantitative outcome results of program participants compared to a control or comparison group. Journal of Drug Issues, 16, 537-567.
73. van Horn, M. L., Jaki, T., Masyn, K., Ramey, S. L., Smith, J. A., & Antaramian, S. (2009). Detecting differential effects: Applying regression mixture models to identify variations in the influence of family resources on academic achievement. Developmental Psychology, 45, 1298-313.
74. Wilson, D. B., & Lipsey, M. W. (2003). The role of method in treatment effectiveness research: Evidence from meta-analysis. In A. E. Kazdin (Ed.), Methodological issues & strategies in clinical research (3rd ed., pp. 589-615). Washington, DC: American Psychological Association.
75. Wolchik, S., Sandler, I., Weiss, L., & Winslow, E. (2007). New Beginnings: An empirically-based intervention program for divorced mothers to help children adjust to divorce. In J. M. Briesmeister & C. E. Schaefer (Eds.), Handbook of parent training: Helping parents prevent and solve problem behaviors (3rd ed., pp. 25-66). Hoboken, NJ: John Wiley & Sons.