Evaluating the Impact of Implementation Factors on Family-Based Prevention Programming: Methods for Strengthening Causal Inference

Prevention Science

Volumn 15, Issue 2, 2014, Pages 246-255

  Crowley, D Max ^a   Coffman, Donna L ^b   Feinberg, Mark E ^b   Greenberg, Mark T ^b   Spoth, Richard L ^c  

^a DUKE UNIVERSITY   (United States)

^b PENNSYLVANIA STATE UNIVERSITY   (United States)

^c IOWA STATE UNIVERSITY   (United States)

Author keywords

Causal inference; Family based intervention; Implementation science; Potential outcomes framework; Propensity scores

Indexed keywords

ADOLESCENT; ADOLESCENT BEHAVIOR; CONTROLLED STUDY; FEMALE; HEALTH PROMOTION; HUMAN; MALE; ORGANIZATION AND MANAGEMENT; OUTCOME ASSESSMENT; PROCEDURES; PROGRAM EVALUATION; PSYCHOLOGY; PUBLIC RELATIONS; RANDOMIZED CONTROLLED TRIAL; RISK REDUCTION; SCHOOL HEALTH SERVICE; SUBSTANCE-RELATED DISORDERS;

ADOLESCENT; ADOLESCENT BEHAVIOR; COMMUNITY-INSTITUTIONAL RELATIONS; FEMALE; HEALTH PROMOTION; HUMANS; MALE; OUTCOME ASSESSMENT (HEALTH CARE); PROGRAM EVALUATION; RISK REDUCTION BEHAVIOR; SCHOOL HEALTH SERVICES; SUBSTANCE-RELATED DISORDERS;

EID: 84897023845     PISSN: 13894986     EISSN: None     Source Type: Journal    
DOI: 10.1007/s11121-012-0352-8     Document Type: Article

References (61)

1. Albin, J. B., Lee, B., Dumas, J., Slater, J., & Witmer, J. (1985). Parent training with Canadian families. Canada's Mental Health, December, 20-24.
2. August, G. J., Bloomquist, M. L., Lee, S. S., Realmuto, G. M., & Hektner, J. M. (2006). Can evidence-based prevention programs be sustained in community practice settings? The Early Risers' Advanced-Stage effectiveness trial. Prevention Science, 7, 151-165. doi: 10. 1007/s11121-005-0024-z.
3. Berkel, C., Mauricio, A. M., Schoenfelder, E., & Sandler, I. N. (2010). Putting the pieces together: An integrated model of program implementation. Prevention Science, 12, 23-33. doi: 10. 1007/s11121-010-0186-1.
4. Brody, G. H., Murry, V. M., Chen, Y.-f., Kogan, S. M., & Brown, A. C. (2006). Effects of family risk factors on dosage and efficacy of a family-centered preventive intervention for rural African Americans. Prevention Science, 7, 281-291. doi: 10. 1007/s11121-006-0032-7.
5. Carroll, C., Patterson, M., Wood, S., Booth, A., Rick, J., & Balain, S. (2007). A conceptual framework for implementation fidelity. Implementation Science, 2, 40. doi: 10. 1186/1748-5908-2-40.
6. Chilenski, S. M., & Greenberg, M. T. (2009). The importance of the community context in the epidemiology of early adolescent substance use and delinquency in a rural sample. American Journal of Community Psychology, 44, 287-301. doi: 10. 1007/s10464-009-9258-4.
7. Coffman, D. L. (2011). Estimating causal effects in mediation analysis using propensity scores. Structural Equation Modeling, 18, 357-369.
8. Cohen, J. (1992). A power primer. Psychological Bulletin, 112, 155-159. doi: 10. 1037/0033-2909. 112. 1. 155.
9. Collins, L. M., Murphy, S. A., Nair, V. N., & Strecher, V. J. (2005). A strategy for optimizing and evaluating behavioral interventions. Annals of Behavioral Medicine, 30, 65-73. doi: 10. 1207/s15324796abm3001_8.
10. Connell, A. M., Dishion, T. J., Yasui, M., & Kavanagh, K. (2007). An adaptive approach to family intervention: Linking engagement in family-centered intervention to reductions in adolescent problem behavior. Journal of Consulting and Clinical Psychology, 75, 568-579. doi: 10. 1037/0022-006X. 75. 4. 568.
11. D'Agostino, R. B. (1998). Propensity score methods for bias reduction in the comparison of a treatment to a non-randomized control group. Statistics in Medicine, 17, 2265-2281.
12. D'Agostino, R. B., & Rubin, D. B. (2000). Estimating and using propensity scores with partially missing data. Journal of the American Statistical Association, 95, 749-759.
13. Domitrovich, C. E., Gest, S. D., Jones, D., Gill, S., & DeRousie, R. M. S. (2010). Implementation quality: Lessons learned in the context of the Head Start REDI trial. Early Childhood Research Quarterly, 25, 284-298. doi: 10. 1016/j. ecresq. 2010. 04. 001.
14. Dumas, J. E., Moreland, A. D., Gitter, A. H., Pearl, A. M., & Nordstrom, A. H. (2006a). Engaging parents in preventive parenting groups: Do ethnic, socioeconomic, and belief match between parents and group leaders matter? Health Education & Behavior, 35, 619-633. doi: 10. 1177/1090198106291374.
15. Dumas, J. E., Nissley-Tsiopinis, J., & Moreland, A. D. (2006b). From intent to enrollment, attendance, and participation in preventive parenting groups. Journal of Child and Family Studies, 16, 1-26. doi: 10. 1007/s10826-006-9042-0.
16. Durlak, J. A., & DuPre, E. P. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41, 327-350. doi: 10. 1007/s10464-008-9165-0.
17. Elliott, D. S., & Mihalic, S. (2004). Issues in disseminating and replicating effective prevention programs. Prevention Science, 5, 47-53. doi: 10. 1023/B: PREV. 0000013981. 28071. 52.
18. Flay, B. R., Biglan, A., Boruch, R. F., Castro, F. G., Gottfredson, D., Kellam, S., et al. (2005). Standards of evidence: Criteria for efficacy, effectiveness and dissemination. Prevention Science, 6, 151-175. doi: 10. 1007/s11121-005-5553-y.
19. Foster, M. (2003). Propensity score matching: An illustrative analysis of dose response. Medical Care, 41, 1183-1192.
20. Glasgow, R. E., Vogt, T. M., & Boles, S. M. (1999). Evaluating the public health impact of health promotion interventions: The RE-AIM framework. American Journal of Public Health, 89, 1322-1327. doi: 10. 2105/AJPH. 89. 9. 1322.
21. Glasgow, R. E., McKay, H. G., Piette, J. D., & Reynolds, K. D. (2001). The RE-AIM framework for evaluating interventions: What can it tell us about approaches to chronic illness management? Patient Education and Counseling, 44, 119-127. doi: 10. 1016/S0738-3991(00)00186-5.
22. Graczyk, P., Domitrovich, C., & Zins, J. (2007). Facilitating the implementation of evidence-based prevention and mental health promotion efforts in schools. In M. Weist (Ed.), Handbook of school mental health: Advancing practice and research. New York: Springer.
23. Graham, J. W., Olchowski, A. E., & Gilreath, T. D. (2007). How many imputations are really needed? Some practical clarifications of multiple imputation theory. Prevention Science, 8, 206-213. doi: 10. 1007/s11121-007-0070-9.
24. Harder, V. S., Stuart, E. A., & Anthony, J. C. (2008). Adolescent cannabis problems and young adult depression: Male-female stratified propensity score analyses. American Journal of Epidemiology, 168, 592-601.
25. Harder, V. S., Stuart, E. A., & Anthony, J. C. (2010). Propensity score techniques and the assessment of measured covariate balance to test causal associations in psychological research. Psychological Methods, 15, 234-249.
26. Hill, J. L., Brooks-Gunn, J., & Waldfogel, J. (2003). Sustained effects of high participation in an early intervention for low-birth-weight premature infants. Developmental Psychology, 39, 730-744.
27. Hirano, K., & Imbens, G. (2001). Estimation of causal effects using propensity score weighting: An application to data on right heart catherization. Health Services and Outcome Research Methodology, 2, 259-278.
28. Holden, G., Rosenberg, G., Barker, K., Tuhrim, S., & Brenner, B. (1993). The recruitment of research participants: A review. Social Work in Health Care, 19, 1-44.
29. Holland, P. W. (1986). Statistics and causal inference. Journal of the American Statistical Association, 81, 945-970.
30. Imbens, G. W. (2000). The role of the propensity score in estimating dose-response functions. Biometrika, 87, 706-710.
31. Kam, C., Greenberg, M., & Walls, C. (2003). Examining the role of implementation quality in school-based prevention using the PATHS curriculum. Prevention Science, 4, 55-63.
32. Littell, R., Milliken, G., Stroup, W., Wolfinger, R., & Schabenberger, O. (2006). SAS for mixed models (2nd ed.). Cary: SAS Institute.
33. Little, R., & Rubin, D. (2002). Statistical analysis with missing data (2nd ed.). New York: John Wiley.
34. Luellen, J. K., Shadish, W. R., & Clark, M. H. (2005). Propensity scores: An introduction and experimental test. Evaluation Review, 29, 530-558.
35. McGowan, M., Nix, R., Murphy, S., Bierman, K., & Conduct Problems Prevention Research Group. (2010). Investigating the impact of selection bias in dose-response analyses of preventive interventions. Prevention Science, 11, 239-251.
36. Prinz, R. J., & Miller, G. E. (1994). Family-based treatment for childhood antisocial behavior: Experimental influences on dropout and engagement. Journal of Clinical Child Psychology, 62, 645-650.
37. Redmond, C., Spoth, R. L., Shin, C., Schainker, L. M., Greenberg, M. T., & Feinberg, M. (2009). Long-term protective factor outcomes of evidence-based interventions implemented by community teams through a community-university partnership. The Journal of Primary Prevention, 30, 513-530. doi: 10. 1007/s10935-009-0189-5.
38. Robins, J., Hernan, M. A., & Brumback, B. (2000). Marginal structural models and causal inference in epidemiology. Epidemiology, 11, 550-560.
39. Rohrbach, L. A., Hodgson, C. S., Broder, B. I., Montgomery, S. B., Flay, B. R., Hansen, W. B., et al. (1994). Parental participation in drug abuse prevention: Results from the midwestern prevention project. Journal of Research on Adolescence, 4, 295-317. doi: 10. 1207/s15327795jra0402_7.
40. Rosenbaum, P. R., & Rubin, D. B. (1983). The central role of the propensity score in observational studies for causal effects. Biometrika, 70, 41-55.
41. Rubin, D. B. (2005). Causal inference using potential outcomes. Journal of the American Statistical Association, 100, 322-331. doi: 10. 1198/016214504000001880.
42. Sampson, R. J., Sharkey, P., & Raudenbush, S. W. (2008). From the cover: Inaugural article: Durable effects of concentrated disadvantage on verbal ability among African-American children. Proceedings of the National Academy of Sciences, 105, 845-852. doi: 10. 1073/pnas. 0710189104.
43. SAS Institute Inc. (2004). SAS/STAT 9. 1 user's guide. Cary: SAS Institute Inc.
44. Schafer, J. L., & Graham, J. W. (2002). Missing data: Our view of the state of the art. Psychological Methods, 7, 147-177. doi: 10. 1037/1082-989X. 7. 2. 147.
45. Schafer, J. L., & Kang, J. D. Y. (2008). Average causal effects from non-randomized studies: A practical guide and simulated example. Psychological Methods, 13, 279-313.
46. Spoth, R., & Greenberg, M. (2011). Impact challenges in community science-with-practice: Lessons from PROSPER on transformative practitioner-scientist partnerships and prevention infrastructure development. American Journal of Community Psychology, 48, 106-119. doi: 10. 1007/s10464-010-9417-7.
47. Spoth, R., & Redmond, C. (1995). Parent motivation to enroll in parenting skills programs: A model of family context and health belief predictors. Journal of Family Psychology, 9, 294-310.
48. Spoth, R., Redmond, C., Kahn, J., & Shin, C. (1997). A prospective validation study of inclination, belief, and context predictors of family-focused prevention involvement. Family Process, 36, 403-429.
49. Spoth, R., Redmond, C., & Shin, C. (2000a). Modeling factors influencing enrollment in family-focused preventive intervention research. Prevention Science, 1, 213-225.
50. Spoth, R., Redmond, C., & Shin, C. (2000b). Reducing adolescents' aggressive and hostile behaviors: Randomized trial effects of a brief family intervention 4 years past baseline. Archives of Pediatrics & Adolescent Medicine, 154, 1248-1257.
51. Spoth, R., Greenberg, M., Bierman, K., & Redmond, C. (2004). Prosper community-university partnership model for public education systems: Capacity-building for evidence-based, competence-building prevention. Prevention Science, 5, 31-39. doi: 10. 1023/B: PREV. 0000013979. 52796. 8b.
52. Spoth, R., Guyll, M., Lillehoj, C. J., Redmond, C., & Greenberg, M. (2007). Prosper study of evidence-based intervention implementation quality by community-university partnerships. Journal of Community Psychology, 35, 981-999. doi: 10. 1002/jcop. 20207.
53. Spoth, R., Redmond, C., Shin, C., Greenberg, M., Clair, S., & Feinberg, M. (2007). Substance-use outcomes at 18 months past baseline. American Journal of Preventive Medicine, 32, 395-402. doi: 10. 1016/j. amepre. 2007. 01. 014.
54. Spoth, R., Guyll, M., Redmond, C., Greenberg, M., & Feinberg, M. (2011). Six-year sustainability of evidence-based intervention implementation quality by community-university partnerships: The PROSPER study. American Journal of Community Psychology, 48, 412-425. doi: 10. 1007/s10464-011-9430-5.
55. Spreewenberg, M., Bartak, A., Croon, M., Hagenaars, J., Buschblach, J., Andrea, H., et al. (2010). The multiple propensity score as control for bias in the comparison of more than two treatment arms. Medical Care, 48, 166-174.
56. Stuart, E. A., Perry, D. F., Le, H.-N., & Ialongo, N. S. (2008). Estimating intervention effects of prevention programs: Accounting for noncompliance. Prevention Science, 9, 288-298. doi: 10. 1007/s11121-008-0104-y.
57. Taylor, B., Graham, J., Cumsille, P., & Hansen, W. (2000). Modeling prevention program effects on growth in substance use analysis of data from the adolescent alcohol prevention trial. Prevention Science, 4, 183-197. doi: 10. 1023/A: 1026547128209.
58. Toomey, T. L., Williams, C. L., Perry, C. L., Murray, D. M., Dudoritz, B., & Veblen-Mortenson, S. (1996). An alcohol primary prevention program for parents of 7th graders: The amazing alternatives! Home Program. Journal of Child and Adolescent Substance Abuse, 5, 35-53.
59. Vanderweele, T. J. (2008). Ignorability and stability assumptions in neighborhood effects research. Statistics in Medicine, 27, 1934-1943. doi: 10. 1002/sim. 3139.
60. Williams, C. L., Perry, C. L., Dudovitz, B., Veblen-Mortenson, S., Anstine, P. S., Komro, K. A., et al. (1995). A home-based prevention program for sixth-grade alcohol use: Results from Project Northland. Journal of Primary Prevention, 16, 125-147.
61. Winslow, E. B., Bonds, D., Wolchik, S., Sandler, I., & Braver, S. (2009). Predictors of enrollment and retention in a preventive parenting intervention for divorced families. The Journal of Primary Prevention, 30, 151-172. doi: 10. 1007/s10935-009-0170-3.