Indirect effects of fidelity to the family check-up on changes in parenting and early childhood problem behaviors

Journal of Consulting and Clinical Psychology

Volumn 81, Issue 6, 2013, Pages 962-974

  Smith, Justin D ^a   Dishion, Thomas J ^b   Shaw, Daniel S ^c   Wilson, Melvin N ^b,d  

^a UNIVERSITY OF OREGON   (United States)

^b ARIZONA STATE UNIVERSITY   (United States)

^c UNIVERSITY OF PITTSBURGH SCHOOL OF MEDICINE   (United States)

^d UNIVERSITY OF VIRGINIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AGE DISTRIBUTION; ARTICLE; BEHAVIOR DISORDER; CAREGIVER; CHILD; CHILD PARENT RELATION; CHILDHOOD DISEASE; CODING; FAMILY; FAMILY THERAPY; FEMALE; FIDELITY; HUMAN; INFANT; MAJOR CLINICAL STUDY; MALE; MEDICAL EXAMINATION; OBSERVATION; PERSONAL VALUE; PRESCHOOL CHILD; PSYCHOLOGICAL RATING SCALE; PSYCHOMETRY; RELIABILITY; VALIDITY; ADULT; CHILD BEHAVIOR DISORDERS; CONTROLLED STUDY; EDUCATION; FOLLOW UP; MARRIAGE; MOTIVATION; PATIENT ATTITUDE; PROCEDURES; PSYCHOLOGY; PSYCHOTHERAPY; RANDOMIZED CONTROLLED TRIAL;

ADULT; CHILD BEHAVIOR DISORDERS; CHILD, PRESCHOOL; EDUCATION, NONPROFESSIONAL; FAMILY THERAPY; FEMALE; FOLLOW-UP STUDIES; HUMANS; MALE; MARRIAGE; MOTIVATION; PATIENT ACCEPTANCE OF HEALTH CARE; PSYCHOTHERAPEUTIC PROCESSES; PSYCHOTHERAPY, BRIEF;

EID: 84889021078     PISSN: 0022006X     EISSN: 19392117     Source Type: Journal    
DOI: 10.1037/a0033950     Document Type: Article

References (71)

1. Aarons, G. A., Sommerfeld, D. H., Hecht, D. B., Silovsky, J. F., & Chaffin, M. J. (2009). The impact of evidence-based practice implementation and fidelity monitoring on staff turnover: Evidence for a protective effect. Journal of Consulting and Clinical Psychology, 77, 270-280. doi: 10.1037/a0013223
2. Achenbach, T. M., & Rescorla, L. A. (2001). Manual for the ASEBA school-age forms and profiles. Washington, DC: ASEBA.
3. Asparouhov, T., & Muthén, B. O. (2010). Bayesian analysis using Mplus: Technical implementation. Mplus Technical Report. Retrieved from http://www.statmodel.com
4. Barber, J. P., Crits-Christoph, P., & Luborsky, L. (1996). Effects of therapist adherence and competence on patient outcome in brief dynamic therapy. Journal of Consulting and Clinical Psychology, 64, 619-622. doi:10.1037/0022-006X.64.3.619
5. Barber, J. P., Gallop, R., Crits-Christoph, P., Frank, A., Thase, M. E., Weiss, R. D., & Connolly Gibbons, M. B. (2006). The role of therapist adherence, therapist competence, and alliance in predicting outcome of individual drug counseling: Results from the National Institute on Drug Abuse Collaborative Cocaine Treatment Study. Psychotherapy Research, 16, 229-240. doi:10.1080/10503300500288951
6. Barber, J. P., Sharpless, B. A., Klostermann, S., & McCarthy, K. S. (2007). Assessing intervention competence and its relation to therapy outcome: A selected review derived from the outcome literature. Professional Psychology: Research and Practice, 38, 493-500. doi:10.1037/0735-7028.38.5.493
7. Berkel, C., Mauricio, A. M., Schoenfelder, E. N., & Sandler, I. N. (2011). Putting the pieces together: An integrated model of program implementation. Prevention Science, 12, 23-33. doi:10.1007/s11121-010-0186-1
8. Boardman, T., Catley, D., Grobe, J. E., Little, T. D., & Ahluwalia, J. S. (2006). Using motivational interviewing with smokers: Do therapist behaviors relate to engagement and therapeutic alliance? Journal of Substance Abuse Treatment, 31, 329-339. doi:10.1016/j.jsat.2006.05 .006
9. Bradley, R. H., Corwyn, R. F., McAdoo, H. P., & Garcia-Coll, C. (2001). The home environments of children in the United States. Part I: Variations by age, ethnicity, and poverty status. Child Development, 72, 1844-1867. doi:10.1111/1467-8624.t01-1-00382
10. Brownson, R. C., Colditz, G. A., & Proctor, E. K. (Eds.). (2012). Dissemination and implementation research in health: Translating science to practice. New York, NY: Oxford University Press. doi:10.1093/acprof: oso/9780199751877.001.0001
11. Carroll, C., Patterson, M., Wood, S., Booth, A., Rick, J., & Balain, S. (2007). A conceptual framework for implementation fidelity. Implementation Science, 2, 40-48. doi:10.1186/1748-5908-2-40
12. Cicchetti, D. V. (1994). Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological Assessment, 6, 284-290. doi:10.1037/1040-3590.6.4.284
13. Connell, A. M., Dishion, T. J., Yasui, M., & Kavanagh, K. (2007). An adaptive approach to family intervention: Linking engagement in family-centered intervention to reductions in adolescent problem behavior. Journal of Consulting and Clinical Psychology, 75, 568-579. doi: 10.1037/0022-006X.75.4.568
14. Dishion, T. J., Brennan, L. M., Shaw, D. S., McEachern, A. D., Wilson, M. N., & Jo, B. (2013). Prevention of problem behavior through annual Family Check-Ups in early childhood: Intervention effects from the home to the second grade of elementary school. Journal of Abnormal Child Psychology.
15. Dishion, T. J., & Connell, A. M. (2008). An ecological approach to family intervention to prevent adolescent drug use: Linking parent engagement to long-term reductions of tobacco, alcohol and marijuana use. In N. Heinrichs, K. Hahlweg, & M. Doepfner (Eds.), Strengthening families: Evidence-based approaches to support child mental health (pp. 403-433). Munster, Ireland: Verlag fur Psychotherapie.
16. Dishion, T. J., Hogansen, J., Winter, C., & Jabson, J. M. (2004). The Coder Impressions Inventory [Unpublished coding manual]. Available from the Child and Family Center, 6217 University of Oregon, Eugene, OR 97403.
17. Dishion, T. J., Kavanagh, K., Schneiger, A., Nelson, S. E., & Kaufman, N. (2002). Preventing early adolescent substance use: A family-centered strategy for public middle school. Prevention Science, 3, 191-201. doi:10.1023/A:1019994500301
18. Dishion, T. J., Knutson, N., Brauer, L., Gill, A., & Risso, J. (2010). Family Check-Up: COACH ratings manual [Unpublished coding manual]. Available from the Child and Family Center, 6217 University of Oregon, Eugene, OR 97403.
19. Dishion, T. J., Patterson, G. R., & Kavanagh, K. (1992). An experimental test of the coercion model: Linking theory, measurement, and intervention. In J. McCord & R. Tremblay (Eds.), Preventing antisocial behavior: Interventions from birth through adolescence (pp. 253-282). New York, NY: Guilford Press.
20. Dishion, T. J., Shaw, D. S., Connell, A., Gardner, F. E. M., Weaver, C., & Wilson, M. (2008). The Family Check-Up with high-risk indigent families: Preventing problem behavior by increasing parents' positive behavior support in early childhood. Child Development, 79, 1395-1414. doi:10.1111/j.1467-8624.2008. 01195.x
21. Dishion, T. J., & Stormshak, E. A. (2007). Intervening in children's lives: An ecological, family-centered approach to mental health care. Washington, DC: American Psychological Association. doi:10.1037/11485-000
22. Elkin, I. (1988). Relationship of therapists' adherence to treatment outcome in the Treatment of Depression Collaborative Research Program. Paper presented at the annual meeting of the Society for Psychotherapy Research, Santa Fe, NM.
23. Finn, S. E., Fischer, C. T., & Handler, L. (Eds.). (2012). Collaborative/therapeutic assessment: A casebook and guide. Hoboken, NJ: Wiley.
24. Forgatch, M. S., & DeGarmo, D. S. (2011). Sustaining fidelity following the nationwide PMTO™ implementation in Norway. Prevention Science, 12, 235-246. doi:10.1007/s11121-011-0225-6
25. Forgatch, M. S., DeGarmo, D. S., & Beldavs, Z. G. (2005). An efficacious theory-based intervention for stepfamilies. Behavior Therapy, 36, 357-365. doi:10.1016/S0005-7894(05)80117-0
26. Forgatch, M. S., Patterson, G. R., & DeGarmo, D. S. (2005). Evaluating fidelity: Predictive validity for a measure of competent adherence to the Oregon Model of Parent Management Training. Behavior Therapy, 36, 3-13. doi:10.1016/S0005-7894(05)80049-8
27. Gardner, F. E. M., Shaw, D. S., Dishion, T. J., Burton, J., & Supplee, L. (2007). Randomized prevention trial for early conduct problems: Effects on proactive parenting and links to toddler disruptive behavior. Journal of Family Psychology, 21, 398-406. doi:10.1037/0893-3200.21.3.398
28. Hawley, K. M., & Weisz, J. R. (2005). Youth versus parent working alliance in usual clinical care: Distinctive associations with retention, satisfaction, and treatment outcome. Journal of Clinical Child and Adolescent Psychology, 34, 117-128. doi:10.1207/s15374424jccp3401-11
29. Henggeler, S. W., Melton, G. B., Brondino, M. J., Scherer, D. G., & Hanley, J. H. (1997). Multisystemic therapy with violent and chronic juvenile offenders and their families: The role of treatment fidelity in successful dissemination. Journal of Consulting and Clinical Psychology, 65, 821-833. doi:10.1037/0022-006X.65.5.821
30. Hettema, J., Steele, J., & Miller, W. R. (2005). Motivational Interviewing. Annual Review of Clinical Psychology, 1, 91-111. doi:10.1146/annurev .clinpsy.1.102803.143833
31. Hogue, A., Dauber, S., Stambaugh, L. F., Cecero, J. J., & Liddle, H. A. (2006). Early therapeutic alliance and treatment outcome in individual and family therapy for adolescent behavior problems. Journal of Consulting and Clinical Psychology, 74, 121-129. doi:10.1037/0022-006X .74.1.121
32. Hogue, A., Henderson, C. E., Dauber, S., Barajas, P. C., Fried, A., & Liddle, H. A. (2008). Treatment adherence, competence, and outcome in individual and family therapy for adolescent behavior problems. Journal of Consulting and Clinical Psychology, 76, 544-555. doi:10.1037/0022-006X.76.4.544
33. Horner, R. H., & Carr, E. G. (1997). Behavioral support for students with severe disabilities: Functional assessment intervention. Journal of Special Education, 31, 84-104. doi:10.1177/002246699703100108
34. Huey, S. J., Jr., Henggeler, S. W., Brondino, M. J., & Pickrel, S. G. (2000). Mechanisms of change in multisystemic therapy: Reducing delinquent behavior through therapist adherence and improved family and peer functioning. Journal of Consulting and Clinical Psychology, 68, 451-467. doi:10.1037/0022- 006X.68.3.451
35. Institute of Medicine. (2001). Crossing the quality chasm: A new health system for the 21st century. Washington, DC: National Academy Press.
36. Institute of Medicine. (2006). Adaption to mental health and addictive disorder: Improving the quality of health care for mental and substanceuse conditions. Washington, DC: National Academy Press.
37. Jabson, J. M., Dishion, T. J., Gardner, F. E. M., & Burton, J. (2004). Relationship Process Code v-2.0 training manual: A system for coding realtionship interactions [Unpublished coding manual]. Available from the Child and Family Center, 6217 University of Oregon, Eugene, OR 97403.
38. Judd, C. M., Kenny, D. A., & McClelland, G. H. (2001). Estimating and testing mediation and moderation in within-subject designs. Psychological Methods, 6, 115-134. doi:10.1037/1082-989X.6.2.115
39. Kazdin, A. E. (2003). Research design in clinical psychology (4th ed.). Boston, MA: Allyn & Bacon.
40. Knutson, N. M., Forgatch, M. S., & Rains, L. A. (2003). Fidelity of Implementation Rating System (FIMP): The training manual for PMTO. Eugene: Oregon Social Learning Center.
41. Lee, S., & Song, X. (2004). Evaluation of the Bayesian and maximum likelihood approaches in analyzing structural equation models with small sample sizes. Multivariate Behavioral Research, 39, 653-686. doi:10.1207/ s15327906mbr3904-4
42. Leichsenring, F., Salzer, S., Hilsenroth, M. J., Leibing, E., Leweke, F., & Rabung, S. (2011). Treatment integrity: An unresolved issue in psychotherapy research. Current Psychiatry Reviews, 7, 313-321. doi:10.2174/157340011797928259
43. Little, R. J. A., & Rubin, D. B. (2002). Statistical analysis with missing data (2nd ed.). New York, NY: Wiley.
44. Lunkenheimer, E. S., Dishion, T. J., Shaw, D. S., Connell, A. M., Gardner, F. E. M., Wilson, M. N., & Skuban, E. M. (2008). Collateral benefits of the Family Check-Up on early childhood school readiness: Indirect effects of parents' positive behavior support. Developmental Psychology, 44, 1737-1752. doi:10.1037/a0013858
45. MacKinnon, D. P., & Dwyer, J. H. (1993). Estimating mediated effects in prevention studies. Evaluation Review, 17, 144-158. doi:10.1177/ 0193841X9301700202
46. MacKinnon, D. P., Lockwood, C. M., Hoffman, J. M., West, S. G., & Sheets, V. (2002). A comparison of methods to test mediation and other intervening variable effects. Psychological Methods, 7, 83-104. doi: 10.1037/1082-989X.7.1.83
47. Malik, M. L., Beutler, L. E., Alimohamed, S., Gallagher-Thompson, D., & Thompson, L. (2003). Are all cognitive therapies alike? A comparison of cognitive and noncognitive therapy process and implications for the application of empirically supported treatments. Journal of Consulting and Clinical Psychology, 71, 150-158. doi:10.1037/0022-006X.71.1 .150
48. Martin, D. J., Garske, J. P., & Davis, K. M. (2000). Relation of the therapeutic alliance with outcome and other variables: A meta-analytic review. Journal of Consulting and Clinical Psychology, 68, 438-450. doi:10.1037/0022- 006X.68.3.438
49. McHugh, R. K., & Barlow, D. H. (2010). The dissemination and implementation of evidence-based psychological treatments: A review of current efforts. American Psychologist, 65, 73-84. doi:10.1037/a0018121
50. Miller, W. R., & Rollnick, S. (2002). Motivational interviewing: Preparing people for change (2nd ed.). New York, NY: Guilford Press.
51. Muthén, B. O. (2010). Bayesian analysis in Mplus: A brief introduction. Technical Report. Version 3. Los Angeles, CA: Muthén & Muthén. Retrieved from http://www.statmodel.com/
52. Muthén, L. K., & Muthén, B. O. (2012). Mplus (Version 7.0). Los Angeles, CA: Author.
53. Noldus Information Technology. (2003). The Observer XT reference manual 5.0. Wageningen, the Netherlands: Author.
54. O'Malley, S. S., Suh, C. S., & Strupp, H. H. (1983). The Vanderbilt Psychotherapy Process Scale: A report on the scale development and a process-outcome study. Journal of Consulting and Clinical Psychology, 51, 581-586. doi:10.1037/0022-006X.51.4.581
55. Patterson, G. R., & Forgatch, M. S. (1985). Therapist behavior as a determinant for client resistance: A paradox for the behavior modifier. Journal of Consulting and Clinical Psychology, 53, 846-851. doi: 10.1037/0022-006X.53.6. 846
56. Perepletchikova, F., & Kazdin, A. E. (2005). Treatment integrity and therapeutic change: Issues and research recommendations. Clinical Psychology: Science and Practice, 12, 365-383. doi:10.1093/clipsy.bpi045
57. Perepletchikova, F., Treat, T. A., & Kazdin, A. E. (2007). Treatment integrity in psychotherapy research: Analysis of the studies and examination of the associated factors. Journal of Consulting and Clinical Psychology, 75, 829-841. doi:10.1037/0022-006X.75.6.829
58. Report of the President's New Freedom Commission on Mental Health. (2004). Final report. Retrieved from http://govinfo.library.unt.edu/ mentalhealthcommission/reports/FinalReport/toc.html
59. Sandler, I. N., Schoenfelder, E. N., Wolchik, S. A., & MacKinnon, D. P. (2011). Long-term impact of prevention programs to promote effective parenting: Lasting effects but uncertain processes. Annual Review of Psychology, 62, 299-329. doi:10.1146/annurev.psych.121208.131619
60. Shaw, B. F., Elkin, I., Yamaguchi, J., Olmsted, M., Vallis, T. M., Dobson, K. S., . . . Imber, S. D. (1999). Therapist competence ratings in relation to clinical outcome in cognitive therapy of depression. Journal of Consulting and Clinical Psychology, 67, 837-846. doi:10.1037/0022-006X.67.6.837
61. Shelef, K., Diamond, G. M., Diamond, G. S., & Liddle, H. A. (2005). Adolescent and parent alliance and treatment outcome in Multidimensional Family Therapy. Journal of Consulting and Clinical Psychology, 73, 689-698. doi:10.1037/0022-006X.73.4.689
62. Shirk, S. R., & Karver, M. (2003). Prediction of treatment outcome from relationship variables in child and adolescent therapy: A meta-analytic review. Journal of Consulting and Clinical Psychology, 71, 452-464. doi:10.1037/0022-006X.71.3.452
63. Shrout, P., & Fleiss, J. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86, 420-428. doi:10.1037/0033-2909.86.2.420
64. Smith, J. D., Dishion, T. J., & Knoble, N. (2013). An experimental study of the psychometric properties of a fidelity of implementation rating system for the Family Check-Up. Manuscript submitted for publication.
65. Smith, J. D., Handler, L., & Nash, M. R. (2010). Therapeutic Assessment for preadolescent boys with oppositional-defiant disorder: A replicated single-case time-series design. Psychological Assessment, 22, 593-602. doi:10.1037/a0019697
66. Smith, J. D., Stormshak, E. A., & Kavanagh, K. (2013). Results of a randomized trial implementing the Family Check-Up in community mental health agencies. Manuscript submitted for publication.
67. Spoth, R. L., & Redmond, C. (2000). Research on family engagement in preventive interventions: Toward improved use of scientific findings in primary prevention practice. The Journal of Primary Prevention, 21, 267-284. doi:10.1023/A:1007039421026
68. Svartberg, M., & Stiles, T. C. (1994). Therapeutic alliance, therapist competence, and client change in short-term anxiety-provoking psychotherapy. Psychotherapy Research, 4, 20-33. doi:10.1080/ 10503309412331333872
69. Tharinger, D. J., Finn, S. E., Hersh, B., Wilkinson, A. D., Christopher, G., & Tran, A. (2008). Assessment feedback with parents and preadolescent children: A collaborative approach. Professional Psychology: Research and Practice, 39, 600-609. doi:10.1037/0735-7028.39.6.600
70. Waltz, J., Addis, M. E., Koerner, K., & Jacobson, N. S. (1993). Testing the integrity of a psychotherapy protocol: Assessment of adherence and competence. Journal of Consulting and Clinical Psychology, 61, 620-630. doi:10.1037/0022-006X.61.4.620
71. Yuan, Y., & MacKinnon, D. P. (2009). Bayesian mediation analysis. Psychological Methods, 14, 301-322. doi:10.1037/a0016972