Methodological challenges of characterizing usual care psychotherapeutic practice

Administration and Policy in Mental Health and Mental Health Services Research

Volumn 37, Issue 3, 2010, Pages 208-220

  Garland, Ann F ^a,b   Hurlburt, Michael S ^a,c   Brookman Frazee, Lauren ^a,b   Taylor, Robin M ^a,b   Accurso, Erin C ^a,b  

^a RADY CHILDREN'S HOSPITAL   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

Psychotherapy; Research methods; Usual care

Indexed keywords

ARTICLE; HEALTH CARE QUALITY; HEALTH SERVICES RESEARCH; HUMAN; MENTAL HEALTH SERVICE; METHODOLOGY; ORGANIZATION AND MANAGEMENT; PSYCHOTHERAPY; REPRODUCIBILITY;

COMMUNITY MENTAL HEALTH SERVICES; HEALTH SERVICES RESEARCH; HUMANS; PSYCHOTHERAPY; QUALITY INDICATORS, HEALTH CARE; REPRODUCIBILITY OF RESULTS; RESEARCH DESIGN;

EID: 77955410751     PISSN: 0894587X     EISSN: 15733289     Source Type: Journal    
DOI: 10.1007/s10488-009-0237-8     Document Type: Article

References (64)

1. Aarons, G. A. (2004). Mental health provider attitudes toward adoption of evidence-based practice: The Evidence-Based Practice Attitude Scale (EBPAS). Mental Health Services Research, 6, 61-74.
2. Aarons, G. A., & Sawitzky, A. (2006). Organizational climate mediates the effect of culture on work attitudes and turnover in mental health services. Administration and Policy in Mental Health and Mental Health Services Research, 33, 289-301.
3. Addis, M. E., & Krasnow, A. D. (2000). A national survey of practicing psychologists' attitudes toward psychotherapy treatment manuals. Journal of Consulting and Clinical Psychology, 68, 331-339.
4. American Psychological Association. (2002). Ethical principles of psychologists and code of conduct. American Psychologist, 57, 1060-1073.
5. Baumann, B. L., Kolko, D. J., Collins, K., & Herschell, A. D. (2006). Understanding practitioners' characteristics and perspectives prior to the dissemination of an evidence-based intervention. Child Abuse and Neglect, 30, 771-787.
6. Bearsley-Smith, C., Sellick, K., Chesters, J., Francis, K., & Gippsland Adolescent Depression Research Group. (2008). Treatment content in child and adolescent mental health services: Development of the treatment recording sheet. Administration and Policy Mental Health, 35, 423-435.
7. Beutler, L. E. (2002). The dodo bird is extinct. Clinical Psychology: Science and Practice, 9, 30-34.
8. Beutler, L. E., & Baker, M. (1998). The movement toward empirical validation: At what level should we analyze, and who are the consumers? (pp. 43-65). Thousand Oaks, CA: Sage Press.
9. Bickman, L. (2000). The most dangerous and difficult question in mental health services research. Mental Health Services Research, 2, 71-72.
10. Brookman-Frazee, L., Garland, A. F., Taylor, R., & Zoffness, R. (2009a). Therapists' attitudes towards psychotherapeutic strategies in community-based psychotherapy with children with disruptive behavior problems. Administration and Policy in Mental Health and Mental Health Services, 36, 1-12.
11. Brookman-Frazee, L., Haine, R. A., Baker-Ericzén, M., Zoffness, R., & Garland, A. F. (2009b). Factors associated with use of evidence-based practice strategies in usual care youth psychotherapy (this issue).
12. Carroll, K. M., & Rounsaville, B. J. (2007). A vision of the next generation of behavioral therapies research in the addictions. Addiction, 102, 850-862.
13. Chambless, D. L., & Hollon, S. D. (1998). Defining empirically supported therapies. Journal of Consulting and Clinical Psychology, 66, 7-18.
14. Chambless, D. L., Sanderson, W. C., Shoham, V., Bennett Johnson, S., Pope, K. S., Crits-Christoph, P., et al. (1996). An update on empirically validated therapies. Clinical Psychologist, 49, 5-18.
15. Chorpita, B. F., Becker, K. D., & Daleiden, E. L. (2007). Understanding the common elements of evidence-based practice: misconceptions and clinical examples. Journal of the American Academy of Child and Adolescent Psychiatry, 46, 647-652.
16. Cichetti, D. V. (1994). Guidelines, criteria, and rule of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological Assessment, 6, 284-290.
17. Eyberg, S. M., Nelson, M. M., & Boggs, S. R. (2008). Evidence-based psychosocial treatments for children and adolescents with disruptive behavior. Journal of Clinical Child and Adolescent Psychology, 37(1), 215-237.
18. Garland, A. F., Brookman-Frazee, L., Hurlburt, M., Accurso, E. C., Zoffness, R., Haine, R. A., & Ganger, W. A. (under review). Characterizing community-based psychotherapy for children with disruptive behavior problems.
19. Garland, A. F., Brookman-Frazee, L., McLeod, B. (2008a). Scoring manual for the PRAC study therapy process observational coding system for child psychotherapy: strategies scale.
20. Garland, A. F., Hawley, K. M., Brookman-Frazee, L., & Hurlburt, M. S. (2008b). Identifying common elements of evidence-based psychosocial treatments for children's disruptive behavior problems. Journal of the American Academy of Child and Adolescent Psychiatry, 47, 505-514.
21. Garland, A. F., Hurlburt, M. S., & Hawley, K. M. (2006a). Examining psychotherapy processes in a services research context. Clinical Psychology: Science and Practice, 13, 30-46.
22. Garland, A. F., McCabe, K. M., & Yeh, M. (2008c). Ethical challenges in practice-based mental health services research: Examples from research with children and families. Clinical Psychology: Science and Practice, 15, 118-124.
23. Garland, A. F., Plemmons, D., & Koontz, L. (2006b). Researchpractice partnerships in mental health: Lessons from participants. Administration and Policy in Mental Health and Mental Health Services, 33, 517-528.
24. Glisson, C., Dukes, D., & Green, P. (2006). The effects of the ARC organizational intervention on caseworker turnover, climate, and culture in children's service systems. Child Abuse and Neglect, 30, 855-880.
25. Glisson, C., Landsverk, J., Schoenwald, S., et al. (2008a). Assessing the organizational social context (OSC) of mental health services: Implications for research and practice. Administration and Policy in Mental Health and Mental Health Services Research, 35, 98-113.
26. Glisson, C., Schoenwald, S. K., Kelleher, K., Landsverk, J., Hoagwood, K. E., Mayberg, S., & Green, P. (2008b). Therapist turnover and new program sustainability in mental health clinics as a function of organizational culture, climate, and service structure. Administration and Policy in Mental Health and Mental Health Services Research. Special Issue: Improving Mental Health Services, 35, 124-133.
27. Goldfried, M. R. (1980). Toward the delineation of therapeutic change principles. American Psychologist, 35, 991-999.
28. Heaton, K. J., Hill, C. E., & Edwards, L. A. (1995). Comparing molecular and molar methods of judging therapist techniques. Psychotherapy Research, 5, 141-153.
29. Hogue, A., Dauber, S., Liddle, H. A., & Samuolis, J. (2004). Linking session focus to treatment outcome in evidence-based treatments for adolescent substance abuse. Psychotherapy: Theory, Research, Practice, Training, 41, 83-96.
30. Hogue, A., Liddle, H. A., & Rowe, C. (1996). Treatment adherence process research in family therapy: A rationale and some practical guidelines. Psychotherapy, 33, 332-345.
31. Hogue, A., Liddle, H. A., Rowe, C., Turner, R. M., Dakof, G. A., & LaPann, K. (1998). Treatment adherence and differentiation in individual versus family therapy for adolescent substance abuse. Journal of Counseling Psychology, 45, 104-114.
32. Hox, J. (2002). Multilevel analysis techniques and applications. Mahwah, NJ: Erlbaum.
33. Hurlburt, M. S., Garland, A. F., Nguyen, K., & Brookman-Frazee, L. (2009). Child and family therapy process: Concordance of therapist and observational (this issue).
34. Jensen, J. P., Bergin, A. E., & Greaves, D. W. (1990). The meaning of eclecticism: New survey and analysis of components. Professional Psychology Research and Practice, 21, 124-130.
35. Jensen-Doss, A., Cusack, K. J., & de Arellano, M. A. (2008). Workshop-based training in trauma-focused CBT: An in-depth analysis of impact on provider practices. Community Mental Health Journal, 44, 227-244.
36. Kataoka, S., Fuentes, S., O'Donoghue, V. P., Castillo-Campos, P., Bonilla, A., Halsey, K., et al. (2006). A community participatory research partnership: The development of a faith-based intervention for children exposed to violence. Ethnicity and Disease, 16, 89-97.
37. Kazdin, A. E., & Nock, M. K. (2003). Delineating mechanisms of change in child and adolescent therapy: Methodological issues and research recommendations. Journal of Child Psychology and Psychiatry and Allied Disciplines, 44, 1116-1129.
38. Kazdin, A. E., Siegel, T. C., & Bass, D. (1990). Drawing on clinical practice to inform research on child and adolescent psychotherapy: Survey of practitioners. Professional Psychology: Research and Practice, 21, 189-198.
39. Kazdin, A. E., & Weisz, J. R. (1998). Identifying and developing empirically supported child and adolescent treatments. Journal of Consulting and Clinical Psychology, 66, 19-36.
40. Kazdin, A. E., & Weisz, J. R. (2003). Evidence-based psychotherapies for children and adolescents. New York, NY: Guilford Press.
41. Knudsen, H. K., Johnson, J. A., & Roman, P. M. (2003). Retaining counseling staff at substance abuse treatment centers: Effects of management practices. Journal of Substance Abuse Treatment, 24, 129-135.
42. Lambert, M., & Hill, C. (1994). Assessing psychotherapy outcomes and processes. Handbook of psychotherapy and behavior change (4th ed., pp. 72-113). New York, NY: Wiley.
43. Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33, 159-174.
44. Mayo, E. (1933). The human problems of industrial civilization. New York, NY: MacMillan.
45. McLeod, B. D. (2001). The therapy process observational coding system for child psychotherapy. Los Angeles: University of California. Unpublished instrument.
46. McLeod, B. D., & Weisz, J. R. (2008). The Therapy Process Observational Coding System for child psychotherapy strategies: Measure characteristics and prediction of outcome in usual clinical practice. (under review).
47. Mufson, L. H., Pollack-Dorta, K., Olfson, M., Weissman, M. M., & Hoagwood, K. (2004). Effectiveness research: Transporting Interpersonal Psychotherapy for Depressed Adolescents (IPTA) from the lab to school-based health clinics. Clinical Child and Family Psychology Review, 7, 251-261.
48. National Advisory Mental Health Council. (1998). Bridging science and service: A report by the National Advisory Mental Health Council's Clinical treatment and Services Workgroup. Bethesda, MD: National Institutes of Health/National Institute of Mental Health.
49. Nelson, T. D., Steele, R. G., & Mize, J. A. (2006). Practitioner attitudes toward evidence-based practice: Themes and challenges. Administration and Policy In Mental Health, 33, 398-409.
50. Perepletchikova, F., Treat, T. A., & Kazdin, A. E. (2007). Treatment integrity in psychotherapy research: Analysis of the studies and examination of the associated factors. Journal of Consulting Clinical Psychology, 75, 829-841.
51. Rubin, D. B. (2005). Causal inference using potential outcomes: Design, modeling, decisions. Journal of the American Statistical Association, 100, 322-331.
52. Schley, C., Ryall, C., Crothers, L., Radovini, S., Fletcher, K., Marriage, K., et al. (2008). Early intervention in the real world: Early intervention with difficult to engage, 'high-risk' youth: Evaluating an intensive outreach approach in youth mental health. Early Intervention in Psychiatry, 2, 195-200.
53. Schoenwald, S. K., Heiblum, N., Saldana, L., & Henggeler, S. W. (2008). The international implementation of multisystemic therapy. Evaluation & The Health Professions, 31, 211-225.
54. Sheehan, A. K., Walrath-Greene, C., Fisher, S., Crossbear, S., & Walker, J. (2007). Evidence-based practice knowledge, use, and factors that influence decisions: Results from an evidence-based practice survey of providers in American Indian/Alaska Native communities. American Indian and Alaska Native Mental Health Research, 14, 29-48.
55. Vinnars, B., Barber, J. B., Norén, K., Gallop, R., & Weinryb, R. M. (2005). Manualized Supportive-Expressive Psychotherapy versus nonmanualized Community-Delivered Psychodynamic Therapy for patients with personality disorders: Bridging efficacy and effectiveness. American Journal of Psychiatry, 162, 1933-1940.
56. Waltz, J., Addis, M. E., Koerner, K., & Jacobson, N. S. (1993). Testing the integrity of a psychotherapy protocol: Assessment of adherence and competence. Journal of Consulting and Clinical Psychology, 61, 620-630.
57. Wampold, B. E., Mondin, G. W., Moody, M., Stich, F., Benson, K., & Ahn, H. (1997). A meta-analysis of outcome studies comparing bona fide psychotherapies: Empiricially, "all must have prizes". Psychological Bulletin, 122, 203-215.
58. Weersing, V. R., Weisz, J. R., & Donenberg, G. R. (2002). Development of the therapy procedures checklist: A therapistreport measure of technique use in child and adolescent treatment. Journal of Clinical Child and Adolescent Psychology, 31, 168-180.
59. Weisz, J. R., Jensen-Doss, A., & Hawley, K. M. (2006). Evidencebased youth psychotherapies versus usual clinical care: A meta-analysis of direct comparisons. American Psychologist, 61, 671-689.
60. Wells, K. B., Sturm, R., Sherbourne, C. D., & Meredith, L. S. (1996). Caring for depression. Cambridge, MA: Harvard University Press.
61. West, S. G., Duan, H., Pequegnat, W., Gaist, P., Des Jarlais, D. C., Holtgrave, D., et al. (2008). Alternatives to the randomized control trial. American Journal of Public Health, 98, 1359-1366.
62. Westfall, J. M., Mold, J., & Fagnan, L. (2007). Practice-based research-"Blue Highways" on the NIH roadmap. The Journal of the American Medical Association, 297, 403-406.
63. Zima, B. T., Hurlburt, M. S., Knapp, P., Ladd, H., Tang, L., Duan, N., et al. (2005). Quality of publicly-funded outpatient specialty mental health care for common childhood psychiatric disorders in California. Journal of the American Academy of Child and Adolescent Psychiatry, 44, 130-144.
64. Zoffness, R., Garland, A., Brookman-Frazee, L., & Roesch, S. (2009). Case management as a significant component of usual care psychotherapy for youth with disruptive behavior problems. Child & Youth Care Forum, 38, 185-200.