Evaluating the efficacy of client feedback in group psychotherapy

Group Dynamics

Volumn 19, Issue 2, 2015, Pages 122-136

  Slone, Norah C ^a   Reese, Robert J ^b   Mathews Duvall, Susan ^c   Kodet, Jonathan ^b  

^a Norton Orthopedic Institute   (United States)

^b UNIVERSITY OF KENTUCKY   (United States)

^c NONE   (United States)

Author keywords

Client feedback; Continuous assessment; Group psychotherapy; Process and outcome; Treatment monitoring

Indexed keywords

EID: 84939261562     PISSN: 10892699     EISSN: None     Source Type: Journal    
DOI: 10.1037/gdn0000026     Document Type: Article

References (57)

1. Anker, M. G., Duncan, B. L., & Sparks, J. A. (2009). Using client feedback to improve couple therapy outcomes: A randomized clinical trial in a naturalistic setting. Journal of Consulting and Clinical Psychology, 77, 693-704. http://dx.doi.org/ 10.1037/a0016062
2. APA Presidential Task Force on Evidence-Based Practice. (2006). Evidence-based practice in psychology. American Psychologist, 61, 271-285. http://dx.doi.org/10.1037/0003-066X.61.4.271
3. Baldwin, S. A., Murray, D. M., & Shadish, W. R. (2005). Empirically supported treatments or type I errors? Problems with the analysis of data from group-administered treatments. Journal of Consulting and Clinical Psychology, 73, 924-935. http://dx.doi.org/10.1037/0022-006X.73.5.924
4. Baldwin, S. A., Stice, E., & Rohde, P. (2008). Statistical analysis of group-administered intervention data: Reanalysis of two randomized trials. Psychotherapy Research, 18, 365-376. http://dx.doi.org/ 10.1080/10503300701796992
5. Barker, C., Pistrang, N., & Elliott, R. (2002). Research methods in clinical psychology: An introduction for students and practitioners (2nd ed.). Chichester, UK: Wiley. http://dx.doi.org/10.1002/ 0470013435
6. Bernard, H., Burlingame, G., Flores, P., Greene, L., Joyce, A., Kobos, J. C., the Science to Service Task Force, American Group Psychotherapy Association. (2008). Clinical practice guidelines for group psychotherapy. International Journal of Group Psychotherapy, 58, 455-542. http://dx.doi.org/10.1521/ijgp.2008.58.4.455
7. Bordin, E. S. (1979). The generalizability of the psychoanalytic concept of the working alliance. Psychotherapy: Research & Practice, 16, 252- 260. http://dx.doi.org/10.1037/h0085885
8. Bringhurst, D. L., Watson, C. W., Miller, S. D., & Duncan, B. L. (2006). The reliability and validity of the Outcome Rating Scale: A replication study of a brief clinical measure. Journal of Brief Therapy, 5, 23-30. Retrieved from http:// journalbrieftherapy.com/
9. Burlingame, G. M., Strauss, B., & Joyce, A. (2013). Change mechanisms and effectiveness of small group treatments. In M. J. Lambert (Ed.), Bergin and Garfield's handbook of psychotherapy and behavior change (6th ed., pp. 640-689). New York, NY: Wiley.
10. Campbell, A., & Hemsley, S. (2009). Outcome Rating Scale and Session Rating Scale in psychological practice: Clinical utility of ultra-brief measures. Clinical Psychologist, 13, 1-9. http://dx.doi.org/10.1080/13284200802676391
11. Castonguay, L. G., Barkham, M., Lutz, W., & McAleavey, A. A. (2013). Practice-oriented research: Approaches and application. In M. J. Lambert (Ed.), Bergin and Garfield's handbook of psychotherapy and behavior change (6th ed., pp. 85-133). New York, NY: Wiley.
12. Chapman, C. L., Burlingame, G. M., Gleave, R. M., Rees, F., Beecher, M., & Porter, G. S. (2012). Clinical prediction in group psychotherapy. Psychotherapy Research, 22, 673-681.
13. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
14. Crits-Christoph, P., Ring-Kurtz, S., Hamilton, J. L., Lambert, M. J., Gallop, R., McClure, B., Rotrosen, J. (2012). A preliminary study of the effects of individual patient-level feedback in outpatient substance abuse treatment programs. Journal of Substance Abuse Treatment, 42, 301-309. http://dx.doi.org/10.1016/j.jsat.2011.09.003
15. Davies, D. R., Burlingame, G. M., Johnson, J. E., Gleave, R. L., & Barlow, S. H. (2008). The effects of a feedback intervention on group process and outcome. Group Dynamics: Theory, Research, and Practice, 12, 141-154. http://dx.doi.org/10.1037/ 1089-2699.12.2.141
16. Duncan, B. (2011). The Partners for Change Outcome Management System (PCOMS): Administration, scoring, interpreting update for the Outcome and Session Ratings Scale. Jensen Beach, FL: Author.
17. Duncan, B. (2012). The partners for change outcome management system (PCOMS): The heart and soul of change project. Canadian Psychology/Psychologie canadienne, 53, 93-104. http://dx.doi.org/10.1037/a0027762
18. Duncan, B. (2014). On becoming a better therapist: Evidence based practice one client at a time (2nd Ed.). Washington, DC: American Psychological Association.
19. Duncan, B. L., & Miller, S. M. (2007). The Group Session Rating Scale. Jensen Beach, FL: Authors.
20. Duncan, B., & Sparks, J. (2010). Heroic clients, heroic agencies: Partners for change (2nd ed.). Jensen Beach, FL: Author.
21. Duncan, B., Sparks, J., Miller, S., Bohanske, R., & Claud, D. (2006). Giving youth a voice: A preliminary study of the reliability and validity of a brief outcome measure for children, adolescents, and caretakers. Journal of Brief Therapy, 5, 71-87. Retrieved from http://journalbrieftherapy.com/
22. Gillaspy, J. A., & Murphy, J. J. (2011). The use of ultra-brief client feedback tools in SFBT. In C. W. Franklin, T. Trepper, E. McCollum, & W. Gingerich (Eds.), Solution-focused brief therapy. New York, NY: Oxford University Press.
23. Hannan, C., Lambert, M. J., Harmon, C., Nielsen, S. L., Smart, D. W., Shimokawa, K., & Sutton, S. W. (2005). A lab test and algorithms for identifying clients at risk for treatment failure. Journal of Clinical Psychology, 61, 155-163. http://dx.doi.org/10.1002/jclp.20108
24. Harmon, S. C., Lambert, M. J., Smart, D. M., Hawkins, E., Nielsen, S. L., Slade, K., & Lutz, W. (2007). Enhancing outcome for potential treatment failures: Therapist-client feedback and clinical support tools. Psychotherapy Research, 17, 379- 392. http://dx.doi.org/10.1080/1050330060 0702331
25. Hawkins, E. J., Lambert, M. J., Vermeersch, D. A., Slade, K. L., & Tuttle, K. C. (2004). The therapeutic effects of providing patient progress information to therapists and patients. Psychotherapy Research, 14, 308-327. http://dx.doi.org/10.1093/ ptr/kph027
26. Heck, R. H., Thomas, S. L., & Tabitha, L. N. (2014). Multilevel and longitudinal modeling with IBM SPSS (2nd ed.). New York, NY: Routledge.
27. Hogue, A., Liddle, H. A., & Rowe, C. (1996). Treatment adherence process research in family therapy: A rationale and some practical guidelines. Psychotherapy: Theory, Research, Practice, 33, 332-345. http://dx.doi.org/10.1037/0033-3204.33.2.332
28. Hox, J. (2010). Multilevel analysis: Techniques and applications (2nd ed.). New York, NY: Routledge.
29. Jacobson, N. S., & Truax, P. (1991). Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59, 12-19. http://dx.doi.org/10.1037/0022-006X.59.1.12
30. Lambert, M. J., Hansen, N. B., & Harmon, S. C. (2010). Outcome Questionnaire System (The OQ System): Development and practical applications in healthcare settings. In M. Barkham, G. E. Hardy, & J. Mellor-Clark (Eds.), Developing and delivering practice-based evidence (pp. 141-154). Malden, MA: John Wiley & Sons, Ltd.
31. Lambert, M. J., Hansen, N. B., Umphress, V., Lunnen, K., Okiishi, J., Burlingame, G. M., & Reisenger, C. W. (1996). Administration and scoring manual for the OQ 45.2. Stevenson, MD: American Professional Credentialing Services.
32. Lambert, M. J., & Ogles, B. M. (2004). The efficacy and effectiveness of psychotherapy. In M. J. Lambert (Ed.), Bergin and Garfield's handbook of psychotherapy and behavior change (5th ed., pp. 139-193). New York, NY: Wiley.
33. Lambert, M. J., & Shimokawa, K. (2011). Collecting client feedback. Psychotherapy, 48, 72-79. http:// dx.doi.org/10.1037/a0022238
34. Lambert, M. J., Whipple, J. L., Smart, D. W., Vermeersch, D. A., Nielsen, S. L., & Hawkins, E. J. (2001). The effects of providing therapists with feedback on patient progress during psychotherapy: Are outcomes enhanced? Psychotherapy Research, 11, 49 - 68. http://dx.doi.org/10.1080/ 713663852
35. Lambert, M. J., Whipple, J. L., Vermeersch, D. A., Smart, D. W., Hawkins, E. J., Nielson, S. L., & Goates, M. (2002). Enhancing psychotherapy outcomes via providing feedback on client progress: A replication. Clinical Psychology & Psychotherapy, 9, 91-103. http://dx.doi.org/10.1002/cpp.324
36. MacKenzie, K. R. (1983). The clinical application of a group climate measure. In R. R. Dies & K. R. MacKenzie (Eds.), Advances in group psychotherapy: Integrating research and practice (pp. 159- 170). New York, NY: International Universities.
37. McRoberts, C., Burlingame, G. M., & Hoag, M. J. (1998). Comparative efficacy of individual and group psychotherapy: A meta-analytic perspective. Group Dynamics: Theory, Research, and Practice, 2, 101-117. http://dx.doi.org/10.1037/1089-2699.2.2.101
38. Miller, S. D., & Duncan, B. L. (2000). The Outcome Rating Scale. Chicago, IL: Authors.
39. Miller, S. D., Duncan, B. L., Brown, K., Sparks, J., & Claud, D. (2003). The Outcome Rating Scale: A preliminary study of the reliability, validity, and feasibility of a brief visual analog measure. Journal of Brief Therapy, 2, 91-100. Retrieved from http://journalbrieftherapy.com/
40. Miller, S. D., Duncan, B. L., & Johnson, L. D. (2000). The Session Rating Scale 3.0. Chicago, IL: Author.
41. Probst, T., Lambert, M. J., Loew, T. H., Dahlbender, R. W., Göllner, R., & Tritt, K. (2013). Feedback on patient progress and clinical support tools for therapists: Improved outcome for patients at risk of treatment failure in psychosomatic in-patient therapy under the conditions of routine practice. Journal of Psychosomatic Research, 75, 255-261. http://dx.doi.org/10.1016/j.jpsychores.2013.07.003
42. Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods (6th ed.). Newbury Park, CA: Sage.
43. Reese, R. J., Duncan, B., Bohanske, B., Owen, J., & Minami, T. (2014). Benchmarking outcomes in a public behavioral health setting: Feedback as a quality improvement strategy. Journal of Consulting and Clinical Psychology, 82, 731-742. http:// dx.doi.org/10.1037/a0036915
44. Reese, R. J., Norsworthy, L. A., & Rowlands, S. R. (2009). Does a continuous feedback system improve psychotherapy outcome? Psychotherapy: Theory, Research, Practice, Training, 46, 418- 431. http://dx.doi.org/10.1037/a0017901
45. Reese, R. J., Toland, M. D., Slone, N. C., & Norsworthy, L. A. (2010). Effect of client feedback on couple psychotherapy outcomes. Psychotherapy: Theory, Research, Practice, Training, 47, 616- 630. http://dx.doi.org/10.1037/a0021182
46. Schuman, D. L., Slone, N. C., Reese, R. J., & Duncan, B. (2014). Efficacy of client feedback in group psychotherapy with soldiers referred for substance abuse treatment. Psychotherapy Research. Advance online publication. http://dx.doi.org/ 10.1080/10503307.2014.900875
47. Shimokawa, K., Lambert, M. J., & Smart, D. W. (2010). Enhancing treatment outcome of patients at risk of treatment failure: Meta-analytic and mega-analytic review of psychotherapy quality assurance system. Journal of Consulting and Clinical Psychology, 78, 298-311. http://dx.doi.org/ 10.1037/a0019247
48. Simon, W., Lambert, M. J., Busath, G., Vazquez, A., Berkeljon, A., Hyer, K., Berrett, M. (2013). Effects of providing patient progress feedback and clinical support tools to psychotherapists in an inpatient eating disorders treatment program: A randomized controlled study. Psychotherapy Research, 23, 287-300. http://dx.doi.org/10.1080/ 10503307.2013.787497
49. Slade, K., Lambert, M. J., Harmon, S. C., Smart, D. W., & Bailey, R. (2008). Improving psychotherapy outcome: The use of immediate electronic feedback and revised clinical support tools. Clinical Psychology & Psychotherapy, 15, 287-303. http://dx.doi.org/10.1002/cpp.594
50. Streiner, D. L. (2010). Last observation carried forward. In N. J. Salkind (Ed.), Encyclopedia of research design (pp. 686-688). Thousand Oaks, CA: Sage.
51. Swift, J. K., & Greenberg, R. P. (2012). Premature discontinuation in adult psychotherapy: A metaanalysis. Journal of Consulting and Clinical Psychology, 80, 547-559. http://dx.doi.org/10.1037/ a0028226
52. Tasca, G. A., Illing, V., Joyce, A. S., & Ogrodniczuk, J. S. (2009). Three-level multilevel growth models for nested change data: A guide for group treatment researchers. Psychotherapy Research, 19, 453- 461. http://dx.doi.org/10.1080/ 10503300902933188
53. Taylor, N. T., Burlingame, G. M., Fuhriman, A., Johansen, J., & Dahl, D. (2001). A survey of mental health care providers and managed care organization attitudes toward, familiarity with, and use of group interventions. International Journal of Group Therapy, 52, 243-263.
54. The American Group Psychotherapy Association. (2007). Practice guidelines for group psychotherapy. Retrieved from http://www.agpa.org/docs/ default-source/practice-resources/download-fullguidelines-( pdf-format)-group-works!-evidence-onthe- effectiveness-of-group-therapy.pdf?sfvrsn=2
55. Whipple, J. L., Lambert, M. J., Vermeersch, D. A., Smart, D. W., Nielsen, S. L., & Hawkins, E. J. (2003). Improving the effects of psychotherapy: The use of early identification of treatment failure and problem-solving strategies in routine practice. Journal of Counseling Psychology, 50, 59-68. http://dx.doi.org/10.1037/0022-0167.50.1.59
56. Wierzbicki, M., & Pekarik, G. (1993). A metaanalysis of psychotherapy drop out. Professional Psychology, Research and Practice, 24, 190-195. http://dx.doi.org/10.1037/0735-7028.24.2.190
57. Yalom, I. D. (1995). The theory and practice of group psychotherapy (4th ed.). New York, NY: Basic Books.