Improving the efficiency of cognitive-behavioural therapy by using formal client feedback

Psychotherapy Research

Volumn 27, Issue 5, 2017, Pages 525-538

  Janse, Pauline D ^a   De Jong, Kim ^b   Van Dijk, Maarten K ^c   Hutschemaekers, Giel J M ^d   Verbraak, Marc J P M ^d  

^a HSK Groep   (Netherlands)

^b LEIDEN UNIVERSITY   (Netherlands)

^c Dimence   (Netherlands)

^d RADBOUD UNIVERSITY NIJMEGEN   (Netherlands)

Author keywords

client feedback; cognitive behavioural therapy; Outcome Rating Scale; Session Rating Scale

Indexed keywords

ADULT; COGNITIVE THERAPY; FEEDBACK SYSTEM; FEMALE; HUMAN; LONGITUDINAL STUDY; MALE; MENTAL DISEASE; MIDDLE AGED; PATIENT-REPORTED OUTCOME; PROCEDURES; STANDARDS; TREATMENT OUTCOME;

ADULT; COGNITIVE THERAPY; FEEDBACK; FEMALE; HUMANS; LONGITUDINAL STUDIES; MALE; MENTAL DISORDERS; MIDDLE AGED; OUTCOME AND PROCESS ASSESSMENT (HEALTH CARE); PATIENT REPORTED OUTCOME MEASURES;

EID: 84961572761     PISSN: 10503307     EISSN: 14684381     Source Type: Journal    
DOI: 10.1080/10503307.2016.1152408     Document Type: Article

References (60)

1. Andrews, G., Issakidis, C., Sanderson, K., Corry, J., & Lapsley, H., (2004). Utilising survey data to inform public policy:Utilising survey data to inform public policy:Comparison of the cost-effectiveness of treatment comparison of the cost-effectiveness of treatment of ten mental disorders. The British Journal of Psychiatry, 184, 526–533. doi:10.1192/bjp.184.6.526
2. Anker, M., Duncan, B. L., & Sparks, J. A., (2009). Using client feedback to improve couple outcomes:A randomized clinical trial in a naturalistic setting. Journal of Consulting and Clinical Psychology, 77, 693–704. doi:10.1037/a0016062
3. Arrindell, W. A., & Ettema, J. H. M., (2003). SCL-90, Handleiding bij een multidimensionele psychopathologie indicator. [SCL-90, Manual for a multidimensional indicator of psychopathology]. Lisse:Swets & Zeitlinger.
4. Asmus, F., Crouzen, M., & Van Oenen, F. J. (2004). Session Rating Scale. Retrieved December 10, 2011, from http://scottdmiller.com/purchase-individual-or-group-licenses
5. Christensen, L., & Mendoza, J. L., (1986). A method of assessing change in a single subject:An alteration of the RC index. Behavior Therapy, 17, 305–308. doi:10.1016/S0005-7894(86)80060-0
6. Cohen, J., (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ:Lawrence Erlbaum.
7. De Jong, K., Timman, R., Hakkaart-Van Roijen, L., Vermeulen, P., Kooiman, K., Passchier, J., & Van Busschbach, J., (2014). The effect of outcome monitoring feedback to clinicians and clients in short and long-term psychotherapy:A randomized controlled trial. Psychotherapy Research, 24(6), 629–639. doi:10.1080/10503307.2013.871079
8. Derogatis, L. R., (1994). Symptom checklist 90–R:Administration, scoring, and procedures manual (3rd ed.). Minneapolis, MN:National Computer Systems.
9. Dijkgraaf-Hartland, W., Brals, C., Verbraak, M., & Van Dijk, M., (2013). Comorbide persoonlijkheidsproblematiek en de effectiviteit van protocollaire behandeling. [Co-morbid personality problems and the effectiveness of manualized treatment]. Directieve Therapie, 33, 14–30.
10. Duncan, B. L., Miller, S. D., Sparks, J. A., Claud, D. A., Reynolds, L. R., Brown, J., & Johnson, L. D., (2003). The session rating scale:Preliminary psychometric properties of a “working” alliance measure. Journal of Brief Therapy, 3, 3–12.
11. Duncan, B. L., & Reese, R. J., (2015). The partners for change outcome management system (PCOMS):Revisiting the client's frame of reference. Psychotherapy, 52(4), 391–401. doi:10.1037/pst0000026
12. Dunlop, W. P., Cortina, J. M., Vaslow, J. B., & Burke, M. J., (1996). Meta-analysis of experiments with matched groups or repeated measures designs. Psychological Methods, 1, 170–177. doi:10.1037/1082-989X.1.2.170
13. Durlak, J. A., (2009). How to select, calculate, and interpret effect sizes. Journal of Pediatric Psychology, 34(9), 917–928. doi:10.1093/jpepsy/jsp004
14. Elliot, D., Brown, J., Miller, S. D., & Duncan, B. L., (2007). ASIST for agencies—using the outcome and session rating scales (ORS/SRS. Version 3.06) [Computer software]. Santa Cruz, CA:Author.
15. Flückiger, C., Del Re, A., Wampold, B. E., Znoj, H., Caspar, F., & Jörg, U., (2012). Valuing clients’ perspective and the effects on the therapeutic alliance:A randomized controlled study of an adjunctive instruction. Journal of Counseling Psychology, 59, 18–26. doi:10.1037/a0023648
16. Graham, J. W., Olchowski A. E., & Gilreath, T. D., (2007). How many imputations are really needed? Some practical clarifications of multiple imputation theory. Prevention Science, 8, 206–213. doi:10.1007/s11121-007-0070-9
17. Hannan, C., Lambert, M. J., Harmon, C., Nielsen, S. L., Smart, D. W., Shimokowa, K., & Sutton, S., (2005). A lab test and algorithms for identifying clients at risk for treatment failure. Journal of Clinical Psychology, 61, 155–163. doi:10.1002/jclp.20108
18. Horvath, A. O., & Greenberg, L. S., (1989). Development and validation of the working alliance inventory. Journal of Counseling Psychology, 36, 223–233. doi:10.1037/0022-0167.36.2.223
19. Jacobson, N. S., & Truax, P., (1991). Clinical significance:A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59, 12–19. doi:10.1037/0022-006X.59.1.12
20. Janse, P. D., Boezen-Hilberdink, L., Van Dijk, M. K., Verbraak, M. J. P. M., & Hutschemaekers, G. J. M., (2014). Measuring feedback from clients:The psychometric properties of the Dutch outcome rating scale and session rating scale. European Journal of Psychological Assessment, 30(2), 86–92. doi:10.1027/1015-5759/a000172
21. Keijsers, G., Van Minnen, A., & Hoogduin, K., (Eds.). (2011). Protocollaire behandeling voor volwassenen met psychische klachten 1 & 2. Amsterdam:Uitgeverij Boom.
22. Keijsers, G. P. J., Verbraak, M., Ten Broeke, E., & Korrelboom, K. (2009). Psychologische behandelingen volgens een protocol. In E. ten Broeke, K. Korrelboom. & M. Verbraak (Ed.), Praktijkboek geïntegreerde cognitieve gedragstherapie. Protocollaire behandelingen op maat. [A practical guide to integrated cognitive and behavioural therapy. Tailor made treatment protocols]. Bussum:Coutinho.
23. Knaup, C., Koesters, M., Schoefer, D., Becker, T., & Puschner, B., (2009). Effect of feedback of treatment outcome in specialist mental healthcare:Meta-analysis. The British Journal of Psychiatry, 195, 15–22. doi:10.1192/bjp.bp.108.053967
24. Lambert, M. J., (2010). Prevention of treatment failure:The use of measuring, monitoring, & feedback in clinical practice. Washington, DC:American Psychological Association.
25. Lambert, M. J., (2013). The efficacy and effectiveness of psychotherapy. In M. J., Lambert (Ed.), Bergin and Garfield's Handbook of psychotherapy and behavior change (6th ed., pp. 169–219). New York:Wiley.
26. Lambert, M. J., Bailey, R., Kimball, K., Shimokawa, K., Harmon, S. C., & Slade, K., (2007). Clinical support tool manual-brief version-40. Salt Lake City, UT:OQMeasures.
27. Lambert, M. J., Hansen, N. B., Umphress, V. J., Lunnen, K., Okiishi, J., Burlingame, G., … Reisinger, C. W., (1996). Administration and scoring manual for the outcome questionnaire (OQ 45.2). Wilmington, DE:American Professional Credentialing Services.
28. Lambert, M. J., Whipple, J. L., Hawkins, E. J., Vermeersch, D. A., Nielsen, S. L., & Smart, D. W., (2003). Is it time for clinicians to routinely track patient outcome? A meta analysis. Clinical Psychology:Science & Practice, 10, 288–301.
29. Lambert, M. J., & Shimokawa, K., (2011). Collecting client feedback. Psychotherapy, 48, 72–79. doi:10.1037/a0022238
30. Lecrubier, Y., Sheehan, D. V., Weiller, E., Amorim, P., Bonora, I., Sheehan, K. H., (1997). The mini international neuropsychiatric interview (MINI). A short diagnostic structured interview:reliability and validity according to the CIDI. European Psychiatry, 12, 224–231. doi:10.1016/S0924-9338(97)83296-8
31. Lewis, C. C., Simons, A. D., & Kim, H. K., (2012). The role of early symptom trajectories and pretreatment variables in predicting treatment response to cognitive behavioral therapy. Journal of Consulting and Clinical Psychology, 80(4), 525–534. doi:10.1037/a0029131
32. Lutz, W., Stulz, N., Martinovich, Z., Leon, S., & Saunders, S. M., (2009). Methodological background of decision rules and feedback tools for outcomes management in psychotherapy. Psychotherapy Research, 19, 502–510. doi:10.1080/10503300802688486
33. Miller, S. D., & Duncan, B. L., (2004). The outcome and session rating scale. Administration and scoring manual. Chicago, IL:Institute for the Study of Therapeutic Change.
34. Miller, S. D., Duncan, B. L., Brown, J., Sorrell, R., & Chalk, M. B., (2006). Using formal client feedback to improve retention and outcome:Making ongoing, real time assessment feasible. Journal of Brief Therapy, 5, 5–22.
35. Miller, S. D., Duncan, B. L., Brown, J., Sparks, J., & Claud, D., (2003). The outcome rating scale:A preliminary study of the reliability, validity, and feasibility of a brief visual analogue measure. Journal of Brief Therapy, 2, 91–100.
36. Murphy, K. P., Rashleigh, C. M., & Timulak, L., (2012). The relationship between progress feedback and therapeutic outcome in student counselling:A randomised control trial. Counselling Psychology Quarterly, 25, 1–18. doi:10.1080/09515070.2012.662349
37. Norcross, J. C., & Lambert, M. J., (2011). Evidence-based therapy relationships. In J. C., Norcross (Ed.), Psychotherapy relationships that work (2nd ed., pp. 1–5). New York:Oxford University Press.
38. Okiishi, J., Lambert, M. J., Eggett, D., Nielsen, L., Dayton, D. D., & Vermeersch, D. A., (2006). An analysis of therapist treatment effects:Toward providing feedback to individual therapists on their clients’ psychotherapy outcome. Journal of Clinical Psychology, 62, 1157–1172. doi:10.1002/jclp.20272
39. Parker, Z. J., & Waller, G., (2015). Factors related to psychotherapists’ self-assessment when treating anxiety and other disorders. Behaviour Research and Therapy, 66, 1–7. doi:10.1016/j.brat.2014.12.010
40. Probst, T., Lambert, M. J., Dahlbender, R. W., Loew, T. H., & Tritt, K., (2014). Providing patient progress feedback and clinical support tools to therapists:Is the therapeutic process of patients on-track to recovery enhanced in psychosomatic in-patient therapy under the conditions of routine practice? Journal of Psychosomatic Research, 76, 477–484. doi:10.1016/j.jpsychores.2014.03.010
41. Probst, T., Lambert, M. J., Loew, T. H., Dahlbender, R. W., & Tritt, K., (2015). Extreme deviations from expected recovery curves and their associations with therapeutic alliance, social support, motivation, and life events in psychosomatic in-patient therapy. Psychotherapy Research, 25(6), 714–723.
42. Reese, R., Gillaspy, A., Owen, J., Flora, K., Cunningham, L., Archie, D., & Marsden, T., (2013). The influence of demand characteristics and social desirability on clients’ ratings of the therapeutic alliance. Journal of Clinical Psychology, 69, 696–709. doi:10.1002/jclp.21946
43. Reese, R. J., Norsworthy, L. A., & Rowlands, S. R., (2009). Does a continuous feedback system improve psychotherapy outcome? Psychotherapy:Theory, Research, Practice, Training, 46, 418–431. doi:10.1037/a0017901
44. Reese, R. J., Toland, M. D., Slone, N. C., & Norsworthy, L. A., (2010). Effect of client feedback on couple psychotherapy outcomes. Psychotherapy:Theory, Research, Practice, Training, 47, 616–630. doi:10.1037/a0021182
45. Rise, M. B., Eriksen, L., Grimstad, H., & Steinsbekk, A., (2012). The short-term effect on alliance and satisfaction of using patient feedback scales in mental health out-patient treatment:A randomised controlled trial. BMC Health Services Research, 12, 348. doi:10.1186/1472-6963-12-348
46. Rubin, D. B., (1987). Multiple imputation for nonresponse in surveys. New York:Wiley.
47. Schotte, C., & De Doncker, D., (1994). ADP IV questionnaire. Belgium:University Hospital Antwerp:Antwerp.
48. Schotte, C., & De Doncker, D., (2000). De ADP-IV:een vragenlijst voor therapeutisch georiënteerde diagnostiek van persoonlijkheidsstoornissen. Psychopraxis, 2, 124–130. doi:10.1007/BF03071865
49. Schuman, D. L., Slone, N. C., Reese, R. J., & Duncan, B., (2015). Efficacy of client feedback in group psychotherapy with soldiers referred for substance abuse treatment. Psychotherapy Research, 25, 396–407. doi:10.1080/10503307.2014.900875
50. Shadish, W. R., Matt, G. E., Navarro, A. M., & Philips, G., (2000). The effects of psychological therapies under clinically representative conditions:A meta-analysis. Psychological Bulletin, 126, 512–529. doi:10.1037/0033-2909.126.4.512
51. Sheehan, D. V., Lecrubier, Y., Sheehan, K. H., Amorim, P., Janavs, J., & Weiler, E., (1998). The mini-international neuropsychiatric interview (M.I.N.I.):The development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. Journal of Clinical Psychiatry, 59, 22–33.
52. Shimokawa, K., Lambert, M. J., & Smart, D. W., (2010). Enhancing treatment outcome of patients at risk of treatment failure:Meta-analytic and mega-analytic review of a psychotherapy quality assurance system. Journal of Consulting and Clinical Psychology, 78, 298–311. doi:10.1037/a0019247
53. Sinnema, H., Franx, G., & Van ‘t Land, H., (2010). Multidisciplinaire richtlijnen in de GGZ. [Multidisciplinary guidelines in mental health care]. Utrecht:Trimbos-instituut.
54. Slone, N. C., Reese, R. J., Mathews-Duvall, S., & Kodet, J. (2015). Evaluating the efficacy of client feedback in group psychotherapy. Group Dynamics:Theory, Research, and Practice, 19, 122–136.
55. Van Ginkel, J. R., (2010). SPSS syntax for applying rules for combining univariate estimates in multiple imputation. Retrieved March 2015, from www.socialsciences. leiden.edu/educationandchildstudies/childandfamilystudies/organisation/staffcfs/van-ginkel.html
56. Van Vliet, I. M., Leroy, H., & Van Megen, H. J. G. M., (2000). M.I.N.I. international neuropsychiatric interview; Dutch version 5.0.0.-R. Utrecht:Department of Psychiatry University Medical Center Utrecht.
57. Walfish, S., Mcalister, B., O'Donnell, P., & Lambert, M., (2012). An investigation of self-assessment bias in mental health providers. Psychological Reports, 110, 639–644. doi:10.2466/02.07.17.PR0.110.2.639-644
58. Weinstein, M. C., & Skinner, J. A., (2010). Comparative effectiveness and health care spending:Implications for reform. New England Journal of Medicine, 362, 460–465. doi:10.1056/NEJMsb0911104
59. Weiss, A. P., Guidi, J., & Fava, M., (2009). Closing the efficacy-effectiveness gap:Translating both the what and the how from randomized controlled trials to clinical practice. The Journal of Clinical Psychiatry, 70, 446–449. doi:10.4088/JCP.08com04901
60. Westert, G. P., Van den Berg, M. J., Zwakhalse, S. L. N., Heijink, R., De Jong, J. D., & Verkleij, H., (2010). Zorgbalans 2010:de prestaties van de Nederlandse zorg. [Care balance 2010:the performance of Dutch health care]. Houten:Bohn Stafleu van Loghum.