The effect of outcome monitoring feedback to clinicians and patients in short and long-term psychotherapy: A randomized controlled trial

Psychotherapy Research

Volumn 24, Issue 6, 2014, Pages 629-639

  De Jong, Kim ^a   Timman, Reinier ^a   Hakkaart Van Roijen, Leona ^a   Vermeulen, Pascal ^b   Kooiman, Kees ^a   Passchier, Jan ^c   Busschbach, Jan Van ^a  

^a ERASMUS MEDICAL CENTER   (Netherlands)

^b Institute for Directive Interventions   (Netherlands)

^c VU UNIVERSITY AMSTERDAM   (Netherlands)

Author keywords

feedback; outcome monitoring; outpatients; psychotherapy research

Indexed keywords

ADAPTIVE BEHAVIOR; ADULT; CONTROLLED STUDY; FEMALE; HUMAN; MALE; MIDDLE AGED; PSYCHOTHERAPY; RANDOMIZED CONTROLLED TRIAL; STANDARDS; TIME; TREATMENT OUTCOME;

ADULT; FEEDBACK, PSYCHOLOGICAL; FEMALE; HUMANS; MALE; MIDDLE AGED; OUTCOME AND PROCESS ASSESSMENT (HEALTH CARE); PSYCHOTHERAPY; TIME FACTORS;

EID: 84900855353     PISSN: 10503307     EISSN: 14684381     Source Type: Journal    
DOI: 10.1080/10503307.2013.871079     Document Type: Article

References (37)

1. Bickman, L. (2008). A measurement feedback system (MFS) is necessary to improve mental health outcomes. Journal of American Academy of Child and Adolescent Psychiatry, 47, 1114–1119. doi:10.1097/CHI.0b013e3181825af8
2. Bickman, L., Douglas Kelley, S., Breda, C., De Andrade, A. R., & Riemer, M. (2011). Effects of routine feedback to clinicians on youth mental health outcomes: A randomized cluster design. Psychiatric Services, 62, 1423–1429. doi:10.1176/appi.ps.002052011
3. Boswell, J. F., Kraus, D. R., Miller, S. D., & Lambert, M. J. (2013). Implementing routine outcome monitoring in clinical practice: Benefits, challenges, and solutions. Psychotherapy Research, Epub ahead of print.
4. Byrne, S. L., Hooke, G. R., Newnham, E. A., & Page, A. C. (2012). The effects of progress monitoring on subsequent readmission to psychiatric care: A six-month follow-up. Journal of Affective Disorders, 137, 113–116. doi:10.1016/j.jad.2011.12.005
5. Carlier, I. V. E., Meuldijk, D., Van Vliet, I. M., Van Fenema, E., Van der Wee, N. J. A., & Zitman, F. G. (2012). Routine outcome monitoring and feedback on physical or mental health status: evidence and theory. Journal of Evaluation in Clinical Practice, 104–110. doi:10.1111/j.1365-2753.2010.01543.x.
6. Cohen, J. (1992). A power primer. Psychological Bulletin, 112(1), 155–159. doi:10.1037/0033-2909.112.1.155
7. de Beurs, E., den Hollander-Gijsman, M., Buwalda, V., Trijsburg, W., & Zitman, F. (2005). De Outcome Questionnaire (OQ−45): een meetinstrument voor meer dan alleen psychische klachten [The Outcome Questionnaire (OQ-45): An instrument that measures more than psychological distress alone]. De Psycholoog, 40, 53–63.
8. De Jong, K. (2012). De rol van de behandelaar: de ‘vergeten’ factor in ROM [The role of the therapist: The ‘forgotten’ factor in routine outcome monitoring]. Tijdschrift voor Psychiatrie, 54, 197–201.
9. De Jong, K., Nugter, M. A., Lambert, M. J., & Burlingame, G. M. (2009). Handleiding voor afname en scoring van de Outcome Questionnaire (OQ−45). Salt Lake City, UT: OQ Measures.
10. Evans, C., Connell, J., Barkham, M., Margison, F., McGrath, G., & Mellor-Clark, J. (2002). Towards a standardised brief outcome measure: psychometric properties and utility of the CORE-OM. The British Journal of Psychiatry, 180, 51–60. doi:10.1192/bjp.180.1.51
11. Hannan, C., Lambert, M. J., Harmon, C., Nielsen, S. L., Smart, D. W., & Shimokawa, K. (2005). A lab test and algorithms for identifying clients at risk for treatment failure. Journal of Clinical Psychology, 61, 155–163. doi:10.1002/jclp.20108
12. Harmon, C., Hawkins, E. J., Lambert, M. J., Slade, K., & Whipple, J. L. (2005). Improving outcomes for poorly responding clients: The use of clinical support tools and feedback to clients. Journal of Clinical Psychology, 61, 175–185. doi:10.1002/jclp.20109
13. Hatfield, D., McCullough, L., Frantz, S. H., & Krieger, K. (2010). Do we know when our clients get worse? An investigation of therapists' ability to detect negative client change. Clinical Psychology & Psychotherapy, 17, 25–32. doi:10.1002/cpp.656
14. Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research, 77, 81–112. doi:10.3102/003465430298487
15. Hawkins, E. J., Lambert, M. J., Vermeersch, D. A., Slade, K. L., & Tuttle, K. C. (2004). The therapeutic effects of providing patient progress information to therapists and patients. Psychotherapy Research, 14, 308–327. doi:10.1093/ptr/kph027
16. Howard, K. I., Moras, K., Brill, P. L., Martinovich, Z., & Lutz, W. (1996). Evaluation of psychotherapy: Efficacy, effectiveness, and patient progress. American Psychologist, 51, 1059–1064. doi:10.1037/0003-066X.51.10.1059
17. Jacobson, N. S., & Truax, P. (1991). Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59, 12–19. doi:10.1037/0022-006X.59.1.12
18. Jamtvedt, G., Young, J. M., Kristoffersen, D. T., O'Brien, M. A., & Oxman, A. D. (2006). Audit and feedback: Effects on professional practice and health care outcomes. Cochrane Database of Systematic Reviews, 2, CD000259.
19. Kluger, A. N., & DeNisi, A. (1996). The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychological Bulletin, 119, 254–284. doi:10.1037/0033-2909.119.2.254
20. Knaup, C., Koesters, M., Schoefer, D., Becker, T., & Puschner, B. (2009). Effect of feedback of treatment outcome in specialist mental healthcare: Meta-analysis. The British Journal of Psychiatry, 195, 15–22. doi:10.1192/bjp.bp.108.053967
21. Kraus, D. R., Seligman, D. A., & Jordan, J. R. (2005). Validation of a behavioral health treatment outcome and assessment tool designed for naturalistic settings: The Treatment Outcome Package. Journal of Clinical Psychology, 61, 285–314. doi:10.1002/jclp.20084
22. Lambert, M. J., Morton, J. J., Hatfield, D. R., Harmon, C., Hamilton, S., & Shimokawa, K. (2004). Administration and scoring manual for the OQ−45.2 (Outcome Questionnaire) (3rd ed.). Wilmington, DE: American Professional Credentialling Services.
23. Lambert, M. J., & Ogles, B. M. (2004). The efficacy and effectiveness of psychotherapy. In M. J. Lambert (Ed.), Bergin and Garfield's handbook of psychotherapy and behavior change (5th ed., pp. 139–193). New York: John Wiley & Sons.
24. Lambert, M. J., Whipple, J. L., Hawkins, E. J., Vermeersch, D. A., Nielsen, S. L., & Smart, D. W. (2003). Is it time for clinicians to routinely track patient outcome? A meta-analysis. Clinical Psychology: Science & Practice, 10, 288–301. doi:10.1093/clipsy.bpg025
25. Marshall, S., Haywood, K., & Fitzpatrick, R. (2006). Impact of patient-reported outcome measures on routine practice: a structured review. Journal of Evaluation in Clinical Practice, 12, 559–568. doi:10.1111/j.1365-2753.2006.00650.x
26. Miller, S. D., Duncan, B. L., Sorrell, R., & Brown, G. S. (2005). The partners for change outcome management system. Journal of Clinical Psychology, 61, 199–208. doi:10.1002/jclp.20111
27. Newnham, E. A., Hooke, G. R., & Page, A. C. (2010). Progress monitoring and feedback in psychiatric care reduces depressive symptoms. Journal of Affective Disorders, 127, 139–146. doi:10.1016/j.jad.2010.05.003
28. Reese, R. J., Norsworthy, L. A., & Rowlands, S. R. (2009). Does a continuous feedback system improve psychotherapy outcome? Psychotherapy: Theory, Research, Practice, Training, 46, 418–431. doi:10.1037/a0017901
29. Riemer, M., & Bickman, L. (2011). Using program theory to link social psychology and program evaluation. In M. M. Mark, S. I. Donaldson & B. Campbell (Eds.), Social psychology and evaluation. New York: Guilford Press.
30. Sapyta, J., Riemer, M., & Bickman, L. (2005). Feedback to clinicians: Theory, Research and practice. Journal of Clinical Psychology: In Session, 61, 145–153. doi:10.1002/jclp.20107
31. Shimokawa, K., Lambert, M. J., & Smart, D. W. (2010). Enhancing treatment outcome of patients at risk of treatment failure: Meta-analytic and mega-analytic review of a psychotherapy quality assurance system. Journal of Consulting and Clinical Psychology, 78, 298–311. doi:10.1037/a0019247
32. Simon, W., Lambert, M. J., Busath, G., Vazquez, A., Berkeljon, A., & Hyer, K. (2013). Effects of providing patient progress feedback and clinical support tools to psychotherapists in an inpatient eating disorders treatment program: A randomized controlled study. Psychotherapy Research, 23, 287–300. doi:10.1080/10503307.2013.787497
33. Simon, W., Lambert, M. J., Harris, M. W., Busath, G., & Vazquez, A. (2012). Providing patient progress information and clinical support tools to therapists: Effects on patients at risk of treatment failure. Psychotherapy Research, 22, 638–647. doi:10.1080/10503307.2012.698918
34. Slade, K., Lambert, M. J., Harmon, S., Smart, D. W., & Bailey, R. (2008). Improving psychotherapy outcome: The use of immediate electronic feedback and revised clinical support tools. Clinical Psychology & Psychotherapy, 15, 287–303. doi:10.1002/cpp.594
35. Thalheimer, W., & Cook, S. (2002). How to calculate effect sizes from published research articles: A simplified methodology Retrieved February 2006, from http://work-learning.com/effect_sizes.htm.
36. Trauer, T. (Ed.). (2010). Outcome measurement in mental health. Theory and practice. Cambridge: Cambridge University Press.
37. Veloski, J., Boex, J. R., Grasberger, M. J., Evans, A., & Wolfson, D. B. (2006). Systematic review of the literature on assessment, feedback and physicians' clinical performance: BEME Guide No. 7. Medical Teacher, 28, 117–128. doi:10.1080/01421590600622665