Beyond measures and monitoring: Realizing the potential of feedback-informed treatment

Psychotherapy

Volumn 52, Issue 4, 2015, Pages 449-457

  Miller, Scott D ^a   Hubble, Mark A ^a   Chow, Daryl ^a   Seidel, Jason ^a  

^a International Center for Clinical Excellence   (United States)

Author keywords

development; Expertise; Professional; Routine outcome measurement; Therapist factors

Indexed keywords

CLINICAL PRACTICE; HUMAN; META ANALYSIS; MONITORING; OUTCOME ASSESSMENT; PSYCHOTHERAPY; FEEDBACK SYSTEM; HEALTH CARE QUALITY; HUMAN RELATION; MENTAL DISORDERS; PSYCHOLOGY; PSYCHOMETRY; REPRODUCIBILITY; STANDARDS; STATISTICS AND NUMERICAL DATA; TREATMENT OUTCOME;

FEEDBACK; HUMANS; MENTAL DISORDERS; OUTCOME AND PROCESS ASSESSMENT (HEALTH CARE); PROFESSIONAL-PATIENT RELATIONS; PSYCHOMETRICS; PSYCHOTHERAPY; QUALITY ASSURANCE, HEALTH CARE; REPRODUCIBILITY OF RESULTS;

EID: 84949671813     PISSN: 00333204     EISSN: 19391536     Source Type: Journal    
DOI: 10.1037/pst0000031     Document Type: Article

References (83)

1. Amble, I., Gude, T., Stubdal, S., Andersen, B. J., & Wampold, B. E. (2015). The effect of implementing the Outcome Questionnaire±45.2 feedback system in Norway: A multisite randomized clinical trial in a naturalistic setting. Psychotherapy Research, 6, 669-677. http://dx.doi .org/10.1080/10503307.2014.928756
2. Anderson, T., Ogles, B. M., Patterson, C. L., Lambert, M. J., & Vermeersch, D. A. (2009). Therapist effects: Facilitative interpersonal skills as a predictor of therapist success. Journal of Clinical Psychology, 65, 755-768. http://dx.doi.org/10.1002/jclp.20583
3. Anderson, T., Patterson, C. L., & Weis, A. (2007). Facilitative interpersonal skills performance analysis rating method. Unpublished coding manual. Department of Psychology, Ohio University, Athens, Ohio.
4. Baldwin, S. A., Wampold, B. E., & Imel, Z. E. (2007). Untangling the alliance±outcome correlation: Exploring the relative importance of therapist and patient variability in the alliance. Journal of Consulting and Clinical Psychology, 75, 842-852. http://dx.doi.org/10.1037/0022-006X .75.6.842
5. Barlow, D. H. (2004). Psychological treatments. American Psychologist, 59, 869-878.
6. Bertolino, B., & Miller, S. D. (Eds.). (2012). ICCE manuals on feedbackinformed treatment (Vols. 1-6). Chicago, IL: ICCE Press.
7. Bickman, L., Kelley, S. D., Breda, C., de Andrade, A. R., & Riemer, M. (2011). Effects of routine feedback to clinicians on mental health outcomes of youths: Results of a randomized trial. Psychiatric Services, 62, 1423-1429. http://dx.doi.org/10.1176/appi.ps.002052011
8. Bordin, E. S. (1979). The generalizability of the psychoanalytic concept of the working alliance. Psychotherapy: Theory, Research & Practice, 16, 252-260. http://dx.doi.org/10.1037/h0085885
9. Boswell, J. F., Kraus, D. R., Miller, S. D., & Lambert, M. J. (2015). Implementing routine outcome monitoring in clinical practice: Benefits, challenges, and solutions. Psychotherapy Research, 25, 6-19. http://dx .doi.org/10.1080/10503307.2013.817696
10. Brown, J. (2015). Measurement feedback good outcomes. http://www .psychoutcomes.org/DecisionSupportToolkit/ToolkitUsageAnd Outcomes. Retrieved October 15, 2015.
11. Brownson, R. C., Kreuter, M. W., Arrington, B. A., & True, W. R. (2006). Translating scientific discoveries into public health action: How can schools of public health move us forward? Public Health Reports, 121, 97-103.
12. Carlier, I. V., Meuldijk, D., Van Vliet, I. M., Van Fenema, E., Van der Wee, N. J., & Zitman, F. G. (2012). Routine outcome monitoring and feedback on physical or mental health status: Evidence and theory. Journal of Evaluation in Clinical Practice, 18, 104-110. http://dx.doi .org/10.1111/j.1365-2753.2010.01543.x
13. Chalkidou, K. (July, 2009). Comparative effectiveness review within the U. K.'s national institute of health and clinical excellence (Issue Brief No. 1296). New York, NY: The Commonwealth Fund. Retrieved from http:// www.commonwealthfund.org/~/media/Files/Publications/Issue%20Brief/ 2009/Jul/Chalkidou/1296_Chalkidou_UK_CER_issue_brief_717.pdf
14. Chambless, D. L., Baker, M. J., Baucom, D. H., Beutler, L. E., Calhoun, K. S., Crits-Christoph, P., . . . Woody, S. R. (1998). Update on empirically validated therapies II. The Clinical Psychologist, 51, 3-16.
15. Chambless, D. L., & Hollon, S. D. (1998). Defining empirically supported therapies. Journal of Consulting and Clinical Psychology, 66, 7-18. http://dx.doi.org/10.1037/0022-006X.66.1.7
16. Chow, D. (2014). The study of supershrinks: Development and deliberate practices of highly effective psychotherapists (Doctoral dissertation, Curtin University). Retrieved from http://espace.library.curtin.edu.au/ R?func=dbin-jump-full&local_base=gen01-era02&object_id=200923
17. Chow, D., & Miller, S. D. (2012). Retrospective analysis of psychotherapists' involvement in deliberate practice (RAPIDPractice). Unpublished manuscript.
18. Chow, D. L., Lu, S., Owen, J., & Miller, S. D. (2015). Difficult conversations in therapy (DCT): Can psychotherapists learn in an environment of immediate feedback with simulated client video vignettes? Manuscript submitted for publication.
19. Chow, D. L., Miller, S. D., Seidel, J. A., Kane, R. T., Thornton, J. A., & Andrews, W. P. (2015). The role of deliberate practice in the development of highly effective psychotherapists. Psychotherapy, 52, 337-345. http://dx.doi.org/10.1037/pst0000015
20. Colvin, G. (2008). Talent is overrated: What really separates world-class performers from everybody else. New York, NY: Penguin.
21. Cummings, N. A. (1986). The dismantling of our health system: Strategies for the survival of psychological practice. American Psychologist, 41, 426-431. http://dx.doi.org/10.1037/0003-066X.41.4.426
22. Cummings, N., & O'Donahue, W. (2008). Eleven blunders that are crippling psychotherapy. New York, NY: Routledge.
23. de Jong, K., van Sluis, P., Nugter, M. A., Heiser, W. J., & Spinhoven, P. (2012). Understanding the differential impact of outcome monitoring: Therapist variables that moderate feedback effects in a randomized clinical trial. Psychotherapy Research, 22, 464-474. http://dx.doi.org/ 10.1080/10503307.2012.673023
24. Department of Health. (2007). How to change clinical practice: Understand, identify, overcome barriers to change. London, England: National Institute for Health and Clinical Excellence.
25. Devlin, N. J., & Appleby, J. (2010). Getting the most out of PROMS: Putting health outcomes at the heart of NHS decision-making. London, England: The King's Fund.
26. Drapeau, M. (2012). The value of tracking in psychotherapy. Integrating Science and Practice, 2, 2-6.
27. Duncan, B. L., Miller, S. D., Wampold, B. E., & Hubble, M. A. (Eds.). (2010). The heart and soul of change: Delivering what works in therapy (2nd ed.). Washington, DC: APA Press. http://dx.doi.org/10.1037/ 12075-000
28. Ericsson, K. A. (2006). The Influence of experience and deliberate practice on the development of superior expert performance. In K. A. Ericsson, N. Charness, P. J. Feltovich, & R. R. Hoffman (Eds.), The Cambridge handbook of expertise and expert performance (pp. 683-704). New York, NY: Cambridge University Press. http://dx.doi.org/10.1017/ CBO9780511816796.038
29. Ericsson, K. A. (2009a). Enhancing the development of professional performance: Implications from the study of deliberate practice. In K. A. Ericsson (Ed.), Development of professional expertise: Toward measurement of expert performance and design of optimal learning environments (pp. 405-431). New York, NY: Cambridge University Press.
30. Ericsson, K. A. (Ed.). (2009b). Development of professional expertise: Toward measurement of expert performance and design of optimal learning environments. New York, NY: Cambridge University Press. http://dx.doi.org/10.1017/CBO9780511609817
31. Ericsson, K. A., Charness, N., Feltovich, P. J., & Hoffman, R. R. (Eds.). (2006). The Cambridge handbook of expertise and expert performance. New York, NY: Cambridge University Press. http://dx.doi.org/10.1017/ CBO9780511816796
32. Ericsson, K. A., Krampe, R. T., & Tesch-Romer, C. (1993). The role of deliberate practice in the acquisition of expert performance. Psychological Review, 100, 363-406. http://dx.doi.org/10.1037/0033-295X.100.3 .363
33. Ericsson, K. A., & Staszewski, J. (1989). Skilled memory and expertise: Mechanisms of exceptional performance. In D. Klahr & K. Kotovsky (Eds.), Complex information processing: The impact of Herbert A. Simon (pp. 265-268). Hillsdale, NJ: Erlbaum.
34. Fixsen, D., Blasé, K., Naoom, S., & Wallace, F. (2009). Core implementation components. Research on Social Work Practice, 19, 531-540. http://dx.doi.org/10.1177/1049731509335549
35. Garfield, S. (1997). The therapist as a neglected variable in psychotherapy research. Clinical Psychology: Science and Practice, 4, 40-43. http:// dx.doi.org/10.1111/j.1468-2850.1997.tb00097.x
36. Geller, J., Norcross, J., & Orlinksy, D. (2005). The psychotherapists own psychotherapy: Patient and clinician perspectives. New York, NY: Oxford University Press.
37. Goldberg, S. B., Rousmaniere, T., Miller, S. D., Whipple, J., Nielsen, S. L., Hoyt, W. T., & Wampold, B. E. (in press). Do psychotherapists improve with time and experience? A longitudinal analysis of real world outcome data. Journal of Consulting and Clinical Psychology.
38. Goodman, J., McKay, J., & DePhilippis, D. (2013). Progress monitoring in mental health and addiction treatment: A means of improving care. Professional Psychology: Research and Practice, 44, 231-246. http:// dx.doi.org/10.1037/a0032605
39. Horvath, A. O., Del Re, A. C., Flückiger, C., & Symonds, D. (2011). Alliance in individual psychotherapy. Psychotherapy, 48, 9-16. http:// dx.doi.org/10.1037/a0022186
40. Howard, K. I., Moras, K., Brill, P. L., Martinovich, Z., & Lutz, W. (1996). Evaluation of psychotherapy: Efficacy, effectiveness, and patient progress. American Psychologist, 51, 1059-1064. http://dx.doi.org/10.1037/ 0003-066X.51.10.1059
41. Hubble, M. A., Duncan, B. L., & Miller, S. D. (Eds.). (1999). The heart and soul of change: What works in therapy. Washington, DC: American Psychological Association. http://dx.doi.org/10.1037/11132-000
42. Hubble, M. A., & Miller, S. D. (2001). In pursuit of folly. Academy of Clinical Psychology Bulletin, 7, 2-7.
43. Kiesler, D. (1966). Some myths of psychotherapy research and the search for a paradigm. Psychological Bulletin, 65, 110-136. http://dx.doi.org/ 10.1037/h0022911
44. Knaup, C., Koesters, M., Schoefer, D., Becker, T., & Puschner, B. (2009). Effect of feedback of treatment outcome in specialist mental healthcare: Meta-analysis. The British Journal of Psychiatry, 195, 15-22. http://dx .doi.org/10.1192/bjp.bp.108.053967
45. Lambert, M. J. (2010). Yes, it is time for clinicians to routinely monitor treatment outcome. In B. Duncan, S. Miller, B. Wampold, & M. Hubble (Eds.), The heart and soul of change: Delivering what works in treatment (pp. 239-266). Washington, DC: APA Press. http://dx.doi.org/10 .1037/12075-008
46. Lambert, M. J. (2012). Helping clinicians to use and learn from researchbased systems: The OQ-analyst. Psychotherapy, 49, 109-114. http://dx .doi.org/10.1037/a0027110
47. Lambert, M. J., & Shimokawa, K. (2011). Collecting client feedback. Psychotherapy, 48, 72-79. http://dx.doi.org/10.1037/a0022238
48. Lambert, M. J., Whipple, J. L., Hawkins, E. J., Vermeersch, D. A., Nielsen, S. L., & Smart, D. W. (2003). Is it time for clinicians to routinely track patient outcome? A meta-analysis. Clinical Psychology: Science and Practice, 10, 288-301. http://dx.doi.org/10.1093/clipsy.bpg025
49. Lehrer, J. (December 13, 2010). The truth wears off: Is there something wrong with the scientific method? The New Yorker. Retrieved from http://www.newyorker.com/magazine/2010/12/13/the-truth-wears-off
50. Luborsky, L., Crits-Christoph, P., McLellan, A. T., Woody, G., Piper, W., Liberman, B., . . . Pilkonis, P. (1986). Do therapists vary much in their success? Findings from four outcome studies. American Journal of Orthopsychiatry, 56, 501-512.
51. Malikiosi-Loizos, M. (2013). Personal therapy for future therapists: Reflections on a still debated issue. European Journal of Counseling Psychology, 2, 33-50. http://dx.doi.org/10.5964/ejcop.v2i1.4
52. Malouf, J. (2012). The need for empirically supported psychology training standards. Psychotherapy in Australia, 18, 28-32. McLeod, B. D. (2011). Relation of the alliance with outcomes in youth psychotherapy: A meta-analysis. Clinical Psychology Review, 31, 603- 616. http://dx.doi.org/10.1016/j.cpr.2011.02.001
53. McLeod, B. D. (2011). Relation of the alliance with outcomes in youth psychotherapy: A meta-analysis. Clinical Psychology Review, 31, 603- 616
54. Miller, S. (2012). Revolution in Swedish mental health practice. http:// www.scottdmiller.com/feedback-informed-treatment-fit/revolution-in-swedish-mental-health-practice-the-cognitive-behavioral-therapymonopoly- gives-way/. Retrieved October 13, 2015.
55. Miller, S. D., & Duncan, B. L. (2000). The Outcome and Session Rating Scales. Chicago, IL: International Center for Clinical Excellence.
56. Miller, S. D., Duncan, B. L., & Hubble, M. A. (2004). Beyond integration: The triumph of outcome over process in clinical practice. Psychotherapy in Australia, 10, 2-19.
57. Miller, S. D., Duncan, B. L., Sorrell, R., & Brown, G. S. (2005). The partners for change outcome management system. Journal of Clinical Psychology, 61, 199-208. http://dx.doi.org/10.1002/jclp.20111
58. Miller, S. D., Hubble, M. A., Chow, D. L., & Seidel, J. A. (2013). The outcome of psychotherapy: Yesterday, today, and tomorrow. Psychotherapy, 50, 88-97. http://dx.doi.org/10.1037/a0031097
59. Miller, S. D., Hubble, M. A., & Duncan, B. L. (2007). Supershrinks. Psychotherapy Networker, 31, 26-35, 56.
60. Miller, S. D., Mee-Lee, D., & Plum, W. (2012). Feedback Readiness Index and Fidelity Measure (FRIFM). Chicago: ICCE.
61. Miller, S., & Schuckard, E. (2014). Psychometrics of the ORS and SRS. Results from RCT's and meta-analyses of routine outcome monitoring & feedback. The available evidence [Slides]. Retrieved http://www.slideshare.net/scottdmiller/measures-and-feedback-miller-schuckard-2014
62. Najavits, L., & Strupp, H. (1994). Differences in the effectiveness of psychodynamic therapists: Process±outcome study. Psychotherapy: Theory, Research & Practice, 31, 114-123. http://dx.doi.org/10.1037/ 0033-3204.31.1.114
63. Nathan, P. E. (1997). Fiddling while psychology burns? Register Report, 23, 1-10.
64. Neimeyer, G., Taylor, J., & Wear, D. (2009). Continuing education in psychology: Outcomes, evaluation, and mandates. Professional Psychology: Research and Practice, 40, 617-624. http://dx.doi.org/10.1037/ a0016655
65. Nissen-Lie, H. A., Monsen, J. T., & Rønnestad, M. H. (2010). Therapist predictors of early patient-rated working alliance: A multilevel approach. Psychotherapy Research, 20, 627-646. http://dx.doi.org/10 .1080/10503307.2010.497633
66. Orlinksy, D., & Rønnestad, M. (2005). How psychotherapists develop: A study of therapeutic work and professional growth. Washington, DC: American Psychological Press.
67. Owen, J., Miller, S. D., Seidel, J. A., & Chow, D. L. (in press). The alliance in the treatment of military adolescents. Journal of Consulting and Clinical Psychology.
68. Pinsof, W. M., Zinbarg, R. E., Lebow, J. L., Knobloch-Fedders, L. M., Durbin, E., Chambers, A., . . . Friedman, G. (2009). Laying the foundation for progress research in family, couple, and individual therapy: The development and psychometric features of the initial systemic therapy inventory of change. Psychotherapy Research, 19, 143-156. http://dx.doi.org/10.1080/10503300802669973
69. Rønnestad, M., & Orlinsky, D. (2005). Therapeutic work and professional development: Main findings and practical implications of a long-term international study. Psychotherapy Bulletin, 40, 27-32.
70. Sanderson, W. C. (2003). Why empirically supported psychological treatments are important. Behavior Modification, 27, 290-299. http://dx.doi .org/10.1177/0145445503027003002
71. Stiles, W. B., Barkham, M., Twigg, E., Mellor-Clark, J., & Cooper, M. (2006). Effectiveness of cognitive±behavioural, person-centred and psychodynamic therapies as practised in UK National Health Service settings. Psychological Medicine, 36, 555-566. http://dx.doi.org/10 .1017/S0033291706007136
72. Strupp, H. H., & Wallach, M. S. (1965). A further study of psychiatrists' responses in quasitherapy situations. Behavioral Science, 10, 113-134. http://dx.doi.org/10.1002/bs.3830100202
73. Substance Abuse and Mental Health Services Administration. (2012). Partners for Change Outcome Management System (PCOMS): International Center for Clinical Excellence. Retrieved from http://www.nrepp .samhsa.gov/ViewIntervention.aspx?id=249
74. Thomason, T. C. (2010). The trend toward evidence-based practice and the future of psychotherapy. American Journal of Psychotherapy, 64, 29- 38.
75. van der Wees, P. (December 3, 2013). Patient-reported outcomes in the Netherlands: Routine use in clinical practice and performance measurement [Slides]. Retrieved from http://www.kingsfund.org.uk/sites/files/kf/media/phil-van-der-wees-proms-netherlands-dec13.pdf
76. van Oenen, F. J., Shipper, S., Van, R., Schoevers, R., Visch, I., Peen, J., & Dekker, J. (in press). Efficacy of immediate patient feedback in emergency psychiatry: A randomized controlled trial in a crisis intervention & brief therapy team. BMC Psychiatry, 13, 331.
77. Walfish, S., McAlister, B., O'Donnell, P., & Lambert, M. J. (2012). An investigation of self-assessment bias in mental health providers. Psychological Reports, 110, 639-644. http://dx.doi.org/10.2466/02.07.17.PR0.110.2.639-644
78. Wampold, B. E., & Brown, G. S. (2005). Estimating variability in outcomes attributable to therapists: A naturalistic study of outcomes in managed care. Journal of Consulting and Clinical Psychology, 73, 914-923. http://dx.doi.org/10.1037/0022-006X.73.5.914
79. Wampold, B. E., & Imel, Z. E. (2015). The great psychotherapy debate: The evidence for what makes psychotherapy work. New York, NY: Routledge.
80. Watkins, D., Jr. (2011). Does psychotherapy supervision contribute to patient outcomes? Considering thirty years of research. The Clinical Supervisor, 30, 235-256. http://dx.doi.org/10.1080/07325223.2011 .619417
81. Wolpert, M. (2014). Uses and abuses of patient reported outcome measures (PROMs): Potential iatrogenic impact of PROMs implementation and how it can be mitigated. Administration and Policy in Mental Health and Mental Health Services Research, 41, 141-145. http://dx.doi.org/10 .1007/s10488-013-0509-1
82. Yong, E. (2012). Replication studies: Bad copy. Nature, 485, 298-300. http://dx.doi.org/10.1038/485298a
83. Young, A. S., Niv, N., Chinman, M., Dixon, L., Eisen, S. V., Fischer, E. P., . . . Owen, R. R. (2011). Routine outcomes monitoring to support improving care for schizophrenia: Report from the VA Mental Health QUERI. Community Mental Health Journal, 47, 123-135. http://dx.doi .org/10.1007/s10597-010-9328-y