Feedback from Outcome Measures and Treatment Effectiveness, Treatment Efficiency, and Collaborative Practice: A Systematic Review

Administration and Policy in Mental Health and Mental Health Services Research

Volumn 43, Issue 3, 2016, Pages 325-343

  Gondek, Dawid ^a   Edbrooke Childs, Julian ^a   Fink, Elian ^a   Deighton, Jessica ^a   Wolpert, Miranda ^a  

^a ANNA FREUD CENTRE   (United Kingdom)

Author keywords

Collaboratve practice; Feedback; Outcome evaluation; Outcome management; Outcome measures

Indexed keywords

COOPERATION; FEEDBACK SYSTEM; HUMAN; MENTAL DISORDERS; MENTAL HEALTH SERVICE; OUTCOME ASSESSMENT; TREATMENT OUTCOME;

COOPERATIVE BEHAVIOR; FEEDBACK; HUMANS; MENTAL DISORDERS; MENTAL HEALTH SERVICES; OUTCOME ASSESSMENT (HEALTH CARE); TREATMENT OUTCOME;

EID: 84953425824     PISSN: 0894587X     EISSN: 15733289     Source Type: Journal    
DOI: 10.1007/s10488-015-0710-5     Document Type: Article

References (70)

1. Ackerman, S. J., & Hilsenroth, M. J. (2003). A review of therapist characteristics and techniques positively impacting the therapeutic alliance. Clinical Psychology Review,23(1), 1–33. doi:10.1016/S0272-7358(02)00146-0.
2. American Psychiatric Association. (2000). Diagnostic criteria from DSM-IV-TR. Washington, DC: American Psychiatric Association.
3. American Psychiatric Association. (2015). Understanding mental disorders: your guide to DSM-5 (1st ed.). Washington, DC: American Psychiatric Association.
4. Anker, M. G., Duncan, B. L., & Sparks, J. A. (2009). Using client feedback to improve couple therapy outcomes: A randomized clinical trial in a naturalistic setting. Journal of Consulting and Clinical Psychology,77(4), 693–704. doi:10.1037/a0016062.
5. Ashaye, O. A., Livingston, G., & Orrell, M. W. (2003). Does standardized needs assessment improve the outcome of psychiatric day hospital care for older people? A randomized controlled trial. Aging & Mental Health,7(3), 195–199.
6. Bickman, L., Kelley, S. D., Breda, C., de Andrade, A. R., & Riemer, M. (2011). Effects of routine feedback to clinicians on youth mental health outcomes: A randomized cluster design. Psychiatric Services,62(12), 1423–1429. doi:10.1176/appi.ps.002052011.
7. Brodey, B. B., Cuffel, B., McCulloch, J., Tani, S., Maruish, M., Brodey, I., & Unützer, J. (2005). The acceptability and effectiveness of patient-reported assessments and feedback in a managed behavioral healthcare setting. American Journal of Managed Care,11(12), 774–780.
8. Byrne, S. L., Hooke, G. R., Newnham, E. A., & Page, A. C. (2012). The effects of progress monitoring on subsequent readmission to psychiatric care: A six-month follow-up. Journal of Affective Disorders,137(1–3), 113–116. doi:10.1016/j.jad.2011.12.005.
9. Carlier, I. V., Meuldijk, D., Van Vliet, I. M., Van Fenema, E., Van der Wee, N. J., & Zitman, F. G. (2012). Routine outcome monitoring and feedback on physical or mental health status: Evidence and theory. Journal of Evaluation in Clinical Practice,18(1), 104–110. doi:10.1111/j.1365-2753.2010.01543.x.
10. Carman, K. L., Dardess, P., Maurer, M., Sofaer, S., Adams, K., Bechtel, C., & Sweeney, J. (2013). Patient and family engagement: A framework for understanding the elements and developing interventions and policies. Health Affairs,32(2), 223–231. doi:10.1377/hlthaff.2012.113332/2/223.
11. Centre for Reviews and Dissemination. (2009). Systematic reviews: CRD’s guidance for undertaking reviews in healthcare. York: University of York.
12. Chen, J., Ou, L., & Hollis, S. J. (2013). A systematic review of the impact of routine collection of patient reported outcome measures on patients, providers and health organisations in an oncologic setting. BMC Health Services Research,13, 211. doi:10.1186/1472-6963-13-211.
13. Cisneros, E. P. (2010). Client/therapist feedback and the role of the alliance on psychotherapy outcomes. Unpublished doctoral dissertation, Loma Linda University, Ann Arbor, Ml.
14. Copeland, B. T. (2007). Outcome and process measure feedback as they effect therapy outcomes. Unpublished doctoral dissertation. George Fox University, Newberg, OR.
15. de Jong, K. (2014). Deriving implementation strategies for outcome monitoring feedback from theory, research and practice. Administration and Policy in Mental Health,. doi:10.1007/s10488-014-0589-6.
16. de Jong, K., van Sluis, P., Nugter, M. A., Heiser, W. J., & Spinhoven, P. (2012). Understanding the differential impact of outcome monitoring: Therapist variables that moderate feedback effects in a randomized clinical trial. Psychotherapy Research,22(4), 464–474. doi:10.1080/10503307.2012.673023.
17. Desroches, S., Lapointe, A., Deschenes, S. M., Gagnon, M. P., & Legare, F. (2011). Exploring dietitians’ salient beliefs about shared decision-making behaviors. Implementation Science,6, 57. doi:10.1186/1748-5908-6-57.
18. Duncan, E. A., & Murray, J. (2012). The barriers and facilitators to routine outcome measurement by allied health professionals in practice: A systematic review. BMC Health Services Research,12, 96. doi:10.1186/1472-6963-12-96.
19. Elwyn, G., Frosch, D., Thomson, R., Joseph-Williams, N., Lloyd, A., Kinnersley, P., & Barry, M. (2012). Shared decision making: A model for clinical practice. Journal of General Internal Medicine,27(10), 1361–1367. doi:10.1007/s11606-012-2077-6.
20. Galvinhill, P. R. (2001). The effects of providing feedback regarding client symptomatology on psychotherapy outcome. Unpublished doctoral dissertation, University of Cincinnati, Ann Arbor, MI.
21. Garfield, S. L. (1994). Research on client variables. In A. E. Bergin & S. L. Garfield (Eds.), Handbook of psychotherapy and behavior change. New York: Wiley.
22. Gilbody, S. M., House, A. O., & Sheldon, T. A. (2001). Routinely administered questionnaires for depression and anxiety: Systematic review. BMJ,322(7283), 406–409. doi:10.1136/bmj.322.7283.406.
23. Greenhalgh, J., Abhyankar, P., McCluskey, S., Takeuchi, E., & Velikova, G. (2013). How do doctors refer to patient-reported outcome measures (PROMS) in oncology consultations? Quality of Life Research,22(5), 939–950. doi:10.1007/s11136-012-0218-3.
24. Harmon, S. C., Lambert, M. J., Smart, D. M., Hawkins, E., Nielsen, S. L., Slade, K., & Lutz, W. (2007). Enhancing outcome for potential treatment failures: Therapist-client feedback and clinical support tools. Psychotherapy Research,17(4), 379–392.
25. Hawkins, E. J. (2004). The therapeutic effects of providing patient progress information to therapists and patients. Psychotherapy Research,14(3), 308–327. doi:10.1093/ptr/kph027.
26. Higgins, J., Altman, D., Gotzsche, P., Juni, P., Moher, D., Oxman, A., & Sterne, J. (2011). The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. BMJ,343, d5928. doi:10.1136/bmj.d5928.
27. Higgins, J. P. T., & Green, S. (2011). Cochrane handbook for systematic reviews of interventions. Retrieved July 20th, 2014, from www.cochrane-handbook.org
28. Jones, G. M., & Delany, T. (2014). What does collaborative practice mean within mental healthcare? A qualitative study exploring understandings and proposing a definition. Journal of Research in Interprofessional Practice and Education,3, 1–15.
29. Joosten, E. A., De Jong, C. A., de Weert-van Oene, G. H., Sensky, T., & van der Staak, C. P. (2011). Shared decision-making: Increases autonomy in substance-dependent patients. Substance Use and Misuse,46(8), 1037–1038. doi:10.3109/10826084.2011.552931.
30. Kluger, A. N., & De Nisi, A. (1996). The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychological Bulletin,119, 254–284. doi:10.1037/0033-2909.119.2.254.
31. Knaup, C., Koesters, M., Schoefer, D., Becker, T., & Puschner, B. (2009). Effect of feedback of treatment outcome in specialist mental healthcare: Meta-analysis. British Journal of Psychiatry,195(1), 15–22. doi:10.1192/bjp.bp.108.053967.
32. Lambert, M., Whipple, J., Hawkins, E., Vermeersch, D., Nielsen, S., & Smart, D. (2003). Is it time for clinicians to routinely track patient outcome? A meta-Analysis. Clinical Psychology: Science and Practice,10(3), 288–301. doi:10.1093/clipsy.bpg025.
33. Lambert, M. J., Whipple, J. L., Smart, D. W., Vermeersch, D. A., Nielsen, S. L., & Hawkins, E. J. (2001). The effects of providing therapists with feedback on patient progress during psychotherapy: Are outcomes enhanced? Psychotherapy Research,11(1), 49–68.
34. Lambert, M. J., Whipple, J. L., Vermeersch, D. A., Smart, D. W., Hawkins, E. J., Nielsen, S. L., & Goates, M. (2002). Enhancing psychotherapy outcomes via providing feedback on client progress: A replication. Clinical Psychology & Psychotherapy,9(2), 91–103. doi:10.1002/cpp.324.
35. Lester, M. C. (2012). The effectiveness of client feedback measures with adolescents in an acute psychiatric inpatient setting. Unpublished doctoral dissertation, University of Central Arkansas, Conway, AR.
36. Marshall, S., Haywood, K., & Fitzpatrick, R. (2006). Impact of patient-reported outcome measures on routine practice: A structured review. Journal of Evaluation in Clinical Practice,12(5), 559–568. doi:10.1111/j.1365-2753.2006.00650.x.
37. Marshall, M., Lockwood, A., Green, G., Zajac-Roles, G., Roberts, C., & Harrison, G. (2004). Systematic assessments of need and care planning in severe mental illness. Cluster randomised controlled trial. British Journal of Psychiatry,185, 163–168.
38. Michie, S., McCaffery, K., & Henegan, C. (2008). Monitoring as a learning and motivational tool. In P. Glasziou, L. Irwig, & J. K. Aronson (Eds.), Evidence-based medical monitoring: from principles to practice (pp. 123–139). Oxford: Blackwell Publishing Ltd.
39. Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2009). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. Journal of Clinical Epidemiology,62(10), 1006–1012. doi:10.1016/j.jclinepi.2009.06.005.
40. Murphy, K. P., Rashleigh, C. M., & Timulak, L. (2012). The relationship between progress feedback and therapeutic outcome in student counselling: A randomised control trial. Counselling Psychology Quarterly,25(1), 1–18. doi:10.1080/09515070.2012.662349.
41. Newnham, E. A., Hooke, G. R., & Page, A. C. (2010). Progress monitoring and feedback in psychiatric care reduces depressive symptoms. Journal of Affective Disorders,127(1–3), 139–146. doi:10.1016/j.jad.2010.05.003.
42. Popay, J., Roberts, H., Sowden, A., Petticrew, M., Arai, L., Rodgers, M.,… Duffy, S. (2006). Guidance on the conduct of narrative synthesis in systematic reviews. A Product from the ESRC Methods Programme.
43. Priebe, S., McCabe, R., Bullenkamp, J., Hansson, L., Lauber, C., Martinez-Leal, R., & Wright, D. J. (2007). Structured patient-clinician communication and 1-year outcome in communitymental healthcare. Cluster randomised controlled trial. British Journal of Psychiatry,. doi:10.1192/bjp.bp.107.036939.
44. Probst, T., Lambert, M. J., Dahlbender, R. W., Loew, T. H., & Tritt, K. (2014). Providing patient progress feedback and clinical support tools to therapists: Is the therapeutic process of patients on-track to recovery enhanced in psychosomatic in-patient therapy under the conditions of routine practice? Journal of Psychosomatic Research,76(6), 477–484. doi:10.1016/j.jpsychores.2014.03.010.
45. Probst, T., Lambert, M. J., Loew, T. H., Dahlbender, R. W., Gollner, R., & Tritt, K. (2013). Feedback on patient progress and clinical support tools for therapists: Improved outcome for patients at risk of treatment failure in psychosomatic in-patient therapy under the conditions of routine practice. Journal of Psychosomatic Research,75(3), 255–261. doi:10.1016/j.jpsychores.2013.07.003.
46. Puschner, B., Schofer, D., Knaup, C., & Becker, T. (2009). Outcome management in in-patient psychiatric care. Acta Psychiatrica Scandinavica,120(4), 308–319. doi:10.1111/j.1600-0447.2009.01397.x.
47. Reese, R. J., Norsworthy, L. A., & Rowlands, S. R. (2009a). Does a continuous feedback system improve psychotherapy outcome? Psychotherapy,46(4), 418–431. doi:10.1037/a0017901.
48. Reese, R. J., Toland, M. D., Slone, N. C., & Norsworthy, L. A. (2010). Effect of client feedback on couple psychotherapy outcomes. Psychotherapy,47(4), 616–630. doi:10.1037/a0021182.
49. Reese, R. J., Usher, E. L., Bowman, D. C., Norsworthy, L. A., Halstead, J. L., Rowlands, S. R., & Chisholm, R. R. (2009b). Using client feedback in psychotherapy training: An analysis of its influence on supervision and counselor self-efficacy. Training and Education in Professional Psychology,3(3), 157–168. doi:10.1037/a0015673.
50. Reeves, E. K. (2009). The use of psychotherapy feedback on client progress: Implications for training and clinical practice. New York: New York University.
51. Rennie, D. (2001). CONSORT revised—improving the reporting of randomized trials. JAMA,285, 2006–2007.
52. Riemer, M., Rosof-Williams, J., & Bickman, L. (2005). Theories related to changing clinician practice. Child & Adolescent Psychiatric Clinics of North America, 14(2), 241–254. doi:10.1016/j.chc.2004.05.002
53. Rise, M. B., Eriksen, L., Grimstad, H., & Steinsbekk, A. (2012). The short-term effect on alliance and satisfaction of using patient feedback scales in mental health out-patient treatment. A randomised controlled trial. BMC Health Services Research,12, 348. doi:10.1186/1472-6963-12-348.
54. Rothwell, P. M., McDowell, Z., Wong, C. K., & Dorman, P. J. (1997). Doctors and patients don’t agree: Cross sectional study of patients’ and doctors’ perceptions and assessments of disability in multiple sclerosis. BMJ,314(7094), 1580–1583.
55. Sapyta, J., Riemer, M., & Bickman, L. (2005). Feedback to clinicians: Theory, research, and practice. Journal of Clinical Psychology,61(2), 145–153. doi:10.1002/jclp.20107.
56. Scheier, M. F., & Carver, C. S. (2003). Goals and confidence as self-regulatory elements underlying health and illness behaviour. In L. D. Cameron & H. Leventhal (Eds.), Goals and confidence as self-regulatory elements underlying health and illness behaviour. London: Taylor Francis.
57. Schmidt, U., Landau, S., Pombo-Carril, M. G., Bara-Carril, N., Reid, Y., Murray, K., & Katzman, M. (2006). Does personalized feedback improve the outcome of cognitive-behavioural guided self-care in bulimia nervosa? A preliminary randomized controlled trial. British Journal of Clinical Psychology,45(Pt 1), 111–121. doi:10.1348/014466505X29143.
58. Simon, W., Lambert, M. J., Busath, G., Vazquez, A., Berkeljon, A., Hyer, K., & Berrett, M. (2013). Effects of providing patient progress feedback and clinical support tools to psychotherapists in an inpatient eating disorders treatment program: A randomized controlled study. Psychotherapy Research,23(3), 287–300. doi:10.1080/10503307.2013.787497.
59. Simon, W., Lambert, M. J., Harris, M. W., Busath, G., & Vazquez, A. (2012). Providing patient progress information and clinical support tools to therapists: Effects on patients at risk of treatment failure. Psychotherapy Research,22(6), 638–647. doi:10.1080/10503307.2012.698918.
60. Slade, K. (2008). Improving psychotherapy outcome: the use of immediate electronic feedback and revised clinical support tools. Unpublished doctoral dissertation, Brigham Young University, Provo.
61. Slade, K., Lambert, M. J., Harmon, S. C., Smart, D. W., & Bailey, R. (2008). Improving psychotherapy outcome: The use of immediate electronic feedback and revised clinical support tools. Clinical Psychology & Psychotherapy,15(5), 287–303. doi:10.1002/cpp.594.
62. Soeken, D. R., Manderscheid, R. W., Flatter, C. H., & Silbergeld, S. (1981). A controlled study of quantitative feedback in married-couples brief group psychotherapy. Psychotherapy Theory Research & Practice,18(2), 204–216. doi:10.1037/h0086081.
63. Thomson, R. G., Eccles, M. P., Steen, I. N., Greenaway, J., Stobbart, L., Murtagh, M. J., & May, C. R. (2007). A patient decision aid to support shared decision-making on anti-thrombotic treatment of patients with atrial fibrillation: Randomised controlled trial. Quality & Safety in Health Care,16(3), 216–223. doi:10.1136/qshc.2006.018481.
64. Trudeau, L. S. (2000). Effects of a clinical feedback system on client and therapist outcomes in a rural community mental health center. Unpublished doctoral dissertation, Iowa State University, Ames.
65. Truitt, K. G. (2011). Modeling treatment outcomes in eating disorders. Unpublished doctoral dissertation, Loma Linda University, Ann Arbor, MI.
66. Valderas, J. M., Kotzeva, A., Espallargues, M., Guyatt, G., Ferrans, C. E., Halyard, M. Y., & Alonso, J. (2008). The impact of measuring patient-reported outcomes in clinical practice: A systematic review of the literature. Quality of Life Research,17(2), 179–193. doi:10.1007/s11136-007-9295-0.
67. van Sonsbeek, M. A., Hutschemaekers, G. G., Veerman, J. W., & Tiemens, B. B. (2014). Effective components of feedback from Routine Outcome Monitoring (ROM) in youth mental health care: Study protocol of a three-arm parallel-group randomized controlled trial. BMC Psychiatry,14, 3. doi:10.1186/1471-244X-14-3.
68. Whipple, J. L., Lambert, M. J., Vermeersch, D. A., Smart, D. W., Nielsen, S. L., & Hawkins, E. J. (2003). Improving the effects of psychotherapy: The use of early identification of treatment and problem-solving strategies in routine practice. Journal of Counseling Psychology,50(1), 59–68. doi:10.1037/0022-0167.50.1.59.
69. Wilson, S. R., Strub, P., Buist, A. S., Knowles, S. B., Lavori, P. W., Lapidus, J., & Vollmer, W. M. (2010). Shared treatment decision making improves adherence and outcomes in poorly controlled asthma. American Journal of Respiratory and Critical Care Medicine,181(6), 566–577. doi:10.1164/rccm.200906-0907OC.
70. World Health Organization. (1992). The ICD-10 classification of mental and behavioural disorders: Clinical descriptions and diagnostic guidelines. Geneva: World Health Organization.