Using Benchmarks and Benchmarking to Improve Quality of Practice and Services

Developing and Delivering Practice-Based Evidence: A Guide for the Psychological Therapies

Volumn , Issue , 2010, Pages 221-256

  Lueger, Robert J ^b   Barkham, Michael ^a  

^a UNIVERSITY OF SHEFFIELD   (United Kingdom)

^b CREIGHTON UNIVERSITY   (United States)

Author keywords

Benchmarking seeking quality improvement by examining processes of successful interventions; Benchmarking psychological therapy outcomes using internal type of benchmarking; Benchmarks and benchmarking improving quality of practice and services; Generic process benchmarking identification of distinct processes in episode of service delivery; Internal benchmarking, collection and comparison of outcomes data within unit of service delivery; Monitoring strategies for individual practitioners and services; Multivariate case mix adjustment helpful tool, not a panacea for understanding contribution of clinical variables to benchmarking results; Patient focused benchmarking studies; Performance parameters indicating quality; Quality evaluation and national databases (NDs)

Indexed keywords

EID: 84886832369     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1002/9780470687994.ch9     Document Type: Chapter

References (62)

1. Ackerberg, D.A., Machado, M.P.&Riordan, M.H. (2006). Benchmarking for productivity improvement: A health-care application. International Economic Review, 47, 161-201.
2. Baer, S.M.&Lueger, R.J. (June, 2003). Benchmarking psychotherapy outcomes. Paper presented at the annual meeting of the Society for Psychotherapy Research, Santa Barbara, CA.
3. Barkham, M., Mellor-Clark, J., Connell, J.&Cahill, J. (2006). A core approach to practice-based evidence: A brief history of the origins and applications of the CORE-OM and CORE system. Counselling&Psychotherapy Research, 6, 3-15.
4. Barkham, M.,Margison, F., Leach, C., Lucock,M.,Mellor-Clark, J. et al. (2001). Service profiling and outcomes benchmarking using the CORE-OM: toward practice-based evidence in the psychological therapies. Journal of Consulting and Clinical Psychology, 69, 184-196.
5. Barkham, M., Stiles,W.B., Connell, J., Twigg, E., Leach, C. et al. (2008). Effects of psychological therapies in randomized trials and practice-based studies.British Journal of Clinical Psychology, 47, 397-415.
6. Barlow, D.H., Craske,M.G., Cerny, J.A.&Klosko, J.S. (1989). Behavioral treatment of panic disorder. Behavior Therapy, 20, 261-282.
7. Beck, A.T., Steer, R.A.&Garbin, G.M. (1988). Psychometric properties of the Beck Depression Inventory: Twenty-five years of evaluation. Clinical Psychology Review, 8, 77-100.
8. Bewick, B.M., Trusler, K., Mullin, T., Grant, S.&Mothersole, G. (2006). Routine outcome measurement completion rates of the CORE-OM in primary care psychological therapies and counselling. Counselling&Psychotherapy Research, 6, 33-40.
9. Brown, G.S., Lambert,M.J., Jones, E.R.&Minami, T. (2005). Identifying highly effective psychotherapists in amanaged care environment. American Journal of Managed Care, 11, 513-520.
10. Burlingame, G.M., Jasper, B.W.&Peterson, G. (2001). Administration and Scoring Manual for the YLSQ. Salt Lake City, UT: American Professional Credentialing Services.
11. Cahill, J., Potter, S.&Mullin, T. (2006). First contact session outcomes in primary care psychological therapy and counselling services. Counselling and Psychotherapy Research, 6, 41-49
12. Camp, R.C. (1989). Benchmarking: The search for industry best practice. New York: ASQC Press.
13. Camp, R.C.&Tweet, A.G. (1994). Benchmarking applied to health care. Journal on Quality Improvement, 20, 229-238.
14. Castonguay, L.G.&Beutler, L.E. (eds.) (2005). Principles of therapeutic change that work. New York: Oxford University Press.
15. Connell, J., Grant, S.&Mullin, T. (2006). Client initiated termination of therapy at NHS primary care counselling services. Counselling&Psychotherapy Research, 6, 60-67.
16. Dewan, N.A., Daniels, A., Zieman, G.&Kramer, T.L. (2000). The national outcomes management project: A benchmarking collaborative study. The Journal of Behavioral Health Services and Research, 27, 431-436.
17. Donnenberg, G.R., Lyons, J.S.&Howard, K.I. (1999). Clinical trials versus mental health services research: contributions and connections. Journal of Clinical Psychology, 55, 1135-1146.
18. Duncan, B.L.,Miller, S.D.&Sparks, J.A. (2004). The heroic client: A revolutionary way to improve effectiveness through client-directed, outcome-informed therapy. San Francisco, CA: Jossey-Bass.
19. Eddy, K.T., Dutra, L.&Westen, D. (2004). A multidimensional meta-analysis of psychotherapy and pharmacotherapy for obsessive-compulsive disorder. Unpublished manuscript, Emory University, Atlanta, GA.
20. Eells, T.D. (2007). Generating and generalizing knowledge about psychotherapy from pragmatic case studies. Pragmatic Case Studies in Psychotherapy, 3, 1.
21. Eisen, S.V., Dill, D.L.&Grob, M.C. (1994). Reliability and validity of a brief patient-report instrument for psychiatric outcome evaluation. Hospital and Community Psychiatry, 45, 242-247.
22. Elkin, I., Shea, M.T., Watkins, J.T., Imber, S.T., Sotsky, S.M. et al. (1989). National Institute of Mental Health Treatment of Depression Collaborative Research Program: General effectiveness of treatments. Archives of General Psychiatry, 46, 971-982.
23. Evans, C., Connell, J., Barkham, M., Margison, F., Mellor-Clark, J. et al. (2002). Towards a standardised brief outcome measure: Psychometric properties and utility of the CORE-OM. British Journal of Psychiatry, 180, 51- 60.
24. Evans, C., Connell, J., Barkham, M., Marshall, C.&Mellor-Clark, J. (2003). Practice-based evidence: Benchmarking NHS primary care counselling services at national and local levels. Clinical Psychology&Psychotherapy, 10, 374-388.
25. Ferlie, E.B.&Shortell, S.M. (2001). Improving the quality of health care in the United Kingdom and the United States: A framework for change. The Millbank Quarterly, 79, 281-315.
26. Frank, J.D. (1973). Persuasion and healing: A comparative study of psychotherapy. Baltimore: Johns Hopkins University Press.
27. Grissom, G.R.&Howard, K.I. (2000). COMPASS-PC. In M. Maruish (ed.), Handbook of psychological assessment in primary care settings. Hillsdale, NJ: Erlbaum Associates.
28. Grissom, G.R., Lyons, J.&Lutz,W. (2003). Standing on the shoulders of a giant: Development of an outcome management system based on the dose model and phase theory of psychotherapy. Journal of Psychotherapy Research, 12, 397-412.
29. Hermann, R.C., Mattke, S., Somekh, D., Silfverhielm, H., Goldner, E. et al. (2006). Quality indicators for international benchmarking of mental health care. International Journal for Quality in Health Care, 18, (Supplement 1), 31-38.
30. Hermann, R.C., Palmer, R.H., Leff, S., Shwartz, M., Provost, S. et al. (2004). Achieving consensus across diverse stakeholders on quality measures for mental healthcare. Medical Care, 42, 1246-1253.
31. Hollon, S.D., DeRubeis, R.J., Evans, M.D., Wiemer, M.J., Garvey, M.J. et al. (1992). Cognitive therapy and pharmacotherapy for depression: Singly and in combination. Archives of General Psychiatry, 49, 774-781.
32. Howard,K.I.,Brill,P.L., Lueger, R.J.&O'Mahoney,M. (1992). Integra outpatient tracking assessment. Radnor, PA: Integra, Inc.
33. Howard, K.I., Brill, P.L., Lueger, R.J.&O'Mahoney,M. (1995). The COMPASS outpatient tracking system. King of Prussia, PA: COMPASS, Inc.
34. Howard, K.I., Kopta, S.M., Krause, M.S.&Orlinsky, D.E. (1986). The doseeffect relationship in psychotherapy. American Psychologist, 41, 159-164.
35. Howard, K.I., Lueger, R.J., Maling, M.&Martinovich, Z. (1993). The phase model of psychotherapy outcome: Causal mediation of change. Journal of Consulting and Clinical Psychology, 61, 678-685.
36. Howard, K.I., Moras, K., Brill, P.L., Martinovich, Z.&Lutz, W. (1996). The evaluation of psychotherapy: Efficacy, effectiveness, and patient progress. American Psychologist, 51, 1059-1064.
37. Hunsley, J.&Lee, C.M. (2007). Research-informed benchmarks for psychological treatments: Efficacy studies, effectiveness studies, and beyond. Professional Psychology, 38, 21-33.
38. Kazdin, A. (2006). Arbitrary metrics: Implications for identifying evidencebased treatments. American Psychologist, 61, 42-49.
39. Keller, G.A. (1997).Management for quality: Continuous quality improvement to increase access to outpatient mental health services. Psychiatric Services, 48, 821-825.
40. Kerr, E.,McGlynn, E., Van Vorst, K.&Wickstrom, S. (2000).Measuring antidepressant prescribing practice in a health care system using administrative data: Implications for quality measurement and improvement. Joint Commission Journal on Quality Improvement, 26, 203-216.
41. Kramer, T.L., Evans, R.B., Landes, R., Mancino, M., Booth, B.M. et al. (2001). Comparing outcomes of routine care for depression: The dilemma of casemix adjustment. The Journal of Behavioral Health Research, 28, 287-300.
42. Kraus, D.R., Seligman, D.A.&Jordan, J.R. (2004). Validation of a behavioral health treatment outcome and assessment tool designed for naturalistic settings: The Treatment Outcome Package. Journal of Clinical Psychology, 61, 285-314.
43. Kroenke, K., Spitzer, R.L.&Williams, J.B.W. (2001). The PHQ-9: Validity of a brief depression severity measure. Journal of General Internal Medicine, 16, 606-613.
44. Lambert, M.J. (2007). Presidential address:Whatwe have learned froma decade of research aimed at improving psychotherapy outcome in routine care. Psychotherapy Research, 17, 1-14.
45. Lambert, M.J.,Hansen, N.B.&Finch, A.E. (2001). Patient-focused research: using patient outcome data to enhance treatment effects. Journal of Consulting and Clinical Psychology, 69, 159-172.
46. Lambert, M.J.,Hansen, N.B., Umphress, V., Lunnen, K., Okiishi, J. et al. (1996). Administration and scoring manual for the OutcomeQuestionnaire (OQ-45.2). Wilmington, DE: American Professional Credentialing Services.
47. Lueger, R.J. (2002). Practice-informed research and research-informed psychotherapy. Journal of Clinical Psychology, 58, 1265-1276.
48. Lutz,W.,Martinovich, Z., Howard, K.I.&Leon, S. (2002). Outcomes management, expected treatment response, and severity-adjusted provider profiling in outpatient psychotherapy. Journal of Clinical Psychology, 58, 1291-1304.
49. Lutz,W., Leach, C., Barkham, M., Lucock, M., Stiles,W.B. et al. (2005). Predicting rate and shape of change for individual clients receiving psychological therapy: Using growth curve modeling and nearest neighbor technologies. Journal of Consulting and Clinical Psychology, 73, 904-913.
50. Mellor-Clark, J. (2006). Developing CORE performance indicators for benchmarking in NHS primary care psychological therapy and counselling services: An editorial introduction. Counselling&Psychotherapy Research, 6,1-2.
51. Mellor-Clark, J.&Barkham, M. (2006). The CORE System: Developing and delivering practice-based evidence through quality evaluation. In C. Feltham&I. Horton (eds.),Handbook of counselling and psychotherapy (2nd edn., pp. 207-224). London: Sage Publications.
52. Mellor-Clark, J., Curtis Jenkins, A., Evans, R., Mothersole, G.&McInnes, B. (2006). Resourcing a CORE Network to develop a National Research Database to help enhance psychological therapies and counselling service provision. Counselling&Psychotherapy Research, 6, 16-22.
53. Merrill, K.A., Tolbert, V.E.&Wade, W.A. (2003). Effectiveness of cognitive therapy for depression in a community mental health center: A benchmarking study. Journal of Consulting and Clinical Psychology, 71, 404- 409.
54. Miller, S.D., Duncan, B., Sorrell, R.&Brown, G.S. (2004). The Partners for Change Outcome Management System. Journal of Clinical Psychology, 61, 199-208.
55. Miller, S.D., Duncan, B.L., Brown, J., Sparks, J.A.&Claud, D.A. (2003). The Outcome Rating Scale: A preliminary study of the reliability, validity, and feasibility of a brief visual analog measure. Journal of Brief Therapy, 2, 91- 100.
56. Minami, T., Serlin, R.C., Wampold, B.E., Kircher, J.C.&Brown, G.S.(Jeb) (2006). Using clinical trials to benchmark effects produced in clinical practice. Quality&Quantity, 42, 513-525.
57. Minami, T., Wampold, B.E., Serlin, R.C., Kircher, J.C.&Brown, G.S.(Jeb) (2007). Benchmarks for psychotherapy efficacy in adult major depression. Journal of Consulting and Clinical Psychology, 75, 232-243.
58. Minami, T., Wampold, B.E., Serlin, R.C., Hamilton, E.G., Brown, G.S.(Jeb) et al. (2008). Benchmarking the effectiveness of psychotherapy treatment for adult depression in a managed care environment: A preliminary study. Journal of Consulting and Clinical Psychology, 76, 116- 124.
59. Morrison, D. (2004). Real-world use of evidence-based treatments in community behavioral health care. Psychiatric Services, 5, 485-487.
60. Mullin, T., Barkham, M., Mothersole, G., Bewick, B.M.&Kinder, A. (2006). Recovery and improvement benchmarks in routine primary care mental health settings. Counselling&Psychotherapy Research, 6, 68-80.
61. Orlinsky, D.E., Grawe, K.&Parks, B.K. (1994). Process and outcome in psychotherapy -Noch einmal. In S.L. Garfield&A.E. Bergin (eds.), Handbook of psychotherapy&(4th edn., pp. 270-376). New York: John Wiley&Sons, Inc.
62. Pilkonis, P.A.&Krause, M.S. (1999). Summary: paradigms for psychotherapy outcome research. Journal of Clinical Psychology, 55, 201-205.