Benchmarking routine psychological services: A discussion of challenges and methods

Behavioural and Cognitive Psychotherapy

Volumn 42, Issue 1, 2014, Pages 16-30

  Delgadillo, Jaime ^a   McMillan, Dean ^b   Leach, Chris ^c   Lucock, Mike ^c   Gilbody, Simon ^b   Wood, Nick ^a  

^a LEEDS COMMUNITY HEALTHCARE NHS TRUST   (United Kingdom)

^b UNIVERSITY OF YORK   (United Kingdom)

^c UNIVERSITY OF HUDDERSFIELD   (United Kingdom)

Author keywords

Anxiety; Benchmarking; Depression; Primary care

Indexed keywords

ADULT; ANXIETY DISORDER; ARTICLE; COGNITIVE THERAPY; COMPARATIVE STUDY; COMPUTER ASSISTED THERAPY; EVIDENCE BASED PRACTICE; FEMALE; FORECASTING; HUMAN; MAJOR DEPRESSION; MALE; MANAGEMENT; MENTAL HEALTH SERVICE; METHODOLOGY; MIDDLE AGED; OUTCOME ASSESSMENT; PRIMARY HEALTH CARE; PSYCHOLOGICAL ASPECT; PSYCHOTHERAPY; QUALITY CONTROL; SELF CARE; STANDARD; UNITED KINGDOM;

ADULT; ANXIETY DISORDERS; BENCHMARKING; COGNITIVE THERAPY; DEPRESSIVE DISORDER, MAJOR; ENGLAND; EVIDENCE-BASED PRACTICE; FEMALE; FORECASTING; HUMANS; MALE; MENTAL HEALTH SERVICES; MIDDLE AGED; OUTCOME ASSESSMENT (HEALTH CARE); POLICY MAKING; PRIMARY HEALTH CARE; PSYCHOTHERAPY, BRIEF; SELF CARE; THERAPY, COMPUTER-ASSISTED;

EID: 84889039391     PISSN: 13524658     EISSN: 14691833     Source Type: Journal    
DOI: 10.1017/S135246581200080X     Document Type: Article

References (45)

1. Blais, M. A., Sinclair, S. J., Baity, M. R.,Worth, J.,Weiss, A. P., Ball, L. A., et al. (2012). Measuring outcomes in adult outpatient psychiatry. Clinical Psychology and Psychotherapy, 19, 203-213
2. Chambless, D. L., Baker, M. J., Baucom, D. H., Beutler, L. E., Calhoun, K. S., Crits-Christoph, P., et al. (1998). Update on empirically validated therapies, II. The Clinical Psychologist, 51, 3-16
3. Chambless, D. L. and Ollendick, T. H. (2001). Empirically supported psychological interventions: Controversies and evidence. Annual Review of Psychology, 52, 685-716
4. Clark, D. M., Layard, R., Smithies, R., Richards, D. A., Suckling, R. and Wright, B. (2009). Improving access to psychological therapy: Initial evaluation of two UK demonstration sites. Behaviour Research and Therapy, 47, 910-920
5. Cochran, W. G. (1954). The combination of estimates from different experiments. Biometrics, 10, 101-129
6. Cohen, J. (1998). Statistical Power Analysis for the Behavioural Sciences (2nd ed.). Hillsdale, NJ: Erlbaum
7. Das-Munshi, J., Goldberg, D., Bebbington, PE., Bhugra, D. K., Brugha, T. S. and Dewey, M. E. (2008). Public health significance of mixed anxiety and depression: Beyond current classification. British Journal of Psychiatry, 192, 171-177
8. Dowrick, C., Leydon, G. M., McBride, A., Howe, A., Burgess, H., Clarke, P., et al. (2009). Patients' and doctors' views on depression severity questionnaires incentivised in UK quality and outcomes framework: Qualitative study. British Medical Journal, 338, b663
9. Evans, C., Margison, F. and Barkham, M. (1998). The contribution of reliable and clinically significant change methods to evidence-based mental health. Evidence-based Mental Health, 1, 70-72
10. Franklin, M. E. and DeRubeis, R. J. (2006). Are efficacious laboratory-validated treatments readily transportable to clinical practice? In J. C. Norcross, L. E. Beutler and R. F. Levant (Eds.), Evidence-Based Practices in Mental Health: Debate and dialogue on fundamental questions (pp. 375-383). Washington DC: American Psychological Association
11. Gilbody, S., Richards, Dand Barkham, M. (2007). Diagnosing depression in primary care using self-completed instruments: UK validation of PHQ-9 and CORE-OM. British Journal of General Practice, 57, 650-652
12. Glover, G., Webb, M. and Evison, F. (2010). Improving Access to Psychological Therapies: A review of the progress made by sites in the first rollout year. Stockton on Tees: North East Public Health Observatory
13. Gyani, A., Shafran, R., Layard, R. and Clark, D. M. (2011). Enhancing Recovery Rates in IAPT Services: Lessons from analysis of the Year One data. London: University of Reading, London School of Economics and Kings College London
14. Higgins, JP. T., Thompson, S. G., Deeks, J. J. and Altman, D. G. (2003). Measuring inconsistency in meta-Analyses. British Medical Journal, 327, 557-560
15. IAPT National Programme Team (2011). The IAPT Data Handbook: Guidance on recording and monitoring outcomes to support local evidence-based practice. Version 2.0. London: National IAPT Programme Team
16. Jacobson, N. S. and Truax, P. (1991). Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59, 12-19
17. Kessler, R. C., Berglund, P., Demler, O., Jin, R., Koretz, D., Merikangas, K. R., et al. (2003). The epidemiology of major depressive disorder: Results from the National Comorbidity Survey Replication (NCS-R). Journal of the American Medical Association, 289, 3095-3105
18. Kroenke, K., Spitzer, R L. and Williams, J. B. W. (2001). ThePHQ-9: Validity of a brief depression severity measure. Journal of General Internal Medicine, 16, 606-613
19. Kroenke, K., Spitzer, R. L., Williams, J. B. W., Monahan, P. O. and Löwe, B. (2007). Anxiety disorders in primary care: Prevalence, impairment, comorbidity, and detection. Annals of Internal Medicine, 146, 317-325
20. Kroenke, K., Spitzer, R. L., Williams, J. B. W. and Löwe, B. (2010). The Patient Health Questionnaire Somatic, Anxiety, and Depressive Symptom Scales: A systematic review. General Hospital Psychiatry, 32, 345-359
21. Larsen, R. J. and Fredrickson, B. L. (1999). Measurement issues in emotion research. In D. Kahneman, E. Diener and N. Shwarz (Eds.), Well-being: The foundations of hedonic psychology (pp.40-60). New York: Russell Sage Foundation
22. Lueger, R. J. and Barkham, M. (2010). Using benchmarks and benchmarking to improve quality of practice and services. In M. Barkham, G. E. Hardy and J. Mellor-Clark (Eds.), Developing and Delivering Practice-Based Evidence. Chichester: Wiley
23. McAleavey, A. A., Nordberg, S. S., Kraus, D. and Castonguay, L. G. (2012). Errors in treatment outcome monitoring: Implications for real-world psychotherapy. Canadian Psychology, 53, 105-114
24. McCaffrey, R. J. and Westervelt, H. J. (1995). Issues associated with repeated neuropsychological assessments. Neuropsychology Review, 5, 203-221
25. McManus, S., Meltzer, H., Brugha, T., Bebbington, P. and Jenkins, R. (2009). Adult Psychiatric Morbidity in England, 2007: Results of a household survey. Retrieved September 7, 2010 from http://www.ic.nhs.uk/pubs/ psychiatricmorbidity07
26. McMillan, D., Richards, D. and Gilbody, S. (2010). Defining successful treatment outcome in depression using the PHQ-9: A comparison of methods. Journal of Affective Disorders, 127, 122-129
27. Minami, T.,Wampold, B. E., Serlin, R. C., Kircher, J. C. and Brown, G. S. (2007). Benchmarks for psychotherapy efficacy in adult major depression. Journal of Consulting and Clinical Psychology, 75, 232-243
28. Minami, T., Serlin, R. C., Wampold, B. E., Kircher, J. C. and Brown, G. S. (2008). Using clinical trials to benchmark effects produced in clinical practice. Quality and Quantity, 42, 513-525
29. Minami, T.,Wampold, BE., Serlin, R. C., Hamilton, E. G., Brown, G. S. and Kircher, J. C. (2008). Benchmarking the effectiveness of psychotherapy treatment for adult depression in a managed care environment: A preliminary study. Journal of Consulting and Clinical Psychology, 76, 116-124
30. National Institute for Health and Clinical Excellence (2007a). Anxiety (amended): Management of anxiety (panic disorder, with or without agoraphobia, and generalized anxiety disorder) in adults in primary, secondary and community care. London: NICE
31. National Institute for Health and Clinical Excellence (2007b). Depression (amended): Management of depression in primary and secondary care. London: NICE
32. National Institute for Health and Clinical Excellence (2011). Common Mental Health Disorders: Identification and pathways to care. London: National Collaborating Centre for Mental Health
33. National Screening Committee (2003). The UK National Screening Committee's Criteria for Appraising the Viability, Effectiveness and Appropriateness of a Screening Programme. London: HMSO
34. Newnham, E. A. and Page, A. C. (2010). Bridging the gap between best evidence and best practice in mental health. Clinical Psychology Review, 30, 127-142
35. Orkin, F. (2010). Risk stratification, risk adjustment, and other risks. Anesthesiology, 113, 1001-1003
36. Richards, D. A. and Suckling, R. (2009). Improving access to psychological therapies: Phase IV prospective cohort study. British Journal of Clinical Psychology, 48, 377-396
37. Richards, D. A. and Borglin, G. (2011). Implementation of psychological therapies for anxiety and depression in routine practice: Two year prospective cohort study. Journal of Affective Disorders, 133, 51-60
38. Roth, A. and Fonagy, P. (2004). What Works for Whom? A critical review of psychotherapy research (2nd edn). New York: Guilford Press
39. Roth, A. D. and Pilling, S. (2007). The Competences Required to Deliver Effective Cognitive and Behavioural Therapy for People with Depression and with Anxiety Disorders. London: Department of Health. Retrieved February 10, 2012 from http://www.ucl.ac.uk/clinicalpsychology/ CORE/CBT-Framework.htm#Map
40. Royal College of Psychiatrists (2011) National Audit of Psychological Therapies for Anxiety and Depression, National Report 2011
41. Shimokawa, K., Lambert, M. J. and Smart, D. W. (2010). Enhancing treatment outcome of patients at risk of treatment failure: Meta-Analytic and mega-Analytic review of a psychotherapy quality assurance system. Journal of Consulting and Clinical Psychology, 78, 298-311
42. Siev, J., Huppert, J. and Chambless, D. L. (2009). The dodo bird, treatment technique, and disseminating empirically supported treatments. The Behavior Therapist, 32, 69-75
43. Spitzer, R., Kroenke, K., Williams, J B. W. and Löwe, B. (2006). A brief measure for assessing generalized anxiety disorder: The GAD-7. Archives of Internal Medicine, 66, 1092-1097
44. Wahl, I., Meyer, B., Löwe, B. and Rose, M. (2010). Measurement of patient reported outcomes in psychotherapy research. Journal of Psychosomatic Research, 68, 676
45. Weersing, V R. and Weisz, J. R. (2002). Community clinic treatment of depressed youth: Benchmarking usual care against CBT clinical trials. Journal of Consulting and Clinical Psychology, 70, 299-310