Routine use of patient reported outcome measures (PROMs) for improving treatment of common mental health disorders in adults

Cochrane Database of Systematic Reviews

Volumn 2016, Issue 7, 2016, Pages

  Kendrick, Tony ^a   El Gohary, Magdy ^a   Stuart, Beth ^a   Gilbody, Simon ^b   Churchill, Rachel ^c   Aiken, Laura ^d   Bhattacharya, Abhishek ^d   Gimson, Amy ^a   Brütt, Anna L ^e   de Jong, Kim ^f   Moore, Michael ^a  

^a UNIVERSITY OF SOUTHAMPTON   (United Kingdom)

^b UNIVERSITY OF YORK   (United Kingdom)

^c UNIVERSITY OF BRISTOL   (United Kingdom)

^d UNIVERSITY HOSPITAL SOUTHAMPTON NHS FOUNDATION TRUST   (United Kingdom)

^e UNIVERSITY MEDICAL CENTER HAMBURG EPPENDORF   (Germany)

^f LEIDEN UNIVERSITY   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; FUNCTIONAL ASSESSMENT; HUMAN; MENTAL DISEASE; MENTAL HEALTH CARE; META ANALYSIS; OUTCOME ASSESSMENT; PATIENT CARE; PATIENT REPORTED OUTCOME MEASURES; PRIORITY JOURNAL; PSYCHOTHERAPY; QUALITY OF LIFE; RANDOMIZED CONTROLLED TRIAL (TOPIC); REVIEW; SYMPTOM ASSESSMENT; SYSTEMATIC REVIEW; TREATMENT OUTCOME; AGED; FEEDBACK SYSTEM; FEMALE; MALE; MENTAL DISORDERS; MIDDLE AGED; PSYCHOLOGY; SUICIDAL IDEATION;

NEUROLEPTIC AGENT;

ADULT; AGED; ANTIPSYCHOTIC AGENTS; FEEDBACK; FEMALE; HUMANS; MALE; MENTAL DISORDERS; MIDDLE AGED; PATIENT OUTCOME ASSESSMENT; QUALITY OF LIFE; RANDOMIZED CONTROLLED TRIALS AS TOPIC; SUICIDAL IDEATION;

EID: 84978792835     PISSN: None     EISSN: 1469493X     Source Type: Journal    
DOI: 10.1002/14651858.CD011119.pub2     Document Type: Review

References (139)

1. Amble I, Gude T, Stubdal S, Andersen BJ, Wampold BE. The effect of implementing the Outcome Questionnaire-45.2 feedback system in Norway: a multisite randomized clinical trial in a naturalistic setting. Psychotherapy Research 2014;24:doi:10.1080/10503307.2014.928756.
2. Berking M, Orth U, Lutz W. How effective is systematic feedback of treatment progress to the therapist? An empirical study in a cognitive-behavioural-oriented inpatient setting [Wie effektiv sind systematische Rückmeldungen des Therapieverlaufs an den Therapeuten? Eine empirische studie in einem stationär-verhaltenstherapeutischen setting]. Zeitschrift Fur Klinische Psychologie Und Psychotherapie 2006;35(1):25-9.
3. Lutz W, Tholen S, Schürch E, Berking M. [Die entwicklung, validierung und reliabilität von kurzformen gängiger psychometrischer Instrumentezur evaluation des therapeutischenfortschritts in psychotherapieund psychiatrie]. Diagnostica 2006;52:11-25.
4. Chang TE, Jing Y, Yeung AS, Brenneman SK, Kalsekar I, Hebden T, et al. Effect of communicating depression severity on physician prescribing patterns: findings from the Clinical Outcomes in MEasurement-based Treatment (COMET) trial. General Hospital Psychiatry 2012;34:105-12. [DOI: 10.1016/j.genhosppsych.2011.12.003]
5. Chang TE, Jing Y, Yeung AS, Brenneman SK, Kalsekar ID, Hebden T, et al. Depression monitoring and patient behavior in the Clinical Outcomes in MEasurement-based Treatment (COMET) trial. Psychiatric Services Hospital & Community Psychiatry 2014;65(8):1058-6.
6. Yeung AS, Jing Y, Brenneman SK, Chang TE, Baer L, Hebden T, et al. Clinical Outcomes in MEasurement-based Treatment (COMET): A trial of depression monitoring and feedback to primary care physicians. Depression and Anxiety 2012;29:865-73.
7. De Jong K, Van Sluis P, Nugter MA, Heiser WJ, Spinhoven P. Understanding the differential impact of outcome monitoring: therapist variables that moderate feedback effects in a randomized controlled trial. Psychotherapy Research 2012;22(4):464-74.
8. De Jong K, Timman R, Hakkaart-van Roijen L, Vermeulen P, Kooiman K, Passchier J, et al. The effect of outcome monitoring feedback to clinicians and patients in short and long-term psychotherapy: a randomized controlled trial. Psychotherapy Research 2014;24(6):629-39.
9. Hansson H, Rundberg J, Österling A, Öjehagen A, Berglund M. Intervention with feedback using Outcome Questionnaire 45 (OQ-45) in a Swedish psychiatric outpatient population. A randomized controlled trial. Nordic Journal of Psychiatry 2013;67(4):274-81.
10. Hawkins EJ, Lambert MJ, Vermeersch DA, Slade KL, Tuttle KC. The therapeutic effects of providing patient progress information to therapists and patients. Psychotherapy Research 2004;14(3):308-27.
11. Lambert MJ, Whipple JL, Smart DW, Vermeersch DA, Nielsen SL. The effects of providing therapists with feedback on patient progress during psychotherapy: Are Outcomes Enhanced?. Psychotherapy Research 2001;11(1):49-68.
12. Mathias SD, Fifer SK, Mazonson PD, Lubeck DP, Buesching DP, Patrick DL. Necessary but not sufficient: the effect of screening and feedback on outcomes of primary-care patients with untreated anxiety. Journal of General Internal Medicine 1994;9:606-15.
13. Mazonson PD, Mathias SD, Fifer SK, Buesching DP, Malek P, Patrick DL. The mental health patient profile: does it change primary-care physicians' practice patterns?. Journal of the American Board of Family Practice/American Board of Family Practice 1996;9:336-45.
14. Murphy KP, Rashleigh CM, Timulak L. The relationship between progress feedback and therapeutic outcome in student counselling: a randomised control trial. Counselling Psychology Quarterly 2012;25:1-18.
15. Probst T, Lambert MJ, Dahlbender RW, Loew TH, Tritt K. Providing patient progress feedback and clinical support tools to therapists: is the therapeutic process of patients on-track to recovery enhanced in psychosomatic in-patient therapy under the conditions of routine practice?. Journal of Psychosomatic Research 2014;76(6):477-84.
16. Probst T, Lambert MJ, Loew TH, Dahlbender RW, Gollner R, Tritt K. Feedback on patient progress and clinical support tools for therapists: Improved outcome for patients at risk of treatment failure in psychosomatic in-patient therapy under the conditions of routine practice. Journal of Psychosomatic Research 2013;75(3):255-61.
17. Reese RJ, Norsworthy LA, Rowlands SR. Does a continuous feedback system improve psychotherapy outcome?. Psychotherapy 2009;46(4):418-31.
18. Reese RJ, Norsworthy LA, Rowlands SR. Does a continuous feedback system improve psychotherapy outcome?. Psychotherapy 2009;46(4):418-31.
19. Scheidt CE, Brockmann J, Caspar F, Rudolf G, Stangier U, Vogel H. The project of the Techniker-Krankenkasse: some comments on the results by the project's scientific advisory board [Das modellprojekt der Techniker-Krankenkasse: eine kommentierung der ergebnisse aus der aicht des wissenschaftlichen projektbeirates]. Psychotherapie Psychosomatik Medizinische Psychologie 2012;62(11):405-12.
20. Wittmann WW, Lutz W, Steffanowski A, Kriz D, Glahn EM, Völkle MC, et al. Qualitätsmonitoringin der ambulanten Psychotherapie: Modellprojekt der Techniker Krankenkasse - Abschlussbericht. Hamburg: Techniker Krankenkasse, 2011.
21. Simon W, Lambert MJ, Harris MW, Busath G, Vazquez A. Providing patient progress information and clinical support tools to therapists: effects on patients at risk of treatment failure. Psychotherapy Research 2012;22:638-47.
22. Trudeau LS. Effects of a clinical feedback system on client and therapist outcomes in a rural community mental health center. Dissertation Abstracts International: Section B: The Sciences and Engineering Dissertation Abstracts International 2001;61:5232.
23. Whipple JL. Improving the effects of psychotherapy: the use of early identification of treatment failure and problem solving strategies in outcome [thesis]. Dissertation Abstracts International: Section B: Sciences and Engineering 2002;63(6-B):3030.
24. Whipple JL, Lambert MJ, Vermeersch DA, Smart DW, Nielsen SL, Hawkins EJ. Improving the effects of psychotherapy: the use of early identification of treatment failure and problem-solving strategies in routine practice. Journal of Counseling Psychology 2003;50(1):59-68.
25. Anker MG, Duncan BL, Sparks JA. Using client deedback to improve couple therapy outcomes: a randomized clinical trial in a naturalistic setting. Journal of Consulting and Clinical Psychology 2009;77(4):693-704.
26. Brodey BB, Cuffel B, McCulloch J, Tani S, Maruish M, Brodey I, et al. The acceptability and effectiveness of patient-reported assessments and feedback in a managed behavioral healthcare setting. The American Journal of Managed Care 2005;11(12):774-80.
27. Brody DS, Lerman CE, Wolfson HG, Caputo GC. Improvement in physicians' counseling of patients with mental health problems. Archives of Internal Medicine 1990;150(5):993-8.
28. Dobscha SK, Corson K, Hickam DH, Perrin NA, Kraemer DF, Gerrity MS. Depression decision support in primary care: a cluster randomized trial. Annals of Internal Medicine 2006;145:477-87.
29. Fluckiger C, Del Re AC, Wampold BE, Znoj H, Caspar F, Jorg U. Valuing clients' perspective and the effects on the therapeutic alliance: a randomized controlled study of an adjunctive instruction. Journal of Counseling Psychology 2012;59(1):18-26.
30. Haderlie MM. Enhancing therapists' clinical judgments of client progress subsequent to objective feedback. Dissertation abstracts International: Section B: The Sciences and Engineering Dissertation Abstracts International 2012;73:616.
31. Harmon SC, Lambert MJ, Smart DM, Hawkins E, Nielsen SL, Slade K, et al. Enhancing outcome for potential treatment failures: therapist client feedback and clinical support tools. Psychotherapy Research 2007;17(4):379-92.
32. Lambert MJ, Whipple JL, Vermeersch DA, Smart DW, Hawkins EJ, Nielsen SL, et al. Enhancing psychotherapy outcomes via providing feedback on client progress: a replication. Clinical Psychology & Psychotherapy 2002;9(2):91-103.
33. Newnham EA, Hooke GR, Page AC. Progress monitoring and feedback in psychiatric care reduces depressive symptoms. Journal of Affective Disorders 2010;127:139-46.
34. Pedersen ER, Kaysen DL, Lindgren KP, Blayney J, Simpson TL. Impact of daily assessments on distress and PTSD symptoms in trauma-exposed women. Journal of Interpersonal Violence 2014;29(5):824-45.
35. Priebe S, McCabe R, Bullenkamo J, Hansson L, Lauber C, Martinez-Leal R, et al. Structured patient-clinician communication and 1-year outcome in community mental healthcare. British Journal of Psychiatry 2007;191(5):420-6.
36. Puschner B, Schofer D, Knaup C, Becker T. Outcome management in in-patient psychiatric care. Acta Psychiatrica Scandinavica 2009;120:308-19.
37. Reese RJ, Toland MD, Slone NC, Norsworthy LA. Effect of client feedback on couple psychotherapy outcomes. Psychotherapy 2010;47(4):616-30.
38. Reese RJ, Gillaspy JA, Owen JJ, Flora KL, Cunningham LC, Archie D, et al. The influence of demand characteristics and social desirability on clients' ratings of the therapeutic alliance. Journal of Clinical Psychology 2013;69(7):696-709.
39. Reeves EK. The use of psychotherapy feedback on client progress: implications for training and clinical practice. The use of psychotherapy feedback on client progress: implications for training and clinical practice. PhD Thesis, New York University. Ann Arbor, MI: Proquest LLC, 2010.
40. Rise MB, Eriksen L, Grimstad H, Steinsbekk A. The short-term effect on alliance and satisfaction of using patient feedback scales in mental health out-patient treatment. A randomised controlled trial. BMC Health Services Research 2012;12:348.
41. Simon GE, VonKorff M, Rutter C, Wagner E. Randomised trial of monitoring, feedback, and management of care by telephone to improve treatment of depression in primary care. BMJ (Clinical Research ed) 2000;320:550-4.
42. Slade M, McCrone P, Kuipers E, Leese M, Parabiaghi A, Priebe S, et al. Use of standardised outcome measures in adult mental health services:randomised controlled trial. British Journal of Psychiatry 2006;189:330-6.
43. Slade K, Lambert MJ, Harmon SC, Smart DW, Bailey R. Improving psychotherapy outcome: the use of immediate electronic feedback and revised clinical support tools. Clinical Psychology & Psychotherapy 2008;15(5):287-303.
44. Gibbons M, Kurtz J, Thompson D, Mack R, Lee J, Rothbard A, et al. The effectiveness of clinician feedback in the treatment of depression in the community mental health system. Journal of Consulting and Clinical Psychology. 2015;83:748-59.
45. Gibbons MB. The development of a therapist feedback system for MDD in community mental health [protocol]. NIH Research Portfolio Online Reporting Tools (RePORT) [projectreporter.nih.gov/project_info_description.cfm?aid=7788979] [Accessed 26 May 2016] 2010.
46. Rise MB, Eriksen L, Grimstada H, Steinsbekk A. The long-term effect on mental health symptoms and patient activation of using patient feedback scales in mental health out-patient treatment. A randomised controlled trial. Patient Education and Counselling 2016;99:164-8.
47. Metz MJ, Franx GC, Veerbeek MA, De Beurs E, Van der Feltz-Cornelis CM, Beekman AT. Shared decision making in mental health care using routine outcome monitoring as a source of information: a cluster randomised controlled trial. BMC Psychiatry 2015;15:313.
48. Linaker OM, Lara MM. Effects of systematic patient feedback on therapy outcome and dropout: a randomized controlled study on adult out-patients at a community mental health centre. clinicaltrials.gov/ct2/show/NCT01796223 2013 [Accessed 24 November 2015].
49. Pinsof W. Assessing psychotherapy outcome in treatment as usual versus treatment as usual with the STIC feedback system. clinicaltrials.gov/ct2/show/NCT02023736 2013 [Accessed 24 November 2015].
50. Biran L, Ganor O. A randomized trial of routine computerized outcome and process clinical measures monitoring in mental health outpatient services: preparing for the planned public mental health reform in Israel. clinicaltrials.gov/ct2/show/NCT02095457 2014 [Accessed 24 November 2015].
51. Ludwig KG. Using the Patient Health Questionnaire-9 (PHQ-9) and Generalized Anxiety Disorder 7-Item Scale (GAD-7) as Feedback Instruments in Brief Psychotherapy. clinicaltrials.gov/ct2/show/NCT02656641 [Accessed 26 May 2016] 2015.
52. Bovendeerd AM. Routine Process Monitoring, systematic patient feedback in the primary and specialised mental healthcare - RPM. trialregister.nl/trialreg/admin/rctview.asp?TC=5466 [Accessed 26 May 2016] 2015.
53. Bastiaansen JACJ. Self-monitoring and personalized feedback as a tool to boost depression treatment. trialregister.nl/trialreg/admin/rctview.asp?TC=5707 [Accessed 26 May 2016] 2016.
54. Andlin-Sobocki P, Jonsson B, Wittchen HU, Olesen J. Cost of disorders of the brain in Europe. European Journal of Neurology 2005;12:1-27.
55. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders, 4th Edition, Text Revision (DSM-IV-TR). Washington, DC: American Psychiatric Association, 2000.
56. Archer J, Bower P, Gilbody S, Lovell K, Richards D, Gask L, et al. Collaborative care for depression and anxiety problems. Cochrane Database of Systematic Reviews 2012, Issue 10. [DOI: 10.1002/14651858.CD006525.pub2]
57. Barkham M, Mellor-Clark J, Connell J, Cahill, J . A core approach to practice-based evidence: a brief history of the origins and applications of the CORE-OM and CORE System. Counselling & Psychotherapy Research 2006;6(1):3-15.
58. Beck AT, Ward CH. An inventory for measuring depression. Archives of General Psychiatry 1961;4:561-71.
59. Beck AT, Steer RA, Brown GK. Manual for the Beck Depression Inventory-II. San Antonio, TX: Psychological Corporation, 1996.
60. Black N. Patient reported outcome measures could help transform healthcare. BMJ 2013;346:doi:10.1136/bmj.f167.
61. Black N, Burke L, Forrest CB, Ravens Sieberer UH, Ahmed S, Valderas JM, et al. Patient-reported outcomes: pathways to better health, better services, and better societies. Quality of Life Research 2015;24:doi:10.1007/s11136-015-1168-3.
62. Bland JM, Kerry SM. Statistics notes. Trials randomised in clusters. BMJ 1997;710:600.
63. British Medical Association & NHS Employers. Quality and Outcomes Framework guidance for GMS contract 2009/10. Delivering investment in general practice. London: NHS Confederation, 2009.
64. Bostwick JM, Pankratz VS. Affective disorders and suicide risk: a reexamination. American Journal of Psychiatry 2000;157:1925-32.
65. Boyce MB, Browne JP. Does providing feedback on patient-reported outcomes to healthcare professionals result in better outcomes for patients? A systematic review. Quality of Life Research 2013;22(9):2265-78 doi:10.1007/s11136-013-0390-0.
66. Carlier IV, Meuldijk D, Van Vliet IM, Van Fenema E, Van der Wee NJ, Zitman FG. Routine outcome monitoring and feedback on physical or mental health status: evidence and theory. Journal of Evaluation in Clinical Practice 2012;18(1):104-10.
67. Compton WM, Conway KP, Stinson FS, Grant BF. Changes in the prevalence of major depression and comorbid substance use disorders in the United States between 1991-1992 and 2001-2002. American Journal of Psychiatry 2006;163:2141-7.
68. Cooper P, Osborne M, Gath D, Feggetter G. Evaluation of a modified self-report measure of social adjustment. British Journal of Psychiatry 1982;141:68-75.
69. Crits-Christoph P, Ring-Kurtz S, Hamilton JL, Lambert MJ, Gallop R, McClure B, et al. A preliminary study of the effects of individual patient-level feedback in outpatient substance abuse treatment programs. Journal of Substance Abuse Treatment 2012;42:301-9.
70. Davidson K, Perry A, Bell L. Would continuous feedback of patient's clinical outcomes to practitioners improve NHS psychological therapy services? Critical analysis and assessment of quality of existing studies. Psychology and Psychotherapy: Theory, Research and Practice 2014;88(1):21-37.
71. Deeks JJ, Higgins JPT, Altman DG (editors). Chapter 9: Analysing data and undertaking meta-analyses. In: Higgins JPT, Green S (editors). Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 (updated March 2011). The Cochrane Collaboration, 2011. Available from cochrane-handbook.org.
72. Derogatis LR, Lipman RS, Rickels K, Uhlenhuth EH, Covi L. The Hopkins Symptom Checklist (HSCL): a self-report symptom inventory. Behavioural Sciences 1974;19(1):1-15.
73. Derogatis LR. SCL-90-R: Administration, Scoring and Procedures Manual-II. Baltimore, Md: Clinical Psychometric Research, 1983.
74. Divine GW, Brown JT, Frazer LM. The unit of analysis error in studies about physicians' patient care behavior. Journal of General Internal Medicine 1992;7:623-9.
75. Dolan P. Modeling valuations for EuroQol health states. Medical Care 1997;35(11):1095-108.
76. Dowrick C, Leydon GM, McBride A, Howe A, Burgess H, Clarke P, et al. Patients' and doctors' views on depression severity questionnaires incentivised in UK quality and outcomes framework: qualitative study. BMJ 2009;338:b663. doi:10.1136/bmj.b663.
77. Egger M, Davey-Smith G, Schneider M, Minder C. Bias in meta-analysis detected by a simple graphical test. BMJ 1997;315:629-35.
78. Ferrari AJ, Charlson FJ, Norman RE, Patten SB, Freedman G, Murray CJL, et al. Burden of depressive disorders by country, sex, age, and year: findings from the global burden of disease study 2010. PLoS Medicine 2013;10(11):e1001547.doi:10.1371/journal.pmed.1001547.
79. First M, Spitzer R, Gibbon M, Williams J. Structured clinical interview for DSM-IV axis I disorders (SCIDI), clinician version. Structured clinical interview for DSM-IV axis I disorders (SCIDI), clinician version. Washington: American Psychiatric Press, 1997.
80. Fitzpatrick R, Gibbons E, Mackintosh A. An overview of patient-reported outcome measures for people with anxiety and depression. Oxford: Patient-reported Outcome Measurement Group, Department of Public Health, University of Oxford, 2009.
81. Gilbody SM, House AO, Sheldon T. Routine administration of Health Related Quality of Life (HRQoL) and needs assessment instruments to improve psychological outcome - a systematic review. Psychological Medicine 2002;32(1345):1356.
82. Gilbody S, Sheldon T, House A. Screening and case-finding instruments for depression: a meta-analysis. Canadian Medical Association Journal 2008;178(8):997-1003.
83. Gilchrist G, Gunn J. Observational studies of depression in primary care: what do we know?. BMC Family Practice 2007;8:DOI: 10.1186/1471-2296-8-28.
84. Goldberg D. The Detection of Psychiatric Illness by Questionnaire. The Detection of Psychiatric Illness by Questionnaire. Oxford: Oxford University Press, 1972.
85. Greenhalgh J, Long AF, Flynn R. The use of patient reported outcome measures in routine clinical practice: Lack of impact or lack of theory?. Social Science and Medicine 2005;60(4):833-43. doi:10.1016/j.socscimed.2004.06.022.
86. Gulliford MC, Ukoumunne OC, Chinn S. Components of variance and intraclass correlations for the design of community-based surveys and intervention studies. American Journal of Epidemiology 1999;149:876-83.
87. Hamilton M. A rating scale for depression. Journal of Neurology, Neurosurgery, and Psychiatry 1960;23:56-62.
88. Higgins JP, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. BMJ 2003;327:557-60.
89. Higgins JPT, Altman DG, Sterne JAC (editors). Chapter 8: Assessing risk of bias in included studies. In: Higgins JPT, Green S (editors). Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 (updated March 2011). The Cochrane Collaboration, 2011. Available from cochrane-handbook.org.
90. Health Resources and Services Administration (HRSA) Health Disparities Collaborative on Depression. Standards on the assessment of patients at diagnosis and follow-up. qualitymeasures.ahrq.gov/browse/by-organization-indiv.aspx?objid=26124(accessed 18 November 2013): AHRQ, 2005.
91. Community and Mental Health Team. Psychological Therapies: Annual Report on the use of IAPT services England, 2014/15. gov.uk/government/uploads/system/uploads/attachment_data/file/386221/NHS_England_Mandate.pdf: Health and Social Care Information Centre, [Accessed 26 November 2015] 2015.
92. The IAPT Data Handbook NHS. Guidance on recording and monitoring outcomes to support local evidence-based practice. Accessed 18 November 2013: iapt.nhs.uk/silo/files/the-iapt-data-handbook.pdf NHS, [Accessed 1 May 2014] 2011.
93. Katon W, Schulberg H. Epidemiology of depression in primary care. General Hospital Psychiatry 1992;14(4):237-47.
94. Kendrick T, Dowrick C, McBride A, Howe A, Clarke P, Maisey S, et al. Management of depression in UK general practice in relation to scores on depression severity questionnaires: analysis of medical record data. BMJ 2009;338:b750. doi:10.1136/bmj.b750.
95. Kendrick T, Moore M, Gilbody S, Churchill R, Stuart B, El-Gohary M. Routine use of patient reported outcome measures (PROMs) for improving treatment of common mental health disorders in adults. Cochrane Database of Systematic Reviews 2014, Issue 6. [DOI: 10.1002/14651858.CD011119]
96. Kessler RC, Berglund P, Demler O, Jin R, Merikangas KR, Walters EE. Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey replication. Archives of General Psychiatry 2005;62:593-602.
97. King M, Nazareth I, Levy G, Walker C, Morris R, Weich S, et al. Prevalence of common mental disorders in general practice attendees across Europe. British Journal of Psychiatry 2008;192:362-7.
98. Knaup C, Koesters M, Schoefer D, Becker T, Puschner B. Effect of feedback of treatment outcome in specialist mental healthcare: meta-analysis. British Journal of Psychiatry 2009;195:15-22 doi:10.1192/bjp.bp.108.053967.
99. Krageloh CU, Czuba KJ, Billington DR, Kersten P, Siegert RJ. Using feedback from patient-reported outcome measures in mental health services: a scoping study and typology. Psychiatric Services 2015;66(3):224-41.
100. Lambert MJ, Whipple JL, Hawkins EJ, Vermeersch DA, Nielsen SL, Smart DW. Is it time for clinicians to routinely track patient outcome? A meta-analysis. Clinical Psychology: Science and Practice 2003;10:288-301.
101. Lambert MJ, Gregersen AT, Burlingame GM. The Outcome Questionnaire-45. In: Murish ME editor(s). Use of Psychological Testing for Treatment Planning and Outcome Assessment. Vol. 3, New Jersey: Erlbaum, 2004:191-234.
102. Lewis G, Pelosi AJ, Araya R, Dunn G. Measuring psychiatric disorder in the community: a standardized assessment for use by lay interviewers. Psychological Medicine 1992;22(2):465-86.
103. Malpass A, Shaw A, Kessler D, Sharp D. Concordance between PHQ-9 scores and patients' experiences of depression: a mixed methods study. British Journal of General Practice 2010;60:doi:10.3399/ bjgp10X502119.
104. Marciniak M, Lage MJ, Landbloom RP, Dunayevich E, Bowman L. Medical and productivity costs of anxiety disorders: case control study. Depression and Anxiety 2004;19:112-20.
105. Marshall S, Haywood K, Fitzpatrick R. Impact of patient-reported outcome measures on routine practice: A structured review. Journal of Evaluation in Clinical Practice 2006;12(5):559-68. doi:10.1111/j.1365-2753.2006.00650.x.
106. McCrone P, Dhanasiri S, Patel A, Knapp M. Paying the price: the cost of mental health care in England to 2026. London: King's Fund, 2008.
107. McManus S, Meltzer H, Brugha T, Bebbington P, Jenkins R. Adult psychiatric morbidity in England, 2007. Results of a household survey. Adult psychiatric morbidity in England, 2007. Results of a household survey. Leicester: National Centre for Social Research & Department of Health Sciences, University of Leicester, 2009.
108. Miller SD, Duncan BL, Brown J, Sparks J, Claud D. The Outcome Rating Scale: a preliminary study of the reliability, validity, and feasibility of a brief visual analog measure. Journal of Brief Therapy 2003;2(2):91-100.
109. Moher D, Liberati A, Tetzlaff J, Altman DG, the PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Medicine 2009;6(7):e1000097.
110. Montgomery SA, Asberg M. A new depression scale designed to be sensitive to change. British Journal of Psychiatry 1979;134(4):382-9.
111. Moore M, Ali S, Stuart B, Leydon GM, Ovens J, Goodall C, et al. Depression management in primary care: an observational study of management changes related to PHQ-9 score for depression monitoring. British Journal of General Practice 2012;62:310-1.
112. Mundt JC, Marks IM, Shear MK, Greist JM. The Work and Social Adjustment Scale: a simple measure of impairment in functioning. British Journal of Psychiatry 2002;180:461-4. doi: 10.1192/bjp.180.5.461.
113. Murray CJL, Vos T, Lozano R, Naghavi M, Flaxman AD, Michaud C, et al. Disability-adjusted life years (DALYs) for 291 diseases and injuries in 21 regions, 1990-2010: a systematic analysis for the Global Burden of Disease Study 2010. Lancet 2012;380(9859):2197-223.
114. National Institute for Health and Clinical Excellence. National Collaborating Centre for Mental Health. Depression. The treatment and management of depression in adults. NICE Clinical Guideline 90. Updated from 2004 guideline. London: NICE, 2009.
115. National Institute for Health and Clinical Excellence. NICE Guideline: common mental health disorders: identification and pathways to care; CG123. London: British Psychological Society and Royal College of Psychiatrists, 2011.
116. National Institute for Health & Clinical Excellence. Quality Standards for the Management of Depression in Adults. publications.nice.org.uk/depression-in-adults-quality-standard-qs8/quality-statement-3-recording-health-outcomes (Accessed 18 November 2013). London: NICE, 2011.
117. Poston JM, Hanson WE. Meta-analysis of psychological assessment as a therapeutic intervention. Psychological Assessment 2010;22(2):203-12.
118. QOF Database. UK level data for Quality and Outcomes Framework 2008-2013 depression indicators. gpcontract.co.uk/browse/UK/Depression/13 (accessed 21 November 2013).
119. Radloff LS. The CES-D scale a self-report depression scale for research in the general population. Applied Psychological Measurement 1977;1:385-401.
120. The Nordic Cochrane Centre, The Cochrane Collaboration. Review Manager (RevMan). Version 5.3. Copenhagen: The Nordic Cochrane Centre, The Cochrane Collaboration, 2014.
121. Robins NL, Helzer JE, Croughan J, Ratcliff KS. The National Institute of Mental Health Diagnostic Interview Schedule: its History, Characteristics, and Validity. Archives of General Psychiatry 1981;38:381-99.
122. Shaw EJ, Sutcliffe D, Lacey T, Stokes T. Assessing depression severity using the UK Quality and Outcomes Framework depression indicators: a systematic review. British Journal of General Practice 2013;63:doi:10.3399/bjgp13X667169.
123. Sheehan DV, Lecrubier Y, Sheehan KH, Amorim P, Janavs J, Weiller E, et al. The Mini-International Neuropsychiatric Interview (M.I.N.I.) the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. Journal of Clinical Psychiatry 1998;Suppl 20:22-3.
124. Shimokawa K, Lambert MJ, Smart DW. Enhancing treatment outcome of patients at risk of treatment failure: meta-analytic and mega-analytic review of a psychotherapy quality assurance system. Journal of Consulting and Clinical Psychology 2010;78:298-311.
125. Simon GE, Katzelnick DJ. Depression, use of medical services and cost-offset effects. Journal of Psychosomatic Research 1997;42:333-4.
126. Simon G, Ludman E, Tutty S, Operskalski B, Von Korff M. Telephone psychotherapy and telephone care management for primary care patients starting antidepressant treatment:a randomized controlled trial. JAMA 2004;292:935-42.
127. Simon W, Lambert MJ, Busath G, Vazquez A, Berkeljon A, Hyer K, et al. Effects of providing patient progress feedback and clinical support tools to psychotherapists in an inpatient eating disorders treatment program: a randomized controlled study. Psychotherapy Research 2013;23:287-300.
128. Spitzer RL, Kroenke K, Williams JB. Validation and utility of a self-report version of the PRIME-MD: the PHQ primary care study. JAMA 1999;282(18):1737-44.
129. Spitzer RL, Kroenke K, Williams JBW, et al. A brief measure for assessing generalised anxiety disorder: the GAD-7. Archives of Internal Medicine 2006;166:1092-7.
130. College Station, TX: StataCorp LP. Stata Statistical Software: Release 14. College Station, TX: StataCorp LP, 2015.
131. Trivedi MH, Rush AJ, Ibrahim HM, Carmody TJ, Biggs MM, Suppes T, et al. The Inventory of Depressive Symptomatology, Clinician Rating (IDS-C) and the Quick Inventory of Depressive Symptomatology, Clinician Rating (QIDS-C) and Self Report (QIDS-SR) in public sector patients with mood disorders: a psychometric evaluation. Psychological Medicine 2004;34:73-82.
132. Valderas JM, Kotzeva A, Espallargues M, Guyatt G, Ferrans CE, Halyard MY, et al. The impact of measuring patient-reported outcomes in clinical practice: a systematic review of the literature. Quality of Life Research 2008;17:179-93 doi:10.1007/s11136-007-9295-0.
133. Ware JE, Kosinski M, Keller SD. A 12-item short-form health survey construction of scales and preliminary tests of reliability and validity. Medical Care 1996;34:220-33.
134. Wells KB, Stewart A, Hays RD, Burnam MA, Rogers W, Daniels M, et al. The functioning and well-being of depressed patients. Results from the Medical Outcomes Study. JAMA 1989;262:914-9.
135. Wetherell JL, Gatz M. The Beck Anxiety Inventory in older adults with generalized anxiety disorder. Journal of Psychopathology and Behavioral Assessment 2005;27(1):17-24.
136. World Health Organization (WHO). The ICD-10 Classification of Mental and Behavioural Disorders. Geneva: WHO, 1992.
137. Yeung AS, Jing Y, Brenneman SK, Chang TE, Baer L, Hebden T, et al. Clinical Outcomes in MEasurement-based Treatment (COMET): a trial of depression monitoring and feedback to primary care physicians. Depression and Anxiety 2012;29(10):865-73.
138. Zigmond AS, Snaith RP. The hospital anxiety and depression scale. Acta Psychiatrica Scandinavica 1983;67(6):361-70.
139. Zung WW. A self rating depression scale. Archives of General Psychiatry 1965;12:63-70.