Effective components of feedback from Routine Outcome Monitoring (ROM) in youth mental health care: Study protocol of a three-arm parallel-group randomized controlled trial

BMC Psychiatry

Volumn 14, Issue 1, 2014, Pages

  Van Sonsbeek, Maartje A M S ^a,b,c   Hutschemaekers, Giel G J M ^a,b   Veerman, Jan W ^a   Tiemens, Bea B G ^a,b  

^a RADBOUD UNIVERSITY NIJMEGEN   (Netherlands)

^b Pro Persona Centre for Education and Science (ProCES)   (Netherlands)

^c Pro Persona Youth Tiel   (Netherlands)

Author keywords

Feedback; Randomized controlled trial; Routine Outcome Monitoring; Youth mental health care

Indexed keywords

ADOLESCENT; ARTICLE; CHILD; CHILD CARE; CONSULTATION; CONTROLLED STUDY; FEEDBACK SYSTEM; HUMAN; MAJOR CLINICAL STUDY; MENTAL HEALTH CARE; NETHERLANDS; OUTCOME ASSESSMENT; PRESCHOOL CHILD; QUALITY OF LIFE; RANDOMIZED CONTROLLED TRIAL; ROUTINE OUTCOME MONITORING; SCHOOL CHILD; SCORING SYSTEM; TREATMENT DURATION; FEMALE; MALE; MENTAL HEALTH; PARENT; PROCEDURES; QUESTIONNAIRE; RANDOMIZED CONTROLLED TRIAL (TOPIC);

ADOLESCENT; CHILD; FEEDBACK; FEMALE; HUMANS; MALE; MENTAL HEALTH; NETHERLANDS; PARENTS; QUALITY OF LIFE; QUESTIONNAIRES; RANDOMIZED CONTROLLED TRIALS AS TOPIC;

EID: 84891545202     PISSN: None     EISSN: 1471244X     Source Type: Journal    
DOI: 10.1186/1471-244X-14-3     Document Type: Article

References (66)

1. GGZNederland Jeugd-ggz: Investeren in de toekomst! Ambities voor 2011-2014 2011, Amersfoort: GGZNederland, GGZNederland.
2. Weisz JR. Psychotherapy for Children and Adolescents: Evidence-Based Treatments and Case Examples 2004, Cambridge: Cambridge University Press.
3. Warren JS, Nelson PL, Mondragon SA, Baldwin SA, Burlingame GM. Youth psychotherapy change trajectories and outcomes in usual care: Community mental health versus managed care settings. J Consult Clin Psychol 2010, 78:144-155.
4. Kazdin AE. Combined and multimodal treatments in child and adolescent psychotherapy: Issues, challenges, and research directions. Clin Psychol Sci Pract 1996, 3:69-100.
5. Hannan C, Lambert MJ, Harmon C, Nielsen SL, Smart DW, Shimokawa K, Sutton SW. A lab test and algorithms for identifying clients at risk for treatment failure. J Clin Psychol 2005, 61:155-163. 10.1002/jclp.20108, 15609357.
6. Hatfield D, McCullough L, Frantz SH, Krieger K. Do we know when our clients get worse? An investigation of therapists' ability to detect negative client change. Clin Psychol Psychother 2010, 17:25-32.
7. Bickman L. A measurement feedback system (MFS) is necessary to improve mental health outcomes. J Am Acad Child Adolesc Psychiatry 2008, 47:1114-1119. 10.1097/CHI.0b013e3181825af8, 2893344, 20566188.
8. Lambert MJ, Whipple JL, Hawkins EJ, Vermeersch DA, Nielsen SL, Smart DW. Is it time for clinicians to routinely track patient outcome? A meta-analysis. Clin Psychol Sci Pract 2006, 10:288-301.
9. De Jong K. A Chance for Change: Building an Outcome Monitoring Feedback System for Outpatient Mental Health Care 2012, Leiden University: Clinical, Health and Neuropsychology, Faculty of Social and Behavioural Sciences.
10. Lambert MJ. Prevention of Treatment Failure: The use of Measuring, Monitoring, and Feedback in Clinical Practice 2010, Washington, DC: American Psychological Association.
11. Lambert M. Presidential address: What we have learned from a decade of research aimed at improving psychotherapy outcome in routine care. Psychother Res 2007, 17:1-14.
12. Kazdin AE. Evidence-based treatment and practice: new opportunities to bridge clinical research and practice, enhance the knowledge base, and improve patient care. Am Psychol 2008, 63:146-159.
13. Ivers NM, Tu K, Francis J, Barnsley J, Shah B, Upshur R, Kiss A, Grimshaw JM, Zwarenstein M. Feedback GAP: study protocol for a cluster-randomized trial of goal setting and action plans to increase the effectiveness of audit and feedback interventions in primary care. Implement Sci 2010, 5:98. 10.1186/1748-5908-5-98, 3161381, 21167034.
14. Ivers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, French SD, O'Brien MA, Johansen M, Grimshaw J, Oxman AD. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev 2012, 6:CD000259.
15. Carlier IV, Meuldijk D, Van Vliet IM, Van Fenema E, Van der Wee NJ, Zitman FG. Routine Outcome Monitoring and feedback on physical or mental health status: evidence and theory. J Eval Clin Pract 2012, 18:104-110. 10.1111/j.1365-2753.2010.01543.x, 20846319.
16. Knaup C, Koesters M, Schoefer D, Becker T, Puschner B. Effect of feedback of treatment outcome in specialist mental healthcare: meta-analysis. Br J Psychiatry 2009, 195:15-22. 10.1192/bjp.bp.108.053967, 19567889.
17. Shimokawa K, Lambert MJ, Smart DW. Enhancing treatment outcome of patients at risk of treatment failure: Meta-analytic and mega-analytic review of a psychotherapy quality assurance system. J Consult Clin Psychol 2010, 78:298-311.
18. Marshall S, Haywood K, Fitzpatrick R. Impact of patient-reported outcome measures on routine practice: a structured review. J Eval Clin Pract 2006, 12:559-568. 10.1111/j.1365-2753.2006.00650.x, 16987118.
19. Valderas JM, Kotzeva A, Espallargues M, Guyatt G, Ferrans CE, Halyard MY, Revicki DA, Symonds T, Parada A, Alonso J. The impact of measuring patient-reported outcomes in clinical practice: a systematic review of the literature. Qual Life Res 2008, 17:179-193. 10.1007/s11136-007-9295-0, 18175207.
20. Haywood K, Marshall S, Fitzpatrick R. Patient participation in the consultation process: a structured review of intervention strategies. Patient Educ Couns 2006, 63:12-23. 10.1016/j.pec.2005.10.005, 16406464.
21. Sapyta J, Riemer M, Bickman L. Feedback to clinicians: theory, research, and practice. J Clin Psychol 2005, 61:145-153. 10.1002/jclp.20107, 15609360.
22. Miller SD, Duncan BL, Sorrell R, Brown GS. The partners for change outcome management system. J Clin Psychol 2005, 61:199-208. 10.1002/jclp.20111, 15609362.
23. Whipple JL, Lambert MJ, Vermeersch DA, Smart DW, Nielsen SL, Hawkins EJ. Improving the effects of psychotherapy: The use of early identification of treatment and problem-solving strategies in routine practice. J Couns Psychol 2003, 50:59-68.
24. Haas E, Hill RD, Lambert MJ, Morrell B. Do early responders to psychotherapy maintain treatment gains?. J Clin Psychol 2002, 58:1157-1172. 10.1002/jclp.10044, 12209871.
25. Lambert MJ, Harmon C, Slade K, Whipple JL, Hawkins EJ. Providing feedback to psychotherapists on their patients' progress: clinical results and practice suggestions. J Clin Psychol 2005, 61:165-174. 10.1002/jclp.20113, 15609358.
26. Kluger AN, DeNisi A. The effects of feedback interventions on performance: a historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychol Bull 1996, 119:254-284.
27. Bickman L, Kelley SD, Breda C, De Andrade AR, Riemer M. Effects of routine feedback to clinicians on mental health outcomes of youths: results of a randomized trial. Psychiat Serv 2011, 62:1423-1429.
28. Riemer M, Bickman L. Using Program Theory to Link Social Psychology and Program Evaluation. Social Psychology and Evaluation 2011, 104-138. New York: Guilford Press, Mark M, Donaldson S, Campbell B.
29. Locke EA, Latham GP. A Theory of Goal Setting and Task Performance 1990, Englewood Cliffs, N.J.: Prentice-Hall.
30. Mugford M, Banfield P, O'Hanlon M. Effects of feedback of information on clinical practice: a review. BMJ 1991, 303:398-402. 10.1136/bmj.303.6799.398, 1670701, 1912809.
31. Jamtvedt G, Young JM, Kristoffersen DT, O'Brien MA, Oxman AD. Audit and feedback: effects on professional practice and health care outcomes. Cochrane Database Syst Rev 2006, 2:CD000259.
32. Harmon C, Hawkins EJ, Lambert MJ, Slade K, Whipple JS. Improving outcomes for poorly responding clients: the use of clinical support tools and feedback to clients. J Clin Psychol 2005, 61:175-185. 10.1002/jclp.20109, 15609355.
33. Slade K, Lambert MJ, Harmon SC, Smart DW, Bailey R. Improving psychotherapy outcome: the use of immediate electronic feedback and revised clinical support tools. Clin Psychol Psychother 2008, 15:287-303. 10.1002/cpp.594, 19115449.
34. Festinger L. A Theory of Cognitive Dissonance 1957, Evanston, IL: Row, Peterson.
35. Carver CS, Scheier MF. Control theory: a useful conceptual framework for personality-social, clinical, and health psychology. Psychol Bull 1982, 92:111-135.
36. Ilgen DR, Fisher CD, Taylor MS. Consequences of individual feedback on behavior in organizations. J Appl Psychol 1979, 64:349-371.
37. De Jong K, Van Sluis P, Nugter MA, Heiser WJ, Spinhoven P. Understanding the differential impact of outcome monitoring: Therapist variables that moderate feedback effects in a randomized clinical trial. Psychother Res 2012, 22:464-474. 10.1080/10503307.2012.673023, 22468992.
38. Claiborn CD, Goodyear RK. Feedback in psychotherapy. J Clin Psychol 2005, 61:209-217. 10.1002/jclp.20112, 15609354.
39. Simon W, Harris M, Lambert M. The effects of progress and clinical support tools feedback compared to TAU within a hospital-based outpatient clinic [abstract]. Book of Abstracts. Society for Psychotherapy Research (SPR) 42nd International Meeting 2011, 29 June - 2 July, Bern, Switzerland 2011, 86.
40. Simon W, Lambert MJ, Harris MW, Busath G, Vazquez A. Providing patient progress information and clinical support tools to therapists: effects on patients at risk of treatment failure. Psychother Res 2012, 22:638-647. 10.1080/10503307.2012.698918, 22755547.
41. Evans C, Connell J, Barkham M, Margison F, McGrath G, Mellor-Clark J, Audin K. Towards a standardised brief outcome measure: psychometric properties and utility of the CORE-OM. Br J Psychiatry 2002, 180:51-60. 10.1192/bjp.180.1.51, 11772852.
42. van der Feltz-Cornelis CM, Volker D, De Heer E. Routine Outcome Monitoring: Ontwikkelingen in de GGZ 2010, Utrecht: Trimbos-instituut.
43. Jensen PS, Hoagwood K, Petti T. Outcomes of mental health care for children and adolescents: II. Literature review and application of a comprehensive model. J Am Acad Child Adolesc Psychiatry 1996, 35:1064-1077. 10.1097/00004583-199608000-00018, 8755804.
44. Boer F, Markus MT, Vermeiren RR. Don't say: stand still, or I can't measure you! routine outcome measurement in child- and adolescent psychiatry. Tijdschr Psychiatr 2012, 54:167-171.
45. Barbaresi WJ, Colligan RC, Weaver AL, Voigt RG, Killian JM, Katusic SK. Mortality, ADHD, and Psychosocial Adversity in Adults With Childhood ADHD: A Prospective Study. Pediatrics 2013, 131:637-644. 10.1542/peds.2012-2354, 23460687.
46. Volkmar FR, Wolf JM. When children with autism become adults. World Psychiatry 2013, 12:79-80. 10.1002/wps.20020, 3619174, 23471806.
47. GGZNederland Zorg op waarde geschat: update. Sectorrapport GGZ 2010 2010, Amersfoort: GGZNederland, GGZNederland.
48. Achenbach TM, McConaughy SH, Howell CT. Child/adolescent behavioral and emotional problems: implications of cross-informant correlations for situational specificity. Psychol Bull 1987, 101:213-222.
49. Van der Ende J, Verhulst FC, Tiemeier H. Agreement of informants on emotional and behavioral problems from childhood to adulthood. Psychol Assess 2012, 24:293-300.
50. Warren JS, Lambert MJ. Youth Clinical Support Tools Manual. Treatment Support Measure: Parent and Youth Forms 2013, Salt Lake City, UT: OQ Measures LLC.
51. Warren JS, Nelson PL, Burlingame GM, Mondragon SA. Predicting patient deterioration in youth mental health services: community mental health vs. managed care settings. J Clin Psychol 2012, 68:24-40. 10.1002/jclp.20831, 21989865.
52. Whipple JL, Lambert MJ. Outcome measures for practice. Annu Rev Clin Psychol 2011, 7:87-111. 10.1146/annurev-clinpsy-040510-143938, 21166536.
53. Goodman R. The strengths and difficulties questionnaire: a research note. J Child Psychol Psychiatry 1997, 38:581-586. 10.1111/j.1469-7610.1997.tb01545.x, 9255702.
54. Van Widenfelt BM, Goedhart AW, Treffers PD, Goodman R. Dutch version of the Strengths and Difficulties Questionnaire (SDQ). Eur Child Adolesc Psychiatry 2003, 12:281-289. 10.1007/s00787-003-0341-3, 14689260.
55. Muris P, Meesters C, Van den Berg F. The strengths and difficulties questionnaire (SDQ). Eur Child Adolesc Psychiatry 2003, 12:1-8.
56. Stone LL, Otten R, Engels RC, Vermulst AA, Janssens JM. Psychometric properties of the parent and teacher versions of the strengths and difficulties questionnaire for 4-to 12-year-olds: a review. Clin Child Fam Psychol Rev 2010, 13:254-274. 10.1007/s10567-010-0071-2, 2919684, 20589428.
57. Ravens-Sieberer U. KIDSCREENgroup: The KIDSCREEN Questionnaires - Quality of life questionnaires for children and adolescents - Handbook 2006, Lengerich: Pabst Science Publishers.
58. Ravens-Sieberer U, Gosch A, Rajmil L, Erhart M, Bruil J, Power M, Duer W, Auquier P, Cloetta B, Czemy L, et al. The KIDSCREEN-52 quality of life measure for children and adolescents: psychometric results from a cross-cultural survey in 13 European countries. Value Health 2008, 11:645-658. 10.1111/j.1524-4733.2007.00291.x, 18179669.
59. Kok I, Van Wijngaarden B. Cliëntwaardering in de GGZ. Vragenlijsten en handleiding: GGZ Thermometer voor de volwassenenzorg (versie 2003) en GGZ Jeugdthermometer (versie 2003) 2003, Utrecht: GGZ Nederland/Trimbos-instituut.
60. Bransen M, Kok I, Van Wijngaarden B. De aanpassing van de GGZ jeugdthermometer versie 2003 tot de GGZ jeugdthermometer versie 2005 2005, Utrecht: Trimbos-instituut.
61. Jacobson NS, Truax P. Clinical significance: a statistical approach to defining meaningful change in psychotherapy research. J Consult Clin Psychol 1991, 59:12-19.
62. Hawkins EJ, Lambert MJ, Vermeersch DA, Slade KL, Tuttle KC. The therapeutic effects of providing patient progress information to therapists and patients. Psychother Res 2004, 14:308-327.
63. Faul F, Erdfelder E, Buchner A, Lang A-G. Statistical power analyses using G* Power 3.1: Tests for correlation and regression analyses. Behav Res Methods 2009, 41:1149-1160. 10.3758/BRM.41.4.1149, 19897823.
64. Muthén LK, Muthén BO. Mplus User's Guide 1998-2012, Los Angeles, CA: Muthén & Muthén, Seventh.
65. Schulz KF, Altman DG, Moher D. CONSORT 2010 statement: updated guidelines for reporting parallel group randomized trials. Ann Intern Med 2010, 152:726-732. 10.7326/0003-4819-152-11-201006010-00232, 20335313.
66. Moher D, Hopewell S, Schulz KF, Montori V, Gøtzsche PC, Devereaux P, Elbourne D, Egger M, Altman DG. CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. BMJ 2010, 340:c869. 10.1136/bmj.c869, 2844943, 20332511.