The effect of implementing the Outcome Questionnaire-45.2 feedback system in Norway: A multisite randomized clinical trial in a naturalistic setting

Psychotherapy Research

Volumn 25, Issue 6, 2015, Pages 669-677

  Amble, Ingunn ^a   Gude, Tore ^a   Stubdal, Sven ^a   Andersen, Bror Just ^b   Wampold, Bruce E ^a,c  

^a MODUM BAD PSYCHIATRIC CENTER   (Norway)

^b Baerum District Psychiatric Center Vestre Viken HF   (Norway)

^c UNIVERSITY OF WISCONSIN MADISON   (United States)

Author keywords

effect; feedback; OQ 45; Outcome Questionnaire 45.2; psychotherapy monitoring

Indexed keywords

ADOLESCENT; ADULT; AGED; CLINICAL TRIAL; CONTROLLED STUDY; DEVICES; FEEDBACK SYSTEM; FEMALE; HEALTH CARE QUALITY; HUMAN; MALE; MIDDLE AGED; MULTICENTER STUDY; NORWAY; OUTCOME ASSESSMENT; PROCEDURES; PSYCHOMETRY; PSYCHOTHERAPY; QUESTIONNAIRE; RANDOMIZED CONTROLLED TRIAL; STANDARDS; YOUNG ADULT;

ADOLESCENT; ADULT; AGED; FEEDBACK; FEMALE; HUMANS; MALE; MIDDLE AGED; NORWAY; OUTCOME ASSESSMENT (HEALTH CARE); PSYCHOMETRICS; PSYCHOTHERAPY; QUALITY OF HEALTH CARE; SURVEYS AND QUESTIONNAIRES; YOUNG ADULT;

EID: 84943454330     PISSN: 10503307     EISSN: 14684381     Source Type: Journal    
DOI: 10.1080/10503307.2014.928756     Document Type: Article

References (55)

1. I.Amble,, T.Gude,, S.Stubdal,, T.Oktedalen,, A.M.Skjorten,, B.J.Andersen,, B.E.Wampold, (2013). Psychometric properties of the Outcome Questionnaire-45.2: The Norwegian version in an international context. Psychotherapy Research, 504–513. 10.1080/10503307.2013.849016
2. M.G.Anker,, B.L.Duncan, . (2009). Using client feedback to improve couple therapy outcomes: A randomized clinical trial in a naturalistic setting. Journal of Consulting and Clinical Psychology, 77, 693–704. 10.1037/a0016062
3. S.Aoun,, D.Pennebaker,, & A.Janca, (2002). Outcome measurement in rural mental health care: A field trial of rooming-in models. Australian Journal of Rural Health, 10, 302–307. 10.1046/j.1440-1584.2002.00484.x
4. M.Barkham,, G.E.Hardy,, & J.Mellor-Clark, (2010). Developing and delivering practice-based evidence: A guide for the psychological therapies. Chichester: Wiley Blackwell. 10.1002/9780470687994
5. S.Beretvas,, L.Kearney, . (2003). A shortened form of the Outcome Questionnaire: A validation of scores across ethnic groups. Published on line by the Counseling and Mind Health Center of Texas University.
6. J.L.Bludworth,, T.J.G.Tracey, . (2010). The bilevel structure of the Outcome Questionnaire–45. Psychological Assessment, 22, 350–355. 10.1037/a0019187
7. J.F.Boswell,, D.R.Kraus,, S.D.Miller,, & M.J.Lambert, (2013). Implementing routine outcome monitoring in clinical practice: Benefits, challenges, and solutions. Psychotherapy Research (ahead-of-print), 1–14. 10.1080/10503307.2013.817696
8. S.L.Budge,, J.T.Moore,, A.C.Del Re,, B.E.Wampold,, T.P.Baardseth,, & J.B.Nienhuis, (2013). The effectiveness of evidence-based treatments for personality disorders when comparing treatment-as-usual and bona fide treatments. Clinical Psychology Review, 33, 1057–1066. 10.1016/j.cpr.2013.08.003
9. D.L.Chambless,, W.C.Sanderson,, V.Shoham,, S.B.Johnson,, K.S.Pope,, P.Crits-Christoph,, S.McCurry, (1996). An update on empirically validated therapies. The Clinical Psychologist, 49(2), 5–18.
10. J.E.Chapman, (2003). Reliability and validity of the progress questionnaire: An adaptation of the outcome questionnaire (Doctoral dissertation), Drexel University, Philadelphia.
11. M.Chiappelli,, G.L.Coco,, S.Gullo,, L.Bensi,, & C.Prestano, (2008). The Outcome Questionnaire 45.2. Italian validation of an instrument for the assessment of phychological treatments. Epidemiologia e Psichiatria Sociale [Epidemiology and Social Psychiatry], 17(2), 152–161.
12. J.Cohen, (1988). Statistical power analysis for the behavioral sciencies. East Sussex: Psychology Press.
13. P.Crits-Christoph,, S.Ring-Kurtz,, J.L.Hamilton,, M.J.Lambert,, R.Gallop,, B.McClure,, J.Rotrosen, (2012). A preliminary study of the effects of individual patient-level feedback in outpatient substance abuse treatment programs. Journal of Substance Abuse Treatment, 42, 301–309. 10.1016/j.jsat.2011.09.003
14. K.de Jong,, M.A.Nugter,, M.G.Polak,, J.E.A.Wagenborg,, P.Spinhoven,, & W.J.Heiser, (2007). The Outcome Questionnaire (OQ-45) in a Dutch population: A cross-cultural validation. Clinical Psychology & Psychotherapy, 14, 288–301. 10.1002/cpp.529
15. K.de Jong,, R.Timman,, L.Hakkaart-Van Roijen,, P.Vermeulen,, K.Kooiman,, J.Passchier,, & J.van Busschbach, (2014). The effect of outcome monitoring feedback to clinicians and patients in short and long-term psychotherapy: A randomized controlled trial. Psychotherapy Research. 10.1080/10503307.2013.871079
16. K.de Jong,, P.van Sluis,, M.A.Nugter,, W.J.Heiser,, & P.Spinhoven, (2012). Understanding the differential impact of outcome monitoring: Therapist variables that moderate feedback effects in a randomized clinical trial. Psychotherapy Research, 22, 464–474. 10.1080/10503307.2012.673023
17. J.A.Durlak, (2009). How to select, calculate, and interpret effect sizes. Journal of Pediatric Psychology, 34, 917–928. 10.1093/jpepsy/jsp004
18. C.Evans,, J.Connell,, M.Barkham,, F.Margison,, G.McGRATH,, J.Mellor-Clark,, & K.Audin, (2002). Towards a standardised brief outcome measure: Psychometric properties and utility of the CORE—OM. The British Journal of Psychiatry, 180(1), 51–60. 10.1192/bjp.180.1.51
19. P.Fonagy,, A.Roth,, & A.Higgitt, (2005). The outcome of psychodynamic psychotherapy for psychological disorders. Clinical Neuroscience Research, 4, 367–377. 10.1016/j.cnr.2005.03.005
20. N.B.Hansen,, & M.J.Lambert, (2003). An evaluation of the dose–response relationship in naturalistic treatment settings using survival analysis. Mental Health Services Research, 5(1), 1–12. 10.1023/A:1021751307358
21. N.B.Hansen,, M.J.Lambert,, & E.M.Forman, (2002). The psychotherapy dose-response effect and its implications for treatment delivery services. Clinical Psychology: Science and Practice, 9, 329–343. 10.1093/clipsy.9.3.329
22. D.R.Hatfield,, & B.M.Ogles, (2004). The use of outcome measures by psychologists in clinical practice. Professional Psychology: Research and Practice, 35, 485–491. 10.1037/0735-7028.35.5.485
23. E.J.Hawkins,, M.J.Lambert,, D.A.Vermeersch,, K.L.Slade,, & K.C.Tuttle, (2004). The therapeutic effects of providing patient progress information to therapists and patients. Psychotherapy Research, 14, 308–327. 10.1093/ptr/kph027
24. S.R.G.Jones, (1992). Was there a Hawthorne effect? American Journal of Sociology, 98, 451–468. 10.1086/230046
25. S.-H.Kim,, S.N.Beretvas,, & A.R.Sherry, (2010). A validation of the factor structure of OQ-45 scores using factor mixture modeling. Measurement and Evaluation in Counseling and Development, 42, 275–295. 10.1177/0748175609354616
26. C.Knaup,, M.Koesters,, D.Schoefer,, T.Becker,, & B.Puschner, (2009). Effect of feedback of treatment outcome in specialist mental healthcare: Meta-analysis. The British Journal of Psychiatry, 195(1), 15–22. 10.1192/bjp.bp.108.053967
27. H.C.Kraemer,, & D.J.Kupfer, (2006). Size of treatment effects and their importance to clinical research and practice. Biological Psychiatry, 59, 990–996. 10.1016/j.biopsych.2005.09.014
28. M.J.Lambert, (2010). Prevention of treatment failure: The use of measuring, monitoring, and feedback in clinical practice. Washington, DC: American Psychological Association.
29. M.J.Lambert, (2013). Bergin and Garfield's handbook of psychotherapy and behavior change. New York, NY: John Wiley & Sons.
30. M.Lambert,, & B.Ogles, (2004). The efficacy and effectiveness of psychotherapy. In M.J.Lambert (Ed.), Bergin and Garfield's handbook of psychotherapy and behaviour change (pp. 139–193). Chichester: John Wiley & Sons.
31. M.J.Lambert,, & K.Shimokawa, (2011a). Measuring client outcome. In J.C.Norcross (Ed.), Psychotherapy relationships that work: Evidence-based responsiveness (2nd ed., pp. 203–223). New York, NY: Oxford University Press.
32. M.J.Lambert,, & K.Shimokawa, (2011b). Collecting client feedback. Psychotherapy, 48(1), 72–79. 10.1037/a0022238
33. M.J.Lambert,, M.Kahler,, C.Harmon,, G.M.Burlingame, (2011). Administration and Scoring Manual Outcome Questionnaire OQ-45.2. (OQ Measures L.L.C.).
34. M.J.Lambert,, G.M.Burlingame,, V.Umphress,, N.B.Hansen,, D.A.Vermeersch,, G.C.Clouse,, & S.C.Yanchar, (1996). The reliability and validity of the Outcome Questionnaire. Clinical Psychology & Psychotherapy, 3, 249–258. 10.1002/(SICI)1099-0879(199612)3:4<249::AID-CPP106>3.0.CO;2-S
35. M.J.Lambert,, W.Hannöver,, K.Nisslmüller,, M.Richard,, & H.Kordy, (2002). Fragebogen zum Ergebnis von Psychotherapie [Questionnaire on the results of psychotherapy: Reliability and validity of the German translation of the Outcome Questionnaire 45.2 (OQ-45.2)]. Zeitschrift für klinische Psychologie und Psychotherapie [Journal of Clinical Psychology and Psychotherapy], 31(1), 40–46. 10.1026//1616-3443.31.1.40
36. K.M.Laska,, A.S.Gurman,, & B.E.Wampold, (2013). Expanding the lens of evidence-based practice in psychotherapy: A common factors perspective. Psychotherapy [Epub ahead of print].
37. G.Lo Coco,, M.Chiappelli,, L.Bensi,, S.Gullo,, C.Prestano,, & M.J.Lambert, (2008). The factorial structure of the outcome questionnaire-45: A study with an Italian sample. Clinical Psychology & Psychotherapy, 15, 418–423. 10.1002/cpp.601
38. A.A.McAleavey,, S.S.Nordberg,, J.A.Hayes,, L.G.Castonguay,, B.D.Locke,, & A.J.Lockard, (2012). Clinical validity of the Counseling Center Assessment of Psychological Symptoms-62 (CCAPS-62): Further evaluation and clinical applications. Journal of Counseling Psychology, 59, 575–590. 10.1037/a0029855
39. S.D.Miller,, B.L.Duncan,, R.Sorrell,, & G.S.Brown, (2005). The partners for change outcome management system. Journal of Clinical Psychology, 61(2), 199–208.
40. R.M.Mueller,, M.J.Lambert, . (1998). Construct validity of the Outcome Questionnaire: A confirmatory factor analysis. Journal of Personality Assessment, 70, 248–262. 10.1207/s15327752jpa7002_5
41. D.C.Mohr, (1995). Negative outcome in psychotherapy: A critical review. Clinical Psychology: Science and Practice, 2(1), 1–27. 10.1111/j.1468-2850.1995.tb00022.x
42. W.M.Pinsof,, R.E.Zinbarg,, J.L.Lebow,, L.M.Knobloch-Fedders,, E.Durbin,, A.Chambers,, G.Friedman, (2009). Laying the foundation for progress research in family, couple, and individual therapy: The development and psychometric features of the initial Systemic Therapy Inventory of Change. Psychotherapy Research, 19(2), 143–156. 10.1080/10503300802669973
43. T.Probst,, M.J.Lambert,, T.H.Loew,, R.W.Dahlbender,, R.Göllner,, & K.Tritt, (2013). Feedback on patient progress and clinical support tools for therapists: Improved outcome for patients at risk of treatment failure in psychosomatic in-patient therapy under the conditions of routine practice. Journal of Psychosomatic Research, 75, 255–261. 10.1016/j.jpsychores.2013.07.003
44. Y.-F.Qin,, & S.-J.Hu, (2008). Usability report of outcome Questionnaire-45 in part of Chinese sample. Chinese Journal of Clinical Psychology, 16, 138–140.
45. R.Shafran,, D.M.Clark,, C.G.Fairburn,, A.Arntz,, D.H.Barlow,, A.Ehlers,, G.T.Wilson, (2009). Mind the gap: Improving the dissemination of CBT. Behaviour Research and Therapy, 47, 902–909. 10.1016/j.brat.2009.07.003
46. K.Shimokawa,, M.J.Lambert,, & D.W.Smart, (2010). Enhancing treatment outcome of patients at risk of treatment failure: Meta-analytic and mega-analytic review of a psychotherapy quality assurance system. Journal of Consulting and Clinical Psychology, 78, 298–311. 10.1037/a0019247
47. W.Simon,, M.J.Lambert,, G.Busath,, A.Vazquez,, A.Berkeljon,, K.Hyer,, M.Berrett, (2013). Effects of providing patient progress feedback and clinical support tools to psychotherapists in an inpatient eating disorders treatment program: A randomized controlled study. Psychotherapy Research, 23, 287–300. 10.1080/10503307.2013.787497
48. W.Simon,, M.J.Lambert,, M.W.Harris,, G.Busath,, & A.Vazquez, (2012). Providing patient progress information and clinical support tools to therapists: Effects on patients at risk of treatment failure. Psychotherapy Research, 22, 638–647. 10.1080/10503307.2012.698918
49. G.I.Spielmans,, E.T.Gatlin,, & J.P.McFall, (2010). The efficacy of evidence-based psychotherapies versus usual care for youths: Controlling confounds in a meta-reanalysis. Psychotherapy Research, 20, 234–246. 10.1080/10503300903311293
50. G.Walter,, M.Cleary,, & J.Rey, (1998). Attitudes of mental health personnel towards rating outcome. Journal of Quality in Clinical Practice, 18(2), 109.
51. B.E.Wampold,, & G.S.Brown, (2005). Estimating therapist variability: A naturalistic study of outcomes in managed care. Journal of Consulting and Clinical Psychology, 73, 914–923. 10.1037/0022-006X.73.5.914
52. B.E.Wampold,, S.L.Budge,, K.M.Laska,, A.C.Del Re,, T.P.Baardseth,, C.Flűckiger,, W.Gunn, (2011). Evidence-based treatments for depression and anxiety versus treatment-as-usual: A meta-analysis of direct comparisons. Clinical Psychology Review, 31, 1304–1312. 10.1016/j.cpr.2011.07.012
53. J.R.Weisz,, A.Jensen-Doss,, & K.M.Hawley, (2006). Evidence-based youth psychotherapies versus usual clinical care: A meta-analysis of direct comparisons. American Psychologist, 61, 671–689. 10.1037/0003-066X.61.7.671
54. P.Wennberg,, B.Philips,, & K.Jong, (2010). The Swedish version of the Outcome Questionnaire (OQ-45): Reliability and factor structure in a substance abuse sample. Psychology and Psychotherapy: Theory, Research and Practice, 83, 325–329. 10.1348/147608309X478715
55. A.Willis,, F.P.Deane,, & T.Coombs, (2009). Improving clinicians’ attitudes toward providing feedback on routine outcome assessments. International Journal of Mental Health Nursing, 18, 211–215. 10.1111/j.1447-0349.2009.00596.x