Progress monitoring in mental health and addiction treatment: A means of improving care

Professional Psychology: Research and Practice

Volumn 44, Issue 4, 2013, Pages 231-246

  Goodman, Jessica D ^a,b   McKay, James R ^a   DePhilippis, Dominick ^a  

^a VETERANS AFFAIRS MEDICAL CENTER   (United States)

^b UNIVERSITY OF PENNSYLVANIA   (United States)

Author keywords

outcome monitoring; Progress monitoring; Psychotherapy outcome; Research synthesis; substance abuse services

Indexed keywords

EID: 84890028377     PISSN: 07357028     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0032605     Document Type: Article

References (77)

1. Abanishe, D. R. (2008). Cross-cultural comparison of the Outcome Questionnaire (Doctoral dissertation). Ann Arbor, MI: ProQuest, UMI Dissertation Publishing.
2. American Psychological Association. (2011). PracticeOUTCOMES: Measures for psychologists. Retrieved from www.practiceoutcomes.apa.org American Psychological Association Presidential Task Force on Evidence- Based Practice. (2006). Evidence-based practice in psychology. American Psychologist, 61, 271-285. doi:10.1037/0003-066X.61.4.271
3. Anker, M. G., Duncan, B. L., & Sparks, J. A. (2009). Using client feedback to improve couple therapy outcomes: A randomized clinical trial in a naturalistic setting. Journal of Consulting and Clinical Psychology, 77, 693-704. doi:10.1037/a0016062
4. Attkisson, C. C., & Zwick, R. (1982). The Client Satisfaction Questionnaire: Psychometric properties and correlations with service utilization and psychotherapy outcome. Evaluation and Program Planning, 5, 233-237.
5. Barkham, M., Margison, F., Leach, C., Lucock, M., Mellor-Clark, J., Evans, C. . . . McGrath, G. (2001). Service profiling and outcomes benchmarking using the CORE-OM: Towards practice-based evidence in the psychological therapies. Journal of Consulting and Clinical Psychology, 69, 184-196. doi:10.1037/0022-006X.69.2.184
6. Beck, A. T., Steer, R. A., & Carbin, M. G. (1988). Psychometric properties of the Beck Depression Inventory: Twenty-five years of evaluation. Clinical Psychology Review, 8, 77-100. doi:10.1016/0272- 7358(88)90050-5
7. Brooner, R. K., & Kidorf, M. (2002). Using behavioral reinforcement to improve methadone treatment participation. Science & Practice Perspectives, 1, 38-47. doi:10.1151/spp021138
8. Brooner, R. K., Kidorf, M. S., King, V. L., Stoller, K. B., Peirce, J. M., Bigelow, G. E., & Kolodner, K. (2004). Behavioral contingencies improve counseling attendance in an adaptive treatment model. Journal of Substance Abuse Treatment, 27, 223-232. doi:10.1016/j.jsat.2004.07 .005
9. Brown, G. S., Lambert, M. J., Jones, E. R., & Minami, T. (2005). Identifying highly effective psychotherapists in a managed care environment. The American Journal of Managed Care, 11, 513-520.
10. Brown, T. A., Chorpita, B. F., Korotitsch, W., & Barlow, D. H. (1997). Psychometric properties of the Depression Anxiety Stress Scales (DASS) in clinical samples. Behaviour Research and Therapy, 35, 79-89. doi:10.1016/S0005-7967(96)00068-X
11. Butler, S. F., Budman, S. H., McGee, M. D., Davis, M. S., Cornelli, R., & Morey, L. C. (2006). Addiction severity assessment tool: Development of a self-report measure for clients in substance abuse treatment. Drug and Alcohol Dependence, 80, 349-360. doi:10.1016/j.drugalcdep.2005 .05.005
12. Cacciola, J. S., Alterman, A. I., DePhilippis, D., Drapkin, M. L., Valadez, C., Jr., Fala, N. C. . . . McKay, J. R. (2012). Development and initial evaluation of the Brief Addiction Monitor (BAM). Journal of Substance Abuse Treatment. doi:10.1016/j.jsat.2012.07.013
13. Cameron, I. M., Cunningham, L., Crawford, J. R., Eagles, J. M., Eisen, S. V., Lawton, K. . . . Hamilton, R. J. (2007). Psychometric properties of the BASIS-24 (Behaviour and Symptom Identification Scale-Revised) mental health outcome measure. International Journal of Psychiatry in Clinical Practice, 11, 36-43. doi:10.1080/13651500600885531
14. Carlier, I. V. E., Meuldijk, D., Van Vliet, I. M., Van Fenema, E., Van der Wee, N. J. A., & Zitman, F. G. (2012). ROM and feedback on physical or mental health status: Evidence and theory. Journal of Evaluation in Clinical Practice, 18, 104-110. doi:10.1111/j.1365-2753.2010.01543.x
15. Carroll, K. M., & Rounsaville, B. J. (2002). On beyond urine: Clinically useful assessment instruments in the treatment of drug dependence. Behaviour Research and Therapy, 40, 1329-1344. doi:10.1016/S0005- 7967(02)00038-4
16. Chao, R. C., Olson, A. N., Spaventa, K. Z., & Smith, C. (2010). Multiculturally sensitive mental health scale (MSMHS): Development, factor analysis, reliability, and validity. Retrieved from http://counselingout fitters.com/vistas/vistas10/Article_66.pdf
17. Crits-Christoph, P., Ring-Kurtz, S., Hamilton, J. L., Lambert, M. J., Gallop, R., McClure, B. . . . Rotrosen, J. (2012). A preliminary study of the effects of individual patient-level feedback in outpatient substance abuse treatment programs. Journal of Substance Abuse Treatment, 42, 301- 309. doi:10.1016/j.jsat.2011.09.003
18. Deering, D. E., Sellman, J. D., Adamson, S. J., Horn, J., & Frampton, C. M. A. (2008). Development of a brief treatment instrument for routine clinical use with methadone maintenance treatment clients: The Methadone Treatment Index. Substance Use & Misuse, 43, 1666-1680. doi:10.1080/10826080802116098
19. Derogatis, L. R., & Melisaratos, N. (1983). The Brief Symptom Inventory: An introductory report. Psychological Medicine, 13, 595-605. doi: 10.1017/S0033291700048017
20. Doucette, A. (2006). Assessing service system performance: Treatment outcomes [Power Point slides]. Retrieved from www.vsias.org/ Handouts/2006/Doucette.Systems%20of%20Care.ppt
21. Duncan, B. L., Miller, S. D., & Sparks, J. A. (2004). The heroic client: A revolutionary way to improve effectiveness through client-directed outcome-informed therapy (rev. ed. ). San Francisco, CA: Jossey-Bass.
22. Duncan, B. L., Miller, S. D., Sparks, J. A., Claud, D. A., Reynolds, L. R., Brown, J., & Johnson, L. D. (2003). The Session Rating Scale: Preliminary psychometric properties of a "working" alliance measure. Journal of Brief Therapy, 3, 3-12.
23. Evans, C., Connell, J., Barkham, M., Margison, F., McGrath, G., Mellor- Clark, J., & Audin, K. (2002). Towards a standardised brief outcome measure: Psychometric properties and utility of the CORE-OM. The British Journal of Psychiatry, 180, 51-60. doi:10.1192/bjp.180.1.51
24. Goodheart, C. D. (2011). Psychology practice: Design for tomorrow. American Psychologist, 66, 339-347. doi:10.1037/a0024222
25. Green, D., & Latchford, G. (2012). Maximising the benefits of psychotherapy: A practice-based evidence approach. Chichester, UK: Wiley- Blackwell.
26. Hall, G. C. N. (2001). Psychotherapy research with ethnic minorities: Empirical, ethical, and conceptual issues. Journal of Consulting and Clinical Psychology, 69, 502-510. doi:10.1037/0022-006X.69.3.502
27. Hamilton, J. D., & Bickman, L. (2008). A measurement feedback system (MFS) is necessary to improve mental health outcomes. Journal of the American Academy of Child & Adolescent Psychiatry, 47, 1114-1119. doi:10.1097/CHI.0b013e3181825af8
28. Hannan, C., Lambert, M. J., Harmon, C., Nielsen, S. L., Smart, D. W., Shimokawa, K., & Sutton, S. W. (2005). A lab test and algorithms for identifying clients at risk for treatment failure. JCLP: In Session, 61, 155-163.
29. Harmon, S. C., Lambert, M. J., Smart, D. M., Hawkins, E., Nielsen, S. L., Slade, K., & Lutz, W. (2007). Enhancing outcome for potential treatment failures: Therapist-client feedback and clinical support tools. Psychotherapy Research, 17, 379-392. doi:10.1080/10503300600702331
30. Hatfield, D., McCullough, L., Frantz, S. H. B., & Krieger, K. (2010). Do we know when our clients get worse? An investigation of therapists' ability to detect negative client change. Clinical Psychology & Psychotherapy, 17, 25-32.
31. Hatfield, D. R., & Ogles, B. M. (2004). The use of outcome measures by psychologists in clinical practice. Professional Psychology: Research and Practice, 35, 485-491. doi:10.1037/0735-7028.35.5.485
32. Hawkins, E. J., Baer, J. S., & Kivlahan, D. R. (2008). Concurrent monitoring of psychological distress and satisfaction measures as predictors of addiction treatment retention. Journal of Substance Abuse Treatment, 35, 207-216. doi:10.1016/j.jsat.2007.10.001
33. Howard, K. I., Moras, K., Brill, P. L., Martinovich, Z., & Lutz, W. (1996). Evaluation of psychotherapy: Efficacy, effectiveness, and patient progress. American Psychologist, 51, 1059-1064. doi:10.1037/0003-066X .51.10.1059
34. Institute of Medicine. (2006). Improving the quality of health care for mental and substance use conditions: Quality chasm series. Washington, DC: The National Academies Press.
35. Kidorf, M., Neufeld, K., & Brooner, R. K. (2004). Combining stepped-care approaches with behavioral reinforcement to motivate employment in opioid-dependent outpatients. Substance Use & Misuse, 39, 2215-2238. doi:10.1081/JA-200034591
36. King, V. L., Stoller, K. B., Hayes, M., Umbricht, A., Currens, M., Kidorf, M. S. . . . Brooner, R. K. (2002). A multicenter randomized evaluation of methadone medical maintenance. Drug and Alcohol Dependence, 65, 137-148. doi:10.1016/S0376-8716(01)00155-7
37. Knaup, C., Koesters, M., Schoefer, D., Becker, T., & Puschner, B. (2009). Effect of feedback of treatment outcome in specialist mental healthcare: Meta-analysis. The British Journal of Psychiatry, 195, 15-22. doi: 10.1192/bjp.bp.108.053967
38. Kraus, D. R., Seligman, D. A., & Jordan, J. R. (2005). Validation of a behavioral health treatment outcome and assessment tool designed for naturalistic settings: The Treatment Outcome Package. Journal of Clinical Psychology, 61, 285-314. doi:10.1002/jclp.20084
39. Kroenke, K., Spitzer, R. L., & Williams, J. B. (2001). The PHQ-9: Validity of a brief depression severity measure. Journal of General Internal Medicine, 16, 606-613. doi:10.1046/j.1525-1497.2001.016009606.x
40. Lambert, M. J. (2012). Helping clinicians to use and learn from researchbased systems: The OQ-analyst. Psychotherapy, 49, 109-114. doi:10 .1037/a0027110
41. Lambert, M. J., Burlingame, G. M., Umphress, V. J., Hansen, N. B., Vermeersch, D., Clouse, G., & Yanchar, S. (1996). The reliability and validity of the Outcome Questionnaire. Clinical Psychology and Psychotherapy, 3, 249 -258. doi:10.1002/(SICI)1099-0879(199612)3: 4249::AID-CPP1063.0.CO;2-S
42. Lambert, M. J., Morton, J. J., Hatfield, D. R., Harmon, C., Hamilton, S., Reid, R. C., . . . Burlingame, G. M. (2004). Administration and scoring manual for the OQ-45.2 (Outcome Questionnaire). Salt Lake City, UT: OQ Measures.
43. Lambert, M. J., & Shimokawa, K. (2011). Collecting client feedback. Psychotherapy, 48, 72-79. doi:10.1037/a0022238
44. Lambert, M. J., Whipple, J. L., Hawkins, E. J., Vermeersch, D. A., Nielsen, S. L., & Smart, D. W. (2003). Is it time for clinicians to routinely track patient outcome? A meta-analysis. Clinical Psychology: Science and Practice, 10, 288-301. doi:10.1093/clipsy.bpg025
45. Lawrinson, P., Copeland, J., & Indig, D. (2005). Development and validation of a brief instrument for ROM in opioid maintenance pharmacotherapy services: The Brief Treatment Outcome Measure (BTOM). Drug and Alcohol Dependence, 80, 125-133. doi:10.1016/j.drugalcdep.2005 .04.001
46. Marlowe, D. B., Festinger, D. S., Dugosh, K. L., Benasutti, K. M., Fox, G., & Croft, J. R. (2012). Adaptive programming improves outcomes in drug court: An experimental trial. Criminal Justice and Behavior, 39, 514-532. doi:10.1177/0093854811432525
47. Marlowe, D. B., Festinger, D. S., Dugosh, K. L., Lee, P. S., & Benasutti, K. M. (2007). Adapting judicial supervision to the risk level of drug offenders: Discharge and 6-month outcomes from a prospective matching study. Drug and Alcohol Dependence, 88, S4-S13. doi:10.1016/j .drugalcdep.2006.10.001
48. Marsden, J., Farrell, M., Bradbury, C., Dale-Perera, A., Eastwood, B., Roxburgh, M., & Taylor, S. (2008). Development of the treatment outcomes profile. Addiction, 103, 1450-1460. doi:10.1111/j.1360-0443 .2008.02284.x
49. Marsden, J., Gossop, M., Stewart, D., Best, D., Farrell, M., Lehmann, P. . . . Strang, J. (1998). The Maudsley Addiction Profile (MAP): A brief instrument for assessing treatment outcome. Addiction, 93, 1857-1868. doi:10.1046/j.1360-0443.1998.9312185711.x
50. McKay, J. R., Alterman, A. I., Cacciola, J. S., O'Brien, C. P., Koppenhaver, J. M., & Shepard, D. S. (1999). Continuing care for cocaine dependence: Comprehensive 2-year outcomes. Journal of Consulting and Clinical Psychology, 67, 420-427. doi:10.1037/0022-006X.67.3 .420
51. McKay, J. R., Lynch, K. G., Shepard, D. S., & Pettinati, H. M. (2005). The effectiveness of telephone-based continuing care for alcohol and cocaine dependence: 24-month outcomes. Archives of General Psychiatry, 62, 199-207. doi:10.1001/archpsyc.62.2.199
52. McKay, J. R., Van Horn, D., Lynch, K. G., Ivey, M., Cary, M. S., Drapkin, M. . . . Plebani, J. G. (under review). An adaptive approach for identifying cocaine-dependent patients who benefit from extended continuing care. Journal of Consulting and Clinical Psychology.
53. McKay, J. R., Van Horn, D., Oslin, D., Ivey, M., Drapkin, M., Coviello, D. . . . Lynch, K. G. (2011). Extended telephone-based continuing care for alcohol dependence: 24 month outcomes and subgroup analyses. Addiction, 106, 1760-1769.PMCID: PMC3174323. doi:10.1111/j.1360-0443 .2011.03483.x
54. McLellan, A. T., McKay, J. R., Forman, R., Cacciola, J., & Kemp, J. (2005). Reconsidering the evaluation of addiction treatment: From retrospective follow-up to concurrent recovery monitoring. Addiction, 100, 447-458. doi:10.1111/j.1360-0443.2005.01012.x
55. Miller, S. D. (2010, July 14). Feedback informed treatment (FIT): A worldwide trend in behavioral health [Web log]. Retrieved from http:// scottdmiller.com/icce/feedback-informed-treatment-fit-a-worldwidetrend- in-behavioral-health/
56. Miller, S. D., Duncan, B. L., Brown, J., Sorrell, R., & Chalk, M. B. (2006). Using formal client feedback to improve retention and outcome: Making ongoing, real-time assessment feasible. Journal of Brief Therapy, 5, 5-22.
57. Miller, S. D., Duncan, B. L., Brown, J., Sparks, J. A., & Claud, D. A. (2003). The Outcome Rating Scale: A preliminary study of the reliability, validity, and feasibility of a brief visual analog measure. Journal of Brief Therapy, 2, 91-100.
58. Miller, S. D., Duncan, B. L., Sorrell, R., & Brown, G. S. (2005). The partners for change outcome management system. JCLP/In Session, 61, 199-208.
59. Murphy, S. A., Collins, L. M., & Rush, A. J. (2007). Customizing treatment to the patient: Adaptive treatment strategies. Drug and Alcohol Dependence, 88, S1-S3. doi:10.1016/j.drugalcdep.2007.02.001
60. Overall, J. E., & Gorham, D. R. (1988). The Brief Psychiatric Rating Scale (BPRS): Recent developments in ascertainment and scaling. Psychopharmacology Bulletin, 24, 97-99.
61. Overington, L., & Ionita, G. (2012). PM measures: A brief guide. Canadian Psychology/Psychologie canadienne, 53, 82.
62. Poston, J. M., & Hanson, W. E. (2010). Meta-analysis of psychological assessment as a therapeutic intervention. Psychological Assessment, 22, 203-212. doi:10.1037/a0018679
63. Pulford, J., Deering, D. E., Robinson, G., Wheeler, A., Adamson, S. J., Frampton, C. M. A. . . . Paton-Simpson, G. (2010). Development of a ROM instrument for use with clients in the New Zealand alcohol and other drug treatment sector: The Alcohol and Drug Outcome Measure (ADOM). New Zealand Journal of Psychology, 39, 35-45.
64. Raes, V., De Jong, C. A. J., De Bacquer, D., Broekaert, E., & De Maeseneer, J. (2011). The effect of using assessment instruments on substance abuse outpatients' adherence to treatment: A multi-centre randomised controlled trial. BMC Health Services Research, 11, 123- 131. doi:10.1186/1472-6963-11-123
65. Reese, R. J., Norsworthy, L. A., & Rowlands, S. R. (2009). Does a continuous feedback system improve psychotherapy outcome? Psychotherapy: Theory, Research, Practice, Training, 46, 418-431. doi: 10.1037/a0017901
66. Reese, R. J., Toland, M. D., Slone, N. C., & Norsworthy, L. A. (2010). Effect of client feedback on couple psychotherapy outcomes. Psychotherapy: Theory, Research, Practice, Training, 47, 616-630. doi: 10.1037/a0021182
67. Simon, G. E., & Perlis, R. H. (2010). Personalized medicine for depression: Can we match patients with treatments?. The American Journal of Psychiatry, 167, 1445-1455. doi:10.1176/appi.ajp.2010.09111680
68. Simpson, M., Lawrinson, P., Copeland, J., & Gates, P. (2009). The Alcohol Treatment Outcome Measure (ATOM): A new clinical tool for standardising outcome measurement for alcohol treatment. Addictive Behaviors, 34, 121-124. doi:10.1016/j.addbeh.2008.09.007
69. Slade, K., Lambert, M. J., Harmon, S. C., Smart, D. W., & Bailey, R. (2008). Improving psychotherapy outcome: The use of immediate electronic feedback and revised clinical support tools. Clinical Psychology & Psychotherapy, 15, 287-303. doi:10.1002/cpp.594
70. Sobell, M. B., & Sobell, L. C. (2000). Stepped care as a heuristic approach to the treatment of alcohol problems. Journal of Consulting and Clinical Psychology, 68, 573-579. doi:10.1037/0022-006X.68.4.573
71. Spitzer, R. L., Kroenke, K., Williams, J. B., & Lowe, B. (2006). A brief measure for assessing generalized anxiety disorder: The GAD-7. Archives of Internal Medicine, 166, 1092-1097. doi:10.1001/archinte.166 .10.1092
72. United States Department of Veterans Affairs. (2009). VA/DoD clinical practice guideline for management of substance use disorders (SUD), Version 2.0.
73. United States Substance Abuse & Mental Health Services Administration. (1995). TIP 14: State outcomes-monitoring systems for alcohol and other drug abuse treatment. Retrieved from store. samhsa. gov/product/ TIP-14-State-Outcomes-Monitoring-Systems-for-Alcohol-and-Other- Drug-Abuse-Treatment/BKD162
74. United States Substance Abuse & Mental Health Services Administration. (2013). National registry of evidence-based programs and practices (NREPP). Retrieved from www.nrepp.samhsa.gov/Index.aspx
75. Valenstein, M., Adler, D. A., Berlant, J., Dixon, L. B., Dulit, R. A., Goldman, B. . . .Sonis, W. A. (2009). Implementing standardized assessments in clinical care: Now's the time. Psychiatric Services, 60, 1372-1375. doi:10.1176/appi.ps.60.10.1372
76. Wing, J. K., Beevor, A. S., Curtis, R. H., Park, S. B., Hadden, S., & Burns, A. (1998). Health of the Nation Outcome Scales (HoNOS). Research and development. The British Journal of Psychiatry, 172, 11-18.
77. Youn, S. J., Kraus, D. R., & Castonguay, L. (2012). The treatment outcome package: Facilitating practice and clinically relevant research. Psychotherapy, 49, 115-122. doi:10.1037/a0027932