Treatment Outcome Package: Measuring and Facilitating Multidimensional Change

Psychotherapy

Volumn 52, Issue 4, 2015, Pages 422-431

  Boswell, James F ^a   Kraus, David R ^b   Castonguay, Louis G ^c   Youn, Soo Jeong ^c  

^a STATE UNIVERSITY OF NEW YORK   (United States)

^b Outcome Referrals   (United States)

^c PENNSYLVANIA STATE UNIVERSITY   (United States)

Author keywords

Feedback; Measurement based care; outcome monitoring; Treatment outcome package

Indexed keywords

CONSENSUS DEVELOPMENT; DECISION MAKING; FINANCIAL MANAGEMENT; JORDAN; MENTAL HEALTH CARE; MONITORING; PSYCHOTHERAPY; TREATMENT OUTCOME; EVIDENCE BASED PRACTICE; HEALTH CARE QUALITY; HUMAN; HUMAN RELATION; MENTAL DISORDERS; PSYCHOLOGY; PSYCHOMETRY; QUESTIONNAIRE; SOCIAL BEHAVIOR; STANDARDS; STATISTICS AND NUMERICAL DATA; TEACHER; TREATMENT FAILURE;

EVIDENCE-BASED PRACTICE; HUMANS; MENTAL DISORDERS; MENTORS; OUTCOME AND PROCESS ASSESSMENT (HEALTH CARE); PROFESSIONAL-PATIENT RELATIONS; PSYCHOMETRICS; PSYCHOTHERAPY; QUALITY ASSURANCE, HEALTH CARE; SOCIAL RESPONSIBILITY; SURVEYS AND QUESTIONNAIRES; TREATMENT FAILURE;

EID: 84949651280     PISSN: 00333204     EISSN: 19391536     Source Type: Journal    
DOI: 10.1037/pst0000028     Document Type: Article

References (62)

1. Adelman, R. W., Castonguay, L. G., Kraus, D. R., & Zack, S. E. (2015). Conducting research and collaborating with researchers: The experience of clinicians in a residential treatment center. Psychotherapy Research, 25, 108-120. http://dx.doi.org/10.1080/10503307.2014.935520
2. Adelman, R., McGee, P., Power, R., & Hanson, C. (2005). Reducing adolescent clients' anger in a residential substance abuse treatment facility. Joint Commission Journal on Quality and Patient Safety, 31, 325-327.
3. Alexander, P. C., Baxter, L., Bentley, J., & Kraus, D. R. (2015). The use of the TOP in child welfare. Manuscript in preparation.
4. Angtuaco, L. A., Castonguay, L. G., & Kraus, D. R. (2005, June). The TOP: A core battery for the assessment of psychotherapy outcome. Paper presented at the Annual Meeting of the Society for Psychotherapy Research, Montreal, Quebec, Canada.
5. Baldwin, S. A., & Imel, Z. E. (2013). Therapist effects: Findings and methods. In M. J. Lambert (Ed.), Bergin and Garfield's handbook of psychotherapy and behavior change (pp. 258-297). New York: Wiley.
6. Beck, A. T., Steer, R. A., & Brown, G. K. (1996). Manual for the Beck Depression Inventory-II. San Antonio, TX: Psychological Corporation.
7. Berwick, D. M., Nolan, T. W., & Whittington, J. (2008). The triple aim: Care, health, and cost. Health Affairs, 27, 759-769. http://dx.doi.org/10 .1377/hlthaff.27.3.759
8. Bickman, L., Rosof-Williams, J., Salzer, M. S., Summerfelt, W. T., Noser, K., Wilson, S. J., & Karver, M. S. (2000). What information do clinicians value for monitoring adolescent client progress and outcomes? Professional Psychology: Research and Practice, 31, 70-74. http://dx .doi.org/10.1037/0735-7028.31.1.70
9. Boswell, J. F., Constantino, M. J., & Kraus, D. R. (2014, April). Promoting context-responsiveness with outcomes monitoring. Paper presented at the Society for the Exploration of Psychotherapy Integration Conference, Montreal, Quebec, Canada.
10. Boswell, J. F., Constantino, M. J., Kraus, D. R., Bugatti, M., & Oswald, J. M. (2015). The expanding relevance of routinely collected outcome data for mental health care decision making. Administration and Policy in Mental Health and Mental Health Services Research. Advance online publication. http://dx.doi.org/10.1007/s10488-015-0649-6
11. Boswell, J. F., Kraus, D. R., Miller, S. D., & Lambert, M. J. (2015). Implementing routine outcome monitoring in clinical practice: Benefits, challenges, and solutions. Psychotherapy Research, 25, 6-19. http://dx .doi.org/10.1080/10503307.2013.817696
12. Boswell, J. F., Kraus, D. R., Nordberg, S., & Castonguay, L. G. (2009, June). The Treatment Outcome Package (TOP): An investigation of its validity. Poster presented at the Society for Psychotherapy Research Conference, Santiago, Chile.
13. Boswell, J. F., & McHugh, R. K. (2015). Learning from research. In J. C. Norcross, G. R. VandenBos, & D. K. Freedheim (Eds.), APA handbook of clinical psychology: Volume V. Education and profession. Washington, DC: American Psychological Association Press.
14. Butcher, J. N., Graham, J. R., Ben-Porath, Y. S., Tellegen, A., & Dahlstrom, W. G. (2001). Minnesota Multiphasic Personality Inventory-2 (MMPI-2): Manual for administration and scoring (rev. ed.). Minneapolis, MN: University of Minnesota Press. http://dx.doi.org/10.1016/ B0-08-043076-7/01294-8
15. Castonguay, L. G. (2011). Psychotherapy, psychopathology, research and practice: Pathways of connections and integration. Psychotherapy Research, 21, 125-140. http://dx.doi.org/10.1080/10503307.2011.563250
16. Castonguay, L. G., Barkham, M., Lutz, W., & McAleavey, A. A. (2013). Practice-oriented research: Approaches and applications. In M. J. Lambert (Ed.), Bergin and Garfield's handbook of therapeutic change (6th ed.). New York: Wiley.
17. Castonguay, L. G., & Beutler, L. E. (2006). Principles of therapeutic change that work. New York, NY: Oxford University Press.
18. Castonguay, L. G., Boswell, J. F., Zack, S. E., Baker, S., Boutselis, M. A., Chiswick, N. R., . . . Holtforth, M. G. (2010). Helpful and hindering events in psychotherapy: A practice research network study. Psychotherapy: Theory, Research, Practice, Training, 47, 327-344. http://dx .doi.org/10.1037/a0021164
19. Castonguay, L. G., & Oltmanns, T. F. (2013). Psychopathology: From science to clinical practice. New York, NY: Guilford Publications.
20. Castonguay, L. G., Pincus, A. L., & McAleavey, A. A. (2015). Practice research network in a psychology training clinic: Building an infrastructure to foster early attachment to the scientific-practitioner model. Psychotherapy Research, 25, 52-66. http://dx.doi.org/10.1080/10503307 .2013.856045
21. Castonguay, L. G., Youn, S. J., McAleavey, A. A., Boswell, J. F., Boutselis, M., Braver, M., . . ., & O'Leary Wiley, M. (2014, June). The use of empirically based techniques in day-to-day practice: Does it matter, and if so, for whom? Paper presented at the Society for Psychotherapy Research Conference, Copenhagen, Denmark.
22. Castonguay, L. G., Youn, S. J., Xiao, H., Muran, J. C., & Barber, J. P. (2015). Building clinicians-researchers partnerships: Lessons from diverse natural settings and practice-oriented initiatives. Psychotherapy Research, 25, 166 -184. http://dx.doi.org/10.1080/10503307.2014 .973923
23. Chernew, M., Gowrisankaran, G., & Scanlon, D. P. (2008). Learning and the value of information: Evidence from health plan report cards. Journal of Econometrics, 144, 156-174. http://dx.doi.org/10.1016/j.jeconom .2008.01.001
24. Constantino, M. J., Boswell, J. F., Bernecker, S. L., & Castonguay, L. G. (2013). Context-responsive integration as a framework for unified psychotherapy and clinical science: Conceptual and empirical considerations. Journal of Unified Psychotherapy and Clinical Science, 2, 1-20.
25. De Jong, K., van Sluis, P., Nugter, M. A., Heiser, W. J., & Spinhoven, P. (2012). Understanding the differential impact of outcome monitoring: Therapist variables that moderate feedback effects in a randomized clinical trial. Psychotherapy Research, 22, 464-474. http://dx.doi.org/ 10.1080/10503307.2012.673023
26. Derogatis, L. R. (1975). Brief Symptom Inventory. Baltimore: Clinical Psychometrics Research.
27. DeRubeis, R. J., Cohen, Z. D., Forand, N. R., Fournier, J. C., Gelfand, L. A., & Lorenzo-Luaces, L. (2014). The Personalized Advantage Index: Translating research on prediction into individualized treatment recommendations. A demonstration [Advance online publication]. PLoS ONE, 9, e83875. http://dx.doi.org/10.1371/journal.pone.0083875
28. Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation research: A synthesis of the literature (FMHI Publ. no. 231). Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, National Implementation Research Network.
29. Foa, E. B., & Rothbaum, B. A. (1998). Treating the trauma of rape: Cognitive behavioral therapy for PTSD. New York: Guilford Press. Goldfield, N. (Ed.). (1999). Physician profiling and risk adjustment. Frederick, MD: Aspen.
30. Hatfield, D. R., & Ogles, B. M. (2004). The use of outcome measures by psychologists in clinical practice. Professional Psychology: Research and Practice, 35, 485-491. http://dx.doi.org/10.1037/0735-7028.35.5 .485
31. Hatfield, D. R., & Ogles, B. M. (2007). Why some clinicians use outcome measures and others do not. Administration and Policy in Mental Health and Mental Health Services Research, 34, 283-291. http://dx.doi.org/10 .1007/s10488-006-0110-y
32. Henderson, A., & Henderson, S. (2010). Provision of a surgeon's performance data for people considering elective surgery. Cochrane Database of Systematic Reviews, 11, CD006327. http://dx.doi.org/10.1002/ 14651858.CD006327.pub2
33. Hibbard, J. H., & Jewett, J. J. (1996). What type of quality information do consumers want in a health care report card? Medical Care Research and Review, 53, 28-47. http://dx.doi.org/10.1177/107755879605300102
34. Hibbard, J. H., Peters, E., Slovic, P., Finucane, M. L., & Tusler, M. (2001). Making health care quality reports easier to use. Joint Commission Journal on Quality Improvement, 27, 591-604.
35. Howard, K. I., Lueger, R. J., Maling, M. S., & Martinovich, Z. (1993). A phase model of psychotherapy outcome: Causal mediation of change. Journal of Consulting and Clinical Psychology, 61, 678-685. http://dx .doi.org/10.1037/0022-006X.61.4.678
36. Howard, K. I., Moras, K., Brill, P. L., Martinovich, Z., & Lutz, W. (1996). Evaluation of psychotherapy. Efficacy, effectiveness, and patient progress. American Psychologist, 51, 1059-1064. http://dx.doi.org/10.1037/ 0003-066X.51.10.1059
37. Hsu, L. M. (1989). Random sampling, randomization, and equivalence of contrasted groups in psychotherapy outcome research. Journal of Consulting and Clinical Psychology, 57, 131-137. http://dx.doi.org/10.1037/ 0022-006X.57.1.131
38. Jacobson, N. S., Roberts, L. J., Berns, S. B., & McGlinchey, J. B. (1999). Methods for defining and determining the clinical significance of treatment effects: Description, application, and alternatives. Journal of Consulting and Clinical Psychology, 67, 300-307. http://dx.doi.org/10 .1037/0022-006X.67.3.300
39. Ketelaar, N. A. B. M., Faber, M. J., Flottorp, S., Rygh, L. H., Deane, K. H. O., & Eccles, M. P. (2011). Public release of performance data in changing the behaviour of healthcare consumers, professionals or organisations. Cochrane Database of Systematic Reviews, 11, CD004538.
40. Koerner, K., & Castonguay, L. G. (2015). Practice-oriented research: What it takes to do collaborative research in private practice. Psychotherapy Research, 25, 67-83. http://dx.doi.org/10.1080/10503307.2014.939119
41. Kraus, D. R. (2015, March). Measuring and improving child well-being. Invited address at the Annie E. Casey Foundation Conference, New Orleans, LA.
42. Kraus, D. R., Bentley, J., Alexander, P., Boswell, J. F., Constantino, M. J., Castonguay, L. G., & Baxter, L. (2015). Predicting therapist effectiveness. Manuscript in preparation.
43. Kraus, D., & Castonguay, L. G. (2010). Treatment Outcome Package (TOP): Development and use in naturalistic settings. In M. Barkham, G. E. Hardy, & J. Mellor-Clark (Eds.), Developing and delivering practice-based evidence: A guide for the psychological therapies (pp. 155-174). New York: Wiley. http://dx.doi.org/10.1002/9780470687994 .ch7
44. Kraus, D. R., Castonguay, L., Boswell, J. F., Nordberg, S. S., & Hayes, J. A. (2011). Therapist effectiveness: Implications for accountability and patient care. Psychotherapy Research, 21, 267-276. http://dx.doi.org/10 .1080/10503307.2011.563249
45. Kraus, D. R., Seligman, D. A., & Jordan, J. R. (2005). Validation of a behavioral health treatment outcome and assessment tool designed for naturalistic settings: The Treatment Outcome Package. Journal of Clinical Psychology, 61, 285-314. http://dx.doi.org/10.1002/jclp.20084
46. Krause, M. S., Lutz, W., & Saunders, S. M. (2007). Empirically certified treatments or therapists: The issue of separability. Psychotherapy: Theory, Research, Practice, Training, 44, 347-353. http://dx.doi.org/10 .1037/0033-3204.44.3.347
47. Lambert, M. J., & Shimokawa, K. (2011). Collecting client feedback. Psychotherapy, 48, 72-79. http://dx.doi.org/10.1037/a0022238
48. Li, L. C., Grimshaw, J. M., Nielsen, C., Judd, M., Coyte, P. C., & Graham, I. D. (2009). Use of communities of practice in business and health care sectors: A systematic review [Advance online publication]. Implementation Science, 4, 27. http://dx.doi.org/10.1186/1748-5908-4-27
49. McAleavey, A. A., Lockard, A. J., Castonguay, L. G., Hayes, J. A., & Locke, B. D. (2015). Building a practice research network: Obstacles faced and lessons learned at the Center for Collegiate Mental Health. Psychotherapy Research, 25, 134 -151. http://dx.doi.org/10.1080/ 10503307.2014.883652
50. McHorney, C. A., Ware, J. E., Jr., & Raczek, A. E. (1993). The MOS 36-Item Short-Form Health Survey (SF-36): II. Psychometric and clinical tests of validity in measuring physical and mental health constructs. Medical Care, 31, 247-263. http://dx.doi.org/10.1097/00005650- 199303000-00006
51. Nordberg, S. S., Castonguay, L. G., Fisher, A. J., Boswell, J. F., & Kraus, D. (2014). Validating the rapid responder construct within a practice research network. Journal of Clinical Psychology, 70, 886-903. http:// dx.doi.org/10.1002/jclp.22077
52. Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., . . . Hensley, M. (2011). Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health and Mental Health Services Research, 38, 65-76. http://dx.doi.org/10.1007/s10488-010-0319-7
53. Ranmuthugala, G., Plumb, J. J., Cunningham, F. C., Georgiou, A., Westbrook, J. I., & Braithwaite, J. (2011). How and why are communities of practice established in the healthcare sector? A systematic review of the literature. BMC Health Services Research, 11, 273. http://dx.doi.org/10 .1186/1472-6963-11-273
54. Riemer, M., Rosof-Williams, J., & Bickman, L. (2005). Theories related to changing clinician practice. Child and Adolescent Psychiatric Clinics of North America, 14, 241-254.
55. Rosenthal, M. B., Frank, R. G., Li, Z., & Epstein, A. M. (2005). Early experience with pay-for-performance: From concept to practice. Journal of the American Medical Association, 294, 1788-1793. http://dx.doi .org/10.1001/jama.294.14.1788
56. Saxon, D., & Barkham, M. (2012). Patterns of therapist variability: Therapist effects and the contribution of patient severity and risk. Journal of Consulting and Clinical Psychology, 80, 535-546. http://dx.doi.org/10 .1037/a0028898
57. Scanlon, D. P., Lindrooth, R. C., & Christianson, J. B. (2008). Steering patients to safer hospitals? The effect of a tiered hospital network on hospital admissions. Health Services Research, 43, 1849-1868. http:// dx.doi.org/10.1111/j.1475-6773.2008.00889.x
58. Strupp, H. H., Horowitz, L. M., & Lambert, M. J. (Eds.). (1997). Measuring patient changes in mood, anxiety, and personality disorders: Toward a core battery. Washington, DC: American Psychological Association Press. http://dx.doi.org/10.1037/10232-000
59. Wampold, B. E., & Brown, G. S. (2005). Estimating variability in outcomes attributable to therapists: A naturalistic study of outcomes in managed care. Journal of Consulting and Clinical Psychology, 73, 914-923. http://dx.doi.org/10.1037/0022-006X.73.5.914
60. Wampold, B. E., & Imel, Z. E. (2015). The great psychotherapy debate: The evidence for what makes psychotherapy work (2nd ed.). New York: Routledge/Taylor & Francis Group.
61. Youn, S. J., Kraus, D. R., & Castonguay, L. G. (2012). The treatment outcome package: Facilitating practice and clinically relevant research. Psychotherapy, 49, 115-122. http://dx.doi.org/10.1037/a0027932
62. Zack, S. E., Castonguay, L. G., Boswell, J. F., McAleavey, A. A., Adelman, R., Kraus, D. R., & Pate, G. A. (2015). Attachment history as a moderator of the alliance outcome relationship in adolescents. Psychotherapy, 52, 258-267. http://dx.doi.org/10.1037/a0037727