Progress monitoring measures: A brief guide

Canadian Psychology

Volumn 53, Issue 2, 2012, Pages 82-92

  Overington, Louise ^a   Ionita, Gabriela ^a  

^a MCGILL UNIVERSITY   (Canada)

Author keywords

Feedback; Outcome; Progress monitoring (PM) measures; Progress tracking; Psychotherapy

Indexed keywords

EID: 84880106138     PISSN: 07085591     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0028017     Document Type: Conference Paper

References (103)

1. Academy Communications. (2006, November 6). New system helps counselors gauge mental health in minutes. Medical News Today. Retrieved from http://www.medicalnewstoday.com/releases/55985.php
2. American Psychological Association. (2011a). Behavior and Symptom Identification Scale-24 (BASIS-24). Retrieved from http://practiceouteomes.apa. org/omt/myMeasure.seam?dataModelSlection-msr%3Ameasures%5B2%5D&cid- 4978&actionMethod-results.xhtml%3AviewMeasure.selectMeasure%28msr%29 (access restricted to APA members)
3. American Psychological Association. (2011b). Outcome Questionnaire-45 (OQ-45). Retrieved from http://practiceoutcomes.apa.org/omt/myMeasure.seam? dataModelSelection=msr%3Ameasures%5B17%5D&cid=4978&actionMethod=results. xhtml%3AviewMeasure.selectMeasure%28msr%29 (access restricted to APA members)
4. American Psychological Association. (2011c). Outcome Rating Scale (ORS). Retrieved from http://practiceoutcomes.apa.org/omt/myMeasure.seam? dataModelSelection-msr%3Ameasures%5B18%5D&cid-4978&actionMethod-results. xhtml%3AviewMeasure.selectMeasure%28msr%29 (access restricted to APA members)
5. American Psychological Association. (2011d). Polaris-Mental Health (MH). Retrieved from http://practiceoutcomes.apa.org/omt/myMeasure.seam? dataModelSelection-msr%3Ameasures%5B21%5D&cid-4978&actionMethod-results. xhtml%3AviewMeasure.selectMeasure%28msr%29 (access restricted to APA members)
6. American Psychological Association. (2011e). The Session Rating Scale (SRS). Retrieved from http://practiceoutcomes.apa.org/omt/myMeasure.seam? dataModelSelection-msr%3Ameasures%5B24%5D&cid-4978&actiorMethod-results. xhtrnl%3AviewMeasure.selectMeasure%28msr%29 (access restricted to APA members)
7. American Psychological Association. (2011f). Treatment Outcome Package (TOP). Retrieved from http://practiceoutcornes.apa-org/omt/myMeasure.seam? dataModelSelection-msr%3Ameasures%5B25%5D&cid-4978&actiorMethod-results. xhtml%3AviewMeasure.selectMeasure%28msr%29 (access restricted to APA members)
8. Anker, M. G., and Duncan., B. L., & Sparks, J. A. (2009). Using client feedback to improve couple therapy outcomes: A randomized clinical trial in a naturalistic setting. Journal of Consulting and Clinical Psychology, 77, 693-704. doi:10.1037/a0016062
9. Ashworth, M., Robinson, S., Godfrey, E., Shepherd, M., Evans, C, Seed, P., Tylee, A. (2005). Measuring mental health outcomes in primary care: The psychometric properties of a new patient-generated outcome measure, PSYCHLOPS (Psychological Outcome Profiles). Primary Care Mental Health, 3, 261-270.
10. Bank of Canada. (2012). Daily currency converter. Retrieved from http://www.bankofcanada.ca/rates/exchange/daily-converter/
11. Barkham, M., Evans, C, Margison, F., McGrath, G., Mellor Clark, J., Milne, D. L., & Connell, J. (1998). The rationale for developing and implementing core outcome batteries for routine use in service settings an dpsychotherapy outcome research. Journal of Mental Health, 7, 35-47. doi:10.1080/09638239818328
12. Barkham, M., Gilbert, N., Connell, J., Marshall, C, & Twigg, E. (2005). Suitability and utility of the CORE-OM and CORE-A for assessing severity of presenting problems in psychological therapy services based in primary and secondary care settings. British Journal of Psychiatry, 186, 239-246. doi:10.1192/bjp.186.3.239
13. Barkham, M., Mellor-Clark, J., Connell, J., Evans, C, Evans, R., & Margison, F. (2010). Clinical Outcome in Routine Evaluation (CORE)-The CORE measures and system: Measuring, monitoring and managing quality evaluation in the psychological therapies. In M. Barkham, G. E. Hardy, & J. Mellor-Clark (Eds.), Developing and delivering practice-based evidence: A guide for the psychological therapies (pp. 175-219). New York, NY: Wiley. doi:10.1002/ 9780470687994.ch8
14. Behavioral Health Laboratories Inc. (2012a). Aggregate reports. Retrieved from http://www.bhealthlabs.com/aggregate.html
15. Behavioral Health Laboratories Inc. (2012b). Downloads and videos: TOP toolkit: Tools and reports. Retrieved from http://www.bhealthlabs.com/article. html
16. Behavioral Health Laboratories Inc. (2012c). Service options. Retrieved from http://www.bhealthlabs.com/upgrade-option.html7user-solo
17. Behavioral Health Laboratories Inc. (2012d). Technology methods. Retrieved from http://www.bhealthlabs.com/technology.html
18. Blais, M. A., and Lenderking., W. R., Baer, L., deLorell, A., Leahy, L., & Burns, C. (1999). Development and initial validation of a brief mental health outcome measure. Journal of Personality Assessment, 73, 359-373. doi:10.1207/S15327752JPA7303-5
19. Bringhurst, D. L., and Watson., C. W., Miller, S. D., & Duncan, B. L. (2006). The reliability and validity of the Outcome Rating Scale: A replication study of a brief clinical measure. Journal of Brief Therapy, 5, 23-30.
20. British Standards Institution. (2012). ISO/EC 21001 information security. Retrieved from http://www.bsigroup.com/en/Assessment-and-certification- services/management-systems/Standards-and-Schemes/ISO-IEC-27001/
21. CelestHealth Solutions. (2008a). Our instruments. Retrieved from http://www.celesthealth.com/instruments.asp
22. CelestHealth Solutions. (2008b). Our method. Retrieved from http://www.celesthealth.com/method.asp
23. CORE IMS. (2012a). CORE benchmarks. Retrieved from http://www.coreims.co. uk/Support-User-Benchmarking.html
24. CORE IMS. (2012b). CORE IMS: Translations. Retrieved from http://www.coreims.co.uk/About-Core-Translations.html
25. CORE IMS. (2012c). CORE IMS: Trial measurement packs. Retrieved from http://www.coreims.co.uk/Buy-Measurement-Trial-Pack.html
26. CORE IMS. (2012d). CORE Net features. Retrieved from http://www.coreims. co.uk/Buy-Net-Software-Features.html
27. CORE IMS. (2012e). CORE Net software. Retrieved from http://www.coreims. co.uk/Buy-Net-Software.html
28. CORE IMS. (2012f). How is the CORE used? Retrieved from http://www.coreims.co.uk/About-Core-System-How-Used.html
29. Czachowski, S., Seed, P., Schofield, P., & Ashworth, M. (2011). Measuring psychological change during cognitive behaviour therapy in primary care: A Polish study using 'PSYCHLOPS' (Psychological Outcome Profiles). Plos One, 6, 1-6. doi.10.1371/journal.pone.0027378
30. de Jong, K., Nugter, M. A., and Polak., M. G., Wagenborg, J. E. A., Spinhoven, P., & Heiser, W. J. (2007). The Outcome Questionnaire (OQ-45) in a Dutch population: A cross-cultural validation. Clinical Psychology and Psychotherapy, 14, 288-301. doi:10.1002/cpp.529
31. Duncan, B., & Miller, S. (2004). The Relationship Rating Scale. Jensen Beach, FL: Author.
32. Duncan, B., & Miller, S. (2007). The Group Session Rating Scale. Jensen Beach, FL: Author.
33. Duncan, B., Miller, S., Huggins, A., & Sparks, J. (2003). The Young Child Outcome Rating Scale and the Young Child Session Rating Scale. Retrieved from http://www.mnfamilycenter.eom/userfiles/l167979/file/ Child%20Measures%20MFC.pdf
34. Duncan, B., Miller, S., Sparks, J., & Murphy, J. (2011). The Group Child Session Rating Scale. Jensen Beach, FL: Author.
35. Duncan, B., Miller, S., & Sparks, J. (2003a). The Child Outcome Rating Scale. Jensen Beach, FL: Author.
36. Duncan, B., Miller, S., & Sparks, J. (2003b). The Child Session Rating Scale. Jensen Beach, FL: Author.
37. Duncan, B. L., and Miller., S. D., Sparks, J. A., Claud, D. A., and Reynolds., L. R., Brown, J., & Johnson, L. D. (2003). The Session Rating Scale: Preliminary psychometric properties of a "working" alliance measure. Journal of Brief Therapy, 3, 3-12.
38. Eisen, S. V., Gerena, M., Ranganathan, G., Esch, D., & Idiculla, T. (2006). Reliability and validity of the BAS1S-24 mental health survey for Whites, African-Americans, and Latinos. Behavioral Health Services & Research, 33, 304-323. doi:10.1007/sl 1414-006-9025-3
39. Eisen, S. V., and Normand., S. L., Belanger, A. J., Spiro, A., & Esch, D. (2004). The Revised Behavior and Symptom Identification Scale (BASIS-R)-Reliability and validity. Medical Care, 42, 1230-1241. doi:10.1097/00005650-200412000-00010
40. Evans, C, Connell, J., Barkham, M., Margison, F., McGrath, G., Mellor-Clark, J., & Audin, K. (2002). Towards a standardised brief outcome measure: Psychometric properties and utility of the CORE-OM. British Journal of Psychiatry, 180, 51-60. doi:10.1192/bjp. 180.1.51
41. Evans, C, Mellor-Clark, J., Margison, F., Barkham, M., Audin, K., Connell, J., & McGrath, G. (2000). CORE: Clinical Outcomes in Routine Evaluation. Journal of Mental Health, 9, 247-255. doi:10.1080/713680250
42. Finch, A. E., and Lambert., M. J., & Schaalje, B. G. (2001). Psychotherapy quality control: The statistical generation of expected recovery curves for integration into an early warning system. Clinical Psychology & Psychotherapy, 8, 231-242.
43. FIT-Outcomes ApS. (2012a). My clients. Retrieved from https://fitoutcomes.heroku.com (Access available with free trial subscription to Fl 1-Outcomes)
44. FIT-Outcomes ApS. (2012b). Statistics. Retrieved from https://fit-outcomes.heroku.com (Access available with free trial subscription to FIT-Outcomes)
45. Froyd, J. E., and Lambert., M. J., & Froyd, J. D. (1996). A review of practices of psychotherapy outcome measurement. Journal of Mental Health, 5, 11-15. doi:10.1080/09638239650037144
46. Grissom, G., & Lyons, J. S. (2006). Pragmatic case studies and evidence-based treatment: Research and clinical applications of a computerized outcomes management system. Pragmatic Case Studies in Psychotherapy, 2, 1-28. Retrieved from http://pcsp.libraries.rutgers.edu
47. Grissom, G. R., and Lyons., J. S., & Lutz, W. (2002). Standing on the shoulders of a giant: Development of an outcome management system based on the dose model and phase model of psychotherapy. Psychotherapy Research, 12, 397-412. doi:10.1093/ptr/12.4.397
48. Hafkenscheid, A., and Duncan., B. L., & Miller, S. D. (2010). The outcome and session rating scales: A cross-cultural examination of the psychometric properties of the Dutch translation. Journal of Brief Therapy, 7, 1-12.
49. Hannan, C, and Lambert., M. J., Harmon, C, and Nielsen., S. L., Smart, D. W., Shimokawa, K., & Sutton, S. W. (2005). A lab test and algorithms for identifying clients at risk for treatment failure. Journal of Clinical Psychology. 61, 155-163. doi:10.1002/jclp.20108
50. Hansen, N. B., and Lambert., M. J., & Forman, E. V. (2002). The psychotherapy dose-response effect and its implications for treatment delivery services. Clinical Psychology: Science and Practice, 9, 329-343. doi:10.1093/clipsy.9.3.329
51. Harmon, S. C, Lambert, M. J., and Smart., D. M., Hawkins, E., Nielsen, S. L., Slade, K., & Lutz, W. (2007). Enhancing outcome for potential treatment failures: Therapist client feedback and clinical support tools. Psychotherapy Research, 17, 379-392. doi:10.1080/105033006O0702331
52. Hatfield, D. R., McCullough, L., Frantz, S. H. B., & Krieger, K. (2010). Do we know when our clients get worse? An investigation of therapists' ability to detect negative client change. Clinical Psychology & Psychotherapy, 17, 25-32. doi:10.1002/cpp.656
53. Hatfield, D. R., & Ogles, B. M. (2004). The use of outcome measures by psychologists in clinical practice. Professional Psychology Research and Practice, 35, 485-491. doi:10.1037/0735-7028.35.5.485
54. Hatfield, D. R., & Ogles, B. M. (2007). Why some clinicians use outcome measures and others do not. Administration and Policy in Mental Health and Mental Health Services Research, 34, 283-291. doi:10.1007/s10488-006-0110-y
55. Hawkins, E. J., and Lambert., M. J., Vermeersch, D. A., Slade, K. L., & Tuttle, K. C. (2004). The therapeutic effects of providing patient progress information to therapists and patients. Psychotherapy Research, 14, 308-327. doi:10.1093/ptr/kph027
56. Health Factors Inc. (2011). Video on demand training center. Retrieved from https://www.myoutcomes.com/Training.aspx
57. Howard, K. L, Kopta, S. M., and Krause., M. S., & Oriinsky, D. E. (1986). The dose-effect relationship in psychotherapy. American Psychologist, 41, 159-164.
58. Irvine, M. (2011, May 22). College mental health screenings going high-tech. ABC News. Retrieved from http://abcnews.go.com/US/wireStory?id= 13659204#.TzUKeNWpqs
59. Jacobson, N. S., & Truax, P. (1991). Clinical-significance - A statistical approach to defining meaningful change in psychotherapy-research. Journal of Consulting & Clinical Psychology, 59, 12-19. doi:10.1037//0022- 6X.59.1.12
60. Kopta, S. M., & Lowry, J. L. (2002). Psychometric evaluation of the Behavioral Health Questionnaire-20: A brief instrument for assessing global mental health and the three phases of psychotherapy outcome. Psychotherapy Research, 12, 413-426. doi:10.1093/ptr/12.4.413
61. Kraus, D. R., and Boswell., J. F., Wright, A. G. G, Castonguay, L. G., & Pincus, A. L. (2010). Factor structure of the treatment outcome package for children. Journal of Clinical Psychology, 66, 627-640. doi:10.1002/jclp. 20675
62. Kraus, D. R., & Castonguay, L. G. (2010). Treatment Outcome Package (TOP): Development and use in naturalistic settings. In M. Barkham, G. E. Hardy, & J. Mellor-Clark (Eds.), A developing and delivering practice-based evidence: A guide for psychological therapies (pp. 155-174). New York, NY: Wily Press. doi:10.1002/9780470687994.ch7
63. Kraus, D. R., and Seligman., D. A., & Jordan, J. R. (2005). Validation of a behavioral health treatment outcome and assessment tool designed for naturalistic settings: The Treatment Outcome Package. Journal of Clinical Psychology, 61, 285-314. doi:10.1002/Jclp.20084
64. Lambert, M. J., and Hansen., N. B., & Harmon, S. C. (2010). Outcome Questionnaire system (The OQ-45 system): Development and practical applications in healthcare settings. In M. Barkham, G. Hardy, & J. Mellor-Clark (Eds.), Developing and delivering practice-based evidence: A guide for the psychological therapies (pp. 141-154). New York, NY: Wiley. doi:10.1002/9780470687994.ch6
65. Lambert, M. J., and Hansen., N. B., Umphress, V., Lunnen, K., Okiishi, J., Burlingame, G. M. Reisinger, C. W. (1996). Administration and scoring manual for the Outcome Questionnaire (OQ-45.2). Wilmington, DE: American Professional Credentialing Services.
66. Lambert, M. J., Morton, J. J., Hatfield, D., Harmon, C, Hamilton, S., Reid, R. C, Shimokawa, K., Burlingame, G. M. (2004). Administration and scoring manual for the Outcome Questionnaire-45. Salt Lake City, UT: OQMeasures.
67. Lambert, M. J., & Ogles, B. M. (2004). The efficacy and effectiveness of psychotherapy. New York, NY: Wiley.
68. Lambert, M. J., & Shimokawa, K. (2011). Collecting client feedback. Psychotherapy, 48, 72-79. doi:10.1037/a0022238
69. Lambert, M. J., and Whipple., J. L., Smart, D. W., Vermeersch, D. A., and Nielsen., S. L., & Hawkins, E. J. (2001). The effects of providing therapists with feedback on patient progress during psychotherapy: Are outcomes enhanced? Psychotherapy Research, 11, 49-68. doi:10.1080/713663852
70. Leach, C, Lucock, M., Barkham, M., Stiles, W. B., Noble, R., & Iveson, S. (2006). Transforming between Beck Depression Inventory and CORE-OM scores in routine clinical practice. British Journal of Clinical Psychology, 45, 153-166. doi:10.1348/014466505X35335
71. Lilienfeld, S. O. (2007). Psychological treatments that cause harm. Perspectives on Psychological Science, 2, 53-70. doi:10.111 l/j.1745-6916.2007. 00029.x
72. Locke, B. D., and Buzolitz., J. S., Lei, P. W., Boswell, J. F., and McAleavey., A. A., Sevig, T. D. Hayes, J. A. (2011). Development of the Counseling Center Assessment of Psychological Symptoms-62 (CCAPS-62). Journal of Counseling Psychology, 58, 97-109. doi:10.1037/a0021282
73. Locke, B. D., and Mcaleavey., A. A., Zhao, Y., Lei, P-W., Hayes, J. A., Castonguay, L. G., Lin, Y. C. (2011). Development and initial validation of the Counseling Center Assessment of Psychological Symptoms-34. Measurement and Evaluation in Counseling and Development, X, 1-19. doi:10.1177/0748175611432642
74. Lueger, R. L. (2006). Technology to support the clinical management of psychotherapy cases: Commentary on the Polaris-MH. Pragmatic Case Studies in Psychotherapy, 2, 1-7. Retrieved from http://www2.scc.rutgers.edu/ joumalstestAindex.php/pcsp/article/viewArticle/881
75. Lueger, R. J., & Barkham, M. (2010). Using benchmarks and benchmarking to improve quality of practice and service. In M. Barkham, G. E. Hardy & J. Mellor-Clark (Eds.), Practice-based evidence: A guide for psychological therapies (pp. 223-256). Hoboken, NJ: Wiley-Blackwell.
76. McLean Hospital. (2012a). BASIS-24. Retrieved from http://www. basissurvey.org/pdf/Basis-24ProductSheet.pdf
77. McLean Hospital. (2012b). BASIS-24 aggregate report (sample report). http://www.basissurvey.org/pdf/Basis24AggregateSampleRptpdf.
78. McLean Hospital. (2012c). BASIS-24 case level report (sample report). Retrieved from http://ebasis.org/pdf/Basis24CaseLevelSampleRpt.pdf
79. McLean Hospital. (2012d). BASIS-24: Measuring patient self-reported outcomes. Retrieved from http://www.basissurvey.org/basis24/
80. McLean Hospital. (2012e). BASIS-32. Retrieved from http://www. basissurvey.org/basis32/
81. McLean Hospital. (2012f). Cost and licensing. Retrieved from http://www.basissurvey.org/about/licensing/
82. Miller, S. (2012). Performance metrics. Retrieved from http://scottdmiller.com/?q=node/6
83. Miller, S. D., & Bargmann, S. (2011). Feedback-Informed Treatment (FIT): Improving the treatment of male clients one man at a time. In J. Ashfield (Ed.), Doing psychotherapy with men: Practicing ethical psychotherapy and counselling with men (pp. 194-207). St Peters, Australia: The Australian Institute of Male Health and Studies.
84. Miller, S. D., & Duncan, B. L. (2004). The outcome and session rating scales: Administration and scoring manual. Chicago, IL: Institute for the Study of Therapeutic Change.
85. Miller, S. D., and Duncan., B. L., & Hubble, M. A. (2004). Beyond integration: The triumph of outcome over process in clinical practice. Psychotherapy In Australia, 10, 2-19.
86. Miller, S. D., and Duncan., B. L., Sorrell, R., & Brown, G. S. (2005). The Partners for Change Outcome Management System. Journal of Clinical Psychology, 61, 199-208. doi:10.1002/Jclp.20111
87. Okiishi, J. C, Lambert, M. J., Eggett, D., Nielsen, L., Dayton, D. D., & Vermeersch, D. (2006)., An analysis of therapist treatment effects: Toward providing feedback to individual therapists on their clients' psychotherapy outcome. Journal of Clinical Psychology, 62, 1157-1172. doi:I0.1002/jclp.20272
88. OQ Measures. (2012a). Administration Methods. Retrieved from http://www.oqmeasures.com/files/oqmeasures/OQ-Analyst-Administration-Methods- Overview.pdf
89. OQ Measures. (2012b). Adult measures. Retrieved from http://www. oqmeasures.com/page.asp?PageId=101
90. OQ Measures. (2012c). Group measures. Retrieved from http://www. oqmeasures.com/page.asp?PageId=104
91. OQ Measures. (2012d). How to obtain OQ paper & pencil product license. Retrieved from http://www.oqmeasures.com/files/oqmeasures/OQ-Measures- Paper-and-Pencil-Order%20Form-2011.pdf
92. OQ Measures. (2012e). More about the OQ-Analyst: What do the OQ Analyst alerts mean? Retrieved from http://www.oqmeasures.com/page.asp?PageId-70
93. OQ Measures. (2012f) - Training video. Retrieved from http://www.oqmeasures.com/training/fullvideo.html
94. OQ Measures. (2012g). Youth/adolescent measures. Retrieved from http://www.oqmeasures.com/page.asp?PageId=102
95. Owen, J., & Imel, Z. (2010). Rating scales in psychotherapy practice. In L. Baer & M. A. Blais (Eds.), Handbook of clinical rating scales and assessment in psychiatry and mental health (pp. 257-270). New York, NY: Humana Press.
96. Polaris Health Directions. (2008a). Polaris-MH client progress report. Retrieved from http://polarishd.squarespace.com/storage/MH-Update-Reportpdf
97. Polaris Health Directions. (2008b). Polaris-MH initial assessment report Retrieved from http://www.polarishealth.com/solutions/MH/MH-mtake-Reportpdf
98. Polaris Health Directions. (2008c). Solutions for the public sector. Retrieved from http://polarishealth.com/public-sector
99. Shimokawa, K., and Lambert., M. J., & Smart, D. W. (2010). Enhancing treatment outcome of patients at risk of treatment failure: Meta-analytic and mega-analytic review of a psychotherapy quality assurance system. Journal of Consulting and Clinical Psychology, 78, 298-311. doi:10.1037/a0019247
100. Stuart, R. B. (1970). Trick or treatment: How and when psychotherapy fails. Champaign, IL: Research Press.
101. U.S. Department of Health and Human Services. (2012). Understanding health information policy. Retrieved from http://www.hhs.gov/ocr/privacy/hipaa/ understanding/index.html
102. Wright, F., and Bewick., B. M., Barkham, M., House, A. O., & Hill, A. J. (2009)., Co-occurrence of self-reported disordered eating and self-harm in UK university students. British Journal of Clinical Psychology, 48, 397-410. doi:10.1348/014466509X410343
103. Young, J. L., and Waehler., C. A., Laux, J. M., McDaniel, P. S., & Hilsenroth, M. J. (2003). Four studies extending the utility of the Schwartz Outcome Scale (SOS-10). Journal of Personality Assessment, 80, 130-138. doi:10.1207/S15327752JPA8002-02