Mental health program monitoring: Towards simplifying a complex task

Psychiatric Rehabilitation Journal

Volumn 26, Issue 3, 2003, Pages 249-261

  Durbin, Janet ^a,b   Prendergast, Peter ^b,c   Dewa, Carolyn S ^a,b   Rush, Brian ^a,b   Cooke, Robert G ^a,b  

^a CENTRE FOR ADDICTION AND MENTAL HEALTH   (Canada)

^b UNIVERSITY OF TORONTO   (Canada)

^c Whitby Mental Health Centre   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

COMMUNITY CARE; DAILY LIFE ACTIVITY; DISEASE SEVERITY; FEASIBILITY STUDY; HEALTH PROGRAM; HUMAN; INFORMATION PROCESSING; LONG TERM CARE; MEDICAL STAFF; MENTAL DISEASE; MENTAL HEALTH SERVICE; OUTCOMES RESEARCH; OUTPATIENT; PATIENT MONITORING; PATIENT SATISFACTION; PSYCHOMETRY; PSYCHOSOCIAL ENVIRONMENT; QUALITY CONTROL; QUALITY OF LIFE; RATING SCALE; RELIABILITY; REPRODUCIBILITY; REVIEW; SELF REPORT; SYMPTOM; VALIDATION PROCESS;

ACTIVITIES OF DAILY LIVING; CANADA; HEALTH STATUS INDICATORS; HUMANS; MENTAL DISORDERS; MENTAL HEALTH SERVICES; PATIENT SATISFACTION; PSYCHIATRIC STATUS RATING SCALES; QUALITY INDICATORS, HEALTH CARE; QUALITY OF LIFE; QUESTIONNAIRES; TREATMENT OUTCOME;

EID: 0347926529     PISSN: 1095158X     EISSN: None     Source Type: Journal    
DOI: 10.2975/26.2003.249.261     Document Type: Review

References (78)

1. American Psychiatric Association. (1987). Diagnostic and Statistical Manual of Mental Disorders (3rd rev. ed.). Washington (DC).
2. American Psychiatric Association. (1994). Diagnostic and Statistical Manual of Mental Disorders (4 ed.). Washington (DC).
3. Anderson, R. L. & Lyons, J. S. (2001). Needs-based planning for persons with serious mental illness residing in intermediate care facilities. The Journal of Behavioral Health Services & Research, 28(1), 104-110.
4. Atkinson, M., & Zibin, S. (1996). Quality of Life Measurement Among Persons with Chronic Mental Illness: A Critique of Measures and Methods. Health Canada, Cat. NO. H39-390/1996E.
5. Baker, S., Barron, N., McFarland, B. H., & Bigelow, D. A. (1994a). A community ability scale for chronically mentally ill consumers: Part 1. Reliability and validity. Community Mental Health Journal, 30, 363-379.
6. Barker, S., Barron, N., McFarland, B. H., Bigelow, D. A., & Carnahan, T. (1994b). A community ability scale for chronically mentally ill consumers: Part II. Applications. Community Mental Health Journal, 30, 459-472.
7. Barry, M. & Zissi, A. (1997). Quality of life as an outcome measure in evaluating mental health services: A review of the empirical evidence. Social Psychiatry and Psychiatric Epidemiology, 32, 38-47.
8. Bracke, Piet. (2001). Measuring the subjective well-being of people in a psychosocial rehabilitation center and a residential psychiatric setting. Psychiatric Rehabilitation Journal, 24(3), 222-236.
9. Clark, C., Scott, E., Boydell, K., & Goering, P. (1999). Effects of client interviewers on client-reported satisfaction with mental health services. Psychiatric Services, 50, 961-964.
10. Dennis, M. (1998). Integrating Research and Clinical Assessment: Measuring Client Needs and Outcomes in a Changing Service Environment. NIDA Resource Centre for Health Service Research.
11. Derogatis, L. R., & Melisaratos, N. (1983). The Brief Symptom Inventory: An introductory report. Psychological Medicine, 13, 595-605.
12. Dickey, B. & Wagenaar, H. (1994). Evaluating health care reform: Including the clinician, client and family perspective. The Journal of Mental Health Administration, 21(3), 313-319.
13. Dickerson, F.B. (1997). Assessing clinical outcomes: The community functioning of persons with serious mental illness. Psychiatric Services, 48(7), 897-902.
14. Drake, R. E., McHugo, G.J., Clark, R. E., Teague, G. B., Xie, H., Miles, K., & Ackerson, T. H. (1998). Assertive community treatment for patients with co-occurring severe mental illness and substance use disorders: A clinical trial. American Journal of Orthopsychiatry, 68(2), 201-215.
15. Druss, B. G., Rosenheck, R. A., & Stolar, M. (1999). Patient satisfaction and administrative measures as indicators of the quality of mental health care. Psychiatric Services, 50, 1053-1058.
16. Durbin, J., Cochrane, J., Goering, P. & Macfarlane, D. (2001). Needs based planning: Evaluation of a level of care planning model. Journal of Behavioural Health Services and Research, 28(1), 67-80.
17. Eddy, D. M. (1998). Performance measurement: Problems and solutions. Health Affairs, 17(4), 7-25.
18. Eisen, S., Shaul, J., Clarridge, B., Nelson, D., Spink, J., & Cleary, P. D. (1999c). Development of a consumer survey for behavioral health services. Psychiatric Services, 50, 793-797.
19. Eisen, S. V., Dill, D. L., & Grob, M. C. (1994). Reliability and validity of a brief patient-report instrument for psychiatric outcome evaluation. Hospital and Community Psychiatry, 45, 242-247.
20. Eisen, S. V., Leff, H. S., & Schaefer, E. (1999a). Implementing outcome systems: Lessons from a test of the BASIS-32 and the SF-36. The Journal of Behavioral Health Services and Research, 26(1), 18-27.
21. Eisen, S. V., Wilcox, M., Leff, H. S., Schaefer, E., & Culhane, M. A. (1999b). Assessing behavioral health outcomes in outpatient programs: Reliability and validity of the BASIS-32. The Journal of Behavioural Health Services and Research, 26(1), 5-17.
22. Ellis, R. H., Wackwitz, J. H., & Foster, M. (1991). Uses of an empirically derived client typology based on level of functioning: Twelve years of the CCAR. The Journal of Mental Health Administration, 18, 88-101.
23. Endicott, J., Spitzer, R. L., Fleiss, J. L., & Cohen, J. (1976). The Global Assessment Scale: A procedure for measuring overall severity of psychiatric disturbance. Archives in General Psychiatry, 33, 766-771.
24. Evaluation Centre@H.S.R.I. (1995). Toolkit for Measuring Psychosocial Outcomes. Columbia, MD: Human Services Research Institute.
25. Gill, K. J., Pratt, C. W., & Librera, L. A. (Spring 1998). The effects of consumer versus staff administration on the measurement of consumer satisfaction with psychiatric rehabilitation. Psychiatric Rehabilitation Journal, 21(4), 365-370.
26. Goeree, R. (1996) Evaluation of Programs for the Treatment of Schizophrenia. Part II. A Review of Selected Programs in Canada. Ottawa, Publications Health Canada.
27. Granello, D. H., Granello, P. F., & Lee, F. (1999). Measuring treatment outcomes and client satisfaction in a partial hospitalization program. The Journal of Behavioural Health Services and Research 1999, 26(1), 50-63.
28. Green, R., & Gracely, E. (1987). Selecting a rating scaler evaluating services to the chronically mentally ill. Community Mental Health Journal, 91-102.
29. Green, R. S., & Newman, F. (1993). Utilizing client outcomes to improve the delivery of mental health services: Coping with organizational realities, concerns about relevance, and the believability of the data. Evaluation and Program Planning, 16, 325-327.
30. Guyatt, G. H., Bombardier, C., & Tugwell, P. X. (1986). Measuring disease-specific quality of life in clinical trials. Canadian Medical Association Journal, 134, 889-895.
31. Hawthorne, W. B., Green, E. E., Lohr, J. B., Hough, R., & Smith, P. G. (1999). Comparison of outcomes of acute care in short-term residential treatment and psychiatric hospital settings. Psychiatric Services, 50(3), 401-406.
32. Hedlung, J. L., & Vieweg, B. W. (1980). The Brief Psychiatric Rating Scale (BPRS): A comprehensive review. Journal of Operational Psychiatry, 11, 48-65.
33. Hoffman, F., Capelli, K., & Matrianni, X. (1997). Measuring treatment outcome for adults and adolescents: Reliability and validity of BASIS-32. Journal of Mental Health Administration, 24(3), 316-331.
34. Jaeschke, R., Singer, J., & Guyatt, G. H. (1989). Measurement of health status. Ascertaining the minimal clinically important difference. Control Clinical Trials, 10, 407-415.
35. Jinnett, K., Alexander, J. A. & Ullman, E. (2001). Case management and quality of life: Assessing treatment and outcomes for clients with chronic and persistent mental illness. Health Services Research, 36(1), 61-90.
36. Kane, R. L., Bartlett, J., & Potthoff, S. (1995). Building an empirically based outcomes information system for managed mental health care. Psychiatric Services, 46, 459-629.
37. Kersten, E., Wilkinson, K., & Wright, S. (1999). Bringing staff on board: Creating an outcomes project tied to continuous quality improvement in an adult community residential service. Evaluation and Program Planning, 22, 221-232.
38. Kessler, R. (1995). Epidemiology of psychiatric co-morbidity. In M. T. Tsuang, M. Tohen, & G. E. Zahner (Eds.) Textbook in Psychiatric Epidemiology. (pp. 179-198). New York: John Wiley and Sons, Inc.
39. Lambert, W., Salzer, M. S., & Bickman, L. (1998). Clinical outcome, consumer satisfaction, and ad hoc ratings of improvement in children's mental health. Journal of Consulting and Clinical Psychology, 66(2), 270-279.
40. Landis, J. B. (1999). Estimating net effects and costs of service options for persons with serious mental illness. Psychiatric Services, 50(6), 735-738.
41. Larsen, D. L., Attkisson, C. C., Hargreaves, W. A., & Nguyen, T. D. (1979). Assessment of client/patient satisfaction: Development of a general scale. Evaluation & Program Planning, 2(3), 197-207.
42. Lehman, A. F. (1997). Toolkit for Evaluating Quality of Life for Persons with Severe Mental Illness. Baltimore, MA: Human Services Research Institute, 1997.
43. Lehman, A. F. (1996). Measures of quality of life among persons with severe and persistent mental disorders. Social Psychiatry and Psychiatric Epidemiology, 31, 78-88.
44. Lehman, A. F. (1995). Measuring quality of life in a reformed health system. Health Affairs, 14(3), 90-101.
45. Lehman, A. F. (1988). A quality of life interview for the chronically mentally ill. Evaluation and Program Planning, 11, 51-62.
46. Lukoff, D., Nuechterlein, K. H., & Ventura, J. (1986). Manual for the expanded brief psychiatric rating scale. Schizophrenia Bulletin, 12, 594-602.
47. Lyons, J. S., O'Mahoney, M. T., Doheny, K. M., Dworkin, L. N., & Miller, S. I. (1995). The prediction of short-stay psychiatric inpatients. Administration and Policy in Mental Health, 23, 17-25.
48. Lyons, J. S., O'Mahoney, M. T., Miller, S. I., Neme, J., Kabat, J., & Miller, F. (1997). Predicting readmission to the psychiatric hospital in a managed care environment: Implications for quality indicators. American Journal of Psychiatry, 154, 337-340.
49. Lyons, J. S., Stutesman, J., & Neme, J. (1997). Predicting psychiatric emergency admissions and hospital outcome. Medical Care, 35, 792-800.
50. Massey, O. T., & Wu, L. (1994). Three critical views of functioning: Comparisons of assessments made by individuals with mental illness, their case managers, and family members. Evaluation and Program Planning, 17(1), 1-7.
51. McHorney, C., Ware, J., & Raczek, A. (1993). The MOS 36 item SF 36 II: Psychometric and clinical tests of validity in measuring physical and mental health constructs. Medical Care, 31, 247-263.
52. McLean Reports. (1996). McLean Hospital.
53. Mueser, K. T., Bennett, M., & Kushner, M. G. (1995). Epidemiology of substance use disorders among persons with chronic mental illness. In A. F. Lehman & L. B. Dixon (Eds.), Double Jeopardy: Chronic Mental Illness and Substance Use Disorders. Chur, Switzerland: Harwood Academic Publishers.
54. Newman, F. L., & Ciarlo, J. A. (1994). Criteria for selecting psychological instruments for treatment outcome assessment. In M. E. Maruish (Ed.), Use of Psychological Testing for Treatment Planning and Outcome Assessment. Hillsdale, NJ: Lawrence Erlbaum Associate Publishers.
55. Van Nieuwenhuizen, C., Schene, A. H., Boevink, W. A., & Wolf, J. R. L. M. (1997). Measuring the quality of life of clients with severe mental illness: A review of instruments. Psychiatric Rehabilitation Journal, 20(4), 33-41.
56. Olfson, M., Mechanic, D., Hansell, S., Boyer, C. A., & Walkup, J. (1999). Prediction of homelessness within three months of discharge among inpatients with schizophrenia. Psychiatric Services, 50(5), 667-673.
57. Overall, J. E., & Gorham, D. R. (1962). The brief psychiatric rating scale. Psychological Reports, 10, 799-812.
58. Piersma, H. L., & Boes, J. L. (1997). Brief Reports. The GAF and psychiatric outcome: A Descriptive Report. Community Mental Health Journal, 33(1), 35-41.
59. Piersma, H. L., Reaume, W. M., & Boes, J. L. (1994). The Brief Symptom Inventory (BSI) as an outcome measure for adult psychiatric inpatients. Journal of Clinical Psychology, 50(4), 555-563.
60. Rosenblatt, A., & Attkisson, C. (1993). Assessing outcomes for sufferers of severe mental disorder: A conceptual framework and review. Evaluation and Program Planning, 16, 347-363.
61. Roy-Byrne, P., Dagadakis, C., Ries, R., Decker, K., Jones, R., Bolte, M. A., Scher, M., Brinkley, J., Gallagher, M., Patrick, D. L., & Mark, H. (1995). A psychiatrist-rated battery of measures for assessing the clinical status of psychiatric inpatients. Psychiatric Services, 46(4), 347-352.
62. Ruggeri, M. (1994). Patients' and relatives' satisfaction with psychiatric services: The state of the art of its measurement. Soc Psychiatry Psychiatric Epidemiology, 29, 212-227.
63. Rush, B. R., & Ogborne, A. C. (1991). Program logic models: Expanding their role and structure. Canadian Journal of Program Evaluation, 6(2), 93-105.
64. Russo, J., Roy-Byrne, P., Jaffe, C., Ries, R., Dagadakis, C., Dwyer-O'Connor, E., & Reeder, D. (1997a). The relationship of patient-administered outcome assessment to quality of life and physician ratings: Validity of the BASIS-32. The Journal of Mental Health Administration, 24(2), 200-214.
65. Russo, J., Roy-Byrne, P., Reeder, D., Alexander, M., Dwyer-O'Connor, E., Dagadakis, C., Ries, R., & Patrick, D. (1997b). Longitudinal assessment of quality of life in acute psychiatric inpatients: Reliability and validity. The Journal of Nervous and Mental Disease, 185(3), 166-175.
66. Russo, J., Trujillo, C. A., Wingerson, D., Decker, K., Ries, R., Wetzler, H., & Roy-Byrne, P. (1998). Brief report. The MOS 36-item short form health survey. Reliability, validity, and preliminary findings in schizophrenic outpatients. Medical Care, 36(5), 752-756.
67. Sederer, L., & Dickey, B. (Eds). (1996). Outcomes Assessment in Clinical Practice. Baltimore: Williams and Wilkins.
68. Skodol, A. E., Link, B. G., Shrout, P. E., & Horwath, E. (1988). The revision of Axis V in DSM-III-R: Should symptoms have been included? American Journal of Psychiatry 145, 825-829. Washington, D.C., Author. American Psychiatric Association.
69. Smith, G. R., Manderscheid, R. W., Flynn, L. M., & Steinwachs, D. M. (1997). Principles for assessment of patient outcomes in mental health care. Psychiatric Services, 48(8), 1033-1036.
70. Smith, W. (1996). Symptom Checklist-90-Revised (SCL-90-R) and the Brief Symptom Inventory (BSI). In L. I. Sederer & B. Dickey. (Eds.), Outcomes Assessment in Clinical Practice (pp. 89-91). Baltimore, etc.: Williams & Wilkins.
71. Sobell, L. C., & Sobell, M. B. (1990). Self-report issues in alcohol abuse: State of the art and future directions. Behavioral Assessment, 12, 77-90.
72. Streiner, D. L., & Norman, G. R. Health Measurement Scales. (1995). A Practical Guide to their Development and Use. (2nd ed.). Oxford: Oxford University Press.
73. Teague, G. B., Ganju, V., Hornik, J. A., Johnson, J. R., & McKinney, J. (1997). The MHSIP mental health report card. A consumer-oriented approach to monitoring the quality of mental health plans. Evaluation Review, 21(3), 330-341.
74. Ventura, J., Green, M. F., Shaner, A., & Liberman, R. P. (1993). Training and quality assurance with the brief psychiatric rating scale: 'Th Drift Busters.' International Journal of Methods in Psychiatric Research, 3, 221-244.
75. Ventura, J., Nuechterlein, K. H., Subotnik et al. (2000). Symptom dimensions in recent-onset schizophrenia and mania: A principal components analysis of the 24-item Brief Psychiatric Rating Scale. Psychiatry Research, 97, 129-135.
76. Ware, J. A., Kosinski, M., & Keller, S. D. (1996). A. 12-item short-form health survey: Construction of scales and preliminary tests of reliability and validity. Med Care, 34, 220-233.
77. Ware, J. E., & Sherbourne, C. D. (1992). The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection. Med Care, 30, 473-483.
78. Zani, B., McFarland, B., Wachal, M., Barker, S., & Barron, N. (1999). Statewide replication of predictive validation for the Multnomah Community Ability Scale. Community Mental Health Journal, 35(3), 223-229.