Validation of a fidelity rating instrument for consumer-operated services

American Journal of Evaluation

Volumn 27, Issue 1, 2006, Pages 9-27

  Mowbray, Carol T ^a   Bybee, Deborah ^a,b   Holter, Mark ^a   Lewandowski, Lisa ^a  

^a UNIVERSITY OF MICHIGAN   (United States)

^b MICHIGAN STATE UNIVERSITY   (United States)

Author keywords

Consumer operated services; Convergent validity; Fidelity; Program implementation

Indexed keywords

EID: 33144475601     PISSN: 10982140     EISSN: None     Source Type: Journal    
DOI: 10.1177/1098214005284971     Document Type: Article

References (39)

1. Becker, D. R., Smith, J., Tanzman, B., Drake, R. E., & Tremblay, T. (2001). Fidelity of supported employment programs and employment outcomes. Psychiatric Services, 52 (6), 834 - 836.
2. Bollen, K., & Lennox, R. (1991). Conventional wisdom on measurement: Astructural equation perspective. Psychological Bulletin, 110, 305 - 314.
3. Bond, G. R., Becker, D. R., & Drake, R. E. (2001). Implementing supported employment as an evidence-based practice. Psychiatric Services, 52 (3), 313 - 322.
4. Bond, G. R., Evans, L., Salyers, M. P., Williams, J., & Kim, H. W. (2000). Measurement of fidelity in psychiatric rehabilitation. Mental Health Service Research, 2 (2), 75 - 87.
5. Bond, G. R., Williams, J., Evans, L., Salyers, M. P., Kim, H. W., & Sharpe, H. (2000). PN-44-psychiatric rehabilitation fidelity toolkit. Cambridge, MA: Human Services Research Institute.
6. Buckner, J. C. (1988). The development of an instrument to measure neighborhood social cohesion. American Journal of Community Psychology, 16, 771 - 791.
7. Burt, M., Duke, A., & Hargreaves, A. (1998). The Program Environment Scale: Assessing client perceptions of communitybased programs for the severely mentally ill. American Journal of Community Psychology, 26, 853 - 879.
8. Calsyn, R. J. (2000). Achecklist for critiquing treatment fidelity studies. Mental Health Services Research, 2 (2), 107 - 113.
9. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.) Hillsdale, NJ: Lawrence Erlbaum.
10. Collins, L. M., Schafer, J. L., & Kam, C. M. (2001). Acomparison of inclusive and restrictive strategies in modern missing data procedures. Psychological Methods, 6 (4), 330 - 351.
11. Cornelius, L. J., Booker, N. C., Arthur, T. E., Reeves, I., & Morgan, O. (2004). The validity and reliability testing of a consumer-based cultural competency inventory. Research in Social Work Practice, 14 (3), 201 - 209.
12. Ganju, V. (2003). Implementation of evidence-based practices in state mental health systems: Implications for research and effectiveness studies. Schizophrenia Bulletin, 29, 125 - 131.
13. Henggeler, S. W., Melton, G. B., Brondino, M. J., Scherer, D. G., & Hanley, J. H. (1997). Multisystemic therapy with violent and chronic juvenile offenders and their families: The role of treatment fidelity in successful dissemination. Journal of Consulting and Clinical Psychology, 65 (5), 821 - 833.
14. Holter, M. C., Mowbray, C. T., Bellamy, C., MacFarlane, P., & Dukarski, J. (2004). Critical ingredients of consumer-run services: Results of a national survey. Community Mental Health Journal, 40 (1), 47 - 63.
15. Huey, S. J., Henggeler, S. W., & Brondino, M. J. (2000). Mechanisms of change in multisystemic therapy: Reducing delinquent behavior through therapist adherence and improved family and peer functioning. Journal of Consulting & Clinical Psychology, 68 (3), 451 - 467.
16. Institute of Medicine. (2001). Improving the quality of long-term care. Washington, DC: National Academy Press.
17. Lucca, A. M. (2000). A clubhouse fidelity index: Preliminary reliability and validity results. Mental Health Services Research, 2 (2), 89-94.
18. Maas, C.J.M., & Hox, J. J. (2005). Sufficient sample sizes for multilevel modeling. Methodology: European Journal of Research Methods for the Behavioral and Social Sciences, 1 (3), 85 - 91.
19. Macias, C., Propst, R., Rodican, C., & Boyd, J. (2001). Strategic planning for ICCD clubhouse implementation: Development of the Clubhouse Research and Evaluation Screening Survey (CRESS). Mental Health Services Research, 3 (3), 155 - 167.
20. McHugo, G. J., Drake, R. E., Teague, G. B., & Xie, H. (1999). The relationship between model fidelity and client outcomes in the New Hampshire Dual Disorders Study. Psychiatric Services, 50 (6), 818 - 824.
21. Moncher, F. J., & Prinz, R. J. (1991). Treatment fidelity in outcome studies. Clinical Psychology Review, 11 (3), 247 - 266.
22. Moser, L. L., DeLuca, N. L., & Bond, G. R. (2004). Implementing evidence-based psychosocial practices: Lessons learned from statewide implementation of two practices. CNS Spectrums, 9 (12), 926 - 936, 942 - 942.
23. Mowbray, C. T., Holter, M. C., Stark, L., Pfeffer, C., & Bybee, D. (2005). A fidelity rating instrument for consumer-run drop-in centers (FRI-CRDI). Research in Social Work Practice, 15 (4), 278 - 290.
24. Mowbray, C. T., Holter, M. C., Teague, G. B., & Bybee, D. (2003). Fidelity criteria: Development, measurement and validation. American Journal of Evaluation, 24, 315 - 340.
25. Mowbray, C. T., & Tan, C. (1993). Consumer-operated drop-in centers: Evaluation of operations and impact. Journal of Mental Health Administration, 20 (1), 8 - 19.
26. Nelson, G. (1988). The development of an instrument to measure neighborhood cohesion. American Journal of Community Psychology, 16 (6), 771 - 779.
27. Nelson, G., Hall, G. B., & Walsh-Bowers, R. (1998). The relationship between housing characteristics, emotional wellbeing, and the personal empowerment of psychiatric consumer/survivors. Community Mental Health Journal, 34 (1), 57 - 69.
28. Orwin, R. G. (2000). Assessing program fidelity in substance abuse health services research. Addiction, 95 (Suppl. 3), S309 - S327.
29. Raudenbush, S., & Bryk, A. (2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.) Thousand Oaks, CA: Sage.
30. Raudenbush, S., Bryk, A., Cheong, Y. F., & Congdon, R. (2004). HLM 6: Hierarchical linear and nonlinear modeling. Chicago: Scientific Software International.
31. Raudenbush, S. W., & Liu, X. (2000). Statistical power and optimal design for multisite randomized trials. Psychological Methods, 5 (2), 199 - 213.
32. Schafer, J., & Graham, J. W. (2002). Missing data: Our viewof the state of the art. Psychological Methods, 7 (2), 147 - 177.
33. Segal, S. P., Silverman, C., & Temkin, T. (1993). Empowerment and self-help agency practice for people with mental disabilities. Social Work, 38 (6), 705 - 712.
34. Shern, D., Lee, B., & Coen, A. (1996). The Colorado Symptom Index: A self report measure for psychiatric symptoms. Tampa, FL: Louis de la Parte Mental Health Institute.
35. Snyder, C. R., Sympson, S. C., Ybasco, F. C., Borders, T. F., Babyak, M. A., & Higgins, R. L. (1996). Development and validation of the State Hope Scale. Journal of Personality and Social Psychology, 2, 321 - 335.
36. Teague, G. B., Bond, G. R., & Drake, R. E. (1998). Program fidelity and Assertive Community Treatment: Development and use of a measure. American Journal of Orthopsychiatry, 68, 216 - 232.
37. Unrau, Y. A. (2001). Using client exit interviewto illuminate outcomes in program logic models: Acase example. Evaluation and Program Planning, 24 (4), 353 - 361.
38. Weisman, A., Tompson, M. C., Okazaki, S., Gregory, J., Goldstein, M. J., Rea, M., et al. (2002). Clinicians' fidelity to a manual-based family treatment as a predictor of the one-year course of bipolar disorder. Family Process, 41 (1), 123 - 131.
39. Zinman, S. (1986). Self-help: The wave of the future. Hospital and Community Psychiatry, 37 (3), 213 - 213.