A comparison of seminar and computer based training on the accuracy and reliability of raters using the children's global assessment scale (CGAS)

Administration and Policy in Mental Health and Mental Health Services Research

Volumn 39, Issue 6, 2012, Pages 458-465

  Lundh, Anna ^a   Kowalski, Jan ^b   Sundberg, Carl Johan ^a   Landén, Mikael ^a,c  

^a KAROLINSKA INSTITUTE   (Sweden)

^b JK Biostatistics   (Sweden)

^c UNIVERSITY OF GOTHENBURG   (Sweden)

Author keywords

Child and Adolescent Mental Health Services; Children's Global Assessment Scale; Rater training; Reliability

Indexed keywords

ADULT; AGED; ARTICLE; COMPARATIVE STUDY; EDUCATION; FEMALE; HEALTH CARE PERSONNEL; HUMAN; MALE; MENTAL DISEASE; MIDDLE AGED; PUBLIC RELATIONS; REPRODUCIBILITY; STATISTICS; TEACHING;

ADULT; AGED; COMPUTER-ASSISTED INSTRUCTION; FEMALE; HEALTH PERSONNEL; HUMANS; INTERPROFESSIONAL RELATIONS; MALE; MENTAL DISORDERS; MIDDLE AGED; REPRODUCIBILITY OF RESULTS; TEACHING;

EID: 84869224251     PISSN: 0894587X     EISSN: 15733289     Source Type: Journal    
DOI: 10.1007/s10488-011-0369-5     Document Type: Article

References (39)

1. Bates, L. W., Lyons, J. A., & Shaw, J. B. (2002). Effects of brief training on application of the Global Assessment of Functioning Scale. Psychological Reports, 91(3 Pt 1), 999-1006.
2. Bero, L. A., Grilli, R., Grimshaw, J. M., Harvey, E., Oxman, A. D., & Thomson, M. A. (1998). Closing the gap between research and practice: an overview of systematic reviews of interventions to promote the implementation of research findings. The Cochrane Effective Practice and Organization of Care Review Group. British Medical Journal, 317(7156), 465-468.
3. Bird, H. R., Canino, G., Rubiostipec, M., & Ribera, J. C. (1987). Further measures of the psychometric properties of The Childrens Global Assessment Scale. Archives of General Psychiatry, 44(9), 821-824.
4. Bland, J. M., & Altman, D. G. (1996). Measurement error and correlation coefficients. British Medical Journal, 313(7048), 41-42.
5. Davis, D. A., Thomson, M. A., Oxman, A. D., & Haynes, R. B. (1995). Changing physician performance. A systematic review of the effect of continuing medical education strategies. Journal of the American Medical Association, 274(9), 700-705.
6. DeMaso, D. R., Twente, A. W., Spratt, E. G., & O'Brien, P. (1995). Impact of psychologic functioning, medical severity, and family functioning in pediatric heart transplantation. The Journal of Heart and Lung Transplantation, 14(6 Pt 1), 1102-1108.
7. Dyrborg, J., Larsen, F. W., Nielsen, S., Byman, J., Nielsen, B. B., & Gautre-Delay, F. (2000). The Children's Global Assessment Scale (CGAS) and Global Assessment of Psychosocial Disability (GAPD) in clinical practice - substance and reliability as judged by intraclass correlations. European Child and Adolescent Psychiatry, 9(3), 195-201.
8. Fernando, T., Mellsop, G., Nelson, K., Peace, K., & Wilson, J. (1986). The reliability of axis V of DSM-III. American Journal of Psychiatry, 143(6), 752-755.
9. Galanter, C. A., & Patel, V. L. (2005). Medical decision making: a selective review for child psychiatrists and psychologists. Journal of Child Psychology and Psychiatry and Allied Disciplines, 46(7), 675-689.
10. Gilbody, S. M., House, A. O., & Sheldon, T. A. (2002). Outcomes research in mental health. Systematic review. British Journal of Psychiatry, 181, 8-16.
11. Gold, J., Buonopane, R. J., Caggiano, R. A., Picciotto, M., Vogeli, C., Kanner, N. T., et al. (2009). Assessing outcomes in child psychiatry. American Journal of Managed Care, 15(4), 210-216.
12. Goldman, H. H., Skodol, A. E., & Lave, T. R. (1992). Revising axis V for DSM-IV: A review of measures of social functioning. American Journal of Psychiatry, 149(9), 1148-1156.
13. Green, B., Shirk, S., Hanze, D., & Wanstrath, J. (1994). The Children's Global Assessment Scale in clinical practice: An empirical evaluation. Journal of the American Academy of Child and Adolescent Psychiatry, 33(8), 1158-1164.
14. Hanssen-Bauer, K., Aalen, O. O., Ruud, T., & Heyerdahl, S. (2007). Inter-rater reliability of clinician-rated outcome measures in child and adolescent mental health services. Administration and Policy In Mental Health, 34(6), 504-512.
15. Hilsenroth, M. J., Ackerman, S. J., Blagys, M. D., Baumann, B. D., Baity, M. R., Smith, S. R., et al. (2000). Reliability and validity of DSM-IV axis V. American Journal of Psychiatry, 157(11), 1858-1863.
16. Hoagwood, K., Hibbs, E., Brent, D., & Jensen, P. (1995). Introduction to the special section: efficacy and effectiveness in studies of child and adolescent psychotherapy. Journal of Consulting and Clinical Psychology, 63(5), 683-687.
17. Hoagwood, K., Jensen, P. S., Petti, T., & Burns, B. J. (1996). Outcomes of mental health care for children and adolescents: I. A comprehensive conceptual model. Journal of the American Academy of Child and Adolescent Psychiatry, 35(8), 1055-1063.
18. Hodges, K. (1993). Structured interviews for assessing children. Journal of Child Psychology and Psychiatry and Allied Disciplines, 34(1), 49-68.
19. Kirkpatrick, D. L., & Kirkpatrick, J. D. (2005). Evaluating training programs : The four levels (3rd ed.) . San Francisco: Berrett- Koehler.
20. Kobak, K. A., Engelhardt, N., & Lipsitz, J. D. (2006). Enriched rater training using Internet based technologies: A comparison to traditional rater training in a multi-site depression trial. Journal of Psychiatric Research, 40(3), 192-199.
21. Kobak, K. A., Lipsitz, J. D., & Feiger, A. (2003). Development of a standardized training program for the Hamilton Depression Scale using internet-based technologies: Results from a pilot study. Journal of Psychiatric Research, 37(6), 509-515.
22. Kobak, K. A., Opler, M. G. A., & Engelhardt, N. (2007). PANSS rater training using Internet and videoconference: Results from a pilot study. Schizophrenia Research, 92(1-3), 63-67.
23. Lundh, A., Kowalski, J., Sundberg, C. J., Gumpert, C., & Landén, M. (2010). Children's Global Assessment Scale (CGAS) in a naturalistic clinical setting: Inter-rater reliability and comparison with expert ratings. Psychiatry Research, 177(1-2), 206-210.
24. Mazade, N. A., & Glover, R. W. (2007). State mental health policy: Critical priorities confronting state mental health agencies. Psychiatric Services, 58(9), 1148-1150.
25. Müller, M. J., & Szegedi, A. (2002). Effects of interrater reliability of psychopathologic assessment on power and sample size calculations in clinical trials. Journal of Clinical Psychopharmacology, 22(3), 318-325.
26. Muratori, F., Picchi, L., Bruni, G., Patarnello, M., & Romagnoli, G. (2003). A two-year follow-up of psychodynamic psychotherapy for internalizing disorders in children. Journal of the American Academy of Child and Adolescent Psychiatry, 42(3), 331-339.
27. Myers, K., & Winters, N. C. (2002). Ten-year review of rating scales. I: Overview of scale functioning, psychometric properties, and selection. Journal of the American Academy of Child and Adolescent Psychiatry, 41(2), 114-122.
28. Peabody, J. W., Luck, J., Glassman, P., Dresselhaus, T. R., & Lee, M. (2000). Comparison of vignettes, standardized patients, and chart abstraction: A prospective validation study of 3 methods for measuring quality. Journal of the American Medical Association, 283(13), 1715-1722.
29. Rey, J. M., Starling, J., Wever, C., Dossetor, D. R., & Plapp, J. M. (1995). Inter-rater reliability of global assessment of functioning in a clinical setting. Journal of Child Psychology and Psychiatry and Allied Disciplines, 36(5), 787-792.
30. Rosen, J., Mulsant, B. H., Marino, P., Groening, C., Young, R. C., & Fox, D. (2008). Web-based training and interrater reliability testing for scoring the Hamilton Depression Rating Scale. Psychiatry Research, 161(1), 126-130.
31. Schorre, B. E., & Vandvik, I. H. (2004). Global assessment of psychosocial functioning in child and adolescent psychiatry. A review of three unidimensional scales (CGAS, GAF, GAPD). European Child and Adolescent Psychiatry, 13(5), 273-286.
32. Shaffer, D., Gould, M. S., Brasic, J., Ambrosini, P., Fisher, P., Bird, H., et al. (1983). A children's global assessment scale (CGAS). Archives of General Psychiatry, 40(11), 1228-1231.
33. Shaffer, D., Lucas, C. P., & Richters, J. E. (1999). Diagnostic assessment in child and adolescent psychopathology. New York: Guilford Press.
34. Shrout, P. E. (1998). Measurement reliability and agreement in psychiatry. Statistical Methods in Medical Research, 7(3), 301-317.
35. Weissman, M. M., Warner, V., & Fendrich, M. (1990). Applying impairment criteria to children's psychiatric diagnosis. Journal of the American Academy of Child and Adolescent Psychiatry, 29(5), 789-795.
36. Winters, N. C., Collett, B. R., & Myers, K. M. (2005). Ten-year review of rating scales, VII: Scales assessing functional impairment. Journal of the American Academy of Child and Adolescent Psychiatry, 44(4), 309-342.
37. Wolpert, M., Cooper, L., Tingay, K., Young, K., & Svanberg, E. (2007). CAMHS Outcomes Research Consortium (CORC) Handbook Available from http://www.corc.uk.net/media/File/CORC%20Resources/Handbook/HANDBOOK%202007.pdf.
38. Yavorsky, C., Opler, M., Ivanova, E., Gordon, J., Jovic, S., & Yang, L. (2010). Quantifying rater drift in an International sample of investigators participating in standardized rater training events: Is PANSS reliability maintained over time? Paper presented at the ISCTM 6th Annual Scientific Meeting. http://isctm.org/public-access/2010-22Feb-Posters-Abstracts.pdf.
39. Zanarini, M. C., Skodol, A. E., Bender, D., Dolan, R., Sanislow, C., Schaefer, E., et al. (2000). The collaborative longitudinal personality disorders study: Reliability of axis I and II diagnoses. Journal of Personality Disorders, 14(4), 291-299.