Predictors and moderators of agreement between clinical and research diagnoses for children and adolescents

Journal of Consulting and Clinical Psychology

Volumn 82, Issue 6, 2014, Pages 1151-1162

  Jensen Doss, Amanda ^a   Youngstrom, Eric A ^b   Youngstrom, Jennifer Kogos ^b   Feeny, Norah C ^c   Findling, Robert L ^d  

^a University of Miami   (United States)

^b The University of North Carolina at Chapel Hill   (United States)

^c CASE WESTERN RESERVE UNIVERSITY   (United States)

^d JOHNS HOPKINS UNIVERSITY   (United States)

Author keywords

Clinical decision making; Diagnosis; Diagnostic agreement; Structured diagnostic interviews

Indexed keywords

ADOLESCENT; ADOLESCENT DISEASE; ADULT; AFRICAN AMERICAN; ARTICLE; ATTENTION DEFICIT DISORDER; CHILD; CHILDHOOD DISEASE; COMORBIDITY; DEPRESSION; DIAGNOSTIC ERROR; DISEASE SEVERITY; DISRUPTIVE BEHAVIOR; EDUCATIONAL STATUS; FAMILY; FAMILY FUNCTIONING; FEMALE; GENDER; HUMAN; JUVENILE; MAJOR CLINICAL STUDY; MALE; MENTAL DISEASE; MENTAL HEALTH SERVICE; OUTPATIENT CARE; PARENT; POSTTRAUMATIC STRESS DISORDER; SCHEDULE FOR AFFECTIVE DISORDERS AND SCHIZOPHRENIA; STRUCTURED INTERVIEW; DEPRESSIVE DISORDER; MEDICAL RECORD; MENTAL DISORDERS; PSYCHOLOGY; RESEARCH; RETROSPECTIVE STUDY;

ADOLESCENT; CHILD; COMMUNITY MENTAL HEALTH SERVICES; COMORBIDITY; DEPRESSION; DEPRESSIVE DISORDER; DIAGNOSTIC ERRORS; FEMALE; HUMANS; MALE; MEDICAL RECORDS; MENTAL DISORDERS; PARENTS; RESEARCH; RETROSPECTIVE STUDIES;

EID: 84925680144     PISSN: 0022006X     EISSN: 19392117     Source Type: Journal    
DOI: 10.1037/a0036657     Document Type: Article

References (63)

1. Achenbach, T. M., & Rescorla, L. A. (2001). Manual for the ASEBA school-age forms & profiles. Burlington: University of Vermont, Research Center for Children, Youth, and Families
2. Aiken, L., & West, S. (1991). Multiple regression: Testing and interpreting interactions. Newbury Park, CA: Sage
3. Ambrosini, P. J. (2000). Historical development and present status of the Schedule for Affective Disorders and Schizophrenia for School-Age Children (K-SADS). Journal of the American Academy of Child & Adolescent Psychiatry, 39, 49-58. doi:10.1097/00004583-200001000-00016
4. American Psychiatric Association. (2001). Diagnostic and statistical manual of mental disorders (4th ed., text rev.)
5. Washington, DC: Author. American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Washington, DC: Author
6. Anderson, D. A., & Paulosky, C. A. (2004). A survey of the use of assessment instruments by eating disorder professionals in clinical practice. Eating and Weight Disorders, 9, 238-241. doi:10.1007/ BF03325075
7. American Psychological Association Presidential Task Force on Evidence-Based Practice. (2006). Evidence-based practice in psychology. American Psychologist, 61, 271-285. doi:10.1037/0003-066X.61.4.271
8. Aronen, E. T., Noam, G. G., & Weinstein, S. R. (1993). Structured diagnostic interviews and clinicians' discharge diagnoses in hospitalized adolescents. Journal of the American Academy of Child & Adolescent Psychiatry, 32, 674-681. doi:10.1097/00004583-199305000-00027
9. Beck, A. T., Steer, R. A., & Carbin, M. G. (1988). Psychometric properties of the Beck Depression Inventory: Twenty-five years of evaluation. Clinical Psychology Review, 8, 77-100. doi:10.1016/0272-7358(88)90050-5
10. Bilek, E. L., & Ehrenreich-May, J. (2012). An open trial investigation of a transdiagnostic group treatment for children with anxiety and depressive symptoms. Behavior Therapy, 43, 887-897. doi:10.1016/j.beth.2012.04.007
11. Bird, H. R., Yager, T. J., Staghezza, B., Gould, M. S., Canino, G., & Rubio-Stipec, M. (1990). Impairment in the epidemiological measurement of childhood psychopathology in the community. Journal of the American Academy of Child & Adolescent Psychiatry, 29, 796-803. doi:10.1097/00004583-199009000-00020
12. Brugha, T. S., Bebbington, P. E., & Jenkins, R. (1999). A difference that matters: Comparisons of structured and semi-structured psychiatric diagnostic interviews in the general population. Psychological Medicine, 29, 1013-1020. doi:10.1017/S0033291799
13. Cashel, M. L. (2002). Child and adolescent psychological assessment: Current clinical practices and the impact of managed care. Professional Psychology: Research and Practice, 33, 446-453. doi:10.1037/0735-7028.33.5.446
14. Chorpita, B. F., Bernstein, A., & Daleiden, E. L. (2011). Empirically guided coordination of multiple evidence-based treatments: An illustration of relevance mapping in children's mental health services. Journal of Consulting and Clinical Psychology, 79, 470-480. doi:10.1037/ a0023982
15. Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20, 37-46. doi:10.1177/ 00131644600
16. Croskerry, P. (2003). The importance of cognitive errors in diagnosis and strategies to minimize them. Academic Medicine, 78, 775-780. doi: 10.1097/00001888-200308000-00003
17. De Los Reyes, A., & Kazdin, A. E. (2005). Informant discrepancies in the assessment of childhood psychopathology: A critical review, theoretical framework, and recommendations for further study. Psychological Bulletin, 131, 483-509
18. Ebesutani, C., Bernstein, A., Chorpita, B. F., & Weisz, J. R. (2012). A transportable assessment protocol for prescribing youth psychosocial treatments in real-world settings: Reducing assessment burden via selfreport scales. Psychological Assessment, 24, 141-155. doi:10.1037/ a0025176
19. Fleiss, J. R. (1981). Statistical methods for rates and proportions (2nd ed.). New York, NY: Wiley
20. Galanter, C. A., & Patel, V. L. (2005). Medical decision making: A selective review for child psychiatrists and psychologists. Journal of Child Psychology and Psychiatry, 46, 675-689. doi:10.1111/j.1469-7610.2005.01452.x
21. Garb, H. N. (1998). Studying the clinician: Judgment research and psychological assessment. Washington, DC: American Psychological Association. doi:10.1037/10299-000
22. Garland, A. F., Lau, A. S., Yeh, M., McCabe, K. M., Hough, R. L., & Landsverk, J. A. (2005). Racial and ethnic differences in utilization of mental health services among high-risk youths. American Journal of Psychiatry, 162, 1336-1343. doi:10.1176/appi.ajp.162.7.1336
23. Geller, B., Zimerman, B., Williams, M., Bolhofner, K., Craney, J. L., DelBello, M. P., & Soutullo, C. (2001). Reliability of the Washington University in St. Louis Kiddie Schedule for Affective Disorders and Schizophrenia (WASH-U-KSADS) mania and rapid cycling sections. Journal of the American Academy of Child & Adolescent Psychiatry, 40, 450-455. doi:10.1097/00004583-200104000-00014
24. Ghanizadeh, A., Mohammadi, M. R., & Yazdanshenas, A. (2006). Psychometric properties of the Farsi translation of the Kiddie Schedule for Affective Disorders and Schizophrenia-Present and Lifetime Version. BMC Psychiatry, 6; 10. doi:10.1186/1471-244X-6-10
25. Hanley, J. A. (2003). Statistical analysis of correlated data using generalized estimating equations: An orientation. American Journal of Epidemiology, 157, 364-375. doi:10.1093/aje/kwf215
26. Hinshaw, S. P., & Cicchetti, D. (2000). Stigma and mental disorder. Development and Psychopathology, 12, 555-598. doi:10.1017/ S0954579400
27. Jensen, A. L., & Weisz, J. R. (2002). Assessing match and mismatch between practitioner-generated and standardized interview-generated diagnoses for clinic-referred children and adolescents. Journal of Consulting and Clinical Psychology, 70, 158-168. doi:10.1037/0022-006X.70.1.158
28. Jensen-Doss, A., & Hawley, K. M. (2011). Understanding clinicians' diagnostic practices. Administration and Policy in Mental Health and Mental Health Services Research, 38, 476-485. doi:10.1007/s10488-011-0334-3
29. Jensen-Doss, A., & Weisz, J. R. (2008). Diagnostic agreement predicts treatment process and outcomes in youth mental health clinics. Journal of Consulting and Clinical Psychology, 76, 711-722. doi:10.1037/0022-006X.76.5.711
30. Jewell, J., Handwerk, M., Almquist, J., & Lucas, C. (2004). Comparing the validity of clinician-generated diagnosis of conduct disorder to the Diagnostic Interview Schedule for Children. Journal of Clinical Child and Adolescent Psychology, 33, 536-546. doi:10.1207/ s15374424jccp3303-11
31. Kaufman, J., Birmaher, B., Brent, D., Rao, U., Flynn, C., Moreci, P., Ryan, N. (1997). Schedule for Affective Disorders and Schizophrenia for School-Age Children-Present and Lifetime Version (K-SADS-PL): Initial reliability and validity data. Journal of the American Academy of Child & Adolescent Psychiatry, 36, 980-988. doi:10.1097/00004583-199707000-00021
32. Klinkman, M. S., Coyne, J. C., Gallo, S., & Schwenk, T. L. (1998). False positives, false negatives, and the validity of the diagnosis of major depression in primary care. Archives of Family Medicine, 7, 451-461. doi:10.1001/archfami.7.5.451
33. Kraemer, H. C., Measelle, J. R., Ablow, J. C., Essex, M. J., Boyce, W. T., & Kupfer, D. J. (2003). A new approach to integrating data from multiple informants in psychiatric assessment and research: Mixing and matching contexts and perspectives. American Journal of Psychiatry, 160, 1566-1577. doi:10.1176/appi.ajp.160.9.1566
34. Kramer, T. L., Robbins, J. M., Phillips, S. D., Miller, T. L., & Burns, B. J. (2003). Detection and outcomes of substance use disorders in adolescents seeking mental health treatment. Journal of the American Academy of Child & Adolescent Psychiatry, 42, 1318-1326. doi:10.1097/01.chi .0000084833.67701.44
35. Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33, 159-174. doi:10.2307/ 2529310
36. Lewczyk, C. M., Garland, A. F., Hurlburt, M. S., Gearity, J., & Hough, R. L. (2003). Comparing DISC-IV and clinician diagnoses among youth receiving public mental health services. Journal of the American Academy of Child & Adolescent Psychiatry, 42, 349-356. doi:10.1097/ 00004583-200303000-00016
37. Little, R. J. A. (1988). A test of missing completely at random for multivariate data with missing values. Journal of the American Statistical Association, 83, 1198-1202. doi:10.1080/01621459.1988 .10478722
38. Loeber, R., & Schmaling, K. B. (1985). Empirical evidence for overt and covert patterns of antisocial conduct problems. Journal of Abnormal Child Psychology, 13, 337-353. doi:10.1007/BF00910652
39. Meehl, P. E. (1954). Clinical versus statistical prediction: A theoretical analysis and a review of the evidence. Minneapolis: University of Minnesota Press. doi:10.1037/11281-000
40. National Institute of Mental Health. (2010). The National Institute of Mental Health Strategic Plan. Retrieved from http://www.nimh.nih.gov/ about/strategic-planning-reports/index.shtml
41. Nelson-Gray, R. O. (2003). Treatment utility of psychological assessment. Psychological Assessment, 15, 521-531. doi:10.1037/1040-3590.15.4 .521
42. Pellegrino, J. F., Singh, N. N., & Carmanico, S. J. (1999). Concordance among three diagnostic procedures for identifying depression in children and adolescents with EBD. Journal of Emotional and Behavioral Disorders, 7, 118-127. doi:10.1177/10634266990
43. Pilkonis, P. A., Heape, C. L., Ruddy, J., & Serrao, P. (1991). Validity in the diagnosis of personality disorders: The use of the LEAD standard. Psychological Assessment, 3, 46-54. doi:10.1037/1040-3590.3.1.46
44. Pogge, D. L., Wayland-Smith, D., Zaccario, M., Borgaro, S., Stokes, J., & Harvey, P. D. (2001). Diagnosis of manic episodes in adolescent inpatients: Structured diagnostic procedures compared to clinical chart diagnoses. Psychiatry Research, 101, 47-54. doi:10.1016/S0165-1781(00)00248-1
45. Powsner, S. M., & Tufte, E. R. (1994). Graphical summary of patient status. The Lancet, 344, 386-389. doi:10.1016/S0140-6736(94)91406-0
46. Ramirez Basco, M., Bostic, J. Q., Davies, D., Rush, A. J., Witte, B., Hendrickse, W., & Barnett, V. (2000). Methods to improve diagnostic accuracy in a community mental health setting. American Journal of Psychiatry, 157, 1599-1605. doi:10.1176/appi.ajp.157.10.1599
47. Regier, D. A., Narrow, W. E., Clarke, D. E., Kraemer, H. C., Kuramoto, S. J., Kuhl, E. A., & Kupfer, D. J. (2013). DSM-5 field trials in the United States and Canada: Part II: Test-retest reliability of selected categorical diagnoses. American Journal of Psychiatry, 170, 59-70
48. Rettew, D. C., Lynch, A. D., Achenbach, T. M., Dumenci, L., & Ivanova, M. Y. (2009). Meta-analyses of agreement between diagnoses made from clinical evaluations and standardized diagnostic interviews. International Journal of Methods in Psychiatric Research, 18, 169-184. doi:10.1002/mpr.289
49. Rey, J. M., Singh, M., Hung, S.-F., Dossetor, D. R., Newman, L., Plapp, J. M., & Bird, K. D. (1997). A global scale of measure the quality of the family environment. Archives of General Psychiatry, 54, 817-822. doi:10.1001/archpsyc.1997.01830210061
50. Sigel, B. A., Kramer, T. L., Conners-Burrow, N. A., Church, J. K., Worley, K. B., & Mitrani, N. A. (2013). Statewide dissemination of traumafocused cognitive-behavioral therapy (TF-CBT). Children and Youth Services Review, 35, 1023-1029. doi:10.1016/j.childyouth.2013.03.012
51. Spengler, P. M., White, M. J., Ãegisdottir, S., Maugherman, A. S., Anderson, L. A., Cook, R. S., Rush, J. D. (2007). The meta-analysis of clinical judgment project: Effects of experience on judgment accuracy. The Counseling Psychologist, 37, 350-399. doi:10.1177/ 00110000062
52. Spitzer, R. L. (1983). Psychiatric diagnosis: Are clinicians still necessary? Comprehensive Psychiatry, 24, 399-411. doi:10.1016/0010-440 X(83)90032-9
53. Suppiger, A., In-Albon, T., Hendriksen, S., Hermann, E., Margraf, J., & Schneider, S. (2009). Acceptance of structured diagnostic interviews for mental disorders in clinical practice and research settings. Behavior Therapy, 40, 272-279
54. Tabachnick, B. G., & Fidell, L. S. (2007). Using multivariate statistics (5th ed.). Boston, MA: Pearson Education. U.S. Census Bureau. (2008). State & county quickfacts: Cuyahoga County, OH. Retrieved January 25, 2008, from http://quickfacts.census.gov
55. Vitiello, B., Malone, R., Buschle, P. R., & Delaney, M. A. (1990). Reliability of DSM-III diagnoses of hospitalized children. Hospital & Community Psychiatry, 41, 63-67
56. Weinstein, S., Stone, K., Noam, G., Grimes, K., & Schwab-Stone, M. (1989). Comparison of DISC with clinicians' DSM-III diagnoses in psychiatric inpatients. Journal of the American Academy of Child & Adolescent Psychiatry, 28, 53-60. doi:10.1097/00004583-198901000-00010
57. Welner, Z., Reich, W., Herjanic, B., Jung, K. G., & Amado, H. (1987). Reliability, validity, and parent-child agreement studies of the Diagnostic Interview for Children and Adolescents (DICA). Journal of the American Academy of Child & Adolescent Psychiatry, 26, 649-653. doi:10.1097/00004583-198709000-00007
58. Young, J., Daleiden, E. L., Chorpita, B. F., Schiffman, J., & Mueller, C. W. (2007). Assessing stability between treatment planning documents in a system of care. Administration and Policy in Mental Health and Mental Health Services Research, 34, 530-539. doi:10.1007/s10488-007-0137-8
59. Youngstrom, E. A. (2013). Future directions in psychological assessment. Journal of Clinical Child and Adolescent Psychology, 42, 139-159. doi:10.1080/15374416.2012.736358
60. Youngstrom, E. A., Ackerman, B. P., & Izard, C. E. (1999). Dysphoriarelated bias in maternal ratings of children. Journal of Consulting and Clinical Psychology, 67, 905-916. doi:10.1037/0022-006X.67.6.905
61. Youngstrom, E. A., Choukas-Bradley, S., Calhoun, C. D., & Jensen-Doss, A. (in press). Clinical guide to the evidence-based assessment approach to diagnosis and treatment. Cognitive and Behavioral Practice
62. Youngstrom, E. A., Meyers, O. I., Demeter, C., Kogos Youngstrom, J., Morello, L., Piiparinen, R., Calabrese, J. R. (2005). Comparing diagnostic checklists for pediatric bipolar disorder in academic and community mental health settings. Bipolar Disorders, 7, 507-517
63. Youngstrom, E. A., Youngstrom, J. K., Freeman, A. J., De Los Reyes, A., Feeny, N. C., & Findling, R. L. (2011). Informants are not all equal: Predictors and correlates of clinician judgments about caregiver and youth credibility. Journal of Child and Adolescent Psychopharmacology, 21, 407-415. doi:10.1089/cap.2011.0032