Meta-analyses of agreement between diagnoses made from clinical evaluations and standardized diagnostic interviews

International Journal of Methods in Psychiatric Research

Volumn 18, Issue 3, 2009, Pages 169-184

  Rettew, David C ^a   Lynch, Alicia Doyle ^b   Achenbach, Thomas M ^a   Dumenci, Levent ^c   Ivanova, Masha Y ^a  

^a UNIVERSITY OF VERMONT COLLEGE OF MEDICINE   (United States)

^b TUFTS UNIVERSITY   (United States)

^c VIRGINIA COMMONWEALTH UNIVERSITY   (United States)

Author keywords

Clinical evaluations; Diagnosis; Meta analysis; Standardized diagnostic interviews (SDIs)

Indexed keywords

AGE DISTRIBUTION; ANOREXIA NERVOSA; ARTICLE; CLINICAL EVALUATION; CLINICAL TRIAL; DIAGNOSTIC ACCURACY; DIAGNOSTIC VALUE; EATING DISORDER; GENERALIZED ANXIETY DISORDER; HOSPITAL PATIENT; HUMAN; INTERMETHOD COMPARISON; META ANALYSIS; MOOD DISORDER; OUTPATIENT; STRUCTURED INTERVIEW; SYSTEMATIC REVIEW;

ADOLESCENT; CHILD; CHILD, PRESCHOOL; FEMALE; HUMANS; INTERVIEW, PSYCHOLOGICAL; MALE; PSYCHIATRIC STATUS RATING SCALES; PSYCHOTIC DISORDERS; REFERENCE VALUES; REGRESSION (PSYCHOLOGY); REPRODUCIBILITY OF RESULTS; RETROSPECTIVE STUDIES; YOUNG ADULT;

EID: 70350771286     PISSN: 10498931     EISSN: None     Source Type: Journal    
DOI: 10.1002/mpr.289     Document Type: Article

References (98)

1. Achenbach T.M., Krukowski R.A., Dumenci L., Ivanova M.Y. (2005) Assessment of adult psychopathology: meta-analyses and implications of cross-informant correlations. Psychological Bulletin, 131, 361-382. (Pubitemid 40688251)
2. Altman D.G. (1991) Practical Statistics for Medical Research, Chapman and Hall.
3. Alyahri A., Goodman R. (2006) Validation of the Arabic strengths and difficulties questionnaire and the development and well-being assessment. La Revue de Santé de la Méditerranée orientale, 12(Suppl. 2), 138-146.
4. American Psychiatric Association. (1980) Diagnostic and Statistical Manual of Mental Disorders (3rd ed.), American Psychiatric Association.
5. American Psychiatric Association. (1987) Diagnostic and Statistical Manual of Mental Disorders (3rd ed. rev.), American Psychiatric Association.
6. American Psychiatric Association. (1994) Diagnostic and Statistical Manual of Mental Disorders (4th ed.), American Psychiatric Association.
7. Angold A., Prendergast M., Cox A., Harrington R., Simonoff E., Rutter M. (1995) The Child and Adolescent Psychiatric Assessment (CAPA). Psychological Medicine, 25, 739-753.
8. Anthony J.C., Folstein M., Romanoski A.J., Von Korff M.R., Nestadt G.R., Chahal R., et al. (1985). Comparison of the lay diagnostic interview schedule and a standardized psychiatric diagnosis. Experience in Eastern Baltimore. Archives of General Psychiatry, 42, 667-675. (Pubitemid 15054611)
9. Balestrieri M., BisoffiG., Tansella M., Martucci M., Goldberg D.P. (2002) Identification of depression by medical and surgical general hospital physicians. General Hospital Psychiatry, 24, 4-11. (Pubitemid 34113726)
10. Beal D.J., Corey D.M., Dunlap W.P. (2002) On the bias of Huffcutt and Arthur's (1995) procedure for identifying outliers in the meta-analysis of correlations. Journal of Applied Psychology, 87, 583-589.
11. Brugha T.S., Bebbington P.E., Jenkins R. (1999) A difference that matters: comparisons of structured and semistructured psychiatric diagnostic interviews in the general population. Psychological Medicine, 29, 1013-1020.
12. Brugha T.S., Jenkins R., Taub N., Meltzer H., Bebbington P.E. (2001) A general population comparison of the Composite International Diagnostic Interview (CIDI) and the Schedules for Clinical Assessment in Neuropsychiatry (SCAN). Psychological Medicine, 31, 1001-1013. (Pubitemid 32725346)
13. Cohen J. (1960) A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20, 37-46.
14. Cohen P., O'Connor P., Lewis S., Velez C.N., Malachowski B. (1987) Comparison of DISC and K-SADS-P interviews of an epidemiological sample of children. Journal of the American Acadamy of Child and Adolescent Psychiatry, 26, 662-667.
15. Costello A.J. (1996) Structured interviewing. In: Child and Adolescent Psychiatry: A Comprehensive Textbook (ed. Lewis M.) (2nd ed.), pp. 457-464), Williams & Williams.
16. Dreessen L, Arntz A. (1999) Personality disorders have no excessively negative impact on therapist-rated therapy process in the cognitive and behavioural treatment of Axis I anxiety disorders. Clinical Psychology and Psychotherapy, 6, 384-394.
17. Endicott J., Spitzer R.L. (1978) A diagnostic interview: The Schedule for Affective Disorders and Schizophrenia. Archives of General Psychiatry, 35, 837-844. (Pubitemid 9076798)
18. Ezpeleta L., de la Osa N., Domenech J.M., Navarro J.B., Losilla J.M., Judez J. (1997) Diagnostic agreement between clinicians and the Diagnostic Interview for Children and Adolescents-DICA-R in an outpatient sample. Journal of Child Psychology and Psychiatry, 38, 431-440. (Pubitemid 27229284)
19. Field A.P. (2001) Meta-analysis of correlation coefficients: a Monte Carlo comparison of fixed- and random-effects methods. Psychological Methods, 6, 161-180.
20. First M.B., Spitzer R.L., Gibbon M., Williams J.B., Benjamin L.S. (1994) Structured Clinical Interview for DSM-IV Axis II Personality Disorders (SCID-II), version 2.0, Biometrics Research Department, New York State Psychiatric Institute.
21. Fisher R.A. (1970) Statistical Methods for Research Workers (14th ed.), Oliver & Boyd.
22. Fleiss J.L. (1981) Statistical Methods for Rates and Proportions (Vol. 2), Wiley.
23. Fridell M., Hesse M. (2006) Clinical diagnosis and SCID-II assessment of DSM-II-R personality disorders. European Journal of Psychological Assessment, 22, 104-108.
24. Füredi J., Rozsa S., Zambori J., Szadoczky E. (2003) The role of symptoms in the recognition of mental health disorders in primary care. Psychosomatics, 44, 402-406. (Pubitemid 37071927)
25. Gelfand D.M., Hartmann D.P. (1975) Child Behavior Analysis and Therapy, Pergamon.
26. Ghanizadeh A., Mohammadi M., Yazdanshenas A. (2006) Psychometric properties of the Farsi translation of the Kiddie Schedule for Affective Disorders and Schizophrenia - present and lifetime version. BMC Psychiatry, 6, 10, DOI: 10.1186/1471-244X-6-10 (Pubitemid 43983120)
27. Goodman R., Ford T., Richards H., Gatward R., Meltzer H. (2000) The development and well-being assessment: description and initial validation of an integrated assessment of child and adolescent psychopathology. Journal of Child Psychology and Psychiatry, 41, 645-655. (Pubitemid 30461904)
28. Guggenmoos-Holzmann I. (1995) Modeling covariate effects in observer agreement studies: the case of nominal scale agreement. Statistics in Medicine, 14, 2285-2286.
29. Gutterman E.M., O'Brien J.D., Young J.G. (1987) Structured diagnostic interviews for children and adolescents: current status and future directions. Journal of the American Academy of Child and Adolescent Psychiatry, 26, 621-630.
30. Härter M., Woll S., Reuter K., Wunsch A., Bengel J. (2004) Recognition of psychiatric disorders in musculoskeletal and cardiovascular rehabilitation patients. Archives of Physical Medicine and Rehabilitation, 85, 1192-1197. (Pubitemid 38962383)
31. Hedges L.V., Olkin I. (1985) Statistical Methods for Meta- Analysis, Academic Press.
32. Helzer J., Kraemer H., Krueger R.F., Wittchen H.U.,Sirovatka P.J., Regier D.A. (eds) (2008) Dimensional Approaches in Diagnostic Classification: Refining the Research Agenda for DSM-V, American Psychiatric Association.
33. Helzer J.E., Robins L.N., McEvoy L.T., Spitznagel E.L., Stoltzman R.K., Farmer A. et al. (1985) A comparison of clinical and diagnostic interview schedule diagnoses. Physician reexamination of lay-interviewed cases in the general population. Archives of General Psychiatry, 42, 657-666.
34. Hunter J.E., Schmidt F.L. (1990) Methods of Meta-Analysis: Correcting Error and Bias in Research Findings, Sage Publications.
35. Jensen A.L., Weisz J.R. (2002) Assessing match and mismatch between practitioner-generated and standardized interview-generated diagnoses for clinic-referred children and adolescents. Journal of Consulting and Clinical Psychology, 70, 158-168.
36. Jewell J., Handwerk M., Almquist J., Lucas C. (2004). Comparing the validity of clinician-generated diagnosis of conduct disorder to the Diagnostic Interview Schedule for Children. Journal of Clinical Child and Adolescent Psychology, 33, 536-546. (Pubitemid 39209997)
37. Jordanova V., Wickramesinghe C., Gerada C., Prince M. (2004) Validation of two survey diagnostic interviews among primary care attendees: a comparison of CIS-R and CIDI with SCAN ICD-10 diagnostic categories. Psychological Medicine, 34, 1013-1024. (Pubitemid 39199971)
38. Kadri N., Agoub M., Gnaoui S.E., Alami K.M., Hergueta T., Moussaoui D. (2005) Moroccan colloquial Arabic version of the Mini International Neuropsychiatric Interview (MINI): qualitative and quantitative validation. European Psychiatry, 20, 193-195. (Pubitemid 40409948)
39. Kampman O., Kiviniemi P., Koivisto E., Vaananen J., Kilkku N., Leinonen E., et al. (2004) Patient characteristics and diagnostic discrepancy in first-episode psychosis. Comprehensive Psychiatry, 45, 213-218. (Pubitemid 38656678)
40. Kaufman J., Birmaher B., Brent D., Rao U., Flynn C., Moreci P., et al. (1997) Schedule for Affective Disorders and Schizophrenia for School-Age Children-Present and Lifetime Version (K-SADS-PL): initial reliability and validity data. Journal of the American Academy of Child and Adolescent Psychiatry, 36, 980-988. (Pubitemid 27272932)
41. Kim Y.S., Choen K.A., Kim B.N., Chang S.A., Yoo H.J., Kim J.W., et al. (2004) The reliability and validity of the Kiddie-Schedule for Affective Disorders and Schizophrenia - present and lifetime version - Korean version (K-SADS-PL-K). Yonsei Medical Journal, 45, 81-89.
42. Klinkman M.S., Coyne J.C., Gallo S., Schwenk T.L. (1998) False positives, false negatives, and the validity of the diagnosis of major depression in primary care. Archives of Family Medicine, 7, 451-461. (Pubitemid 128435152)
43. Klinkman M.S., Schwenk T.L., Coyne J.C. (1997) Depression in primary care - more like asthma than appendicitis: the Michigan Depression Project. Canadian Journal of Psychiatry, 42, 966-973.
44. Kobak K.A., Taylor L.H., Dottl S.L., Greist J.H., Jefferson J.W., Burroughs D., et al. (1997) A computer-administered telephone interview to identify mental disorders. Journal of the American Medical Association, 278, 905-910. (Pubitemid 27492242)
45. Komiti A.A., Jackson H.J., Judd F.K., Cockram A.M., Kyrios M., Yeatman R., et al. (2001) A comparison of the Composite International Diagnostic Interview (CIDI-auto) with clinical assessment in diagnosing mood and anxiety disorders. Australian and New Zealand Journal of Psychiatry, 35, 224-230. (Pubitemid 32377542)
46. Kramer T.L., Robbins J.M., Phillips S.D., Miller T.L., Burns B.J. (2003) Detection and outcomes of substance use disorders in adolescents seeking mental health treatment. Journal of the American Academy of Child and Adolescent Psychiatry, 42, 1318-1326. (Pubitemid 39585992)
47. Kranzler H.R., Kadden R.M., Babor T.F., Rounsaville B.J. (1994) Longitudinal expert, all data procedure for psychiatric diagnosis in patients with psychoactive substance use disorders. Journal of Nervous and Mental Disease, 182, 277-283.
48. Krueger R.F., Markon K.E., Patrick C.J., Iacono W.G. (2005) Externalizing psychopathology in adulthood: a dimensional- spectrum conceptualization and its implications for DSM-V. Journal of Abnormal Psychology, 114, 537-550.
49. Landis J.R., Koch G.G. (1977) The measurement of observed agreement for categorical data. Biometrics, 33, 159-174.
50. Leckman J.F., Sholomskas D., Thompson W.D., Belanger A., Weissman M.M. (1982) Best estimate of lifetime psychiatric diagnosis: a methodological study. Archives of General Psychiatry, 39, 879-883. (Pubitemid 12042853)
51. Lecrubier Y., Weiller E. (1998) Characteristics, recognition and treatment of dysthymics in primary care. European Psychiatry, 13, 198-202. (Pubitemid 28365926)
52. Lewczyk C.M., Garland A.F., Hurlburt M.S., Gearity J., Hough R.L. (2003) Comparing DISC-IV and clinician diagnoses among youths receiving public mental health services. Journal of the American Academy of Child and Adolescent Psychiatry, 42, 349-356. (Pubitemid 39592092)
53. Loerch B., Szegedi A., Kohnen R., Benkert O. (2000) The primary care evaluation of mental disorders (PRIMEMD), German version: a comparison with the CIDI. Journal of Psychiatric Research, 34, 211-220. (Pubitemid 30364921)
54. Lowe B., Spitzer R.L., Grafe K., Kroenke K., Quenter A., Zipfel S., et al. (2004) Comparative validity of three screening questionnaires for DSM-IV depressive disorders and physicians' diagnoses. Journal of Affective Disorders, 78, 131-140. (Pubitemid 38045472)
55. Matarazzo J.D. (1983) The reliability of psychiatric and psychological diagnosis. Clinical Psychology Review, 3, 103-145.
56. McClellan J.M., Werry J.S. (2000) Research psychiatric diagnostic interviews for children and adolescents. Journal of the American Academy of Child and Adolescent Psychiatry, 39, 19-27. (Pubitemid 30029896)
57. McQuade W.H., Levy S.M., Yanek L.R., Davis S.W., Liepman M.R. (2000) Detecting symptoms of alcohol abuse in primary care settings. Archives of Family Medicine, 9, 814-821.
58. Moya T., Fleitlich-Bilyk B., Goodman R., Nogueira F.C., Focci P.S., Nicoletti M., et al. (2005) The eating disorders section of the Development and Well-Being Assessment (DAWBA): development and validation. Revista Brasileria Psiquitria, 27, 25-31. (Pubitemid 40477450)
59. Mullick M.S.I., Goodman R. (2005) The prevalence of psychiatric disorders among 5-10 year olds in rural, urban and slum areas in Bangladesh. Social Psychiatry and Psychiatric Epidemiology, 40, 663-671.
60. Muthén L.K., Muthén B.O. (2007) Mplus User's Guide (5th ed.), Muthén & Muthén.
61. North C.S., Pollio D.E., Thompson S.J., Ricci D.A., Smith E.M., Spitznagel E.L. (1997) A comparison of clinical and structured interview diagnoses in a homeless mental health clinic. Community Mental Health Journal, 33, 531-543.
62. Nussbeck F.W. (2005) Assessing multimethod association with categorical variables. In: Handbook of Multimethod Assessment in Psychology (eds Eid M., Diener E.), American Psychological Association.
63. Otsubo T., Tanaka K., Koda R., Shinoda J., Sano N., Tanaka S., et al. (2005) Reliability and validity of Japanese version of the Mini-International Neuropsychiatric Interview. Psychiatry and Clinical Neurosciences, 59, 517-526. (Pubitemid 41765747)
64. Pellegrino J.F., Singh N.N., Carmanico S.J. (1999) Concordance among three diagnostic procedures for identifying depression in children and adolescents with EBD. Journal of Emotional and Behavior Disorders, 7, 118-127.
65. Pini S., Perkonnig A., Tansella M., Wittchen H.U., Psich D. (1999) Prevalence and 12-month outcome of threshold and subthreshold mental disorders in primary care. Journal of Affective Disorders, 56, 37-48.
66. Ramirez Basco M., Bostic J.Q., Davies D., Rush A.J., Witte B., Hendrickse W., et al. (2000) Methods to improve diagnostic accuracy in a community mental health setting. American Journal of Psychiatry, 157, 1599-1605. (Pubitemid 30761031)
67. Regier D.A., Kaelber C.T., Rae D.S., Farmer M.E., Knauper B., Kessler R.C., et al. (1998) Limitations of diagnostic criteria and assessment instruments for mental disorders. Implications for research and policy. Archives of General Psychiatry, 55, 109-115. (Pubitemid 28087596)
68. Reich W. (2000) Diagnostic Interview for Children and Adolescents (DICA). Journal of the American Academy of Child and Adolescent Psychiatry, 39, 59-66. (Pubitemid 30029900)
69. Robins L.N., Barrett J.E. (1989) The Validity of Psychiatric Diagnoses, Raven Press.
70. Robins L.N., Helzer J.E., Croughan J., Ratcliff K.S. (1981) National Institute of Mental Health Diagnostic Interview Schedule. Its history, characteristics, and validity. Archives of General Psychiatry, 38, 381-389. (Pubitemid 11156022)
71. Rosenman S.J., Korten A.E., Levings C.T. (1997a) Computerised diagnosis in acute psychiatry: validity of CIDI-auto against routine clinical diagnosis. Journal of Psychiatric Research, 31, 581-592.
72. Rosenman S.J., Levings C.T., Korten A.E. (1997b) Clinical utility and patient acceptance of the computerized Composite International Diagnostic Interview. Psychiatric Services, 48, 815-820. (Pubitemid 27232882)
73. Rosenthal R. (1991) Meta-Analytic Procedures for Social Research, Sage Publications.
74. Shaffer D., Fisher P., Lucas C.P., Dulcan M.K., Schwab-Stone M.E. (2000) NIMH Diagnostic Interview Schedule for Children version IV (NIMH DISC-IV): description, differences from previous versions, and reliability of some common diagnoses. Journal of the American Academy of Child and Adolescent Psychiatry, 39, 28-38. (Pubitemid 30029897)
75. Shanee N., Apter A., Weizman A. (1997) Psychometric properties of the K-SADS-PL in an Israeli adolescent clinical population. Israel Journal of Psychiatry and Related Sciences, 34, 179-186. (Pubitemid 127756848)
76. Shear M.K., Greeno C., Kang J., Ludewig D., Frank E., Swartz H.A., et al. (2000) Diagnosis of nonpsychotic patients in community clinics. American Journal of Psychiatry, 157, 581-587. (Pubitemid 30191197)
77. Sheehan D.V., Lecrubier Y., Sheehan K.H., Amorim P., Janavs J., Weiller E., et al. (1998) The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. Journal of Clinical Psychiatry, 59(Suppl. 20), 22-33. (Pubitemid 29001829)
78. Spitzer R.L. (1983) Psychiatric diagnosis: are clinicians still necessary? Comprehensive Psychiatry, 24, 399-411.
79. Spitzer R.L., Williams J.B., Gibbon M., First M.B. (1992) The Structured Clinical Interview for DSM-III-R (SCID). I: history, rationale, and description. Archives of General Psychiatry, 49, 624-629.
80. Steiner J.L., Tebes J.K., Sledge W.H., Walker M.L. (1995) A comparison of the Structured Clinical Interview for DSM-III-R and clinical diagnoses. Journal of Nervous and Mental Diseases, 183, 365-369.
81. Strakowski S.M., Hawkins J.M., Keck P.E. Jr, McElroy S.L., West S.A., Bourne M.L., et al. (1997) The effects of race and information variance on disagreement between psychiatric emergency service and research diagnoses in first-episode psychosis. Journal of Clinical Psychiatry, 58, 457-463.
82. Szádóczky E., Rózsa S., Zámbori J., Füredi J. (2004) Anxiety and mood disorders in primary care practice. International Journal of Psychiatry in Clinical Practice, 8, 77-84. (Pubitemid 38833079)
83. Tenney N.H., Schotte C.K., Denys D.A., van Megen H.J., Westenberg H.G. (2003) Assessment of DSM-IV personality disorders in obsessive-compulsive disorder: comparison of clinical diagnosis, self-report questionnaire, and semi-structured interview. Journal of Personality Disorders, 17, 550-561.
84. Thornton C., Russell J., Hudson J. (1998) Does the Composite International Diagnostic Interview underdiagnose the eating disorders? International Journal of Eating Disorders, 23, 341-345. (Pubitemid 28134430)
85. Tiemens B.G., Ormel J., Simon G.E. (1996) Occurrence, recognition, and outcome of psychological disorders in primary care. American Journal of Psychiatry, 153, 636-644. (Pubitemid 26133615)
86. Tiemens B.G., VonKorff M., Lin E.H. (1999) Diagnosis of depression by primary care physicians versus a structured diagnostic interview. Understanding discordance. General Hospital Psychiatry, 21, 87-96.
87. van Marwijk H.W., de Bock G.H., Hermans J., Mulder J.D., Springer M.P. (1996) Prevalence of depression and clues to focus diagnosis. A study among Dutch general practice patients 65+ years of age. Scandinavian Journal of Primary Health Care, 14, 142-147. (Pubitemid 26296881)
88. Van Weel-Baumgarten E.M., Van Den Bosch W.J., Van Den Hoogen H.J., Zitman F.G. (2000) The validity of the diagnosis of depression in general practice: is using criteria for diagnosis as a routine the answer? British Journal of General Practitioners, 50, 284-287.
89. Weinstein S.R., Stone K., Noam G.G., Grimes K., Schwab- Stone M. (1989) Comparison of DISC with clinicians' DSM-III diagnoses in psychiatric inpatients. Journal of the American Academy of Child and Adolescent Psychiatry, 28, 53-60. (Pubitemid 19037879)
90. Welner Z., Reich W., Herjanic B., Jung K.G., Amado H. (1987) Reliability, validity, and parent-child agreement studies of the Diagnostic Interview for Children and Adolescents (DICA). Journal of the American Academy of Child and Adolescent Psychiatry, 26, 649-653.
91. Williams J.B., Gibbon M., First M.B., Spitzer R.L., Davies M., Borus J., et al. (1992) The Structured Clinical Interview for DSM-III-R (SCID). II. Multisite test-retest reliability. Archives of General Psychiatry, 49, 630-636.
92. Wittchen H.U. (1994) Reliability and validity studies of the WHO-Composite International Diagnostic Interview (CIDI): a critical review. Journal of Psychiatric Research, 28, 57-84. (Pubitemid 24146902)
93. Wittchen H.U., Üstün T.B., Kessler R.C. (1999) Diagnosing mental disorders in the community. A difference that matters? Psychological Medicine, 29, 1021-1027.
94. World Health Organization. (1978) Mental Disorders: Glossary and Guide to their Classification in Accordance with the Tenth Revision of the International Classification of Diseases (9th ed.), World Health Organization.
95. World Health Organization. (1992) Mental Disorders: Glossary and Guide to their Classification in Accordance with the Tenth Revision of the International Classification of Diseases (10th ed.), World Health Organization.
96. World Health Organization. (1990) CIDI - Core User Manual: Introduction and Question by Question Specification for the Composite International Diagnostic Interview (CIDI) (version 1.0, rev. 4), World Health Organization.
97. World Health Organization. (1994) Schedules for Clinical Assessment in Neuropsychiatry, version 2.0 (SCAN-2), World Health Organization.
98. Young J.G., O'Brien J.D., Gutterman E.M., Cohen P. (1987) Research on the clinical interview. Journal of the American Academy of Child and Adolescent Psychiatry, 26, 613-620.