Method matters: Understanding diagnostic reliability in DSM-IV and DSM-5

Journal of Abnormal Psychology

Volumn 124, Issue 3, 2015, Pages 764-769

  Chmielewski, Michael ^a   Clark, Lee Anna ^b   Michael Bagby, R ^c   Watson, David ^b  

^a SOUTHERN METHODIST UNIVERSITY   (United States)

^b UNIVERSITY OF NOTRE DAME   (United States)

^c UNIVERSITY OF TORONTO   (Canada)

Author keywords

Diagnosis; DSM 5; DSM IV; Reliability; SCID; Test Retest

Indexed keywords

ADULT; AGED; ARTICLE; AUDIO RECORDING; BIPOLAR I DISORDER; BIPOLAR II DISORDER; CLINICAL TRIAL (TOPIC); DIAGNOSTIC VALUE; DSM-5; DSM-IV; DYSTHYMIA; FEMALE; GENERALIZED ANXIETY DISORDER; HUMAN; INTERVIEW; MAJOR CLINICAL STUDY; MAJOR DEPRESSION; MALE; OBSESSIVE COMPULSIVE DISORDER; PANIC; PHOBIA; POSTTRAUMATIC STRESS DISORDER; PSYCHOSIS; SELF REPORT; SOCIAL PHOBIA; SUBSTANCE ABUSE; TEST RETEST RELIABILITY; VERY ELDERLY; ADOLESCENT; DIAGNOSTIC AND STATISTICAL MANUAL OF MENTAL DISORDERS; DIFFERENTIAL DIAGNOSIS; MENTAL DISORDERS; MIDDLE AGED; REPRODUCIBILITY; YOUNG ADULT;

ADOLESCENT; ADULT; AGED; AGED, 80 AND OVER; DIAGNOSIS, DIFFERENTIAL; DIAGNOSTIC AND STATISTICAL MANUAL OF MENTAL DISORDERS; FEMALE; HUMANS; MALE; MENTAL DISORDERS; MIDDLE AGED; REPRODUCIBILITY OF RESULTS; YOUNG ADULT;

EID: 84938997880     PISSN: 0021843X     EISSN: 19391846     Source Type: Journal    
DOI: 10.1037/abn0000069     Document Type: Article

References (24)

1. American Psychiatric Association. (1980). Diagnostic and statistical manual of mental disorders (3rd ed.). Washington, DC: Author.
2. American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders (4th ed., text rev.). Washington, DC: Author.
3. Blashfield, R. K., & Livesley, W. J. (1991). Metaphorical analysis of psychiatric classification as a psychological test. Journal of Abnormal Psychology, 100, 262-270. http://dx.doi.org/10.1037/0021-843X.100.3.262
4. Brown, T. A., Di Nardo, P. A., Lehman, C. L., & Campbell, L. A. (2001). Reliability of DSM-IV anxiety and mood disorders: Implications for the classification of emotional disorders. Journal of Abnormal Psychology, 110, 49-58. http://dx.doi.org/10.1037/0021-843X.110.1.49
5. Di Nardo, P. A., Brown, T. A., & Barlow, D. H. (1994). Anxiety Disorders Interview Schedule for DSM-IV: Lifetime version (ADIS-IV-L). San Antonia, TX: Psychological Corporation.
6. Di Nardo, P., Moras, K., Barlow, D. H., Rapee, R. M., & Brown, T. A. (1993). Reliability of DSM-III-R anxiety disorder categories. Using the Anxiety Disorders Interview Schedule-Revised (ADIS-R). Archives of General Psychiatry, 50, 251-256. http://dx.doi.org/10.1001/archpsyc.1993.01820160009001
7. First, M., Spitzer, R. L., Gibbon, M., & Williams, J. B. W. (2002). Structured clinical interview for DSM-IV-TR axis I disorders, research version, patient ed. (SCID-I/P). New York: Biometrics Research, New York State Psychiatric Institute.
8. Fleiss, J. L. (1981). Statistical methods for rates and proportions (2nd ed.). Hoboken, NJ: Wiley.
9. Frances, A. (2012, May 8). Newsflash from APA meeting: DSM-5 has flunked its reliability tests. Retrieved from http://www.huffingtonpost.com/allen-frances/DSM-5-reliability-tests_b_1490857.html
10. Klerman, G. L., Vaillant, G. E., Spitzer, R. L., & Michels, R. (1984). A debate on DSM-III. The American Journal of Psychiatry, 141, 539-553. http://dx.doi.org/10.1176/ajp.141.4.539
11. Kraemer, H. C., Kupfer, D. J., Clarke, D. E., Narrow, W. E., & Regier, D. A. (2012). DSM-5: How reliable is reliable enough? The American Journal of Psychiatry, 169, 13-15. http://dx.doi.org/10.1176/appi.ajp.2011.11010050
12. Markon, K. E., Chmielewski, M., & Miller, C. J. (2011). The reliability and validity of discrete and continuous measures of psychopathology: A quantitative review. Psychological Bulletin, 137, 856-879. http://dx.doi.org/10.1037/a0023678
13. McKenzie, D. P., Mackinnon, A. J., Péladeau, N., Onghena, P., Bruce, P. C., Clarke, D. M.,... McGorry, P. D. (1996). Comparing correlated kappas by resampling: Is one level of agreement significantly different from another? Journal of Psychiatric Research, 30, 483-492. http://dx.doi.org/10.1016/S0022-3956(96)00033-7
14. Nelson-Gray, R. O. (1991). DSM-IV: Empirical guidelines from psychometrics. Journal of Abnormal Psychology, 100, 308-315. http://dx.doi.org/10.1037/0021-843X.100.3.308
15. Regier, D. A., Narrow, W. E., Clarke, D. E., Kraemer, H. C., Kuramoto, S. J., Kuhl, E. A., & Kupfer, D. J. (2013). DSM-5 field trials in the United States and Canada: II. Test-retest reliability of selected categorical diagnoses. The American Journal of Psychiatry, 170, 59-70. http:// dx.doi.org/10.1176/appi.ajp.2012.12070999
16. Samuel, D. B., Hopwood, C. J., Ansell, E. B., Morey, L. C., Sanislow, C. A., Markowitz, J. C.,... Grilo, C. M. (2011). Comparing the temporal stability of self-report and interview assessed personality disorder. Journal of Abnormal Psychology, 120, 670-680. http://dx.doi.org/10.1037/a0022647
17. Spitzer, R. L., & Fleiss, J. L. (1974). A re-analysis of the reliability of psychiatric diagnosis. The British Journal of Psychiatry, 125, 341-347. http://dx.doi.org/10.1192/bjp.125.4.341
18. Spitzer, R. L., Forman, J. B., & Nee, J. (1979). DSM-III field trials: I. Initial interrater diagnostic reliability. The American Journal of Psychiatry, 136, 815-817. http://dx.doi.org/10.1176/ajp.136.6.815
19. Spitzer, R. L., Williams, J. B. W., & Endicott, J. (2012). Standards for DSM-5 reliability. The American Journal of Psychiatry, 169, 537. http:// dx.doi.org/10.1176/appi.ajp.2012.12010083
20. Watson, D., O'Hara, M. W., Chmielewski, M., McDade-Montez, E. A., Koffel, E., Naragon, K., & Stuart, S. (2008). Further validation of the IDAS: Evidence of convergent, discriminant, criterion, and incremental validity. Psychological Assessment, 20, 248 -259. http://dx.doi.org/ 10.1037/a0012570
21. Watson, D., O'Hara, M. W., Simms, L. J., Kotov, R., Chmielewski, M., McDade-Montez, E. A.,... Stuart, S. (2007). Development and validation of the Inventory of Depression and Anxiety Symptoms (IDAS). Psychological Assessment, 19, 253-268. http://dx.doi.org/10.1037/1040-3590.19.3.253
22. Williams, J. B. W., Gibbon, M., First, M. B., Spitzer, R. L., Davies, M., Borus, J.,... Wittchen, H. U. (1992). The structured clinical interview for DSM-III-R (SCID): II. Multisite test-retest reliability. Archives of General Psychiatry, 49, 630-636. http://dx.doi.org/10.1001/archpsyc.1992.01820080038006
23. Zanarini, M. C., Skodol, A. E., Bender, D., Dolan, R., Sanislow, C., Schaefer, E.,... Gunderson, J. G. (2000). The Collaborative Longitudinal Personality Disorders Study: Reliability of Axis I and II diagnoses. Journal of Personality Disorders, 14, 291-299. http://dx.doi.org/ 10.1521/pedi.2000.14.4.291
24. Zimmerman, M. (1994). Diagnosing personality disorders. A review of issues and research methods. Archives of General Psychiatry, 51, 225-245. http://dx.doi.org/10.1001/archpsyc.1994.03950030061006