When clinical description becomes statistical prediction

American Psychologist

Volumn 59, Issue 7, 2004, Pages 595-613

  Westen, Drew ^a   Weinberger, Joel ^b  

^a EMORY UNIVERSITY   (United States)

^b ADELPHI UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COGNITION; HUMAN; METHODOLOGY; PREDICTION AND FORECASTING; PSYCHIATRY; PSYCHOLOGY; REVIEW; STATISTICS;

COGNITION; HUMANS; PREDICTIVE VALUE OF TESTS; PSYCHIATRY; PSYCHOLOGY;

EID: 4544280328     PISSN: 0003066X     EISSN: None     Source Type: Journal    
DOI: 10.1037/0003-066X.59.7.595     Document Type: Review

References (135)

1. Achenbach, T. M. (1991). Manual for the Child Behavior Checklist/4-18 and 1991 Profile. Burlington: University of Vermont, Department of Psychiatry.
2. American Psychiatric Association. (1952). Diagnostic and statistical manual of mental disorders (1st ed.). Washington, DC: Author.
3. American Psychiatric Association. (1994). Diagnostic and statistical manual of mental disorders (4th ed.). Washington, DC: Author.
4. American Psychological Society Observer. (2003). In appreciation: Paul E. Meehl (1920-2003). Observer, 12, 13.
5. Barber, B. (1961). Resistance by scientists to scientific discovery. Science, 134, 596-602.
6. Basco, M. R., Bostic, J. Q., Davies, D., Rush, A. J., Witte, B., Hendrickse, W., et al. (2000). Methods to improve diagnostic accuracy in a community mental health setting. American Journal of Psychiatry, 157, 1599-1605.
7. Beck, A. T., Steer, R. A., & Brown, G. K. (1996). Manual for the Beck Depression Inventory - II. San Antonio, TX: Psychological Corporation.
8. Bernstein, D. P., Cohen, P., Skodol, A., Bezirganian, S., & Brook, J. S. (1996). Childhood antecedents of adolescent personality disorders. American Journal of Psychiatry, 153, 907-913.
9. Betan, E., Heim, A., Zittel, C., & Westen, D. (2004). The structure of countertransference phenomena in psychotherapy: An empirical investigation. Unpublished manuscript, Emory University.
10. Block, J. (1971). Lives through time. Berkeley, CA: Bancroft.
11. Block, J. (1978). The Q-sort method in personality assessment and psychiatric research. Palo Alto, CA: Consulting Psychologists Press.
12. Block, J. (1995). A contrarian view of the Five-Factor approach to personality descriptions. Psychological Bulletin, 117, 187-215.
13. Block, J., & Block, J. H. (1981). Studying situational dimensions: A grand perspective and some limited empiricism. In D. M. Magnusson (Ed.), Toward a psychology of situations: An interactional perspective (pp. 85-103). Hillsdale, NJ: Erlbaum.
14. Bradley, R., Hilsenroth, M., & Westen, D. (2003). Validity of SWAP-200 personality diagnosis in an outpatient sample. Unpublished manuscript, Emory University.
15. Brammer, R. (2002). Effects of experience and training on diagnostic accuracy. Psychological Assessment, 14, 110-113.
16. Butcher, J. N., Dahlstrom, W. G., Graham, J. R., Tellegen, A. M., & Kaemmer, B. (1989). MMPI-2: Manual for administration and scoring. Minneapolis: University of Minnesota.
17. Caspi, A. (1998). Personality development across the life span. In W. Damon (Series Ed.) & N. Eisenberg (Vol. Ed.), Handbook of child psychology: Vol. 3. Social emotional, personality development (pp. 311-388). New York: Wiley.
18. Cassidy, J., & Shaver, P. R. (1999). Handbook of attachment: Theory, research, and clinical applications. New York: Guilford Press.
19. Chapman, L. J., & Chapman, J. P. (1967). Genesis of popular but erroneous psychodiagnostic observations. Journal of Abnormal Psychology, 72, 193-204.
20. Cleckley, H. (1941). The mask of sanity. St. Louis, MO: Mosby.
21. Clifton, A., Turkheimer, E., & Oltmanns, T. F. (2003). Self and peer perspectives on pathological personality traits and interpersonal problems. Unpublished manuscript, University of Virginia.
22. Colvin, R., Block, J., & Funder, D. (1995). Overly positive self-evaluations and personality: Negative implications for mental health. Journal of Personality and Social Psychology, 68, 1152-1162.
23. Cousineau, T. M. (1997). Psychological predictors of health service utilization in college students. Unpublished doctoral dissertation, Adelphi University.
24. Cronbach, L. J., Rajaratnam, N., & Gleser, G. C. (1964). Theory of generalizability: A liberalization of reliability theory. British Journal of Statistical Psychology, 16, 137-163.
25. Dawes, R. M., Faust, D., & Meehl, P. E. (1989). Clinical versus actuarial judgment. Science, 243, 1668-1674.
26. Dozier, M., & Kobak, R. (1992). Psychophysiology in attachment interviews: Converging evidence for deactivating strategies. Child Development, 63, 1473-1480.
27. Dutra, L., Campbell, L., & Westen, D. (2004). Quantifying clinical judgment in the assessment of adolescent psychopathology: Reliability, validity, and factor structure of the Child Behavior Checklist for Clinician-Report. Journal of Clinical Psychology, 60, 65-85.
28. Epstein, S. (1986). Does aggregation produce spuriously high estimates of behavior stability? Journal of Personality and Social Psychology, 50, 1199-1210.
29. Epstein, S. (1992). Coping ability, negative self-evaluation, and overgeneralization: Experiment and theory. Journal of Personality and Social Psychology, 62, 826-836.
30. Fiedler, E., Oltmanns, T., & Turkheimer, E. (in press). Traits associated with personality disorders and adjustment to military life: Predictive validity of self and peer reports. Military Psychology.
31. First, M. B., Spitzer, R. L., Gibbon, M., & Williams, J. B. W. (1997). Structured Clinical Interview for DSM-IV personality disorders (SCID-II). Washington, DC: American Psychiatric Press.
32. Fonagy, P., Steele, H., & Steele, M. (1991). Maternal representations of attachment during pregnancy predict the organization of infant-mother attachment at one year of age. Child Development, 62, 891-905.
33. Garb, H. N. (1998). Studying the clinician: Judgment research and psychological assessment. Washington, DC: American Psychological Association.
34. Garb, H. N., Wood, J. M., Nezworski, M. T., & Grove, W. M. (2001). Toward a resolution of the Rorschach controversy. Psychological Assessment, 13, 433-448.
35. Gilbert, D. T., & Ebert, J. E. J. (2002). Decisions and revisions: The affective forecasting of changeable outcomes. Journal of Personality and Social Psychology, 82, 502-514.
36. Goldberg, L. R. (1991). Human mind versus regression equation: Five contrasts. In D. Cicchetti & W. M. Grove (Eds.), Thinking clearly about psychology: Essays in honor of Paul E. Meehl (Vol. 1, pp. 173-184). Minneapolis: University of Minnesota Press.
37. Greenbaum, P. E., & Dedrick, R. F. (1998). Hierarchical confirmatory factor analysis of the Child Behavior Checklist/4-18. Psychological Assessment, 10, 149-155.
38. Greenwald, A. G., Pratkanis, A. R., Leippe, M. R., & Baumgardner, M. H. (1986). Under what conditions does theory obstruct research progress. Psychological Review, 93, 216-229.
39. Grilo, C. M., McGlashan, T. H., Quinlan, D. M., Walker, M., Greenfeld, D., & Edell, W. (1998). Frequency of personality disorders in two age cohorts of psychiatry inpatients. American Journal of Psychiatry, 155, 140-142.
40. Grove, W. M., & Meehl, P. E. (1996). Comparative efficiency of informal (subjective, impressionistic) and formal (mechanical, algorithmic) prediction procedures: The clinical-statistical controversy. Psychology, Public Policy, and Law, 2, 293-323.
41. Grove, W. M., Zald, D. H., Lebow, B. S., Snitz, B. E., & Nelson, C. (2000). Clinical versus mechanical prediction: A meta-analysis. Psychological Assessment, 12, 19-30.
42. Hare, R. D. (1999). Psychopaths and their nature: Implications for the mental health and criminal justice systems. In T. Millon & E. Simonsen (Eds.), Psychopathy: Antisocial, criminal, and violent behavior (pp. 188-212). New York: Guilford Press.
43. Hare, R. D., Harpur, T. J., Hakstian, A. R., Forth, A. E., Hart, S. D., & Newman, J. P. (1990). The revised Psychopathy Checklist: Reliability and factor structure. Psychological Assessment: A Journal of Consulting and Clinical Psychology, 2, 338-341.
44. Hare, R. D., Hart, S. D., & Harpur, T. J. (1991). Psychopathy and the DSM-IV criteria for antisocial personality disorder. Journal of Abnormal Psychology, 100, 391-398.
45. Harkness, A. R., Tellegen, A., & Waller, N. (1995). Differential convergence of self-report and informant data for Multidimensional Personality Questionnaire traits: Implications for the construct of negative emotionality. Journal of Personality Assessment, 64, 185-204.
46. Heim, A., & Westen, D. (2002). Subclinical Cognitive Disturbance Inventory. Unpublished manual, Emory University. Available from www.psychsystems.net/lab
47. Hiller, J. B., Rosenthal, R., Bornstein, R. F., Berry, D. T. R., & Brunell-Neuleib, S. (1999). A comparative meta-analysis of Rorschach and MMPI validity. Psychological Assessment, 11, 278-296.
48. Holt, R. (1958). Clinical and statistical prediction: A reformulation and some new data. Journal of Abnormal and Social Psychology, 56, 1-12.
49. Horowitz, L. M., Rosenberg, S. E., Baer, B. A., Ureno, G., & Billasenor. (1988). Inventory of Interpersonal Problems: Psychometric properties and clinical applications. Journal of Consulting and Clinical Psychology, 56, 885-892.
50. John, O. P., & Robins, R. W. (1994). Accuracy and bias in self-perception: Individual differences in self-enhancement and the role of narcissism. Journal of Personality and Social Psychology, 66, 206-219.
51. Johnston, M. H., & Holzman, P. S. (1979). Assessing schizophrenic thinking. San Francisco: Jossey-Bass.
52. Kahneman, D., & Tversky, A. (1973). On the psychology of prediction. Psychological Review, 80, 237-251.
53. Kahneman, D., & Tversky, A. (2000). Choice, values, and frames. New York: Cambridge University Press.
54. Klonsky, E. D., Oltmanns, T. F., & Turkheimer, E. (2002). Informant-reports of personality disorder: Relation to self-reports and future research directions. Clinical Psychology: Science & Practice, 9, 300-311.
55. Kranzler, H., Kadden, R., Babor, T., Tennen, H., & Rounsaville, B. (1996). Validity of the SCID in substance abuse patients. Addiction, 91, 859-868.
56. Kuhn, T. (1962). The structure of scientific revolutions. Chicago: University of Chicago Press.
57. Kunda, Z. (1990). The case for motivated reasoning. Psychological Bulletin, 108, 480-498.
58. Levy, K. N., Becker, D. F., Grilo, C. M., Mattanah, J., Garnet, K. E., Quinlan, D. M., et al. (1999). Concurrent and predictive validity of the personality disorder diagnosis in adolescent patients. American Journal of Psychiatry, 156, 1522-1528.
59. Lewicki, P. (1986). Processing information about covariations that cannot be articulated. Journal of Experimental Psychology: Learning, Memory, and Cognition, 12, 135-146.
60. Loevinger, J., & Wessler, R. (1970). Measuring ego development: Construction and use of a Sentence Completion Test (Vol. 1). San Francisco: Jossey-Bass.
61. Lorenz, A. R., & Newman, J. P. (2002). Utilization of emotion cues in male and female offenders with antisocial personality disorder: Results from a lexical decision task. Journal of Abnormal Psychology, 111, 513-516.
62. Luborsky, L., Diguer, L., Seligman, D. A., Rosenthal, R., Krause, E. D., Johnson, S., et al. (1999). The researcher's own therapy allegiances: A "wild card" in comparisons of treatment efficacy. Clinical Psychology: Science and Practice, 6, 95-106.
63. Ludolph, P., Westen, D., Misle, B., Jackson, A., Wixom, J., & Wiss, F. C. (1990). The borderline diagnosis in adolescents: Symptoms and developmental history. American Journal of Psychiatry, 147, 470-476.
64. Main, M., Kaplan, N., & Cassidy, J. (1985). Security in infancy, childhood, and adulthood: A move to the level of representation. Monographs of the Society for Research in Child Development 50(1-2, Serial No. 209).
65. Marin-Avellan, L., McGauley, G., Campbell, C., & Fonagy, P. (2004, February). Using the SWAP-200 in a personality-disordered forensic population: Is it valid, reliable and useful? Paper presented at the annual Conference of the British and Irish Group for the Study of Personality Disorders, Cardiff, UK.
66. McAdams, D. (1992). The Five-Factor model in personality: A critical appraisal. Journal of Personality, 60, 329-361.
67. McClelland, D. C. (1985). Human motivation. Glenview, IL: Scott, Foresman.
68. McClelland, D. C., Koestner, R., & Weinberger, J. (1989). How do self-attributed and implicit motives differ? Psychological Review, 96, 690-702.
69. McFall, R. (1991). Manifesto for a science of clinical psychology. The Clinical Psychologist, 44, 75-88.
70. McReynolds, P. (1987). Lightner Witmer: Little-known founder of clinical psychology. American Psychologist, 42, 849-858.
71. Mechl, P. E. (1954). Clinical vs. statistical prediction. Minneapolis: University of Minnesota Press.
72. Meehl, P. (1959). Some ruminations on the validation of clinical procedures. Canadian Journal of Psychology, 13, 106-128.
73. Meehl, P. E. (1960). The cognitive activity of the clinician. American Psychologist, 15, 19-27.
74. Meehl, P. (1973). Why I do not attend case conferences. In P. Meehl (Ed.), Psychodiagnostics: Selected papers (pp. 225-302). New York: Norton.
75. Meehl, P. E. (1978). Theoretical risks and tabular asterisks: Sir Karl, Sir Ronald, and the slow progress of soft psychology. Journal of Consulting and Clinical Psychology, 46, 806-834.
76. Mischel, W. (1968). Personality and assessment. New York: Wiley.
77. Moffitt, T. E., Caspi, A., Harrington, H., & Milne, B. J. (2002). Males on the life-course-persistent and adolescence-limited antisocial pathways: Follow-up at age 26 years. Development and Psychopathology, 14, 179-207.
78. Morey, L. C. (1991). The Personality Assessment Inventory: Professional manual. Odessa, FL: Psychological Assessment Resources.
79. Nicholls, J. G., Licht, B. G., & Pearl, R. A. (1982). Some dangers of using personality questionnaires to study personality. Psychological Bulletin, 92, 572-580.
80. Nisbett, R. E., & Ross, L. (1980). Human inference: Strategies and shortcomings of social judgment. Englewood Cliffs, NJ: Prentice-Hall.
81. Nisbett, R. E., & Wilson, T. D. (1977). Telling more than we can know: Verbal reports on mental processes. Psychological Review, 84, 231-259.
82. Novotny, C., Eddy, K., & Westen, D. (2004). Impulsivity in eating disorders treated in the community. Unpublished manuscript, Emory University.
83. Paulhus, D. L., Fridhandler, B., & Hayes, S. (1997). Psychological defense: Contemporary theory and research. In R. Hogan, J. Johnson, & S. Briggs, Handbook of personality psychology (pp. 543-579). New York: Academic Press.
84. Perry, J. C. (1992). Problems and considerations in the valid assessment of personality disorders. American Journal of Psychiatry, 149, 1645-1653.
85. Pilkonis, P. A., Heape, C. L., Proietti, J. M., Clark, S. W., McDavid, J. D., & Pitts, T. E. (1995). The reliability and validity of two structured diagnostic interviews for personality disorders. Archives of General Psychiatry, 52, 1025-1033.
86. Pilkonis, P. A., Heape, C. L., Ruddy, J., & Serrao, P. (1991). Validity in the diagnosis of personality disorders: The use of the LEAD standard. Psychological Assessment, 31, 46-54.
87. Porcerelli, J. H., Cogan, R., & Hibbard, S. (2004). Personality characteristics of partner violent men: A Q-sort approach. Journal of Personality Disorders, 18, 151-162.
88. Ready, R. E., Watson, D., & Clark, L. A. (2002). Psychiatric patient- and informant-reported personality: Predicting concurrent and future behavior. Assessment, 9, 361-372.
89. Reber, A. (1992). The cognitive unconscious: An evolutionary perspective. Consciousness and Cognition, 1, 93-133.
90. Robins, R. W., John, O., Caspi, A., Moffitt, T. E., & Stouthamer-Loeber, M. (1996). Resilient, overcontrolled, and undercontrolled boys: Three replicable personality types. Journal of Personality and Social Psychology, 70, 157-171.
91. Rosenthal, R., & DiMatteo, M. R. (2000). Meta analysis: Recent developments in quantitative methods for literature reviews. Annual Review of Psychology, 52, 59-82.
92. Rosnow, R. L., & Rosenthal, R. (1991). If you're looking at the cell means, you're not looking at only the interaction (unless all main effects are zero). American Psychologist, 110, 574-576.
93. Rubin, D. B., Wallace, W., & Houston, B. (1993). The beginnings of expertise for ballads. Cognitive Science, 17, 435-462.
94. Russ, E., Heim, A., & Westen, D. (2003). Parental bonding and personality pathology assessed by clinician report. Journal of Personality Disorders, 17, 522-536.
95. Sarbin, T. R. (1962). The present status of the clinical-statistical prediction problem. Anthropology and Medicine, 10, 315-323.
96. Sawyer, J. (1966). Measurement and prediction, clinical and statistical. Psychological Bulletin, 66, 178-200.
97. Schwartz, N. (1999). Self-reports: How the questions shape the answers. American Psychologist, 54, 93-105.
98. Segal, D. L., Corcoran, J., & Coughlin, A. (2002). Diagnosis, differential diagnosis, and the SCID. In M. Hersen & L. K. Porzelius (Eds.), Diagnosis, conceptualization, and treatment planning for adults: A step-by-step guide (pp. 13-34). Mahwah, NJ: Erlbaum.
99. Shedler, J., Mayman, M., & Manis, M. (1993). The illusion of mental health. American Psychology, 48, 1117-1131.
100. Shedler, J., Mayman, M., & Manis, M. (1994). More illusions. American Psychologist, 49, 974-976.
101. Shedler, J., & Westen, D. (1998). Refining the measurement of Axis II: A Q-sort procedure for assessing personality pathology. Assessment, 5, 333-353.
102. Shedler, J., & Westen, D. (2004). Refining DSM-IV personality disorder diagnosis: Integrating science and practice. American Journal of Psychiatry, 161, 1-16.
103. Shedler, J., & Westen, D. (in press). Dimensions of personality pathology: An alternative to the Five Factor Model. American Journal of Psychiatry.
104. Smith, C. P., Atkinson, J. W., McClelland, D. C., & Veroff, J. (Eds.). (1992). Motivation and personality: Handbook of thematic content analysis. New York: Cambridge University Press.
105. Spence, M. A., Greenberg, D. A., Hodge, S. E., & Vieland, V. J. (2003). The emperor's new methods. American Journal of Human Genetics, 72, 1084-1087.
106. Spitzer, R. L. (1983). Psychiatric diagnosis: Are clinicians still necessary? Comprehensive Psychiatry, 24, 399-411.
107. Spitzer, R. L., Endicott, J., & Robins, E. (1975). Clinical criteria for psychiatric diagnosis and DSM-III. American Journal of Psychiatry, 132, 1187-1192.
108. Stricker, G., & Trierweiler, S. J. (1995). The local clinical scientist: A bridge between science and practice. American Psychologist, 50, 995-1002.
109. Strube, M. J. (2000). Reliability and generalizability theory. In L. G. Grimm & P. R. Yarnold (Eds.), Reading and understanding MORE multivariate statistics (pp. 23-66). Washington, DC: American Psychological Association.
110. Tanaka, J. W., & Taylor, M. (1991). Object categories and expertise: Is the basic level in the eye of the beholder? Cognitive Psychology, 23, 457-482.
111. Tavris, C. (2003). Mind games: Psychological warfare between therapists and scientists. Chronicle of Higher Education, 49, B47.
112. Thomas, C., Turkheimer, E., & Oltmanns, T. F. (2003). Factorial structure of pathological personality as evaluated by peers. Journal of Abnormal Psychology, 112, 81-91.
113. Weinberger, J. (in press). The rediscovery of the unconscious. New York: Guilford Press.
114. Westen, D. (1988). Official and unofficial data. New Ideas in Psychology, 6, 323-331.
115. Westen, D. (1995). A clinical-empirical model of personality: Life after the Mischelian ice age and the NEO-lithic era. Journal of Personality, 63, 495-524.
116. Westen, D. (1996). A model and a method for uncovering the nomothetic from the idiographic: An alternative to the Five-Factor Model? Journal of Research in Personality, 30, 400-413.
117. Westen, D. (1997). Divergences between clinical and research methods for assessing personality disorders: Implications for research and the evolution of Axis II. American Journal of Psychiatry, 154, 895-903.
118. Westen, D. (1998). The scientific legacy of Sigmund Freud: Toward a psychodynamically informed psychological science. Psychological Bulletin, 124, 333-371.
119. Westen, D. (2002). Clinical Diagnostic Interview. Unpublished manual, Emory University. Available from www.psychsystems.net/lab
120. Westen, D., Feit, A., & Zittel, C. (1999). Methodological issues in research using projective techniques. In P. C. Kendall, J. N. Butcher, & G. Holmbeck (Eds.), Handbook of research methods in clinical psychology (2nd ed., pp. 224-240). New York: Wiley.
121. Westen, D., & Harnden-Fischer, J. (2001). Personality profiles in eating disorders: Rethinking the distinction between Axis I and Axis II. American Journal of Psychiatry, 165, 547-562.
122. Westen, D., & Muderrisoglu, S. (2003). Reliability and validity of personality disorder assessment using a systematic clinical interview: Evaluating an alternative to structured interviews. Journal of Personality Disorders, 17, 350-368.
123. Westen, D., Muderrisoglu, S., Fowler, C., Shedler, J., & Koren, D. (1997). Affect regulation and affective experience: Individual differences, group differences, and measurement using a Q-sort procedure. Journal of Consulting and Clinical Psychology, 65, 429-439.
124. Westen, D., Novotny, C., & Thompson-Brenner, H. (2004). The empirical status of empirically supported therapies: Assumptions, methods, and findings. Psychological Bulletin, 130, 631-663.
125. Westen, D., & Shedler, J. (1999a). Revising and assessing Axis II, Part 1: Developing a clinically and empirically valid assessment method. American Journal of Psychiatry, 156, 258-272.
126. Westen, D., & Shedler, J. (1999b). Revising and assessing Axis II, Part 2: Toward an empirically based and clinically useful classification of personality disorders. American Journal of Psychiatry, 156, 273-285.
127. Westen, D., Shedler, J., Durrett, C., Glass, S., & Martens, A. (2003). Personality diagnosis in adolescence: DSM-IV Axis II diagnoses and an empirically derived alternative. American Journal of Psychiatry, 160, 952-966.
128. Westen, D., & Weinberger, J. (in press). In praise of clinical judgment: Meehl's forgotten legacy. Journal of Clinical Psychology.
129. Wiggins, J. (1973). Personality and prediction: Principles of personality assessment. Reading, MA: Addison-Wesley.
130. Wilberg, T., Dammen, T., & Friis, S. (2000). Comparing personality diagnostic questionnaire-4+ with longitudinal, expert, all data (LEAD) standard diagnoses in a sample with a high prevalence of Axis I and Axis II disorders. Comprehensive Psychiatry, 41, 295-302.
131. Wilkinson-Ryan, T., & Westen, D. (2000). Identity disturbance in borderline personality disorder: An empirical investigation. American Journal of Psychiatry, 157, 528-541.
132. Williams, J. M., Mathews, A., & MacLeod, C. (1996). The emotional Stroop task and psychopathology. Psychological Bulletin, 120, 3-24.
133. Wilson, T. D., Lindsey, S., & Schooler, T. Y. (2000). A model of dual attitudes. Psychological Review, 107, 101-126.
134. Wood, J. M., Garb, H. N., Lilienfeld, S. O., & Nezworski, M. (2002). Clinical assessment. Annual Review of Psychology, 53, 519-543.
135. Zittel, C., & Westen, D. (in press). Borderline personality disorder as seen in clinical practice: Implications for DSM-V. American Journal of Psychiatry.