Failure of Rorschach-comprehensive-system-based testimony to be admissible under the Daubert-Joiner-Kumho standard

Psychology, Public Policy, and Law

Volumn 8, Issue 2, 2002, Pages 216-234

  Grove, William M ^a   Barden, R Christopher ^b   Garb, Howard N ^c,e   Lilienfeld, Scott O ^d  

^a UNIVERSITY OF MINNESOTA   (United States)

^b National Association for Consumer Protection in Mental Health Practices   (United States)

^c UNIVERSITY OF PITTSBURGH   (United States)

^d EMORY UNIVERSITY   (United States)

^e UNIVERSITY OF PITTSBURGH SCHOOL OF MEDICINE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 23044535002     PISSN: 10768971     EISSN: None     Source Type: Journal    
DOI: 10.1037/1076-8971.8.2.216     Document Type: Article

References (91)

1. Acklin, M. W., McDowell, C. J., Verschell, M. S., & Chan, D. (2000). Interobserver agreement, intraobserver reliability, and the Rorschach Comprehensive System. Journal of Personality Assessment, 74, 15-47.
2. American Psychological Association. (1992). Ethical principles of psychologists and code of conduct. American Psychologist, 47, 1597-1611.
3. Archer, R. P., & Gordon, R. A. (1988). MMPI and Rorschach indices of schizophrenic and depressive diagnoses among adolescent inpatients. Journal of Personality Assessment, 52, 276-287.
4. Archer, R. P., & Krishnamurthy, R. (1997). MMPI-A and Rorschach indices related to depression and conduct disorder: An evaluation of the incremental validity hypothesis. Journal of Personality Assessment, 69, 517-533.
5. Aronow, E. (2001). CS norms, psychometrics, and possibilities for the Rorschach technique. Clinical Psychology: Science and Practice, 8, 383-385.
6. Ball, J. D., Archer, R. P., Gordon, R. A., & French, J. (1991). Rorschach depression indices with children and adolescents: Concurrent validity findings. Journal of Personality Assessment, 57, 465-476.
7. Barden, R. C. (2001a). Informed consent in psychotherapy: A multidisciplinary perspective. The Journal of the American Academy of Psychiatry and the Law, 29, 160-166.
8. Barden, R. C. (2001b, May 11). Science intensive litigation: Protecting the integrity of the legal system from pseudoscientific "expert" testimony. Invited address to the national meeting of the American Bar Association Litigation Section, Phoenix, AZ.
9. Bornstein, R. F. (1999). Criterion validity of objective and projective dependency tests: A meta-analytic assessment of behavioral prediction. Psychological Assessment, 11, 48-57.
10. Burns, B., & Viglione, D. J. (1996). The Rorschach Human Experience variable, interpersonal relatedness, and object representation in nonpatients. Psychological Assessment, 8, 92-99.
11. Butcher, J. N., Dahlstrom, W. G., Graham, J. R., Tellegen, A., & Kaemmer, B. (1989). Minnesota Multiphasic Personality Inventor)-II (MMPI-2): Manual for administration and scoring. Minneapolis: University of Minnesota Press.
12. Caine, S. L., Frueh, B. C., & Kinder, B. N. (1995). Rorschach susceptibility to malingered depressive disorders in adult females. In J. N. Butcher & C. D. Spielberger (Eds.), Advances in personality assessment (Vol. 10, pp. 165-174). Hillsdale, NJ: Erlbaum.
13. Carlson, C. F., Kula, M. L., & St. Laurent, C. M. (1997). Rorschach revised DEPI and CDI with inpatient major depressives and borderline personality disorder with major depression: Validity issues. Journal of Clinical Psychology, 53, 51-58.
14. Carter, C. L., & Dacey, C. M. (1996). Validity of the Beck Depression Inventory, MMPI, and Rorschach in assessing adolescent depression. Journal of Adolescence, 19, 223-231.
15. Conners, K. (1989). Manual for Conners' rating scales. North Tonawanda, NY: Multi-Health Systems.
16. Daubert v. Merrell Dow Pharmaceuticals, Inc., 509 U. S., 113 S. Ct. 2786 (1993).
17. Exner, J. E. (1974). The Rorschach: A comprehensive system. Vol. 1: Basic foundations. New York: Wiley.
18. Exner, J. E. (1978). The Rorschach: A comprehensive system. Vol. 2: Interpretation. New York: Wiley.
19. Exner, J. E. (1986). The Rorschach: A comprehensive system. Vol. I: Basic foundations (2nd ed.). New York: Wiley.
20. Exner, J. E. (1991). The Rorschach: A comprehensive system. Vol. 2: Interpretation (2nd ed.). New York: Wiley.
21. Exner, J. E. (1993). The Rorschach: A comprehensive system. Vol. 1: Basic foundations (3rd ed.). New York: Wiley.
22. Exner, J. E. (1995). Comment on "Narcissism in the Comprehensive System for the Rorschach." Clinical Psychology: Science and Practice, 2, 200-206.
23. Exner, J. E. (2001a). A comment on "The misperception of psychopathology: Problems with the norms of the Comprehensive System for the Rorschach." Clinical Psychology: Science and Practice, 8, 386-388.
24. Exner, J. E. (2001b). A Rorschach workbook for the Comprehensive System (5th ed.). Asheville, NC: Rorschach Workshops.
25. Exner, J. E., & Weiner, I. B. (1982). The Rorschach: A comprehensive system. Vol. 3: Assessment of children and adolescents. New York: Wiley.
26. Exner, J. E., & Weiner, I. B. (1995). The Rorschach: A comprehensive system. Vol. 3: Assessment of children and adolescents (2nd ed.). New York: Wiley.
27. Frye v. United States, 293 F. 1013, D. C. Cir. (1923).
28. Gacono, C. B., & Meloy, J. R. (1994). The Rorschach assessment of aggressive and psychopathic personalities. Hillsdale, NJ: Erlbaum.
29. Garb, H. N. (1984). The incremental validity of information used in personality assessment. Clinical Psychology Review, 4, 641-655.
30. Garb, H. N. (1985). Linear and configural statistical models in the diagnosis of mental disorders. (Doctoral dissertation, University of Illinois at Chicago, 1985). Dissertation Abstracts International, 45 7B, 2307.
31. Garb, H. N. (1998). Studying the clinician: Judgment research and psychological assessment. Washington, DC: American Psychological Association.
32. Garb, H. N., Florio, C. M., & Grove, W. M. (1998). The validity of the Rorschach and the Minnesota Multiphasic Personality Inventory: Results from meta-analyses. Psychological Science, 9, 402-404.
33. Garb, H. N., Wood, J. M., Nezworski, M. T., Grove, W. M., & Stejskal, W. J. (2001). Toward a resolution of the Rorschach controversy. Psychological Assessment, 13, 433-448.
34. General Electric Co. v. Joiner, 118 S. Ct. 512 (1997).
35. Gittelman, R. (1980). The role of psychological tests for differential diagnosis in child psychiatry. Journal of the American Academy of Child Psychiatry, 19, 413-434.
36. Goode, E. (2001, February 20). What's in an inkblot? Some say, not much. The New York Times, pp. D1, D4.
37. Gronnerod, C. (1999). Rorschach interrater agreement estimates: An empirical evaluation. Scandinavian Journal of Psychology, 40, 115-120.
38. Groth-Marnat, G. (1997). Handbook of psychological assessment (3rd ed.). New York: Wiley.
39. Grove, W. M., & Barden, R. C. (1999). Protecting the integrity of the legal system: The admissibility of testimony from mental health experts under Daubert/Kumho analyses. Psychology, Public Policy, and Law, 5, 224-242.
40. Hagen, M. (1997). Whores of the court: The fraud of psychiatric testimony and the rape of American justice. New York: HarperColIins.
41. Hamel, M., Shaffer, T. W., & Erdberg, P. (2000). A study of nonpatient preadolescent Rorschach protocols. Journal of Personality Assessment, 75, 280-294.
42. Heilbrun, K. (1992). The role of psychological testing in forensic assessment. Law and Human Behavior, 16, 257-272.
43. Miller, J. B., Rosenthal, R., Bornstein, R. F., Berry, D. T. R., & Brunell-Neuleib, S. (1999). A comparative meta-analysis of Rorschach and MMPI validity. Psychological Assessment, 11, 278-296.
44. Hilsenroth, M. J., & Handler, L. (1995). A survey of graduate students' experiences, interests, and attitudes about learning the Rorschach. Journal of Personality Assessment, 64, 243-257.
45. Hunsley, J., & Di Giulio, G. (2001). Norms, norming, and clinical assessment. Clinical Psychology: Science and Practice, 8, 378-382.
46. Ilonen, T., Taiminen, T., Karlsson, H., Lauerma, H., Leinonen, K., Wallenius, E.,et al. (1999). Diagnostic efficiency of the Rorschach schizophrenia and depression indices in identifying first-episode schizophrenia and severe depression. Psychiatry Research, 87, 183-192.
47. Jansak, D. M. (1997). The Rorschach Comprehensive System Depression Index, depression heterogeneity, and the role of self-schema (Doctoral dissertation, California School of Professional Psychology, San Diego, 1996). Dissertation Abstracts International, 57, 6576B.
48. Jorgensen, K., Andersen, T. J., & Dam, H. (2000). The diagnostic efficiency of the Rorschach Depression Index and the Schizophrenia Index: A review. Assessment, 7, 259-280.
49. Kadle, J. C. (1989). The suitability of standard Rorschach scoring categories for nonpatient and clinically depressed elderly (Doctoral dissertation, Case Western Reserve University, 1989). Dissertation Abstracts International, 50, 2154B.
50. Kaplan, R. M., & Saccuzzo, D. P. (2001). Psychological testing: Principles, applications, and issues (5th ed.). Belmont, CA: Wadsworth.
51. Kumho Tire Co., Ltd. v. Carmichael, 119 S. Ct. 1167 (1999).
52. Lilienfeld, S. O., Wood, J. M., & Garb, H. N. (2000). The scientific status of projective techniques. Psychological Science in the Public Interest, 1, 27-66.
53. Lilienfeld, S. O., Wood, J. M., & Garb, H. N. (2001, May). What's wrong with this picture? Scientific American, 284, 80-87.
54. Lipkin, L. R. (1989). Rorschach performance as a test of a theory of late-onset depression in women (Doctoral dissertation, Temple University, 1988). Dissertation Abstracts International, 49, 2864B.
55. Lipovsky, J. A., Finch, A. J., & Belter, R. W. (1989). Assessment of depression in adolescents: Objective and projective measures. Journal of Personality Assessment, 53, 449-458.
56. Meyer, G. J. (1993). The impact of response frequency on the Rorschach constellation indices and on their validity with diagnostic and MMPI-2 criteria. Journal of Personality Assessment, 60, 153-180.
57. Meyer, G. J. (1997a). Assessing reliability: Critical corrections for a critical examination of the Rorschach Comprehensive System. Psychological Assessment, 9, 480-489.
58. Meyer, G. J. (1997b). Thinking clearly about reliability: More critical corrections regarding the Rorschach Comprehensive System. Psychological Assessment, 9, 495-498.
59. Meyer, G. J. (1999). The convergent validity of MMPI and Rorschach scales: An extension using profile scores to define response and character styles on both methods and a reexamination of simple Rorschach response frequency. Journal of Personality Assessment, 72, 1-35.
60. Meyer, G. J. (2000). On the science of Rorschach research. Journal of Personality Assessment, 75, 46-81.
61. Meyer, G. J. (2001). Evidence to correct misperceptions about Rorschach norms. Clinical Psychology: Science and Practice, 8, 389-397.
62. Meyer, G. J., & Handler, L. (1997). The ability of the Rorschach to predict subsequent outcome: A meta-analysis of the Rorschach Prognostic Rating scale. Journal of Personality Assessment, 69, 1-38.
63. Meyer, G. J., & Handler, L. (2000). Incremental validity of the Rorschach Prognostic Rating scale over the MMPI Ego Strength scale and IQ. Journal of Personality Assessment, 74, 356-370.
64. Meyer, G. J., & Richardson, C. (2001, August). An examination of changes in Form Quality codes in the Rorschach Comprehensive System from 1974 to 1995. Paper presented at the Midwinter Meeting of the Society for Personality Assessment, Philadelphia.
65. Nakata, L. M. (2000). Interrater reliability and the Comprehensive System for the Rorschach: Clinical and non-clinical protocols (Doctoral dissertation, Pacific Graduate School of Psychology, 1999). Dissertation Abstracts International, 60 (8B), 4296.
66. Nunnally, J. C., & Bernstein, I. C. (1994). Psychometric theory (3rd ed.). New York: McGraw-Hill.
67. Parker, K. C. H., Hanson, R. K., & Hunsley, J. (1988). MMPI, Rorschach, and WAIS: A meta-analytic comparison of reliability, stability, and validity. Psychological Bulletin, 103, 367-373.
68. Pinkerman, J. E., Haynes, J. P., & Keiser, T. (1993). Characteristics of psychological practice in juvenile court clinics. American Journal of Forensic Psychology, 11, 3-12.
69. Psychological Corporation (1997). Wechsler Adult Intelligence Scale, Third Edition. Wechsler Memory Scale, Third Edition, technical manual. San Antonio, TX: Author.
70. Ritzier, B. (1995). Putting your eggs in the content analysis basket: A response to Aronow, Reznikov, and Moreland. Journal of Personality Assessment, 64, 229-234.
71. Ritzier, B., Erard, R., & Pettigrew, G. (2002). Protecting the integrity of Rorschach Expert Witnesses: A Reply to Grove and Barden (1999) Re: The Admissibility of Testimony Under Daubert/Kumho Analyses. Psychology, Public Policy, and Law, 8, 201-215.
72. Rosenthal, R. (1978). The "file drawer problem" and tolerance for null results. Psychological Bulletin, 86, 638-641.
73. Sechrest, L. (1963). Incremental validity: A recommendation. Educational and Psychological Measurement, 12, 153-158.
74. Sells, J. E. (1991). A validity study of the DEPI index: The Rorschach Comprehensive System (Doctoral dissertation, University of Utah, 1990). Dissertation Abstracts International, 51, 5590B.
75. Shaffer, T. W., Erdberg, P., & Haroian, J. (1999). Current nonpatient data for the Rorschach, WAIS-R, and MMPI-2. Journal of Personality Assessment, 73, 305-316.
76. Silberg, J. L., & Armstrong, J. G. (1992). The Rorschach test for predicting suicide among depressed adolescent inpatients. Journal of Personality Assessment, 59, 290-303.
77. Singer, H. K., & Brabender, V. (1993). The use of the Rorschach to differentiate unipolar and bipolar disorders. Journal of Personality Assessment, 60, 333-345.
78. Viglione, D. J., Brager, R. C., & Haller, N. (1988). Usefulness of structural Rorschach data in identifying inpatients with depressive symptoms: A preliminary study. Journal of Personality Assessment, 52, 524-529.
79. Wechsler, D. (1997). WAIS - III administration and scoring manual. San Antonio, TX: Psychological Corporation.
80. Weiner, I. B. (1999). Contemporary perspectives on Rorschach assessment. European Journal of Psychological Assessment, 15, 78-86.
81. Whitehead, W. C. (1985). Clinical decision making on the basis of Rorschach, MMPI, and automated MMPI report data. Unpublished doctoral dissertation, University of Texas Health Science Center at Dallas.
82. Widiger, T. A. (2001). The best and the worst of us? Clinical Psychology: Science and Practice, 8, 374-377.
83. Wood, J. M., & Lilienfeld, S. O. (1999). The Rorschach Inkblot Test: A case of overstatement? Assessment, 6, 341-349.
84. Wood, J. M., Lilienfeld, S. O., Garb, H. N., & Nezworski, M. T. (2000). The Rorschach Test in clinical diagnosis: A critical review, with a backward look at Garfield (1947). Journal of Clinical Psychology, 56, 395-430.
85. Wood, J. M., Nezworski, M. T., Garb, H. N., & Lilienfeld, S. O. (2001a). The misperception of psychopathology: Problems with the norms of the Comprehensive System for the Rorschach. Clinical Psychology: Science and Practice, 8, 350-373.
86. Wood, J. M., Nezworski, M. T., Garb, H. N., & Lilienfeld, S. O. (2001b). Problems with the norms of the Comprehensive System for the Rorschach: Methodological and conceptual considerations. Clinical Psychology: Science and Practice, 8, 397-402.
87. Wood, J. M., Nezworski, M. T., & Stejskal, W. J. (1996a). The Comprehensive System for the Rorschach: A critical examination. Psychological Science, 7, 3-10.
88. Wood, J. M., Nezworski, M. T., & Stejskal, W. J. (1996b). Thinking critically about the Comprehensive System for the Rorschach: A reply to Exner. Psychological Science, 7, 14-17.
89. Wood, J. M., Nezworski, M. T., & Stejskal, W. J. (1997). The reliability of the Comprehensive System for the Rorschach: A comment on Meyer (1997). Psychological Assessment, 9, 490-494.
90. Wood, J. M., Nezworski, M. T., Stejskal, W. J., & Garven, S. (2001). Advancing scientific discourse in the controversy surrounding the Comprehensive System for the Rorschach: A rejoinder to Meyer (2000). Journal of Personality Assessment, 76, 369378.
91. Wood, J. M., Nezworski, M. T., Stejskal, W. J., Garven, S., & West, S. G. (1999). Methodological issues in evaluating Rorschach validity: A comment on Burns and Viglione (1996), Weiner, (1996), and Ganellen (1996). Assessment, 6, 115-129.