A second look at the validity of widely used rorschach indices: Comment on Mihura, Meyer, Dumitrascu, and Bombel (2013)

Psychological Bulletin

Volumn 141, Issue 1, 2015, Pages 236-249

  Wood, James M ^a   Garb, Howard N ^b   Teresa Nezworski, M ^c   Lilienfeld, Scott O ^d   Duke, Misty C ^a  

^a UNIVERSITY OF TEXAS AT EL PASO   (United States)

^b Joint Base San Antonio ^*  (United States)

^c William Beaumont Medical Center   (United States)

^d EMORY UNIVERSITY   (United States)

Author keywords

Comprehensive system; Meta analysis; Rorschach inkblot test; Validity

Indexed keywords

HUMAN; MENTAL DISORDERS; PERSONALITY TEST;

HUMANS; MENTAL DISORDERS; RORSCHACH TEST;

EID: 84925687995     PISSN: 00332909     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0036005     Document Type: Article

References (79)

1. Arenella, J. (2000). Rorschach indicators of body image disruption and precocious maturity in sexually and physically abused girls (Doctoral dissertation). Available from ProQuest Dissertations and Theses database. (UMI No. 9959123)
2. Arenella, J., & Ornduff, S. R. (2000). Manifestations of bodily concern in sexually abused girls. Bulletin of the Menninger Clinic, 64, 530-542.
3. Åsberg, M., & Forslund, K. (2000). Neurobiological aspects of suicidal behavior. International Review of Psychiatry, 12, 62-74. doi:10.1080/ 09540260074148
4. Auker-Keller, A. A. (1998). Female breast cancer patients: The differences in psychological and family functioning based on severity of illness (Doctoral dissertation). Available from ProQuest Dissertations and Theses database. (UMI No. 9934015)
5. Ayearst, L. E., & Bagby, R. M. (2010). Evaluating the psychometric properties of psychological measures. In M. M. Antony & D. H. Barlow (Eds.), Handbook of assessment and treatment planning for psychological disorders (2nd ed., pp. 23-61). New York, NY: Guilford Press.
6. Bank, C. A. (2001). Predicting sexually abused victims using the Rorschach Inkblot Test (Doctoral dissertation). Available from ProQuest Dissertations and Theses database. (UMI No. 3014406)
7. Begg, C. B. (1994). Publication bias. In H. Cooper & L. V. Hedges (Eds.), The handbook of research synthesis (pp. 399-409). New York, NY: Russell Sage Foundation.
8. Belcher, P. L. (1995). A comparison of male adolescent sexual offenders using the Rorschach (Doctoral dissertation). Available from ProQuest Dissertations and Theses database. (UMI No. 9536333)
9. Bénony, H., Daloz, L., Bungener, C., Chahraoui, K., Frenay, C., & Auvin, J. (2002). Emotional factors and subjective quality of life in subjects with spinal cord injuries. American Journal of Physical Medicine & Rehabilitation, 81, 437-445. doi:10.1097/00002060-200206000-00008
10. Black, E. M. (2002). The use of the Rorschach Inkblot Technique in the detection and diagnosis of child sexual abuse (Doctoral dissertation). Available from ProQuest Dissertations and Theses database. (UMI No. 3068669)
11. Burns, J. C. (2003). Use of the Rorschach to identify trauma in a sample of homeless and indigent women (Doctoral dissertation). Available from ProQuest dissertations and Theses database. (UMI No. 3084479)
12. Connolly, E. L. (1997). Chronic stress in mothers of severely disabled children: A Rorschach study (Doctoral dissertation). Available from ProQuest dissertations and Theses database. (UMI No. 9730214)
13. Daley, B. S. (1992). A descriptive study of the Rorschach and chronic pain (Doctoral dissertation). Available from ProQuest dissertations and Theses database. (UMI No. 9236716)
14. Dawes, R. M. (1994). House of cards: Psychology and psychotherapy built on myth. New York, NY: Free Press.
15. De Vincent, T. (2009). A validation of the controls cluster of the Rorschach Comprehensive System (Doctoral dissertation). Available from ProQuest dissertations and Theses database. (UMI No. 3353725)
16. Exner, J. E. (1974). The Rorschach: A Comprehensive System (Vol. 1). New York, NY: Wiley.
17. Exner, J. E. (1986). Some Rorschach data comparing schizophrenics with borderline and schizotypal personality disorders. Journal of Personality Assessment, 50, 455-471. doi:10.1207/s15327752jpa5003_14
18. Exner, J. E. (1996). A comment on "The Comprehensive System for the Rorschach: A critical examination." Psychological Science, 7, 11-13. http://dx.doi.org/10.1111/j.1467-9280.1996.tb00659.x
19. Exner, J. E. (2003). The Rorschach: A Comprehensive System. Vol. 1: Basic foundations and principles of interpretation (4th ed.). New York, NY: Wiley.
20. Exner, J. E., & Erdberg, P. (2005). The Rorschach: A Comprehensive System. Vol. 2: Advanced interpretation (4th ed.). New York, NY: Wiley.
21. Exner, J. E., & Wylie, J. (1977). Some Rorschach data concerning suicide. Journal of Personality Assessment, 41, 339 -348. doi:10.1207/ s15327752jpa4104_1
22. Flahault, C., & Sultan, S. (2010). On being a child of an ill parent: A Rorschach investigation of adaptation to parental cancer compared to other illnesses. Rorschachiana, 31, 43-69. doi:10.1027/1192-5604/ a000004
23. Fowler, J. C., Piers, C., Hilsenroth, M. J., Holdwick, D. J., & Padawer, J. R. (2001). The Rorschach Suicide Constellation: Assessing various degrees of lethality. Journal of Personality Assessment, 76, 333-351. doi:10.1207/S15327752JPA7602_13
24. Friedrich, W. N., Einbender, A. J., & McCarty, P. (1999). Sexually abused girls and their Rorschach responses. Psychological Reports, 85, 355- 362. doi:10.2466/PR0.85.6.355-362
25. Garb, H. N. (1999). Call for a moratorium on the use of the Rorschach Inkblot in clinical and forensic settings. Assessment, 6, 313-317. doi: 10.1177/107319119900600402
26. García-Alba, C. (2004). Anorexia and depression: Depressive comorbidity in anorexic adolescents. The Spanish Journal of Psychology, 7, 40-52. Retrieved from http://www.ucm.es/info/Psi/docs/journal/
27. Gregg, P. A. (1998). The effect of impression management on correlations between Rorschach and MMPI-2 variables (Doctoral dissertation). Available from ProQuest dissertations and Theses database. (UMI No. 9807469)
28. Grosso, C. G. (1999). An investigation of the construct and concurrent validity of variables from the Comprehensive System for the Rorschach in a child psychiatric inpatient population (Doctoral dissertation). Available from ProQuest dissertations and Theses database. (UMI No. 9940446)
29. Hayman, J. A. (2000). An actuarial and confirmatory investigation of the interpersonal and self-perception clusters of the Rorschach Comprehensive System (Doctoral dissertation). Available from ProQuest dissertations and Theses database. (UMI No. 9965254)
30. Holaday, M., & Blakeney, P. (1994). A comparison of psychologic functioning in children and adolescents with severe burns on the Rorschach and the Child Behavior Checklist. Journal of Burn Care & Rehabilitation, 15, 412-415. doi:10.1097/00004630-199409000-00006
31. Holaday, M., Moak, J., & Shipley, M. A. (2001). Rorschach protocols from children and adolescents with Asperger's disorder. Journal of Personality Assessment, 76, 482-495. doi:10.1207/S15327752JPA7603_09
32. Hunsley, J., Lee, C. M., Wood, J. M., & Taylor, W. (in press). Controversial and questionable assessment techniques. In S. O. Lilienfeld, S. J. Lynn, & J. M. Lohr (Eds.), Science and pseudoscience in contemporary clinical psychology (2nd ed.). New York, NY: Guilford Press.
33. Hunsley, J., & Mash, E. J. (2008). Developing criteria for evidence-based assessment: An introduction to assessments that work. In J. Hunsley & E. J. Mash (Eds.), A guide to assessments that work (pp. 3-14). New York, NY: Oxford University.
34. Kirkcaldy, B. D., Richardson-Vejgaard, R., & Merrick, J. (2010). Suicide risk in adolescents and adults. In J. M. Brown & E. A. Campbell (Eds.), Cambridge handbook of forensic psychology (pp. 327-334). Cambridge, England: Cambridge University Press. doi: 10.1017/CBO9780511730290.041
35. Leifer, M., Shapiro, J. P., Martone, M. W., & Kassem, L. (1991). Rorschach assessment of psychological functioning in sexually abused girls. Journal of Personality Assessment, 56, 14 -28. doi:10.1207/ s15327752jpa5601_2
36. Lieb, K., Zanarini, M. C., Schmahl, C., Linehan, M. M., & Bohus, M. (2004). Borderline personality disorder. The Lancet, 364, 453-461. Lipsey, M. W., & Wilson, D. B. (2001). Practical meta-analysis. Thousand Oaks, CA: Sage.
37. Lipsey, M. W., & Wilson, D. B. (2001). Practical meta-analysis. Thousand Oaks, CA: Sage
38. Long, J. S. (1995). A comparative study between the Rorschach and MMPI-A in predicting symptoms and behaviors with inpatient adolescents (Doctoral dissertation). Available from ProQuest dissertations and Theses database. (UMI No. 9536085)
39. Lottenberg Semer, N., & Yazigi, L. (2009). The Rorschach and the body: The study of self-esteem in enuretic children through the Rorschach method. Rorschachiana, 30, 3-25. doi:10.1027/1192-5604.30.1.3
40. Lundbäck, E., Forslund, K., Rylander, G., Jokinen, J., Nordström, P., Nordström, A.-L., & Åsberg, M. (2006). CSF 5-HIAA and the Rorschach test in patients who have attempted suicide. Archives of Suicide Research, 10, 339-345. doi:10.1080/13811110600790942
41. McCrae, R. R., & Costa, P. T., Jr. (1997). Personality trait structure as a human universal. American Psychologist, 52, 509-516. doi:10.1037/ 0003-066X.52.5.509
42. McCraw, R. K., & Pegg-McNab, J. (1989). Rorschach comparisons of male juvenile sex offenders and nonsex offenders. Journal of Personality Assessment, 53, 546-553. doi:10.1207/s15327752jpa5303_11
43. Meyer, G. J. (1993). The impact of response frequency on the Rorschach constellation indices and on their validity with diagnostic and MMPI-2 criteria. Journal of Personality Assessment, 60, 153-180. doi:10.1207/ s15327752jpa6001_13
44. Meyer, G. J., Erdberg, P., & Shaffer, T. W. (2007). Toward international normative reference data for the Comprehensive System. Journal of Personality Assessment, 89, S201-S216. doi:10.1080/ 00223890701629342
45. Meyer, G. J., Viglione, D. J., Mihura, J. L., Erard, R. E., & Erdberg, P. (2011). Rorschach Performance Assessment System: Administration, coding, interpretation, and technical manual. Toledo, OH: Rorschach Performance Assessment System.
46. Mihura, J. L., Meyer, G. J., Bel-Bahar, T., & Gunderson, J. (2003). Correspondence among observer ratings of Rorschach, Big Five Model, and DSM-IV personality disorder constructs. Journal of Personality Assessment, 81, 20-39. doi:10.1207/S15327752JPA8101_03
47. Mihura, J. L., Meyer, G. J., Dumitrascu, N., & Bombel, G. (2013). The validity of individual Rorschach variables: Systematic reviews and meta-analyses of the Comprehensive System. Psychological Bulletin, 139, 548-605. doi:10.1037/a0029406
48. Mihura, J. L., Meyer, G. J., Viglione, D. J., Ritzier, B., Kaser-Boyd, N., Adrian, C., Bornstein, R. F. (2002). The Rorschach Construct Scale: Observer-rating (mixed gender, female, & male formats) and self-rating forms [Unpublished scale and tables]. University of Toledo, Toledo, OH.
49. Mishra, D., Khalique, A., & Kumar, R. (2010). Rorschach profile of manic patients. Journal of Projective Psychology & Mental Health, 17, 158-164. Retrieved from http://www.somaticinkblots.com/SISJournal/ tabid/61/Default.aspx
50. Moore, T. L. (2003). Sexually victimized and non-sexually victimized adolescent sexual offenders: One group or two? (Doctoral dissertation). Available from ProQuest dissertations and Theses database. (UMI No. 8217265)
51. Nakamura, N., Fuchigami, Y., & Tsugawa, R. (2007). Rorschach comprehensive system data for a sample of 240 adult nonpatients from Japan. Journal of Personality Assessment, 89(Suppl. 1), S97-S102. doi:10.1080/00223890701583291
52. Owens, T. H. (1982). Personality characteristics of female psychotherapy patients with a history of incest (Doctoral dissertation). Available from ProQuest dissertations and Theses database. (UMI No. 8217265)
53. Perfect, M. M. (2004). Incremental validity of the Minnesota Multiphasic Personality Inventory (MMPI-A) and Rorschach Inkblot Test in predicting the number and severity of adolescents' maltreatment histories (Doctoral dissertation). Available from ProQuest dissertations and Theses database. (UMI No. 3143446)
54. Porcelli, P., & Meyer, G. J. (2002). Construct validity of Rorschach variables for alexithymia. Psychosomatics: Journal of Consultation and Liaison Psychiatry, 43, 360-369. doi:10.1176/appi.psy.43.5.360
55. Ritsher, J. E. B. (1997). Depression assessment of Russian psychiatric patients: Validity of MMPI and Rorschach scales (Doctoral dissertation). Available from ProQuest dissertations and Theses database. (UMI No. 9816520)
56. Sakowicz, K. (2010). Rorschach correlates of childhood sexual abuse (Doctoral dissertation). Available from ProQuest dissertations and Theses database. (UMI No. 3437950)
57. Saraydarian, L. (1990). Diagnostic clarity of borderline personality disorder: A Rorschach study (Doctoral dissertation). Available from Pro- Quest dissertations and Theses database. (UMI No. 9027329)
58. Saulsman, L. M., & Page, A. C. (2004). The five-factor model and personality disorder empirical literature: A meta-analytic review. Clinical Psychology Review, 23, 1055-1085. doi:10.1016/j.cpr.2002 .09.001
59. Scroppo, J. C., Drob, S. L., Weinberger, J. L., & Eagle, P. (1998). Identifying dissociative identity disorder: A self-report and projective study. Journal of Abnormal Psychology, 107, 272-284. doi:10.1037/ 0021-843X.107.2.272
60. Shinaver, C. S. (1996). The impact of sexual trauma on the information processing of boys (Doctoral dissertation). Available from ProQuest dissertations and Theses database. (UMI No. 9706798)
61. Skinstad, A. H., Troland, K., & Mortensen, J. K. (1999). Rorschach responses in borderline personality disorder with alcohol dependence. European Journal of Psychological Assessment, 15, 133-142. doi: 10.1027//1015-5759.15.2.133
62. Smith, A. L. (2008). Verbal and social functioning among boys in the criminal justice system (Doctoral dissertation). Available from ProQuest dissertations and Theses database. (UMI No. 3320210)
63. Sultan, S., Andronikof, A., Réveillère, C., & Lemmel, G. (2006). A Rorschach stability study in a nonpatient adult sample. Journal of Personality Assessment, 87, 330-348. doi:10.1207/s15327752jpa8703_13
64. Sultan, S., & Meyer, G. J. (2009). Does productivity impact the stability of Rorschach scores? Journal of Personality Assessment, 91, 480-493. doi:10.1080/00223890903088693
65. Takahashi, M., Takahashi, Y., & Nishio, H. (2007). Rorschach-testkaishakuho [Principles of interpretation of the Comprehensive Rorschach Test]. Tokyo, Japan: Kongo Shuppan.
66. Verias, E. A. (2007). Further investigation into the Rorschach and the utility of a modified DEPI in relation to adolescent depression (Doctoral dissertation). Available from ProQuest dissertations and Theses database. (UMI No. 3270246)
67. Viglione, D. J., & Meyer, G. J. (2008). An overview of Rorschach psychometrics for forensic practice. In C. B. Gacono, F. B. Evans, N. Kaser-Boyd, & L. A. Gacono (Eds.), The handbook of forensic Rorschach assessment (pp. 21-53). New York, NY: Routledge.
68. Viglione, D. J., Towns, B., & Lindshield, D. (2012). Understanding and using the Rorschach Inkblot Test to assess post-traumatic conditions. Psychological Injury and Law, 5, 135-144. doi:10.1007/s12207-012- 9128-5
69. Wirt, R. D., Lachar, D., Klinedinst, J. K., & Seat, R. D. (1977). Multidimensional description of child personality: A manual for the Personality Inventory for Children. Los Angeles, CA: Western Psychological Services.
70. Wood, J. M., Krishnamurthy, R., & Archer, R. P. (2003). Three factors of the Comprehensive System for the Rorschach and their relationship to Wechsler IQ scores in an adolescent sample. Assessment, 10, 259-265. doi:10.1177/1073191103255493
71. Wood, J. M., Lilienfeld, S. O., Garb, H. N., & Nezworski, M. T. (2000). The Rorschach Test in clinical diagnosis: A critical review, with a backward look at Garfield (1947). Journal of Clinical Psychology, 56, 395- 430. doi:10.1002/(SICI)1097-4679(200003)56:3<395::AIDJCLP15 >3.0.CO;2-O
72. Wood, J. M., Lilienfeld, S. O., Nezworski, M. T., Garb, H. N., Wildermuth, J., & Allen, K. H. (2010). Validity of Rorschach Inkblot scores for discriminating psychopaths from nonpsychopaths in forensic populations: A meta-analysis. Psychological Assessment, 22, 336-349. doi: 10.1037/a0018998
73. Wood, J. M., Nezworski, M. T., & Garb, H. N. (2003). What's right with the Rorschach?. Scientific Review of Mental Health Practice, 2, 142-146.
74. Wood, J. M., Nezworski, M. T., Garb, H. N., & Lilienfeld, S. O. (2001). The misperception of psychopathology: Problems with the norms of the Comprehensive System for the Rorschach. Clinical Psychology: Science and Practice, 8, 350-373. doi:10.1093/clipsy.8.3.350
75. Wood, J. M., Nezworski, M. T., Lilienfeld, S. O., & Garb, H. N. (2003). What's wrong with the Rorschach? Science confronts the controversial inkblot test. San Francisco, CA: Jossey-Bass.
76. Wood, J. M., Nezworski, M. T., & Stejskal, W. J. (1996). The Comprehensive System for the Rorschach: A critical examination. Psychological Science, 7, 3-10. doi:10.1111/j.1467-9280.1996.tb00658.x
77. Yamamoto, K., Kanbara, K., Mutsuura, H., Ban, I., Mizuno, Y., Abe, T., Fukunaga, M. (2010). Psychological characteristics of Japanese patients with chronic pain assessed by the Rorschach test. BioPsychoSocial Medicine, 4, Article 20. doi:10.1186/1751-0759- 4-20
78. Zodan, J. (2010). Rorschach assessment of childhood sexual abuse and borderline pathology: A comparison of clinical samples (Doctoral dissertation). Available from ProQuest dissertations and Theses database. (UMI No. 3425222)
79. Zodan, J., Charnas, J., & Hilsenroth, M. J. (2009). Rorschach assessment of reality testing, affect and object representation of borderline pathology: A comparison of clinical samples. Bulletin of the Menninger Clinic, 73, 121-142. doi:10.1521/bumc.2009.73.2.121