Does response distortion statistically affect the relations between self-report psychopathy measures and external criteria?

Psychological Assessment

Volumn 28, Issue 3, 2016, Pages 294-306

  Watts, Ashley L ^a   Lilienfeld, Scott O ^a   Edens, John F ^b   Douglas, Kevin S ^c   Skeem, Jennifer L ^d   Verschuere, Bruno ^e   LoPilato, Alexander C ^f  

^a EMORY UNIVERSITY   (United States)

^b TEXAS A AND M UNIVERSITY   (United States)

^c SIMON FRASER UNIVERSITY   (Canada)

^d University of California at Berkeley   (United States)

^e UNIVERSITY OF AMSTERDAM   (Netherlands)

^f UNIVERSITY OF GEORGIA   (United States)

Author keywords

Personality assessment; Psychopathy; Response bias; Self report; Social desirability

Indexed keywords

ADULT; ARTICLE; CRITERION RELATED VALIDITY; CRITERION VARIABLE; FEMALE; HUMAN; LEVENSON SELF REPORT PSYCHOPATHY SCALE FACTOR 1; LEVENSON SELF REPORT PSYCHOPATHY SCALE FACTOR 2; MAJOR CLINICAL STUDY; MALADJUSTMENT; MALE; OFFENDER; PERSONALITY; PERSONALITY ASSESSMENT; PERSONALITY ASSESSMENT INVENTORY ANTISOCIAL FEATURE SCALE; PERSONALITY ASSESSMENT INVENTORY DEFENSIVENESS; PERSONALITY ASSESSMENT INVENTORY MALINGERING; PERSONALITY ASSESSMENT INVENTORY NEGATIVE IMPRESSION MANAGEMENT; PERSONALITY ASSESSMENT INVENTORY POSITIVE IMPRESSION MANAGEMENT; PREDICTION; PSYCHOPATHIC PERSONALITY INVENTORY COLDHEARTEDNESS; PSYCHOPATHIC PERSONALITY INVENTORY DEVIANT RESPONDING; PSYCHOPATHIC PERSONALITY INVENTORY FEARLESS DOMINANCE; PSYCHOPATHIC PERSONALITY INVENTORY SELF CENTERED IMPULSIVITY; PSYCHOPATHIC PERSONALITY INVENTORY UNLIKELY VIRTUE; PSYCHOPATHIC PERSONALITY INVENTORY VARIABLE RESPONSE INCONSISTENCY; PSYCHOPATHY; PSYCHOPATHY CHECKLIST REVISED; PSYCHOPATHY CHECKLIST REVISED FACTOR 1; RESPONSE DISTORTION; SELF REPORT; STRUCTURED CLINICAL INTERVIEW FOR DSM DISORDERS; ANTISOCIAL PERSONALITY DISORDER; PERSONALITY TEST; PRISONER; PSYCHOLOGY; REPRODUCIBILITY; STATISTICS AND NUMERICAL DATA;

ADULT; ANTISOCIAL PERSONALITY DISORDER; HUMANS; MALE; PERSONALITY INVENTORY; PRISONERS; REPRODUCIBILITY OF RESULTS; SELF REPORT;

EID: 84933566302     PISSN: 10403590     EISSN: 1939134X     Source Type: Journal    
DOI: 10.1037/pas0000168     Document Type: Article

References (69)

1. American Psychiatric Association. (2013). Diagnostic and statistical manual of mental Disorders (5th ed.). Washington, DC: Author.
2. Baron, R. M., & Kenny, D. A. (1986). The moderator-mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations. Journal of Personality and Social Psychology, 51, 1173-1182. http://dx.doi.org/10.1037/0022-3514.51.6.1173
3. Benning, S. D., Patrick, C. J., Hicks, B. M., Blonigen, D. M., & Krueger, R. F. (2003). Factor structure of the psychopathic personality inventory:Validity and implications for clinical assessment. Psychological Assessment, 15, 340-350. http://dx.doi.org/10.1037/1040-3590.15.3.340
4. Ben-Porath, Y. S., & Waller, N. G. (1992). "Normal" personality inventories in clinical assessment: General requirements and the potential for using the NEO Personality Inventory. Psychological Assessment, 4, 14-19. http://dx.doi.org/10.1037/1040-3590.4.1.14
5. Block, J. (1961). The Q-sort method in personality assessment and psychiatric research (No. 457). Springfield, IL: Thomas. http://dx.doi.org/ 10.1037/13141-000
6. Block, J., & Thomas, H. (1955). Is satisfaction with self a measure of adjustment? Journal of Abnormal and Social Psychology, 51, 254-259. http://dx.doi.org/10.1037/h0048246
7. Cleckley, H. (1941). The mask of sanity: An attempt to reinterpret the so-called psychopathic personality. St. Louis, MO: Mosby.
8. Cohen, J., Cohen, P., West, S. G., & Aiken, L. S. (2013). Applied multiple regression/correlation analysis. Mahwah, NJ: Erlbaum.
9. Connelly, B. S., & Ones, D. S. (2010). An other perspective on personality:Meta-analytic integration of observers' accuracy and predictive validity. Psychological Bulletin, 136, 1092-1122. http://dx.doi.org/10.1037/ a0021212
10. Cooke, D., Hart, S., & Logan, C. (2005). Comprehensive Assessment of Psychopathic Personality Disorder: Institutional Rating Scale, Version 1.1. [Unpublished manual].
11. Cooke, D. J., & Michie, C. (2001). Refining the construct of psychopathy:Towards a hierarchical model. Psychological Assessment, 13, 171-188. http://dx.doi.org/10.1037/1040-3590.13.2.171
12. Davis, C. G., Thake, J., & Weekes, J. R. (2012). Impression managers:Nice guys or serious criminals? Journal of Research in Personality, 46, 26-31. http://dx.doi.org/10.1016/j.jrp.2011.11.001
13. Derefinko, K. J., & Lynam, D. R. (2006). Convergence and divergence among self-report psychopathy measures: A personality-based approach. Journal of Personality Disorders, 20, 261-280. http://dx.doi.org/ 10.1521/pedi.2006.20.3.261
14. de Vries, R. E., Zettler, I., & Hilbig, B. E. (2014). Rethinking trait conceptions of Social Desirability Scales: Impression management as an expression of honesty-humility. Assessment, 21, 286-299.
15. Douglas, K. S., Lilienfeld, S. O., Skeem, J. L., Poythress, N. G., Edens, J. F., & Patrick, C. J. (2008). Relation of antisocial and psychopathic traits to suicide-related behavior among offenders. Law and Human Behavior, 32, 511-525. http://dx.doi.org/10.1007/s10979-007-9122-8
16. Edens, J. F., Buffington, J. K., & Tomicic, T. L. (2000). An investigation of the relationship between psychopathic traits and malingering on the psychopathic personality inventory. Assessment, 7, 281-296. http://dx .doi.org/10.1177/107319110000700307
17. Edens, J. F., Hart, S. D., Johnson, D. W., Johnson, J. K., & Olver, M. E. (2000). Use of the Personality Assessment Inventory to assess psychopathy in offender populations. Psychological Assessment, 12, 132-139. http://dx.doi.org/10.1037/1040-3590.12.2.132
18. Edens, J. F., Marcus, D. K., Lilienfeld, S. O., & Poythress, N. G., Jr. (2006). Psychopathic, not psychopath: Taxometric evidence for the dimensional structure of psychopathy. Journal of Abnormal Psychology, 115, 131-144. http://dx.doi.org/10.1037/0021-843X.115.1.131
19. Edens, J. F., & Ruiz, M. A. (2006). On the validity of validity scales: The importance of defensive responding in the prediction of institutional misconduct. Psychological Assessment, 18, 220-224. http://dx.doi.org/ 10.1037/1040-3590.18.2.220
20. Ekman, P. (1993). Facial expression and emotion. American Psychologist, 48, 384-392.
21. First, M. B., Gibbon, M., Spitzer, R. L., Williams, J. B. W., & Benjamin, L. S. (1997). Structured Clinical Interview for DSM-IV Axis II Personality Disorders, (SCID-II). Washington, DC: American Psychiatric Press.
22. Fritz, M. S., & MacKinnon, D. P. (2008). A graphical representation of the mediated effect. Behavior Research Methods, 40, 55-60. http://dx.doi .org/10.3758/BRM.40.1.55
23. Gacono, C. B., Meloy, J. R., Sheppard, K., Speth, E., & Roske, A. (1995). A clinical investigation of malingering and psychopathy in hospitalized insanity acquittees. Bulletin of the American Academy of Psychiatry and the Law, 23, 387-397.
24. Grove, W. M., & Meehl, P. E. (1996). Comparative efficiency of informal (subjective, impressionistic) and formal (mechanical, algorithmic) prediction procedures: The clinical-statistical controversy. Psychology, Public Policy, and Law, 2, 293-323. http://dx.doi.org/10.1037/1076-8971.2.2.293
25. Hare, R. D. (1985). Comparison of procedures for the assessment of psychopathy. Journal of Consulting and Clinical Psychology, 53, 7-16. http://dx.doi.org/10.1037/0022-006X.53.1.7
26. Hare, R. D. (1991/2003). Manual for the Revised Psychopathy Checklist (1st ed.). Toronto, Ontario, Canada: Multi-Health Systems.
27. Hart, S. D., Hare, R. D., & Forth, A. E. (1996). Psychopathy as validation of of the Revised Psychopathy Checklist. In J. Monahan & H. J. Steadman (Eds.), Violence and mental disorder: Developments in risk assessment (pp. 81-98). Chicago, IL: University of Chicago Press.
28. Hopwood, C. J., Ansell, E. B., Pincus, A. L., Wright, A. G., Lukowitsky, M. R., & Roche, M. J. (2011). The circumplex structure of interpersonal sensitivities. Journal of Personality, 79, 707-740. http://dx.doi.org/ 10.1111/j.1467-6494.2011.00696.x
29. John, O. P., & Robins, R. W. (1993). Determinants of interjudge agreement on personality traits: The Big Five domains, observability, evaluativeness, and the unique perspective of the self. Journal of Personality, 61, 521-551. http://dx.doi.org/10.1111/j.1467-6494.1993.tb00781.x
30. Jones, S., & Miller, J. D. (2012). Psychopathic traits and externalizing behaviors: A comparison of self- and informant reports in the statistical prediction of externalizing behaviors. Psychological Assessment, 24, 255-260. http://dx.doi.org/10.1037/a0025264
31. Kelsey, K. R., Rogers, R., & Robinson, E. V. (2014). Self-report measures of psychopathy: What is their role in forensic assessments? Journal of Psychopathology and Behavioral Assessment. Advance online publication. http://dx.doi.org/10.1007/s10862-014-9475-5
32. Levenson, M. R., Kiehl, K. A., & Fitzpatrick, C. M. (1995). Assessing psychopathic attributes in a noninstitutionalized population. Journal of Personality and Social Psychology, 68, 151-158. http://dx.doi.org/ 10.1037/0022-3514.68.1.151
33. Li, A., & Bagger, J. (2006). Using the BIDR to distinguish the effects of impression management and self-deception on the criterion validity of personality measures: A meta-analysis. International Journal of Selection and Assessment, 14, 131-141. http://dx.doi.org/10.1111/j.1468-2389.2006.00339.x
34. Lilienfeld, S. O., & Andrews, B. P. (1996). Development and preliminary validation of a self-report measure of psychopathic personality traits in noncriminal populations. Journal of Personality Assessment, 66, 488-524. http://dx.doi.org/10.1207/s15327752jpa6603_3
35. Lilienfeld, S. O., & Fowler, K. A. (2006). The self-report assessment of psychopathy. In C. Patrick (Ed.), Handbook of psychopathy (pp. 107-132). New York, NY: Guilford Press.
36. Lilienfeld, S. O., Patrick, C. J., Benning, S. D., Berg, J., Sellbom, M., & Edens, J. F. (2012). The role of fearless dominance in psychopathy:Confusions, controversies, and clarifications. Personality Disorders:Theory, Research, and Treatment, 3, 327-340. http://dx.doi.org/ 10.1037/a0026987
37. Lykken, D. T. (1957). A study of anxiety in the sociopathic personality. Journal of Abnormal and Social Psychology, 55, 6-10. http://dx.doi.org/ 10.1037/h0047232
38. Marcus, D. K., Fulton, J. J., & Edens, J. F. (2013). The two-factor model of psychopathic personality: Evidence from the psychopathic personality inventory. Personality Disorders: Theory, Research, and Treatment, 4, 67-76. http://dx.doi.org/10.1037/a0025282
39. McCord, W., & McCord, J. (1964). The psychopath: An essay on the criminal mind. Oxford, England: D. Van Nostrand.
40. McCrae, R. R., & Costa, P. T. (1983). Social desirability scales: More substance than style. Journal of Consulting and Clinical Psychology, 51, 882-888. http://dx.doi.org/10.1037/0022-006X.51.6.882
41. McCrae, R. R., & Costa, P. T., Jr. (1989). The structure of interpersonal traits: Wiggins's circumplex and the five-factor model. Journal of Personality and Social Psychology, 56, 586-595. http://dx.doi.org/10.1037/ 0022-3514.56.4.586
42. McGrath, R. E., Mitchell, M., Kim, B. H., & Hough, L. (2010). Evidence for response bias as a source of error variance in applied assessment. Psychological Bulletin, 136, 450-470. http://dx.doi.org/10.1037/a0019216
43. McHoskey, J. W., Worzel, W., & Szyarto, C. (1998). Machiavellianism and psychopathy. Journal of Personality and Social Psychology, 74, 192-210. http://dx.doi.org/10.1037/0022-3514.74.1.192
44. Meehl, P. E. (1954). Clinical versus statistical prediction: A theoretical analysis and a review of the evidence. Minneapolis, MN: University of Minnesota Press. http://dx.doi.org/10.1037/11281-000
45. Meehl, P. E. (1957). When shall we use our heads instead of the formula? Journal of Counseling Psychology, 4, 268 -273. http://dx.doi.org/ 10.1037/h0047554
46. Miller, J. D., Jones, S. E., & Lynam, D. R. (2011). Psychopathic traits from the perspective of self and informant reports: Is there evidence for a lack of insight? Journal of Abnormal Psychology, 120, 758-764. http://dx .doi.org/10.1037/a0022477
47. Miller, J. D., & Lynam, D. R. (2012). An examination of the Psychopathic Personality Inventory's nomological network: A meta-analytic review. Personality Disorders: Theory, Research, and Treatment, 3, 305-326. http://dx.doi.org/10.1037/a0024567
48. Morey, L. C. (1991). Personality Assessment Inventory (PAI). Odessa, FL: PAR.
49. Morey, L. C. (2012). Detection of response bias in applied assessment: Comment on McGrath et al. (2010). Psychological Injury and Law, 5, 1-9.
50. Newman, J. P., & Kosson, D. S. (1986). Passive avoidance learning in psychopathic and nonpsychopathic offenders. Journal of Abnormal Psychology, 95, 252-256. http://dx.doi.org/10.1037/0021-843X.95.3.252
51. Newman, J. P., Widom, C. S., & Nathan, S. (1985). Passive avoidance in syndromes of disinhibition: Psychopathy and extraversion. Journal of Personality and Social Psychology, 48, 1316-1327. http://dx.doi.org/ 10.1037/0022-3514.48.5.1316
52. Niesten, I. J., Nentjes, L., Merckelbach, H., & Bernstein, D. P. (2015). Antisocial features and "faking bad": A critical note. International Journal of Law and Psychiatry. Advanced online publication. http://dx .doi.org/10.1016/j.ijlp.2015.03.005
53. Ones, D. S., Viswesvaran, C., & Reiss, A. D. (1996). Role of social desirability in personality testing for personnel selection: The red herring. Journal of Applied Psychology, 81, 660-679. http://dx.doi.org/ 10.1037/0021-9010.81.6.660
54. Paulhus, D. L., & John, O. P. (1998). Egoistic and moralistic biases in self-perception: The interplay of self-deceptive styles with basic traits and motives. Journal of Personality, 66, 1025-1060. http://dx.doi.org/ 10.1111/1467-6494.00041
55. Poythress, N. G., Lilienfeld, S. O., Skeem, J. L., Douglas, K. S., Edens, J. F., Epstein, M., & Patrick, C. J. (2010). Using the PCL-R to help estimate the validity of two self-report measures of psychopathy with offenders. Assessment, 17, 206 -219. http://dx.doi.org/10.1177/ 1073191109351715
56. Preacher, K. J., & Hayes, A. F. (2004). SPSS and SAS procedures for estimating indirect effects in simple mediation models. Behavior Research Methods, Instruments, & Computers, 36, 717-731. http://dx.doi .org/10.3758/BF03206553
57. Preacher, K. J., & Hayes, A. F. (2008). Asymptotic and resampling strategies for assessing and comparing indirect effects in multiple mediator models. Behavior Research Methods, 40, 879-891. http://dx.doi .org/10.3758/BRM.40.3.879
58. Preacher, K. J., & Kelley, K. (2011). Effect size measures for mediation models: Quantitative strategies for communicating indirect effects. Psychological Methods, 16, 93-115. http://dx.doi.org/10.1037/a0022658
59. Ray, J. V., Hall, J., Rivera-Hudson, N., Poythress, N. G., Lilienfeld, S. O., & Morano, M. (2013). The relation between self-reported psychopathic traits and distorted response styles: A meta-analytic review. Personality Disorders: Theory, Research, and Treatment, 4, 1-14. http://dx.doi.org/ 10.1037/a0026482
60. Rogers, R., & Cruise, K. R. (2000). Malingering and deception among psychopaths. In C. B. Gacono (Ed.), The clinical and forensic assessment of psychopathy: A practitioner's guide. The LEA series in personality and clinical psychology (pp. 269-284). Mahwah, NJ: Erlbaum.
61. Sackeim, H. A., & Gur, R. C. (1979). Self-deception, other-deception, and self-reported psychopathology. Journal of Consulting and Clinical Psychology, 47, 213-215. http://dx.doi.org/10.1037/0022-006X.47.1.213
62. Sellbom, M. (2011). Elaborating on the construct validity of the Levenson self-report psychopathy scale in incarcerated and non-incarcerated samples. Law and Human Behavior, 35, 440 - 451. http://dx.doi.org/ 10.1007/s10979-010-9249-x
63. Smith, S. F., Watts, A. L., & Lilienfeld, S. O. (2014). On the trail of the elusive successful psychopath. The Psychologist, 27, 506-511.
64. Tellegen, A. (1982). Brief manual for the Multidimensional Personality Questionnaire. Unpublished manuscript, University of Minnesota, Minneapolis.
65. Uziel, L. (2010). Rethinking social Desirability scales from impression management to interpersonally oriented self-control. Perspectives on Psychological Science, 5, 243-262. http://dx.doi.org/10.1177/ 1745691610369465
66. Vazire, S. (2006). Informant reports: A cheap, fast, and easy method for personality assessment. Journal of Research in Personality, 40, 472-481. http://dx.doi.org/10.1016/j.jrp.2005.03.003
67. Verona, E., Patrick, C. J., & Joiner, T. E. (2001). Psychopathy, antisocial personality, and suicide risk. Journal of Abnormal Psychology, 110, 462-470.
68. Verschuere, B., Uzieblo, K., De Schryver, M., Douma, H., Onraedt, T. Y., & Crombez, G. (2014). The inverse relation between psychopathy and faking good: Not response bias but true variance in psychopathic personality. Journal of Forensic Psychiatry & Psychology, 25, 705-713. http://dx.doi.org/10.1080/14789949.2014.952767
69. Widom, C. S. (1977). A methodology for studying noninstitutionalized psychopaths. Journal of Consulting and Clinical Psychology, 45, 674-683.