On the invalidity of validity scales: Evidence from self-reports and observer ratings in volunteer samples

Journal of Personality and Social Psychology

Volumn 78, Issue 3, 2000, Pages 582-593

  Piedmont, Ralph L ^b   McCrae, Robert R ^c   Rieman, Rainer ^a   Angleitner, Alois ^a  

^a BIELEFELD UNIVERSITY   (Germany)

^b LOYOLA UNIVERSITY MARYLAND   (United States)

^c NONE

Author keywords

[No Author keywords available]

Indexed keywords

ADOLESCENT; ADULT; AGED; ARTICLE; EPIDEMIOLOGY; FEMALE; HUMAN; MALE; METHODOLOGY; MIDDLE AGED; PERSONALITY TEST; PSYCHOMETRY; REGRESSION ANALYSIS; REPRODUCIBILITY;

ADOLESCENT; ADULT; AGED; BIAS (EPIDEMIOLOGY); FEMALE; HUMANS; MALE; MIDDLE AGED; PERSONALITY INVENTORY; PSYCHOMETRICS; REGRESSION ANALYSIS; REPRODUCIBILITY OF RESULTS;

EID: 0034146543     PISSN: 00223514     EISSN: None     Source Type: Journal    
DOI: 10.1037/0022-3514.78.3.582     Document Type: Article

References (56)

1. Alperin, J. J., Archer, R. P., & Coates, G. D. (1996). Development and effects of an MMPI-A K-correction procedure. Journal of Personality Assessment, 67, 155-168.
2. Angleitner, A., & Ostendorf, F. (1999). Manual zur deutschsprachigen Fassung des Multidimensional Personality Questionnaire (MPQ) von Tellegen [Manual for the German version of Tellegen's Multidimensional Personality Questionnaire (MPQ)]. Unpublished manuscript, University of Bielefeld, Bielefeld, Germany.
3. Arbisi, P. A., & Ben-Porath, Y. S. (1995). An MMPI-2 infrequent response scale for use with psychopathological populations: The infrequency-psychopathology scale, F(p). Psychological Assessment, 7, 424-431.
4. Archer, R. P., Fontaine, J., & McCrae, R. R. (1998). The effects of two MMPI-2 validity scales on basic scale relations to external criteria. Journal of Personality Assessment, 70, 87-102.
5. Baer, R. A., Ballenger, J., Berry, D. T. R., & Wetter, M. W. (1997). Detection of random responding on the MMPI-A. Journal of Personality Assessment, 68, 139-151.
6. Barrick, M. R., & Mount, M. K. (1996). Effects of impression management and self-deception on the predictive validity of personality constructs. Journal of Applied Psychology, 81, 261-272.
7. Ben-Porath, Y. S., & Waller, N. G. (1992). "Normal" personality inventories in clinical assessment: General requirements and the potential for using the NEO Personality Inventory. Psychological Assessment, 4, 14-19.
8. Borkenau, P., & Ostendorf, F. (1992). Social desirability scales as moderator and suppressor variables. European Journal of Personality, 6, 199-214.
9. Borkenau, P., & Ostendorf, F. (1993). NEO-Fünf-Faktoren-Inventar (NEO-FFI) [NEO Five-Factor Inventory]. Göttingen, Germany: Hogrefe.
10. Butcher, J. N., Dahlstrom, W. G., Graham, J. R., Tellegen A., & Kaemmer, B. (1989). MMPI2: Manual for administration and scoring. Minneapolis, MN: University of Minnesota Press.
11. Butcher, J. N., & Rouse, S. V. (1996). Personality: Individual differences and clinical assessment. Annual Review of Psychology, 47, 87-111.
12. Church, A. T., & Burke, P. J. (1994). Exploratory and confirmatory tests of the Big Five and Tellegen's three-and four-dimensional models. Journal of Personality and Social Psychology, 66, 93-114.
13. Cohen, J., & Cohen, P. (1975). Applied multiple regression/correlation analysis for the behavioral sciences. Hillsdale, NJ: Erlbaum.
14. Costa, P. T., Jr., & McCrae, R. R. (1988). Personality in adulthood: A 6-year longitudinal study of self-reports and spouse ratings on the NEO Personality Inventory. Journal of Personality and Social Psychology, 54, 853-863.
15. Costa, P. T., Jr., & McCrae, R. R. (1989). Personality, stress, and coping: Some lessons from a decade of research. In K. S. Markides & C. L. Cooper (Eds.), Aging, stress and health (pp. 267-283). New York: Wiley.
16. Costa, P. T., Jr., & McCrae, R. R. (1992). Revised NEO Personality Inventory: Professional manual. Odessa, FL: Psychological Assessment Resources.
17. Costa, P. T., Jr., & McCrae, R. R. (1997). Stability and change in personality assessment: The Revised NEO Personality Inventory in the Year 2000. Joumal of Personality Assessment, 68, 86-94.
18. Costa, P. T., Jr., McCrae, R. R., & Dye, D. A. (1991). Facet scales for Agreeableness and Conscientiousness: A revision of the NEO Personality Inventory. Personality and Individual Differences, 12, 887-898.
19. Crowne, D. P., & Marlowe, D. (1960). A new scale of social desirability independent of psychopathology. Journal of Consulting Psychology, 24, 349-354.
20. Dicken, C. (1963). Good impression, social desirability, and acquiescence as suppressor variables. Educational and Psychological Measurement, 23, 699-720.
21. Diener, E., Sandvik, E., Pavot, W., & Gallagher, D. (1991). Response artifacts in the measurement of subjective well-being. Social Indicators Research, 24, 35-56.
22. Edwards, A. L. (1957). The social desirability variable in personality assessment and research. New York: Dryden.
23. Goldberg, L. R., & Kilkowski, J. M. (1985). The prediction of semantic consistency in self-descriptions: Characteristics of persons and of terms that affect the consistency of responses to synonym and antonym pairs. Journal of Personality and Social Psychology, 48, 82-98.
24. Goldberg, L. R., Rorer, L. G., & Greene, M. M. (1970). The usefulness of "stylistic" scales as potential suppressor or moderator variables in predictions from the CPI. ORI Research Bulletin, 10, 1-31.
25. Gross, J. J., & John, O. P. (1997). Revealing feelings: Facets of emotional expressivity in self-reports, peer ratings, and behavior. Journal of Personality and Social Psychology, 72, 435-448.
26. Hough, L. M., Eaton, N. K., Dunnette, M. D., Kamp, J. D., & McCloy, R. A. (1990). Criterion-related validities of personality constructs and the effect of response distortion on those validities. Journal of Applied Psychology, 75, 581-595.
27. Jackson, D. N. (1984). Personality Research Form manual (3rd ed.). Port Huron, MI: Research Psychologists Press.
28. Jackson, D. N. (1989). Basic Personality Inventory manual. Port Huron, MI: Sigma Assessment Systems.
29. Kozma, A., & Stones, M. J. (1987). Social desirability in measures of subjective well-being: A systematic evaluation. Journal of Gerontology, 42, 56-59.
30. Lim, J., & Butcher, J. N. (1996). Detection of faking on the MMPI-2: Differentiation among faking-bad, denial, and claiming extreme virtue. Journal of Personality Assessment, 67, 1-25.
31. McCrae, R. R. (1986). Well-being scales do not measure social desirability. Journal of Gerontology, 41, 390-393.
32. McCrae, R. R. (1993). Agreement of personality profiles across observers. Multivariate Behavioral Research, 28, 25-40.
33. McCrae, R. R., & Costa, P. T., Jr. (1983). Social desirability scales: More substance than style. Journal of Consulting and Clinical Psychology, 51, 882-888.
34. McCrae, R. R., & Costa, P. T., Jr. (1992). Discriminant validity of the NEO-PI-R facet scales. Educational and Psychological Measurement, 52, 229-237.
35. McCrae, R. R., Costa, P. T., Jr., Dahlstrom, W. G., Barefoot, J. C., Siegler, I. C., & Williams, R. B., Jr. (1989). A caution on the use of the MMPI K-correction in research on psychosomatic medicine. Psychosomatic Medicine, 51, 58-65.
36. McCrae, R. R., Stone, S. V., Fagan, P. J., & Costa, P. T., Jr. (1998). Identifying causes of disagreement between self-reports and spouse ratings of personality. Journal of Personality, 66, 285-313.
37. Nasby, W., & Read, N. W. (1997). The life voyage of a solo circumnavigator: Integrating theoretical and methodological perspectives. Journal of Personality, 65, 785-1068.
38. Nicholson, R. A., & Hogan, R. (1990). The construct validity of social desirability. American Psychologist, 45, 290-292.
39. Ones, D. S., Viswesvaran, C., & Reiss, A. D. (1996). Role of social desirability in personality testing for personnel selection: The red herring. Journal of Applied Psychology, 81, 660-679.
40. Ostendorf, F., & Angleitner, A. (1994, July). Psychometric properties of the German translation of the NEO Personality Inventory (NEO-PI-R). Poster presented at the 7th Conference of the European Association of Personality Psychology, Madrid, Spain.
41. Paulhus, D. L. (1991). Measurement and control of response bias. In J. P. Robinson, P. R. Shaver, & Wrightsman, L. S. (Eds.), Measures of personality and social psychological attitudes (pp. 17-59). San Diego, CA: Academic Press.
42. Paulhus, D. L. (1998). Manual of the Balanced Inventory of Desirable Responding (BIDR-7). Toronto, Ontario, Canada: Multi-Health Systems.
43. Paunonen, S. V., & Jackson, D. N. (1985). Idiographic measurement strategies for personality and prediction: Some unredeemed promissory notes. Psychological Review, 92, 486-511.
44. Piedmont, R. L. (1993). A longitudinal analysis of burnout in the health care setting: The role of personal dispositions. Journal of Personality Assessment, 61, 457-473.
45. Piedmont, R. L. (1994). Validation of the rater form of the NEO-PI-R for college students: Toward a paradigm for measuring personality development. Assessment, 1, 259-265.
46. Piedmont, R. L. (1998). The Revised NEO Personality Inventory: Clinical and research applications. New York: Plenum.
47. Piedmont, R. L., & Weinstein, H. P. (1993). A psychometric evaluation of the new NEO-PI-R facets scales for Agreeableness and Conscientiousness. Journal of Personality Assessment, 60, 302-318.
48. Putnam, S. H., Kurtz, J. E., & Houts, D. C. (1996). Four-month test-retest reliability of the MMPI-2 with normal male clergy. Journal of Personality Assessment, 67, 341-353.
49. Riemann, R., Angleitner, A., & Strelau, J. (1997). Genetic and environmental influences on personality: A study of twins reared together using the self-and peer report NEO-FFI scales. Journal of Personality, 65, 449-475.
50. Schinka, J. A., Kinder, B., & Kremer, T. (1997). Research validity scales for the NEO-PI-R: Development and initial validation. Journal of Personality Assessment, 68, 127-138.
51. Smith, H. L. (1997). The structure and utility of social desirability scales in psychological research. Unpublished doctoral dissertation, University of Illinois at Urbana-Champaign.
52. Stein, L. A. R., Graham, J. R., & Williams, C. L. (1995). Detecting fake-bad MMPI-A profiles. Journal of Personality Assessment, 65, 415-427.
53. Tellegen, A. (1978/1982). Brief manual of the Multidimensional Personality Questionnaire. Unpublished manuscript, University of Minnesota.
54. Tellegen, A. (1988). The analysis of consistency in personality assessment. Journal of Personality, 56, 621-663.
55. Tellegen, A., Kamp, J., & Watson, D. (1982). Recognizing individual differences in predictive structure. Psychological Review, 89, 95-105.
56. Tellegen, A., & Waller, N. G. (in press). Exploring personality through test construction: Development of the Multidimensional Personality Questionnaire. In S. R. Briggs, J. M. Cheek, & E. M. Donahue (Eds.), Handbook of adult personality inventories. New York: Plenum.