An Other Perspective on Personality: Meta-Analytic Integration of Observers' Accuracy and Predictive Validity

Psychological Bulletin

Volumn 136, Issue 6, 2010, Pages 1092-1122

  Connelly, Brian S ^a   Ones, Deniz S ^b  

^a UNIVERSITY OF TORONTO   (Canada)

^b UNIVERSITY OF MINNESOTA   (United States)

Author keywords

Consensus; Informants; Meta analysis; Observers; Personality

Indexed keywords

ARTICLE; HUMAN; HUMAN RELATION; META ANALYSIS; OBSERVER VARIATION; PERSONALITY; PERSONALITY TEST; REPRODUCIBILITY; SOCIAL BEHAVIOR;

HUMANS; INTERPERSONAL RELATIONS; OBSERVER VARIATION; PERSONALITY; PERSONALITY INVENTORY; REPRODUCIBILITY OF RESULTS; SOCIAL BEHAVIOR;

EID: 78349258093     PISSN: 00332909     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0021212     Document Type: Article

References (106)

1. Abe J.A. Shame, guilt, and personality judgment. Journal of Research in Personality 2004, 38:85-104. doi: 10.1016/S0092-6566(03)00055-2.
2. Barrick M.R., Mount M.K., Judge T.A. Personality and performance at the beginning of the new millennium: What do we know and where do we go next?. International Journal of Selection and Assessment 2001, 9:9-30. doi: 10.1111/1468-2389.00160.
3. Bernieri F.J., Zuckerman M., Koestner R., Rosenthal R. Measuring person perception accuracy: Another look at self-other agreement. Personality and Social Psychology Bulletin 1994, 20:367-378. doi: 10.1177/0146167294204004.
4. Block J. A contrarian view of the five-factor approach to personality description. Psychological Bulletin 1995, 117:187-215. doi: 10.1037/0033-2909.117.2.187.
5. Bogg T., Roberts B.W. Conscientiousness and health-related behaviors: A meta-analysis of the leading behavioral contributors to mortality. Psychological Bulletin 2004, 130:887-919. doi: 10.1037/0033-2909.130.6.887.
6. Borkenau P., Liebler A. Trait inferences: Sources of validity at zero acquaintance. Journal of Personality and Social Psychology 1992, 62:645-657. doi: 10.1037/0022-3514.62.4.645.
7. Bouchard T.J., Loehlin J.C. Genes, evolution, and personality. Behavioral Genetics 2001, 31:243-273. doi: 10.1023/A:1012294324713.
8. Cassin S.E., von Ranson K.M. Personality and eating disorders: A decade in review. Clinical Psychology Review 2005, 25:895-916. doi: 10.1016/j.cpr.2005.04.012.
9. Chaplin W.F., Goldberg L.R. A failure to replicate the Bem and Allen study of individual differences in cross-situational consistency. Journal of Personality and Social Psychology 1984, 47:1074-1090. doi: 10.1037/0022-3514.47.5.1074.
10. Connelly, B. S., & Ones, D. S. (2008, April). Interrater unreliability in assessment center ratings: A meta-analysis. Paper presented at the meeting for the Society for Industrial and Organizational Psychologists, San Francisco, CA.
11. Connolly J.J., Kavanagh E.J., Viswesvaran C. The convergent validity between self and observer ratings of personality: A meta-analytic review. International Journal of Selection and Assessment 2007, 15:110-117. doi: 10.1111/j.1468-2389.2007.00371.x.
12. Conway J.M., Jako R.A., Goodman D.F. A meta-analysis of interrater and internal consistency reliability of selection interviews. Journal of Applied Psychology 1995, 80:565-579. doi: 10.1037/0021-9010.80.5.565.
13. Costa P.T., McCrae R.R. Personality in adulthood: A six-year longitudinal study of self-reports and spouse ratings on the NEO Personality Inventory. Journal of Personality and Social Psychology 1988, 54:853-863. doi: 10.1037/0022-3514.54.5.853.
14. Costa P.T., McCrae R.R. Four ways five factors are basic. Personality and Individual Differences 1992, 13:653-665. doi: 10.1016/0191-8869(92)90236-I.
15. Costa P.T., McCrae R.R. Domains and facets: Hierarchical personality assessment using the Revised NEO Personality Inventory. Journal of Personality Assessment 1995, 64:21-50. doi: 10.1207/s15327752jpa6401_2.
16. DeYoung C.G. Higher-order factors of the Big Five in a multi-informant sample. Journal of Personality and Social Psychology 2006, 91:1138-1151. doi: 10.1037/0022-3514.91.6.1138.
17. DeYoung C.G., Quilty L.C., Peterson J.B. Between facets and domains: 10 aspects of the Big Five. Journal of Personality and Social Psychology 2007, 93:880-896. doi: 10.1037/0022-3514.93.5.880.
18. Digman J.M. Personality structure: Emergence of the five-factor model. Annual Review of Psychology 1990, 41:417-440. doi: 10.1146/annurev.ps.41.020190.002221.
19. Digman J.M. Higher-order factors of the Big Five. Journal of Personality and Social Psychology 1997, 73:1246-1256. doi: 10.1037/0022-3514.73.6.1246.
20. Dilchert S., Ones D.S., Van Rooy D.L., Viswesvaran C. Big Five factors of personality. Encyclopedia of career development 2006, 36-42. Sage, Thousand Oaks, CA. J.H. Greenhaus, G.A. Callahan (Eds.).
21. Dudley N.M., Orvis K.A., Lebiecki J.E., Cortina J.M. A meta-analytic investigation of conscientiousness in the prediction of job performance: Examining the intercorrelations and the incremental validity of narrow traits. Journal of Applied Psychology 2006, 91:40-57. doi: 10.1037/0021-9010.91.1.40.
22. Ebstein R.P., Novick O., Umansky R., Priel B., Osher Y., Blaine D., Belmaker R.H. Dopamine D4 receptor (D4DR) exon III polymorphism associated with the human personality trait of novelty seeking. Nature Genetics 1996, 12:78-80. doi: 10.1038/ng0196-78.
23. Ellingson J.E., Sackett P.R., Hough L.M. Social desirability corrections in personality measurement: Issues of applicant comparison and construct validity. Journal of Applied Psychology 1999, 84:155-166. doi: 10.1037/0021-9010.84.2.155.
24. Eysenck H.J. " The structure of phenotypic personality traits" Comment. American Psychologist 1993, 48:1299-1300. doi: 10.1037/0003-066X.48.12.1299.b.
25. Foldes H.J., Duehr E.E., Ones D.S. Group differences in personality: Meta-analyses comparing five U.S. racial groups. Personnel Psychology 2008, 61:579-616. doi: 10.1111/j.1744-6570.2008.00123.x.
26. Friedman H.S., Booth-Kewley S. The " disease-prone personality" A meta-analytic view of the construct. Social psychology of health 2003, 305-324. Psychology Press, New York, NY. P. Salovey, A.J. Rothman (Eds.).
27. Funder D.C. On the accuracy of personality judgment: A realistic approach. Psychological Review 1995, 102:652-670. doi: 10.1037/0033-295X.102.4.652.
28. Funder D.C. Personality judgment: A realistic approach to person perception 1999, Academic Press, San Diego, CA.
29. Funder D.C., West S.G. Consensus, self-other agreement, and accuracy in personality judgment: An introduction. Journal of Personality 1993, 61:457-476. doi: 10.1111/j.1467-6494.1993.tb00778.x.
30. Goldberg L.R. The structure of phenotypic personality traits. American Psychologist 1993, 48:26-34. doi: 10.1037/0003-066X.48.1.26.
31. Heller D., Watson D., Hies R. The role of person versus situation in life satisfaction: A critical examination. Psychological Bulletin 2004, 130:574-600. doi: 10.1037/0033-2909.130.4.574.
32. Hogan R. A socioanalytic interpretation of the five-factor model. The five-factor model of personality 1996, 163-179. Guilford, New York, NY. J.S. Wiggins (Ed.).
33. Hogan R., Shelton D. A socioanalytic perspective on job performance. Human Performance 1998, 11:129-144. doi: 10.1207/s15327043hup1102&3_2.
34. Hough L.M. The " Big Five" personality variables-construct confusion: Description versus prediction. Human Performance 1992, 5:139-155. doi: 10.1207/s15327043hup0501&2_8.
35. Hough L.M., Eaton N.K., Dunnette M.D., Kamp J.D., McCloy R.A. Criterion-related validities of personality constructs and the effect of response distortion on those validities. Journal of Applied Psychology 1990, 75:581-595. doi: 10.1037/0021-9010.75.5.581.
36. Hough L.M., Ones D.S. The structure, measurement, validity, and use of personality variables in industrial, work, and organizational psychology. Handbook of industrial, work, and organizational psychology: Vol. 1. Personnel psychology 2001, 233-277. Sage, Thousand Oaks, CA. N. Anderson, D.S. Ones, H.K. Sinangil, C. Viswesvaran (Eds.).
37. Hülsheger, U. R., & Connelly, B. S. (2010, April). Validity of observer ratings with raters from outside the workplace. Paper presented at the meeting of the Society for Industrial and Organizational Psychologists, Atlanta, GA.
38. Hunter J.E., Schmidt F.L. Fixed effects vs. random effects meta-analysis models: Implications for cumulative research knowledge. International Journal of Selection and Assessment 2000, 8:275-292. doi: 10.1111/1468-2389.00156.
39. Hunter J.E., Schmidt F.L. Methods of meta-analysis: Correcting error and bias in research findings 2004, Sage, Newbury Park, CA.
40. John O.P., Robins R.W. Determinants of interjudge agreement on personality traits: The Big Five domains, observability, evaluativeness, and the unique perspective of the self. Journal of Personality 1993, 61:521-551. doi: 10.1111/j.1467-6494.1993.tb00781.x.
41. Jones E.E. The rocky road from acts to dispositions. American Psychologist 1979, 34:107-117. doi: 10.1037/0003-066X.34.2.107.
42. Judge T.A., Heller D., Mount M.K. Five-factor model of personality and job satisfaction: A meta-analysis. Journal of Applied Psychology 2002, 87:530-541. doi: 10.1037/0021-9010.87.3.530.
43. Kenny D.A. A general model of consensus and accuracy in interpersonal perception. Psychological Review 1991, 98:155-163. doi: 10.1037/0033-295X.98.2.155.
44. Kenny D.A. PERSON: A general model of interpersonal perception. Personality and Social Psychology Review 2004, 8:265-280. doi: 10.1207/s15327957pspr0803_3.
45. Kenny D.A., Albright L. Accuracy in interpersonal perception: A social relations analysis. Psychological Bulletin 1987, 102:390-402. doi: 10.1037/0033-2909.102.3.390.
46. Kenny D.A., Albright L., Malloy T.E., Kashy D.A. Consensus in interpersonal perception: Acquaintance and the Big Five. Psychological Bulletin 1994, 116:245-258. doi: 10.1037/0033-2909.116.2.245.
47. Kenny D.A., La Voie L. The social relations model. Advances in experimental social psychology 1984, 18:142-182. Academic Press, Orlando, FL. L. Berkowitz (Ed.).
48. Kenny D.A., Winquist L. The measurement of interpersonal sensitivity: Consideration of design, components, and unit of analysis. Interpersonal sensitivity: Theory and measurement 2001, 265-302. Erlbaum, Mahwah, NJ. J.A. Hall, F.J. Bernieri (Eds.).
49. Kenrick D.T., Funder D.C. Lessons from the person-situation debate. American Psychologist 1988, 43:23-34. doi: 10.1037/0003-066X.43.1.23.
50. Klonsky E., Oltmanns T.F., Turkheimer E. Informant-reports of personality disorder: Relation to self-reports and future research directions. Clinical Psychology: Science and Practice 2002, 9:300-311. doi: 10.1093/clipsy/9.3.300.
51. Krueger R.F., Caspi A., Moffitt T.E., Silva P.A., McGee R. Personality traits are differentially linked to mental disorders: A multitrait-multidiagnosis study of an adolescent birth cohort. Journal of Abnormal Psychology 1996, 105:299-312. doi: 10.1037/0021-843X.105.3.299.
52. Krueger R.F., Tackett J.L. Personality and psychopathology: Working toward the bigger picture. Journal of Personality Disorders 2003, 17:109-128. doi: 10.1521/pedi.17.2.109.23986.
53. Kuncel N.R., Hezlett S.A., Ones D.S. A comprehensive meta-analysis of the predictive validity of the Graduate Record Examinations: Implications for graduate student selection and performance. Psychological Bulletin 2001, 127:162-181. doi: 10.1037/0033-2909.127.1.162.
54. Kurtz J.E., Sherker J.L. Relationship quality, trait similarity, and self-other agreement on personality ratings in college roommates. Journal of Personality 2003, 71:21-48. doi: 10.1111/1467-6494.t01-1-00005.
55. Lahey B.B. Public health significance of neuroticism. American Psychologist 2009, 64:241-256. doi: 10.1037/a0015309.
56. Lievens F., De Corte W., Schollaert E. A closer look at the frame-of-reference effect in personality scale scores and validity. Journal of Applied Psychology 2008, 93:268-279. doi: 10.1037/0021-9010.93.2.268.
57. Malloy T.E., Kenny D.A. The social relations model: An integrative method for personality research. Journal of Personality 1986, 54:199-225. doi: 10.1111/j.1467-6494.1986.tb00393.x.
58. Malouff J.M., Thorsteinsson E.B., Schutte N.S. The relationship between the five-factor model of personality and symptoms of clinical disorders: A meta-analysis. Journal of Psychopathology and Behavioral Assessment 2005, 27:101-114. doi: 10.1007/s10862-005-5384-y.
59. Marcus B., Machilek F., Schütz A. Personality in cyberspace: Personal websites as media for personality expressions and impressions. Journal of Personality and Social Psychology 2006, 90:1014-1031. doi: 10.1037/0022-3514.90.6.1014.
60. McCrae R.R., Costa P.T. Social desirability scales: More substance than style. Journal of Consulting and Clinical Psychology 1983, 51:882-888. doi: 10.1037/0022-006X.51.6.882.
61. McCrae R.R., Costa P.T. Validation of the five-factor model of personality across instruments and observers. Journal of Personality and Social Psychology 1987, 52:81-90. doi: 10.1037/0022-3514.52.1.81.
62. McCrae R.R., Costa P.T. Personality trait structure as a human universal. American Psychologist 1997, 52:509-516. doi: 10.1037/0003-066X.52.5.509.
63. McCrae R.R., Costa P.T., Martin T.A., Oryol V.E., Rukavishnikov A.A., Senin I.G., Urbánek T. Consensual validation of personality traits across cultures. Journal of Research in Personality 2004, 38:179-201. doi: 10.1016/S0092-6566(03)00056-4.
64. McCrae R.R., Stone S.V., Fagan P.J., Costa P.T. Identifying causes of disagreement between self-reports and spouse ratings of personality. Journal of Personality 1998, 66:285-313. doi: 10.1111/1467-6494.00013.
65. Mischel W. Personality and assessment 1968, Wiley, New York, NY.
66. Morgeson F.P., Campion M.A., Dipboye R.L., Hollenbeck J.R., Murphy K., Schmitt N. Reconsidering the use of personality tests in personnel selection contexts. Personnel Psychology 2007, 60:683-729. doi: 10.1111/j.1744-6570.2007.00089.x.
67. Mount M.K., Barrick M.R., Strauss J. Validity of observer ratings of the Big Five personality factors. Journal of Applied Psychology 1994, 79:272-280. doi: 10.1037/0021-9010.79.2.272.
68. Munafò M.R., Clark T.G., Moore L.R., Payne E., Walton R., Flint J. Genetic polymorphisms and personality in healthy adults: A systematic review and meta-analysis. Molecular Psychiatry 2003, 8:471-484. doi: 10.1038/sj.mp.4001326.
69. Murphy K.R., Dzieweczynski J.L. Why don't measures of broad dimensions of personality perform better as predictors of job performance?. Human Performance 2005, 18:343-357. doi: 10.1207/s15327043hup1804_2.
70. Nisbett R.E., Ross L. Human inference: Strategies and shortcomings of social judgment 1980, Prentice Hall, Englewood Cliffs, NJ.
71. Nunnally J.C. Psychometric theory 1978, McGraw-Hill, New York, NY.
72. Oltmanns T.F., Friedman J.N., Fiedler E.R., Turkheimer E. Perceptions of people with personality disorders based on thin slices of behavior. Journal of Research in Personality 2004, 38:216-229. doi: 10.1016/S0092-6566(03)00066-7.
73. Oltmanns T.F., Melley A.H., Turkheimer E. Impaired social functioning and symptoms of personality disorders assessed by peer and self-report in a nonclinical population. Journal of Personality Disorders 2002, 16:437-452. doi: 10.1521/pedi.16.5.437.22123.
74. Oltmanns T.F., Turkheimer E., Strauss M.E. Peer assessment of personality traits and pathology in female college students. Assessment 1998, 5:53-65. doi: 10.1177/107319119800500108.
75. Ones D.S., Dilchert S., Viswesvaran C., Judge T.A. In support of personality assessment in organizational settings. Personnel Psychology 2007, 60:995-1027. doi: 10.1111/j.1744-6570.2007.00099.x.
76. Ones D.S., Viswesvaran C. Personality at work: Criterion-focused occupational personality scales used in personnel selection. Personality psychology in the workplace: Decade of behavior 2001, 63-92. American Psychological Association, Washington, DC, doi: 10.1037/10434-003. B.W. Roberts, R. Hogan (Eds.).
77. Ones D.S., Viswesvaran C., Reiss A.D. Role of social desirability in personality testing for personnel selection: The red herring. Journal of Applied Psychology 1996, 81:660-679. doi: 10.1037/0021-9010.81.6.660.
78. Paulhus D.L. Two-component models of socially desirable responding. Journal of Personality and Social Psychology 1984, 46:598-609. doi: 10.1037/0022-3514.46.3.598.
79. Paulhus D.L., Reid D.B. Enhancement and denial in socially desirable responding. Journal of Personality and Social Psychology 1991, 60:307-317. doi: 10.1037/0022-3514.60.2.307.
80. Paulhus D.L., Trapnell P.D. Self-presentation of personality: An agency-communion framework. Handbook of personality: Theory and research 2008, 492-517. Guilford, New York, NY. O.P. John, R.W. Robins, L.A. Pervin (Eds.).
81. Poropat A.E. A meta-analysis of the five-factor model of personality and academic performance. Psychological Bulletin 2009, 135:322-338. doi: 10.1037/a0014996.
82. Riemann R., Angleitner A., Strelau J. Genetic and environmental influences on personality: A study of twins reared together using the self- and peer-report NEO-FFI scales. Journal of Personality 1997, 65:449-475. doi: 10.1111/j.1467-6494.1997.tb00324.x.
83. Roberts B.W., Chernyshenko O.S., Stark S., Goldberg L.R. The structure of Conscientiousness: An empirical investigation based on seven major personality questionnaires. Personnel Psychology 2005, 58:103-139. doi: 10.1111/j.1744-6570.2005.00301.x.
84. Roberts B.W., Kuncel N.R., Shiner R., Caspi A., Goldberg L.R. The power of personality: The comparative validity of personality traits, socioeconomic status, and cognitive ability for predicting important life outcomes. Perspectives on Psychological Science 2007, 2:313-345. doi: 10.1111/j.1745-6916.2007.00047.x.
85. Salgado J.F., Moscoso S. Meta-analysis of interrater reliability of job performance ratings in validity studies of personnel selection. Perceptual and Motor Skills 1996, 83:1195-1201.
86. Salgado J.F., Viswesvaran C., Ones D.S. Predictors used for personnel selection: An overview of constructs, methods and techniques. Handbook of industrial, work and organizational psychology 2002, 165-199. Sage, Thousand Oaks, CA, doi: 10.2466/PMS.83.7.1195-1201. N. Anderson, H.K. Sinangil (Eds.).
87. Saulsman L.M., Page A.C. The five-factor model and personality disorder empirical literature: A meta-analytic review. Clinical Psychology Review 2004, 23:1055-1085. doi: 10.1016/j.cpr.2002.09.001.
88. Scherer K.R. Personality inference from voice quality: The loud voice of extroversion. European Journal of Social Psychology 1978, 8:467-487. doi: 10.1002/ejsp.2420080405.
89. Schmidt F.L., Hunter J.E. The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. Psychological Bulletin 1998, 124:262-274. doi: 10.1037/0033-2909.124.2.262.
90. Schmidt F.L., Hunter J.E. Theory testing and measurement error. Intelligence 1999, 27:183-198. doi: 10.1016/S0160-2896(99)00024-0.
91. Schmidt F.L., Le H., Ilies R. Beyond alpha: An empirical examination of the effects of different sources of measurement error on reliability estimates for measures of individual differences constructs. Psychological Methods 2003, 8:206-224. doi: 10.1037/1082-989X.8.2.206.
92. Schmidt F.L., Oh I.S., Hayes T.L. Fixed-versus random-effects models in meta-analysis: Model properties and an empirical comparison of differences in results. The British Journal of Mathematical and Statistical Psychology 2009, 62:97-128. doi: 10.1348/000711007X255327.
93. Schmit M.J., Ryan A.M., Stierwalt S.L., Powell A.B. Frame of reference effects on personality scale scores and criterion-related validity. Journal of Applied Psychology 1995, 80:607-620. doi: 10.1037/0021-9010.80.5.607.
94. Shen E. The validity of self-estimate. Journal of Educational Psychology 1925, 16:104-107. doi: 10.1037/h0073590.
95. Shrauger J.S., Schoeneman T.J. Symbolic interactionist view of self-concept: Through the looking glass darkly. Psychological Bulletin 1979, 86:549-573. doi: 10.1037/0033-2909.86.3.549.
96. Small E.E., Diefendorff J.M. The impact of contextual self-ratings and observer ratings of personality on the personality-performance relationship. Journal of Applied Social Psychology 2006, 36:297-320. doi: 10.1111/j.0021-9029.2006.00009.x.
97. Spain J.S., Eaton L.G., Funder D.C. Perspectives on personality: The relative accuracy of self versus others for the prediction of emotion and behavior. Journal of Personality 2000, 68:837-867. doi: 10.1111/1467-6494.00118.
98. Starzyk K.B., Holden R.R., Fabrigar L.R., MacDonald T.K. The Personal Acquaintance Measure: A tool for appraising one's acquaintance with any person. Journal of Personality and Social Psychology 2006, 90:833-847. doi: 10.1037/0022-3514.90.5.833.
99. Steel P. The nature of procrastination: A meta-analytic and theoretical review of quintessential self-regulatory failure. Psychological Bulletin 2007, 133:65-94. doi: 10.1037/0033-2909.133.1.65.
100. Sullivan, P. S. (1995). Interpersonal perception in dyadic and group settings: A social relations analysis (Unpublished doctoral dissertation). University of Connecticut, Storrs.
101. Trapmann S., Hell B., Hirn J.O.W., Schuler H. Meta-analysis of the relationship between the Big Five and academic success at university. Zeitschrift für Psychologie/Journal of Psychology 2007, 215:132-151. doi: 10.1027/0044-3409.215.2.132.
102. Vazire S. Informant reports: A cheap, fast, and easy method for personality assessment. Journal of Research in Personality 2006, 40:472-481. doi: 10.1016/j.jrp.2005.03.003.
103. Vernon P. Some characteristics of the good judge of personality. Journal of Social Psychology 1933, 4:42-58.
104. Viswesvaran C., Ones D.S. Measurement error in " Big Five factors" personality assessment: Reliability generalization across studies and measures. Educational and Psychological Measurement 2000, 60:224-235. doi: 10.1177/00131640021970475.
105. Viswesvaran C., Ones D.S., Schmidt F.L. Comparative analysis of the reliability of job performance ratings. Journal of Applied Psychology 1996, 81:557-574. doi: 10.1037/0021-9010.81.5.557.
106. Zillig L.M.P., Hemenover S.H., Dienstbier R.A. What do we assess when we assess a Big Five trait? A content analysis of the affective, behavioral, and cognitive processes represented in the Big Five personality inventories. Personality and Social Psychology Bulletin 2002, 28:847-858. doi: 10.1177/0146167202289013.