Assessing within-person personality variability via frequency estimation: More evidence for a new measurement approach

Journal of Research in Personality

Volumn 45, Issue 6, 2011, Pages 535-548

  Fleisher, Matthew S ^a   Woehr, David J ^b   Edwards, Bryan D ^c   Cullen, Kristin L ^d  

^a HUMAN RESOURCES RESEARCH ORGANIZATION   (United States)

^b UNIVERSITY OF NORTH CAROLINA AT CHARLOTTE   (United States)

^c OKLAHOMA STATE UNIVERSITY   (United States)

^d AUBURN UNIVERSITY   (United States)

Author keywords

Consistency; Intraindividual variability; Measurement; Reliability; Validity

Indexed keywords

EID: 81455158942     PISSN: 00926566     EISSN: 10957251     Source Type: Journal    
DOI: 10.1016/j.jrp.2011.06.009     Document Type: Article

References (88)

1. Allport G.W. Personality: A psychological interpretation 1937, Holt, New York.
2. Amelang M., Borkenau P. The trait concept: Current theoretical considerations, empirical facts, and implications for personality inventory construction. Personality assessment via questionnaires 1986, 7-34. Springer, Berlin. A. Angleitner, J.S. Wiggins (Eds.).
3. Arthur W., Woehr D.J., Graziano W.G. Personality testing in employment settings: Problems and issues in the application of typical selection practices. Personnel Review 2001, 30:657-676.
4. Back M.D., Schmukle S.C., Egloff B. Predicting actual behavior from the explicit and implicit self-concept of personality. Journal of Personality and Social Psychology 2009, 97:533-548.
5. Baird B.M., Le K., Lucas R.E. On the nature of intraindividual personality variability: Reliability, validity, and associations with well-being. Journal of Personality and Social Psychology 2006, 90:512-527.
6. Barrick M.R., Mount M.K. The Big Five personality dimensions and job performance. Personnel Psychology 1991, 44:1-26.
7. Barrick M.R., Mount M.K., Judge T.A. Personality and performance at the beginning of the new millennium: What do we know and where do we go next?. International Journal of Selection and Assessment 2001, 9:9-30.
8. Barrick M.R., Stewart G.L., Piotrowski M. Personality and job performance: Test of the mediating effects of motivation among sales representatives. Journal of Applied Psychology 2002, 87:43-51.
9. Baumeister R.F. On the stability of variability: Retest reliability of metatraits. Personality and Social Psychology Bulletin 1991, 17:633-639.
10. Baumeister R.F., Tice D.M. Metatraits. Journal of Personality 1988, 56:571-598.
11. Bell S.T. Deep-level composition variables as predictors of team performance: A meta-analysis. Journal of Applied Psychology 2007, 92:595-615.
12. Bem D.J., Allen A. On predicting some of the people some of the time: The search for cross-situational consistencies in behavior. Psychological Review 1974, 81:506-520.
13. Biesanz J.C., West S.G. Personality coherence: Moderating self-other profile agreement and profile consensus. Journal of Personality and Social Psychology 2000, 79:425-437.
14. Biesanz J.C., West S.G., Graziano W.G. Moderators of self-other agreement: Reconsidering temporal consistency in personality. Journal of Personality and Social Psychology 1998, 75:467-477.
15. Bing M.N., Whanger J.C., Davison H.K., VanHook J.B. Incremental validity of the frame-of-reference effect in personality scale scores: A replication and extension. Journal of Applied Psychology 2004, 89:1185-1203.
16. Bonett D.G. Sample size requirements for comparing two alpha coefficients. Applied Psychological Measurement 2003, 27:72-74.
17. Bono J., Judge T. Personality and transformational and transactional leadership: A meta-analysis. Journal of Applied Psychology 2004, 89:901-910.
18. Brown K.W., Moskowitz D.S. Dynamic stability of behavior: The rhythms of our interpersonal lives. Journal of Personality 1998, 66:105-134.
19. Button S.B., Mathieu J.E., Zajac D.M. Goal orientation in organizational research: A conceptual and empirical foundation. Organizational Behavior and Human Decision Processes 1996, 67:26-48.
20. Cacioppo J.T., Petty R.E. The need for cognition. Journal of Personality and Social Psychology 1982, 42:116-131.
21. Cervone D. The architecture of personality. Psychological Review 2004, 111:183-204.
22. Cohen J., Cohen P., West S.G., Aiken L.S. Applied multiple regression/ correlation analysis for the behavioral sciences 2003, Lawrence Erlbaum Associates, Mahwah, NJ. 2nd ed.
23. Cosmides L., Tooby J. Are humans good intuitive statisticians after all? Rethinking some conclusions from the literature on judgment under uncertainty. Cognition 1996, 58:1-73.
24. Costa P.T., McCrae R.R. NEO PI-R professional manual 1992, Psychological Assessment Resources, Odessa, FL.
25. Deadrick D.L., Gardner D.G. Distributional ratings of performance levels and variability: An examination of rating validity in a field setting. Group and Organization Management 1997, 22:317-342.
26. Edwards B.D., Woehr D.J. Examination and evaluation of frequency estimation based personality measurement. Personality and Individual Differences 2007, 43:803-814.
27. Elliot A.J., Church M.A. A hierarchical model of approach and avoidance achievement motivation. Journal of Personality and Social Psychology 1997, 72:218-232.
28. Fisher C. Mood and emotions while working: Missing pieces of job satisfaction?. Journal of Organizational Behavior 2000, 21:185-202.
29. Fleeson W. Toward a structure- and process-integrated view of personality: Traits as density distributions of states. Journal of Personality and Social Psychology 2001, 80:1011-1027.
30. Fleeson W. Situation-based contingencies underlying trait-content manifestation in behavior. Journal of Personality 2007, 75:825-862.
31. Fleeson W., Gallagher P. The implications of Big Five standing for the distribution of trait manifestation in behavior: Fifteen experience-sampling studies and a meta-analysis. Journal of Personality and Social Psychology 2009, 97:1097-1114.
32. Fleeson W., Leicht C. On delineating and integrating the study of variability and stability in personality psychology: Interpersonal trust as illustration. Journal of Research in Personality 2006, 40:5-20.
33. Fleeson W., Malanos A., Achille N. An intra-individual, process approach to the relationship between extraversion and positive affect: Is acting extraverted as " good" as being extraverted?. Journal of Personality and Social Psychology 2002, 83:1409-1422.
34. Gibbons A.M., Rupp D.E. Dimension consistency as an individual difference: A new (old) perspective on the assessment center construct validity debate. Journal of Management 2009, 35:1154-1180.
35. Gigerenzer G. How to make cognitive illusions disappear: Beyond " heuristics and biases" European Review of Social Psychology 1991, 2:83-115.
36. Goldberg L.R. The development of markers for the Big-Five factor structure. Psychological Assessment 1992, 4:26-42.
37. Goldberg L.R. A broad-bandwidth, public-domain, personality measuring the lower level facets of several five factor models. Personality psychology in Europe 1999, Vol. 7:7-28. Tilburg University Press, Tilburg, the Netherlands.
38. Heggestad, E. D., Gordon, H., and Reeve, C. L. (2009). Do contextualized personality measures predict personality in context? In B. A. Scott (Chair.), Personality and within-individual relationships: New research findings and directions. Symposium conducted at the annual meeting of the Society for Industrial and Organizational Psychology, New Orleans, LA.
39. Hogan J., Holland B. Using theory to evaluate personality and job-performance relations: A socioanalytic perspective. Journal of Applied Psychology 2003, 88:100-112.
40. Holden R.R. Socially desirable responding does moderate personality scale validity both in experimental and in nonexperimental contexts. Canadian Journal of Behavioural Science 2007, 39:184-201.
41. Holden R.R. Underestimating the effects of faking on the validity of self-report personality scales. Personality and Individual Differences 2008, 44:311-321.
42. Hough L.M. The " Big Five" personality variables-construct confusion: Description versus prediction. Human Performance 1992, 5:139-155.
43. Hough L.M., Eaton N.K., Dunnette M.D., Kamp J.D., McCloy R.A. Criterion-related validities of personality constructs and the effect of response distortion on those validities. Journal of Applied Psychology Monograph 1990, 75:581-595.
44. Huang, J. L., and Ryan, A. M. (2009). Examining personality states and situations in customer service jobs. In B. A. Scott (Chair.), Personality and within-individual relationships: New research findings and directions. Symposium conducted at the annual meeting of the Society for Industrial and Organizational Psychology, New Orleans, LA, April.
45. Hurtz G.M., Donovan J.J. Personality and job performance: The Big Five revisited. Journal of Applied Psychology 2000, 85:869-879.
46. International Personality Item Pool (2008). A scientific collaboratory for the development of advanced measures of personality traits and other individual differences. Retrieved 19.08.08. http://ipip.ori.org/.
47. James L.R. Measurement of personality via conditional reasoning. Organizational Research Methods 1998, 1:131-163.
48. James L.R., Demaree R.G., Wolf G. Estimating within-group interrater reliability with and without response bias. Journal of Applied Psychology 1984, 69:85-98.
49. James L.R., Mazerolle M.D. Personality in work organizations 2002, Sage Publications, Thousand Oaks, CA.
50. James L.R., McIntyre M.D., Glisson C.A., Green P.D., Patton T.W., LeBreton J.M., et al. A conditional reasoning measure for aggression. Organizational Research Methods 2005, 8:69-99.
51. John, O. P., Donahue, E. M., and Kentle, R. L. (1991). The Big Five inventory - Versions 4a and 54. Berkley, CA: University of California, Berkley, Institute of Personality and Social Research.
52. Judge T., Ilies R., Scott B. Work-family conflict and emotions: Effects at work and at home. Personnel Psychology 2006, 59:779-814.
53. Kane J.S. Performance distribution assessment. Performance assessment: Methods and applications 1986, 237-273. Johns Hopkins University Press, Baltimore, MD. R.A. Berk (Ed.).
54. Kane J.S. The conceptualization and representation of total performance effectiveness. Human Resource Management Review 1996, 6:123-145.
55. Kane J.S. Accuracy and its determinants in distributional assessment. Human Performance 2000, 13:47-84.
56. Kane J.S., Lawler E.E. Performance appraisal effectiveness: Its assessment and determinants. Research in organizational behavior 1979, Vol. 1:425-478. JAI Press, Greenwich, CT.
57. Kane J.S., Woehr D.J. Performance measurement reconsidered: An examination of frequency estimation as a basis for assessment. Performance measurement: Current perspectives and future challenges 2006, 237-273. Lawrence Erlbaum Associates, Inc, Hillsdale, NJ. W. Bennett, C. Lance, D.J. Woehr (Eds.).
58. Kanfer R. Motivation theory and industrial and organizational psychology. Handbook of industrial and organizational psychology 1991, 75-170. Consulting Psychologists Press, Palo Alto, CA. M.D. Dunnette, L.M. Hough (Eds.).
59. Kim S., Feldt L.S. A comparison of tests for equality of two or more independent alpha coefficients. Journal of Educational Measurement 2008, 45:179-193.
60. Lubinski D., Humphreys L.G. Assessing spurious 'moderator effects': Illustrated substantively with the hypothesized ('synergistic') relation between spatial and mathematical ability. Psychological Bulletin 1990, 107:385-393.
61. McCrae R.R., Costa P.T. Toward a new generation of personality theories: Theoretical contexts for the five-factor model. The five-factor model of personality 1996, 51-87. Guilford Press, New York. J.S. Wiggins (Ed.).
62. McFarland, L. A. (2000). Toward an integrated model of applicant faking. Unpublished dissertation. Michigan State University.
63. Mischel W. Personality and assessment 1968, John Wiley and Sons, New York.
64. Mischel W., Shoda Y. Reconciling processing dynamics and personality dispositions. Annual Review of Psychology 1998, 49:229-258.
65. Mitchell, T. R. (1997). Matching motivational strategies with organizational contexts. In B. M. Staw and L. L. Cummings (Eds.), Research in organizational behavior (Vol. 19, pp. 57-149). London, UK:Elsevier Limited.
66. Ng, K., Koh, C., Ang, S., Kennedy, J. C., and Chan, K. (in press). Rating leniency and halo in multisource feedback ratings: Testing cultural assumptions of power distance and individualism-collectivism. Journal of Applied Psychology.
67. Paunonen S.V. Trait relevance and the differential predictability of behavior. Journal of Personality 1988, 56:599-619.
68. Paunonen S.V., Jackson D.N. Idiographic measurement strategies for personality and prediction: Some unredeemed promissory notes. Psychological Review 1985, 92:486-511.
69. Payne C.S., Youngcourt S.S., Beaubien J.M. A meta-analytic examination of the goal orientation nomological net. Journal of Applied Psychology 2007, 92:128-150.
70. Peeters M.A.G., Van Tuijl H.F.J.M., Rutte C.G., Reymen I.M.M.J. Personality and team performance: A meta-analysis. European Journal of Personality 2006, 20:377-396.
71. Sadowski C.J., Cogburn H.E. Need for cognition in the Big-Five factor structure. The Journal of Psychology 1997, 131:307-312.
72. Salgado J. The Big Five personality dimensions and counterproductive behaviors. International Journal of Selection and Assessment 2002, 10:117-125.
73. Saucier G. Mini-markers: A brief version of Goldberg's unipolar Big-Five markers. Journal of Personality Assessment 1994, 63:506-516.
74. Schimmack U. Frequency judgments of emotions: The cognitive basis of personality assessment. Frequency processing and cognition 2002, 189-204. Oxford University Press, Inc, New York, NY. P. Sedlmeier, T. Betsch (Eds.).
75. Schmit M.J., Ryan A.M., Stierwalt S.L., Powell A.B. Frame-of-reference effects on personality scale scores and criterion-related validity. Journal of Applied Psychology 1995, 80:607-620.
76. Scott B.A., Colquitt J.A., Paddock E.L., Judge T.A. A daily investigation of the role of manager empathy on employee well-being. Organizational Behavior and Human Decision Processes 2010, 113:127-140.
77. Sedlmeier P., Hertwig R., Gigerenzer G. Are judgments of the positional frequencies of letters systematically biased due to availability?. Journal of Experimental Psychology: Learning, Memory, and Cognition 1998, 24:754-770.
78. SPSS Inc. (2005). mrInterview (Standard) version 3.0. Chicago, IL: SPSS Inc.
79. Stark S., Chernyshenko O.S., Drasgow F. An IRT approach to constructing and scoring pairwise preference items involving stimuli on different dimensions: The multi-unidimensional pairwise-preference model. Applied Psychological Measurement 2005, 29:184-203.
80. Steiner D.D., Rain J.S., Smalley M.M. Distributional ratings of performance: Further examination of a new rating format. Journal of Applied Psychology 1993, 78:438-442.
81. Tversky A., Kahneman D. Availability: A heuristic for judging frequency and probability. Cognitive Psychology 1973, 5:207-232.
82. Tversky A., Kahneman D. Judgment under uncertainty: Heuristics and biases. Science 1974, 185:1124-1131.
83. Uy M.A., Foo M.D., Aguinis H. Using experience sampling methodology to advance entrepreneurship theory and research. Organizational Research Methods 2010, 13:31-54.
84. VandeWalle D. Development and validation of a work domain goal orientation instrument. Education and Psychological Measurement 1997, 57:995-1015.
85. Viswesvaran C., Ones D.S. Meta-analysis of fakability estimates: Implications for personality measurement. Educational and Psychological Measurement 1999, 59:197-210.
86. Weinblatt, N., and Heller, D. (2009). A within-individual examination of work and family role-based personalities. In B. A. Scott (Chair.), Personality and within-individual relationships: New research findings and directions. Symposium conducted at the annual meeting of the Society for Industrial and Organizational Psychology, New Orleans, LA, April.
87. White L.A., Young M.C., Hunter A.E., Rumsey M.G. Lessons learned in transitioning personality measures from research to operational settings. Industrial and Organizational Psychology: Perspectives on Science and Practice 2008, 1:291-295.
88. Woehr D.J., Miller M.J. Distributional ratings of performance: More evidence for a new rating format. Journal of Management 1997, 23:705-720.