A Closer Look at the Frame-of-Reference Effect in Personality Scale Scores and Validity

Journal of Applied Psychology

Volumn 93, Issue 2, 2008, Pages 268-279

  Lievens, Filip ^a   De Corte, Wilfried ^a   Schollaert, Eveline ^a  

^a GHENT UNIVERSITY   (Belgium)

Author keywords

criterion related validity; frame of reference; item responding; personality scales; reliability

Indexed keywords

ACHIEVEMENT; ADULT; ARTICLE; FEMALE; HUMAN; MALE; PERSONALITY; PERSONALITY TEST; REPRODUCIBILITY; STUDENT; VALIDATION STUDY;

ACHIEVEMENT; ADULT; FEMALE; HUMANS; MALE; PERSONALITY; PERSONALITY INVENTORY; REPRODUCIBILITY OF RESULTS; STUDENTS;

EID: 41549164282     PISSN: 00219010     EISSN: None     Source Type: Journal    
DOI: 10.1037/0021-9010.93.2.268     Document Type: Article

References (42)

1. Aronson Z.H., and Reilly R.R. Personality validity: The role of schemas and motivated reasoning. International Journal of Selection and Assessment 14 (2006) 372-380
2. Asendorpf J.B., Borkenau P., Ostendorf F., and van Aken M.A.G. Carving personality description at its joints: Confirmation of three replicable personality prototypes for both children and adults. European Journal of Personality 15 (2001) 169-198
3. Bing M.N., Whanger J.C., Davison H.K., and VanHook J.B. Incremental validity of the frame-of-reference effect in personality scale scores: A replication and extension. Journal of Applied Psychology 89 (2004) 150-157
4. Binning J.F., and Barrett G.V. Validity of personnel decisions: A conceptual analysis of the inferential and evidential bases. Journal of Applied Psychology 74 (1989) 478-494
5. Born M.P. Development of a situation-response inventory for managerial selection. International Journal of Selection and Assessment 2 (1994) 45-52
6. Campbell J.P., McCloy R.A., Oppler S.H., and Sager C.E. A theory of performance. In: Schmitt N., and Borman W.C. (Eds). Personnel selection in organizations (1993), Jossey Bass, San Francisco 35-70
7. Cronbach L.J. Essentials of psychological testing. 2nd ed. (1960), Harper & Row, New York
8. De Fruyt F. A person-centered approach to P-E fit questions using a multiple-trait model. Journal of Vocational Behavior 60 (2002) 73-90
9. De Fruyt F., and Mervielde I. Personality and interests as predictors of educational streaming and achievement. European Journal of Personality 10 (1996) 405-425
10. Dudley N.M., Orvis K.A., Lebiecki J.E., and Cortina J.M. A meta-analytic investigation of conscientiousness in the prediction of job performance: Examining the intercorrelations and the incremental validity of narrow traits. Journal of Applied Psychology 91 (2006) 40-57
11. Eid M., and Langeheine R. The measurement of consistency and occasion specificity with latent class models: A new model and its application to the measurement of affect. Psychological Methods 4 (1999) 100-116
12. Feldt L.S. A test of the hypothesis that Cronbach's alpha reliability coefficient is the same for two tests administered to the same sample. Psychometrika 45 (1980) 99-105
13. Feldt L.S., and Ankenmann R.D. Appropriate sample size for comparing alpha reliabilities. Applied Psychological Measurement 22 (1998) 170-178
14. Furnham A., and Jaspars J. The evidence for interaction in psychology: A critical analysis of the situation-response inventories. Personality and Individual Differences 4 (1983) 627-644
15. Goldberg L.R. A broad-bandwidth, public-domain, personality inventory measuring the lower-level facets of several five-factor models. In: Mervielde I., Deary I., De Fruyt F., and Ostendorf F. (Eds). Personality psychology in Europe 7 (1999), Tilburg University Press, Tilburg, The Netherlands 7-28
16. Goldstein H.W., Zedeck S., and Goldstein I.L. g: Is this your final answer?. Human Performance 15 (2002) 123-142
17. Gordon E.D., and Holden R.R. Personality test item validity: Insights from "self" and "other" research and theory. Personality and Individual Differences 25 (1998) 103-117
18. Holden R.R., Fekken G.C., and Cotton D.H.G. Clinical reliabilities and validities of the microcomputerized basic personality inventory. Journal of Clinical Psychology 46 (1990) 845-849
19. Holtz B.C., Ployhart R.E., and Dominguez A. Testing the rules of justice: The effects of frame-of-reference and pretest validity information on personality test responses and test perceptions. International Journal of Selection and Assessment 13 (2005) 75-86
20. Hunthausen J.M., Truxillo D.M., Bauer T.B., and Hammer B.L. A field study of frame-of-reference effects on personality test validity. Journal of Applied Psychology 88 (2003) 545-551
21. Knowles E.S. Item context effects on personality scales. Measuring changes the measure. Journal of Personality and Social Psychology 55 (1988) 312-320
22. Kunda Z., and Sanitioso R. Motivated changes in the self-concept. Journal of Experimental Social Psychology 25 (1989) 272-285
23. Lievens F., Buyse T., and Sackett P.R. The operational validity of a video-based situational judgment test for medical college admissions: Illustrating the importance of matching predictor and criterion construct domains. Journal of Applied Psychology 90 (2005) 442-452
24. McFarland L.A., and Ryan A.M. Variance in faking across noncognitive measures. Journal of Applied Psychology 85 (2000) 812-821
25. McFarland L.A., Ryan A.M., and Ellis A. Item placement on a personality measure: Effects on faking behavior and test measurement properties. Journal of Personality Assessment 78 (2002) 348-369
26. Meng X.L., Rosenthal R., and Rubin D.B. Comparing correlated correlation coefficients. Psychological Bulletin 111 (1992) 172-175
27. Mischel W., and Shoda Y. A cognitive-affective system theory of personality: Reconceptualizing the invariances in personality and the role of situations. Psychological Review 102 (1995) 246-268
28. Motowidlo S.J., Hooper A.C., and Jackson H.L. A theoretical basis for situational judgment tests. In: Weekley J., and Ployhart R. (Eds). Situational judgment tests (2006), Jossey-Bass, San Francisco
29. Murphy K.R., and Davidshofer C.O. Psychological testing: Principles and applications. 5th ed. (2001), Prentice-Hall, Upper Saddle River, NJ
30. Robie C., Schmit M.J., Ryan A.M., and Zickar M.J. Effects of item context specificity on the measurement equivalence of a personality inventory. Organizational Research Methods 3 (2000) 348-365
31. Rogers T.B. Analysis of stages underlying process of responding to personality items. Acta Psychologica 38 (1974) 205-213
32. Rogers T.B. Analysis of two central stages underlying responding to personality items-Self-referent decision and response selection. Journal of Research in Personality 8 (1974) 128-138
33. Rosse J.G., Stecher M.D., Miller J.L., and Levin R.A. The impact of response distortion on preemployment personality testing and hiring decisions. Journal of Applied Psychology 83 (1998) 634-644
34. Sanitioso R., Kunda Z., and Fong G.T. Motivated recruitment of autobiographical memories. Journal of Personality and Social Psychology 59 (1990) 229-241
35. Schmidt F.L., Viswesvaran C., and Ones D.S. Reliability is not validity and validity is not reliability. Personnel Psychology 53 (2000) 901-912
36. Schmit M.J., Ryan A.M., Stierwalt S.L., and Powell A.B. Frame of reference effects on personality scale scores and criterion-related validity. Journal of Applied Psychology 80 (1995) 607-620
37. Schmitt N., Oswald F.L., Kim B.H., Gillespie M.A., Ramsay L.J., and Yoo T. Impact of elaboration on socially desirable responding and the validity of biodata measures. Journal of Applied Psychology 88 (2003) 979-988
38. Sorrentino R.M., and Higgins E.T. Motivation and cognition: Warming to synergism. In: Sorrentino R.M., and Higgins E.T. (Eds). The handbook of motivation and cognition: Foundations of social behavior (1986), Guilford Press, New York 3-10
39. Vey, M. A., Ones, D. S., Hezlett, S. A., Kuncel, N. R., Vannelli, J. R., Briggs, K. H., & Campbell, J. P. (2003, April). Relationships among college grade indices: A meta-analysis examining temporal influences. Paper presented at the 18th annual conference of the Society for Industrial and Organizational Psychology, Orlando, FL.
40. Warr P. Indirect processes in criterion-related validity. Journal of Organizational Behavior 2 (2000) 731-745
41. Wright J.C., and Mischel W. A conditional analysis of dispositional constructs: The local predictability of social behavior. Journal of Personality and Social Psychology 53 (1987) 1159-1177
42. Zickar M.J., Gibby R.E., and Robie C. Uncovering faking samples in applicant, incumbent, and experimental data sets: An application of mixed-model item response theory. Organizational Research Methods 7 (2004) 168-190