Practical limitations in making decisions regarding the distribution of applicant personality test scores based on incumbent data

Journal of Business and Psychology

Volumn 22, Issue 2, 2007, Pages 123-134

  Bott, Jennifer P ^a   O'Connell, Matthew S ^b   Ramakrishnan, Mano ^c   Doverspike, Dennis ^d  

^a BALL STATE UNIVERSITY   (United States)

^b Select International Inc   (United States)

^c GEORGE WASHINGTON UNIVERSITY   (United States)

^d UNIVERSITY OF AKRON   (United States)

Author keywords

Cutoffs; Faking; Personality tests; Response distortion; Scores; Selection; Utility

Indexed keywords

EID: 33847741343     PISSN: 08893268     EISSN: None     Source Type: Journal    
DOI: 10.1007/s10869-007-9053-x     Document Type: Article

References (57)

1. Alliger, G. M., Lilienfield, S.O., & Mitchell, K. E. (1996). The susceptibility of overt and covert integrity tests to coaching and faking. Psychological Science, 7, 32-39.
2. Barrett, G. V., Phillips, J. S., & Alexander, R. A. (1981). Concurrent and predictive validity designs: A critical reanalysis. Journal of Applied Psychology, 66, 1-6.
3. Barrick, M. R., & Mount, M. K. (1991). The Big Five personality dimensions and job performance: A meta-analysis. Personnel Psychology, 44, 1-26.
4. Bartram, D. (1996). The relationship between ipsatized and normative measures of personality. Journal of Occupational and Organizational Psychology, 69, 25-39.
5. Cascio, W. F. (1998). Applied psychology in human resource management (5th ed.). Upper Saddle River, NJ: Prentice Hall.
6. Cascio, W. F., Alexander, R. A., & Barrett, G. V. (1988). Setting cutoff scores: Legal, psychometric, and professional guidelines. Personnel Psychology, 41, 1-24.
7. Cascio, W. F., Outtz, J. L., Zedeck, S., & Goldstein, I. L. (1991). Statistical implications of six methods of test score use in personnel selection. Human Performance, 4, 233-254.
8. Christiansen, N. D., Goffin, R. D., Johnston, N. G., & Rothstein, M. G. (1994). Correcting the 16PF for faking: Effects on criterion-related validity and individual hiring decisions. Personnel Psychology, 47, 847-860.
9. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
10. Cook C., Heath, F., Thompson, R. L., & Thompson, B. (2001). Score reliability in web- or internet-based surveys: Unnumbered graphic rating scales versus likert-type scales. Educational and Psychological Measurement, 61, 697-706.
11. Costa, P. T., & McCrae, R. R. (1992). The five-factor model of personality and its relevance to personality disorders. Journal of Personality Disorders, 6, 343-359.
12. Crocker, L., & Algina, J. (1986). Introduction to classical and modern test theory. Chicago: Holt, Rinhart, and Winston, Inc.
13. Crowne, D. P., & Marlowe, D. (1960). A new scale of social desirability independent of psychopathology. Journal of Consulting Psychology, 24, 349-354.
14. Cunningham, M. R., Wong, D. T., & Barbee, A. P. (1994). Self-presentation dynamics on overt integrity tests: Experimental studies of the Reid Report. Journal of Applied Psychology, 79, 643-658.
15. Donovan, J. J., Dwight, S. A., & Hurtz, G. M (2003). An assessment of the prevalence, severity, and verifiability of entry-level applicant faking using the randomized response technique. Human Performance, 16, 81-106.
16. Douglas, E. F., McDaniel, M. A., & Snell, A. F. (1996). The validity of non-cognitive measures decays when applicants fake. Academy of Management Proceedings, Cincinnati, Ohio.
17. Dwight, S. A., & Donovan, J. J. (2003). Do warnings not to fake reduce faking? Human Performance, 16, 1-23.
18. Ellingson, J. E., Sackett, P. R., & Hough, L. M. (1999). Social desirability corrections in personality measurement: Issues of applicant comparison and construct validity. Journal of Applied Psychology, 84, 155-166.
19. Fischer, D. G., & Fick, C. (1993). Measuring social desirability: Short forms of the Marlowe-Crowne social desirability scale. Educational and Psychological Measurement, 53, 417-424.
20. Guion, R. M., & Cranny, C. J. (1982). A note on the concurrent and predictive validity designs: A critical reanalysis. Journal of Applied Psychology, 67, 239-244.
21. Hattrup, K., O'Connell, M. S., & Wingate, P. H. (1998). Prediction of multidimensional criteria: Distinguishing task and contextual performance. Human Performance, 11, 305-320.
22. Hattrup, K., O'Connell, M. S., & Labrador, J. R (2005). Incremental validity of locus of control after controlling for cognitive ability and conscientiousness. Journal of Business and Psychology, 19, 461-481.
23. Heggestad, E. D., Morrison, M., Reeve, C. L., & McCloy, R. A. (2006). Forced-choice assessments of personality for selection: Evaluating issues of normative assessment and faking resistance. Journal of Applied Psychology, 91(1), 9-24.
24. Hicks, L. E. (1970). Some properties of ipsative, normative, and forced-choice normative measures. Psychological Bulletin, 74, 167-184.
25. Hoffman, C. C, & Thornton, G. C. (1997). Examining selection utility when competing predictors differ in adverse impact. Personnel Psychology, 50(2), 455-460.
26. Hough, L. M., Eaton, N. K., Dunnette, M. D., & Kamp, J. D. (1990). Criterion-related validities of personality constructs and the effect of response distortion on those validities. Journal of Applied Psychology, 75, 581-595.
27. Johnson, C. E., Wood, R., & Blinkhorn, S. F. (1988). Spuriouser and spuriouser: The use of ipsative personality tests. Journal of Occupational Psychology, 61, 153-162.
28. Kehoe, J. F., & Olson, A. (2005). Cut scores and employment discrimination litigation. In F. Landy (Ed.) Employment discrimination litigation: Behavioral, quantitative, and legal perspectives (pp. 410-449). San Francisco, CA: Jossey-Bass.
29. McFarland, L. A., & Ryan, A. M. (2000). Variance in faking across noncognitive measures. Journal of Applied Psychology, 85(5), 812-821.
30. Motowidlo, S. J., Hooper, A. C., & Jackson, H. L. (2006). A theoretical basis for situational judgment tests. In J. A. Weekly & R. E. Ployhart (Eds.), Situational judgment tests: Theory, measurement, and application (pp. 57-81). Mahwah, MJ: Lawrence Erlbaum Associates.
31. Mueller-Hanson, R., Heggestad, E. D., & Thornton, G. C. III (2003). Faking and selection: Considering the use of personality from select-in and select-out perspectives. Journal of Applied Psychology, 88, 348-355.
32. TM for Manufacturing system. Technical Report: Select International, Inc.
33. O'Connell, M. S., Doverspike, D., Gillikin, S., & Meloun, J. M. (2001). Computer Anxiety: Effects on Computerized Testing and Implications for e.Cruiting. Journal of e.Commerce and Psychology, 1, 25-39.
34. TM for Manufacturing system based on a normative sample. Technical Report, Select International, Inc.
35. O'Connell, M. S., McDaniel, M. A., Grubb, W. L., Hartman, N. S., & Lawrence, A. (2002). Incremental validity of situational judgment tests for task and contextual job performance. Symposium presented at the 17th annual meeting of the Society for Industrial and Organizational Psychology, Toronto, Canada.
36. O'Connell, M. S., & Smith (1999). Normative and validity results for hourly worker assessment scales. Technical report, Select International, Inc.
37. Ones, D. S., & Viswesvaran, C. (2003). Job-specific applicant pools and national norms for personality scales: Implications for range-restriction corrections in validation research. Journal of Applied Psychology, 88(3), 570-577.
38. Ones, D. S., Viswesvaran, C., & Reiss, A. D. (1996). The role of social desirability in personality testing for personnel selection: The red herring. Journal of Applied Psychology, 81, 660-679.
39. Ones, D. S., Viswesvaran, C., & Schmidt, F. L. (1993). Comprehensive meta-analysis of integrity test validities: Findings and implications for personnel selection and theories of job performance. Journal of Applied Psychology, 78, 579-703.
40. Paulhus, D. L. (1984). Two-component models of socially desirable responding. Journal of Personality and Social Psychology, 46, 598-609.
41. Ployhart, R. E., Weekley, J. A., Holtz, B. C., & Kemp, C. (2003). Web-based and paper-and-pencil testing of applicants in a proctored setting: Are personality, biodata, and situational judgment tests comparable? Personnel Psychology, 56, 733-752.
42. Pulakos, E. D., Schmitt, N., Dorsey, D. W., Arad, S., Hedge, J. W., & Borman, W. C. (2002). Predicting adaptive performance: Further tests of a model of adaptability. Human Performance, 15(4), 299-324.
43. Rosse, J. G., Stecher, M. D., Miller, J. L., & Levin, R. A. (1998). The impact of response distortion on preemployment personality testing and hiring decisions. Journal of Applied Psychology, 83, 634-644.
44. Saldago, J. F. (1997). The five factor model of personality and job performance in the European Community. Journal of Applied Psychology, 82(1), 30-43.
45. Schmit, M. J., & Ryan, A. M. (1993). The Big Five in personnel selection: Factor structure in applicant and nonapplicant populations. Journal of Applied Psychology, 78(6), 966-974.
46. Schneider, B. (1987). The people make the place. Personnel Psychology, 40(3), 437-453.
47. SIOP. (1987). Principles for validation and use of personnel selection procedures (3rd ed.), College Park, MD: Society for Industrial and Organizational Psychology.
48. Smith, D. B., Hanges, P. J., & Dickson, M. W. (2001). Personnel selection and the five-factor model: Reexamining the effects of applicant's frame of reference. Journal of Applied Psychology, 86(2), 304-315.
49. Snell, A. F., Sydell, E. J., & Lueke, S. B. (1999). Towards a theory of applicant faking: Integrating studies of deception. Human Resource Management Review, 9(2), 219-242.
50. Stark, S., Chernyshenko, O. S., Chan, K., Lee, W. C., & Drasgow, F. (2001). Effects of the testing situation on item responding: Cause for concern. Journal of Applied Psychology, 86, 943-953.
51. Weekly, J. A., Ployhart, R. E., & Harold, C. M. (2004). Personality and situational judgment tests across applicant and incumbent settings: An examination of validity, measurement, and subgroup differences. Human Performance, 17(4), 433-461.
52. Stewart, G. L., & Carson, K. P. (1995). Personality dimensions and domains of service performance: A field investigation. Journal of Business and Psychology, 9(4), 365-378.
53. Strahan, R., & Gerbasi, K. C. (1972). Short, homogeneous versions of the Marlowe-Crowne social desirability scale. Journal of Clinical Psychology, 28, 191-193.
54. Svyantek, D. J., & Ekeberg, S. E. (2001). Defining practical significance through academic and practitioner collaboration. Current Topics in Management, 6, 25-50.
55. Van Iddekinge, C. H., Raymark, P. H., Eidson, Jr., C. E., & Putka, D. J. (2001, April). Applicant-Incumbent Differences on Personality, Integrity, and Customer Service Measures. Poster presented at the 16th Annual Meeting of the Society for Industrial and Organizational Psychology: San Diego, CA.
56. Viswesvaran, C., & Ones, D. S. (1999). Meta-analyses of fakability estimates: Implications for personality measurement. Educational and Psychological Measurement, 59(2), 197-210.
57. Werner, S. H., Jones, J. W., & Steffy, B. D. (1989). The relationship between intelligence, honesty, and theft admissions. Educational and Psychological Measurement, 49, 921-927.