Effects of the testing situation on item responding: Cause for concern

Journal of Applied Psychology

Volumn 86, Issue 5, 2001, Pages 943-953

  Stark, Stephen ^a   Chernyshenko, Oleksandr S ^a   Chan, Kim Yin ^b   Lee, Wayne C ^a   Drasgow, Fritz ^a  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

^b Ministry of Defence Government of Singapore   (Singapore)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; FEMALE; FORENSIC MEDICINE; HUMAN; INTERPERSONAL COMMUNICATION; JOB FINDING; MALE; PERSONALITY TEST; PERSONNEL MANAGEMENT; PSYCHOMETRY; VALIDATION STUDY;

ADULT; FEMALE; HUMANS; JOB APPLICATION; LIE DETECTION; MALE; PERSONALITY ASSESSMENT; PERSONNEL SELECTION; PSYCHOMETRICS; TRUTH DISCLOSURE;

EID: 85047685381     PISSN: 00219010     EISSN: None     Source Type: Journal    
DOI: 10.1037/0021-9010.86.5.943     Document Type: Article

References (41)

1. Baker, F. B., Al-Karni, A., & Al-Dosary, I. M. (1991). EQUATE: A computer program for the test characteristic method of IRT equating. Applied Psychological Measurement, 15, 215-222.
2. Barrick, M. R., & Mount, M. K. (1991). The Big Five personality dimensions and job performance: A meta-analysis. Personnel Psychology, 44, 1-26.
3. Birnbaum, A. (1968). Some latent trait models and their use in inferring an examinee's ability. In F. M. Lord & M. R. Novick (Eds.), Statistical theories of mental test scores (pp. 397-472). Reading, MA: Addison-Wesley.
4. Chan, K.-Y., Drasgow, F., & Sawin, L. L. (1999). What is the shelf life of a test? The effect of time on the psychometrics of a cognitive ability test battery. Journal of Applied Psychology, 84, 610-619.
5. Chernyshenko, O. S., Chan, K. Y., Stark, S., Drasgow, F., & Williams, B. (1999, April). Fitting item response theory models to personality data. Paper presented at the 14th Annual Conference of the Society for Industrial and Organizational Psychology, Atlanta, GA.
6. Conn, S. R. (1994). Reliability and equivalency: Comparison of the 16PF fifth edition and fourth edition (Form A). In S. R. Conn & M. L. Rieke (Eds.), The 16PF fifth edition technical manual (pp. 77-99). Champaign, IL: Institute for Personality and Ability Testing.
7. Conn, S. R., & Rieke, M. L. (Eds.). (1994). The 16PF fifth edition technical manual. Champaign, IL: Institute for Personality and Ability Testing.
8. Day, D. V., & Silverman, S. B. (1989). Personality and job performance: Evidence of incremental validity. Personnel Psychology, 42, 25-36.
9. Donovan, M. A., & Drasgow, F. (1999). Do men's and women's experiences of sexual harassment differ? An examination of differential test functioning of the Sexual Experiences Questionnaire. Military Psychology, 11, 265-282.
10. Douglas, E. F., McDaniel, M. A., & Snell, A. (1996, August). The validity of non-cognitive measures decays when applicants fake. Paper presented at the annual conference of the Academy of Management, Cincinnati, OH.
11. Drasgow, F., & Lissak, R. I. (1983). Modified parallel analysis: A procedure for examining the latent dimensionality of dichotomously scored item responses. Journal of Applied Psychology, 68, 363-373.
12. Dunnette, M. D., McCartney, J., Carlson, H. C., & Kirchner, W. K. (1962). A study of faking behavior on a forced-choice or self-descriptive checklist. Personnel Psychology, 15, 13-24.
13. Ellingson, J. E., Smith, D. B., & Sackett, P. R. (1999, April). Investigating the influence of social desirability on personality factor structure. Paper presented at the 14th Annual Conference of the Society for Industrial and Organizational Psychology, Atlanta, GA.
14. Ellis, B. B. (1990). Assessing intelligence cross-nationally: A case for differential item functioning detection. Intelligence, 14, 61-78.
15. Ellis, B. B., Becker, P., & Kimmel, H. D. (1993). An item response theory evaluation of an English version of the Trier Personality Inventory. Journal of Cross-Cultural Psychology, 2, 133-148.
16. Flanagan, W. J., Raju, N. S., & Haygood, J. M. (1998, April). Impression management, measurement equivalence, and personality factors: Can IRT be used to determine the impact of faking? Paper presented at the 13th Annual Conference of the Society for Industrial and Organizational Psychology, Dallas, TX.
17. Gellatly, I. R., Paunonen, S. V., Meyer, J. P., Jackson, D. N., & Goffin, R. D. (1991). Personality, vocational interest, and cognitive predictors of managerial job performance and satisfaction. Personality and Individual Differences, 12, 221-231.
18. Hattie, J. (1985). Methodology review: Assessing unidimensionality of tests and items. Applied Psychological Measurement, 9, 139-164.
19. Hough, L. M., Eaton, N. K., Dunnette, M. D., Kamp, J. D., & McCloy, R. A. (1990). Criterion-related validities of personality constructs and the effect of response distortion on those validities. Journal of Applied Psychology, 75, 581-595.
20. Hulin, C. L., Drasgow, F., & Parsons, C. K. (1983). Item response theory: Applications to psychological measurement. Homewood, IL: Dow Jones Irwin.
21. Kenrick, D. T., & Funder, D. C. (1988). Profiting from controversy: Lessons from the person-situation debate. American Psychologist, 43, 23-34.
22. Kim, S. H., Cohen, A. S., & Park, T. H. (1995). Detection of differential item functioning in multiple groups. Journal of Educational Measurement, 32, 261-276.
23. Kluger, A. N., Reilly, R. R., & Russell, C. J. (1991). Faking biodata tests: Are option-keyed instruments more resistant? Journal of Applied Psychology, 76, 889-896.
24. Lord, F. M. (1980). Applications of item response theory to practical testing problems. Hillsdale, NJ: Erlbaum.
25. Mischel, W. (1968). Personality and assessment. New York: Wiley.
26. Mislevy, R. J., & Bock, R. D. (1991). BILOG users' guide. Chicago: Scientific Software.
27. Montag, I., & Comrey, A. L. (1990). Stability of major personality factors under changing motivational conditions. Journal of Social Behavior and Personality, 5, 265-274.
28. Ones, D. S., Viswesvaran, C., & Reiss, A. D. (1996). Role of social desirability in personality testing for personnel selection: The red herring. Journal of Applied Psychology, 81, 660-679.
29. Raju, N. S., van der Linden, W. J., & Fleer, P. F. (1992, April). An internal measure of test bias with applications for differential item functioning. Paper presented at the annual meeting of the American Educational Research Association, San Francisco, CA.
30. Raju, N. S., van der Linden, W. J., & Fleer, P. F. (1995). IRT-based internal measures of differential functioning of items and tests. Applied Psychological Measurement, 19, 353-368.
31. Rosse, J. G., Stecher, M. D., Miller, J. L., & Levin, R. A. (1998). The impact of response distortion on preemployment personality testing and hiring decisions. Journal of Applied Psychology, 83, 634-644.
32. Schmidt, F. L., & Hunter, J. E. (1998). The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. Psychological Bulletin, 124, 262-274.
33. Schmit, M. J., & Ryan, A. M. (1993). The Big Five in personnel selection: Factor structure in applicant and nonapplicant populations. Journal of Applied Psychology, 78, 966-974.
34. Shealy, R., & Stout, W. (1993). A model-based standardization approach that separates true bias/DIF from group ability differences and detects test bias/DTF as well as item bias/DIF. Psychometrika, 58, 159-194.
35. Snell, A. F., & Sydell, E. J. (1999, April). Do impression management scores adequately measure intentional response distortion? Paper presented at the 14th Annual Conference of the Society for Industrial and Organizational Psychology, Atlanta, GA.
36. Sorbom, D. (1974). A general method for studying differences in factor means and factor structure between groups. British Journal of Mathematical and Statistical Psychology, 27, 229-239.
37. Stark, S. (1999). PAIRDIF3: Pal-wise DIF detection procedure for the 3PL model using Lord's chi-square [Computer software]. Department of Psychology, University of Illinois at Urbana-Champaign.
38. Stocking, M. L., & Lord, F. M. (1983). Developing a common metric in item response theory. Psychological Bulletin, 99, 118-128.
39. Tett, R. P., Jackson, D. N., & Rothstein, M. (1991). Personality measures as predictors of job performance: A meta-analytic review. Personnel Psychology, 44, 703-742.
40. Zickar, M. J., & Drasgow, F. (1996). Detecting faking on a personality instrument using appropriateness measurement. Applied Psychological Measurement, 20, 71-87.
41. Zickar, M. J., Rosse, J., & Levin, R. (1996, April). Modeling the effects of faking on personality scales. Paper presented at the 11th Annual Conference of the Society for Industrial and Organizational Psychology, San Diego, CA.