Two-step testing in employee selection: Is score inflation a problem?

International Journal of Selection and Assessment

Volumn 16, Issue 2, 2008, Pages 112-120

  Nye, Christopher D ^a   Do, Ben Roy ^a,c   Drasgow, Fritz ^a   Fine, Saul ^b,d  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

^b Career Harmony Inc   (Israel)

^c ROOSEVELT UNIVERSITY   (United States)

^d Midot Systems

Author keywords

[No Author keywords available]

Indexed keywords

EID: 43949146656     PISSN: 0965075X     EISSN: 14682389     Source Type: Journal    
DOI: 10.1111/j.1468-2389.2008.00416.x     Document Type: Article

References (39)

1. Baron, H., Miles, A. Bartram, D. (2000, April) Using online testing to reduce time-to-hire. Paper presented at the 16th Annual Conference of the Society for Industrial and Organizational Psychology, San Diego, CA.
2. Bartram, D. Brown, A. (2004) Online Testing: Mode of administration and the stability of OPQ32i scores. International Journal of Selection and Assessment, 12, 278 284.
3. Bartram, D., Brown, A. Holtzhausen, G. (2005) Online Personality Testing: Is unsupervised administration an issue? Proceedings of the BPS Occupational Psychology Conference, Chesford Grange, January. Leicester, UK : BPS, pp. 199 200.
4. Beaty, J.C., Fallon, J.D., Shepherd, W.J. Barrett, C. (2002, April) Proctored Versus Unproctored Web-Based Administration of a Cognitive Ability Test. Paper presented at the 17th annual conference of the Society for Industrial and Organizational Psychology, Toronto, Canada.
5. Beilock, R. Dimitrova, D.V. (2003) An Exploratory Model of Inter-Country Internet Diffusion. Telecommunications Policy, 27, 237 252.
6. Bock, R.D., Gibbons, R. Muraki, E. (1988) Full-Information Item Factor Analysis. Applied Psychological Measurement, 12, 261 280.
7. Bock, R.D., Gibbons, R., Schilling, S.G., Muraki, E., Wilson, D.T. Wood, R. (2002) TESTFACT 4 [Computer Program]. Chicago, IL : Scientific Software International.
8. Brown, A., Bartram, D., Holtzhausen, G., Carstairs, J. Mylonis, G. (2005, April) Online Personality and Motivation Testing: Is unsupervised administration an issue? Paper presented at the 20th annual conference of the Society for Industrial and Organizational Psychology, Los Angeles, CA.
9. Burke, M.J. (1993) Computerized Psychological Testing, Impacts on Measuring Predictor Constructs and Future Job Behavior. In : Schmitt, N. Borman, W.C. (eds.), Personnel Selection in Organizations. San Francisco : Jossey-Bass, pp. 203 239.
10. Campbell, D.T. Stanley, J.C. (1963) Experimental and Quasi-Experimental Designs for Research. Boston, MA : Houghton Mifflin Company.
11. CareerHarmony (2003) Test Information Catalog. Petach Tikva, Israel : CareerHarmony, Ltd.
12. Chapman, D.S. Webster, J. (2003) The Use of Technologies in the Recruiting, Screening, and Selection Processes for Job Candidates. International Journal of Selection and Assessment, 11, 113 120.
13. Cohen, J. (1977) Statistical Power Analysis for the Behavioral Sciences (rev. edn). Orlando, FL : Academic Press.
14. Do, B.-R., Shepherd, W.J. Drasgow, F. (April, 2005) Measurement Equivalence Across Proctored and Unproctored Administration Modes of Web-Based Measures. Paper presented at the 20th annual conference of the Society for Industrial and Organizational Psychologists, Los Angeles, CA.
15. Dwight, S.A. Feigelson, M.E. (2000) A Quantitative Review of the Effect of Computerized Testing on the Measurement of Social Desirability. Educational and Psychological Measurement, 60, 340 260.
16. Harris, M.M., Hoye, G.V. Lievens, F. (2003) Privacy and Attitudes Towards Internet-Based Selection Systems: A cross-cultural comparison. International Journal of Selection and Assessment, 11, 230 236.
17. Holden, R.R., Wood, L.L. Tomashewski, L. (2001) Do response Time Limitations Counteract the Effect of Faking on Personality Inventory Validity. Journal of Personality and Social Psychology, 81, 160 169.
18. Hough, L.M., Eaton, N.K., Dunnette, M.D., Kamp, J.D. McCloy, R.A. (1990) Criterion-Related Validities of Personality Constructs and the Effect of Response Distortion on those Validities (Monograph). Journal of Applied Psychology, 75, 581 595.
19. International Testing Commission (2006) International Guidelines on Computer-Based and Internet-Delivered Testing: Version 2005. International Journal of Testing, 6, 143 172.
20. Kulik, J.A., Kulik, C.C. Bangert, R.L. (1984) Effects of Practice on Aptitude and Achievement Test Scores. American Educational Research Journal, 21, 435 447.
21. MacFarland, L.A. (2003) Warning Against Faking on a Personality Test: Effects on applicant reactions and personality test scores. International Journal of Selection and Assessment, 11, 265 276.
22. Mead, A.D. Drasgow, F. (1993) Equivalence of Computerized and Paper-and-Pencil Cognitive Ability Tests: A meta-analysis. Psychological Bulletin, 114, 449 458.
23. Miniwatts Marketing Group (2006). Retrieved July 18, 2006, from.
24. Mueller-Hanson, R., Heggestad, E.D. Thornton, G.C. (2003) Faking and Selection: Considering the use of personality from select-in and select-out perspectives. Journal of Applied Psychology, 88, 348 355.
25. Naglieri, J.A., Drasgow, F., Schmite, M., Handler, L., Prifitera, A., Margolis, A. Velasquez, R. (2004) Psychological Testing on the Internet: New problems, old issues. American Psychologist, 59, 150 162.
26. Ones, D.S., Viswesvaran, C. Reiss, A.D. (1996) Role of Social Desirability in Personality Testing for Personnel Selection: The red herring. Journal of Applied Psychology, 81, 660 679.
27. Oswald, F.L., Carr, J.Z. Schmidt, A.M. (2001, April) The Medium and the Message: Dual effects of supervision and web-based testing on measurement equivalence for ability testing and personality measures. Paper presented at the 16th Annual Conference for the Society for Industrial and Organizational Psychology, San Diego, CA.
28. Paulhus, D.L. (1984) Two-Component Models of Socially Desirable Responding. Journal of Personality and Social Psychology, 46, 598 609.
29. Pew Internet and American Life Project (2007) Demographics of Internet Users. Retrieved March 15, 2007, from.
30. Richman, W.L., Kiesler, S., Weisband, S. Drasgow, F. (1999) A Meta-Analytic Study of Social Desirability Distortion on Computer-Administrative Questionnaires, Traditional Questionnaires, and Interviews. Journal of Applied Psychology, 84, 754 775.
31. Rynes, S.L., Bretz, R.D., Jr. Gerhart, B. (1991) The Importance of Recruitment in Job Choice: A different way of looking. Personnel Psychology, 44, 487 521.
32. Schmit, M.J. Ryan, A.M. (1993) The Big Five in Personnel Selection: Factor structure in applicant and nonapplicant populations. Journal of Applied Psychology, 78, 966 974.
33. Segall, D.O. (2001, April) Detecting Test Compromise in High-Stakes Computerized Adaptive Testing: A verification testing approach. Paper presented at the annual meeting of the National Council on Measurement in Education, Seattle, WA.
34. Sinar, E.F. Reynolds, D.H. (2001, April) Applicant Reactions to Internet-Based Selection Techniques. In F. L. Oswald (Chair), Computers=good? How test-user and test-taker perceptions affect technology-based employment testing. Symposium presented at the 16th Annual Conference of the Society for Industrial and Organizational Psychology, San Diego, CA.
35. Sinar, E.F., Reynolds, D.H. Paquet, S.L. (2003) Nothing but 'Net? Corporate Image and Web-Based Testing. International Journal of Selection and Assessment, 11, 150 157.
36. Smith, D.B. Ellingson, J.E. (2002) Substance Versus Style: A new look at social desirability in motivating contexts. Journal of Applied Psychology, 87, 211 219.
37. Tippins, N.T., Beaty, J., Drasgow, F., Gibson, W.M., Pearlman, K., Segall, D.O. Shepherd, W. (2006) Unproctored Internet Testing in Employment Settings. Personnel Psychology, 59, 189 225.
38. Viswesvaran, C. (2003) Introduction to Special Issue: Role of technology in shaping the future of staffing and assessment. International Journal of Selection and Assessment, 11, 107 112.
39. Wiechmann, D. Ryan, A.M. (2003) Reactions to Computerized Testing in Selection Contexts. International Journal of Selection and Assessment, 11, 215 229.