The magnitude and extent of cheating and response distortion effects on unproctored internet-based tests of cognitive ability and personality

International Journal of Selection and Assessment

Volumn 18, Issue 1, 2010, Pages 1-16

  Arthur, Winfred ^a   Glaze, Ryan M ^a   Villado, Anton J ^a   Taylor, Jason E ^b  

^a TEXAS A AND M UNIVERSITY   (United States)

^b PeopleAnswers Inc   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 77349110473     PISSN: 0965075X     EISSN: 14682389     Source Type: Journal    
DOI: 10.1111/j.1468-2389.2010.00476.x     Document Type: Article

References (39)

1. Arthur W. Report on the Development of an Internet-Administered General Mental Ability Test (with Verbal and Numeric Sub-Scales) 2004, College Station, TX, Winfred Arthur, Jr Consulting
2. Arthur W. ATMA Test-Retest Reliability Study 2005, College Station, TX, Winfred Arthur, Jr Consulting
3. Arthur W. Development and Initial Validation of the PeopleAnswers Personality Inventory 2006, College Station, TX, Winfred Arthur, Jr Consulting
4. Arthur W, Villado AJ, Glaze RM. Evaluating the Effectiveness and Efficacy of the PPI Falsification Scale: Recommendations for its use in the Peopleanswers Assessment System 2007, College Station, TX, Winfred Arthur, Jr Consulting
5. Baron H, Austin J. 2000, Paper Presented at the 15th Annual Conference of the Society for Industrial and Organizational Psychology, New Orleans, LA
6. Barrick MR, Mount MK. The Big Five Personality Dimensions and Job Performance: A meta-analysis. Personnel Psychology 1991, 44:1-26.
7. Birkeland SA, Manson TM, Kisamore JL, Brannick MT, Smith MA. A Meta-Analytic Investigation of Job Applicant Faking on Personality Measures. International Journal of Selection and Assessment 2006, 14:317-335.
8. Booth-Kewley S, Edwards JE, Rosenfeld P. Impression Management, Social Desirability, and Computer Administration of Attitude Questionnaires: Does the computer make a difference? Journal of Applied Psychology 1992, 77:563-566.
9. Burke E. Preserving the Integrity of Online Testing: Symposium Presented at the 23rd Annual Conference of the Society for Industrial and Organizational Psychology, San Francisco, CA. Internet Testing: Current issues, research, solutions, guidelines, and concerns 2008, April, Tippins NP. In, (Chair)
10. Cizek GJ. Cheating on Tests: How to do it, detect it, and prevent it 1999, Mahwah, NJ, Lawrence Erlbaum Associates
11. Dudek FJ. The Continuing Misinterpretation of the Standard Error of Measurement. Psychological Bulletin 1979, 86:335-337.
12. Edens PS, Arthur W. 2000, April, Paper Presented at the 15th Annual Conference of the Society for Industrial and Organizational Psychology, New Orleans, LA
13. Ellingson JE, Sackett PR, Connelly BS. Personality Assessment Across Selection and Development Contexts: Insights into response distortion. Journal of Applied Psychology 2007, 92:386-395.
14. Foster D. Innovative Technologies for Monitoring Test Taker Behavior Online: Symposium Presented at the 23rd Annual Conference of the Society for Industrial and Organizational Psychology, San Francisco, CA. Internet Testing: Current issues, research, solutions, guidelines, and concerns 2008, Tippins NP. In, (Chair)
15. Griffith RL, Chmielowski T, Yoshita Y. Do Applicants Fake? An Examination of the Frequency of Applicant Faking Behavior. Personnel Review 2007, 36:341-355.
16. Guilford JS, Zimmerman WS, Guilford JP. The Guilford-Zimmerman Temperament Survey Handbook: Twenty-five years of research application 1976, San Diego, CA, EdITS Publishers
17. Gulliksen H. Theory of Mental Tests 1950, New York, Wiley
18. Hausknecht JP, Halpert JA, Di Paolo NT, Moriarty-Gerrard MO. Retesting in Selection: A meta-analysis of coaching and practice effects for tests of cognitive ability. Journal of Applied Psychology 2007, 92:373-385.
19. Hogan J, Barrett P, Hogan R. Personality Measurement, Faking, and Employment Selection. Journal of Applied Psychology 2007, 92:1270-1285.
20. Hough LM. Effects of Intentional Distortion in Personality Measurement and Evaluation of Suggested Palliatives. Human Performance 1998, 11:209-244.
21. Hough LM, Eaton NL, Dunnette MD, Kamp JD, McCloy RA. Criterion-Related Validities of Personality Constructs and the Effect of Response Distortion on Those Validities. Journal of Applied Psychology 1990, 75:581-595.
22. Hough LM, Oswald FL. Personality Testing and Industrial-Organizational Psychology: Reflections, progress, and prospects. Industrial and Organizational Psychology: Perspectives on Science and Practice 2008, 1:271-290.
23. Jackson DN, Messick SJ. The Differential Personality Inventory (Form L) 1964, Goshen, NY, Research Psychologists Press
24. McBride JR. Innovations in Computer-Based Ability Testing: Promise, problems and perils. Beyond Multiple Choice 1998, 113-129. Hakel MD. In, (ed.), Mahwah, NJ, Lawrence Erlbaum Associates, pp
25. Messick S. Validity of Psychological Assessment: Validation of inferences from persons' responses and performances as scientific inquiry into score meaning. American Psychologist 1995, 50:741-749.
26. Nye CD, Do B, Drasgow F, Fine S. Two-Step Testing in Employee Selection: Is score inflation a problem? International Journal of Selection and Assessment 2008, 16:112-120.
27. Ones DS, Viswesvaran C, Reiss AD. Role of Social Desirability in Personality Testing for Personnel Selection: The red herring. Journal of Applied Psychology 1996, 81:660-679.
28. Paulhus DL. Socially Desirable Responding: The evolution of the construct. The Role of Constructs in Psychological and Educational Measurement 2002, 49-69. Braun HJackson DWiley D. In, (eds), Mahwah, NJ, Lawrence Erlbaum Associates, pp
29. Pearlman K. Unproctored Internet Testing: Practical, legal, and ethical concerns. Industrial and Organizational Psychology: Perspectives on Science and Practice 2009, 2:14-19.
30. Ployhart RE, Weekley JA, Holtz BC, Kemp C. Web-Based and Paper-and-Pencil Testing of Applicants in a Proctored Setting: Are personality, biodata, and situational judgment tests comparable? Personnel Psychology 2003, 56:733-752.
31. Potosky D, Bobko P. Computer Versus Paper-and-Pencil Administration Mode and Response Distortion in Noncognitive Selection Tests. Journal of Applied Psychology 1997, 82:293-299.
32. Potosky D, Bobko P. Selection Testing Via the Internet: Practical considerations and exploratory empirical findings. Personnel Psychology 2004, 57:1003-1034.
33. Richman WL, Kiesler S, Weisband S, Drasgow F. A Meta-Analytic Study of Social Desirability in Computer-Administered Questionnaires, Traditional Questionnaires, and Interviews. Journal of Applied Psychology 1999, 84:754-755.
34. Schmitt N, Oswald FL. The Impact of Corrections for Faking on the Validity of Noncognitive Measures in Selection Settings. Journal of Applied Psychology 2006, 91:613-621.
35. Tippins NP. Internet Alternatives to Traditional Proctored Testing: Where are we now? Industrial and Organizational Psychology: Perspectives on Science and Practice 2009, 2:2-10.
36. Tippins NP, Beaty J, Drasgow F, Wade MW, Pearlman K, Segall DO, Shepherd W. Unproctored Internet Testing in Employment Settings. Personnel Psychology 2006, 59:189-225.
37. Viswesvaran C, Ones DS. Meta-Analyses of Fakability Estimates: Implications for personality measurement. Educational and Psychological Measurement 1999, 59:197-210.
38. Whitley BE. Factors Associated with Cheating Among College Students: A review. Research in Higher Education 1998, 39:235-274.
39. Wilkerson JM, Nagao DH, Martin CL. Socially Desirable Responding in Computerized Questionnaires: When questionnaire purpose matters more than the mode. Journal of Applied Social Psychology 2002, 32:544-559.