Internet testing: A natural experiment reveals test score inflation on a high-stakes, unproctored cognitive test

Computers in Human Behavior

Volumn 25, Issue 3, 2009, Pages 738-742

  Carstairs, Jane ^a   Myors, Brett ^b  

^a UNIVERSITY OF WOLVERHAMPTON   (United Kingdom)

^b GRIFFITH UNIVERSITY   (Australia)

Author keywords

Achievement measures; Cheating; Cognitive assessment; Educational measurement; Internet usage

Indexed keywords

ACHIEVEMENT MEASURES; CHEATING; COGNITIVE ASSESSMENT; EDUCATIONAL MEASUREMENT; INTERNET USAGE;

INTERNET;

TESTING;

EID: 65049088008     PISSN: 07475632     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.chb.2009.01.011     Document Type: Article

References (21)

1. Anastasi A., and Urbina S. Psychological testing. 7th ed. (1997), Prentice Hall, New Jersey
2. Bartram D. Assessment in organisations. Applied Psychology: An International Review 53 (2004) 237-259
3. Bartram, D., & Brown, A. (2002). Online testing: Mode of administration and the stability of OPQ 32i scores. Paper presented at the ITC conference on computer-based testing and the internet, Winchester, England.
4. Carlbring P., Brunt S., Bohman S., Austin D., Richards J., Öst L., et al. Internet vs. Paper and pencil administration of questionnaires commonly used in panic/agoraphobia research. Computers in Human Behavior 23 (2007) 1421-1434
5. Coyne I., Warszta T., Beadle S., and Sheehan N. The impact of mode of administration on the equivalence of a test battery: A quasi-experimental design. International Journal of Selection and Assessment 13 (2005) 220-224
6. Herrero J., and Meneses J. Short web-based versions of the perceived stress (PSS) and Center for Epidemiological Studies-Depression (CESD) scales: A comparison to pencil and paper responses among Internet users. Computers in Human Behavior 22 (2006) 830-846
7. Huang H.-M. Do print and web surveys provide the same results?. Computers in Human Behavior 22 (2006) 334-350
8. International Test Commission. International guidelines for test use (2000), International Test Commission, Belgium
9. International Test Commission (2005). International guidelines on computer-based and Internet delivered testing. Belgium: International Test Commission.
10. Lievens, F., & Harris, M. M. (2003). Research on internet recruiting and testing: Current status and future directions. In C. L. Cooper, & I. T. Robinson (Eds.), International review of industrial and organizational psychology (Vol. 18). West Sussex: Wiley.
11. Luce K.H., Winzelberg A.J., Das S., Osborne M.I., Bryson S.W., and Taylor C.B. Reliability of selfreport: Paper versus online administration. Computers in Human Behavior 23 (2007) 1384-1389
12. Mead A.D., and Drasgow F. Equivalence of computerized and paper-and-pencil cognitive ability tests: A meta-analysis. Psychological Bulletin 114 (1993) 449-458
13. Murphy K.R., and Myors B. Statistical power analysis: A simple and general model for traditional and modern hypothesis tests. 2nd ed. (2004), Erlbaum, New Jersey
14. Naglieri J.A., Drasgow F., Schmit M., Handler L., Prifitera A., Margolis A., et al. Psychological testing on the Internet. New problems, old issues. American Psychologist 59 (2004) 150-162
15. Oswald, F. L., Carr, J. Z., & Schmidt, A. M. (2001). The medium and the message: Dual effects of supervision and web-based testing on measurement equivalence for ability and personality measures. Symposium presented at the 16th annual SIOP conference, San Diego.
16. Salgado J.F., and Moscoso S. Internet-based personality testing: Equivalence of measures and assesses' perceptions and reactions. International Journal of Selection and Assessment 11 (2003) 194-205
17. Schmidt, G. R., Barrett, P. T., Dickter, D. N., Fetzer, M.S., Goldman, M., Handler, C.A. et al. (2008). Current issues in internet assessment-the providers' view. Panel discussion at the annual conference of the society for industrial/organizational psychology, San Francisco, CA.
18. Templer K.J., and Lange S.R. Internet testing: Equivalence between proctored lab and unproctored field conditions. Computers in Human Behavior 24 (2008) 1216-1228
19. Tippins N.T., Beaty J., Drasgow F., Gibson W.M., Pearlman K., Segall D.O., et al. Unproctored Internet testing in employment settings. Personnel Psychology 59 (2006) 189-225
20. WebCT (2001). WebCT 3.6 reference manual for designers. Lynnfield, MA: WebCT, Inc.
21. Whitaker B.G. Internet-based attitude assessment: Does gender affect measurement equivalence?. Computers in Human Behavior 23 (2007) 1183-1194