Detecting answer copying using the kappa statistic

Applied Psychological Measurement

Volumn 30, Issue 5, 2006, Pages 412-431

  Sotaridona, Leonardo ^a,b   Van Der Linden, Wim J ^a   Meijer, Rob R ^a  

^a UNIVERSITY OF TWENTE   (Netherlands)

^b CTB/McGraw Hill   (United States)

Author keywords

Answer copying; Kappa statistic; Power analysis; Type I error

Indexed keywords

EID: 33746584725     PISSN: 01466216     EISSN: 15523497     Source Type: Journal    
DOI: 10.1177/0146621606288891     Document Type: Article

References (21)

1. Agresti, A. (1990). Categorical data analysis. New York: John Wiley.
2. Bay, L. G. (1995, April). Detection of cheating on multiple-choice examinations. Paper presented at the annual meeting of the American Educational Research Association, San Francisco.
3. Bock, R. D. (1972). Estimating item parameters and latent ability when responses are scored in two or more nominal categories. Psychometrika, 46, 443-459.
4. Bock, R. D. (1997). The nominal categories model. In W. J. van der Linden & R. K. Hambleton (Eds.), Handbook of modern item response theory (pp. 33-49). New York: Springer.
5. Casella, G., & Berger, R. L. (2002). Statistical inference (2nd ed.). Pacific Grove, CA: Duxbury.
6. Cizek, G. J. (1999). Cheating on tests: How to do it, detect it, and prevent it. Englewood Cliffs, NJ: Lawrence Erlbaum.
7. Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20, 37-46.
8. Fleiss, J. L., Cohen, J., & Everitt, B. S. (1969). Large-sample standard errors of kappa and weighted kappa. Psychological Bulletin, 72, 323-327.
9. Frary, R. B., Tideman, T. N., & Watts, T. M. (1977). Indices of cheating on multiple-choice tests. Journal of Educational Statistics, 6, 152-165.
10. Hemker, B. T., Sijtsma, K., Molenaar, W., & Junker, B. W. (1996). Polytomous IRT models and monotone likelihood ratio of total score. Psychometrika, 61, 679-693.
11. Hemker, B. T., Sijtsma, K., Molenaar, W., & Junker, B. W. (1997). Stochastic ordering using the latent trait and the sum score in polytomous IRT models. Psychometrika, 62, 331-347.
12. Holland, P. W. (1996). Assessing unusual agreement between the incorrect answers of two examinees using the K-index: Statistical theory and empirical support (Research Report RR-96-4). Princeton, NJ: Educational Testing Service.
13. Lehmann, E. (1999). Elements of large-sample theory. New York: Springer.
14. Lewis, C., & Thayer, D. T. (1998). The power of the K-index (or PMIR) to detect copying (Research Report RR-98-49). Princeton, NJ: Educational Testing Service.
15. Sotaridona, L. S., & Meijer, R. R. (2002). Statistical properties of the K-index for detecting answer copying. Journal of Educational Measurement, 39, 115-132.
16. Sotaridona, L. S., & Meijer, R. R. (2003). Two new statistics to detect answer copying. Journal of Educational Measurement, 40, 53-69.
17. Thissen, D., & Steinberg, L. (1997). A response model for multiple-choice items. In W. J. van der Linden & R. K. Hambleton (Eds.), Handbook of modern item response theory (pp. 51-65). New York: Springer.
18. van der Linden, W. J., & Sotaridona, L. S. (2004). A statistical test for detecting answer copying on multiple-choice tests. Journal of Educational Measurement, 41, 361-377.
19. van der Linden, W. J., & Sotaridona, L. S. (in press). Detecting answer copying when the regular response process follows a polytomous response model. Journal of Educational and Behavioral Statistics, 31-31.
20. Wollack, J. A. (1997). A nominal response model approach to detect answer copying. Applied Psychological Measurement, 21, 307-320.
21. Wollack, J. A., & Cohen, A. S. (1998). Detection of answer copying with unknown item and trait parameters. Applied Psychological Measurement, 22, 144-152.