Can software improve marker accuracy at detecting contract cheating? A pilot study of the Turnitin authorship investigate alpha

Assessment and Evaluation in Higher Education

Volumn 45, Issue 4, 2020, Pages 473-482

  Dawson, Phillip ^a   Sutherland Smith, Wendy ^a   Ricksen, Mark ^b  

^a DEAKIN UNIVERSITY   (Australia)

^b Turnitin LLC   (United States)

Author keywords

academic integrity; Cheating; contract cheating; educational technology; marking

Indexed keywords

EID: 85074009416     PISSN: 02602938     EISSN: 1469297X     Source Type: Journal    
DOI: 10.1080/02602938.2019.1662884     Document Type: Article

References (23)

1. Bennett, S., P., Dawson, M., Bearman, E., Molloy, and D., Boud. 2017. “How Technology Shapes Assessment Design: Findings from a Study of University Teachers.” British Journal of Educational Technology 48(2): 672–682. doi:10.1111/bjet.12439.
2. Bretag, T., R., Harper, M., Burton, C., Ellis, P., Newton, P., Rozenberg, S., Saddiqui, and K., van Haeringen. 2018. “Contract Cheating: A Survey of Australian University Students.” Studies in Higher Education: 1–20. doi:10.1080/03075079.2018.1462788.
3. Carmichael, J. J., and M., Weiss. 2019. “Digital Warfare: Machine Learning and Contract Cheating.” Paper presented at ISPIM Connects Ottawa, Ottawa, Canada on 7-10 April 2019. www.ispim.org.
4. Clarke, R., and T., Lancaster. 2007. “Establishing a Systematic Six-Stage Process for Detecting Contract Cheating.” Paper Presented at the 2007 2nd International Conference on Pervasive Computing and Applications, July 26–27.
5. Dawson, P., 2016. “Five Ways to Hack and Cheat with Bring-Your-Own-Device Electronic Examinations.” British Journal of Educational Technology 47(4): 592–600. doi:10.1111/bjet.12246.
6. Dawson, P., and S. L., Dawson. 2018. “Sharing Successes and Hiding Failures: ‘Reporting Bias’ in Learning and Teaching Research.” Studies in Higher Education 43(8): 1405–1416. doi:10.1080/03075079.2016.1258052.
7. Dawson, P., and W., Sutherland-Smith. 2018a. “Can Markers Detect Contract Cheating? Results from a Pilot Study.” Assessment & Evaluation in Higher Education 43(2): 286–293. doi:10.1080/02602938.2017.1336746.
8. Dawson, P., and W., Sutherland-Smith. 2018b. “Can Training Improve Marker Accuracy at Detecting Contract Cheating? a Multi-Disciplinary Pre-Post Study.” Assessment & Evaluation in Higher Education 44 (5):715-725.
9. Ding, S. H. H., B. C. M., Fung, F., Iqbal, and W. K., Cheung. 2018. “Learning Stylometric Representations for Authorship Analysis.” IEEE Transactions on Cybernetics 49(1) 107-12.
10. Grant, T., 2007. “Quantifying Evidence in Forensic Authorship Analysis.” International Journal of Speech, Language and the Law 14(1): 1–25. doi:10.1558/ijsll.v14i1.1.
11. Harper, R., T., Bretag, C., Ellis, P., Newton, P., Rozenberg, S., Saddiqui, and K., van Haeringen. 2018. “Contract Cheating: A Survey of Australian University Staff.” Studies in Higher Education: 1–17. doi:10.1080/03075079.2018.1462789.
12. Holzinger, A., 2016. “Interactive Machine Learning for Health Informatics: When Do we Need the Human-in-the-Loop?.” Brain Informatics 3(2): 119–131. doi:10.1007/s40708-016-0042-6.
13. Juola, P., 2017. “Detecting Contract Cheating via Stylometric Methods.” Plagiarism across Europe and Beyond 2017 — Conference Proceedings, 187–198. Brno, Czech Republic: Mendel University.
14. Lancaster, T., and R., Clarke. 2007. “The Phenomena of Contract Cheating.” In Student Plagiarism in an Online World: Problems and Solutions, edited by T., Roberts, 144–158. Hershey, USA: Idea Group Inc.
15. Lancaster, T., and R., Clarke. 2015. “Contract Cheating: The Outsourcing of Assessed Student Work.” In Handbook of Academic Integrity, edited by T. A., Bretag, 1–14. Singapore: Springer Singapore.
16. Lines, L., 2016. “Ghostwriters Guaranteeing Grades? the Quality of Online Ghostwriting Services Available to Tertiary Students in Australia.” Teaching in Higher Education, 21(8): 889–914.
17. Mackinnon, A., 2000. “A Spreadsheet for the Calculation of Comprehensive Statistics for the Assessment of Diagnostic Tests and Inter-Rater Agreement.” Computers in Biology and Medicine 30(3): 127–134. doi:10.1016/S0010-4825(00)00006-8.
18. Medway, D., S., Roper, and L., Gillooly. 2018. “Contract Cheating in UK Higher Education: A Covert Investigation of Essay Mills.” British Educational Research Journal 44(3): 393–418. doi:10.1002/berj.3335.
19. Mellar, H., R., Peytcheva-Forsyth, S., Kocdar, A., Karadeniz, and B., Yovkova. 2018. “Addressing Cheating in e-Assessment Using Student Authentication and Authorship Checking Systems: Teachers’ Perspectives.” International Journal for Educational Integrity 14(1): 2. doi:10.1007/s40979-018-0025-x.
20. Newcombe, R. G., 2001. “Simultaneous Comparison of Sensitivity and Specificity of Two Tests in the Paired Design: A Straightforward Graphical Approach.” Statistics in Medicine 20(6): 907–915. doi:10.1002/sim.906.
21. Newton, P. M., 2018. “How Common Is Commercial Contract Cheating in Higher Education and Is It Increasing? a Systematic Review.” Frontiers in Education 3(67). doi:10.3389/feduc.2018.00067.
22. Rogerson, A. M., 2017. “Detecting Contract Cheating in Essay and Report Submissions: Process, Patterns, Clues and Conversations.” International Journal for Educational Integrity 13(1): 10. doi:10.1007/s40979-017-0021-6.
23. Sutherland-Smith, W., and K., Dullaghan. 2019. “You Don’t Always Get What You Pay for: User Experiences of Engaging with Contract Cheating Sites.” Assessment & Evaluation in Higher Education, 44(8), 1148–1162.