A comparison of human and computer marking of short free-text student responses

Computers and Education

Volumn 55, Issue 2, 2010, Pages 489-499

  Butcher, Philip G ^a   Jordan, Sally E ^a  

^a OPEN UNIVERSITY   (United Kingdom)

Author keywords

Authoring tools and methods

Indexed keywords

AUTHORING TOOLS AND METHODS; COMPUTERISED SYSTEMS; HIGH QUALITY; REGULAR EXPRESSIONS; STUDENT RESPONSE;

COMPUTATIONAL LINGUISTICS;

EID: 77953132417     PISSN: 03601315     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.compedu.2010.02.012     Document Type: Article

References (18)

1. Attali Y., and Burstein J. Automated essay scoring with e-rater® V.2. Journal of Technology, Learning and Assessment 4 3 (2006)
2. Butcher P.G. OpenMark examples (2006). http://www.open.ac.uk/openmarkexamples
3. Butcher P.G., Swithenby S.J., and Jordan S.E. eAssessment and the independent learner. 23rd ICDE World Conference on Open Learning and Distance Education, 7-10 June 2009, Maastricht, The Netherlands. Available from (2009). http://www.open.ac.uk/colmsct/resources
4. Frean A. GCSE and A level exam results inaccurate, Ofqual warns pupils. Retrieved 05.05.09 from (2008). http://www.timesonline.co.uk/tol/life_and_style/education/article3941601.ece
5. Gibbs G., and Simpson C. Conditions under which assessment supports students' learning. Learning and Teaching in Higher Education 1 (2004) 3-31
6. Jordan S., and Mitchell T. E-assessment for learning? The potential of short free-text questions with tailored feedback. British Journal of Educational Technology 40 2 (2009) 371-385
7. Leacock C., and Chodorow M. C-rater: automated scoring of short-answer questions. Computers and Humanities 37 4 (2003) 389-405
8. Mitchell T., Aldridge N., Williamson W., and Broomhead P. Computer based testing of medical knowledge. 10th computer assisted assessment conference, Loughborough, July 2003. Retrieved 05.05.09 from (2003). http://www.caaconference.com/pastConferences/2003/proceedings/index.asp
9. Mitchell T., Russell T., Broomhead P., and Aldridge N. Towards robust computerised marking of free-text responses. 6th International CAA Conference, Loughborough, UK. Retrieved 05.05.09 from (2002). http://www.caaconference.com/pastConferences/2002/proceedings/index.asp
10. Nicol D.J. E-assessment by design: using multiple choice tests to good effect. Journal of Further and Higher Education 31 1 (2007) 53-64
11. Orrell J. Assessment beyond belief: the cognitive process of grading. In: Havnes A., and McDowell L. (Eds). Balancing dilemmas in assessment and learning in contemporary education (2008), Routledge, London 251-263
12. Pearson. Intelligent essay assessor. Retrieved 21.12.09 from (2009). http://www.knowledge-technologies.com/prodIEA.shtml
13. Pulman, S., & Sukkarieh, J. (2005) Automatic short answer marking. Proceedings of the 2nd Workshop on Building Educational Applications Using NLP, Ann Arbor, June 2005.
14. Rézeau J. Regular expression short answer question type for moodle (2008). http://docs.moodle.org/en/Question_types
15. Ross S.M., Jordan S.E., and Butcher P.G. Online instantaneous and targeted feedback for remote learners. In: Bryan C., and Clegg K.V. (Eds). Innovative assessment in higher education (2006), Routledge, London 123-131
16. Siddiqi, R., & Harrison, C. J. (2008) On the automated assessment of short free-text responses. Paper presented at the 34th International Association for Educational Assessment (IAEA) Annual Conference, Cambridge, UK, September 2008.
17. Sukkarieh, J. Z., Pulman, S. G., & Raikes, N. (2003) Auto-marking: using computational linguistics to score short, free-text responses. Paper presented at the 29thth International Association for Educational Assessment (IAEA) Annual Conference, Manchester.
18. Sukkarieh, J. Z., Pulman, S. G., & Raikes, N. (2004) Auto-marking 2: using computational linguistics to score short, free-text responses. Paper presented at the 30thth International Association for Educational Assessment (IAEA) Annual Conference, Philadephia.