Automatic Test-Based Assessment of Programming: A Review

ACM Journal on Educational Resources in Computing

Volumn 5, Issue 3, 2005, Pages 4-

  Douce, Christopher ^a   Livingstone, David ^b   Orwell, James ^b  

^a Feedback Instruments   (United Kingdom)

^b KINGSTON UNIVERSITY   (United Kingdom)

Author keywords

computer based training; Design; Documentation; Education; learning; Measurement; Performance; programming assessment

Indexed keywords

COMPUTER SCIENCE; CURRICULA; EDUCATION; LEARNING SYSTEMS; RESEARCH AND DEVELOPMENT MANAGEMENT;

AUTOMATIC ASSESSMENT SYSTEMS; COMPUTER-BASED TRAINING; PROGRAMMING ASSESSMENT;

COMPUTER PROGRAM LISTINGS;

EID: 33749351359     PISSN: 15314278     EISSN: 15314278     Source Type: Journal    
DOI: 10.1145/1163405.1163409     Document Type: Article

References (34)

1. Beck, K. 2003. Test Driven Development: By Example. Addison-Wesley, Boston, MA.
2. Daly, C. And Horgan, J. 2005. Patterns of plagiarism. In Proceedings of the 36th SIGCSE Technical Symposium on Computer Science Education.
3. Daly, C. And Waldron, J. 2004. Assessing the assessment of programming ability. In Proceedings of the 35th SIGCSE Technical Symposium on Computer Science Education. 210-213.
4. Daly, C. 1999 RoboProf and an introductory computer programming course. In Proceedings of the 4th Annual SIGCSE/SIGCUE ITiCSE Conference on Innovation and Technology in Computer Science Education. 155-158.
5. Edwards, S. H. 2003a Using test-driven development in the classroom: providing students with automatic, concrete feedback on performance. In Proceedings of the International Conference on Education and Information Systems: Technologies and Applications. 421-426.
6. Edwards, S. H. 2003b. Teaching software testing: Automatic grading meets test-first coding. In Proceedings of the OOPSLA’03 Conference. Poster presentation. 318-319.
7. English, J. 2004. Automated Assessment of GUI Programs using JEWL. Proceedings of the 9th Annual SIGCSE Conference on Innovation and Technology in Computer Science Education. 131-141.
8. English, J. 2002. Experience with a computer-assisted formal programming examination. ACM SIGCSE Bull. 34, 3: Proceedings of the 7th Annual Conference on Innovation and Technology in Computer Science Education. 51-54.
9. English, J. And Siviter, P. 2000. Experience with an automatically assessed course. In Proceedings of the 5th Annual SIGCSE Conference on Innovation and Technology in Computer Science Education. 168-171.
10. Forsythe, G. E. And Wirth, N. 1965. Automatic grading programs. Commun. ACM 8, 5, 275-529.
11. Gehringer, E. F. 2001. Electronic peer review and peer grading in computer-science courses. In Proceedings of the 32nd SIGCSE Technical Symposium on Computer Science Education. 139-143.
12. Hext, J. B. And Winings, J. W. 1969. An automatic grading scheme for simple programming exercises. Commun. ACM 12, 5, 272-275.
13. Higgins, C., Hegazy, T., Symeonidis, P., And Tsintsifas, A. 2003. The CourseMaster CBA system: Improvements over Ceilidh. J. Edu. Inf.Technol. 8, 3, 287-304.
14. Hollingsworth, J. 1960. Automatic graders for programming classes. Commun. ACM 3, 10, 528-529.
15. Hung, S.-L., Kwok, L. F., And Chan, R. 1993. Automatic programming assessment. Comput. Edu. 20, 2, 183-190.
16. Isaacson, P. C. And Scott, T. A. 1989. Automating the execution of student programs. SIGCSE Bull. 21, 2, 15-22.
17. Jackson, D. And Usher, M. 1997. Grading student programing using ASSYST. In Technical Symposium on Computer Science Education, Proceedings of the 28th SIGCSE (San Jose, CA), 335-339.
18. Jackson, D. 2000. A semi-automated approach to on-line assessment. In Proceedings of the 5th Annual SIGCSE Conference on Innovation and Technology in Computer Science Education, 164-167.
19. Joy, M. And Luck, M. 1998. Effective electronic marking for on-line assessment. In Proceedings of the 6th Annual Conference on the Teaching of Computing (Dublin City University, Ireland). 134-138.
20. Korhonen, A. And Malmi, L. 2000. Algorithm simulation with automatic assessment. In Proceedings of the 5th Annual SIGCSE/SIGCUE ItiCSE Conference on Innovation and Technology in Computer Science Education. 160-163.
21. Korhonen, A., Malmi, L., Myllyselk, P., And Scheinin, P. 2002. Does it make a difference if students exercise on the web or in the classroom? In Proceedings of the 7th Annual SIGCSE/SIGCUE Conference on Innovation and Technology in Computer Science Education, ITiCSE02 (Aarhus, Denmark), ACM Press, New York, 121-124.
22. Leal, J. P. And Moreira, N. 1998. Automatic grading of programming exercises. Tech. Rep. DCC-98-4, Dep. di Ciência de Computadores, Universidade do Porto, Portugal.
23. Luck, M. And Joy, M.S. 1999. A secure on-line submission system. Softw. Pract. Exper. 29, 8, 721-740.
24. Mitrovic, A., Martin, B., And Mayo, M. 2000. Using evaluation to shape ITS design: Results and experiences with SQL-tutor. In User Modeling and User- Adapted Interaction 12. 243-279.
25. Naur, P. 1964. Automatic grading of students’ ALGOL programming. BIT 4, 177-188.
26. Oliver, R. G. 1998. Experience of assessing programming assignments by computer. In Computer Based Assessment Volume 2: Case Studies in Science and Computing. D. Charman and A. Elmes, eds., University of Plymouth. 45-49.
27. Reek, K. A. 1989. The TRY system - or - how to avoid testing student programs. SIGCSE Bull. 21, 1, 112-116.
28. Saikkonen, R., Malmi, L., and Korhonen, A. 2001. Fully automatic assessment of programming exercises. In Proceedings of the ITiCSE 2001 Conference, ACM Press, New York, 133-136.
29. Smythe, C., et al. 2005. IMS question and test interoperability, Ver. 2.0, IMS Global Learning Consortium.
30. Sykes, E. R. And Franek, F. 2004. A prototype for an intelligent tutoring system for students learning to program in Java. Int. J. Comput.Appl. 1, 35-44.
31. Thoburn, G. And Row, G. 1996. PASS - An automated program assessment system. In Proceedings of the 4th Annual Conference on the Teaching of Computing (Centre for Teaching Computing, Dublin City University).R. Rory O’Connor and S. Alexander, eds.
32. Von Matt, U. 1994. Kassandra: The automatic grading system. Tech. Rep.UMIACS-TR-94-59, Institute for Advanced Computer Studies, Dept. of Computer Science, University of Maryland.
33. Wilson, S., Blinco, K., And Rehak, D. 2004. Service-oriented frameworks: Modelling the infrastructure for the next generation of e-learning systems. JISC-CETIS. Available from JISC.
34. Woit, D. And Mason, D. 2003. Effectiveness of on-line assessment. In Proceedings of the 34th SIGCSE Technical Symposium on Computer Science Education. 137-141.