Measuring the effectiveness of error messages designed for novice programmers

SIGCSE'11 - Proceedings of the 42nd ACM Technical Symposium on Computer Science Education

Volumn , Issue , 2011, Pages 499-504

  Marceau, Guillaume ^a   Fisler, Kathi ^a   Krishnamurthi, Shriram ^b  

^a WORCESTER POLYTECHNIC INSTITUTE   (United States)

^b BROWN UNIVERSITY   (United States)

Author keywords

Error messages; Novice programmers; User studies

Indexed keywords

ERROR MESSAGES; NOVICE PROGRAMMER; PROGRAMMING ENVIRONMENT; RESEARCH METHODS; STUDENT RESPONSE; USER-STUDIES;

COMPUTER PROGRAMMING; EDUCATION COMPUTING; ENGINEERING EDUCATION; STUDENTS;

TEACHING;

EID: 79954446561     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1953163.1953308     Document Type: Conference Paper

References (25)

1. Chabert, J.M. and Higginbotham, T.F. An Investigation of Novice Programmer Errors in IBM 370 (OS) Assembly Language. In Proceedings of the ACM Southeast Regional Conference, pages 319-323. 1976.
2. Cohen, J. A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20(1):37-46, 1960.
3. Coull, N.J. SNOOPIE: Development Of A Learning Support Tool For Novice Programmers Within A Conceptual Framework. PhD Thesis, School of Computer Science, University Of St. Andrews, 2008.
4. Fagin, B.S. and Merkle, L. Quantitative analysis of the effects of robots on introductory Computer Science education. Journal on Educational Resources in Computing, 2(4):1-18, 2002.
5. Findler, R.B., Clements, J., Flanagan, C., Flatt, M., Krishnamurthi, S., Steckler, P., and Felleisen, M. DrScheme: A programming environment for Scheme. Journal of Functional Programming, 12(02):159-182, 2002.
6. Gross, P. and Powers, K. Evaluating assessments of novice programming environments. In Proceedings of the International Workshop on Computing Education Research, pages 99-110. 2005. (Pubitemid 43907620)
7. Hagan, D. and Markham, S. Teaching Java with the BlueJ environment. In Proceedings of Australasian Society for Computers in Learning in Tertiary Education Conference. 2000.
8. Hage, J. and Keeken, P.V. Mining Helium programs with Neon. Technical Report, Department of Information and Computing Sciences, Utrecht University, 2007.
9. Holt, R.C., Wortman, D.B., Barnard, D.T., and Cordy, J.R. SP/k: a system for teaching computer programming. Communications of the ACM, 20(5):301-309, 1977.
10. Hristova, M., Misra, A., Rutter, M., and Mercuri, R. Identifying and correcting Java programming errors for introductory computer science students. In Proceedings of the Symposium on Computer Science Education, pages 153-156. 2003.
11. Jackson, J., Cobb, M., and Carver, C. Identifying Top Java Errors for Novice Programmers. In Proceedings of the Frontiers in Education Conference, pages T4C-24. 2005.
12. Jadud, M.C. A First Look at Novice Compilation Behaviour Using BlueJ. Computer Science Education, 15(1):25-40, 2005.
13. Jadud, M.C. Methods and tools for exploring novice compilation behaviour. In Proceedings of the International Workshop on Computing Education Research, pages 73-84. 2006. (Pubitemid 46645508)
14. Köksal, M.F., Başar, R.E., and Üsküdarli, S. Screen-Replay: A Session Recording and Analysis Tool for DrScheme. Proceedings of the Scheme and Functional Programming Workshop, Technical Report, California Polytechnic State University, CPSLO-CSC-09-03,: 103-110, 2009.
15. Lane, H.C. and VanLehn, K. Intention-based scoring: An approach to measuring success at solving the composition problem. In Proceedings of the Symposium on Computer Science Education, pages 373-377. 2005. (Pubitemid 40821276)
16. Levy, R.B., Ben-Ari, M., and Uronen, P.A. The Jeliot 2000 program animation system. Computers & Education, 40(1):1-15, 2003. (Pubitemid 35464293)
17. Moskal, B., Lurie, D., and Cooper, S. Evaluating the effectiveness of a new instructional approach. In Proceedings of the Symposium on Computer Science Education, pages 75-79. 2004. (Pubitemid 43773202)
18. Murphy, L., Lewandowski, G., McCauley, R., Simon, B., Thomas, L., and Zander, C. Debugging: the good, the bad, and the quirky - a qualitative analysis of novices' strategies. In Proceedings of the Symposium on Computer Science Education, pages 163-167. 2008.
19. Ng Cheong Vee, M., Mannock, K., and Meyer, B. Empirical study of novice errors and error paths in object-oriented programming. In Proceedings of the Conference of the Higher Education Academy, Subject Centre for Information and Computer Sciences, pages 54-58. 2006.
20. Nienaltowski, M., Pedroni, M., and Meyer, B. Compiler Error Messages: What Can Help Novices? In Proceedings of the Technical Symposium on Computer Science Education, pages 168-172. 2008.
21. Pears, A., Seidman, S., Malmi, L., Mannila, L., Adams, E., Bennedsen, J., Devlin, M., and Paterson, J. A survey of literature on the teaching of introductory programming. ACM SIGCSE Bulletin, 39(4):204-223, 2007.
22. Ragonis, N. and Ben-Ari, M. On understanding the statics and dynamics of object-oriented programs. ACM SIGCSE Bulletin, 37(1):226-230, 2005. (Pubitemid 40821242)
23. Rey, J.S. From Alice To BlueJ: A Transition To Java. Master's thesis, School of Computing, Robert Gordon University, 2009.
24. Spohrer, J.C. and Soloway, E. Novice mistakes: are the folk wisdoms correct? Communications of the ACM, 29(7)1986.
25. Van Haaster, K. and Hagan, D. Teaching and Learning with BlueJ: an Evaluation of a Pedagogical Tool. Issues in Informing Science and Information Technology, 1:455-470, 2004.