Translating principles of effective feedback for students into the CS1 context

ACM Transactions on Computing Education

Volumn 16, Issue 1, 2016, Pages

  Ott, Claudia ^a   Robins, Anthony ^a   Shephard, Kerry ^a  

^a UNIVERSITY OF OTAGO   (New Zealand)

Author keywords

CS1; Effective feedback practice; Higher education

Indexed keywords

EDUCATION; STUDENTS; TEACHING;

COMPUTER SCIENCE EDUCATION; CONTEMPORARY MODELS; EFFECTIVE FEEDBACK PRACTICE; FEEDBACK INTERVENTIONS; FIRST YEAR PROGRAMMING; HIGHER EDUCATION; LEARNING OUTCOME; LEARNING PROCESS;

EDUCATION COMPUTING;

EID: 84964788332     PISSN: None     EISSN: 19466226     Source Type: Journal    
DOI: 10.1145/2737596     Document Type: Article

References (105)

1. K. Ala-Mutka. 2005. A survey of automated assessment approaches for programming assignments. Computer Science Education 15, 2, 83-102.
2. V. L. Almstrum, O. Hazzan, M. Guzdial, and M. Petre. 2005. Challenges to computer science education research. In Proceedings of the 36th SIGCSE Technical Symposium on Computer Science Education (SIGCSE'05). 191-192.
3. K. E. Arnold and M. D. Pistilli. 2012. Course Signals at Purdue: Using learning analytics to increase student success. In Proceedings of the 2nd International Conference on Learning Analytics and Knowledge (LAK'12). 267-270.
4. S. Askew and C. Lodge. 2000. Gifts, ping-pong and loops-linking feedback and learning. In Feedback for Learning, S. Askew (Ed.). RoutledgeFalmer, London, UK, 1-18.
5. T. Auvinen. 2011. Rubyric. In Proceedings of the 11th Koli Calling International Conference on Computing Education Research. 102-106.
6. T. Bailey and J. Forbes. 2005. Just-in-Time Teaching for CS0. ACM SIGCSE Bulletin 37, 1, 366.
7. C. Bailey-Lee, S. Garcia, and L. Porter. 2013. Can peer instruction be effective in upper-division computer science courses? ACM Transactions on Computing Education 13, 3, 12.1-12.22.
8. R. Barber and M. Sharkey. 2012. Course correction: Using analytics to predict course success. In Proceedings of the 2nd International Conference on Learning Analytics and Knowledge (LAK'12). 259-262.
9. C. Beaumont, M. O'Doherty, and L. Shannon. 2008. Staff and student perceptions of feedback quality in the context of widening participation. Available at https://www.heacademy.ac.uk/.
10. K. Becker. 2003. Grading programming assignments using rubrics. ACM SIGCSE Bulletin 35, 3, 253-253.
11. S. Bergin and R. Reilly. 2005. Programming: Factors that influence success. ACM SIGCSE Bulletin 37, 1, 411-415.
12. S. Bergin, R. Reilly, and D. Traynor. 2005. Examining the role of self-regulated learning on introductory programming performance. In Proceedings of the 2005 International Workshop on Computing Education Research (ICER'05). 81-86.
13. J. Biggs and C. Tang. 2007. Teaching forQuality Learning atUniversity:What the Student Does.McGraw-Hill.
14. S. Bloxham and L. Campbell. 2010. Generating dialogue in assessment feedback: Exploring the use of interactive cover sheets. Assessment and Evaluation in Higher Education 35, 3, 291-300.
15. G. Braught, L. M. Eby, and T.Wahls. 2008. The effects of pair-programming on individual programming skill. In Proceedings of the 39th SIGCSE Technical Symposium on Computer Science Education (SIGCSE'08). 200-204.
16. D. Bruff. 2009. Teaching with Classroom Response Systems: Creating Active Learning Environments. Wiley.
17. K. Buffardi and S. Edwards. 2014. Responses to adaptive feedback for software testing. In Proceedings of the 2014 Conference on Innovation and Technology in Computer Science Education (ITiCSE'14). 165-170.
18. D. Burke and Pieterick. 2010. Giving Students Effective Written Feedback. McGraw-Hill International.
19. D. L. Butler and P. H. Winne. 1995. Feedback and self-regulated learning: A theoretical synthesis. Review of Educational Research 65, 3, 245-281.
20. R. Cardell-Oliver. 2011. How can software metrics help novice programmers? In Proceedings of the 13th Australasian Computing Education Conference. 55-62.
21. D. Carless. 2006. Differing perceptions in the feedback process. Studies in Higher Education 31, 2, 219-233.
22. D. Carless. 2007. Learning-oriented assessment: Conceptual bases and practical implications. Innovations in Education and Teaching International 44, 1, 57-66.
23. D. Carless, D. Salter, M. Yang, and J. Lam. 2011. Developing sustainable feedback practices. Studies in Higher Education 36, 4, 395-407.
24. P. Carter. 2012. An experience report: On the use of multimedia pre-instruction and Just-in-Time Teaching in a CS1 course. In Proceedings of the 43rd ACM Technical Symposium on Computer Science Education (SIGCSE'12). 361-366.
25. A. T. Chamillard. 2011. Using a student response system in CS1 and CS2. In Proceedings of the 42nd ACM technical symposium on computer science education (SIGCSE'11). 299-304.
26. D. Clow. 2013. An overview of learning analytics. Teaching in Higher Education 18, 6, 683-695.
27. A. Corbett and J. Anderson. 2001. Locus of feedback control in computer-based tutoring: Impact on learning rate, achievement and attitudes. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (SIGCHI'01). 245-252.
28. Q. Cutts and G. Kennedy. 2005. Connecting learning environments using electronic voting systems. In Proceedings of the 7th Australasian Conference on Computing Education. 181-186.
29. P. Denny, A. Luxton-Reilly, and J. Hamer. 2008. The PeerWise system of student contributed assessment questions. In Proceedings of the 10th Australasian Conference on Computing Education. 69-74.
30. P. Denny, A. Luxton-Reilly, E. Tempero, and J. Hendrickx. 2011. CodeWrite: Supporting student-driven practice of java. In Proceedings of the 42nd ACM Technical Symposium on Computer Science Education (SIGCSE'11). 471-476.
31. L. Deslauriers, E. Schelew, and C. Wieman. 2011. Improved learning in a large-enrollment physics class. Science 332, 6031, 862-864.
32. C. S. Dweck. 1999. Self-Theories: Their Role in Motivation, Personality, and Development. Psychology Press.
33. J. East and J. Schafer. 2005. In-person grading: An evaluative experiment. ACM SIGCSE Bulletin 37, 1, 378-382.
34. A. Essa and H. Ayad. 2012. Student success system: Risk analytics and data visualization using ensembles of predictive models. In Proceedings of the 2nd International Conference on Learning Analytics and Knowledge (LAK'12). 158-161.
35. N. J. G. Falkner and K. E. Falkner. 2012. A fast measure for identifying at-risk students in computer science. In Proceedings of the 9th Annual International Conference on International Computing Education Research (ICER'12). 55-62.
36. N. Falkner, R. Vivian, D. Piper, and K. Falkner. 2014. Increasing the effectiveness of automated assessment by increasing marking granularity and feedback units. In Proceedings of the 45th ACM Technical Symposium on Computer Science Education (SIGCSE'14). 9-14.
37. J. B. Fenwick, C. Norris, F. Barry, J. Rountree, C. Spicer, and S. Cheek. 2009. Another look at the behaviors of novice programmers. ACM SIGCSE Bulletin 41, 1, 296-300.
38. G. C. Gannod, J. E. Burge, and M. T. Helmick. 2008. Using the inverted classroom to teach software engineering. In Proceedings of the 13th International Conference on Software Engineering (ICSE'08). 777-786.
39. G. Gibbs. 2006. How assessment frames student learning. In Innovative Assessment in Higher Education, C. Bryan and K. Clegg (Eds.). Routledge, London, UK, 23-36.
40. G. Gibbs. 2010. Using Assessment to Support Student Learning. Leeds Met Press, Leeds Metropolitan University.
41. G. Gibbs and C. Simpson. 2004. Conditions under which assessment supports students' learning. Learning and Teaching in Higher Education 5, 1, 3-31.
42. S. Grissom. 2013. Introduction to special issue on alternatives to lecture. ACM Transactions on Computing Education 13, 3, 1-5.
43. S. Grissom, C. Hundhausen, and P. Conrad. 2014. Alternatives to lecture: Experience peer instruction and pedagogical code reviews. In Proceedings of the 45th ACM Technical Symposium on Computer Science Education (SIGCSE'14). 275-276.
44. M. Guzdial and B. Ericson. 2007. Introduction to Computing and Programming in Java: A Multimedia Approach. Pearson Prentice Hall.
45. L. Haaranen and P. Ihantola. 2014. How (not) to introduce badges to online exercises. In Proceedings of the 45th ACM Technical Symposium on Computer Science Education (SIGCSE'14). 33-38.
46. J. Hamer, H. C. Purchase, A. Luxton-Reilly, and J. Sheard. 2010. Tools for "contributing student learning." In Proceedings of the 2010 ITiCSE Working Group Reports (ITiCSE-WGR'10). 1-14.
47. J. Hattie. 2009. Visible Learning: A Synthesis of Over 800 Meta-Analyses Relating to Achievement. Routledge.
48. J. Hattie and H. Timperley. 2007. The Power of Feedback. Review of Educational Research 77, 1, 81-112.
49. R. Hernández. 2012. Does continuous assessment in higher education support student learning? Higher Education 64, 4, 489-502.
50. D. Horton, M. Craig, J. Campbell, P. Gries, and D. Zingaro. 2014. Comparing outcomes in inverted and traditional CS1. In Proceedings of the 2014 Conference on Innovation and Technology in Computer Science Education (ITiCSE'14). 261-266.
51. D. Hounsell. 2003. Student feedback, learning and development. In Higher Education and the Lifecourse, M. Slowey and D. Watson (Eds.). Society for Research into Higher Education Series. Open University Press, Buckingham, UK, 67-78.
52. D. Hounsell. 2007. Towards more sustainable feedback to students. In Rethinking Assessment in Higher Education: Learning for the Longer Term, D. Boud and N. Falchikov (Eds.). Routledge, London, UK.
53. I.-H. Hsiao, S. Sosnovsky, and P. Brusilovsky. 2010. Guiding students to the right questions: Adaptive navigation support in an E-learning system for Java programming. Journal of Computer Assisted Learning 26, 4, 270-283.
54. G. Hughes. 2011. Towards a personal best: A case for introducing ipsative assessment in higher education. Studies in Higher Education 36, 3, 353-367.
55. C. Hundhausen, A. Agrawal, and P. Agarwal. 2013. Talking about code: Integrating pedagogical code reviews into early computing courses. ACM Transactions on Computing Education 13, 3.
56. P. Ihantola and T. Ahoniemi. 2010. Review of recent systems for automatic assessment of programming assignments. In Proceedings of the 10th Koli Calling International Conference on Computing Education Research. 86-93.
57. P. Ihantola, V. Karavirta, and O. Seppälä. 2011. Automated visual feedback from programming assignments. In Proceedings of the 6th Program Visualization Workshop (PVW'11). 87-95.
58. B. Irwin, S. Hepplestone, G. Holden, H. J. Parkin, and L. Thorpe. 2013. Engaging students with feedback through adaptive release. Innovations in Education and Teaching International 50, 1, 51-61.
59. V. Isomöttönen and V. Tirronen. 2013. Teaching programming by emphasizing self-direction: How did students react to the active role required of them? ACM Transactions on Computing Education 13, 2.
60. T. Jessop, Y. El Hakim, and G. Gibbs. 2013. The whole is greater than the sum of its parts: A large-scale study of students' learning in response to different programme assessment patterns. Assessment and Evaluation in Higher Education 39, 1, 73-88.
61. M. Joy, J. Sinclair, S. Sun, J. Sitthiworachart, and J. Ĺopez-Gonźalez. 2009. Categorising computer science education research. Education and Information Technologies 14, 2, 105-126.
62. G. Kennedy and Q. Cutts. 2005. The association between students' use of an electronic voting system and their learning outcomes. Journal of Computer Assisted Learning 21, 260-268.
63. P. Kinnunen, V. Meisalo, and L. Malmi. 2010. Have we missed something? Identifying missing types of research in computing education. In Proceedings of the 6th International Workshop on Computing Education Research. ACM, New York, NY, 13-22.
64. A. Kumar. 2005. Generation of problems, answers, grade, and feedback-case study of a fully automated tutor. ACM Journal of Educational Resources in Computing 5, 3, 1-25.
65. J. Kurhila and A. Vihavainen. 2011. Management, structures and tools to scale up personal advising in large programming courses. In Proceedings of the 2011 Conference on Information Technology Education (SIGITE'11). 3.
66. J. Lewis, P. J. DePasquale, and J. Chase. 2010. Java Foundations: Introduction to Program Design and Data Structures. Pearson Education.
67. N.-F. Liu and D. Carless. 2006. Peer feedback: The learning element of peer assessment. Teaching in Higher Education 11, 3, 279-290.
68. A. Luxton-Reilly. 2009. A systematic review of tools that support peer assessment. Computer Science Education 19, 4, 209-232.
69. L. Malmi, J. Sheard, Simon, R. Bednarik, J. Helminen, A. Korhonen, N. Myller, J. Sorva, and A. Taherkhani. 2010. Characterizing research in computing education: A preliminary analysis of the literature. In Proceedings of the 6th International Workshop on Computing Education Research. ACM, NewYork, NY, 3-12.
70. R. C. Martin. 2009. Clean Code: A Handbook of Agile Software Craftsmanship. Prentice Hall.
71. A. McLean. 2012. An Anatomy of Feedback: A Phenomenographic Investigation into Undergraduate Students' Experiences of Feedback. Ph.D. Dissertation. University of Otago, Dunedin, New Zealand.
72. J. C. Nesbit, O. O. Adesope, Q. Liu, and W. Ma. 2014. How effective are intelligent tutoring systems in computer science education? In Proceedings of the 2014 IEEE 14th International Conference on Advanced Learning Technologies. 99-103.
73. D. Nicol. 2014. Unlocking learners' evaluative skills: A peer review perspective. In Proceedings of the 10th Annual Conference on International Computing Education Research (ICER'14).
74. D. J. Nicol and D. Macfarlane-Dick. 2006. Formative assessment and self-regulated learning: A model and seven principles of good feedback practice. Studies in Higher Education 31, 2, 199-218.
75. N. Parlante. 2007. Nifty reflections. ACM SIGCSE Bulletin 39, 2, 25-26.
76. A. Pears, J. Harland, M. Hamilton, and R. Hadgraft. 2013. What is feedback? Connecting student perceptions to assessment practices. In Proceedings of Learning and Teaching in Computing and Engineering (LaTiCE'13). 2013.
77. A. Pears, S. Seidman, L. Malmi, L. Mannila, E. Adams, J. Bennedsen, M. Devlin, and J. Paterson. 2007. A survey of literature on the teaching of introductory programming. ACM SIGCSE Bulletin 39, 4, 204.
78. D. Perkins, C. Hancock, R. Hobbs, F. Martin, and R. Simmons. 1989. Conditions of learning in novice programmers. In Studying the Novice Programmer, E. Soloway and J. C. Spohrer (Eds.). Lawrence Erlbaum, Hillsdale, NJ, 261-279.
79. L. Porter, C. Bailey-Lee, and B. Simon. 2013. Halving fail rates using peer instruction: A study of four computer science courses. In Proceedings of the 44th ACM Technical Symposium on Computer Science Education (SIGCSE'13). 177-182.
80. L. Porter and B. Simon. 2013. Retaining nearly one-third more majors with a trio of instructional best practices in CS1. In Proceedings of the 44th ACM Technical Symposium on Computer Science Education (SIGCSE'13). 165-170.
81. A. Poulos and M. J. Mahony. 2008. Effectiveness of feedback: The students' perspective. Assessment and Evaluation in Higher Education 33, 2, 143-154.
82. M. Price, K. Handley, and J. Millar. 2011. Feedback: Focusing attention on engagement. Studies in Higher Education 36, 8, 37-41.
83. M. Prosser and K. Trigwell. 1999. Understanding Learning and Teaching. Society for Research into Higher Education Series. Open University Press.
84. A. Radermacher, G. Walia, and R. Rummelt. 2012. Improving student learning outcomes with pair programming. In Proceedings of the 9th Annual International Conference on International Computing Education Research (ICER'12). 87-92.
85. P. Ramsden. 2003. Learning to Teach in Higher Education. RoutledgeFalmer.
86. K. Renaud and Q. Cutts. 2013. Teaching human-centered security using nontraditional techniques. ACM Transactions on Computing Education 13, 3, 11.1-11.23.
87. A. Robins. 2010. Learning edge momentum: A new account of outcomes in CS1. Computer Science Education 20, 1, 37-71.
88. A. Robinson and M. Udall. 2006. Using formative assessment to improve student learning through critical reflection. In Innovative Assessment in Higher Education, C. Bryan and K. Clegg (Eds.). Routledge, London, UK, 92-99.
89. N. Rountree, J. Rountree, and A. Robins. 2004. Interacting factors that predict success and failure in a CS1 course. ACM SIGCSE Bulletin 36, 4.
90. D. R. Sadler. 1989. Formative assessment and the design of instructional systems. Instructional Science 144, 119-144.
91. D. R. Sadler. 2002. Ah! . . . So that's 'quality.' In Assessment: Case Studies, Experience and Practice from Higher Education, P. Schwartz and Webb (Eds.). Kogan Page, London, UK, 130-137.
92. N. Salleh, E. Mendes, and J. Grundy. 2011. Empirical studies of pair programming for CS/SE teaching in higher education: A systematic literature review. IEEE Transactions on Software Engineering 37, 4, 509-525.
93. K. Sambell. 2011. Rethinking Feedback in Higher Education: An Assessment for Learning Perspective. Higher Education Academy, Bristol, UK.
94. C. Shaffer, M. Cooper, and S. Edwards. 2007. Algorithm visualization: A report on the state of the field. ACM SIGCSE Bulletin 39, 1, 150-154.
95. B. Simon, R. Lister, and S. Fincher. 2006. Multi-institutional computer science education research: A review of recent studies of novice understanding. In Proceedings of the 36th Annual Conference on Frontiers in Education. 12-17.
96. J. Smith, J. Tessler, E. Kramer, and C. Lin. 2012. Using peer review to teach software testing. In Proceedings of the 9th Annual International Conference on International Computing Education Research (ICER'12). 93-98.
97. J. Spacco, B. Simon, and J. Parris. 2013. How we teach impacts student learning: Peer instruction vs. lecture in CS0. In Proceedings of the 44th ACM Technical Symposium on Computer Science Education (SIGCSE'13). 41-46.
98. E. S. Tabanao, M. M. T. Rodrigo, and M. C. Jadud. 2011. Predicting at-risk novice Java programmers through the analysis of online protocols. In Proceedings of the 7th International Workshop on Computing Education Research (ICER'11). 85.
99. K. Tan. 2007. Conceptions of self-assessment. In Rethinking Assessment in Higher Education: Learning for the Longer Term, D. Boud and N. Falchikov (Eds.). Routledge, London, UK.
100. A. Vihavainen, J. Airaksinen, and C. Watson. 2014. A systematic review of approaches for teaching introductory programming and their influence on success. In Proceedings of the 10th Annual Conference on International Computing Education Research (ICER'14). 19-26.
101. B. C. Wilson and S. Shrock. 2001. Contributing to success in an introductory computer science course: A study of twelve factors. ACM SIGCSE Bulletin 33, 1, 184-188.
102. K. Wood, D. Parsons, J. Gasson, and P. Haden. 2013. It's never too early: Pair programming in CS1. In Proceedings of the 15th Australasian Computing Education Conference (ACE'13). 13-21.
103. M. Yorke and P. Knight. 2004. Self-theories: Some implications for teaching and learning in higher education. Studies in Higher Education 29, 1, 25-37.
104. B. J. Zimmerman. 1998. Developing self-fulfilling cycles of academic regulation: An analysis of exemplary instructional models. In Self- Regulated Learning: From Teaching to Self-Reflective Practice, D. H. Schunk and B. J. Zimmerman (Eds.). Guilford Press, New York, NY, 1-19.
105. D. Zingaro. 2014. Peer instruction contributes to self-efficacy in CS1. In Proceedings of the 45th ACM Technical Symposium on Computer Science Education (SIGCSE'14). 373-378.