A review of automated feedback systems for learners: Classification framework, challenges and opportunities

Computers and Education

Volumn 162, Issue , 2021, Pages

  Deeva, Galina ^a   Bogdanova, Daria ^a   Serral, Estefanía ^a   Snoeck, Monique ^a   De Weerdt, Jochen ^a  

^a UNIVERSITY OF LEUVEN   (Belgium)

Author keywords

Automated feedback; Computer tutoring; e learning; Intelligent tutoring systems; Systematic literature review; Technology enhanced learning

Indexed keywords

AUTOMATION;

CLASSIFICATION FRAMEWORK; DESIGN AND EVALUATIONS; DESIGN-SCIENCE RESEARCHES; EDUCATIONAL SETTINGS; LITERATURE REVIEWS; PERSONALIZED FEEDBACK; REFERENCE FRAMEWORKS; TECHNOLOGICAL ADVANCEMENT;

LEARNING SYSTEMS;

EID: 85097737908     PISSN: 03601315     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.compedu.2020.104094     Document Type: Article

References (148)

1. Ai, H., Providing graduated corrective feedback in an intelligent computer-assisted language learning environment. ReCALL 29:3 (2017), 313–334.
2. Akçapınar, G., How automated feedback through text mining changes plagiaristic behavior in online assignments. Computers & Education 87 (2015), 123–130.
3. Anderson, L.W., Krathwohl, D.R., Airasian, P.W., Cruikshank, K.A., Mayer, R.E., Pintrich, P.R., Raths, J., Wittrock, M.C., A taxonomy for learning, teaching, and assessing: A revision of bloom's taxonomy of educational objectives. abridged edition, 2001, Longman, White Plains, NY.
4. Arevalillo-Herráez, M., Arnau, D., Ferri, F.J., Santos, O.C., Gui-driven intelligent tutoring system with affective support to help learning the algebraic method. 2017 IEEE international conference on systems, man, and cybernetics (SMC), 2017, 2867–2872 IEEE.
5. Arevalillo-Herráez, M., Arnau, D., Marco-Giménez, L., Domain-specific knowledge representation and inference engine for an intelligent tutoring system. Knowledge-Based Systems 49 (2013), 97–105.
6. Bandara, W., Miskon, S., Fielt, E., A systematic, tool-supported method for conducting literature reviews in information systems. ECIS 2011 proceedings [19th European conference on information systems], 2011, AIS Electronic Library (AISeL)/Association for Information Systems.
7. Baneres, D., Saíz, J., Intelligent tutoring system for learning digital systems on mooc environments. 2016 10th international conference on complex, intelligent, and software intensive systems (CISIS), 2016, IEEE, 95–102.
8. Barker, T., An automated feedback system based on adaptive testing: Extending the model. International Journal of Emerging Technologies in Learning (iJET), 5(2), 2010.
9. Barmaki, R., Hughes, C.E., Providing real-time feedback for student teachers in a virtual rehearsal environment. Proceedings of the 2015 ACM on international conference on multimodal interaction, 2015, ACM, 531–537.
10. Basu, S., Biswas, G., Kinnebrew, J.S., Learner modeling for adaptive scaffolding in a computational thinking-based science learning environment. User Modeling and User-Adapted Interaction 27:1 (2017), 5–53.
11. Belcadhi, L.C., Personalized feedback for self assessment in lifelong learning environments based on semantic web. Computers in Human Behavior 55 (2016), 562–570.
12. Benotti, L., Aloi, F., Bulgarelli, F., Gomez, M.J., The effect of a web-based coding tool with automatic feedback on students' performance and perceptions. Proceedings of the 49th ACM technical symposium on computer science education, 2018, ACM, 2–7.
13. Bimba, A.T., Idris, N., Al-Hunaiyyan, A., Mahmud, R.B., Shuib, N.L.B.M., Adaptive feedback in computer-based learning environments: A review. Adaptive Behavior 25:5 (2017), 217–234.
14. Bjorn, M., Ravyse, W., Villafruella, D.S., Luimula, M., Leivo, S., Higher education learner experience with fuzzy feedback in a digital learning environment. 2018 9th IEEE international conference on cognitive infocommunications (CogInfoCom), 2018, IEEE 000253–000260.
15. Bloom, B.S., The 2 sigma problem: The search for methods of group instruction as effective as one-to-one tutoring. Educational Researcher 13:6 (1984), 4–16.
16. Boud, D., Molloy, E., Rethinking models of feedback for learning: The challenge of design. Assessment & Evaluation in Higher Education 38:6 (2013), 698–712.
17. Cabestrero, R., Quirós, P., Santos, O.C., Salmeron-Majadas, S., Uria-Rivas, R., Boticario, J.G., Arnau, D., Arevalillo-Herráez, M., Ferri, F.J., Some insights into the impact of affective information when delivering feedback to students. Behaviour & Information Technology 37:12 (2018), 1252–1263.
18. Caiza, J.C., Del Alamo, J.M., Programming assignments automatic grading: Review of tools and implementations. 7th international technology, education and development conference (INTED2013), 2013, 5691––5700.
19. Calvo, R.A., Ellis, R.A., Students' conceptions of tutor and automated feedback in professional writing. Journal of Engineering Education 99:4 (2010), 427–438.
20. Chan, J.C., Leung, H., Tang, J.K., Komura, T., A virtual reality dance training system using motion capture technology. IEEE Transactions on Learning Technologies 4:2 (2010), 187–195.
21. Cheng, G., The impact of online automated feedback on students' reflective journal writing in an efl course. The Internet and Higher Education 34 (2017), 18–27.
22. Choi, I.-C., Efficacy of an icall tutoring system and process-oriented corrective feedback. Computer Assisted Language Learning 29:2 (2016), 334–364.
23. Chung, Z., Nagai, H., Rodrigo, M.M.T., An intelligent tutoring system for Japanese language particles with user assessment and feedback. AIED workshops. Citeseer, 2013.
24. Chu, T., Taele, P., Hammond, T., Supporting Chinese character educational interfaces with richer assessment feedback through sketch recognition. 2018.
25. Correia, H.P., Leal, J.P., Paiva, J.C., Enhancing feedback to students in automated diagram assessment. 2017.
26. Cutumisu, M., Blair, K.P., Chin, D.B., Schwartz, D.L., Assessing whether students seek constructive criticism: The design of an automated feedback system for a graphic design task. International Journal of Artificial Intelligence in Education 27:3 (2017), 419–447.
27. Demaidi, M.N., Gaber, M.M., Filer, N., Ontopefege: Ontology-based personalized feedback generator. IEEE Access 6 (2018), 31644–31664.
28. Di Eugenio, B., Fossati, D., Haller, S., Yu, D., Glass, M., Be brief, and they shall learn: Generating concise language feedback for a computer tutor. International Journal of Artificial Intelligence in Education 18:4 (2008), 317–345.
29. Dias Pereira dos Santos, A., Yacef, K., Martinez-Maldonado, R., Forró trainer: Automated feedback for partner dance learning. Adjunct publication of the 25th conference on user modeling, adaptation and personalization, 2017, ACM, 103–104.
30. Dominguez, A.K., Yacef, K., Curran, J., Data mining to generate individualised feedback. International conference on intelligent tutoring systems, 2010, Springer, 303–305.
31. Dzikovska, M., Steinhauser, N., Farrow, E., Moore, J., Campbell, G., Beetle ii: Deep natural language understanding and automatic feedback generation for intelligent tutoring in basic electricity and electronics. International Journal of Artificial Intelligence in Education 24:3 (2014), 284–332.
32. Economides, A.A., Personalized feedback in cat. WSEAS Transactions on Advances in Engineering Education, 2(3), 2005, 174.
33. Ferguson, P., Student perceptions of quality feedback in teacher education. Assessment & Evaluation in Higher Education 36:1 (2011), 51–62.
34. Fleming, M.L., Levie, W.H., Instructional message design: Principles from the behavioral sciences. 1978, Educational Technology.
35. Fossati, D., Di Eugenio, B., Ohlsson, S., Brown, C., Chen, L., Data driven automatic feedback generation in the ilist intelligent tutoring system. Technology, Instruction, Cognition and Learning 10:1 (2015), 5–26.
36. Fournier-Viger, P., Nkambou, R., Mayers, A., Mephu-Nguifo, E., Faghihi, U., Multi-paradigm generation of tutoring feedback in robotic arm manipulation training. International conference on intelligent tutoring systems, 2012, Springer, 233–242.
37. Frenoy, R., Soullard, Y., Thouvenin, I., Gapenne, O., Adaptive training environment without prior knowledge: Modeling feedback selection as a multi-armed bandit problem. Proceedings of the 2016 conference on user modeling adaptation and personalization, 2016, ACM, 131–139.
38. Friedman, J., Hastie, T., Tibshirani, R., The elements of statistical learning, Vol. 1, 2001, Springer series in statistics, New York.
39. Frutos-Morales, F., Sánchez-Vera, M., Castellanos-Nieves, D., Esteban-Gil, A., Cruz-Corona, C., Prendes-Espinosa, M., Fernández-Breis, J., An extension of the oele platform for generating semantic feedback for students and teachers. Procedia-Social and Behavioral Sciences 2:2 (2010), 527–531.
40. Fujita, T., Jones, K., Miyazaki, M., Learners use of domain-specific computer-based feedback to overcome logical circularity in deductive proving in geometry. ZDM, 1–15, 2018.
41. Fung, M., Jin, Y., Zhao, R., Hoque, M.E., Roc speak: Semi-automated personalized feedback on nonverbal behavior from recorded videos. Proceedings of the 2015 ACM international joint conference on pervasive and ubiquitous computing, 2015, ACM, 1167–1178.
42. Gallien, T., Oomen-Early, J., Personalized versus collective instructor feedback in the online courseroom: Does type of feedback affect student satisfaction, academic performance and perceived connectedness with the instructor?. International Journal on E-Learning 7:3 (2008), 463–476.
43. Gerdes, A., Heeren, B., Jeuring, J., van Binsbergen, L.T., Ask-elle: An adaptable programming tutor for haskell giving automated feedback. International Journal of Artificial Intelligence in Education 27:1 (2017), 65–100.
44. Gimeno Sanz, A., De-Sequeira, J.M., Designing feedback to support language acquisition using the “ingenio” authoring tool. Online Submission 1 (2009), 1239–1243.
45. Golonka, E.M., Bowles, A.R., Frank, V.M., Richardson, D.L., Freynik, S., Technologies for foreign language learning: A review of technology types and their effectiveness. Computer Assisted Language Learning 27:1 (2014), 70–105.
46. Grawemeyer, B., Mavrikis, M., Holmes, W., Gutiérrez-Santos, S., Wiedmann, M., Rummel, N., Affective learning: Improving engagement and enhancing learning with affect-aware feedback. User Modeling and User-Adapted Interaction 27:1 (2017), 119–158.
47. Grigoriou, T., Cheong, C., Cheong, F., Improving quality of feedback using a technology-supported learning system. PACIS, 2015, 86.
48. Gutierrez, F., Atkinson, J., Adaptive feedback selection for intelligent tutoring systems. Expert Systems with Applications 38:5 (2011), 6146–6152.
49. Hattie, J., Timperley, H., The power of feedback. Review of Educational Research 77:1 (2007), 81–112.
50. Hautala, J., Baker, D.L., Keurulainen, A., Ronimus, M., Richardson, U., Cole, R., Early science learning with a virtual tutor through multimedia explanations and feedback on spoken questions. Educational Technology Research & Development 66:2 (2018), 403–428.
51. Hevner, A., Chatterjee, S., Design science research in information systems. Design research in information systems, 2010, Springer, 9–22.
52. Hevner, A.R., March, S.T., Park, J., Ram, S., Design science in information systems research. MIS Quarterly 28:1 (2004), 75–105 http://www.jstor.org/stable/25148625.
53. Hodgkinson, B., Lutteroth, C., Wünsche, B., Glgetfeedbacktowards automatic feedback and assessment for opengl 3d modelling assignments. Image and vision computing New Zealand (IVCNZ), 2016 international conference on, 2016, IEEE, 1–6.
54. Ho, V.W., Harris, P.G., Kumar, R.K., Velan, G.M., Knowledge maps: A tool for online assessment with automated feedback. Medical Education Online, 23(1), 2018, 1457394.
55. Höhn, S., Ras, E., Designing formative and adaptive feedback using incremental user models. International conference on web-based learning, 2016, Springer, 172–177.
56. Holland, J., Mitrovic, A., Martin, B., J-latte: A constraint-based tutor for java. 2009.
57. Hull, A., du Boulay, B., Motivational and metacognitive feedback in sql-tutor. Computer Science Education 25:2 (2015), 238–256.
58. Hülsmann, F., Göpfert, J.P., Hammer, B., Kopp, S., Botsch, M., Classification of motor errors to provide real-time feedback for sports coaching in virtual realitya case study in squats and tai chi pushes. Computers & Graphics 76 (2018), 47–59.
59. Hwang, G.-J., Definition, framework and research issues of smart learning environments-a context-aware ubiquitous learning perspective. Smart Learning Environments, 1(1), 2014, 4.
60. Inventado, P.S., Legaspi, R., Bui, T., Suarez, M., Predicting student's appraisal of feedback in an its using previous affective states and continuous affect labels from eeg data. Proceedings of the 18th international conference on computers in education, 2010, Putrajaya, Malaysia.
61. Jiménez, S., Juárez-Ramírez, R., Castillo, V.H., Licea, G., Ramírez-Noriega, A., Inzunza, S., A feedback system to provide affective support to students. Computer Applications in Engineering Education 26:3 (2018), 473–483.
62. Johnson, S., Zaiane, O., Intelligent feedback polarity and timing selection in the shufti intelligent tutoring system. International conference on computers in education, 2012, Citeseer.
63. Jordan, P.W., Albacete, P.L., Katz, S., Ford, M., Lipschultz, M., Eliciting student explanations during tutorial dialogue for the purpose of providing formative feedback. AIED workshops, 2013.
64. Jylhä, A., Erkut, C., Auditory feedback in an interactive rhythmic tutoring system. Proceedings of the 6th audio mostly conference: A conference on interaction with sound, 2011, ACM, 109–115.
65. Kão, K., Niitsoo, M., Matchmysound: Introducing feedback to online music education. International conference on web-based learning, 2014, Springer, 217–225.
66. Karavirta, V., Helminen, J., Ihantola, P., A mobile learning application for parsons problems with automatic feedback. Proceedings of the 12th Koli calling international conference on computing education research, 2012, ACM, 11–18.
67. Karkalas, S., Mavrikis, M., Xenos, M., Kynigos, C., Feedback authoring for exploratory activities: The case of a logo-based 3d microworld. International conference on computer supported education, 2016, Springer, 259–278.
68. Kazi, H., Haddawy, P., Suebnukarn, S., Leveraging a domain ontology to increase the quality of feedback in an intelligent tutoring system. International conference on intelligent tutoring systems, 2010, Springer, 75–84.
69. Kazi, H., Haddawy, P., Suebnukarn, S., Employing umls for generating hints in a tutoring system for medical problem-based learning. Journal of Biomedical Informatics 45:3 (2012), 557–565.
70. Kelly, D., McDonald, J., Markham, C., A system for teaching sign language using live gesture feedback. Automatic face & gesture recognition, 2008, FG’08. 8th IEEE International Conference on. IEEE, 1–2 2008.
71. Kennedy, G., Ioannou, I., Zhou, Y., Bailey, J., O'Leary, S., Mining interactions in immersive learning environments for real-time student feedback. Australasian Journal of Educational Technology, 29(2), 2013.
72. Keuning, H., Jeuring, J., Heeren, B., A systematic literature review of automated feedback generation for programming exercises. ACM Transactions on Computing Education, 19(1), 2018, 3.
73. Kitchenham, B., Procedures for performing systematic reviews, Vol. 33, 2004, Keele University, Keele, UK, 1–26 2004.
74. Kyan, M., Sun, G., Li, H., Zhong, L., Muneesawang, P., Dong, N., Elder, B., Guan, L., An approach to ballet dance training through ms kinect and visualization in a cave virtual reality environment. ACM Transactions on Intelligent Systems and Technology (TIST) 6:2 (2015), 1–37.
75. Lee, H.-S., Pallant, A., Pryputniewicz, S., Lord, T., Mulholland, M., Liu, O.L., Automated text scoring and real-time adjustable feedback: Supporting revision of scientific arguments involving uncertainty. Science Education 103:3 (2019), 590–622.
76. Le, N.-T., Strickroth, S., Gross, S., Pinkwart, N., A review of ai-supported tutoring approaches for learning programming. Advanced computational methods for knowledge engineering, 2013, Springer, 267–279.
77. Li, Q., Hsieh, S.-J., An intelligent tutoring system for computer numerical control programming. International Journal of Engineering Education 35:1 (2019), 252–261.
78. Liu, C., Calvo, R.A., Lim, R., Improving medical students’ awareness of their non-verbal communication through automated non-verbal behavior feedback. Frontiers in ICT, 3, 2016, 11.
79. Liu, B., Chen, H., He, W., A framework of deriving adaptive feedback from educational ontologies. Young computer scientists, 2008. ICYCS 2008. The 9th international conference for, 2008, IEEE, 2476–2480.
80. Liu, M., Li, Y., Xu, W., Liu, L., Automated essay feedback generation and its impact on revision. IEEE Transactions on Learning Technologies 10:4 (2017), 502–513.
81. Lu, X., Di Eugenio, B., Ohlsson, S., Fossati, D., Simple but effective feedback generation to tutor abstract problem solving. Proceedings of the fifth international natural language generation conference, 2008, Association for Computational Linguistics, 104–112.
82. Lukáč, S., Sekerák, J., Implementation of feedback in digital learning environment with a focus on system geogebra. Emerging eLearning technologies and applications (ICETA), 2015 13th international conference on, 2015, IEEE, 1–7.
83. del Mar Sánchez-Vera, M., Fernández-Breis, J.T., Castellanos-Nieves, D., Frutos-Morales, F., Prendes-Espinosa, M.P., Semantic web technologies for generating feedback in online assessment environments. Knowledge-Based Systems 33 (2012), 152–165.
84. Marcus, N., Ben-Naim, D., Bain, M., Instructional support for teachers and guided feedback for students in an adaptive elearning environment. Information technology: New generations (ITNG), 2011 eighth international conference on, 2011, IEEE, 626–631.
85. Martin, F., Chen, Y., Moore, R.L., Westine, C.D., Systematic review of adaptive learning research designs, context, strategies, and technologies from 2009 to 2018. Educational Technology Research & Development 68:4 (2020), 1903–1929.
86. Ma, X., Wijewickrema, S., Zhou, Y., Zhou, S., O'Leary, S., Bailey, J., Providing effective real-time feedback in simulation-based surgical training. International conference on medical image computing and computer-assisted intervention, 2017, Springer, 566–574.
87. McGuire, P., Tu, S., Logue, M.E., Mason, C.A., Ostrow, K., Counterintuitive effects of online feedback in middle school math: Results from a randomized controlled trial in assistments. Educational Media International 54:3 (2017), 231–244.
88. Mich, O., Pianta, E., Mana, N., Interactive stories and exercises with dynamic feedback for improving reading comprehension skills in deaf children. Computers & Education 65 (2013), 34–44.
89. Mirzaeian, V.R., Kohzadi, H., Azizmohammadi, F., Learning Persian grammar with the aid of an intelligent feedback generator. Engineering Applications of Artificial Intelligence 49 (2016), 167–175.
90. Mitrovic, A., Ohlsson, S., Barrow, D.K., The effect of positive feedback in a constraint-based intelligent tutoring system. Computers & Education 60:1 (2013), 264–272.
91. Monahan, S., Johnson, E., Lucas, G., Finch, J., Gratch, J., Autonomous agent that provides automated feedback improves negotiation skills. International conference on artificial intelligence in education, 2018, Springer, 225–229.
92. Naismith, L.M., Lajoie, S.P., Motivation and emotion predict medical students attention to computer-based feedback. Advances in Health Sciences Education, 2017, 1–21.
93. Narciss, S., Feedback strategies for interactive learning tasks. Handbook of Research on Educational Communications and Technology 3 (2008), 125–144.
94. Narciss, S., Sosnovsky, S., Schnaubert, L., Andrès, E., Eichelmann, A., Goguadze, G., Melis, E., Exploring feedback and student characteristics relevant for personalizing feedback strategies. Computers & Education 71 (2014), 56–76.
95. Ng, K., Interactive multimedia for technology-enhanced learning with multimodal feedback. Musical robots and interactive multimodal systems, 2011, Springer, 105–126.
96. Nguyen, A.-T., Chen, W., Rauterberg, M., Online feedback system for public speakers. E-Learning, E-Management, E-Services, (eds.) (IS3e), 2012 IEEE Symposium on, 2012, IEEE, 1–5.
97. Normadhi, N.B.A., Shuib, L., Nasir, H.N.M., Bimba, A., Idris, N., Balakrishnan, V., Identification of personal traits in adaptive learning environment: Systematic literature review. Computers & Education 130 (2019), 168–190.
98. Ochoa, X., Domínguez, F., Guamán, B., Maya, R., Falcones, G., Castells, J., The rap system: Automatic feedback of oral presentation skills using multimodal analysis and low-cost sensors. Proceedings of the 8th international conference on learning analytics and knowledge, 2018, ACM, 360–364.
99. O'Brien, H.L., Toms, E.G., What is user engagement? A conceptual framework for defining user engagement with technology. Journal of the American Society for Information Science and Technology 59:6 (2008), 938–955.
100. Pardo, A., Jovanovic, J., Dawson, S., Gašević, D., Mirriahi, N., Using learning analytics to scale the provision of personalised feedback. British Journal of Educational Technology 50:1 (2019), 128–138.
101. Parvez, S.M., Blank, G.D., Individualizing tutoring with learning style based feedback. International conference on intelligent tutoring systems, 2008, Springer, 291–301.
102. Perikos, I., Grivokostopoulou, F., Hatzilygeroudis, I., Assistance and feedback mechanism in an intelligent tutoring system for teaching conversion of natural language into logic. International Journal of Artificial Intelligence in Education 27:3 (2017), 475–514.
103. Perlmuter, L.C., Monty, R.A., The importance of perceived control: Fact or fantasy? Experiments with both humans and animals indicate that the mere illusion of control significantly improves performance in a variety of situations. American Scientist 65:6 (1977), 759–765.
104. Price, T.W., Dong, Y., Barnes, T., Generating data-driven hints for open-ended programming. International Educational Data Mining Society, 2016.
105. Pridemore, D.R., Klein, J.D., Control of feedback in computer-assisted instruction. Educational Technology Research & Development 39:4 (1991), 27–32.
106. Qian, Y., Lehman, J.D., Using targeted feedback to address common student misconceptions in introductory programming: A data-driven approach. SAGE Open, 9(4), 2019 2158244019885136.
107. Rahati, A., Kabanza, F., Delivering tutoring feedback using persuasive dialogues. International conference on intelligent tutoring systems, 2010, Springer, 251–253.
108. Rajendran, R., Iyer, S., Murthy, S., Personalized affective feedback to address students frustration in its. IEEE Transactions on Learning Technologies, 2018.
109. Rhienmora, P., Haddawy, P., Suebnukarn, S., Dailey, M.N., Intelligent dental training simulator with objective skill assessment and feedback. Artificial Intelligence in Medicine 52:2 (2011), 115–121.
110. Rivers, K., Koedinger, K.R., Automatic generation of programming feedback: A data-driven approach. The first workshop on AI-supported education for computer science (AIEDCS 2013), Vol. 50, 2013.
111. Roll, I., Aleven, V., McLaren, B.M., Koedinger, K.R., Improving students help-seeking skills using metacognitive feedback in an intelligent tutoring system. Learning and Instruction 21:2 (2011), 267–280.
112. Romano, G., Schneider, J., Drachsler, H., Dancing salsa with machinesfilling the gap of dancing learning solutions. Sensors, 19(17), 2019, 3661.
113. Roscoe, R.D., Snow, E.L., McNamara, D.S., Feedback and revising in an intelligent tutoring system for writing strategies. International conference on artificial intelligence in education, 2013, Springer, 259–268.
114. Roselli, R., Gilbert, S., Howard, L., Blessing, S., Raut, A., Pandian, P., Integration of an intelligent tutoring system with a web-based authoring system to develop online homework assignments with formative feedback. American society for engineering education 2008 conference, 2008.
115. Schaffer, H.E., Young, K.R., Ligon, E.W., Chapman, D.D., Automating individualized formative feedback in large classes based on a directed concept graph. Frontiers in Psychology, 8, 2017, 260.
116. Schneider, J., Börner, D., Van Rosmalen, P., Specht, M., Can you help me with my pitch? Studying a tool for real-time automated feedback. IEEE Transactions on Learning Technologies 9:4 (2016), 318–327.
117. Sedrakyan, G., Poelmans, S., Snoeck, M., Assessing the influence of feedback-inclusive rapid prototyping on understanding the semantics of parallel uml statecharts by novice modellers. Information and Software Technology 82 (2017), 159–172.
118. Seechaliao, T., Instructional strategies to support creativity and innovation in education. Journal of Education and Learning 6:4 (2017), 201–208.
119. Serral Asensio, E., Ruiz, J., Elen, J., Snoeck, M., Conceptualizing the domain of automated feedback for learners. Proceedings of the XXII Iberoamerican conference on software engineering, CIbSE 2019, 2019, Curran Associates 2019.
120. Serral, E., Snoeck, M., Conceptual framework for feedback automation in sles. Smart education and e-learning 2016, 2016, Springer, 97–107.
121. Shaalan, K., Magdy, M., Fahmy, A., Analysis and feedback of erroneous Arabic verbs. Natural Language Engineering 21:2 (2015), 271–323.
122. Shekhar, V.S., Agarwalla, A., Agarwal, A., Nitish, B., Kumar, V., Enhancing jflap with automata construction problems and automated feedback. Contemporary computing (IC3), 2014 seventh international conference on, 2014, IEEE, 19–23.
123. Shute, V.J., Focus on formative feedback. Review of Educational Research 78:1 (2008), 153–189.
124. Silva, P., Costa, E., de Araújo, J.R., An adaptive approach to provide feedback for students in programming problem solving. International conference on intelligent tutoring systems, 2019, Springer, 14–23.
125. Singh, R., Gulwani, S., Solar-Lezama, A., Automated feedback generation for introductory programming assignments. ACM SIGPLAN Notices 48:6 (2013), 15–26.
126. Stranieri, A., Yearwood, J., Enhancing learning outcomes with an interactive knowledge-based learning environment providing narrative feedback. Interactive Learning Environments 16:3 (2008), 265–281.
127. Sullins, J., Craig, S.D., Hu, X., Exploring the effectiveness of a novel feedback mechanism within an intelligent tutoring system. International Journal of Learning Technology 10:3 (2015), 220–236.
128. Sung, Y.-T., Liao, C.-N., Chang, T.-H., Chen, C.-L., Chang, K.-E., The effect of online summary assessment and feedback system on the summary writing on 6th graders: The lsa-based technique. Computers & Education 95 (2016), 1–18.
129. Sun, J.C.-Y., Yu, S.-J., Chao, C.-H., Effects of intelligent feedback on online learners engagement and cognitive load: The case of research ethics education. Educational Psychology, 2018, 1–18.
130. Suselo, T., Wünsche, B.C., Luxton-Reilly, A., Technologies and tools to support teaching and learning computer graphics: A literature review. Proceedings of the twenty-first Australasian computing education conference. ACE 19, 2019, Association for Computing Machinery, New York, NY, USA, 96105, 10.1145/3286960.3286972.
131. Taele, P., Barreto, L., Hammond, T., Maestoso: An intelligent educational sketching tool for learning music theory. Twenty-seventh IAAI conference, 2015.
132. Tiam-Lee, T.J., Sumi, K., Adaptive feedback based on student emotion in a system for programming practice. International conference on intelligent tutoring systems, 2018, Springer, 243–255.
133. VanLehn, K., The relative effectiveness of human tutoring, intelligent tutoring systems, and other tutoring systems. Educational Psychologist 46:4 (2011), 197–221.
134. VanLehn, K., Wetzel, J., Grover, S., Van De Sande, B., Learning how to construct models of dynamic systems: An initial evaluation of the dragoon intelligent tutoring system. IEEE Transactions on Learning Technologies 10:2 (2016), 154–167.
135. Voerman, L., Meijer, P.C., Korthagen, F.A., Simons, R.J., Types and frequencies of feedback interventions in classroom interaction in secondary education. Teaching and Teacher Education 28:8 (2012), 1107–1115.
136. de Vries, B.P., Cucchiarini, C., Bodnar, S., Strik, H., van Hout, R., Spoken grammar practice and feedback in an asr-based call system. Computer Assisted Language Learning 28:6 (2015), 550–576.
137. Wang, K., Lin, B., Rettig, B., Pardi, P., Singh, R., Data-driven feedback generator for online programing courses. Proceedings of the fourth (2017) ACM conference on learning@ scale, 2017, ACM, 257–260.
138. Ward, W., Cole, R., Bolaños, D., Buchenroth-Martin, C., Svirsky, E., Weston, T., My science tutor: A conversational multimedia virtual tutor. Journal of Educational Psychology, 105(4), 2013, 1115.
139. Watson, C., Li, F.W., Lau, R.W., Learning programming languages through corrective feedback and concept visualisation. International conference on web-based learning, 2011, Springer, 11–20.
140. Webster, J., Watson, R.T., Analyzing the past to prepare for the future: Writing a literature review. 2002 (MIS quarterly, xiii–xxiii).
141. Wilson, J., Czik, A., Automated essay evaluation software in English language arts classrooms: Effects on teacher feedback, student motivation, and writing quality. Computers & Education 100 (2016), 94–109.
142. Wohlin, C., Guidelines for snowballing in systematic literature studies and a replication in software engineering. Proceedings of the 18th international conference on evaluation and assessment in software engineering, 2014, 1–10.
143. Wong, J.H., Ogren, L., Peters, S., Bratt, E.O., Newport, R., Developing and evaluating an intelligent tutoring system for advanced shiphandling. Proceedings of the interservice/industry, training, simulation, and education conference (I/ITSEC) annual meeting, 2014.
144. Wong, W.-K., Yang, M.-L., Chaoc, T.-K., A language learning system with automatic feedback: An application based on a English-Chinese parallel corpus. 2010.
145. Wünsche, B.C., Huang, E., Shaw, L., Suselo, T., Leung, K.-C., Dimalen, D., van der Mark, W., Luxton-Reilly, A., Lobb, R., Coderunnergl-an interactive web-based tool for computer graphics teaching and assessment. 2019 international conference on electronics, information, and communication (ICEIC), 2019, IEEE, 1–7.
146. Zacharia, Z.C., Manoli, C., Xenofontos, N., De Jong, T., Pedaste, M., van Riesen, S.A., Kamp, E.T., Mäeots, M., Siiman, L., Tsourlidaki, E., Identifying potential types of guidance for supporting student inquiry when using virtual and remote labs in science: A literature review. Educational Technology Research and Development 63:2 (2015), 257–302.
147. Zhu, M., Lee, H.-S., Wang, T., Liu, O.L., Belur, V., Pallant, A., Investigating the impact of automated feedback on students scientific argumentation. International Journal of Science Education 39:12 (2017), 1648–1668.
148. Zinn, C., Algorithmic debugging and literate programming to generate feedback in intelligent tutoring systems. Joint German/Austrian conference on artificial intelligence (Künstliche Intelligenz), 2014, Springer, 37–48.