Predicting student performance from LMS data: A comparison of 17 blended courses using moodle LMS

IEEE Transactions on Learning Technologies

Volumn 10, Issue 1, 2017, Pages 17-29

  Conijn, Rianne ^a   Snijders, Chris ^a   Kleingeld, Ad ^a   Matzat, Uwe ^a  

^a EINDHOVEN UNIVERSITY OF TECHNOLOGY   (Netherlands)

Author keywords

Learning analytics; learning management systems; portability; predictive modeling; student performance

Indexed keywords

BEHAVIORAL RESEARCH; COMPUTER SOFTWARE PORTABILITY; EDUCATION; FORECASTING; ONLINE SYSTEMS; PREDICTIVE ANALYTICS; STUDENTS;

EARLY INTERVENTION; EDUCATIONAL INSTITUTIONS; LEARNING ANALYTICS; LEARNING MANAGEMENT SYSTEM; PREDICTIVE MODELING; PREDICTOR VARIABLES; STUDENT PERFORMANCE; THEORETICAL ARGUMENTS;

INFORMATION MANAGEMENT;

EID: 85017609008     PISSN: 19391382     EISSN: None     Source Type: Journal    
DOI: 10.1109/TLT.2016.2616312     Document Type: Article

References (60)

1. N. Hoic-Bozic, V. Mornar, and I. Boticki, "A blended learning approach to course design and implementation," IEEE Trans. Educ, vol. 52, no. 1, pp. 19-30, Feb. 2009.
2. S. Retalis, A. Papasalouros, Y. Psaromiligkos, S. Siscos, and T. Kargidis, "Towards networked learning analytics-A concept and a tool," in Proc. 5th Int. Conf. Netw. Learn., 2006, pp. 1-8.
3. A. A. Piña, "An overview of learning management systems," in Virtual Learning Environments: Concepts, Methodologies, Tools and Applications, 1st ed. Louisville, KY, USA: Sullivan Univ. Syst., 2012, pp. 33-51.
4. G. Siemens and R. S. Baker, "Learning analytics and educational data mining: Towards communication and collaboration," in Proc. 2nd Int. Conf. Learn. Analytics Knowl., 2012, pp. 252-254.
5. P. Long, G. Siemens, G. Conole, and D. Gasevic, (Eds.) "Announcing open course: Learning and knowledge analytics," in Proc. 1st Int. Conf. Learn. Analytics Knowl., Banff, AB, Canada, 2011.
6. C. Romero and S. Ventura, "Educational data mining: A review of the state of the art," IEEE Trans. Syst. Man Cybern. Part C Appl. Rev, vol. 40, no. 6, pp. 601-618, Nov. 2010.
7. S. B. Shum and R. Ferguson, "Social learning analytics," Educ. Technol. Soc, vol. 15, no. 3, pp. 3-26, 2012.
8. R. S. J. d Baker and K. Yacef, "The state of educational data mining in 2009: A review and future visions," J. Educ. Data Min, vol. 1, no. 1, pp. 3-17, Oct. 2009.
9. D. W. Shaffer,, et al., "Epistemic network analysis: A prototype for 21st-century assessment of learning," Int. J. Learn. Media, vol. 1, no. 2, pp. 33-53, 2009.
10. D. Gašević, S. Dawson, T. Rogers, and D. Gasevic, "Learning analytics should not promote one size fits all: The effects of instructional conditions in predicting academic success," Internet High. Educ, vol. 28, pp. 68-84, Jan. 2016.
11. S. Joksimović, D. Gašević, T. M. Loughin, V. Kovanović, and M. Hatala, "Learning at distance: Effects of interaction traces on academic achievement," Comput. Educ, vol. 87, pp. 204-217, Sep. 2015.
12. J. P. Campbell and D. G. Oblinger, "Academic analytics," Educause, vol. 42, pp. 40-42, 2007.
13. D. T. Tempelaar, B. Rienties, and B. Giesbers, "In search for the most informative data for feedback generation: Learning analytics in a data-rich context," Comput. Human Behavior, vol. 47, pp. 157-167, Jun. 2015.
14. D. Clow, "An overview of learning analytics," Teach. High. Educ, vol. 18, no. 6, pp. 683-695, 2013.
15. M. Richardson, C. Abraham, and R. Bond, "Psychological correlates of university students? academic performance: A systematic review and meta-Analysis," Psychol. Bull, vol. 138, no. 2, pp. 353-387, 2012.
16. M. G. Moore, "Editorial: Three types of interaction," Amer. J. Distance Educ, vol. 3, no. 3, pp. 1-6, Jan. 1989.
17. - A. F. Agudo-Peregrina, S. Iglesias-Pradas, M. - A. Conde-Gonzǎlez, and - A. Hernǎndez-Garcǐa, "Can we predict success from log data in VLEs? Classification of interactions for learning analytics and their relation with performance in VLE-supported F2F and online learning," Comput. Hum. Behav, vol. 31, pp. 542-550, Feb. 2014.
18. S. Dawson, N. Mirriahi, and D. Gasevic, "Importance of theory in learning analytics in formal and workplace settings," J. Learn. Anal, vol. 2, no. 2, pp. 1-4, Dec. 2015.
19. D. Cunningham and T. Duffy, "Constructivism: Implications for the design and delivery of instruction," Handbook Res. Educ. Commun. Technol., New York: McMillan, pp. 170-198, 1996.
20. M. Ally, "Foundations of educational theory for online learning," Theory and Practice of Online Learning. Athabasca, AB: Athabasca Univ., pp. 15-44, 2004.
21. H. Coates, R. James, and G. Baldwin, "A critical examination of the effects of learning management systems on university teaching and learning," Tertiary Educ. Manage, vol. 11, no. 1, pp. 19-36, Mar. 2005.
22. P. H. Winne, "A metacognitive view of individual differences in self-regulated learning," Learn. Individual Differences, vol. 8, no. 4, pp. 327-353, 1996.
23. P. H. Winne and A. F. Hadwin, "Studying as self-regulated learning,"Metacognition Educ. Theory Pract, vol. 93, pp. 27-30, 1998.
24. J. S. Brown, A. Collins, and P. Duguid, "Situated cognition and the culture of learning," Educ. Res, vol. 18, no. 1, pp. 32-42, 1989.
25. S. Buckingham Shum and R. D. Crick, "Learning dispositions and transferable competencies: Pedagogy, modelling and learning analytics," in Proc. 2nd Int. Conf. Learn. Analytics Knowl., 2012, pp. 92-101.
26. S. Rafaeli and G. Ravid, "Online, web-based learning environment for an information systems course: Access logs, linearity and performance," in Proc. Inf. Syst. Educ. Conf., 1997, vol. 97, pp. 92-99.
27. L. V. Morris, C. Finnegan, and S.-S. Wu, "Tracking student behavior, persistence, and achievement in online courses," Internet High. Educ, vol. 8, no. 3, pp. 221-231, 2005.
28. L. Macfadyen and S. Dawson, "Mining LMS data to develop an ?early warning system? for educators: A proof of concept," Comput. Educ, vol. 54, no. 2, pp. 588-599, Feb. 2010.
29. S. Dawson, E. McWilliam, and J. P.-L. Tan, "Teaching smarter: How mining ICT data can inform and improve learning and teaching practice," in Proc. Annu. Conf. Australasian Soc. Comput. Learn. Tertiary Educ., Jan. 2008, pp. 221-230.
30. D. Nandi, M. Hamilton, J. Harland, and G. Warburton, "How active are students in online discussion forums?" in Proc. 13th Australasian Comput. Educ. Conf., 2011, vol. 114, pp. 125-134.
31. T. Yu and I.-H. Jo, "Educational technology approach toward learning analytics: Relationship between student online behavior and learning performance in higher education," in Proc. 4th Int. Conf. Learn. Anal. Knowl., 2014, pp. 269-270.
32. N. Z. Zacharis, "A multivariate approach to predicting student outcomes in web-enabled blended learning courses," Internet High. Educ, vol. 27, pp. 44-53, Oct. 2015.
33. V. Kovanović, D. Gásević, S. Dawson, S. Joksimović, R. S. Baker, and M. Hatala, "Penetrating the black box of time-on-Task estimation," in Proc. 5th Int. Conf. Learn. Analytics Knowl., 2015, pp. 184-193.
34. C. Beer, K. Clark, and D. Jones, "Indicators of engagement," in Australian Soc. Comput. Learn. Tertiary Educ. Annu. Conf., 2010, pp. 75-86.
35. S. M. Jayaprakash, E. W. Moody, E. J. Lauría, J. R. Regan, and J. D. Baron, "Early alert of academically at-risk students: An open source analytics initiative," J. Learn.Anal, vol. 1, no. 1, pp. 6-47, 2014.
36. E. J. M. Lauría, J. D. Baron, M. Devireddy, V. Sundararaju, and S. M. Jayaprakash, "Mining academic data to improve college student retention: An open source perspective," in Proc. 2nd Int. Conf. Learn. Anal. Knowl., 2012, pp. 139-142.
37. B. Rienties, L. Toetenel, and A. Bryan, "?Scaling up? learning design: Impact of learning design activities on LMS behavior and performance," in Proc. 5th Int. Conf. Learn. Anal. Knowl., 2015, pp. 315-319.
38. J. Milne, L. M. Jeffrey, G. Suddaby, and A. Higgins, "Early identification of students at risk of failing," in Proc. Australian Soc. Comput. Learn. Tertiary Educ. Annu. Conf., 2012, pp. 657-661.
39. Y.-H. Hu, C.-L. Lo, and S.-P. Shih, "Developing early warning systems to predict students? online learning performance," Comput. Hum. Behav, vol. 36, pp. 469-478, Jul. 2014.
40. J. Schell, B. Lukoff, and C. Alvarado, "Using early warning signs to predict academic risk in interactive, blended teaching environments," Internet Learn, vol. 3, no. 2, 2014, Art. no. 6.
41. Y. Park, J. H. Yu, and I.-H. Jo, "Clustering blended learning courses by online behavior data: A case study in a Korean higher education institute," Internet High. Educ, vol. 29, pp. 1-11, Apr. 2016.
42. S. J. Dollinger, A. M. Matyja, and J. L. Huber, "Which factors best account for academic success: Those which college students can control or those they cannot?" J. Res. Personality, vol. 42, no. 4, pp. 872-885, Aug. 2008.
43. M. Munoz-Organero, P. J. Munoz-Merino, and C. D. Kloos, "Student behavior and interaction patterns with an LMS as motivation predictors in e-learning settings," IEEE Trans. Educ, vol. 53, no. 3, pp. 463-470, Aug. 2010.
44. J. W. You, "Identifying significant indicators using LMS data to predict course achievement in online learning," Internet High. Educ, vol. 29, pp. 23-30, Apr. 2016.
45. J. B. Arbaugh, "System, scholar or students? Which most influences online MBA course effectiveness?" J. Comput. Assist. Learn, vol. 30, no. 4, pp. 349-362, 2014.
46. J. Davies and M. Graff, "Performance in e-learning: Online participation and student grades," Brit. J. Educ. Technol, vol. 36, no. 4, pp. 657-663, 2005.
47. M. C. O?Connor and S. V. Paunonen, "Big five personality predictors of post-secondary academic performance," Personality Individual Differences, vol. 43, no. 5, pp. 971-990, Oct. 2007.
48. J. G. Nicholls, "Achievement motivation: Conceptions of ability, subjective experience, task choice, and performance," Psychol. Rev, vol. 91, no. 3, pp. 328-346, 1984.
49. J. Hattie, Visible Learning: A Synthesis of Over 800 Meta-Analyses Relating to Achievement. Evanston, IL, USA: Routledge, 2008.
50. J. F. Superby, J.-P. Vandamme, and N. Meskens, "Determination of factors influencing the achievement of the first-year university students using data mining methods," in Proc. 8th Int. Conf. Intell. Tutoring Syst., 2006, pp. 37-44.
51. M. A. Conard, "Aptitude is not enough: How personality and behavior predict academic performance," J. Res. Personality, vol. 40, no. 3, pp. 339-346, Jun. 2006.
52. J. Knight, "Distinguishing the learning approaches adopted by undergraduates in their use of online resources," Active Learn. High. Educ, vol. 11, no. 1, pp. 67-76, Mar. 2010.
53. S. Iglesias-Pradas, C. Ruiz-de-Azcárate, and Á. F. Agudo-Peregrina, "Assessing the suitability of student interactions from Moodle data logs as predictors of cross-curricular competencies," Comput. Human Behavior, vol. 47, pp. 81-89, 2015.
54. R.-S. Shaw, "A study of the relationships among learning styles, participation types, and performance in programming language learning supported by online forums," Comput. Educ, vol. 58, no. 1, pp. 111-120, Jan. 2012.
55. J. Hattie and H. Timperley, "The power of feedback," Rev. Educ. Res, vol. 77, no. 1, pp. 81-112, 2007.
56. A. N. Kluger and A. DeNisi, "The effects of feedback interventions on performance: A historical review, a meta-Analysis, and a preliminary feedback intervention theory," Psychol. Bull, vol. 119, no. 2, 1996, pp. 254-284.
57. B. Daniels, "CROSSFOLD: Stata module to perform k-fold cross-validation," Statistical Software Components S457426, Boston College Department of Economics, 2012.
58. L. Rankine, L. Stevenson, J. Malfroy, and K. Ashford-Rowe, "Benchmarking across universities: A framework for LMS analysis," in Proc. Australian Soc. Comput. Learn. Tertiary Educ. Annu. Conf., 2009, pp. 815-819.
59. O. Petropoulou, S. Retalis, K. Siassiakos, S. Karamouzis, and T. Kargidis, "Helping educators analyse interactions within networked learning communities: A framework and the AnalyticsTool system," in Proc. 6th Int. Conf. Netw. Learn., 2008, pp. 5-7.
60. L. Lockyer, E. Heathcote, and S. Dawson, "Informing pedagogical action: Aligning learning analytics with learning design," Amer. Behavioral Sci., Mar. 2013, pp. 1439-1459.