The current landscape of learning analytics in higher education

Computers in Human Behavior

Volumn 89, Issue , 2018, Pages 98-110

  Viberg, Olga ^a   Hatakka, Mathias ^b   Bälter, Olof ^a   Mavroudi, Anna ^a  

^a ROYAL INSTITUTE OF TECHNOLOGY   (Sweden)

^b ÖREBRO UNIVERSITY   (Sweden)

Author keywords

Evidence; Higher education; Learning analytics; Literature review; Research methods

Indexed keywords

BEHAVIORAL RESEARCH; HUMAN COMPUTER INTERACTION;

EVIDENCE; HIGHER EDUCATION; LEARNING ANALYTICS; LEARNING EXPERIENCES; LITERATURE REVIEWS; RESEARCH APPROACH; RESEARCH QUESTIONS; SCIENTIFIC KNOWLEDGE;

STUDENTS;

HUMAN; HUMAN EXPERIMENT; LANDSCAPE; LEARNING; REVIEW; STUDENT; TEACHING;

EID: 85053083367     PISSN: 07475632     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.chb.2018.07.027     Document Type: Review

References (93)

1. Agudo-Peregrina, Á.F., Iglesias-Pradas, S., Conde-González, M.Á., Hernández-García, Á., Can we predict success from log data in VLEs? Classification of interactions for learning analytics and their relation with performance in VLE-supported F2F and online learning. Computers in Human Behavior 31 (2014), 542–550.
2. Ali, L., Asadi, M., Gašević D., Jovanovic, J., Hatala, M., Factors influencing beliefs for adoption of a learning analytic tool: An empirical study. Computers & Education 62 (2013), 130–148.
3. Ali, L., Hatala, M., Gašević D., Jovanovic, J., A qualitative evolution of a learning analytics tool. Computers & Education 58 (2012), 470–489.
4. Arnold, K.E., Lonn, S., Pistilli, M.D., An exercise in institutional reflection: The learning analytics readiness instrument (LARI). Proceedings of the fourth international conference on learning analytics and knowledge, 2014, ACM, 163–167.
5. Arnold, K., Pistilli, M., Course signals at Purdue: Using learning analytics to increase student success. Proceedings of the second international learning analytics and knowledge conference, 2012, ACM, 267–270.
6. Arnold, K.E., Sclater, N., Student perceptions of their privacy in learning analytics applications. Proceedings of the seventh international learning analytics & knowledge conference, 2017, ACM, 66–69.
7. Avella, J., Kebritchi, M., Nunn, S., Kanai, T., Learning analytics methods, benefits, and challenges in higher education: A systematic literature review. Online Learning 20:2 (2016), 13–29.
8. Broadbent, J., Poon, W., Self-regulated learning strategies and academic achievement in online higher education learning environments: A systematic review. The Internet and Higher Education 27 (2015), 1–15.
9. Broos, T., Verbert, K., Langie, G., Van Soom, C., De Laet, T., Multi-institutional positioning test feedback dashboard for aspiring students: Lessons learnt from a case study in flanders. Proceedings of the 8th international conference on learning analytics and knowledge, 2018, ACM, 51–55.
10. Buckingham Shum, S., Crick, R., Learning dispositions and transferable competencies: Pedagogy, modelling and learning analytics. Proceedings of the 2nd international conference on learning analytics and knowledge, 2012, ACM, 92–101.
11. Casey, K., Using keystroke analytics to improve pass-fail classifiers. Journal of Learning Analytics 4:2 (2017), 189–211.
12. Casquero, O., Ovelar, R., Romo, J., Benito, M., Alberdi, M., Students’ personal networks in virtual and personal learning environments: A case study in higher education using learning analytics approach. Interactive learning environments 24:1 (2013), 49–67.
13. Chen, Y., Johri, A., Rangwala, H., Running out of STEM: A comparative study across STEM majors of college students at-risk of dropping out early. Proceedings of the 8th international conference on learning analytics and knowledge, 2018, ACM, 270–279.
14. Chiu, M., Fujita, N., Statistical discourse analysis of online Discussions: Informal cognition, social metacognition, and knowledge creation. Proceedings of the fourth international conference on learning analytics and knowledge, 2014, ACM, 217–225.
15. Clow, D., An overview of learning analytics. Teaching in Higher Education 18:6 (2013), 683–695.
16. Daniel, B., Big Data and analytics in higher education: Opportunities and challenges. British Journal of Educational Technology 46:5 (2015), 904–920.
17. Dawson, S., Gašević D., Siemens, G., Joksimovic, S., Current state and future trends: A citation network analysis of the learning analytics field. Proceedings of the fifth international conference on learning analytics and knowledge, 2014, ACM, 231–240.
18. Dimopoulos, I., Petropoulou, O., Retails, S., Assessing students’ performance using the learning analytics enriched rubrics. Proceedings of the third international conference on learning analytics and knowledge conference, 2013, ACM, 195–198.
19. Drachsler, H., Kalz, M., The MOOC and learning analytics innovative cycle (MOLAC): A reflective summary of ongoing research and its challenges. Journal of Computer Assisted Learning 32 (2016), 281–290.
20. Echeverria, V., Martinez-Maldonado, R., Granda, R., Chiluiza, K., Conati, C., Shum, S.B., Driving data storytelling from learning design. Proceedings of the 8th international conference on learning analytics and knowledge, 2018, ACM, 131–140.
21. Ezen-Can, A., Grafsgaard, J., Lester, J., Boyer, K., Classifying student dialogue acts with multimodal learning analytics. Proceedings of the fifth international conference on learning analytics and knowledge, 2015, ACM, 280–289.
22. Ferguson, R., Learning analytics: Drivers, developments and challenges. International Journal of Technology Enhanced Learning 4:5/6 (2012), 304–317.
23. Ferguson, R., Brasher, A., Cooper, A., Hillaire, G., Mittelmeier, J., Rienties, B., Vuorikari, R., Research evidence of the use of learing analytics; implications for education policy. Vuorikari, R., Castano-Munoz, J., (eds.) A European framework for action on learning analytics, 2016, Joint Research Centre Science for Policy Report, Luxembourg, 1–152.
24. Ferguson, R., Clow, D., Where is the evidence? A call to action for learning analytics. Proceedings of the seventh international learning analytics & knowledge conference, 2017, ACM, 56–65.
25. Ferguson, R., Wei, Z., He, Y., Buckingham Shum, S., An evaluation of learning analytics to identify exploratory dialogue in online discussions. Proceedings of the third international conference on learning analytics and knowledge conference, 2013, ACM, 85–93.
26. de Freitas, S., Gibson, D., Du Plessis, C., Halloran, P., Williams, E., Ambrose, M., et al. Foundations of dynamic learning analytics: Using university student data to increase retention. British Journal of Educational Technology 46:6 (2015), 1175–1188.
27. Gašević D., Mirriahi, N., Dawson, S., Analytics of the effects of video use and instruction to support reflective learning. Proceedings of the fourth international conference on learning analytics and Knowledge, 2014, ACM, 123–132.
28. Gilmore, D., Goffman's front stage and backstage behaviours in online education. Journal of Learning Analytics 1:3 (2014), 187–190.
29. Grönlund, Å., Andersson, A., e-Gov research quality improvements since 2003: More rigor, but research (perhaps) redefined. Proceedings of 5th international conference, EGOV 2005. Krakow, Poland, 2006, Springer, Heidelberg, Germany.
30. Guarcello, M., Levine, R., Beemer, J., Frazee, J., Laumakis, M., Schellenberg, A., Balancing student Success: Assessing supplemental instruction through coarsened Exact matching. Technology, Knowledge and Learning 22:3 (2017), 335–352.
31. Hart, S., Daucourt, M., Ganley, C., Individual differences related to college students’ course performance in Calculus II. Journal of Learning Analytics 4:2 (2017), 129–153.
32. Herodotou, C., Rienties, B., Boroowa, A., Zdrahal, Z., Hlosta, M., Naydenova, G., Implementing predictive learning analytics on a large scale: The teacher's perspective. Proceedings of the seventh international learning analytics & knowledge conference, 2017, ACM, 267–271.
33. Ihantola, P., Vihavainen, A., Ahadi, A., Butler, M., Börstler, J., Edwards, S., Toll, D., Educational data mining and learning analytics in programming: Literature review and case studies. Proceedings of the 2015 ITiCSE working group reports, 2016, ACM, 41–63.
34. Jivet, I., Scheffel, M., Specht, M., Drachsler, H., License to evaluate: Preparing learning analytics dashboards for educational practice. Proceedings of the 8th international conference on learning analytics & knowledge, 2018, ACM, 31–40.
35. Junco, R., Clem, C., Predicting course outcomes with digital textbook usage data. The Internet and Higher Education 27 (2015), 54–63.
36. Kovanović V., Gašević D., Dawson, S., Joksimović S., Baker, R., Hatala, M.M., Penetrating the black box of time-on-task estimation. Proceedings of the fifth international conference on learning analytics and knowledge, 2015, ACM, 184–193.
37. Kwong, T., Wong, E., Yue, K., Bringing abstract academic integrity and ethical concepts into real-life situations. Technology. Knowledge and Learning 22:3 (2017), 353–368.
38. Lang, C., Macfadyen, L.P., Slade, S., Prinsloo, P., Sclater, N., The complexities of developing a personal code of ethics for learning analytics practitioners: Implications for institutions and the field. Proceedings of the 8th international conference on learning analytics and knowledge, 2018, ACM, 436–440.
39. Lawson, C., Beer, C., Dolene, R., Moore, T., Fleming, J., Identification of “At Risk” students using learning analytics: The ethical dilemmas of intervention strategies in higher education institution. Educational Technology Research & Development 64:5 (2016), 957–968.
40. Lee, K., Rethinking the accessibility of online higher education: A historical overview. The Internet and Higher Education 33 (2017), 15–23.
41. Leitner, P., Khallil, M., Ebner, M., Learning analytics in higher education – a literature review. Peña-Ayala, A., (eds.) Learning Analytics: Fundaments, Applications, and Trends: A View of the Current Stat of the Art to Enhance e-Learning, 2017, Springer, Chum, 1–23.
42. Liu, M., Kang, J., Zou, W., Lee, H., Pan, Z., Corliss, S., Using data to understand how to better design adaptive learning. Technology, Knowledge and Learning 22:3 (2017), 271–298.
43. Lodge, J.M., Alhadad, S.S., Lewis, M.J., Gašević D., Inferring learning from big Data: The importance of a transdisciplinary and multidimensional approach. Technology, Knowledge and Learning 22:3 (2017), 385–400.
44. Long, P., Siemens, G., Penetrating the fog: Analytics in learning and education. Educause Review 46:5 (2011), 31–40.
45. Lonn, S., Krumm, A., Waddington, R., Teasley, S., Bridging the gap from knowledge to action: Putting analytics in the hands of academic advisors. Proceedings of the second international conference on learning analytics and knowledge conference, 2012, ACM, 184–187.
46. Mah, D.-K., Learning analytics and digital badges: Potential impact on student retention in higher education. Technology, Knowledge and Learning 21:3 (2016), 285–305.
47. Mangaroska, K., Sharma, K., Giannakos, M., Trætteberg, H., Dillenbourg, P., Gaze insights into debugging behavior using learner-centred analysis. Proceedings of the 8th international conference on learning analytics and knowledge, 2018, March, ACM, 350–359.
48. McCoy, C., Shih, P., Teachers as producers of data analytics: A case study of a teacher-focused educational data science program. Journal of Learning Analytics 3:3 (2016), 193–214.
49. th e-Learning Conference of the German Computer Society, München, Germany, September 1, 2015 Retrieved from https://pdfs.semanticscholar.org/1d3a/de2c0a5a60be82030616b99ebd8426238098.pdf 2018-05-17.
50. Millecamp, M., Gutiérrez, F., Charleer, S., Verbert, K., De Laet, T., A qualitative evaluation of a learning dashboard to support advisor-student dialogues. Proceedings of the 8th international conference on learning analytics and knowledge, 2018, March, ACM, 56–60.
51. Minovic, M., Milavanovic, M., Sosevic, U., Gonzales, M., Visualisation of student learning model in serious games. Computers in Human Behavior 47 (2015), 98–107.
52. Nguyen, Q., Huptych, M., Rienties, B., Linking students’ timing of engagement to learning design and academic performance. Proceedings of the 8th international conference on learning analytics and knowledge, 2018, ACM, 141–150.
53. Nguyen, Q., Rienties, B., Toetenel, L., Unravelling the dynamics of instructional practice: A longitudinal study on learning design and VLE activities. Proceedings of the seventh international learning analytics & knowledge conference, 2017, ACM, 168–177.
54. Nistor, N., Baltes, B., Dascălu, M., Mihăilă D., Smeaton, G., Trăuşan-Matu, Ş., Participation in virtual academic communities of practice under the influence of technology acceptance and community factors. A learning analytics application. Computers in Human Behavior 34 (2014), 339–344.
55. Nistor, N., Derntl, M., Klamma, R., Learning Analytics: Trends and issues of the empirical research of the years 2011-2014. Conole et al, G., (eds.) Design for teaching and learning in a networked world: Ec-tel 2015, LNCS 9307, 2015, Springer, 453–459.
56. Ochoa, X., Domínguez, F., Guamán, B., Maya, R., Falcones, G., Castells, J., The RAP system: Automatic feedback of oral presentation skills using multimodal analysis and low-cost sensors. Proceedings of the 8th international conference on learning analytics and knowledge, 2018, ACM, 360–364.
57. Oster, M., Lonn, S., Pistilli, M.D., Brown, M.G., The learning analytics readiness instrument. Proceedings of the sixth international conference on learning analytics & knowledge, 2016, April, ACM, 173–182.
58. Papamitsiou, Z., Economides, A., Learning analytics and educational data mining in practice: A systematic literature review of empirical evidence. Educational Technology & Society 17:4 (2014), 49–64.
59. Papamitsiou, Z., Karapistoli, E., Economides, A., Applying classification techniques on temporal trace data for shaping student behavior models. Proceedings of the sixth international conference on learning analytics & knowledge, 2016, ACM, 299–303.
60. Peña-Ayala, A., Learning analytics: A glance of evolution, status, and trends according to a proposed taxonomy. WIREs Data Mining Knowl Discov, 2018, 10.1002/widm.1243 2018, 8: null.
61. Picciano, A., The evolution of big data and learning analytics in American higher education. Journal of Asynchronous Learning Networks 16:3 (2012), 9–20.
62. Prinsloo, P., Slade, S., Student vulnerability, agency, and learning analytics: An exploration. Journal of Learning Analytics 3:1 (2016), 159–182.
63. Prinsloo, P., Slade, S., An elephant in the learning analytics room: The obligation to act. Proceedings of the seventh international learning analytics & knowledge conference, 2017, ACM, 46–55.
64. Rienties, B., Toetenel, L., The impact of 151 learning designs on student satisfaction and performance: Social learning (analytics) matters. Proceedings of the sixth international conference on learning analytics & knowledge, 2016, ACM, 339–343.
65. Rienties, B., Toetenel, L., Bryan, A., “Scaling up” learning design: Impact of learning design activities on LMS behavior and performance. Proceedings of the fifth international conference on learning analytics and knowledge, 2015, ACM, 315–319.
66. Rodríguez-Triana, M.J., Prieto, L.P., Martínez-Monés, A., Asensio-Pérez, J.I., Dimitriadis, Y., The teacher in the loop: Customizing multimodal learning analytics for blended learning. Proceedings of the 8th international conference on learning analytics and knowledge, 2018, ACM, 417–426.
67. Rubel, A., Jones, K., Student privacy in learning analytics: An information ethics perspective. The Information Society 32:2 (2016), 143–159.
68. Santos, J., Verbert, K., Govaerts, S., Duval, E., Addressing learner issues with StepUp!: An evaluation. Proceedings of the third international conference on learning analytics and knowledge conference, 2013, ACM, 14–22.
69. Schumacher, C., Ifenthaler, D., Features students really expect from learning analytics. Computers in Human Behavior 7 (2018), 397–407.
70. Siemens, G., Baker, R., Learning analytics and educational data mining: Towards communication and collaboration. Proceedings of the second international conference on learning analytics & knowledge, 2012, ACM, 252–254.
71. Sin, K., Muthu, L., Application of big data in educational data mining and learning analytics - a literature review. ICTAC Journal of Soft Computing 5:4 (2015), 1035–1049.
72. Slade, S., Prinsloo, P., Learning analytics: Ethical issues and dilemmas. American Behavioral Scientist 57:10 (2013), 1510–1529.
73. Sonnerberg, C., Bannert, M., Discovering the effects of metacognitive prompts on the sequential structure of SRL-processes using process mining techniques. Journal of Learning Analytics 2:1 (2015), 72–100.
74. Strang, K., Beyond engagement analytics: Which online mixed-data factors predict student learning outcomes?. Education and Information Technologies 20:4 (2016), 1–21.
75. Tabuenca, B., Kalz, M., Drachsler, H., Specht, M., Time will tell: The role of mobile learning analytics in self-regulated learning. Computers & Education 89 (2015), 53–74.
76. Tempelaar, D., Cuypers, H., van de Vrie, E., Heck, A., van der Kooij, H., Formative assessment and learning analytics. Proceedings of the third international conference on learning analytics and knowledge conference, 2013, ACM, 205–209.
77. Tempelaar, D., Rienties, B., Giesbers, B., In search for the most informative data for feedback generation: Learning analytics in a data-rich context. Computers in Human Behavior 47 (2015), 157–167.
78. Tempelaar, D., Rienties, B., Nguyen, Q., Adding disposition to create pedagogy-based learning analytics. Journal of Higher Education Development 12:1 (2017), 15–35.
79. Tsai, Y.S., Moreno-Marcos, P.M., Tammets, K., Kollom, K., Gašević D., SHEILA policy framework: Informing institutional strategies and policy processes of learning analytics. Proceedings of the 8th international conference on learning analytics and knowledge, 2018, ACM, 320–329.
80. Van Barneveld, A., Arnold, K.E., Campbell, J.P., Analytics in higher education: Establishing a common language. Educause Learning Initiative 1 (2012), 1–11.
81. Viberg, O., Design and use of mobile technology in distance language education: Matching learning practices with technologies-in-practice. Doctoral dissertation, 2015, Örebro University, Sweden.
82. Viberg, O., Grönlund, Å., Systematising the field of mobile assisted language learning. International Journal of Mobile and Blended Learning 5:4 (2013), 72–90.
83. Waddington, T., Nam, S., Lonn, S., Teasley, S., Improving early warning systems with categorized course resource usage. Journal of Learning Analytics 3:3 (2016), 263–290.
84. Webster, J., Watson, R., Analyzing the past to prepare for the future: Writing a literature review. Management Information Systems Quarterly 26:2 (2002), xiii–xxiii.
85. West, D., Heath, D., Huijser, H., Let's Talk learning analytics: A framework for implementation in relation to student retention. Online Learning 20:2 (2016), 30–50.
86. Whitelock, D., Twiner, A., Richardson, J., Field, D., Pulman, S., OpenEssayist: A supply and demand learning analytics tool for drafting academic essays. Proceedings of the fifth international conference on learning analytics and knowledge, 2015, ACM, 208–212.
87. Williams, P., Assessing collaborative learning: Big data, analytics and university futures. Assessment & Evaluation in Higher Education 42:6 (2017), 978–989.
88. Wise, A., Perera, N., Hsiao, Y.-T., Speer, J., Marbouti, F., Microanalytic case studies of individual participation patterns in an asynchronous online discussion in an undergraduate blended course. The Internet and Higher Education 15 (2012), 108–117.
89. Wise, A., Vytasek, J., Hausknecht, S., Zhao, Y., Developing learning analytics design knowledge in the “middle space”: The student tuning model and align design framework for learning analytics work. Online Learning 20:2 (2016), 155–182.
90. Wise, A., Zhao, Y., Hausknecht, S., Learning analytics for online discussion: A pedagogical model for intervention with embedded and extracted analytics. Proceedings of the third international conference on learning analytics and knowledge conference, 2013, ACM, 48–56.
91. Worsley, M., (Dis)engagement matters: Identifying efficacious learning practices with multimodal learning analytics. Proceedings of the 8th international conference on learning analytics and knowledge, 2018, ACM, 365–369.
92. Worsley, M., Blikstein, P., Leveraging multimodal learning analytics to differentiate student learning strategies. Proceedings of the fifth international conference on learning analytics and knowledge, 2015, ACM, 360–367.
93. Xing, W., Guo, R., Petakovic, E., Goggins, S., Participation-based student final performance prediction model through interpretable Genetic Programming: Integrating learning analytics, educational data mining and theory. Computers in Human Behavior 47 (2015), 168–181.