Multimodal data to design visual learning analytics for understanding regulation of learning

Computers in Human Behavior

Volumn 100, Issue , 2019, Pages 298-304

  Noroozi, Omid ^a,b   Alikhani, Iman ^a   Järvelä, Sanna ^a   Kirschner, Paul A ^a,c   Juuso, Ilkka ^a   Seppänen, Tapio ^a  

^a UNIVERSITY OF OULU   (Finland)

^b WAGENINGEN UNIVERSITY   (Netherlands)

^c OPEN UNIVERSITY OF THE NETHERLANDS   (Netherlands)

Author keywords

Collaborative learning; Learning; Learning analytics; Multimodality; Regulation of learning

Indexed keywords

DATA HANDLING; DATA VISUALIZATION; GRAPHICAL USER INTERFACES; MODAL ANALYSIS; VISUALIZATION;

COLLABORATIVE LEARNING; LEARNING; LEARNING ANALYTICS; MULTI-MODALITY; REGULATION OF LEARNING;

COMPUTER AIDED INSTRUCTION;

EID: 85065174048     PISSN: 07475632     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.chb.2018.12.019     Document Type: Article

References (52)

1. Antonietti, A., Colombo, B., Di Nuzzo, C., Metacognition in self-regulated multimedia learning: Integrating behavioural, psychophysiological and introspective measures. Learning, Media and Technology 40:2 (2014), 1–23.
2. Azevedo, R., Defining and measuring engagement and learning in science: Conceptual, theoretical, methodological, and analytical issues. Educational Psychologist 50:1 (2015), 84–94.
3. Baker, R., Siemens, G., Educational data mining and learning analytics. Sawyer, K., (eds.) Cambridge handbook of the learning sciences, 2nd ed., 2014, Cambridge University Press, Cambridge, MA, 253–274.
4. Bannert, M., Reimann, P., Sonnenberg, C., Process mining techniques for analysing patterns and strategies in students' self-regulated learning. Metacognition and Learning 9:2 (2014), 161–185.
5. Basol, G., Balgalmis, E., A multivariate investigation of gender differences in the number of online tests received-checking for perceived self-regulation. Computers in Human Behavior 58 (2016), 388–397.
6. Blikstein, P., Gomes, J.S., Akiba, H.T., Schneider, B., The effect of highly scaffolded versus general instruction on students' exploratory behavior and arousal. Technology, Knowledge and Learning 22:1 (2016), 105–128.
7. Chanel, G., Mühl, C., Connecting brains and bodies: Applying physiological computing to support social interaction. Interacting with Computers 27:5 (2015), 534–550.
8. Cranford, K.N., Tiettmeyer, J.M., Chuprinko, B.C., Jordan, S., Grove, N.P., Measuring load on working memory: The use of heart rate as a means of measuring chemistry students' cognitive load. Journal of Chemical Education 91:5 (2014), 641–647.
9. D'Mello, S.K., Duckworth, A., Dieterle, E., Advanced, analytic, automated (AAA) measurement of engagement during learning. Educational Psychologist 57:2 (2017), 104–123.
10. D'Mello, S., A selective meta-analysis on the relative incidence of discrete affective states during learning with technology. Journal of Educational Psychology 105:4 (2013), 1082–1099.
11. Fairclough, S.H., Venables, L., Tattersall, A., The influence of task demand and learning on the psychophysiological response. International Journal of Psychophysiology 56:2 (2005), 171–184.
12. Garbarino, M., Lai, M., Tognetti, S., Picard, R., Bender, D., Empatica E3 - a wearable wireless multi-sensor device for real-time computerized biofeedback and data acquisition. Proceedings of the 4th international conference on wireless mobile communication and healthcare - “transforming healthcare through innovations in mobile and wireless technologies,” 39–42, 2014 http://doi.org/10.4108/icst.mobihealth.2014.257418.
13. Gašević, D., Dawson, S., Siemens, G., Let's not forget: Learning analytics are about learning. TechTrends 59:1 (2015), 64–71.
14. Greller, W., Drachsler, H., Translating learning into numbers: Toward a generic framework for learning analytics. Siemens, G., (eds.) Educational Technology and society, special issue on learning analytics, 2012, 42–57 http://doi.org/10.1145/2330601.2330634.
15. Haapalainen, E., Kim, S., Forlizzi, J.F., Dey, A.K., Psycho-physiological measures for assessing cognitive load. Proceedings of the 12th ACM international conference on ubiquitous computing, 2010, 301–310.
16. Hadwin, A.F., Järvelä, S., Miller, M., Self-regulation, co-regulation and shared regulation in collaborative learning environments (pp. 83-106). Schunk, D., Greene, J., (eds.) Handbook of self-regulation of learning and performance, 2nd ed., 2017, Routledge, NY.
17. Harley, J.M., Bouchet, F., Hussain, M.S., Azevedo, R., Calvo, R., A multicomponential analysis of emotions during complex learning with an intelligent multiagent system. Computers in Human Behavior 48 (2015), 615–625.
18. Henriques, R., Paiva, A., Antunes, C., On the need of new methods to mine electrodermal activity in emotion-centered studies. Cao, L., Zeng, Y., Symeonidis, A.L., Gorodetsky, V.I., Yu, P.S., Singh, M.P., (eds.) Agents and data mining interaction, Vol. 7607, 2013, Springer, Berlin, 203–215.
19. Jarodzka, H., Holmqvist, K., Gruber, H., Eye tracking in educational science: Theoretical frameworks and research agendas. Journal of Eye Movement Research 10:1 (2017), 1–18.
20. Järvelä, S., Hadwin, A.F., New frontiers: Regulating learning in CSCL. Educational Psychologist 48:1 (2013), 25–39.
21. Järvelä, S., Järvenoja, H., Malmberg, J., Isohätälä, J., Sobocinski, M., How do types of interaction and phases of self-regulated learning set a stage for collaborative engagement?. Learning and Instruction 43:1 (2016), 39–51.
22. Kreibig, S.D., Gendolla, G.H.E., Scherer, K.R., Goal relevance and goal conduciveness appraisals lead to differential autonomic reactivity in emotional responding to performance feedback. Biological Psychology 91:3 (2012), 365–375.
23. Leite, I., Henriques, R., Martinho, C., Paiva, A., Sensors in the wild: Exploring electrodermal activity in child-robot interaction. Human-robot interaction (HRI) proceedings of the 8th ACM/IEEE international conference on human-robot interaction, 2013, IEEE Press Piscataway, NJ, USA, 41–48.
24. Li, X., Hong, X., Moilanen, A., Huang, X., Pfister, T., Zhao, G., et al. Towards reading hidden emotions: A comparative study of spontaneous micro-expression spotting and recognition methods. IEEE Transactions on Affective Computing, 99, 2017 https://doi.org/10.1109/TAFFC.2017.2667642.
25. Malmberg, J., Järvelä, S., Järvenoja, H., Capturing temporal and sequential patterns of self, co- and socially shared regulation in the context of collaborative learning. Contemporary Educational Psychology 49:1 (2017), 160–174.
26. Mikroyannidis, A., Okada, A., Scott, P., Rusman, E., Specht, M., Stefanov, K., et al. WeSPOT: A personal and social approach to inquiry-based learning. Journal of Universal Computer Science 19:14 (2013), 2093–2111.
27. Miller, M., Hadwin, A., Scripting and awareness tools for regulating collaborative learning: Changing the landscape of support in CSCL. Computers in Human Behavior 52:1 (2015), 573–588.
28. Molenaar, I., Chiu, M.M., Dissecting sequences of regulation and cognition: Statistical discourse analysis of primary school children's collaborative learning. Metacognition and Learning 9:2 (2014), 137–160 http://doi.org/10.1007/s11409-013-9105-8.
29. Mønster, D., Håkonsson, D.D., Eskildsen, J.K., Wallot, S., Physiological evidence of interpersonal dynamics in a cooperative production task. Physiology & Behavior 156:1 (2016), 24–34.
30. Nistor, N., Hernández-Garcíacc, A., What types of data are used in learning analytics? An overview of six cases. Computers in Human Behavior 89 (2018), 335–338.
31. Noroozi, O., Kirschner, P., Biemans, H.J.A., Mulder, M., Promoting argumentation competence: Extending from first- to second-order scaffolding through adaptive fading. Educational Psychology Review 30:1 (2018), 153–176.
32. Noroozi, O., Teasley, S.D., Biemans, H.J.A., Weinberger, A., Mulder, M., Facilitating learning in multidisciplinary groups with transactive CSCL scripts. International Journal of Computer-Supported Collaborative Learning 8:2 (2013), 189–223.
33. Noroozi, O., Weinberger, A., Biemans, H.J.A., Mulder, M., Chizari, M., Argumentation-based computer supported collaborative learning (ABCSCL). A systematic review and synthesis of fifteen years of research. Educational Research Review 7:2 (2012), 79–106.
34. Pecchinenda, A., Smith, C.A., The affective significance of skin conductance activity during a difficult problem-solving task. Cognition & Emotion 10:5 (1996), 481–504.
35. Pijeira-Díaz, H.J., Drachsler, H., Järvelä, S., Kirschner, P.A., Investigating collaborative learning success with physiological coupling indices based on electrodermal activity. Proceedings of the sixth international conference on learning analytics and knowledge, 2016, ACM, Edinburgh, United Kingdom April 25-29, 2016.
36. Reimann, P., Markauskaite, L., Bannert, M., E-research and learning theory: What do sequence and process mining methods contribute?. British Journal of Educational Technology 45:3 (2014), 528–540.
37. Roll, I., Winne, P.H., Understanding, evaluating, and supporting self-regulated learning using learning analytics. Journal of Learning Analytics 2:1 (2015), 7–12.
38. Tomaka, J., Blascovich, J., Kelsey, R.M., Leitten, C.L., Subjective, physiological, and behavioral effects of threat and challenge appraisal. Journal of Personality and Social Psychology 65:2 (1993), 248–260.
39. Verbert, K., Duval, E., Klerkx, J., Govaerts, S., Santos, J.L., Learning analytics dashboard applications. American Behavioral Scientist 57:10 (2013), 1500–1509.
40. Viberg, O., Hatakka, M., Bälter, O., Mavroudi, A., The current landscape of learning analytics in higher education. Computers in Human Behavior 89 (2018), 98–110.
41. Wallot, S., Roepstorff, A., Mønster, D., Multidimensional recurrence quantification analysis (MdRQA) for the analysis of multidimensional time-series: A software implementation in MATLAB and its application to group-level data in joint action. Frontiers in Psychology, 7, 2016, 1835 http://doi.org/10.3389/fpsyg.2016.01835.
42. Wang, M., Jacobson, M.J., Knowledge visualization for learning and knowledge management. Educational Technology & Society 14:3 (2011), 1–3.
43. Wang, M., Peng, J., Cheng, B., Zhou, H., Liu, J., Knowledge visualization for self-regulated learning. Educational Technology & Society 14:3 (2011), 28–42.
44. Winne, P.H., Comments on motivation in real-life, dynamic, and interactive learning environments. European Psychologist 9:4 (2004), 257–263.
45. Winne, P.H., Improving measurements of self-regulated learning. Educational Psychologist 45:4 (2010), 267–276.
46. Winne, P.H., Cognition and metacognition in self-regulated learning. Schunk, D., Greene, J., (eds.) Handbook of self-regulation of learning and performance, 2nd ed., 2017, Routledge, New York, NY.
47. Winne, P.H., Hadwin, A.F., Studying as self-regulated engagement in learning. Hacker, D., Dunlosky, J., Graesser, A., (eds.) Metacognition in educational theory and practice, 1998, Lawrence Erlbaum, Hillsdale, NJ, 277–304.
48. Wise, F.A., Hsiao, T.Y., Self-regulation in online discussions: Aligning data streams to investigate relationships between speaking, listening, and task conditions. Computers in Human Behavior, 2018 (in press) https://doi.org/10.1016/j.chb.2018.01.034.
49. Worsley, M., Blikstein, P., Leveraging multimodal learning analytics to differentiate student learning strategies. Proceedings of the fifth international conference on learning analytics and knowledge - LAK ’15, 2015, ACM Press, New York, USA, 360–367.
50. Zhang, X., Meng, Y., Ordóñez de Pablos, P., Sun, Y., Learning analytics in collaborative learning supported by slack: from the perspective of engagement. Computers in Human Behavior, 2018 (in press) https://doi.org/10.1016/j.chb.2017.08.012.
51. Zimmerman, B.J., Investigating self-regulation and motivation: Historical background, methodological developments, and future prospects. American Educational Research Journal 45:1 (2008), 166–183.
52. Zimmerman, B.J., Schunk, D.H., Self-regulated learning and performance: An Introduction and an overview. Zimmerman, B.J., Schunk, D.H., (eds.) Handbook of self-regulation of learning and performance, 2011, Routledge, New York, 1–12.