Self-regulated learning strategies predict learner behavior and goal attainment in Massive Open Online Courses

Computers and Education

Volumn 104, Issue , 2017, Pages 18-33

  Kizilcec, René F ^a   Pérez Sanagustín, Mar ^b   Maldonado, Jorge J ^b,c  

^a STANFORD UNIVERSITY   (United States)

^b PONTIFICIA UNIVERSIDAD CATÓLICA DE CHILE   (Chile)

^c UNIVERSIDAD DE CUENCA   (Ecuador)

Author keywords

Individual differences; Learning analytics; Massive open online course; Online learning; Self regulated learning

Indexed keywords

COMPUTER AIDED INSTRUCTION; CURRICULA; LEARNING SYSTEMS; ONLINE SYSTEMS; SURVEYS;

INDIVIDUAL DIFFERENCES; LEARNING ANALYTICS; MASSIVE OPEN ONLINE COURSE; ONLINE LEARNING; SELF-REGULATED LEARNING;

E-LEARNING;

EID: 84994524464     PISSN: 03601315     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.compedu.2016.10.001     Document Type: Article

References (96)

1. Aleven, V., Stahl, E., Schworm, S., Fischer, F., Wallace, R., Help seeking and help design in interactive learning environments. Review of Educational Research 73:3 (2003), 277–320.
2. Anderson, A., Huttenlocher, D., Kleinberg, J., & Leskovec, J. (2014). Engaging with massive online courses. WWW ’14 Proceedings of the 23rd International Conference on World Wide Web, 687–698. http://dx.doi.org/10.1145/2566486.2568042.
3. Azevedo, R., Aleven, V., Metacognition and learning technologies: An overview of current interdisciplinary research. In International handbook of metacognition and learning technologies, 2013, Springer, New York, 1–16.
4. Azevedo, R., Cromley, J.G., Does training on self-regulated learning facilitate students' learning with hypermedia?. Journal of Educational Psychology, 96(3), 2004, 523.
5. Azevedo, R., Moos, D.C., Greene, J.A., Winters, F.I., Cromley, J.G., Why is externally-facilitated regulated learning more effective than self-regulated learning with hypermedia?. Educational Technology Research and Development 56:1 (2008), 45–72.
6. Bandura, A., Self-efficacy: The exercise of control. 1997, Freeman, New York, NY, USA.
7. Banerjee, A.V., Duflo, E., (Dis)Organization and success in an economics MOOC. American Economic Review, Vol. 104, 2014, 514–518, 10.1257/aer.104.5.514.
8. Bannert, M., Reimann, P., Sonnenberg, C., Process mining techniques for analysing patterns and strategies in students' self-regulated learning. Metacognition and Learning 9:2 (2014), 161–185, 10.1007/s11409-013-9107-6.
9. de Barba, P.G., Kennedy, G.E., Ainley, M.D., The role of students' motivation and participation in predicting performance in a MOOC Motivation and participation in MOOCs. Journal of Computer Assisted Learning(March 2015), 2016, 10.1111/jcal.12130.
10. Barnard-Brak, L., Paton, V.O., Lan, W.Y., Profiles in self-regulated learning in the online learning environment. The International Review of Research in Open and Distributed Learning 11:1 (2010), 61–80.
11. Barnard, L., Paton, V., Lan, W., Online self-regulatory learning behaviors as a mediator in the relationship between online course perceptions with achievement. The International Review of Research in Open and Distributed Learning, 9(2), 2008.
12. Basol, G., Balgalmis, E., A multivariate investigation of gender differences in the number of online tests received-checking for perceived self-regulation. Computers in Human Behavior 58 (2016), 388–397.
13. Beheshitha, S. S., Gašević, D., & Hatala, M. (2015). A process mining approach to linking the study of aptitude and event facets of self-regulated learning. Proceedings of the Fifth International Conference on Learning Analytics And Knowledge - LAK ’15, 265–269. http://dx.doi.org/10.1145/2723576.2723628.
14. Beishuizen, J., Steffens, K., A conceptual framework for research on self-regulated learning. Self-regulated learning in technology enhanced learning environments, 2011, Springer, 3–19.
15. Boekaerts, M., Self-regulated learning : Where we are today. International Journal of Educational Research 31 (1999), 445–457.
16. Borkowski, J.G., Metacognition: Theory or chapter heading?. Learning and Individual Differences 8:4 (1996), 391–402.
17. Boud, D., Enhancing learning through self-assessment. 1995, Routledge.
18. Breslow, L., Pritchard, D.E., DeBoer, J., Stump, G., Ho, A.D., Seaton, D., Studying learning in the worldwide classroom: Research into edX's first MOOC. Research & Practice in Assessment 8:March 2012 (2013), 13–25 Retrieved from http://www.mendeley.com/catalog/studying-learning-worldwide-classroom-research-edxs-first-mooc/.
19. Broadbent, J., Poon, W., Self-regulated learning strategies & academic achievement in online higher education learning environments: A systematic review. The Internet and Higher Education 27 (2015), 1–13, 10.1016/j.iheduc.2015.04.007.
20. Butler, D.L., Winne, P.H., Feedback and self-regulated learning: A theoretical synthesis. Review of Educational Research 65:3 (1995), 245–281, 10.3102/00346543065003245.
21. Buuren, S., Groothuis-Oudshoorn, K., Mice: Multivariate imputation by chained equations in R. Journal of Statistical Software, 45(3), 2011.
22. Chen, G., Davis, D., Lin, J., Hauff, C., & Houben, G.-J. (2016). Beyond the MOOC platform: Gaining Insights aboutLearners from the Social Web. Proceedings of the 8th ACM Conference on Web Science, WebSci’16, 15–24. http://dx.doi.org/10.1145/2908131.2908145.
23. Davis, D., Chen, G., Hauff, C., & Houben, G. (2016). Gauging MOOC Learners' Adherence to the Designed Learning Path. In Proceedings of the 9th International Conference on Educational Data Mining (EDM). Raleigh, NC, USA.
24. Davis, D., Chen, G., Zee, T., Van Der, Hauff, C., & Houben, G. (2016). Retrieval Practice and Study Planning in MOOCs: Exploring Classroom-Based Self-Regulated Learning Strategies at Scale. In Proceedings of the 11th European Conference on Technology Enhanced Learning (EC-TEL).
25. Dignath, C., Büttner, G., Components of fostering self-regulated learning among students. A meta-analysis on intervention studies at primary and secondary school level. Metacognition and Learning 3:3 (2008), 231–264.
26. Duckworth, A.L., Grant, H., Loew, B., Oettingen, G., Gollwitzer, P.M., Self-regulation strategies improve self-discipline in adolescents: Benefits of mental contrasting and implementation intentions. Educational Psychology 31:1 (2011), 17–26, 10.1080/01443410.2010.506003.
27. Duckworth, A.L., Kirby, T.A., Gollwitzer, A., Oettingen, G., From fantasy to action: Mental contrasting with implementation intentions (MCII) improves academic performance in children. Social Psychological and Personality Science 4:6 (2013), 745–753, 10.1177/1948550613476307.
28. Effeney, G., Carroll, A., Bahr, N., Self-regulated learning: Key strategies and their sources in a sample of adolescent males1. Australian Journal of Educational and Developmental Psychology 13 (2013), 58–74.
29. Evans, B.J., Baker, R.B., Dee, T.S., Persistence patterns in Massive Open Online Courses (MOOCs). Journal of Higher Education 87:2 (2016), 206–242, 10.1353/jhe.2016.0006.
30. Friedman, J., Hastie, T., Tibshirani, R., The elements of statistical learning. 2001, Springer, Berlin, Germany.
31. Gašević, D., Dawson, S., Siemens, G., Let's not forget: Learning analytics are about learning. TechTrends 59:1 (2015), 64–71.
32. Guo, P. J., & Reinecke, K. (2014). Demographic differences in how students navigate through MOOCs. Proceedings of the First ACM Conference on Learning @ Scale Conference - L@S ’14, 21–30. http://dx.doi.org/10.1145/2556325.2566247.
33. Hadwin, A.F., Nesbit, J.C., Jamieson-Noel, D., Code, J., Winne, P.H., Examining trace data to explore self-regulated learning. Metacognition and Learning 2:2–3 (2007), 107–124, 10.1007/s11409-007-9016-7.
34. Hansen, J.D., Reich, J., Democratizing education? Examining access and usage patterns in massive open online courses. Science (New York, N.Y.), 350:6265 (2015), 1245–1248, 10.1126/science.aab3782.
35. Henrich, J., Heine, S.J., Norenzayan, A., The weirdest people in the world?. The Behavioral and Brain Sciences 33:2–3 (2010), 61–83, 10.1017/S0140525X0999152X discussion 83–135.
36. Hew, K.F., Cheung, W.S., Students' and instructors' use of massive open online courses (MOOCs): Motivations and challenges. Educational Research Review 12 (2014), 45–58, 10.1016/j.edurev.2014.05.001.
37. Ho, A.D., Chuang, I., Reich, J., Coleman, C.A., Whitehill, J., Northcutt, C.G.,.. Petersen, R., HarvardX and MITx : Two years of open online courses fall 2012-Summer 2014. SSRN Electronic Journal 10 (2015), 1–37, 10.2139/ssrn.2586847.
38. Hood, N., Littlejohn, A., Milligan, C., Context counts: How learners’ contexts influence learning in a MOOC. Computers & Education 91 (2015), 83–91, 10.1016/j.compedu.2015.10.019.
39. Jordan, K., Initial trends in enrolment and completion of massive open online courses. The International Review Of Research In Open And Distributed Learning, 15(1), 2014, 10.19173/irrodl.v15i1.1651.
40. Karpicke, J.D., Roediger, H.L., The critical importance of retrieval for learning. Science 319:5865 (2008), 966–968, 10.1126/science.1152408 (New York, N.Y.).
41. Kim, C., Hodges, C.B., Effects of an emotion control treatment on academic emotions, motivation and achievement in an online mathematics course. Instructional Science 40:1 (2012), 173–192, 10.1007/s11251-011-9165-6.
42. Kizilcec, R. F. & Brooks, C. (in press). Diverse Big Data and Randomized Field Experiments in Massive Open Online Courses: Opportunities for Advancing Learning Research. In G. Siemens & C. Lang (Eds.), Handbook on Learning Analytics & Educational Data Mining.
43. Kizilcec, R. F., & Halawa, S. (2015). Attrition and Achievement Gaps in Online Learning. In Proceedings of the Second ACM Conference on Learning @ Scale. http://dx.doi.org/10.1145/2724660.2724680.
44. Kizilcec, R. F., Piech, C., & Schneider, E. (2013). Deconstructing Disengagement: Analyzing Learner Subpopulations in Massive Open Online Courses. In Proceedings of the Third International Conference on Learning Analytics and Knowledge. http://dx.doi.org/10.1145/2460296.2460330.
45. Kizilcec, R.F., Pérez-Sanagustín, M., Maldonado, J.J., Recommending self-regulated learning strategies does not improve performance in a MOOC. Proceedings of the Third ACM Conference on Learning @ Scale, 2016, 10.1145/2876034.2893378.
46. Kizilcec, R.F., Schneider, E., Motivation as a lens to understand online Learners: Toward data-driven design with the OLEI scale. Transactions on Computer-Human Interactions (TOCHI), 22(2), 2015, 10.1145/2699735.
47. Koedinger, K. R., Mclaughlin, E. a, Kim, J., Zhuxin Jia, J., & Bier, N. L. (2015). Learning is Not a Spectator Sport: Doing is Better than Watching for Learning from a MOOC. In Proceedings of the Second ACM Conference on Learning @ Scale. http://dx.doi.org/10.1145/2724660.2724681.
48. Lajoie, S., Azevedo, R., Teaching and learning in technology-rich environments. Handbook of educational psychology, Vol. 2, 2006, 803–821.
49. Lee, T.-H., Shen, P.-D., Tsai, C.-W., Applying web-enabled problem-based learning and self-regulated learning to add value to computing education in Taiwan's vocational schools. Educational Technology & Society 11:3 (2008), 13–25.
50. Liang, J.-C., Tsai, C.-C., Internet self-efficacy and preferences toward constructivist internet-based learning environments: A study of pre-school teachers in Taiwan. Educational Technology & Society 11:1 (2008), 226–237.
51. Liou, P.-Y., Kuo, P.-J., Validation of an instrument to measure students' motivation and self-regulation towards technology learning. Research in Science & Technological Education 32:2 (2014), 79–96, 10.1080/02635143.2014.893235.
52. Little, R.J.A., Missing-data adjustments in large surveys. Journal of Business & Economic Statistics 6:3 (1988), 287–296, 10.2307/1391881.
53. Littlejohn, A., Hood, N., Milligan, C., Mustain, P., Learning in MOOCs: Motivations and self-regulated learning in MOOCs. The Internet and Higher Education 29 (2016), 40–48, 10.1016/j.iheduc.2015.12.003.
54. Littlejohn, A., Milligan, C., Designing MOOCs for profesional learners: Tools and patterns to encourage self_regulated learning. Design Paper 42:June (2015), 1–10 Retrieved from http://www.openeducationeuropa.eu/en/article/Design-Patterns-for-Open-Online-Teaching-and-Learning-Design-Paper-42-4.
55. Mullaney, T., & Reich, J. (2015). Staggered Versus All-At-Once Content Release in Massive Open Online Courses: Evaluating a Natural Experiment. Proceedings of the Second (2015) ACM Conference on Learning @ Scale, 185–194. http://dx.doi.org/10.1145/2724660.2724663.
56. Nawrot, I., & Doucet, A. (2014). Building engagement for MOOC students: introducing support for time management on online learning platforms. In Proceedings of the companion publication of the 23rd international conference on World wide web companion (pp. 1077–1082).
57. Nicol, D.J., Macfarlane-dick, D., Formative assessment and self-regulated learning: A model and seven principles of good feedback practice. Studies in Higher Education (2006) 31:2 (2006), 199–218, 10.1080/03075070600572090.
58. Niemi, H., Nevgi, A., Virtanen, P., Towards self-regulation in web-based learning. Journal of Educational Media 28:1 (2003), 49–71, 10.1080/1358165032000156437.
59. Ogan, A., Walker, E., Baker, R., Rodrigo, M.M.T., Soriano, J.C., Castro, M.J., Towards understanding how to assess help-seeking behavior across cultures. International Journal of Artificial Intelligence in Education 25:2 (2015), 229–248, 10.1007/s40593-014-0034-8.
60. Perna, L.W., Ruby, A., Boruch, R.F., Wang, N., Scull, J., Evans, C., Moving through MOOCs: Understanding the progression of users in Massive Open Online Courses. Educational Researcher(December), 2014, 421–432, 10.3102/0013189X14562423.
61. Pintrich, P.R., The role of motivation in promoting and sustaining self-regulated learning. International Journal of Educational Research 31:6 (1999), 459–470.
62. Pintrich, P.R., The role of goal orientation in self-regulated learning. Boekaerts, M., Pintrich, P.R., Zeidner, M., (eds.) Handbook of self-regulation, 2000, Academic Press, San Diego, 451–502 http://dx.doi.org/10.1016/B978-012109890-2/50043-3.
63. Pintrich, P.R., A conceptual framework for assessing motivation and self-regulated learning in college students. Educational Psychology Review 16:4 (2004), 385–407.
64. Pintrich, P.R., others, A manual for the use of the motivated strategies for learning questionnaire (MSLQ). 1991.
65. Puustinen, M., Pulkkinen, L., Models of self-regulated learning: A review. Scandinavian Journal of Educational Research 45:3 (2001), 269–286.
66. Reich, J., MOOC completion and retention in the context of student intent. EDUCASE Review Online, 2014 Retrieved from http://er.educause.edu/articles/2014/12/mooc-completion-and-retention-in-the-context-of-student-intent.
67. Reich, J., Rebooting MOOC research. Science 347:6217 (2015), 34–35.
68. Richardson, M., Abraham, C., Bond, R., Psychological correlates of university students' academic performance: A systematic review and meta-analysis. Psychological Bulletin, 138(2), 2012, 353.
69. Rigotti, T., Schyns, B., Mohr, G., A short version of the occupational self-efficacy scale: Structural and construct validity across five countries. Journal of Career Assessment 16:2 (2008), 238–255.
70. Roll, I., Winne, P.H., Understanding, evaluating, and supporting self-regulated learning using learning analytics. Journal of Learning Analytics 2 (2015), 7–12.
71. Samruayruen, B., Enriquez, J., Natakuatoong, O., Samruayruen, K., Self-regulated learning: A key of a successful learner in online learning environments in Thailand. Journal of Educational Computing Research 48:1 (2013), 45–69.
72. Schraw, G., Dennison, R.S., Assessing metacognitive awareness. Contemporary Educational Psychology 19:4 (1994), 460–475.
73. Schunk, D.H., Self-regulated learning: The educational legacy of Paul R. Pintrich. Educational Psychologist 40:2 (2005), 85–94.
74. Seaton, D.T., Bergner, Y., Chuang, I., Mitros, P., Pritchard, D.E., Who does what in a massive open online course?. Communications of the ACM 57:4 (2014), 58–65, 10.1145/2500876.
75. Shah, D., MOOCs in 2015: Breaking down the numbers. EdSurge, 2015, December Retrieved from https://www.edsurge.com/news/2015-12-28-moocs-in-2015-breaking-down-the-numbers.
76. Siadaty, M., Gašević, D., Hatala, M., Associations between technological scaffolding and micro-level processes of self-regulated learning: A workplace study. Computers in Human Behavior 55 (2016), 1007–1019, 10.1016/j.chb.2015.10.035.
77. Sun, J.C.-Y., Rueda, R., Situational interest, computer self-efficacy and self-regulation: Their impact on student engagement in distance education. British Journal of Educational Technology 43:2 (2012), 191–204.
78. Taub, M., Azevedo, R., Bouchet, F., Khosravifar, B., Can the use of cognitive and metacognitive self-regulated learning strategies be predicted by learners’ levels of prior knowledge in hypermedia-learning environments?. Computers in Human Behavior 39 (2014), 356–367, 10.1016/j.chb.2014.07.018.
79. Tibshirani, R., Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society, Series B (Statistical Methodology) 58:1 (1996), 267–288.
80. Tsai, C.-C., Conceptions of learning versus conceptions of web-based learning: The differences revealed by college students. Computers & Education 53:4 (2009), 1092–1103.
81. Tsai, C.-C., Chuang, S.-C., Liang, J.-C., Tsai, M.-J., Self-efficacy in internet-based learning environments: A literature review. Educational Technology & Society 14:4 (2011), 222–240.
82. Wang, Y., Baker, R., Content or platform: Why do students complete MOOCs?. MERLOT Journal of Online Learning and Teaching 11:1 (2015), 191–218.
83. Wang, C.-H., Shannon, D.M., Ross, M.E., Students' characteristics, self-regulated learning, technology self-efficacy, and course outcomes in online learning. Distance Education 34:3 (2013), 302–323.
84. Warr, P., Downing, J., Learning strategies, learning anxiety and knowledge acquisition. British Journal of Psychology 91:3 (2000), 311–333.
85. Weinstein, C.E., Acee, T.W., Jung, J., Self-regulation and learning strategies. New Directions for Teaching and Learning 2011:126 (2011), 45–53, 10.1002/tl.443.
86. Winne, P.H., Issues in researching self-regulated learning as patterns of events. Metacognition and Learning 9:2 (2014), 229–237, 10.1007/s11409-014-9113-3.
87. Winne, P.H., Baker, R. Sj., The potentials of educational data mining for researching metacognition, motivation and self-regulated learning. JEDM-Journal of Educational Data Mining 5:1 (2013), 1–8.
88. Winne, P.H., Hadwin, A.F., Studying as self-regulated learning. Metacognition in Educational Theory and Practice 93 (1998), 27–30.
89. Winne, P.H., Nesbit, J.C., The psychology of academic achievement. Annual Review of Psychology 61 (2010), 653–678.
90. Yukselturk, E., Top, E., Exploring the link among entry characteristics, participation behaviors and course outcomes of online learners: An examination of learner profile using cluster analysis. British Journal of Educational Technology 44:5 (2013), 716–728, 10.1111/j.1467-8535.2012.01339.x.
91. Zheng, S., Rosson, M. B., Shih, P. C., & Carroll, J. M. (2015). Understanding Student Motivation, Behaviors and Perceptions in MOOCs. Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing - CSCW ’15, (pp. 1882–1895). http://dx.doi.org/10.1145/2675133.2675217.
92. Zimmerman, B.J., Investigating self-regulation and motivation: Historical background, methodological developments, and future prospects. American Educational Research Journal 45:1 (2008), 166–183.
93. Zimmerman, B.J., Self-regulated Learning: Theories, measures, and outcomes. International encyclopedia of the social & behavioral sciences. 2015, Elsevier Retrieved from http://www.sciencedirect.com/science/article/pii/B9780080970868260601.
94. Zimmerman, B.J., Attaining self-regulation: A social cognitive perspective. Boekaerts, M., Pintrich, P.R., Zeidner, M., (eds.) Handbook of self-regulation, 2000, Academic Press, San Diego, USA, 13–39, 10.1016/B978-012109890-2/50031-7.
95. Zimmerman, B.J., Pons, M.M., Development of a structured interview for assessing student use of self-regulated learning strategies. American Educational Research Journal 23:4 (1986), 614–628, 10.2307/1163093.
96. Zou, H., Hastie, T., Regularization and variable selection via the elastic net. Journal of the Royal Statistical Society, Series B (Statistical Methodology) 67:2 (2005), 301–320, 10.1038/203024b0.