Learning analytics should not promote one size fits all: The effects of instructional conditions in predicting academic success

Internet and Higher Education

Volumn 28, Issue , 2016, Pages 68-84

  Gašević, Dragan ^a,b   Dawson, Shane ^b   Rogers, Tim ^a   Gasevic, Danijela ^c  

^a UNIVERSITY OF EDINBURGH   (United Kingdom)

^b UNIVERSITY OF SOUTH AUSTRALIA   (Australia)

^c UNIVERSITY OF EDINBURGH   (United Kingdom)

Author keywords

Instructional conditions; Learning analytics; Learning success; Self regulated learning; Student retention

Indexed keywords

ENGINEERING EDUCATION; FORECASTING; INFORMATION MANAGEMENT; STUDENTS;

INSTRUCTIONAL CONDITIONS; LEARNING ANALYTICS; LEARNING SUCCESS; SELF-REGULATED LEARNING; STUDENT RETENTION;

EDUCATION;

EID: 84944809984     PISSN: 10967516     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.iheduc.2015.10.002     Document Type: Article

References (67)

1. Á.F. Agudo-Peregrina, S. Iglesias-Pradas, M.Á. Conde-González, and Á. Hernández-García Can we predict success from log data in VLEs? Classification of interactions for learning analytics and their relation with performance in VLE-supported F2F and online learning Computers in Human Behavior 31 2014 542 550 10.1016/j.chb.2013.05.031
2. L. Ali, M. Asadi, D. Gašević, J. Jovanović, and M. Hatala Factors influencing beliefs for adoption of a learning analytics tool: An empirical study Computers & Education 62 2013 130 148 10.1016/j.compedu.2012.10.023
3. J.W. Alstete, and N.J. Beutell Performance indicators in online distance learning courses: A study of management education Quality Assurance in Education 12 1 2004 6 14 10.1108/09684880410517397
4. F. Araque, C. Roldán, and A. Salguero Factors influencing university drop out rates Computers & Education 53 3 2009 563 574 10.1016/j.compedu.2009.03.013
5. R. Azevedo, D.C. Moos, J.A. Greene, F.I. Winters, and J.G. Cromley Why is externally-facilitated regulated learning more effective than self-regulated learning with hypermedia? Educational Technology Research and Development 56 1 2008 45 72 10.1007/s11423-007-9067-0
6. L. Baer, and J.P. Campbell From metrics to analytics, reporting to action: Analytics' role in changing the learning environment D.G. Oblinger, Game Changers - Education and Information Technologies 2012 EDUCAUSE 53 65 (Retrieved from http://net.educause.edu/ir/library/pdf/pub7203.pdf)
7. R. Baker, and G. Siemens Educational data mining and learning analytics R.K. Sawyer, Cambridge handbook of the learning sciences 2014 Cambridge University Press Cambridge, UK
8. R. Baker, and K. Yacef The state of educational data mining in 2009: Review and future visions Journal of Educational Data Mining 1 1 2009 3 17
9. R. Barber, and M. Sharkey Course correction: Using analytics to predict course success Proceedings of the 2nd International Conference on Learning Analytics and Knowledge 2012 ACM New York, NY, USA 259 262 10.1145/2330601.2330664
10. R.A. Bjork, J. Dunlosky, and N. Kornell Self-regulated learning: Beliefs, techniques, and illusions Annual Review of Psychology 64 1 2013 417 444 10.1146/annurev-psych-113011-143823
11. A.E. Black, and E.L. Deci The effects of instructors' autonomy support and students' autonomous motivation on learning organic chemistry: A self-determination theory perspective Science Education 84 6 2000 740 756
12. A.-M. Bliuc, R. Ellis, P. Goodyear, and L. Piggott Learning through face-to-face and online discussions: Associations between students' conceptions, approaches and academic performance in political science British Journal of Educational Technology 41 3 2010 512 524 10.1111/j.1467-8535.2009.00966.x
13. J.P. Campbell, P.B. DeBlois, and D. Oblinger Academic analytics: A new tool for a new era Educause Review 42 4 2007 40 57
14. M.H. Cho, and B.J. Kim Students' self-regulation for interaction with others in online learning environments The Internet and Higher Education 17 2013 69 75 10.1016/j.iheduc.2012.11.001
15. S.H. Chung, P.H. Schwager, and D.E. Turner An empirical study of students' computer self-efficacy: Differences among four academic disciplines at a large university The Journal of Computer Information Systems 42 4 2002 1 6
16. G. Clarebout, J. Elen, N.A.J. Collazo, G. Lust, and L. Jiang Metacognition and the use of tools R. Azevedo, V. Aleven, International handbook of metacognition and learning technologies 2013 Springer New York 187 195 (Retrieved from http://link.springer.com/chapter/10.1007/978-1-4419-5546-3-13)
17. J. Cohen A power primer Psychological Bulletin 112 1 1992 155 159
18. S. Dawson, D. Gašević, G. Siemens, and S. Joksimovic Current state and future trends: A citation network analysis of the learning analytics field Proceedings of the Fourth International Conference on Learning Analytics And Knowledge 2014 ACM New York, NY, USA 231 240 10.1145/2567574.2567585
19. Y. Engeström Learning by expanding: An activity-theoretical approach to developmental research 2014 Cambridge University Press Cambridge, UK
20. A. Field, and G. Hole How to design and report experiments 2003 SAGE Publications Ltd. London (Retrieved from http://www.sagepub.com/textbooks/Book219351?prodId=Book219351)
21. C. Finnegan, L.V. Morris, and K. Lee Differences by course discipline on student behavior, persistence, and achievement in online courses of undergraduate general education Journal of College Student Retention: Research, Theory and Practice 10 1 2009 39 54 10.2190/CS.10.1.d
22. D.R. Garrison, and M. Cleveland-Innes Facilitating cognitive presence in online learning: Interaction is not enough American Journal of Distance Education 19 3 2005 133 148 10.1207/s15389286ajde1903-2
23. D.R. Garrison, T. Anderson, and W. Archer Critical inquiry in a text-based environment: Computer conferencing in higher education The Internet and Higher Education 2 2-3 1999 87 105 10.1016/S1096-7516(00)00016-6
24. D. Gašević, S. Dawson, and G. Siemens Let's not forget: Learning analytics are about learning TechTrends 59 1 2015 64 71
25. D. Gašević, N. Mirriahi, and S. Dawson Analytics of the effects of video use and instruction to support reflective learning Proceedings of the Fourth International Conference on Learning Analytics And Knowledge 2014 ACM New York, NY, USA 123 132 10.1145/2567574.2567590
26. A. Gelman, and J. Hill Data analysis using regression and multilevel/hierarchical models 2006 Cambridge University Press
27. P. Ginns, and R. Ellis Quality in blended learning: Exploring the relationships between on-line and face-to-face teaching and learning The Internet and Higher Education 10 1 2007 53 64 10.1016/j.iheduc.2006.10.003
28. C.R. Graham Blended learning systems: Definition, current trends, and future directions C.J. Bonk, C.R. Graham, The handbook of blended learning: Global perspectives, local designs 2006 Pfeiffer Publishing San Francisco, CA 3 21
29. D.W. Hosmer, and S. Lemeshow Applied logistic regression 2000 Wiley-Interscience New York
30. S.M. Jayaprakash, E.W. Moody, E.J.M. Lauría, J.R. Regan, and J.D. Baron Early alert of academically at-risk students: An open source analytics initiative Journal of Learning Analytics 1 1 2014 6 47
31. S. Joksimović, D. Gašević, V. Kovanović, B.E. Riecke, and M. Hatala Social presencein online discussions as a process predictor of academic performance Journal of ComputerAssisted Learning 2015 10.1111/jcal.12107 (in press, http://onlinelibrary.wiley.com/doi/10.1111/jcal.12107/abstract)
32. O.N. Keene The log transformation is special Statistics in Medicine 14 8 1995 811 819 10.1002/sim.4780140810
33. Z.J. Kovacic Predicting student success by mining enrolment data Research in Higher Education Journal 15 2012
34. V. Kovanović, S. Joksimović, D. Gašević, and M. Hatala Automated cognitive presence detection in online discussion transcripts Proceedings of the 4th International Conference on Learning Analytics and Knowledge - Workshops (LAK 2014) 2014 Indianapolis, IN
35. E.J.M. Lauría, J.D. Baron, M. Devireddy, V. Sundararaju, and S.M. Jayaprakash Mining academic data to improve college student retention: An open source perspective Proceedings of the 2nd International Conference on Learning Analytics and Knowledge 2012 ACM New York, NY, USA 139 142 10.1145/2330601.2330637
36. J. Lave, and E. Wenger Situated learning: Legitimate peripheral participation 1991 Cambridge university Press Cambridge, UK
37. L. Lockyer, E. Heathcote, and S. Dawson Informing pedagogical action aligning learning analytics with learning design American Behavioral Scientist 57 10 2013 1439 1459 10.1177/0002764213479367
38. G. Lust, J. Elen, and G. Clarebout Regulation of tool-use within a blended course: Student differences and performance effects Computers & Education 60 1 2013 385 395 10.1016/j.compedu.2012.09.001
39. G. Lust, N.A. Juarez Collazo, J. Elen, and G. Clarebout Content management systems: Enriched learning opportunities for all? Computers in Human Behavior 28 3 2012 795 808 10.1016/j.chb.2011.12.009
40. G. Lust, M. Vandewaetere, E. Ceulemans, J. Elen, and G. Clarebout Tool-use in a blended undergraduate course: In search of user profiles Computers & Education 57 3 2011 2135 2144 10.1016/j.compedu.2011.05.010
41. L.P. Macfadyen, and S. Dawson Mining LMS data to develop an "early warning system" for educators: A proof of concept Computers & Education 54 2 2010 588 599 10.1016/j.compedu.2009.09.008
42. L.P. Macfadyen, and S. Dawson Numbers are not enough. Why e-Learning analytics failed to inform an institutional strategic plan Educational Technology & Society 15 3 2012
43. L.P. Macfadyen, S. Dawson, A. Pardo, and D. Gasevic Embracing big data in complex educational systems: The learning analytics imperative and the policy challenge Research & Practice in Assessment 9 2 2014 17 28
44. J. Manyika, M. Chui, B. Brown, J. Bughin, R. Dobbs, C. Roxburgh, and A.H. Byers Big data: The next frontier for innovation, competition and productivity 2012 McKinsey Global Institute (Retrieved from http://www.mckinsey.com/insights/business-technology/big-data-the-next-frontier-for-innovation)
45. R.H. Myers Classical and modern regression with applications 1990 Duxbury/Thompson Learning Pacific Grove, CA.
46. S. Palmer Modelling engineering student academic performance using academic analytics International Journal of Engineering Education 29 1 2013 132 138
47. S. Palmer, D. Holt, and S. Bray Does the discussion help? The impact of a formally assessed online discussion on final student results British Journal of Educational Technology 39 5 2008 847 858 10.1111/j.1467-8535.2007.00780.x
48. D.N. Perkins The fingertip effect: How information-processing technology shapes thinking Educational Researcher 14 7 1985 11 17 10.3102/0013189X014007011
49. P. Reimann, L. Markauskaite, and M. Bannert e-Research and learning theory: What do sequence and process mining methods contribute? British Journal of Educational Technology 45 3 2014 528 540 10.1111/bjet.12146
50. T. Rogers, D. Gašević, and S. Dawson Learning analytics and the imperative for theory driven research C. Haythornthwaite, R. Andrews, J. Fransma, E. Meyers, The SAGE Handbook of E-learning Research 2nd edition 2015 SAGE Publications Ltd. London, UK (in press)
51. C. Romero, M.-I. López, J.-M. Luna, and S. Ventura Predicting students' final performance from participation in on-line discussion forums Computers & Education 68 2013 458 472 10.1016/j.compedu.2013.06.009
52. C. Romero, S. Ventura, and E. García Data mining in course management systems: Moodle case study and tutorial Computers & Education 51 1 2008 368 384 10.1016/j.compedu.2007.05.016
53. G. Siemens, and D. Gašević Special issue on learning and knowledge analytics Educational Technology & Society 15 3 2012 1 163
54. G. Siemens, and P.D. Long Penetrating the fog: Analytics in learning and education Educause Review 46 5 2011 31 40
55. G. Siemens, S. Dawson, and G. Lynch Improving the quality and productivity of the higher education sector - Policy and strategy for systems-level deployment of learning analytics 2014 Office of Learning and Teaching, Australian Goverment Camberra, Australia (Retrieved from http://solaresearch.org/Policy-Strategy-Analytics.pdf)
56. K. Swan Special Issue on Learning Analytics 16(3) 2012 5 100
57. K. Swan, D. Matthews, L. Bogle, E. Boles, and S. Day Linking online course design and implementation to learning outcomes: A design experiment The Internet and Higher Education 15 2 2012 81 88 10.1016/j.iheduc.2011.07.002
58. K. Trigwell, M. Prosser, and F. Waterhouse Relations between teachers' approaches to teaching and students' approaches to learning Higher Education 37 1 1999 57 70 10.1023/A:1003548313194
59. E. Whitmire Disciplinary differences and undergraduates' information-seeking behavior Journal of the American Society for Information Science and Technology 53 8 2002 631 638
60. P.H. Winne Minimizing the black box problem to enhance the validity of theories about instructional effects Instructional Science 11 1 1982 13 28 10.1007/BF00120978
61. P.H. Winne A metacognitive view of individual differences in self-regulated learning Learning and Individual Differences 8 4 1996 327 353 10.1016/S1041-6080(96)90022-9
62. P.H. Winne How software technologies can improve research on learning and bolster school reform Educational Psychologist 41 1 2006 5 17 10.1207/s15326985ep4101-3
63. P.H. Winne A cognitive and metacognitive analysis of self-regulated learning D.H. Schunk, B. Zimmerman, Handbook of self-regulation of learning and performance 2011 Routledge New Work and Oxon 15 32
64. P.H. Winne, and A.F. Hadwin Studying as self-regulated learning D.J. Hacker, J. Dunlosky, A.C. Graesser, Metacognition in educational theory and practice 1998 Lawrence Erlbaum Associates Publishers Mahwah, NJ, US 277 304
65. A.F. Wise, J. Speer, F. Marbouti, and Y.-T. Hsiao Broadening the notion of participation in online discussions: Examining patterns in learners' online listening behaviors Instructional Science 41 2 2013 323 343 10.1007/s11251-012-9230-9
66. A. Zafra, C. Romero, and S. Ventura Multiple instance learning for classifying students in learning management systems Expert Systems with Applications 38 12 2011 15020 15031 10.1016/j.eswa.2011.05.044
67. B.J. Zimmerman, and D.H. Schunk Handbook of self-regulation of learning and performance 2011 Routledge New York