Students’ perceptions of, and emotional responses to, personalised learning analytics-based feedback: an exploratory study of four courses

Assessment and Evaluation in Higher Education

Volumn , Issue , 2020, Pages 1-21

  Lim, Lisa Angelique ^a   Dawson, Shane ^a   Gašević, Dragan ^b   Joksimović, Srecko ^a   Pardo, Abelardo ^a   Fudge, Anthea ^a   Gentili, Sheridan ^a  

^a UNIVERSITY OF SOUTH AUSTRALIA   (Australia)

^b MONASH UNIVERSITY   (Australia)

Author keywords

emotions; epistemic network analysis; learning analytics; Personalised feedback

Indexed keywords

EID: 85087459270     PISSN: 02602938     EISSN: 1469297X     Source Type: Journal    
DOI: 10.1080/02602938.2020.1782831     Document Type: Article

References (56)

1. Ajjawi, R., and D., Boud. 2018. “Examining the Nature and Effects of Feedback Dialogue.” Assessment & Evaluation in Higher Education 43: 1106–1119. doi: 10.1080/02602938.2018.1434128.
2. Bodily, R., and K., Verbert. 2017. “Trends and Issues in Student-Facing Learning Analytics Reporting Systems Research.” Proster presented at the 7th International Conference in Learning Analytics and Knowledge, ACM. doi: 10.1145/3027385.3027403.
3. Brown, M. G., J., Schiltz, H., Derry, and C., Holman. 2019. “ Implementing Online Personalized Social Comparison Nudges in a Web-Enabled Coaching System.” The Internet and Higher Education 43: 100691. doi: 10.1016/j.iheduc.2019.100691.
4. Boud, D., 1995. “ Assessment and Learning: Contradictory or Complementary.” In Assessment for Learning in Higher Education, edited by Knight, P., 35–48. London: Kogan Page
5. Boud, D., and E., Molloy. 2013. “ Rethinking Models of Feedback for Learning: The Challenge of Design.” Assessment & Evaluation in Higher Education 38 (6): 698–712. doi: 10.1080/02602938.2012.691462.
6. Carless, David., 2019. “ Feedback Loops and the Longer-Term: Towards Feedback Spirals.” Assessment & Evaluation in Higher Education 44 (5): 705–714. doi: 10.1080/02602938.2018.1531108.
7. Carless, D., and D., Boud. 2018. “ The Development of Student Feedback Literacy: Enabling Uptake of Feedback.” Assessment & Evaluation in Higher Education 43: 1315–1325. doi: 10.1080/02602938.2018.1463354.
8. Carless, D., D., Salter, M., Yang, and J., Lam. 2011. “ Developing Sustainable Feedback Practices.” Studies in Higher Education 36 (4): 395–407. doi: 10.1080/03075071003642449.
9. Cohen, M. T., 2012. “ The Importance of Self-Regulation for College Student Learning.” College Student Journal 46 (4): 892–902.
10. Colthorpe, K., T., Sharifirad, L., Ainscough, S., Anderson, and K., Zimbardi. 2018. “ Prompting Undergraduate Students’ Metacognition of Learning: Implementing ‘Meta-Learning’ Assessment Tasks in the Biomedical Sciences.” Assessment & Evaluation in Higher Education 43 (2): 272–285. doi: 10.1080/02602938.2017.1334872.
11. Esterhazy, R., and C., Damşa. 2019. “ Unpacking the Feedback Process: An Analysis of Undergraduate Students’ Interactional Meaning-Making of Feedback Comments.” Studies in Higher Education 44 (2): 260–274. doi: 10.1080/03075079.2017.1359249.
12. Fong, C. J., D. L., Schallert, K. M., Williams, Z. H., Williamson, J. R., Warner, S., Lin, and Y. W., Kim. 2018. “ When Feedback Signals Failure but Offers Hope for Improvement: A Process Model of Constructive Criticism.” Thinking Skills and Creativity 30: 42–53. doi: 10.1016/j.tsc.2018.02.014.
13. Gašević, D., S., Dawson, T., Rogers, and D., Gasevic. 2016. “ Learning Analytics Should Not Promote One Size Fits All: The Effects of Instructional Conditions in Predicting Academic Success.” The Internet and Higher Education 28 (Supplement C): 68–84. doi: 10.1016/j.iheduc.2015.10.002.
14. Greller, W., and H., Drachsler. 2012. “ Translating Learning into Numbers: A Generic Framework for Learning Analytics.” Educational Technology & Society 15 (3): 42–57.
15. Handley, K., M., Price, and J., Millar. 2011. “ Beyond ‘Doing Time’: Investigating the Concept of Student Engagement with Feedback.” Oxford Review of Education 37 (4): 543–560. doi: 10.1080/03054985.2011.604951.
16. Hattie, J., 2014. Visible Learning for Teachers: Maximizing Impact on Learning. Florence, GB: Routledge.
17. Hattie, J., and H., Timperley. 2007. “ The Power of Feedback.” Review of Educational Research 77 (1): 81–112. doi: 10.3102/003465430298487.
18. Hareli, S., and B., Parkinson. 2008. “ What’s Social about Social Emotions? ” Journal for the Theory of Social Behaviour 38 (2): 131–156. doi: 10.1111/j.1468-5914.2008.00363.x.
19. Higgins, R., P., Hartley, and A., Skelton. 2001. “ Getting the Message across: The Problem of Communicating Assessment Feedback.” Teaching in Higher Education 6 (2): 269–274. doi: 10.1080/13562510120045230.
20. Hounsell, D., 2007. “ Towards More Sutsainable Feedback to Students.” In Rethinking Assessment in Higher Education, edited by D., Boud and N., Falchikov, 101–113. London: Routledge.
21. Jivet, I., M., Scheffel, H., Drachsler, and M., Specht. 2018. “ License to Evaluate: Preparing Learning Analytics Dashboards for Educational Practice.” In LAK’18: International Conference on Learning Analytics and Knowledge, March 7–9, 2018, Sydney, NSW, Australia. New York, NY: ACM.
22. Jonsson, A., 2013. “ Facilitating Productive Use of Feedback in Higher Education.” Active Learning in Higher Education 14 (1): 63–76. doi: 10.1177/1469787412467125.
23. Jonsson, A., and E., Panadero. 2018. “ Facilitating Students’ Active Engagement with Feedback.” In the Cambridge Handbook of Instructional Feedback, edited by A. A., Lipnevich and J. K., Smith. Cambridge: Cambridge University Press.
24. Klein, E. E., T., Tellefsen, and P. J., Herskovitz. 2007. “ The Use of Group Support Systems in Focus Groups: Information Technology Meets Qualitative Research.” Computers in Human Behavior 23 (5): 2113–2132. doi: 10.1016/j.chb.2006.02.007.
25. Lim, L. A., S., Gentili, A., Pardo, V., Kovanović, A., Whitelock-Wainwright, D., Gašević, and S., Dawson. 2019. “ What Changes, and for Whom? a Study of the Impact of Learning Analytics-Based Process Feedback in a Large Course.” Learning and Instruction: 101202. doi: 10.1016/j.learninstruc.2019.04.003.
26. Liu, D. Y.-T., K., Bartimote-Aufflick, A., Pardo, and A. J., Bridgeman. 2017. “ Data-Driven Personalization of Student Learning Support in Higher Education.” In Learning Analytics: Fundaments, Applications, and Trends, Studies in Systems, Decision and Control, 94, edited by A., Peña-Ayala, 143–169. Springer International Publishing. doi: 10.1007/978-3-319-52977-6
27. Lockyer, L., E., Heathcote, and S., Dawson. 2013. “ Informing Pedagogical Action: Aligning Learning Analytics with Learning Design.” American Behavioral Scientist 57 (10): 1439–1459. doi: 10.1177/0002764213479367.
28. Matcha, W., N. A., Uzir, D., Gasevic, and A., Pardo. 2019a. “ A Systematic Review of Empirical Studies on Learning Analytics Dashboards: A Self-Regulated Learning Perspective.” IEEE Transactions on Learning Technologies. doi: 10.1109/TLT.2019.2916802.
29. Matcha, W., D., Gašević, N. A., Uzir, J., Jovanović, and A., Pardo. 2019b. “ Analytics of Learning Strategies: Associations with Academic Performance and Feedback.” In The 9th International Learning Analytics and Knowledge Conference (LAK19), March, 2019, Tempe, AZ, USA. 461–470. New York, NY: ACM. doi: 10.1145/3303772.3303787.
30. Molloy, E., D., Boud, and M., Henderson. 2019a. “Developing a Learning-Centred Framework for Feedback Literacy.” Assessment & Evaluation in Higher Education 45: 1–14. doi: 10.1080/02602938.2019.1667955.
31. Molloy, E., C., Noble, and R., Ajjawi. 2019b. “ Attending to Emotion in Feedback.” In The Impact of Feedback in Higher Education: Improving Assessment Outcomes for Learners, edited by M., Henderson, R., Ajjawi, D., Boud and E., Molloy, 83–105. Cham: Springer International Publishing.
32. Morgan, D. L., 1997. Focus Groups as Qualitative Research. 2nd ed. Thousand Oaks, CA: SAGE.
33. Muis, K. R., R., Pekrun, G. M., Sinatra, R., Azevedo, G., Trevors, E., Meier, and B. C., Heddy. 2015. “ The Curious Case of Climate Change: Testing a Theoretical Model of Epistemic Beliefs, Epistemic Emotions, and Complex Learning.” Learning and Instruction 39: 168–183. doi: 10.1016/j.learninstruc.2015.06.003.
34. Mulliner, E., and T., Tucker. 2017. “ Feedback on Feedback Practice: Perceptions of Students and Academics.” Assessment & Evaluation in Higher Education 42 (2): 266–288. doi: 10.1080/02602938.2015.1103365.
35. Nash, G., G., Crimmins, and F., Oprescu. 2016. “ If First-Year Students Are Afraid of Public Speaking Assessments What Can Teachers Do to Alleviate Such Anxiety? ” Assessment & Evaluation in Higher Education 41 (4): 586–600. doi: 10.1080/02602938.2015.1032212.
36. Nathan, M. J., and R. K., Sawyer. 2014. “ Foundations of the Learning Sciences.” In The Cambridge Handbook of the Learning Sciences (Cambridge Handbooks in Psychology), edited by R., Keith Sawyer, 14–21. New York, NY: Cambridge University Press.
37. Nicol, D. J., and D., Macfarlane‐Dick. 2006. “ Formative Assessment and Self‐Regulated Learning: A Model and Seven Principles of Good Feedback Practice.” Studies in Higher Education 31 (2): 199–218. doi: 10.1080/03075070600572090.
38. Orsmond, P., and S., Merry. 2013. “ The Importance of Self-Assessment in Students’ Use of Tutors’ Feedback: A Qualitative Study of High and Non-High Achieving Biology Undergraduates.” Assessment & Evaluation in Higher Education 38 (6): 737–753. doi: 10.1080/02602938.2012.697868.
39. Pardo, Abelardo, Kathryn, Bartimote-Aufflick, Simon, Buckingham Shum, Shane, Dawson, Jing, Gao, Dragan, Gašević, Steve, Leichtweis, et al. 2018. “ OnTask: Delivering Data-Informed Personalized Learning Support Actions.” Journal of Learning Analytics 5 (3): 235–249. doi: 10.18608/jla.2018.53.15.
40. Pardo, Abelardo, Jelena, Jovanovic, Shane, Dawson, Dragan, Gašević, and Negin, Mirriahi. 2019. “ Using Learning Analytics to Scale the Provision of Personalised Feedback.” British Journal of Educational Technology 50 (1): 128–138. doi: 10.1111/bjet.12592.
41. Pekrun, R., 2006. “ The Control-Value Theory of Achievement Emotions: Assumptions, Corollaries, and Implications for Educational Research and Practice.” Educational Psychology Review 18 (4): 315–341. doi: 10.1007/s10648-006-9029-9.
42. Pekrun, R., and L., Linnenbrink-Garcia. 2012. “ Academic Emotions and Student Engagement.” In Handbook of Research on Student Engagement, edited by S. L., Christenson, A. L., Reschly and C. Wylie, 259–282. Boston, MA: Springer US.
43. Pekrun, R., and E. J., Stephens. 2010. “ Achievement Emotions in Higher Education.” In Higher Education: Handbook of Theory and Research, edited by J., Smart, 257–305. Dordrecht: Springer.
44. Pitt, E., M., Bearman, and R., Esterhazy. 2020. “ The Conundrum of Low Achievement and Feedback for Learning.” Assessment & Evaluation in Higher Education 45 (2): 239–250. doi: 10.1080/02602938.2019.1630363.
45. Pitt, E., and L., Norton. 2017. “ Now That’s the Feedback I Want!’ Students’ Reactions to Feedback on Graded Work and What They Do with It.” Assessment & Evaluation in Higher Education 42 (4): 499–516. doi: 10.1080/02602938.2016.1142500.
46. Price, M., K., Handley, and J., Millar. 2011. “ Feedback: Focusing Attention on Engagement.” Studies in Higher Education 36 (8): 879–896. doi: 10.1080/03075079.2010.483513.
47. Price, Margaret, Karen, Handley, Jill, Millar, and Berry, O'Donovan. 2010. “ Feedback: All That Effort, but What is the Effect? ” Assessment & Evaluation in Higher Education 35 (3): 277–289. doi: 10.1080/02602930903541007.
48. Rowe, A. D., 2017. “ Feelings about Feedback: The Role of Emotions in Assessment for Learning.” In Scaling up Assessment for Learning in Higher Education, 159–172. Singapore: Springer.
49. Rowe, A. D., J., Fitness, and L. N., Wood. 2014. “ The Role and Functionality of Emotions in Feedback at University: A Qualitative Study.” The Australian Educational Researcher 41 (3): 283–309. doi: 10.1007/s13384-013-0135-7.
50. Ryan, T., D., Gašević, and M., Henderson. 2019. “ Identifying the Impact of Feedback over Time and at Scale: Opportunities for Learning Analytics.” In The Impact of Feedback in Higher Education: Improving Assessment Outcomes for Learners, edited by M., Henderson, R., Ajjawi, D., Boud and E., Molloy, 207–223. Cham: Springer International Publishing.
51. Ryan, T., and M., Henderson. 2018. “ Feeling Feedback: Students’ Emotional Responses to Educator Feedback.” Assessment & Evaluation in Higher Education 43 (6): 880–892. doi: 10.1080/02602938.2017.1416456.
52. Shaffer, D. W., W., Collier, and A. R., Ruis. 2016. “ A Tutorial on Epistemic Network Analysis: Analyzing the Structure of Connections in Cognitive, Social, and Interaction Data.” Journal of Learning Analytics 3 (3): 9–45. doi: 10.18608/jla.2016.33.3.
53. Shaffer, D. W., and A., Ruis. 2017. “ Epistemic Network Analysis: A Worked Example of Theory-Based Learning Analytics.” In Handbook of Learning Analytics. 1st ed., edited by C., Lang, G., Siemens, A., Wise and D., Gašević, 175–187. Society for Learning Analytics Research.
54. Teasley, S. D., 2017. “ Student Facing Dashboards: One Size Fits All? ” Technology, Knowledge and Learning 22 (3): 377–384. doi: 10.1007/s10758-017-9314-3.
55. Winstone, N. E., R. A., Nash, M., Parker, and J., Rowntree. 2017. “ Supporting Learners’ Agentic Engagement with Feedback: A Systematic Review and a Taxonomy of Recipience Processes.” Educational Psychologist 52 (1): 17–37. doi: 10.1080/00461520.2016.1207538.
56. Yorke, M., 2003. “ Formative Assessment in Higher Education: Moves towards Theory and the Enhancement of Pedagogic Practice.” Higher Education 45 (4): 477–501. doi: 10.1023/A:1023967026413.