Using achievement goal-based personalized motivational feedback to enhance online learning

Educational Technology Research and Development

Volumn 69, Issue 2, 2021, Pages 553-581

  Wang, Huanhuan ^a   Lehman, James D ^b  

^a BEIJING NORMAL UNIVERSITY   (China)

^b PURDUE UNIVERSITY   (United States)

Author keywords

Achievement goals; Effectiveness; Motivation; Online learning; Personalized feedback

Indexed keywords

EID: 85100932344     PISSN: 10421629     EISSN: 15566501     Source Type: Journal    
DOI: 10.1007/s11423-021-09940-3     Document Type: Article

References (71)

1. Aleven, V., Mclaren, B., Roll, I., & Koedinger, K. (2006). Toward meta-cognitive tutoring: A model of help-seeking with a cognitive tutor. International Journal of Artificial Intelligence in Education, 16(2), 101–128.
2. Aleven, V., McLaughlin, E. A., Glenn, R. A., & Koedinger, K. R. (2017). Instruction based on adaptive learning technologies. In R. E. Mayer & P. Alexander (Eds.), Handbook of research on learning and instruction (2nd ed., pp. 522–560). New York: Routledge.
3. Allen, E., & Seaman, J. (2017). Digital learning compass: Distance education enrollment report 2017. Babson Park, MA: Babson Survey Research Group.
4. Ames, C. (1992). Classrooms: Goals, structures, and student motivation. Journal of Educational Psychology, 84(3), 261–271.
5. An, D., & Carr, M. (2017). Learning styles theory fails to explain learning and achievement: Recommendations for alternative approaches. Personality and Individual Differences, 116, 410–416.
6. Arroyo, I., Beck, J. E., Beal, C. R., Wing, R., & Woolf, B. P. (2001). Analyzing students’ response to help provision in an elementary mathematics intelligent tutoring system. Papers of the AIED-2001 workshop on help provision and help-seeking in interactive learning environments, 34–46.
7. Bawa, P. (2016). Retention in online courses: exploring issues and solutions. SAGE Open, 6(1), 1–11.
8. Berlin, N., & Dargnies, M. P. (2016). Gender differences in reactions to feedback and willingness to compete. Journal of Economic Behavior & Organization, 130, 320–336.
9. Brusilovsky, P. (2001). Adaptive educational hypermedia. Proceedings of Tenth International PEG Conference, 8–12.
10. Budd, R. W., Thorp, R. K., & Donohew, L. (1967). Content analysis of communications. New York: The Macmillan Co.
11. Butler, R. (1987). Task-involving and ego-involving properties of evaluation: Effects of different feedback conditions on motivational perceptions, interest, and performance. Journal of Educational Psychology, 79(4), 474.
12. Covington, M. V. (2000). Goal theory, motivation, and school achievement: An integrative review. Annual Review of Psychology, 51, 171–200.
13. Creswell, J. W. (2013). Qualitative inquiry and research design: choosing among five approaches. Thousand Oaks, CA: Sage Publications.
14. Daniels, L. M., Haynes, T. L., Stupnisky, R. H., Perry, R. P., Newall, N. E., & Pekrun, R. (2008). Individual differences in achievement goals: A longitudinal study of cognitive, emotional, and achievement outcomes. Contemporary Educational Psychology, 33(4), 584–608.
15. DeCoster, J., Gallucci, M., & Iselin, A. M. R. (2011). Best practices for using median splits, artificial categorization, and their continuous alternatives. Journal of experimental psychopathology, 2(2), 197–209.
16. Defalco, J., Georgoulas-Sherry, V., Paquette, L., Baker, R., Rowe, J., Mott, B., & Lester, J. (2016). Motivational feedback messages as interventions to frustration in GIFT. Proceedings of the Fourth GIFT User Symposium (pp. 25–35).
17. Dominicis, S., Sokoloski, R., Jaeger, C. M., & Schultz, P. W. (2019). Making the smart meter social promotes long-term energy conservation. Palgrave Communications, 5(1), 1–8.
18. Duffy, M. C., & Azevedo, R. (2015). Motivation matters: Interactions between achievement goals and agent scaffolding for self-regulated learning within an intelligent tutoring system. Computers in Human Behavior, 52, 338–348.
19. Elliot, A. J., & Church, M. A. (1997). A hierarchical model of approach and avoidance achievement motivation. Journal of Personality and Social Psychology Copyright, 72(1), 218–232.
20. Elliot, A. J., & McGregor, H. A. (2001). A 2 X 2 achievement goal framework. Journal of Personality and Social Psychology, 80, 501–519.
21. Elliot, A., Murayama, K., Kobeisy, A., & Lichtenfeld, S. (2015). Potential-based achievement goals. British Journal of Educational Psychology, 85(2), 192–206.
22. Eng, J. (2003). Sample size estimation: How many individuals should be studied? Radiology, 227(2), 309–313.
23. Fasihuddin, H., Skinner, G., & Athauda, R.(2016). A comprehensive review of adaptive, open, and online learning literature. International Conference on Computer Science Education Innovation & Technology (pp. 1–10).
24. Faul, F., Erdfelder, E., Lang, A. G., & Buchner, A. (2007). G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods, 39(2), 175–191.
25. th graders motivation and achievement in learning about acids and bases. International Journal of Science and Mathematics Education, 3(3), 463–484.
26. Goldin, I., Narciss, S., Foltz, P., & Bauer, M. (2017). New directions in formative feedback in interactive learning environments. International Journal of Artificial Intelligence in Education, 27(3), 385–392.
27. Hancock, T. E., Stock, W. A., & Kulhavy, R. W. (1992). Predicting feedback effects from response- certitude estimates. Bulletin of the Psychonomic Society, 30(2), 173–176.
28. Harackiewicz, J. M., & Linnenbrink, E. A. (2005). Multiple achievement goals and multiple pathways for learning: The agenda and impact of Paul R. Pintrich. Educational Psychologist, 40(2), 75–84.
29. Hattie, J., & Timperley, H. (2007). The power of feedback. Medical Education, 77(1), 81–112.
30. Hedberg, J. G., & McNamara, S. E. (1985). Matching feedback and cognitive style in visual CAI tasks. The Meeting of the American Educational Research Association (pp. 1–29).
31. Hornstra, L., Majoor, M., & Peetsma, T. (2017). Achievement goal profiles and developments in effort and achievement in upper elementary school. British Journal of Educational Psychology, 87(4), 606–629.
32. Ivankova, N. V., Creswell, J. W., & Stick, S. L. (2006). Using mixed-methods sequential explanatory design: From theory to practice. Field Methods, 18(1), 3–20.
33. Luo, W., Paris, S. G., Hogan, D., & Luo, Z. (2011). Do performance goals promote learning? A pattern analysis of Singapore students’ achievement goals. Contemporary Educational Psychology, 36(2), 165–176.
34. Keller, J. M. (2006). Development of two measures of learner motivation. Florida State University.
35. Khalil, H., & Ebner, M. (2014). MOOCs completion rates and possible methods to improve retention - A literature review. EdMedia: World Conference on Educational Media and Technology (pp. 1305–1313).
36. Kim, C., & Keller, J. M. (2007). Effects of motivational and volitional email messages (MVEM) with personal messages on undergraduate students? Motivation, study habits and achievement. British Journal of Educational Technology, 39(1), 36–51.
37. Kirschner, P. A. (2017). Stop propagating the learning styles myth. Computers & Education, 106, 166–171.
38. Koedinger, K. R., Brunskill, E., Baker, R. S., McLaughlin, E. A., & Stamper, J. (2013). New potentials for data-driven intelligent tutoring system development and optimization. AI Magazine, 34(3), 27–41.
39. Mahvelati, E. H. (2020). Field-Dependent/Field-Independent Learners’ Information Processing Behavior in an Implicit Learning Task: Evidence from Iranian EFL Learners. Journal of psycholinguistic research, 1–19.
40. Martinez, M. A. (1999). An investigation into successful learning: Measuring the impact of learning orientation, a primary learner-difference variable. Provo, UT: Brigham Young University.
41. Martinez, M. A. (2001). Key design considerations for personalized learning on the web. Educational Technology & Society, 4(1), 26–40.
42. Mascret, N., Elliot, A. J., & Cury, F. (2015). Extending the 3 × 2 achievement goal model to the sport domain: The 3 × 2 achievement goal questionnaire for sport. Psychology of Sport and Exercise, 17, 7–14.
43. Midgley, C., Kaplan, A., Middleton, M., Maehr, M. L., Urdan, T., Hicks Anderman, L., & Roeser, R. (1998). The Development and Validation of Scales Assessing Students’ Achievement Goal Orientations. Contemporary Educational Psychology, 23, 113–131.
44. Molden, D. C., Lucas, G. M., Finkel, E. J., Kumashiro, M., & Rusbult, C. (2009). Perceived support for promotion-focused and prevention-focused goals: Associations with well-being in unmarried and married couples. Psychological Science, 20(7), 787–793.
45. Mory, E. H. (1994). Adaptive feedback in computer-based instruction: Effects of response certitude on performance, feedback-study time, and efficiency. Educational Computing Research, 11(3), 263–290.
46. Nakic, J., Granic, A., & Glavinic, V. (2015). Anatomy of student models in adaptive learning systems: A systematic literature review of individual differences from 2001 to 2013. Journal of Educational Computing Research, 51(4), 459–489.
47. Narciss, S. (2004). The impact of informative tutoring feedback and self-efficacy on motivation and achievement in concept learning. Experimental Psychology, 51(3), 214–228.
48. Narciss, S. (2008). Feedback strategies for interactive learning tasks. In Handbook of Research on Educational Communications and Technology (4th ed., pp. 125–144). Springer.
49. Narciss, S., Sosnovsky, S., Schnaubert, L., Andrès, E., Eichelmann, A., Goguadze, G., & Melis, E. (2014). Exploring feedback and student characteristics relevant for personalizing feedback strategies. Computers and Education, 71, 56–76.
50. Nguyen, T. (2015). The effectiveness of online learning: Beyond no significant difference and future horizons. Journal of Online Learning and Teaching, 11(2), 309–319.
51. Pailai, J., Wunnasri, W., Hayashi, Y., & Hirashima, T. (2018, June). Correctness-and confidence-based adaptive feedback of kit-build concept map with confidence tagging. In International Conference on Artificial Intelligence in Education (pp. 395–408). Springer, Cham.
52. Pintrich, P. R. (1999). The role of motivation in promoting and sustaining self-regulated learning. International Journal of Educational Research, 31(6), 459–470.
53. Pintrich, P. R. (2000). Multiple goals, multiple pathways: The role of goal orientation in learning and achievement. Journal of Educational Psychology, 92(3), 545–555.
54. Pintrich, P. R. (2000). The role of goal orientation in self-regulated learning. In M. Boekaerts, M. Zeidner, & P. R. Pintrich (Eds.), Handbook of Self-Regulation (pp. 451–502). San Diego, CA: Academic Press.
55. Polso, K. M., Tuominen, H., Hellas, A., & Ihantola, P. (2020). Achievement goal orientation profiles and performance in a programming MOOC. In Proceedings of the 2020 ACM Conference on Innovation and Technology in Computer Science Education (pp. 411–417).
56. Privitera, G. J. (2016). Research methods for the behavioral sciences. Sage Publications.
57. Sadler, D. (1998). Formative assessment: Revisiting the territory. Assessment in Education: Principles, Policy & Practice, 5(1), 77–84.
58. Schunk, D. H. (1995). Self-efficacy, motivation, and performance. Journal of Applied Sport Psychology, 7(2), 112–137.
59. Senko, C., & Harackiewicz, J. M. (2005). Regulation of achievement goals: The role of competence feedback. Journal of Educational Psychology, 97(3), 320–336.
60. Senko, C., & Miles, K. M. (2008). Pursuing their own learning agenda: How mastery-oriented students jeopardize their class performance. Contemporary Educational Psychology, 33(4), 561–583.
61. Senko, C. (2016). Achievement goal theory: A story of early promises, eventual discords, and future possibilities. Chapter to appear in K. Wentzel & D. Miele (Eds.), Handbook of Motivation at School (Vol. 2, pp. 75–95). New York, NY: Routledge.
62. Shin, J., Lee, Y., & Seo, E. (2017). The effects of feedback on students’ achievement goals: Interaction between reference of comparison and regulatory focus. Learning and Instruction, 49, 21–31.
63. Shin, T. S., & Dickson, W. P. (2010). The effects of peer- and self-referenced feedback on students’ motivation and academic performance in online learning environments. Journal of Online Learning and Teaching, 6(1), 1–11.
64. Sommet, N., & Elliot, A. J. (2017). Achievement goals, reasons for goal pursuit, and achievement goal complexes as predictors of beneficial outcomes: Is the influence of goals reducible to reasons? Journal of Educational Psychology, 109(8), 1141.
65. thInternational Conference on Computer Supported Education, Lisbon, Portugal (pp. 88–97).
66. Tobias, S. (1994). Interest, prior knowledge, and learning. Review of Educational Research, 64(1), 37–54.
67. VanLehn, K. (2011). The relative effectiveness of human tutoring, intelligent tutoring systems, and other tutoring systems. Educational Psychologist, 46(4), 197–221.
68. Vasilyeva, E., De Bra, P., Pechenizkiy, M., & Puuronen, S. (2008). Tailoring feedback in online assessment: Influence of learning styles on the feedback preferences and elaborated feedback effectiveness. Eighth IEEE International Conference on Advanced Learning Technologies (pp. 834–838).
69. Vasilyeva, E., Pechenizkiy, M., & DeBra, P. (2008). Adaptation of elaborated feedback in e-learning. Lecture Notes in Computer Science, 5149, 235–244.
70. Weidinger, A. F., Spinath, B., & Steinmayr, R. (2016). Why does intrinsic motivation decline following negative feedback? The mediating role of ability self-concept and its moderation by goal orientations. Learning and Individual Differences, 47, 117–128.
71. Zimmerman, B. J., & Schunk, D. H. (2011). Motivational sources and outcomes of self-regulated learning and performance. Handbook of self-regulation of learning and performance, 5(3), 49–64.