The impact of critical feedback choice on students' revision, performance, learning, and memory

Computers in Human Behavior

Volumn 78, Issue , 2018, Pages 351-367

  Cutumisu, Maria ^a   Schwartz, Daniel L ^b  

^a UNIVERSITY OF ALBERTA   (Canada)

^b STANFORD UNIVERSITY   (United States)

Author keywords

Assessment; Choice; Feedback; Game; Learning performance; Memory

Indexed keywords

DATA STORAGE EQUIPMENT; EDUCATION; FEEDBACK;

ASSESSMENT; CHOICE; COLLEGE STUDENTS; FEEDBACK MESSAGES; GAME; LEARNING PERFORMANCE; MIDDLE SCHOOL STUDENTS; STUDENT LEARNING;

STUDENTS;

ADULT; COLLEGE STUDENT; CONTROLLED STUDY; FEMALE; HUMAN; LEARNING; MAJOR CLINICAL STUDY; MALE; MEMORY; REST;

EID: 85029559423     PISSN: 07475632     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.chb.2017.06.029     Document Type: Article

References (108)

1. Ackerman, D.S., Gross, B.L., Instructor feedback: How much do students really want?. Journal of Marketing Education 32:2 (2010), 172–181.
2. Anseel, F., Beatty, A.S., Shen, W., Lievens, F., Sackett, P.R., How are we doing after 30 years? A meta-analytic review of the antecedents and outcomes of feedback-seeking behavior. Journal of Management 41:1 (2015), 318–348.
3. Ashford, S.J., De Stobbeleir, K., Nujella, M., To seek or not to Seek: Is that the only Question? Recent developments in feedback-seeking literature. Annual Review of Organizational Psychology and Organizational Behavior 3 (2016), 213–239 Annual Reviews.
4. Askew, S., Lodge, C., Gifts, ping-pong and loops-linking feedback and learning. Askew, S., (eds.) Feedback for learning, 1st ed., 2000, Routledge, London, UK, 1–17.
5. Attali, Y., Effects of multiple-try feedback and question type during mathematics problem solving on performance in similar problems. Computers & Education 86 (2015), 260–267.
6. Bangert-Drowns, R., Kulik, C.C., Kulik, J.A., Morgan, M., The instructional effect of feedback in test-like events. Review of Educational Research 61:2 (1991), 213–238.
7. Beaumont, C., O'Doherty, M., Shannon, L., Reconceptualising assessment feedback: A key to improving student learning?. Studies in Higher Education 36:6 (2011), 671–687, 10.1080/03075071003731135.
8. Black, P., Wiliam, D., Assessment and classroom learning. Assessment in Education: Principles, Policy & Practice 5:1 (1998), 7–74.
9. Bolzer, M., Strijbos, J., Fischer, F., Inferring mindful cognitive-processing of peer-feedback via eye-tracking: Role of feedback-characteristics, fixation-durations and transitions. Journal of Computer Assisted Learning 31 (2015), 422–434, 10.1111/jcal.12091.
10. Bounds, R., Bush, C., Aghera, A., Rodriguez, N., Stansfield, R.B., Santen, S.A., Emergency medicine residents' self-assessments play a critical role when receiving feedback. Academic Emergency Medicine 20:10 (2013), 1055–1061.
11. Brummelman, E., Thomaes, S., de Castro, B.O., Overbeek, G., Bushman, B.J., “That's not just beautiful - that's incredibly beautiful!” the adverse impact of inflated praise on children with low self-esteem. Psychological Science 25:3 (2014), 728–735 Sage Publications.
12. Burnett, P.C., Mandel, V., Praise and feedback in the primary classroom: Teachers' and students' perspectives. Australian Journal of Educational & Developmental Psychology 10 (2010), 145–154.
13. Butler, A.C., Karpicke, J.D., Roediger, H.L., Correcting a metacognitive error: Feedback increases retention of low-confidence correct responses. Journal of Experimental Psychology: Learning, Memory, and Cognition 34:4 (2008), 918–928.
14. Butler, D.L., Winne, P.H., Feedback and self-regulated learning: A theoretical synthesis. Review of Educational Research 65:3 (1995), 245–281.
15. Butterfield, B., Metcalfe, J., The correction of errors committed with high confidence. Metacognition and Learning 1:1 (2006), 69–84.
16. Carless, D., Differing perceptions in the feedback process. Studies in Higher Education 31:2 (2006), 219–233.
17. Carless, D., Salter, D., Yang, M., Lam, J., Developing sustainable feedback practices. Studies in Higher Education 36:4 (2011), 395–407.
18. Chai, L., To have or have not: An examination of feedback, learner control knowledge type in online learning. Proceedings of the 36th annual Hawaii international conference on system sciences, 2003, 10.
19. Chatzisarantis, N.L.D., Hagger, M.S., Effects of an intervention based on self-determination theory on self-reported leisure-time physical activity participation. Psychology and Health 24:1 (2009), 29–48.
20. Clark, I., Formative assessment: Assessment is for self-regulated learning. Educational Psychology Review 24:2 (2012), 205–249.
21. Cody, M.W., Teachman, B.A., Post-event processing and memory bias for performance feedback in social anxiety. Journal of Anxiety Disorders 24:5 (2010), 468–479.
22. Conati, C., Jaques, N., Muir, M., Understanding attention to adaptive hints in educational games: An eye-tracking study. International Journal of Artificial Intelligence in Education 23:1–4 (2013), 136–161.
23. Conlin, L., Chin, D.B., Blair, K.P., Cutumisu, M., Schwartz, D.L., Guardian angels of our better nature: finding evidence of the benefits of design thinking. Proceedings of the 122nd American Society for Engineering Education (ASEE'15), Seattle, WA, USA, June 14–17, 2015, 10.
24. Critcher, C.R., Dunning, D., Armor, D.A., When self-affirmations reduce defensiveness: timing is key. Personality and Social Psychology Bulletin 36:7 (2010), 947–959, 10.1177/0146167210369557.
25. Cutumisu, M., Blair, K.P., Chin, D.B., Schwartz, D.L., Assessing whether students seek constructive criticism: The design of an automated feedback system for a graphic design task. International Journal of Artificial Intelligence in Education, 2016, 1–29, 10.1007/s40593-016-0137-5 online first.
26. Cutumisu, M., Blair, K.P., Chin, D.B., Schwartz, D.L., Posterlet: A game-based assessment of children's choices to seek feedback and to revise. Journal of Learning Analytics 2:1 (2015), 49–71 Retrieved from http://epress.lib.uts.edu.au/journals/index.php/JLA/article/view/4091/4836.
27. Cutumisu, M., Chin, D.B., Schwartz, D.L., A game-based assessment of students' choices to seek feedback and to revise. Proceedings of the 11th International Conference on Cognition and Exploratory Learning in Digital Age (CELDA), Porto, Portugal, October 25–27, 2014, 17–24.
28. Cutumisu, M., Schwartz, D.L., Assessing middle-school students' feedback and revision behavior in a computer-based task. American Educational Research Association (AERA '17) Symposium: Behavior Measurement - Investigating Performance Tasks as Measures of Social and Emotional Learning Skills, San Antonio, TX, USA, April 27 – May 1, 2017 Symposium Paper.
29. Cutumisu, M., Schwartz, D.L., Choosing versus receiving feedback: The impact of feedback valence on learning in an assessment game. In Proceedings of the 9th International Educational Data Mining Conference (EDM'16), Raleigh, NC, USA, June 29–July 2, 2016, 341–346.
30. Cutumisu, M., Schwartz, D.L., The relation between high-school students' performance and feedback memory. Proceedings of the London International Conference on Education. London, United Kingdom, November 14–17, 2016, 80–85.
31. D'Mello, S., Olney, A., Williams, C., Hays, P., Gaze tutor: A gaze-reactive intelligent tutoring system. International Journal of Human-Computer Studies 70:5 (2012), 377–398.
32. Danielmeier, C., Ullsperger, M., Post-error adjustments. Frontiers in Psychology, 2, 2011, 233.
33. Dauenheimer, D.G., Stahlberg, D., Spreemann, S., Sedikides, C., Self-enhancement, self-verification, or self-assessment? The intricate role of trait modifiability in the self-evaluation process. Revue internationale de psychologie sociale 15:3–4 (2002), 89–112 Presses universitaires de Grenoble.
34. Dawson, E., Gilovich, T., Regan, D.T., Motivated reasoning and performance on the wason selection task. Personality and Social Psychology Bulletin 28:10 (2002), 1379–1387.
35. De Stobbeleir, K.E.M., Ashford, S.J., Buyens, D., Self-regulation of creativity at work: The role of feedback-seeking behavior in creative performance. Academy of Management Journal 54:4 (2011), 811–831.
36. Deci, E.L., Ryan, R.M., Intrinsic motivation and self-determination in human behavior. 1985, Plenum Press, New York.
37. Ehrlinger, J., Mitchum, A.L., Dweck, C.S., Understanding overconfidence: Theories of intelligence, preferential attention, and distorted self-assessment. Journal of Experimental Social Psychology 63 (2016), 94–100.
38. Evans, C., Making sense of assessment feedback in higher education. Review of Educational Research 83:1 (2013), 70–120, 10.3102/0034654312474350.
39. Fazio, L.K., Marsh, E.J., Surprising feedback improves later memory. Psychonomic Bulletin & Review 16:1 (2009), 88–92.
40. Fishbach, A., Eyal, T., Finkelstein, S.R., How positive and negative feedback motivate goal pursuit. Social and Personality Psychology Compass 4:8 (2010), 517–530.
41. Fisher, R.A., On the probable error of a coefficient of correlation deduced from a small sample. Metron 1 (1921), 3–32.
42. Geitz, G., Joosten-Ten Brinke, D., Kirschner, P.A., Sustainable feedback: Students' and tutors' perceptions. The Qualitative Report, 21(11), 2016, 2103.
43. Gibbs, G., Simpson, C., Conditions under which assessment supports students' learning. Learning and Teaching in Higher Education 1 (2005), 3–31.
44. Green, J.D., Pinter, B., Sedikides, C., Mnemic neglect and self-threat: Trait modifiability moderates self-protection. European Journal of Social Psychology 35:2 (2005), 225–235.
45. Gregory, J.B., Levy, P.E., Using feedback in organizational consulting. 2015, American Psychological Association, Washington, D.C.
46. Harris, L.R., Brown, G.T.L., Harnett, J.A., Analysis of New Zealand primary and secondary student peer- and self-assessment comments: Applying Hattie and Timperley's feedback model. Assessment in Education: Principles, Policy & Practice 22:2 (2015), 265–281, 10.1080/0969594X.2014.976541.
47. Hattie, J., Visible learning: A synthesis of over 800 meta-analyses relating to achievement. 2009, Routledge, Taylor and Francis Group, Abingdon.
48. Hattie, J., Visible learning for teachers: Maximizing impact on learning. 2012, Routledge.
49. Hattie, J., Gan, M., Instruction based on feedback. Mayer, R., Alexander, P., (eds.) Handbook of research on learning and instruction, 1st ed., 2011, Routledge, New York, 249–271.
50. Hattie, J., Timperley, H., The power of feedback. Review of Educational Research 77:1 (2007), 81–112, 10.3102/003465430298487.
51. Haydon, M.L., Larson, D., Reed, E., Shrivastava, V.K., Preslicka, C.W., Nageotte, M.P., Obstetric outcomes and maternal satisfaction in nulliparous women using patient-controlled epidural analgesia. American Journal of Obstetrics and Gynecology, 205(3), 2011, e6 271.
52. van der Helden, J., Boksem, M.A., Blom, J.H., The importance of failure: Feedback-related negativity predicts motor learning efficiency. Cerebral Cortex (New York, N.Y.: 1991) 20:7 (2010), 1596–1603, 10.1093/cercor/bhp224.
53. Higgins, E.T., Beyond pleasure and pain. American Psychologist, 52(12), 1997, 1280.
54. Hounsell, D., Boud, D., Falchikov, N., Towards more sustainable feedback to students. Boud, D., Falchikov, N., (eds.) Rethinking assessment in higher education, 1st ed., 2007, Routledge London, Abingdon, UK, 101–113.
55. Hounsell, D., McCune, V., Hounsell, J., Litjens, J., The quality of guidance and feedback to students. Higher Education Research & Development 27:1 (2008), 55–67.
56. Hounsell, D., Slowey, M., Watson, D., Student feedback, learning and development. Slowey, M., Watson, D., (eds.) Higher education and the lifecourse, 1st ed., 2003, SRHE & Open University Press, Buckingham, 67–78.
57. Houtman, F., Castellar, E.N., Notebaert, W., Orienting to errors with and without immediate feedback. Journal of Cognitive Psychology 24:3 (2012), 278–285.
58. Houtman, F., Notebaert, W., Blinded by an error. Cognition 128:2 (2013), 228–236.
59. Jonsson, A., Facilitating productive use of feedback in higher education. Active Learning in Higher Education 14:1 (2013), 63–76.
60. Katz, I., Assor, A., When choice motivates and when it does not. Educational Psychology Review, 19(4), 2007, 429.
61. Kizilcec, R.F., Saltarelli, A.J., Reich, J., Cohen, G.L., Closing global achievement gaps in MOOCs. Science 355:6322 (2017), 251–252.
62. Kluger, A.N., DeNisi, A., The effects of feedback interventions on performance. Psychological Bulletin 119:2 (1996), 254–284, 10.1037/0033-2909.119.2.254.
63. Kluger, A.N., DeNisi, A., Feedback interventions: Toward the understanding of a double-edged sword. Current Directions in Psychological Science 7:3 (1998), 67–72.
64. Kovacs, M., Beck, A.T., Maladaptive cognitive structures in depression. The American Journal of Psychiatry 135:5 (1978), 525–533, 10.1176/ajp.135.5.525.
65. Kulkarni, C.E., Bernstein, M.S., Klemmer, S.R., PeerStudio: Rapid peer feedback emphasizes revision and improves performance. Proceedings of the second (2015) ACM conference on learning@ scale, Vancouver, Canada, 2015, 75–84, 10.1145/2724660.2724670.
66. LaDonna, K.A., Hatala, R., Lingard, L., Voyer, S., Watling, C., Staging a performance: Learners' perceptions about direct observation during residency. Medical Education 51:5 (2017), 498–510.
67. Landis-Lewis, Z., Brehaut, J.C., Hochheiser, H., Douglas, G.P., Jacobson, R.S., Computer-supported feedback message tailoring: Theory-informed adaptation of clinical audit and feedback for learning and behavior change. Implementation Science, 10(1), 2015, 12.
68. Mahfoodh, O.H.A., “I feel disappointed”: EFL university students' emotional responses towards teacher written feedback. Assessing Writing 31 (2017), 53–72.
69. Mangels, J.A., Butterfield, B., Lamb, J., Good, C., Dweck, C.S., Why do beliefs about intelligence influence learning success? A social cognitive neuroscience model. Social Cognitive and Affective Neuroscience 1:2 (2006), 75–86.
70. McDonnell, J., Curtis, W., Making space for democracy through assessment and feedback in higher education: Thoughts from an action research project in education studies. Assessment & Evaluation in Higher Education 39:8 (2014), 932–948.
71. Merry, S., Price, M., Carless, D., Taras, M., Reconceptualising feedback in higher education: Developing dialogue with students. 1st ed., 2013, Routledge, New York, NY.
72. Mulliner, E., Tucker, M., Feedback on feedback practice: Perceptions of students and academics. Assessment & Evaluation in Higher Education 42:2 (2017), 266–288.
73. Narciss, S., Designing and evaluating tutoring feedback strategies for digital learning environments on the basis of the interactive tutoring feedback model. Digital Education Review 23 (2013), 7–26.
74. Notebaert, W., Houtman, F., Van Opstal, F., Gevers, W., Fias, W., Verguts, T., Post-error slowing: An orienting account. Cognition 111:2 (2009), 275–279.
75. OECD, PISA 2012 assessment and analytical Framework: Mathematics, reading, science, problem solving and financial literacy. 2013, OECD Publishing, Paris, 10.1787/9789264190511-en.
76. Patall, E.A., Cooper, H., Wynn, S.R., The effectiveness and relative importance of choice in the classroom. Journal of Educational Psychology, 102(4), 2010, 896.
77. Porath, C.L., Bateman, T.S., Self-regulation: From goal orientation to job performance. Journal of Applied Psychology, 91(1), 2006, 185.
78. Price, M., Handley, K., Millar, J., O'Donovan, B., Feedback: All that effort, but what is the effect?. Assessment & Evaluation in Higher Education 35:3 (2010), 277–289.
79. Reeve, J., Bolt, E., Cai, Y., Autonomy-supportive teachers: How they teach and motivate students. Journal of Educational Psychology, 91(3), 1999, 537.
80. Reynolds, P.L., Symons, S., Motivational variables and children's text search. Journal of Educational Psychology, 93(1), 2001, 14.
81. Rietsche, R., Lehmann, K., Haas, P., Söllner, M., The twofold value of IT-based peer assessment in management information systems education. 13th international conference on Wirtschaftsinformatik (WI), 2017, University of St. Gallen, Institute of Information Management, St. Gallen, Switzerland, 1–5.
82. Roscoe, R.D., Wilson, J., Johnson, A.C., Mayra, C.R., Presentation, expectations, and experience: Sources of student perceptions of automated writing evaluation. Computers in Human Behavior 70:5 (2017), 207–221, 10.1016/j.chb.2016.12.076.
83. Sadler, D.R., Beyond feedback: Developing student capability in complex appraisal. Assessment & Evaluation in Higher Education 35:5 (2010), 535–550.
84. Sanitioso, R., Kunda, Z., Fong, G.T., Motivated recruitment of autobiographical memories. Journal of Personality and Social Psychology, 59(2), 1990, 229.
85. Sargeant, J., Mcnaughton, E., Mercer, S., Murphy, D., Sullivan, P., Bruce, D.A., Providing feedback: Exploring a model (emotion, content, outcomes) for facilitating multisource feedback. Medical Teacher 33:9 (2011), 744–749, 10.3109/0142159X.2011.577287.
86. Schwartz, D.L., Arena, D., Measuring what matters most: Choice-based assessments for the digital age. 2013, MIT Press, Cambridge, Massachusetts.
87. Schwartz, D.L., Lindgren, R., Lewis, S., Constructivism in an age of non-constructivist assessments. Duffy, T.M., Tobias, S., (eds.) Constructivist instruction: Success or failure?, 1st ed., 2009, Routledge/Taylor & Francis Group, New York, 34–61.
88. Schwartz, D.L., Tsang, J.M., Blair, K.P., The ABCs of how we learn: 26 scientifically proven approaches, how they work, and when to use them. 2016, W.W. Norton & Company, US.
89. Sedikides, C., Green, J.D., Saunders, J., Skowronski, J.J., Zengel, B., Mnemic neglect: Selective amnesia of one's faults. European Review of Social Psychology 27:1 (2016), 1–62.
90. Shute, V.J., Focus on formative feedback. Review of Educational Research 78:1 (2008), 153–189.
91. Sitzman, D.M., Rhodes, M.G., Kornell, N., The influence of feedback on predictions of future memory performance. Memory & Cognition 44:7 (2016), 1102–1113.
92. Sonnentag, S., Sparr, J.L., Feedback and self-regulatory focus: Predicting affective reactions and performance in a field study. Academy of Management Proceedings 2008:1 (2008), 1–6, 10.5465/AMBPP.2008.33643503.
93. Soper, D., Significance of the difference between two correlations calculator [software]. 2015 Retrieved from http://www.danielsoper.com/statcalc.
94. Spataro, P., Mulligan, N.W., Rossi-Arnaud, C., Divided attention can enhance memory encoding: The attentional boost effect in implicit memory. Journal of Experimental Psychology: Learning, Memory, and Cognition, 39(4), 2013, 1223.
95. Steinborn, M.B., Flehmig, H.C., Bratzke, D., Schröter, H., Error reactivity in self-paced performance: Highly-accurate individuals exhibit largest post-error slowing. The Quarterly Journal of Experimental Psychology 65:4 (2012), 624–631.
96. Story, A.L., Self-esteem and memory for favorable and unfavorable personality feedback. Personality and Social Psychology Bulletin 24:1 (1998), 51–64.
97. Swallow, K.M., Jiang, Y.V., The attentional boost effect: Transient increases in attention to one task enhance performance in a second task. Cognition 115:1 (2010), 118–132.
98. Swallow, K.M., Jiang, Y.V., Goal-relevant events need not be rare to boost memory for concurrent images. Attention, Perception, & Psychophysics 74:1 (2012), 70–82.
99. Thurlings, M., Vermeulen, M., Bastiaens, T., Stijnen, S., Understanding feedback: A learning theory perspective. Educational Research Review 9 (2013), 1–15.
100. Timms, M., DeVelle, S., Lay, D., Towards a model of how learners process feedback: A deeper look at learning. Australian Journal of Education 60:2 (2016), 128–145.
101. Van der Borght, L., Schouppe, N., Notebaert, W., Improved memory for error feedback. Psychological Research 80:6 (2016), 1049–1058.
102. Wakefield, C., Adie, J., Pitt, E., Owens, T., Feeding forward from summative assessment: The essay feedback checklist as a learning tool. Assessment & Evaluation in Higher Education 39:2 (2014), 253–262.
103. Waller, L., Papi, M., Motivation and feedback: How implicit theories of intelligence predict L2 writers' motivation and feedback orientation. Journal of Second Language Writing 35 (2017), 54–65.
104. Walsh, B., Nixon, S., Walker, C., Doyle, N., Using a clean feedback model to facilitate the learning process. Creative Education, 6(10), 2015, 953.
105. Wiliam, D., What is assessment for learning?. Studies in Educational Evaluation 37:1 (2011), 3–14.
106. Williams, E.F., Ehrlinger, J., Failing to learn from feedback. Ellingson, J.E., Noe, R.A., (eds.) Autonomous learning in the workplace, 1st ed., 2017, Routledge, London, UK, 263–286.
107. Winstone, N.E., Nash, R.A., Parker, M., Rowntree, J., Supporting learners' agentic engagement with feedback: A systematic review and a taxonomy of recipience processes. Educational Psychologist 1 (2017), 1–21.
108. Yorke, M., Formative assessment in higher education: Moves towards theory and the enhancement of pedagogic practice. Higher Education 45:4 (2003), 477–501.