Inside the Next Black Box: Examining Students’ Responses to Teacher Feedback in a Formative Assessment Context

Frontiers in Education

Volumn 7, Issue , 2022, Pages

  Lui, Angela M ^a  

^a CITY UNIVERSITY OF NEW YORK   (United States)

Author keywords

affective and cognitive processes; decision making; emotions; formative assessment; formative feedback; interpretations; motivational states; responses to feedback

Indexed keywords

EID: 85128451492     PISSN: None     EISSN: 2504284X     Source Type: Journal    
DOI: 10.3389/feduc.2022.751549     Document Type: Article

References (91)

1. Allal L. Lopez L. M. (2005). “Formative assessment of learning: a review of publications in French,” in Formative Assessment: Improving Learning in Secondary Classrooms, ed. OECD (Paris: OECD), 241–264.
2. Andrade H. (2010). “Students as the definitive source of formative assessment: Academic selfassessment and the self-regulation of learning,” in Handbook of Formative Assessment, eds Andrade H. Cizek G. (New York, NY: Routledge), 90–105.
3. Andrade H. (2013). “Classroom assessment in the context of learning theory and research,” in SAGE Handbook of Research on Classroom Assessment, ed. McMillan J. H. (New York, NY: SAGE), 17–34. 10.4135/9781452218649.n2
4. Andrade H. (2016). Classroom Assessment and Learning: A Selective Review of Theory and Research [White paper]. Washington, DC: National Academy of Sciences.
5. Andrade H. L. Bennett R. E. Cizek G. J. (eds) (2019). Handbook of Formative Assessment in the Disciplines. Milton Park: Routledge. 10.4324/9781315166933
6. Andrade H. L. Wang X. Du Y. Akawi R. L. (2009). Rubric-referenced self-assessment and self-efficacy for writing. J. Educ. Res. 102 287–302. 10.3200/JOER.102.4.287-302
7. Bangert-Drowns R. L. Kulik C.-L. C. Kulik J. A. Morgan M. (1991). The instructional effect of feedback in test–like events. Rev. Educ. Res. 61 213–238. 10.3102/00346543061002213
8. Bennett R. E. (2011). Formative assessment: a critical review. Assess. Educ. Principles Policy Practice 18 5–25. 10.1080/0969594X.2010.513678
9. Black P. Wiliam D. (1998). Assessment and classroom learning. Assess. Educ. Principles Policy Practice 5 7–74. 10.1080/0969595980050102
10. Bonner S. M. Chen P. P. (2019). Systematic Classroom Assessment: An Approach for Learning and Self-regulation. Milton Park: Routledge Press.
11. Brookhart S. M. (2007/2008). Feedback that fits. Educ. Leadership 65 54–59.
12. Brown G. T. Peterson E. R. Yao E. S. (2016). Student conceptions of feedback: impact on self-regulation, self-efficacy, and academic achievement. Br. J. Educ. Psychol. 86 606–629. 10.1111/bjep.12126 27612004
13. Bryer M. J. Speerschneider K. (2016). likert: Analysis and Visualization Likert Items. R Package Version 1.3.5. Available online at: https://CRAN.R-project.org/package=likert.
14. Burgoyne A. P. Hambrick D. Z. Macnamara B. N. (2020). How firm are the foundations of mind-set theory? the claims appear stronger than the evidence. Assoc. Psychol. Sci. 31 258–267. 10.1177/0956797619897588 32011215
15. Butler D. L. Winne P. H. (1995). Feedback and self-regulated learning: a theoretical synthesis. Rev. Educ. Res. 65 245–281. 10.3102/00346543065003245
16. Cauley K. M. McMillan J. H. (2010). Formative assessment techniques to support student motivation and achievement. Clear. House: J. Educ. Strategies Issues Ideas 83 1–6. 10.1080/00098650903267784
17. Cellar D. F. Stuhlmacher A. F. Young S. K. Fisher D. M. Adair C. K. Haynes S. et al. (2011). Trait goal orientation, self-regulation, and performance: a meta-analysis. J. Bus. Psychol. 26 467–483. 10.1007/s10869-010-9201-6
18. Chan J. C. Y. Lam S. F. (2010). Effects of different evaluative feedback on students’ self-efficacy in learning. Instruct. Sci. 38 37–58.
19. Chen F. Lui A. Andrade H. Valle C. Mir H. (2017). Criteria-referenced formative assessment in the arts. Educ. Assess. Eval. Accountability 29 297–314. 10.1080/00220671.2016.1255870
20. Cimpian A. Arce H. M. C. Markman E. M. Dweck C. S. (2007). Subtle linguistic cues affect children’s motivation. Psychol. Sci. 18 314–316. 10.1111/j.1467-9280.2007.01896.x 17470255
21. Cizek G. J. Andrade H. L. Bennett R. E. (2019). “Integrating measurement principles into formative assessment,” in Handbook of Formative Assessment in the Disciplines, eds Andrade H. L. Bennett R. E. Cizek G. J. (Milton Park: Routledge), 3–19.
22. Coe M. Hanita M. Nishioka V. Smiley R. (2011). An Investigation of the Impact of the 6+1 Trait Writing Model on Grade 5 Student Writing Achievement (NCEE 2012-4010). Washington, DC: National Center for Education Evaluation and Regional Assistance, Institute of Education Sciences, U.S. Department of Education.
23. Cohen J. Cohen P. West S. G. Aiken L. S. (2003). Applied Multiple Regression/correlation Analysis for the Behavioral Sciences, 3rd Edn. Mahwah, NJ: Lawrence Erlbaum Associates, Inc.
24. Cowie B. (2005). Pupil commentary on assessment for learning. Curriculum J. 16 137–151. 10.1080/09585170500135921
25. Dann R. (2014). Assessment as learning: blurring the boundaries of assessment and learning for theory, policy and practice. Assess. Educ. Principles Policy Practice 21 149–166. 10.1080/0969594X.2014.898128
26. Draper S. W. (2009). What are learners actually regulating when given feedback? Br. J. Educ. Technol. 40 306–315. 1 10.1111/j.1467-8535.2008.00930.x
27. Dweck C. (2000). Self-theories: Their Role in Motivation, Personality, and Development. Hove: Psychology Press.
28. Dweck C. (2006). Mindset: The New Psychology of Success. New York, NY: Random House.
29. Ekholm E. Zumbrunn S. Conklin S. (2015). The relation of college student self-efficacy toward writing and writing self-regulation aptitude: writing feedback perceptions as a mediating variable. Teach. Higher Educ.: Critical Perspect. 20 197–207. 10.1080/13562517.2014.974026
30. Ericsson K. A. Simon H. A. (1993). Protocol Analysis. Cambridge, MA: MIT press.
31. Ericsson K. A. Simon H. A. (1998). How to study thinking in everyday life: contrasting think-aloud protocols with descriptions and explanations of thinking. Mind Culture Act. 5 178–186. 10.1207/s15327884mca0503_3
32. Fatima S. Ali M. Saad M. I. (2021). The effects of students’ conceptions of feedback on academic self-efficacy and self-regulation: evidence from higher education in Pakistan. J. Appl. Res. Higher Educ. 14 180–199. 10.1108/JARHE-07-2020-0209
33. Fisk S. M. (2017). A Qualitative Inquiry of Students’ and Teachers’ Perceptions on Feedback in Three Queensland Secondary Schools. (Publication No. 112506). Doctoral dissertation, Brisbane City QLD: Queensland University of Technology.
34. Gamlem S. M. Smith K. (2013). Students’ perceptions of classroom feedback. Assess. Educ. Principles Policy Practice 20 150–169. 10.1080/0969594X.2012.749212
35. Green C. Gilhooly K. (1996). “Protocol analysis: practical implementation,” in Handbook of Qualitative Research Methods for Psychology and Social Sciences, ed. Richardson J. T. (Leicester: BPS Books), 55–74.
36. Gunderson E. A. Hamdan N. Sorhagen N. S. (2017). Who needs innate ability to succeed in math and literacy? academic-domain-specific theories of intelligence about peers versus adults. Dev. Psychol. 53 1188–1205. 10.1037/dev0000282 28383932
37. Harris L. R. Brown G. T. Harnett J. A. (2014). Understanding classroom feedback practices: a study of New Zealand student experiences, perceptions, and emotional responses. Educ. Assess. Eval. Accountability 26 107–133. 10.1007/s11092-013-9187-5
38. Hattie J. A. C. (2009). Visible Learning: A Synthesis of 800+ Meta-analyses on Achievement. Milton Park: Routledge.
39. Hattie J. A. C. Timperley H. (2007). The power of feedback. Rev. Educ. Res. 77 81–112. 10.3102/003465430298487
40. Havnes A. Smith K. Dysthe O. Ludvigsen K. (2012). Formative assessment and feedback: making learning visible. Stud. Educ. Eval. 38 21–27. 10.1097/ACM.0000000000001922 29065021
41. Hier B. O. Mahony K. E. (2018). The contribution of mastery experiences, performance feedback, and task effort to elementary-aged students’ self-efficacy in writing. School Psychol. Quarterly 33 408–418. 10.1037/spq0000226 28857589
42. Holm S. (1979). A simple sequentially rejective multiple test procedure. Scand. J. Statistics 6 65–70. 10.2307/4615733
43. Jonsson A. Panadero E. (2018). “Facilitating students’ active engagement with feedback,” in The Cambridge Handbook of Instructional Feedback, eds Lipnevich A. A. Smith J. K. (Cambridge: Cambridge University Press), 531–554.
44. Kluger A. N. DeNisi A. (1996). The effects of feedback interventions on performance: a historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychol. Bull. 119 254–284. 10.1037/0033-2909.119.2.254
45. Kulhavy R. W. (1977). Feedback in written instruction. Rev. Educ. Res. 47 211–232. 10.3102/00346543047002211
46. Lee H. Chung H. Q. Zhang Y. Abedi J. Warschauer M. (2020). The effectiveness and features of formative assessment in US K-12 Education: a systematic review. Appl. Measurement Educ. 33 124–140. 10.1080/08957347.2020.1732383
47. Leighton J. P. (2019). Students’ interpretation of formative assessment feedback: three claims for why we know so little about something so important. J. Educ. Measurement 56 793–814. 10.1111/jedm.12237
48. Lerner J. S. Keltner D. (2000). Beyond valence: toward a model of emotion-specific influences on judgement and choice. Cogn. Emot. 14 473–493. 10.1080/026999300402763
49. Lipnevich A. A. Smith J. K. (2009a). Effects of differential feedback on students’ examination performance. J. Exp. Psychol. Appl. 15 319–333. 10.1037/a0017841 20025418
50. Lipnevich A. A. Smith J. K. (2009b). “I really need feedback to learn:” students’ perspectives on the effectiveness of the differential feedback messages. Educ. Assess. Eval. Accountability 21 347–367. 10.1007/s11092-009-9082-2
51. Lipnevich A. A. Berg D. A. G. Smith J. K. (2016). “Toward a model of student response to feedback,” in The Handbook of Human and Social Conditions in Assessment, eds Brown G. T. L. Harris L. R. (Milton Park: Routledge), 169–185.
52. Lipnevich A. A. McCallen L. N. Miles K. P. Smith J. K. (2014). Mind the gap! students’ use of exemplars and detailed rubrics as formative assessment. Instruct. Sci. 42 539–559. 10.1007/s11251-013-9299-9
53. Lui A. M. (2020). Validity of the Responses to Feedback Survey: Operationalizing and Measuring Students’ Cognitive and Affective Responses to Teacher Feedback. Doctoral dissertation, Albany, NY: University at Albany, State University of New York.
54. Lui A. Andrade H. (2022). The next black box of formative assessment: a model of the internal mechanisms of feedback processing. Front. Educ. 7:751548. 10.3389/feduc.2022.751548
55. McMillan J. H. (2016). “Section discussion: student perceptions of assessment,” in Handbook of Social and Human Conditions in Assessment, eds Brown G. T. L. Harris L. R. (Milton Park: Routledge), 221–244.
56. Midgley C. Maehr M. L. Hruda L. Z. Anderman E. Anderman L. Freeman K. E. et al. (2000). Manual for the Patterns of Adaptive Learning Scales. Ann Arbor, MI: University of Michigan.
57. Narciss S. (2013). Designing and evaluating tutoring feedback strategies for digital learning. Digit. Educ. Rev. 23, 7–26.
58. Nicol D. J. MacFarlane-Dick D. (2006). Formative assessment and self-regulated learning: a model and seven principles of good feedback practice. Stud. Higher Educ. 31 199–218. 10.1080/03075070600572090
59. Pajares F. Hartley J. Valiante G. (2001). Response format in writing self-efficacy assessment: greater discrimination increases prediction. Measurement Eval. Counseling Dev. 33 214–221. 10.1080/07481756.2001.12069012
60. Panadero E. Lipnevich A. (2021). A review of feedback typologies and models: towards an integrative model of feedback elements. Educ. Res. Rev. 35:100416. 10.1016/j.edurev.2021.100416
61. Patil I. (2021). ggstatsplot: “ggplot2” Based Plots with Statistical Details. R Package Version 0.2.0. Available online at: https://CRAN.R-project.org/package=ggstatsplot.
62. Payne S. C. Youngcourt S. S. Beaubien J. M. (2007). A meta-analytic examination of the goal orientation nomological net. J. Appl. Psychol. 92 128–150. 10.1037/0021-9010.92.1.128 17227156
63. Pellegrino J. W. DiBello L. V. Goldman S. R. (2016). A framework for conceptualizing and evaluating the validity of instructionally relevant assessments. Educ. Psychol. 51 59–81. 10.1080/00461520.2016.1145550
64. Phelan J. C. Choi K. Niemi D. Vendlinski T. P. Baker E. L. Herman J. (2012). The effects of POWERSOURCE© assessments on middle-school students’ math performance. Assess. Educ. Principles Policy Practice 19 211–230. 10.1080/0969594X.2010.532769
65. Pitt E. Norton L. (2017). ‘Now that’s the feedback I want!’ students’ reactions to feedback on graded work and what they do with it. Assess. Eval. Higher Educ. 42 499–516. 10.1080/02602938.2016.1142500
66. Rakoczy K. Harks B. Klieme E. Blum W. Hochweber J. (2013). Written feedback in mathematics: mediated by students’ perception, moderated by goal orientation. Learn. Instruction 27 63–73. 10.1016/j.learninstruc.2013.03.002
67. Ramaprasad A. (1983). On the definition of feedback. Behav. Sci. 28 4–13.
68. Revelle W. (2019). psych: Procedures for Psychological, Psychometric, and Personality Research. Evanston, IL: Northwestern University.
69. Robinson S. Pope D. Holyoak L. (2013). Can we meet their expectations? experiences and perceptions of feedback in first year undergraduate students. Assess. Eval. Higher Educ. 38 260–272. 10.1080/02602938.2011.629291
70. Ruiz-Primo M. A. Li M. (2013). “Examining formative feedback in the classroom context: new research perspectives,” in SAGE Handbook of Research on Classroom Assessment, ed. McMillan J. H. (New York, NY: SAGE), 215–232.
71. Sadler D. R. (1989). Formative assessment and the design of instructional systems. Instructional Sci. 18 119–144. 10.1007/BF00117714
72. Sargeant J. Mann K. Sinclair D. Vleuten Cees Van Der Metsemakers J. (2008). Understanding the influence of emotions and reflection upon multi-source feedback acceptance and use. Adv. Health Sci. Educ. 13 275–288. 10.1007/s10459-006-9039-x 17091339
73. Schellings G. L. M. van Hout-Wolters B. H. A. M. Veenman M. V. J. Meijer J. (2013). Assessing metacognitive activities: the in-depth comparison of a task-specific questionnaire with think-aloud protocols. Eur. J. Psychol. Educ. 28 963–990.
74. Shepard L. A. (2000). The role of assessment in a learning culture. Educ. Researcher 29 4–14. 10.3102/0013189X029007004
75. Shute V. (2008). Focus on formative feedback. Rev. Educ. Research 78 153–189.
76. Tierney R. (2013). “Fairness in classroom assessment,” in SAGE Handbook of Research on Classroom Assessment, ed. McMillan J. H. (Thousand Oaks, CA: SAGE), 125–144.
77. Tulis M. Steuer G. Dresel M. (2016). Learning from errors: a model of individual processes. Frontline Learn. Res. 4:12–26. 10.14786/flr.v4i2.168
78. Tunstall P. Gipps C. (1996). Teacher feedback to young children in formative assessment: a typology. Br. Educ. Res. J. 22 389–404. 10.1080/0141192960220402
79. Van der Kleij F. M. Lipnevich A. A. (2021). Student perceptions of assessment feedback: a critical scoping review and call for research. Educ. Assess. Eval. Accountability 33 345–373. 10.1007/s11092-020-09331-x
80. Van der Kleij F. M. Feskens R. C. W. Eggen T. J. H. M. (2015). Effects of feedback in a computer-based learning environment on students’ learning outcomes: a meta-analysis. Rev. Educ. Res. 85 475–511. 10.3102/0034654314564881
81. VandeWalle D. Cron W. L. Slocum J. W. Jr. (2001). The role of goal orientation following performance feedback. J. Appl. Psychol. 86 629–640. 10.1037/0021-9010.86.4.629 11519647
82. Weaver M. R. (2006). Do students value feedback? student perceptions of tutors’ written responses. Assess. Eval. Higher Educ. 31 379–394. 10.1080/02602930500353061
83. Whitington V. Glover A. Harley F. (2004). Preservice early childhood students’ perceptions of written feedback on their essays. Early Child Dev. Care 174 321–337. 10.1080/0300443032000153390
84. Wiggins G. (2012). Seven keys to effective feedback. Educ. Leadership 70 10–16. 10.1371/journal.pone.0248628 33886550
85. Wiliam D. (2010). “An integrative summary of the research literature and implications for a new theory of formative assessment,” in Handbook of Formative Assessment, eds Andrade H. L. Cizek G. J. (Milton Park: Routledge), 18–40.
86. Wiliam D. (2011). What is assessment for learning? Stud. Educ. Eval. 37 3–14. 10.1016/j.stueduc.2011.03.001
87. Wiliam D. (2013). “Feedback and instructional correctives,” in SAGE Handbook of Research on Classroom Assessment, ed. McMillan J. H. (New York, NY: SAGE), 197–214.
88. Wingate U. (2010). The impact of formative feedback on the development of academic writing. Assess. Eval. Higher Educ. 35 519–533. 10.1080/02602930903512909
89. Winstone N. E. Nash R. A. Parker M. Rowntree J. (2017). Supporting learners’ agentic engagement with feedback: a systematic review and a taxonomy of recipience processes. Educ. Psychol. 52 17–37. 10.1080/00461520.2016.1207538
90. Winstone N. Bourne J. Medland E. Niculescu I. Rees R. (2021). Check the grade, log out”: students’ engagement with feedback in learning management systems. Assess. Eval. Higher Educ. 46 631–643. 10.1080/02602938.2020.1787331
91. Wisniewski B. Zierer K. Hattie J. (2020). The power of feedback revisited: a meta-analysis of educational feedback research. Front. Psychol. 10:3087. 10.3389/fpsyg.2019.03087 32038429