The power of internal feedback: exploiting natural comparison processes

Assessment and Evaluation in Higher Education

Volumn 46, Issue 5, 2021, Pages 756-778

  Nicol, David ^a  

^a UNIVERSITY OF GLASGOW   (United Kingdom)

Author keywords

Assessment; comparison processes; internal feedback; self regulation; information

Indexed keywords

EID: 85092756149     PISSN: 02602938     EISSN: 1469297X     Source Type: Journal    
DOI: 10.1080/02602938.2020.1823314     Document Type: Article

References (73)

1. Ajjawi, R., and D., Boud. 2017. “ Researching Feedback Dialogue: An Interactional Analysis Approach.” Assessment & Evaluation in Higher Education 42: 252–265. doi: 10.1080/02602938.2015.1102863.
2. Ajjawi, R., and D., Boud. 2018. “ Examining the Nature and Effects of Feedback Dialogue.” Assessment & Evaluation in Higher Education 43 (7): 1106–1119. doi: 10.1080/02602938.2018.1434128.
3. Alfieri, L., T., Nokes-Malach, and C., Schunn. 2013. “ Learning through Case Comparison: A Meta-Analytic Review.” Educational Psychologist 48 (2): 87–113. doi: 10.1080/00461520.2013.775712.
4. Allal, L., 2016. “ The Co-Regulation of Student Learning in an Assessment for Learning Culture.” In Assessment for Learning: Meeting the Challenge of Implementation, edited by D., Laveault and L., Allal. Switzerland: Springer. doi: 10.1007/978-3-319-39211-0_15.
5. Andrade, H. L., 2018. “ Feedback in the Context of Self-Assessment.” In The Cambridge Handbook of Instructional Feedback, edited by A.A., Lipnevich and J.K., Smith, 376–408. Cambridge: Cambridge University Press.
6. Ashford, S. J., and L. L., Cummings. 1983. “ Feedback as an Individual Resource: Personal Strategies of Creating Information.” Organisational Behaviour and Human Performance 32: 370–398. doi: 10.1016/0030-5073(83)90156-3.
7. Askell-Williams, H., and M. J., Lawson. 2005. “ Students’ Knowledge about the Value of Discussions for Teaching and Learning.” Social Psychology of Education 8 (1): 83–115. doi: 10.1007/s11218-004-5489-2.
8. Boud, D., and E., Molloy. 2013. “ Rethinking Models of Feedback for Learning: The Challenge of Design.” Assessment & Evaluation in Higher Education 38 (6): 698–712. doi: 10.1080/02602938.2012.691462.
9. Boud, D., R., Ajjawi, P., Dawson, and J., Tai. 2019. Developing Evaluative Judgement in Higher Education; Assessment for Knowing and Producing Quality Work. Oxford: Routledge.
10. Bouwer, R., M., Lesterhuis, P., Bonne, and S., De Maeyer. 2018. “ Applying Criteria to Examples or Learning by Comparison: Effects on Students' Evaluative Judgment and Performance in Writing.” Frontiers in Education 3: 86. doi: 10.3389/feduc.2018.00086.
11. Butler, D. L., and P. H., Winne. 1995. “ Feedback and Self-Regulated Learning: A Theoretical Synthesis.” Review of Educational Research 65 (3): 245–281. doi: 10.3102/00346543065003245.
12. Carless, D., 2020. “ Longitudinal Perspectives on Students’ Experiences of Feedback: A Need for Teacher–Student Partnerships.” Higher Education Research & Development 39 (3): 425–438. doi: 10.1080/07294360.2019.1684455.
13. Carless, D., and D., Boud. 2018. “ The Development of Student Feedback Literacy: Enabling Uptake of Feedback.” Assessment & Evaluation in Higher Education 43 (8): 1315–1325. doi: 10.1080/02602938.2018.1463354.
14. Carless, D., and K. K. H., Chan. 2017. “ Managing Dialogic Use of Exemplars.” Assessment & Evaluation in Higher Education 42 (6): 930–941. doi: 10.1080/02602938.2016.1211246.
15. Chi, M. T H., M., Roy, and R. G. M., Hausmann. 2008. “Observing Tutorial Dialogues Collaboratively: Insights about Human Tutoring Effectiveness from Vicarious Learning.” Cognitive Science 32 (2): 301–341. doi: 10.1080/03640210701863396.
16. Clark, I., 2012. “ Formative Assessment: Assessment is for Self-Regulated Learning.” Educational Psychology Review 24 (2): 205–249. doi: 10.1007/s10648-011-9191-6.
17. Edwards, B. J., J. J., Williams, D., Gentner, and T., Lombrozo. 2019. “ Explanation Recruits Comparison in a Category-Learning Task.” Cognition 185: 21–38. doi: 10.1016/j.cognition.2018.12.011.
18. Evans, C., 2013. “ Making Sense of Assessment Feedback in Higher Education.” Review of Educational Research 83 (1): 70–120. doi: 10.3102/0034654312474350.
19. Fawns, T., and C., O’Shea. 2019. “ Evaluative Judgement of Working Practices: Reconfiguring Assessment to Support Student Adaptability and Agency across Complex Settings.” Italian Journal of Educational Technology27 (1): 5-18. doi: 10.17471/2499-4324/1027.
20. Finn, B., R., Thomas, and K. A., Rawson. 2018. “ Learning More from Feedback: Elaborating Feedback with Examples Enhances Concept Learning.” Learning and Instruction 54: 104–113. doi: 10.1016/j.learninstruc.2017.08.007.
21. Gentner, D., 2010. “ Bootstrapping the Mind: Analogical Processes and Symbol Systems.” Cognitive Science 34 (5): 752–775. doi: 10.1111/j.1551-6709.2010.01114.x.
22. Gentner, D., 2016. “ Language as a Cognitive Tool Kit: How Language Supports Relational Thought.” The American Psychologist 71 (8): 650–657. doi: 10.1037/amp0000082.
23. Gentner, D. G., K. J., Holyoak, and B. K., Kokinov. 2001. The Analogical Mind: Perspectives from Cognitive Science. Cambridge, MA: MIT Press.
24. Gentner, D., and F., Maravilla. 2018. “ Analogical Reasoning.” In International Handbook of Thinking and Reasoning, edited by L. J., Ball and V. A., Thomson, 186–203. New York, NY: Psychology Press.
25. Gentner, D., J., Loewenstein, and L., Thompson. 2003. “ Learning and Transfer: A General Role for Analogical Encoding.” Journal of Educational Psychology 95 (2): 393–408. doi: 10.1037/0022-0663.95.2.393.
26. Goldstone, R. L., S., Day, and J. Y., Son. 2010. “ Comparison.” In On Thinking: Towards a Theory of Thinking, edited by B., Glatzeder, V., Goel, and A., von Müller, 103–122. Heidelberg, Germany: Springer-Verlag. doi: 10.1007/978-3-642-03129-8_7.
27. Gravett, K., 2020. “ Feedback Literacies as Sociomaterial Practice.” Critical Studies in Education. doi: 10.1080/17508487.2020.1747099.
28. Hattie, J., and H., Timperley. 2007. “ The Power of Feedback.” Review of Educational Research 77 (1): 81–112. doi: 10.3102/003465430298487.
29. Hoyos, C., and D., Gentner. 2017. “ Generating Explanations via Analogical Comparisons.” Psychonomic Bulletin & Review 24 (5): 1364–1374. doi: 10.3758/s13423-017-1289-5.
30. Kaufman, J., and C., Schunn. 2011. “ Students' Perceptions about Peer Assessment for Writing: Their Origin and Impact on Revision Work.” Instructional Science 39 (3): 387–406. http://www.jstor.org/stable/23882808. doi: 10.1007/s11251-010-9133-6.
31. Kurtz, K. J., C. H., Miao, and D., Gentner. 2001. “ Learning by Analogical Bootstrapping.” Journal of the Learning Sciences 10 (4): 417–446. doi: 10.1207/S15327809JLS1004new_2.
32. Kurtz, K. J., O., Boukrina, and D., Gentner. 2013. “ Comparison Promotes Learning and Transfer of Relational Categories.” Journal of Experimental Psychology. Learning, Memory, and Cognition 39 (4): 1303–1310. doi: 10.1037/a0031847.
33. Laming, D., 2004. Human Judgement: The Eye of the Beholder. London: Thomson Learning. ISBN 1-86152-777-2.
34. Li, L., and V. Grion. 2019. “The Power of giving feedback ad receiving feedback in peer assessment”, All Ireland Journal of Teaching and Learning in Higher Education 11 (2): 1–17. https://ojs.aishe.org/index.php/aishe-j/article/view/413/671
35. Lin-Siegler, X., D., Shaenfield, and A. D., Elder. 2015. “ Contrasting Case Instruction Can Improve Self-Assessment of Writing.” Educational Technology Research and Development 63 (4): 517–537. doi: 10.1007/s11423-015-9390-9.
36. Lipnevich, A. A., L. N., McCallen, K. P., Miles, and J. K., Smith. 2014. “ Mind the Gap! Students’ Use of Exemplars and Detailed Rubrics as Formative Assessment.” Instructional Science 42 (4): 539–559. doi: 10.1007/s11251-013-9299-9.
37. Loewenstein, J., L., Thompson, and D., Gentner. 1999. “ Analogical Encoding Facilitates Knowledge Transfer in Negotiation.” Psychonomic Bulletin & Review 6 (4): 586–597. doi: 10.3758/bf03212967.
38. Loewenstein, J., L., Thompson, and D., Gentner. 2003. “ Analogical Learning in Negotiation Teams: Comparing Cases Promotes Learning and Transfer.” Academy of Management Learning & Education 2 (2): 119–127. doi: 10.5465/amle.2003.9901663.
39. McConlogue, T., 2015. “ Making Judgements: Investigating the Process of Composing and Receiving Peer Feedback.” Studies in Higher Education 40 (9): 1495–1506. doi: 10.1080/03075079.2013.868878.
40. Merry, S., M., Price, D., Carless, and M., Taras. 2013. Reconceptualising Feedback in Higher Education: Developing Dialogue with Students. London: Routledge.
41. Nagarajan, A., and C., Hmelo-Silver. 2006. “Scaffolding Learning from Contrasting Video Cases.” Proceedings of the 7th International Conference on Learning Sciences, 495–501.
42. Natriello, G., 1987. “ The Impact of Evaluation Processes on Students.” Educational Psychologist 22 (2): 155–175. doi: 10.1207/s15326985ep2202_4.
43. Nicol, D., 2010. “ From Monologue to Dialogue: Improving Written Feedback Processes in Mass Higher Education.” Assessment & Evaluation in Higher Education 35 (5): 501–517. doi: 10.1080/02602931003786559.
44. Nicol, D., 2013. “ Resituating Feedback from the Reactive to the Proactive.” In Feedback in Higher and Professional Education: Understanding It and Doing It Well, edited by D., Boud and E., Molloy, 34–49. Oxon: Routledge.
45. Nicol, D., 2014. “ Guiding Principles of Peer Review: unlocking Learners’ Evaluative Skills.” In Advances and Innovations in University Assessment and Feedback, edited by C., Kreber, C., Anderson, N., Entwistle and J., McArthur. Edinburgh: Edinburgh University Press http://www.jstor.com/stable/10.3366/j.ctt14brxp5.16.
46. Nicol, D., 2019. “ Reconceptualising Feedback as an Internal Not an External Process.” Italian Journal of Educational Research, Special Issue: 71–83. https://ojs.pensamultimedia.it/index.php/sird/article/view/3270.
47. Nicol, D., A., Serbati, and M., Tracchi. 2019. “ Competence Development and Portfolios: Promoting Reflection through Peer Review.” All Ireland Journal of Higher Education 11 (2): 1–13. ojs.aishe.org/index.php/aishe-j/article/view/405/664.
48. Nicol, D., A., Thomson, and C., Breslin. 2014. “ Rethinking Feedback Practices in Higher Education: A Peer Review Perspective.” Assessment & Evaluation in Higher Education 39 (1): 102–122. doi: 10.1080/02602938.2013.795518.
49. Nicol, D., and G. Selvaretnam, G. 2020. “Making Internal Feedback Explicit: Harnessing the comparisons students make during two-stage exams. https://doi.org/10.31234/osf.io/jrc6y
50. Nicol, D., and S., McCallum. 2020. “Making internal feedback explicit: Exploiting the multiple comparisons that occur during peer review.” doi: 10.31234/osf.io/ksp2v
51. Nicol, D. J., and D., Macfarlane-Dick. 2006. “ Formative Assessment and Self-Regulated Learning: A Model and Seven Principles of Good Feedback Practice.” Studies in Higher Education 31 (2): 199–218. doi: 10.1080/03075070600572090.
52. Panadero, E., H., Andrade, and S., Brookhart. 2018. “ Fusing Self-Regulated Learning and Formative Assessment: A Roadmap of Where we Are, How we Got Here, and Where we Are Going.” The Australian Educational Researcher 45 (1): 13–31. doi: 10.1007/s13384-018-0258-y.
53. Panadero, E., J., Broadbent, D., Boud, and J. M., Lodge. 2019. “ Using Formative Assessment to Influence Self- and co-Regulated Learning: The Role of Evaluative Judgement.” European Journal of Psychology of Education 34 (3): 535–557. doi: 10.1007/s10212-018-0407-8.
54. Panadero, E., and A., Jonsson. 2013. “ The Use of Scoring Rubrics for Formative Assessment Purposes Revisited: A Review.” Educational Research Review 9: 129–144. doi: 10.1016/j.edurev.2013.01.002.
55. Panadero, E., A., Lipnevich, and J., Broadbent. 2019. “ Turning Self-Assessment into Self-Feedback.” In The Impact of Feedback in Higher Education, edited by M., Henderson, R., Ajjawi, D., Boud, and E., Molloy. Cham: Palgrave Macmillan. doi: 10.1007/978-3-030-25112-3_9.
56. Piaget, J., 1976. The Grasp of Consciousness: Action and Concept in the Young Child. Cambridge: Harvard University Press.
57. Rittle-Johnson, B., and J. R., Star. 2011. “ The Power of Comparison in Learning and Instruction. Learning Outcomes Supported by Different Types of Comparisons.” Psychology of Learning and Motivation 55: 199–225. doi: 10.1016/B978-0-12-387691-1.00007-7.
58. Rowe, A. D., 2017. “ Feelings about Feedback: The Role of Emotions in Assessment for Learning.” In Scaling up Assessment for Learning in Higher Education, edited by D., Carless, S. M., Bridges, S. K. Y., Chan and R, Glofcheski, 159–172. Singapore: Springer.
59. Rust, C., M. Price., and B. O’Donovan. 2003. “ Improving Students Learning by Developing Their Understanding of Assessment Criteria and Processes.” Assessment & Evaluation in Higher Education 28 (2): 147–164. doi: 10.1080/02602930301671.
60. Ryan, T., and M., Henderson. 2018. “ Feeling Feedback: Students’ Emotional Responses to Educator Feedback.” Assessment & Evaluation in Higher Education 43 (6): 880–892. doi: 10.1080/02602938.2017.1416456.
61. Sadler, D. R., 1989. “ Formative Assessment and the Design of Instructional Systems.” Instructional Science 18 (2): 119–144. doi: 10.1007/BF00117714.
62. Sadler, D. R., 2010. “ Beyond Feedback: Developing Student Capability in Complex Appraisal.” Assessment & Evaluation in Higher Education 35 (5): 535–550. doi: 10.1080/02602930903541015.
63. Sargeant, J., H., Armson, B., Chesluk, T., Dornan, K., Eva, E., Holmboe, J., Lockyer, E., Loney, K., Mann, and C., van der Vleuten. 2010. “ The Processes and Dimensions of Informed Self-Assessment: A Conceptual Model.” Academic Medicine 85 (7): 1212–1220. doi: 10.1097/ACM.0b013e3181d85a4e.
64. Sfard, A., 1998. “ On Two Metaphors for Learning and the Danger of Choosing Just One.” Educational Researcher 27 (2): 4–13. doi: 10.2307/1176193.
65. Sutton, P., 2012. “ Conceptualising Feedback Literacy: Knowing, Being, and Acting.” Innovations in Education and Teaching International 49 (1): 31–40. doi: 10.1080/14703297.2012.647781.
66. Tai, J., R., Ajjawi, D., Boud, P., Dawson, and E., Panadero. 2018. “ Developing Evaluative Judgement: Enabling Students to Make Decisions about the Quality of Work.” Higher Education 76 (3): 467–481. doi: 10.1007/s10734-017-0220-3.
67. Tanner, K. D., 2012. “ Promoting Student Metacognition.” CBE Life Sciences Education 11 (2): 113–120. doi: 10.1187/cbe.12-03-0033.
68. Torrance, H., 2012. “ Formative Assessment at the Crossroads: Conformative, Deformative and Transformative.” Oxford Review of Education 38 (3): 323–342. doi: 10.1080/03054985.2012.689693.
69. Vygotsky, L. S., 1978. Mind in Society; The Development of Higher Psychological Processes. Cambridge, MA: Harvard University Press. ISBN-10: 0674576292
70. Winstone, N. E., R. A., Nash, M., Parker, and J., Rowntree. 2017. “ Supporting Learners' Agentic Engagement with Feedback: A Systematic Review and a Taxonomy of Recipience Processes.” Educational Psychologist 52 (1): 17–37. doi: 10.1080/00461520.2016.1207538.
71. Winstone, N., and D., Carless. 2019. Designing Effective Feedback Processes in Higher Education: A Learning-Focused Approach. Oxford: Routledge.
72. Yan, Z., 2020. “ Self-Assessment in the Process of Self-Regulated Learning and Its Relationship with Academic Achievement.” Assessment & Evaluation in Higher Education 45 (2): 224–238. doi: 10.1080/02602938.2019.1629390.
73. Yan, Z., and G. T. L., Brown. 2017. “ A Cyclical Self-Assessment Process: Towards a Model of How Students Engage in Self-Assessment.” Assessment & Evaluation in Higher Education 42 (8): 1247–1262. doi: 10.1080/02602938.2016.1260091.