Reflection on exam grades to improve calibration of secondary school students: a longitudinal study

Metacognition and Learning

Volumn 15, Issue 3, 2020, Pages 291-317

  Nederhand, Marloes L ^a   Tabbers, Huib K ^a   Jongerling, Joran ^a   Rikers, Remy M J P ^a,b  

^a ERASMUS UNIVERSITY ROTTERDAM   (Netherlands)

^b UTRECHT UNIVERSITY   (Netherlands)

Author keywords

Calibration accuracy; Longitudinal design; Outcome feedback; Overconfidence; Performance feedback; Reflection; Self assessment; Self regulated learning

Indexed keywords

EID: 85086474783     PISSN: 15561623     EISSN: 15561631     Source Type: Journal    
DOI: 10.1007/s11409-020-09233-9     Document Type: Article

References (73)

1. Baker, J. M. C., & Dunlosky, J. (2006). Does momentary accessibility influence metacomprehension judgments? The influence of study-judgment lags on accessibility effects. Psychonomic Bulletin & Review, 13(1), 60–65. 10.3758/BF03193813. DOI: 10.3758/BF03193813
2. Black, P., & Wiliam, D. (2009). Developing the theory of formative assessment. Educational Assessment, Evaluation and Accountability (formerly: Journal of Personnel Evaluation in Education), 21(1), 5–31. 10.1007/s11092-008-9068-5. DOI: 10.1007/s11092-008-9068-5
3. Bol, L., & Hacker, D. J. (2001). A comparison of the effects of practice tests and traditional review on performance and calibration. Journal of Experimental Education, 69(2), 133–151. 10.1080/00220970109600653. DOI: 10.1080/00220970109600653
4. Bol, L., Hacker, D. J., O’Shea, P., & Allen, D. (2005). The influence of overt practice, achievement level, and explanatory style on calibration accuracy and performance. Journal of Experimental Education, 73(4), 269–290. 10.3200/JEXE.73.4.269-290. DOI: 10.3200/JEXE.73.4.269-290
5. Boud, D., Lawson, R., & Thompson, D. G. (2013). Does student engagement in self-assessment calibrate their judgement over time? Assessment and Evaluation in Higher Education, 38(8), 941–956. 10.1080/02602938.2013.769198. DOI: 10.1080/02602938.2013.769198
6. Brown, G. T. L., Andrade, H. L., & Chen, F. (2015). Accuracy in student self-assessment: Directions and cautions for research. Assessment in Education: Principles, Policy & Practice, 22(4), 444–457. 10.1080/0969594X.2014.996523. DOI: 10.1080/0969594X.2014.996523
7. Butler, D. L., & Winne, P. H. (1995). Feedback and self-regulated learning: A theoretical synthesis. Review of Educational Research, 65(3), 245–281. DOI: 10.3102/00346543065003245
8. Callender, A. A., Franco-Watkins, A. M., & Roberts, A. S. (2016). Improving metacognition in the classroom through instruction, training, and feedback. Metacognition and Learning, 11(2), 215–235. 10.1007/s11409-015-9142-6. DOI: 10.1007/s11409-015-9142-6
9. Carpenter, S. K., Lund, T. J. S., Coffman, C. R., Armstrong, P. I., Lamm, M. H., & Reason, R. D. (2016). A classroom study on the relationship between student achievement and retrieval-enhanced learning. Educational Psychology Review, 28(2), 353–375. 10.1007/s10648-015-9311-9. DOI: 10.1007/s10648-015-9311-9
10. Clark, I. (2012). Formative assessment: Assessment is for self-regulated learning. Educational Psychology Review, 24, 205–249. 10.1007/s10648-011-9191-6. DOI: 10.1007/s10648-011-9191-6
11. De Bruin, A. B. H., Kok, E., Lobbestael, J., & De Grip, A. (2017). The impact of an online tool for monitoring and regulating learning at university: Overconfidence, learning strategy, and personality. Metacognition and Learning, 12(1), 21–43. 10.1007/s11409-016-9159-5. DOI: 10.1007/s11409-016-9159-5
12. De Bruin, A. B., Thiede, K. W., Camp, G., & Redford, J. (2011). Generating keywords improves metacomprehension and self-regulation in elementary and middle school children. Journal of Experimental Child Psychology, 109(3), 294–310. 10.1016/j.jecp.2011.02.005. DOI: 10.1016/j.jecp.2011.02.005
13. De Bruin, A. B. H., & Van Gog, T. (2012). Improving self-monitoring and self-regulation: From cognitive psychology to the classroom. Learning and Instruction, 22(4), 245–252. 10.1016/j.learninstruc.2012.01.003. DOI: 10.1016/j.learninstruc.2012.01.003
14. Dent, A. L., & Koenka, A. C. (2016). The relation between self-regulated learning and academic achievement across childhood and adolescence: A meta-analysis. Educational Psychology Review, 28(3), 425–474. 10.1007/s10648-015-9320-8. DOI: 10.1007/s10648-015-9320-8
15. Destan, N., Spiess, M. A., de Bruin, A., van Loon, M., & Roebers, C. M. (2017). 6- and 8-year-olds’ performance evaluations: Do they differ between self and unknown others? Metacognition and Learning, 12(3), 315–336. 10.1007/s11409-017-9170-5. DOI: 10.1007/s11409-017-9170-5
16. Dunlosky, J., & Rawson, K. A. (2012). Overconfidence produces underachievement: Inaccurate self evaluations undermine students’ learning and retention. Learning and Instruction, 22(4), 271–280. 10.1016/j.learninstruc.2011.08.003. DOI: 10.1016/j.learninstruc.2011.08.003
17. Dunlosky, J., Serra, M. J., Matvey, G., & Rawson, K. A. (2005). Second-order judgments about judgments of learning. Journal of General Psychology, 132(4), 335–346. 10.3200/GENP.132.4.335-346. DOI: 10.3200/GENP.132.4.335-346
18. Dunlosky, J., & Thiede, K. W. (2013). Four cornerstones of calibration research: Why understanding students’ judgments can improve their achievement. Learning and Instruction, 24, 58–61. 10.1016/j.learninstruc.2012.05.002. DOI: 10.1016/j.learninstruc.2012.05.002
19. Dunlosky, J., Hartwig, M. K., Rawson, K. A., Lipko, A. R. (2018) Improving college students’ evaluation of text learning using idea-unit standards. Quarterly Journal of Experimental Psychology 64(3), 467–484. 10.1080/17470218.2010.502239
20. Ericsson, K. A., Krampe, R. T., & Tesch-Römer, C. (1993). Deliberate practice and the acquisition and maintenance of expert performance in medicine and related domains. Psychological Review, 100(3), 363–406. DOI: 10.1037/0033-295X.100.3.363
21. Finn, B., & Metcalfe, J. (2008). Judgments of learning are influenced by memory for past test. Journal of Memory and Language, 58(1), 19–34. 10.1016/j.jml.2007.03.006. DOI: 10.1016/j.jml.2007.03.006
22. Finn, B., & Tauber, S. K. (2015). When confidence is not a signal of knowing: How students’ experiences and beliefs about processing fluency can lead to miscalibrated confidence. Educational Psychology Review, 27(4), 567–586. 10.1007/s10648-015-9313-7. DOI: 10.1007/s10648-015-9313-7
23. Foster, N. L., Was, C. A., Dunlosky, J., & Isaacson, R. M. (2017). Even after thirteen class exams, students are still overconfident: The role of memory for past exam performance in student predictions. Metacognition and Learning, 12(1), 1–19. 10.1007/s11409-016-9158-6. DOI: 10.1007/s11409-016-9158-6
24. Fritzsche, E. S., Händel, M., & Kröner, S. (2018). What do second-order judgments tell us about low-performing students’ metacognitive awareness? Metacognition and Learning., 13, 159–177. 10.1007/s11409-018-9182-9. DOI: 10.1007/s11409-018-9182-9
25. Griffith, L. E., Cook, D. J., Guyatt, G. H., & Charles, C. A. (1999). Comparison of open and closed questionnaire formats in obtaining demographic information from Canadian general internists. Journal of Clinical Epidemiology, 52(10), 997–1005. 10.1016/S0895-4356(99)00106-7. DOI: 10.1016/S0895-4356(99)00106-7
26. Gutierrez de Blume, A. P., Wells, P., Davis, A. C., & Parker, J. (2017). “You can sort of feel it”: Exploring metacognition and the feeling of knowing among undergraduate students. The Qualitative Report, 22(7), 2017–2032 Retrieved from http://nsuworks.nova.edu/tqr.
27. Hacker, D. J., Bol, L., & Bahbahani, K. (2008). Explaining calibration accuracy in classroom contexts: The effects of incentives, reflection, and explanatory style. Metacognition and Learning, 3(2), 101–121. 10.1007/s11409-008-9021-5. DOI: 10.1007/s11409-008-9021-5
28. Hacker, D. J., Bol, L., Horgan, D. D., & Rakow, E. A. (2000). Test prediction and performance in a classroom context. Journal of Educational Psychology, 92(1), 160–170. 10.1037//0022-0663.92.1.160. DOI: 10.1037//0022-0663.92.1.160
29. Händel, M., Fritzsche, E. S. (2013) Students’ confidence in their performance judgements: a comparison of different response scales. Educational Psychology 35(3), 377–395. 10.1080/01443410.2014.895295
30. Händel, M., & Fritzsche, E. S. (2016). Unskilled but subjectively aware: Metacognitive monitoring ability and respective awareness in low-performing students. Memory and Cognition, 44(2), 229–241. 10.3758/s13421-015-0552-0. DOI: 10.3758/s13421-015-0552-0
31. Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research, 77(1), 81–112. 10.3102/003465430298487. DOI: 10.3102/003465430298487
32. Hox, J. J. (2010). Multilevel Analysis. In Multilevel analysis: Techniques and applications. International encyclopedia of statistical science (2nd ed.). New York, NY: Routledge. 10.1007/978-3-642-04898-2_387. DOI: 10.1007/978-3-642-04898-2_387
33. Huff, J. D., & Nietfeld, J. L. (2009). Using strategy instruction and confidence judgments to improve metacognitive monitoring. Metacognition and Learning, 4(2), 161–176. 10.1007/s11409-009-9042-8. DOI: 10.1007/s11409-009-9042-8
34. Koriat, A. (1997). Monitoring one’s own knowledge during study: A cue-utilization approach to judgments of learning. Journal of Experimental Psychology: General, 126(4), 349–370. 10.1037/0096-3445.126.4.349. DOI: 10.1037/0096-3445.126.4.349
35. Krosnick, J. A., & Presser, S. (2010). Question and questionnaire design. In P. Van Marsden & J. D. Wright (Eds.), Handbook of survey research (Vol. 62, 2nd ed., pp. 263–314). Bingley, UK: Emerald Group Publishing Limited. 10.1111/j.1432-1033.1976.tb10115.x. DOI: 10.1111/j.1432-1033.1976.tb10115.x
36. Kruger, J., & Dunning, D. (1999). Unskilled and unaware of it: How difficulties in recognizing one’s own incompetence lead to self-assessments. Journal of Personality and Social Psychology, 77(6), 1121–1134. 10.1037/0022-3514.77.6.1121. DOI: 10.1037/0022-3514.77.6.1121
37. Labuhn, A. S., Zimmerman, B. J., & Hasselhorn, M. (2010). Enhancing students’ self-regulation and mathematics performance: The influence of feedback and self-evaluative standards. Metacognition and Learning, 5(2), 173–194. 10.1007/s11409-010-9056-2. DOI: 10.1007/s11409-010-9056-2
38. Lajoie, S. P. (2008). Metacognition, self regulation, and self-regulated learning: A rose by any other name? Educational Psychology Review, 20(4), 469–475. 10.1007/s10648-008-9088-1. DOI: 10.1007/s10648-008-9088-1
39. Lamb, M. (2017). The motivational dimension of language teaching. Language Teaching, 50(3), 301–346. 10.1017/S0261444817000088. DOI: 10.1017/S0261444817000088
40. Lichtenstein, S., & Fischhoff, B. (1977). Do those who know more also know more about how much they know? Organizational Behavior and Human Decision Processes, 20, 159–183. DOI: 10.1016/0030-5073(77)90001-0
41. Lyons, K. E., & Ghetti, S. (2011). The development of uncertainty monitoring in early childhood. Child Development, 82(6), 1778–1787. 10.1111/j.1467-8624.2011.01649.x.
42. Metcalfe, J., & Finn, B. (2008). Evidence that judgments of learning are causally related to study choice. Psychonomic Bulletin and Review, 15(1), 174–179. 10.3758/PBR.15.1.174. DOI: 10.3758/PBR.15.1.174
43. Metcalfe, J., & Finn, B. (2012). Hypercorrection of high confidence errors in children. Learning and Instruction, 22(4), 253–261. 10.1016/j.learninstruc.2011.10.004. DOI: 10.1016/j.learninstruc.2011.10.004
44. Miller, T. M., & Geraci, L. (2011a). Training metacognition in the classroom: The influence of incentives and feedback on exam predictions. Metacognition and Learning, 6(3), 303–314. 10.1007/s11409-011-9083-7. DOI: 10.1007/s11409-011-9083-7
45. Miller, T. M., & Geraci, L. (2011b). Unskilled but aware: Reinterpreting overconfidence in low-performing students. Journal of Experimental Psychology: Learning, Memory, and Cognition, 37(2), 502–506. 10.1037/a0021802. DOI: 10.1037/a0021802
46. Nederhand, M. L., Tabbers, H. K., Abrahimi, H., & Rikers, R. M. J. P. (2018a). Improving calibration over texts by providing standards both with and without idea-units. Journal of Cognitive Psychology, 30(7), 689–700. 10.1080/20445911.2018.1513005. DOI: 10.1080/20445911.2018.1513005
47. Nederhand, M. L., Tabbers, H. K., Splinter, T. A. W., & Rikers, R. M. J. P. (2018b). The effect of performance standards and medical experience on diagnostic calibration accuracy. Health Professions Education., 4, 300–307. 10.1016/j.hpe.2017.12.008. DOI: 10.1016/j.hpe.2017.12.008
48. Nederhand, M. L., Tabbers, H. K., & Rikers, R. M. J. P. (2019). Learning to calibrate: Providing standards to improve calibration accuracy for different performance levels. Applied Cognitive Psychology., 33, 1068–1079. 10.1002/acp.3548. DOI: 10.1002/acp.3548
49. Nelson, T. O., & Narens, L. (1990). Metamemory: A theoretical framework and new findings. The Psychology of Learning and Motivation, 26(26), 125–141. 10.1016/S0079-7421(08)60053-5. DOI: 10.1016/S0079-7421(08)60053-5
50. Nicol, D. J., & Macfarlane-Dick, D. (2006). Formative assessment and self-regulated learning: A model and seven principles of good feedback practice. Studies in Higher Education, 31(2), 199–218. 10.1080/03075070600572090. DOI: 10.1080/03075070600572090
51. Nietfeld, J. L., Cao, L., & Osborne, J. W. (2006). The effect of distributed monitoring exercises and feedback on performance, monitoring accuracy, and self-efficacy. Metacognition and Learning, 1(2), 159–179. 10.1007/s10409-006-9595-6. DOI: 10.1007/s10409-006-9595-6
52. Panadero, E., Brown, G. T. L., & Strijbos, J. W. (2016). The future of student self-assessment: A review of known unknowns and potential directions. Educational Psychology Review, 28(4), 803–830. 10.1007/s10648-015-9350-2. DOI: 10.1007/s10648-015-9350-2
53. Paulus, M., Tsalas, N., Proust, J., & Sodian, B. (2014). Metacognitive monitoring of oneself and others: Developmental changes during childhood and adolescence. Journal of Experimental Child Psychology, 122(1), 153–165. 10.1016/j.jecp.2013.12.011. DOI: 10.1016/j.jecp.2013.12.011
54. Roebers, C. M. (2014). Children’s deliberate memory development: The contribution of strategies and metacognitive processes. In P. J. Bauer & R. Fivush (Eds.), The Wiley handbook on the development of children’s memory (Vol. 2, pp. 865–894). West Sussex: Wiley-Blackwell.
55. Roebers, C. M. (2017). Executive function and metacognition: Towards a unifying framework of cognitive self-regulation. Developmental Review, 45, 31–51. 10.1016/j.dr.2017.04.001. DOI: 10.1016/j.dr.2017.04.001
56. Sadler, D. R. (1989). Formative assessment and the design of instructional systems. Instructional Science, 18(2), 119–144. 10.1007/BF00117714. DOI: 10.1007/BF00117714
57. Schneider, W., & Löffler, E. (2016). The development of metacognitive knowledge in children and adolescents. In J. Dunlosky & S. K. Tauber (Eds.), Oxford Handbook of Metamemory (pp. 491–518). Oxford University Press.
58. Schraw, G. (2009). Measuring metacognitive Judgements. In Handbook of Metacognition in Education (pp. 439–462). doi:10.4324/9780203876428. DOI: 10.4324/9780203876428
59. Serra, M. J., & DeMarree, K. G. (2016). Unskilled and unaware in the classroom: College students’ desired grades predict their biased grade predictions. Memory and Cognition, 44(7), 1127–1137. 10.3758/s13421-016-0624-9. DOI: 10.3758/s13421-016-0624-9
60. Sheldon, O. J., Dunning, D., & Ames, D. R. (2014). Emotionally unskilled, unaware, and uninterested in learning more: Reactions to feedback about deficits in emotional intelligence. The Journal of Applied Psychology, 99(1), 125–137. 10.1037/a0034138. DOI: 10.1037/a0034138
61. Steiner, M., van Loon, M. H., Bayard, N. S., & Roebers, C. M. (2020). Development of Children’s monitoring and control when learning from texts: Effects of age and test format. Metacognition and Learning, 15(1), 3–27. 10.1007/s11409-019-09208-5. DOI: 10.1007/s11409-019-09208-5
62. Stone, E. R., & Opel, R. B. (2000). Training to improve calibration and discrimination: The effects of performance and environmental feedback. Organizational Behavior and Human Decision Processes, 83(2), 282–309. 10.1006/obhd.2000.2910. DOI: 10.1006/obhd.2000.2910
63. Stone, N. J. (2000). Exploring the relationship between calibration and self-regulated learning. Educational Psychology Review, 12(4), 437–475. 10.1023/A:1009084430926. DOI: 10.1023/A:1009084430926
64. Teimouri, Y., Goetze, J., & Plonsky, L. (2019). Second language anxiety and achievement: A meta-analysis. Studies in Second Language Acquisition, 41(2), 363–387. 10.1017/S0272263118000311. DOI: 10.1017/S0272263118000311
65. Thiede, K. W., Griffin, T. D., Wiley, J., & Anderson, M. C. M. (2010). Poor metacomprehension accuracy as a result of inappropriate cue use. Discourse Processes, 47(4), 331–362. 10.1080/01638530902959927. DOI: 10.1080/01638530902959927
66. Trilling, B., & Fadel, C. (2009). 21st century skills. Jossey-Bass, 256. https://doi.org/10.1145/1719292.1730970.
67. Weil, L. G., Fleming, S. M., Dumontheil, I., Kilford, E. J., Weil, R. S., Rees, G., Dolan, R. J., & Blakemore, S. J. (2013). The development of metacognitive ability in adolescence. Consciousness and Cognition, 22(1), 264–271. 10.1016/j.concog.2013.01.004. DOI: 10.1016/j.concog.2013.01.004
68. Wiliam, D. (2016). The secret of effective feedback. Educational Leadership, 73(7), 10–15 Retrieved from https://www.scopus.com/record/display.uri?eid=2-s2.0-84978969364&origin=resultslist&sort=plf-f&src=s&sid=54c5ee97b5760a54b634802811095048&sot=autdocs&sdt=autdocs&sl=17&s=AU-ID%286602672352%29&relpos=5&citeCnt=4&searchTerm.
69. Winne, P. H., & Jamieson-Noel, D. (2002). Exploring students' calibration of self reports about study tactics and achievement. Contemporary Educational Psychology, 27, 551–572. 10.1016/S0361-476X(02)00006-1. DOI: 10.1016/S0361-476X(02)00006-1
70. Winne, P. H., & Perry, N. E. (2000). Measuring self-regulated learning. In M. Boekaerts, P. R. Pintrich, & M. Zeidner (Eds.), Handbook of self-regulation (pp. 531–566). San Diego, CA: Academic Press. DOI: 10.1016/B978-012109890-2/50045-7
71. Wolters, C. A. (2010). Self-regulated learning and the 21st century competencies. USA University of Houston, (May), 27. Retrieved from http://www.hewlett.org/uploads/Self_Regulated_Learning__21st_Century_Competencies.pdf
72. Zimmerman, B. J. (1990). Self-regulated learning and academic achievement: An overview. Educational Psychologist, 25(1), 3–17. DOI: 10.1207/s15326985ep2501_2
73. Zimmerman, B. J. (2000). Attaining self-regulation: A social cognitive perspective. In M. Boekaerts, P. R. Pintrich, & M. Zeidner (Eds.), Handbook of self-regulation (pp. 13–40). Cambridge, MA: Academic Press. DOI: 10.1016/B978-012109890-2/50031-7