Calibrating Calibration: A Meta-Analysis of Learning Strategy Instruction Interventions to Improve Metacognitive Monitoring Accuracy

Journal of Educational Psychology

Volumn 114, Issue 4, 2021, Pages 681-700

  de Blume, Antonio P Gutierrez ^a  

^a GEORGIA SOUTHERN UNIVERSITY   (United States)

Author keywords

Learning strategy interventions; Meta analysis; Metacognitive monitoring; Metacomprehension accuracy; Self regulated learning

Indexed keywords

EID: 85131138918     PISSN: 00220663     EISSN: 19392176     Source Type: Journal    
DOI: 10.1037/edu0000674     Document Type: Article

References (131)

1. Adesope, O. O., Lavin, T., Thompson, T., & Ungerleider, C. (2010). A systematic review and meta-analysis on the cognitive correlates of bilingualism. Review of Educational Research, 80(2), 207-245. https://doi.org/10.3102/0034654310368803
2. Adesope, O. O., & Nesbit, J. C. (2012). Verbal redundancy in multimedia learning environments: A meta-analysis. Journal of Educational Psychology, 104(1), 250-263. https://doi.org/10.1037/a0026147
3. Agresti, A., & Franklin, C. (2007). Statistics: The art of learning from data. Pearson. https://www.libs.uga.edu/reserves/docs/main-spring2017/lutz-stat6220/agresti%20&%20franklin%203e.pdf
4. American Psychological Association. (2009). Publication manual of the American Psychological Association (6th ed.).
5. Azevedo, R., & Witherspoon, A. M. (2009). Self-regulated use with hypermedia. In A. Graesser, J. Dunlosky, & D. Hacker (Eds.), Handbook of metacognition in education (pp. 319-339). Lawrence Erlbaum. https://doi.org/10.4324/9780203876428.ch17
6. *Baars, M., Leopold, C., & Paas, F. (2018). Self-explaining steps in problem-solving tasks to improve self-regulation in secondary education. Journal of Educational Psychology, 110(4), 578-595. https://doi.org/10.1037/edu0000223
7. *Baars, M., van Gog, T., de Bruin, A., & Paas, F. (2014). Effects of problem solving after worked example study on primary school children’s monitoring accuracy. Applied Cognitive Psychology, 28(3), 382-391. https://doi.org/10.1002/acp.3008
8. *Baars, M., Vink, S., van Gog, T., de Bruin, A., & Paas, F. (2014). Effects of training self-assessment and using assessment standards on retrospective and prospective monitoring of problem solving. Learning and Instruction, 33, 92-107. https://doi.org/10.1016Zj.learninstruc.2014.04.004
9. *Baars, M., Visser, S., van Gog, T., de Bruin, A., & Paas, F. (2013). Completion of partially worked-out examples as a generation strategy for improving monitoring accuracy. Contemporary Educational Psychology, 38(4), 395-406. https://doi.org/10.1016/j.cedpsych.2013.09.001
10. Baeten, M., Kyndt, E., Struyven, K., & Dochy, F. (2010). Using studentcentered learning environments to stimulate deep approaches to learning: Factors encouraging and discouraging their effectiveness. Educational Research Review, 5(3), 243-260. https://doi.org/10.1016/j.edurev.2010.06.001
11. *Bailey, H., Dunlosky, J., & Hertzog, C. (2010). Metacognitive training at home: Does it improve older adults’ learning? Gerontology, 56(4), 414-420. https://doi.org/10.1159/000266030
12. Begg, C. B., & Mazumdar, M. (1994). Operating characteristics of a rank correlation test for publication bias. Biometrics, 50(4), 1088-1101. https://doi.org/10.2307/2533446
13. Bembenutty, H. (2007). Self-regulation of learning and academic delay of gratification: Gender and ethnic differences among college students. Journal of Advanced Academics, 18(4), 586-616. https://doi.org/10.4219/jaa -2007-553
14. *Bensley, D. A., & Spero, R. A. (2014). Improving critical thinking skills and metacognitive monitoring through direct infusion. Thinking Skills and Creativity, 12, 55-68. https://doi.org/10.1016/j.tsc.2014.02.001
15. Boekaerts, M. (1999). Self-regulated learning: Where we are today. International Journal of Educational Research, 31(6), 445-457. https://doi.org/10.1016/S0883-0355(99)00014-2
16. Boekaerts, M., & Rozendaal, J. S. (2010). Using multiple calibration indices in order to capture the complex picture of what affects students’ accuracy of feeling of confidence. Learning and Instruction, 20(5), 372-382. https://doi.org/10.1016/j.learninstruc.2009.03.002
17. Boer, H. D., Donker-Bergstra, A., Kostons, D., Korpershoek, H., & Werf, M. (2013). Effective strategies for self-regulated learning: A meta-analysis. GION Onderzoek/Onderwijs. https://www.semanticscholar.org/paper/Effective-Strategies-for-Self-regulated-Learning-%3A-Boer-Donker-Bergstra/810d9e602f104ba4de55a4537247517b26072c4a
18. *Bol, L., Hacker, D. J., O'Shea, P., & Allen, D. (2005). The influence of overt practice, achievement level, and explanatory style on calibration accuracy and performance. Journal of Experimental Education, 73(4), 269-290. https://doi.org/10.3200/JEXE.73.4.269-290
19. *Bol, L., Hacker, D. J., Walck, C. C., & Nunnery, J. A. (2012). The effects of individual or group guidelines on the calibration accuracy and achievement of high school biology students. Contemporary Educational Psychology, 37(4), 280-287. https://doi.org/10.1016Zj.cedpsych.2012.02.004
20. Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009). Introduction to meta-analysis. Wiley. https://doi.org/10.1002/9780470743386
21. *Bossert, T. S., & Schwantes, F. M. (1995). Children’s comprehension monitoring: Training children to use rereading to aid comprehension. Literacy Research and Instruction, 35(2), 109-121. https://doi.org/10.1080/19388079509558201
22. Brannick, M. T., Miles, D. E., & Kisamore, J. L. (2005). Calibration between student mastery and self-efficacy. Studies in Higher Education, 30(4), 473-483. https://doi.org/10.1080/03075070500160244
23. Brown, A. (1987). Metacognition, executive control, self-regulation, and other more mysterious mechanisms. In F. Weinert & R. Kluwe (Eds.), Metacognition, motivation, and understanding (pp. 65-116). Lawrence Erlbaum. https://www.worldcat.org/title/metacognition-motivation-and-understanding/oclc/14904010
24. *Bugg, J. M., & McDaniel, M. A. (2012). Selective benefits of question self-generation and answering for remembering expository text. Journal of Educational Psychology, 104(4), 922-931. https://doi.org/10.1037/a0028661
25. Butler, D. L., & Winne, P. H. (1995). Feedback and self-regulated learning: A theoretical synthesis. Review of Educational Research, 65(3), 245-281. https://doi.org/10.3102/00346543065003245
26. *Callender, A. A., Franco-Watkins, A. M., & Roberts, A. S. (2016). Improving metacognition in the classroom though instruction, training, and feedback. Metacognition and Learning, 11(2), 215-235. https://doi.org/10.1007/s11409-015-9142-6
27. Chiu, M., & Klassen, R. (2010). Relations of mathematics self-concept and its calibration with mathematics achievement: Cultural differences among fifteen-year-olds in 34 countries. Learning and Instruction, 20(1), 2-17. https://doi.org/10.1016/j.learninstruc.2008.11.002
28. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Lawrence Erlbaum. https://doi.org/10.4324/9780203771587
29. *Cogliano, M., Bernacki, M. L., & Kardash, C. M. (2020). A metacogni-tive retrieval practice intervention to improve undergraduates’ monitoring and control processes and use of performance feedback for classroom learning. Journal of Educational Psychology. Advance online publication. https://doi.org/10.1037/edu0000624
30. Cooper, H., Hedges, L. V., & Valentine, J. C. (Eds.). (2009). The handbook of research synthesis and meta-analysis (2nd ed.). Russell Sage Foundation.https://www.russellsage.org/publications/handbook-research-synthesis -and-meta-analysis-second-edition
31. *De Backer, L., Van Keer, H., & Valcke, M. (2015). Promoting university students’ metacognitive regulation through peer learning: The potential of reciprocal peer tutoring. Higher Education, 70(3), 469-486. https://doi.org/10.1007/s10734-014-9849-3
32. de Bruin, A. B. H., & van Gog, T. (2012). Improving self-monitoring and self-regulation: From cognitive psychology to the classroom. Learning and Instruction, 22(4), 245-252. https://doi.org/10.1016/j.learninstruc.2012.01.003
33. Denson, N. (2009). Do curricular and co-curricular diversity activities influence racial bias? A meta-analysis. Review of Educational Research, 79(2), 805-838. https://doi.org/10.3102/0034654309331551
34. *DiGiacomo, G., & Chen, P. P. (2016). Enhancing self-regulatory skills through an intervention embedded in a middle school mathematics curriculum. Psychology in the Schools, 53(6), 601-616. https://doi.org/10.1002/pits.21929
35. Dignath, C., Buettner, G., & Langfeldt, H. (2008). How can primary school students learn self-regulated learning strategies most effectively? A meta-analysis on self-regulation training programmes. Educational Research Review, 3(2), 101-129. https://doi.org/10.1016/j.edurev.2008.02.003
36. Dinsmore, D. L., & Alexander, P. A. (2012). A critical discussion of deep and surface processing: What it means, how it is measured, the role of context, and model specification. Educational Psychology Review, 24(4), 499-567. https://doi.org/10.1007/s10648-012-9198-7
37. *Doyle, M. E., & Hourihan, K. L. (2016). Metacognitive monitoring during category learning: How success affects future behaviour. Memory, 24(9), 1197-1207. https://doi.org/10.1080/09658211.2015.1086805
38. Efklides, A. (2008). Metacognition: Defining its facets and levels of functioning in relation to self-regulation and co-regulation. European Psychologist, 13(4), 277-287. https://doi.org/10.1027/1016-9040.13.4.277
39. Efklides, A. (2011). Interactions of metacognition with motivation and affect in self-regulated learning: The MASRL model. Educational Psychologist, 46(1), 6-25. https://doi.org/10.1080/00461520.2011.538645
40. Egger, M., Davey Smith, G., Schneider, M., & Minder, C. (1997). Bias in meta-analysis detected by a simple, graphical test. BMJ (Clinical Research Ed.), 315(7109), 629-634. https://doi.org/10.1136/bmj.315.7109.629
41. Ellis, P. D. (2010). The essential guide to effect sizes: Statistical power, meta-analysis, and the interpretation of research results. Cambridge University Press. https://doi.org/10.1017/CBO9780511761676
42. Entwistle, N. (1988). Motivational factors in students’ approaches to learning. In R. R. Schmeck (Ed.), Perspectives on individual differences. Learning strategies and learning styles (pp. 21-51). Plenum Press. https://doi.org/10.1007/978-1-4899-2118-5_2
43. Flavell, J. H. (1979). Metacognition and cognitive monitoring: A new area of psychological inquiry. American Psychologist, 34(10), 906-911. https://doi.org/10.1037/0003-066X.34.10.906
44. *Fukaya, T. (2013). Explanation generation, not explanation expectancy, improves metacomprehension accuracy. Metacognition and Learning, 8(1), 1-18. https://doi.org/10.1007/s11409-012-9093-0
45. Ghetti, S., & Angelini, L. (2008). The development of recollection and familiarity in childhood and adolescence: Evidence from the dual-process signal detection model. Child Development, 79(2), 339-358. https://doi.org/10.1111/j.1467-8624.2007.01129.x
46. *Griffin, T. D., Wiley, J., & Thiede, K. W. (2008). Individual differences, rereading, and self-explanation: Concurrent processing and cue validity as constraints on metacomprehension accuracy. Memory & Cognition, 36(1), 93-103. https://doi.org/10.3758/MC.36.E93
47. *Griffin, T. D., Wiley, J., & Thiede, K. W. (2019). The effects of comprehension-test expectancies on metacomprehension accuracy. Journal of Experimental Psychology: Learning, Memory, and Cognition, 45(6), 1066-1092. https://doi.org/10.1037/xlm0000634
48. Gutierrez, A. P., & Price, A. F. (2017). Calibration between undergraduate students’ prediction of and actual performance: The role of gender and performance attributions. Journal of Experimental Education, 85(3), 486-500. https://doi.org/10.1080/00220973.2016.1180278
49. *Gutierrez, A. P., & Schraw, G. (2015). Effects of strategy training and incentives on students’ performance, confidence, and calibration. Journal of Experimental Education, 83(3), 386-404. https://doi.org/10.1080/00220973.2014.907230
50. Gutierrez, A. P., Schraw, G., Kuch, F., & Richmond, A. S. (2016). A two-process model of metacognitive monitoring: Evidence for distinct accuracy and error factors. Learning and Instruction, 44, 1-10. https://doi.org/10.1016/j.learninstruc.2016.02.006
51. *Gutierrez de Blume, A. P. (2017). The effects of strategy training and an extrinsic incentive on fourth-and fifth-grade students’ performance, confidence, and calibration accuracy. Cogent Education, 4(1), 1314652. https://doi.org/10.1080/2331186X.2017.1314652
52. Hacker, D. J., Bol, L., & Bahbahani, K. (2008). Explaining calibration accuracy in classroom contexts: The effects of incentives, reflection, and explanatory style. Metacognition and Learning, 3(2), 101-121. https://doi.org/10.1007/s11409-008-9021-5
53. *Handel, M., Harder, B., & Dresel, M. (2020). Enhanced monitoring accuracy and test performance: Incremental effects of judgment training over and above repeated testing. Learning and Instruction, 65, 101245-101249. https://doi.org/10.1016/j.learninstruc.2019.101245
54. Hedges, L. V. (1981). Distribution theory for Glass’s estimator of effect size and related estimators. Journal of Educational and Behavioral Statistics, 6(2), 107-128. https://doi.org/10.3102/10769986006002107
55. Hedges, L. V., & Vevea, J. L. (1998). Fixed and random-effects models in meta-analysis. Psychological Methods, 3(4), 486-504. https://doi.org/10.1037/1082-989X.3.4.486
56. Higgins, J. P., & Thompson, S. (2002). Quantifying heterogeneity in a meta-analysis. Statistics in Medicine, 21(11), 1539-1558. https://doi.org/10.1002/sim.1186
57. Higgins, J. P., Thompson, S., Deeks, J., & Altman, D. G. (2003). Measuring inconsistency in meta-analyses. British Medical Journal, 327(7414), 557-560. https://doi.org/10.1136/bmj.327.7414.557
58. *Huff, J. D., & Nietfeld, J. L. (2009). Using strategy instruction and confidence judgments to improve metacognitive monitoring. Metacognition and Learning, 4(2), 161-176. https://doi.org/10.1007/s11409-009-9042-8
59. *Jaeger, A. J., Velazquez, M. N., Dawdanow, A., & Shipley, T. F. (2018). Sketching and summarizing to reduce memory for seductive details in science text. Journal of Educational Psychology, 110(7), 899-916. https://doi.org/10.1037/edu0000254
60. *Jaeger, A. J., & Wiley, J. (2014). Do illustrations help or harm metacomprehension accuracy? Learning and Instruction, 34, 58-73. https://doi.org/10.1016/j.learninstruc.2014.08.002
61. Kardash, K. C., & Amlund, J. T. (1991). Self-reported learning strategies and learning from expository text. Contemporary Educational Psychology, 16(2), 117-138. https://doi.org/10.1016/0361-476X(91)90032-G
62. *Kinnunen, R., & Vauras, M. (1995). Comprehension monitoring and the level of comprehension in high-and low-achieving primary school children’s reading. Learning and Instruction, 5(2), 143-165. https://doi.org/10.1016/0959-4752(95)00009-R
63. *Kolovelonis, A., Goudas, M., Dermitzaki, I., & Kitsantas, A. (2013). Self-regulated learning and performance calibration among elementary physical education students. European Journal of Psychology of Education, 28(3), 685-701. https://doi.org/10.1007/s10212-012-0135-4
64. *Kostons, D., & de Koning, B. B. (2017). Does visualization affect monitoring accuracy, restudy choice, and comprehension scores of students in primary education? Contemporary Educational Psychology, 51, 1-10. https://doi.org/10.1016/j.cedpsych.2017.05.001
65. *Kostons, D., van Gog, T., & Paas, F. (2010). Self-assessment and task selection in learner-controlled instruction: Differences between effective and ineffective learners. Computers & Education, 54(4), 932-940. https://doi.org/10.1016/j.compedu.2009.09.025
66. Krebs, S. S., & Roebers, C. M. (2010). Children’s strategic regulation, metacognitive monitoring, and control processes during test taking. The British Journal of Educational Psychology, 80(3), 325-340. https://doi.org/10.1348/000709910X485719
67. *Labuhn, A. S., Zimmerman, B. J., & Hasselhorn, M. (2010). Enhancing students’ self-regulation and mathematics performance: The influence of feedback and self-evaluative standards. Metacognition and Learning, 5(2), 173-194. https://doi.org/10.1007/s11409-010-9056-2
68. *Linderholm, T., & Zhao, Q. (2008). The impact of strategy instruction and timing of estimates on low and high working-memory capacity readers’ absolute monitoring accuracy. Learning and Individual Differences, 18(2), 135-143. https://doi.org/10.1016/j.lindif.2005.09.002
69. Lipsey, M. W., & Wilson, D. B. (2001). Practical meta-analysis. SAGE. https://us.sagepub.com/en-us/nam/practical-meta-analysis/book11092
70. Lyons, K. E., & Ghetti, S. (2011). The development of uncertainty monitoring in early childhood. Child Development, 82(6), 1778-1787. https://doi.org/10.1111/j.1467-8624.2011.01649.x
71. Ma, W., Adesope, O. O., Nesbit, J. C., & Liu, Q. (2014). Intelligent tutoring systems and learning outcomes: A meta-analysis. Journal of Educational Psychology, 106(4), 901-918. https://doi.org/10.1037/a0037123
72. *Magliano, J. P., Little, L. D., & Graesser, A. C. (1993). The impact of comprehension instruction on the calibration of comprehension. Literacy Research and Instruction, 32(3), 49-63. https://doi.org/10.1080/1938807 9309558124
73. McCormick, C. B. (2003). Metacognition and learning. In W. M. Reynolds & G. E. Miller (Eds.), Handbook of psychology: Educational psychology (pp. 79-102). Wiley.
74. McNamara, D. S., & Magliano, J. (2009). Toward a comprehensive model of comprehension. In B. H. Ross (Ed.), The psychology of learning and motivation: Vol. 51. The psychology of learning and motivation (pp. 297-384). Academic Press. https://doi.org/10.1016/S0079-7421(09)51009-2
75. *Miller, T. M., & Geraci, L. (2011). Training metacognition in the classroom: The influence of incentives and feedback on exam predictions. Metacognition and Learning, 6(3), 303-314. https://doi.org/10.1007/s11409-011-9083-7
76. *Miller, T. M., & Geraci, L. (2014). Improving metacognitive accuracy: How failing to retrieve practice items reduces overconfidence. Consciousness and Cognition, 29, 131-140. https://doi.org/10.1016/j.concog.2014.08.008
77. Mirandola, C., Ciriello, A., Gigli, M., & Cornoldi, C. (2018). Metacogni-tive monitoring of text comprehension: An investigation on postdictive judgments in typically developing children and children with reading comprehension difficulties. Frontiers in Psychology, 9, 2253. https://doi.org/10.3389/fpsyg.2018.02253
78. Nelson, T. O., & Narens, L. (1990). Metamemory: A theoretical framework and new findings. In G. Bower (Ed.), The psychology of learning and moti-ration (Vol. 26, pp. 125-173). Academic Press. https://www.elsevier.com/books/psychology-of-learning-and-motivation/bower/978-0-12-543326-6
79. *Nietfeld, J. L., Cao, L., & Osborne, J. W. (2005). Metacognitive monitoring accuracy and student performance in the postsecondary classroom. Journal of Experimental Education, 74(1), 7-28. https://www.jstor.org/stable/20157410
80. *Nietfeld, J., Cao, L., & Osborne, J. (2006). The effect of distributed monitoring exercises and feedback on performance, monitoring accuracy, and self-efficacy. Metacognition and Learning, 1(2), 159-179. https://doi.org/10.1007/s10409-006-9595-6
81. Nietfeld, J. L., Enders, C. K., & Schraw, G. (2006). A Monte Carlo comparison of measures of relative and absolute monitoring accuracy. Educational and Psychological Measurement, 66(2), 258-271. https://doi.org/10.1177/0013164404273945
82. *Nietfeld, J. L., & Schraw, G. (2002). The effect of knowledge and strategy training on monitoring accuracy. The Journal of Educational Research, 95(3), 131-142. https://doi.org/10.1080/00220670209596583
83. Orwin, R. G. (1983). A fail-safe N for effect size in meta-analysis. Journal of EducationalStatistics, 8(2), 157-159. https://doi.org/10.2307/1164923
84. Palincsar, A. S., & Brown, A. L. (1984). Reciprocal teaching of comprehension-fostering and comprehension-monitoring activities. Cognition and Instruction, 1(2), 117-175. https://doi.org/10.1207/s1532690xci0102_1
85. Panadero, E. (2017). A review of self-regulated learning: Six models and four directions for research. Frontiers in Psychology, 8, 422-428. https://doi.org/10.3389/fpsyg.2017.00422
86. *Pilegard, C., & Fiorella, L. (2016). Helping students help themselves: Generative learning strategies improve middle school students’ self-regulation in a cognitive tutor. Computers in Human Behavior, 65, 121-126. https://doi.org/10.1016/j.chb.2016.08.020
87. Pressley, M., & Harris, K. R. (2006). Cognitive strategies instruction: From basic research to classroom instruction. In P. A. Alexander & P. H. Winne (Eds.), Handbook of educational psychology (pp. 265-286). Lawrence Erl-baum. https://psycnet.apa.org/record/2006-07986-000
88. *Pyc, M. A., Rawson, K. A., & Aschenbrenner, A. J. (2014). Metacogni-tive monitoring during criterion learning: When and why are judgments accurate? Memory & Cognition, 42(6), 886-897. https://doi.org/10.3758/s13421-014-0403-4
89. *Raaijmakers, S. F., Baars, M., Paas, F., Merrienboer, J. J. G., & van Gog, T. (2018). Training self-assessment and task-selection skills to foster selfregulated learning: Do trained skills transfer across domains. Applied Cognitive Psychology, 32(2), 270-277. ? https://doi.org/10.1002/acp.3392
90. Ramsden, P. (1993). Learning to teach in higher education. Studies in Higher Education, 18, 105-111. https://doi.org/10.1080/03075079312 331382498
91. *Redford, J. S., Thiede, K. W., Wiley, J., & Griffin, T. D. (2012). Concept mapping improves metacomprehension accuracy among 7th graders. Learning and Instruction, 22(4), 262-270. https://doi.org/10.1016/j.learninstruc.2011.10.007
92. *Reid, A. J., Morrison, G. R., & Bol, L. (2017). Knowing what you know: Improving metacomprehension and calibration accuracy in digital text. Educational Technology Research and Development, 65(1), 29-45. https://doi.org/10.1007/s11423-016-9454-5
93. Roderer, T., & Roebers, C. M. (2010). Explicit and implicit confidence judgments and developmental differences in metamemory: An eyetracking approach. Metacognition and Learning, 5(3), 229-250. https://doi.org/10.1007/s11409-010-9059-z
94. Roebers, C. M., Schmid, C., & Roderer, T. (2009). Metacognitive monitoring and control processes involved in primary school children’s test performance. The British Journal of Educational Psychology, 79(4), 749-767. https://doi.org/10.1348/978185409X429842
95. Roebers, C. M., & Spiess, M. (2017). The development of metacognitive monitoring and control in second graders: A short-term longitudinal study. Journal of Cognition and Development, 18(1), 110-128. https://doi.org/10.1080/15248372.2016.1157079
96. Roediger, H. L., III., & Karpicke, J. D. (2006). Test-enhanced learning: Taking memory tests improves long-term retention. Psychological Science, 17(3), 249-255. https://doi.org/10.1111/j.1467-9280.2006.01693.x
97. *Roelle, J., Schmidt, E. M., Buchau, A., & Berthold, K. (2017). Effects of informing learners about the dangers of making overconfident judgments of learning. Journal of Educational Psychology, 109(1), 99-117. https://doi.org/10.1037/edu0000132
98. Rosenthal, R. (1979). The “file drawer problem” and tolerance for null results. Psychological Bulletin, 86(3), 638-641. https://doi.org/10.1037/0033-2909.86.3.638
99. *Saenz, G. D., Geraci, L., & Tirso, R. (2019). Improving metacognition: A comparison of interventions. Applied Cognitive Psychology, 33(5), 918-929. https://doi.org/10.1002/acp.3556
100. *Schleinschok, K., Eitel, A., & Scheiter, K. (2017). Do drawing tasks improve monitoring and control during learning from text? Learning and Instruction, 51, 10-25. https://doi.org/10.1016/j.learninstruc.2017.02.002
101. Schmidt, F. L., & Hunter, J. E. (2014). Methods of meta-analysis: Correcting error and bias in research findings. SAGE. https://us.sagepub.com/en-us/nam/methods-of-meta-analysis/book240589
102. *Schnaubert, L., & Bodemer, D. (2017). Prompting and visualising monitoring outcomes: Guiding self-regulatory processes with confidence judgments. Learning and Instruction, 49, 251-262. https://doi.org/10.1016/j.learninstruc.2017.03.004
103. Schneider, W., Vise, M., Lockl, K., & Nelson, T. (2000). Developmental trends in children’s memory monitoring: Evidence from a judgment-of-learning task. Cognitive Development, 15(2), 115-134. https://doi.org/10.1016/S0885-2014(00)00024-1
104. Schraw, G. (2009). Measuring metacognitive judgments. In D. J. Hacker, J. Dunlosky, & A. C. Graesser (Eds.), Handbook of metacognition in education (pp. 415-429). Lawrence Erlbaum. https://doi.org/10.4324/9780203876428
105. Schraw, G., Crippen, K. J., & Hartley, K. (2006). Promoting self-regulation in science education: Metacognition as part of a broader perspective on learning. Research in Science Education, 36(1-2), 111-139. https://doi.org/10.1007/s11165-005-3917-8
106. Schraw, G., & Dennison, R. S. (1994). Assessing metacognitive awareness. Contemporary Educational Psychology, 19(4), 460-475. https://doi.org/10.1006/ceps.1994.1033
107. Schraw, G., Kuch, F., & Gutierrez, A. P. (2013). Measure for measure: Calibrating ten commonly used calibration scores. Learning and Instruction, 24, 48-57. https://doi.org/10.1016/j.learninstruc.2012.08.007
108. Schraw, G., Kuch, F., Gutierrez, A. P., & Richmond, A. S. (2014). Exploring a three-level model of calibration accuracy. Journal of Educational Psychology, 106(4), 1192-1202. https://doi.org/10.1037/a0036653
109. Serra, M. J., & Metcalfe, J. (2009). Effective implementation of metacognition. In D. J. Hacker, J. Dunlosky, & A. C. Graesser (Eds.), Handbook of metacognition in education (pp. 278-298). Lawrence Erlbaum. https://doi.org/10.4324/9780203876428
110. Sharma, M. D., & Bewes, J. (2011). Self-monitoring: Confidence, academic achievement, and gender differences in physics. Journal of Learning Design, 4(3), 1-13. https://doi.org/10.5204/jld.v4i3.76
111. Shiu, L., & Chen, Q. (2013). Self and external monitoring of reading comprehension. Journal of Educational Psychology, 105(1), 78-88. https://doi.org/10.1037/a0029378
112. Soto, C., Gutierrez de Blume, A. P., Carrasco Bernal, M. A., & Contreras Castro, M. A. (2020). The role of metacognitive cues on the comprehension of proficient and poor readers. Journal of Research in Reading, 43(3), 272-289. https://doi.org/10.1111/1467-9817.12303
113. Struyven, K., Dochy, F., Janssens, S., & Gielen, S. (2006). On the dynamics of students’ approaches to learning: The effects of the teaching/learn-ing environment. Learning and Instruction, 16(4), 279-294. https://doi.org/10.1016/j.learninstruc.2006.07.001
114. Tabachnick, B. G., & Fidell, L. S. (2013). Cleaning up your act: Screening data prior to analysis. Using multivariate statistics (6th ed., pp. 676-780). Pearson. https://www.pearson.com/us/higher-education/program/Tabachnick-Using-Multivariate-Statistics-6th-Edition/PGM332849.html
115. *Thiede, K. W., Anderson, M., & Therriault, D. (2003). Accuracy of meta-cognitive monitoring affects learning of texts. Journal of Educational Psychology, 95(1), 66-73. https://doi.org/10.1037/0022-0663.95T.66
116. *Thiede, K. W., & Anderson, M. C. (2003). Summarizing can improve metacomprehension accuracy. Contemporary Educational Psychology, 28(2), 129-160. https://doi.org/10.1016/S0361-476X(02)00011-5
117. *Thiede, K. W., Dunlosky, J., Griffin, T. D., & Wiley, J. (2005). Understanding the delayed-keyword effect on metacomprehension accuracy. Journal of Experimental Psychology: Learning, Memory, and Cognition, 31(6), 1267-1280. https://doi.org/10.1037/0278-7393.31.6T267
118. *Thiede, K. W., Griffin, T. D., Wiley, J., & Anderson, M. C. (2010). Poor metacomprehension accuracy as a result of inappropriate cue use. Discourse Processes, 47(4), 331-362. https://doi.org/10.1080/01638530902959927
119. *Thiede, K. W., Redford, J. S., Wiley, J., & Griffin, T. D. (2012). Elementary school experience with comprehension testing may influence metacomprehension accuracy among seventh and eighth graders. Journal of Educational Psychology, 104(3), 554-564. https://doi.org/10.1037/a0028660
120. *Thomas, A. K., & McDaniel, M. A. (2007). The negative cascade of incongruent generative study-test processing in memory and metacomprehension. Memory & Cognition, 35(4), 668-678. https://doi.org/10.3758/BF03193305
121. van Houten-Schat, M. A., Berkhout, J. J., van Dijk, N., Endedijk, M. D., Jaarsma, A. D. C., & Diemers, A. D. (2018). Self-regulated learning in the clinical context: A systematic review. Medical Education, 52(10), 1008-1015. https://doi.org/10.1111/medu.13615
122. *van Loon, M. H., de Bruin, A. B. H., van Gog, T., van Merrienboer, J. J. G., & Dunlosky, J. (2014). Can students evaluate their understanding of cause-and-effect relations? The effects of diagram completion on monitoring accuracy. Acta Psychologica, 151, 143-154. https://doi.org/10.1016/j.actpsy.2014.06.007
123. *von der Linden, N., Schneider, W., & Roebers, C. (2011). The effects of summary production and encoding condition on children’s metacognitive monitoring. Metacognition and Learning, 6(1), 3-23. https://doi.org/10.1007/s11409-010-9063-3
124. *Was, C. A., Beziat, T. L., & Isaacson, R. M. (2013). Improving metacognition in a college classroom: Does enough practice work? Journal of Research in Education, 23(1), 77-93. https://files.eric.ed.gov/fulltext/EJ1098426.pdf
125. *Wiley, J., Griffin, T. D., Jaeger, A. J., Jarosz, A. F., Cushen, P. J., & Thiede, K. W. (2016). Improving metacomprehension accuracy in an undergraduate course context. Journal of Experimental Psychology: Applied, 22(4), 393-405. https://doi.org/10.1037/xap0000096
126. Winne, P. H., & Hadwin, A. F. (1998). Studying as self-regulated engagement in learning. In D. Hacker, J. Dunlosky, & A. Graesser (Eds.), Metacognition in educational theory and practice (pp. 277-304). Lawrence Erl-baum. https://www.routledge.com/Metacognition-in-Educational-Theory-and-Practice/Hacker-Dunlosky-Graesser/p/book/9780805824827
127. Winne, P. H., & Hadwin, A. F. (2008). The weave of motivation and self-regulated learning. In D. H. Schunk & B. J. Zimmerman (Eds.), Motivation and self-regulated learning: Theory, research, and applications (pp. 297-314). Lawrence Erlbaum. https://www.routledge.com/Motivation-and-Self-Regulated-Learning-Theory-Research-and-Applications/Schunk-Zimmerman/p/book/9780805858983
128. Winne, P. H., & Nesbit, J. C. (2009). Supporting self-regulated learning with cognitive tools. In, D. J. Hacker, J. Dunlosky, & A. C. Graesser, (Eds.), Handbook of metacognition in education (pp. 259-277). Rout-ledge/Taylor & Francis Group. https://doi.org/10.4324/9780203876428
129. *Zawadzka, K., Simkiss, N., & Hanczakowski, M. (2018). Remind me of the context: Memory and metacognition at restudy. Journal of Memory and Language, 101, 1-17. https://doi.org/10.1016Zj.jml.2018.03.001
130. Zimmerman, B. J. (2000). Attaining self-regulation: A social cognitive perspective. In M. Boekaerts, P. R. Pintrich, & M. Zeidner (Eds.), Handbook of selfregulation (pp. 13-39). Academic Press.https://www.elsevier.com/books/handbook-of-self-regulation/boekaerts/978-0-12-109890-2
131. Zimmerman, B. J., & Moylan, A. R. (2009). Self-regulation: Where metacognition and motivation intersect. In D. J. Hacker, J. Dunlosky, & A. C. Graesser (Eds.), Handbook of metacognition in education (pp. 299-315). Routledge. https://doi.org/10.4324/9780203876428