Feedback reduces the metacognitive benefit of tests

Journal of Experimental Psychology: Applied

Volumn 19, Issue 1, 2013, Pages 1-13

  Kornell, Nate ^a   Rhodes, Matthew G ^b  

^a WILLIAMS COLLEGE   (United States)

^b Veterinary Dentistry and Oral Surgery   (United States)

Author keywords

Feedback; Judgment of learning; Learning; Metacognition; Test

Indexed keywords

ADAPTIVE BEHAVIOR; ADOLESCENT; ADULT; AGED; ARTICLE; COGNITION; DECISION MAKING; EDUCATION; FEMALE; HUMAN; LEARNING; MALE; MEMORY; MIDDLE AGED; YOUNG ADULT;

ADOLESCENT; ADULT; AGED; COGNITION; EDUCATIONAL MEASUREMENT; FEEDBACK, PSYCHOLOGICAL; FEMALE; HUMANS; JUDGMENT; LEARNING; MALE; MEMORY; MIDDLE AGED; YOUNG ADULT;

EID: 84876111352     PISSN: 1076898X     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0032147     Document Type: Article

References (56)

1. Ariel, R., & Dunlosky, J. (2011). The sensitivity of judgments-of-learning resolution to past test performance, new learning, and forgetting. Memory & Cognition, 39, 171-184. doi:10.3758/s13421-010-0002-y
2. Ariel, R., Dunlosky, J., & Bailey, H. (2009). Agenda-based regulation of study-time allocation: When agendas override item-based monitoring. Journal of Experimental Psychology: General, 138, 432-447. doi: 10.1037/a0015928
3. Buhrmester, M., Kwang, T., & Gosling, S. D. (2011). Amazon's Mechanical Turk: A new source of inexpensive, yet high-quality, data? Perspectives on Psychological Science, 6, 3-5. doi:10.1177/ 1745691610393980
4. Castel, A. D., Rhodes, M. G., & Friedman, M. C. (2013). Predicting memory benefits in the production effect: The use and misuse of selfgenerated distinctive cues when making judgments of learning. Memory & Cognition, 41, 28-35. doi:10.3758/s13421-012-0249-6
5. Dunlosky, J., Hartwig, M. K., Rawson, K. A., & Lipko, A. R. (2011). Improving college students' evaluation of text learning using idea-unit standards. Quarterly Journal of Experimental Psychology, 64, 467-484. doi:10.1080/17470218.2010.502239
6. Dunlosky, J., & Nelson, T. O. (1992). Importance of the kind of cue for judgments of learning (JOL) and the delayed JOL effect. Memory & Cognition, 20, 374-380. doi:10.3758/BF03210921
7. Dunlosky, J., & Nelson, T. O. (1994). Does the sensitivity of judgments of learning (JOLs) to the effects of various study activities depend on when the JOLs occur? Journal of Memory and Language, 33, 545-565. doi:10.1006/jmla.1994.1026
8. Finn, B. (2008). Framing effects on metacognitive monitoring and control. Memory & Cognition, 36, 813-821. doi:10.3758/MC.36.4.813
9. Finn, B., & Metcalfe, J. (2007). The role of memory for past test in the underconfidence with practice effect. Journal of Experimental Psychology: Learning, Memory, and Cognition, 33, 238-244. doi:10.1037/ 0278-7393.33.1.238
10. Finn, B., & Metcalfe, J. (2008). Judgments of learning are influenced by memory for past test. Journal of Memory and Language, 58, 19-34. doi:10.1016/j.jml.2007.03.006
11. Glenberg, A. M., Wilkinson, A. C., & Epstein, W. (1982). The illusion of knowing: Failure in the self-assessment of comprehension. Memory & Cognition, 10, 597-602. doi:10.3758/BF03202442
12. Grimaldi, P. J., & Karpicke, J. D. (2012). When and why do retrieval attempts enhance subsequent encoding? Memory & Cognition, 40, 505- 513. doi:10.3758/s13421-011-0174-0
13. Hartwig, M. K., & Dunlosky, J. D. (2012). Study strategies of college students: Are self-testing and scheduling related to achievement? Psychonomic Bulletin & Review, 19, 126-134. doi:10.3758/s13423-011- 0181-y
14. Hays, M. J., Kornell, N., & Bjork, R. A. (2010). The costs and benefits of providing feedback during learning. Psychonomic Bulletin & Review, 17, 797-801. doi:10.3758/PBR.17.6.797
15. Jönsson, F. U., Hedner, M., & Olsson, M. J. (2012). The testing effect as a function of explicit testing instructions and judgments of learning. Experimental Psychology, 59, 251-257. doi:10.1027/1618-3169/ a000150
16. Karpicke, J. (2009). Metacognitive control and strategy selection: Deciding to practice retrieval during learning. Journal of Experimental Psychology: General, 138, 469-486. doi:10.1037/a0017341
17. Kimball, D. R., & Metcalfe, J. (2003). Delaying judgments of learning affects memory, not metamemory. Memory & Cognition, 31, 918-929. doi:10.3758/BF03196445
18. King, J. F., Zechmeister, E. B., & Shaughnessy, J. J. (1980). Judgments of knowing: The influence of retrieval practice. The American Journal of Psychology, 93, 329-343. doi:10.2307/1422236
19. Kittur, A., Chi, E. H., & Suh, B. (2008). Crowdsourcing user studies with Mechanical Turk. Proceeding of the twenty-sixth annual CHI conference
20. Koriat, A. (1997). Monitoring one's own knowledge during study: A cue-utilization approach to judgments of learning. Journal of Experimental Psychology: General, 126, 349-370. doi:10.1037/0096-3445 .126.4.349
21. Koriat, A. (1998). Illusions of knowing: The link between knowledge and metaknowledge. In V. Y. Yzerbyt & G. Lories (Eds.), Metacognition cognitive and social dimensions (pp. 16-34). London, United Kingdom: Sage.
22. Koriat, A., Bjork, R. A., Sheffer, L., & Bar, S. K. (2004). Predicting one's own forgetting: The role of experience-based and theory-based processes. Journal of Experimental Psychology: General, 133, 643-656. doi:10.1037/0096-3445.133.4.643
23. Koriat, A., Ma'ayan, H., & Nussinson, R. (2006). The intricate relationships between monitoring and control in metacognition: Lessons for the cause-and-effect relation between subjective experience and behavior. Journal of Experimental Psychology: General, 135, 36-69. doi: 10.1037/0096-3445.135.1.36
24. Kornell, N. (2012). A stability bias in human memory. In N. M. Seel (Ed.), Encyclopedia of the sciences of learning (pp. 4-7). Boston, MA: Springer. doi:10.1007/978-1-4419-1428-6
25. Kornell, N., & Bjork, R. A. (2007). The promise and perils of selfregulated study. Psychonomic Bulletin & Review, 14, 219-224. doi: 10.3758/BF03194055
26. Kornell, N., & Bjork, R. A. (2008). Optimizing self-regulated study: The benefits-and costs-of dropping flashcards. Memory, 16, 125-136. doi: 10.1080/09658210701763899
27. Kornell, N., & Bjork, R. A. (2009). A stability bias in human memory: Overestimating remembering and underestimating learning. Journal of Experimental Psychology: General, 138, 449-468. doi:10.1037/ a0017350
28. Kornell, N., Bjork, R. A., & Garcia, M. A. (2011). Why tests appear to prevent forgetting: A distribution-based bifurcation model. Journal of Memory and Language, 65, 85-97. doi:10.1016/j.jml.2011.04.002
29. Kornell, N., Hays, M. J., & Bjork, R. A. (2009). Unsuccessful retrieval attempts enhance subsequent learning. Journal of Experimental Psychology: Learning, Memory, & Cognition, 35, 989-998. doi:10.1037/ a0015729
30. Kornell, N., & Metcalfe, J. (2006). Study efficacy and the region of proximal learning framework. Journal of Experimental Psychology: Learning, Memory, and Cognition, 32, 609-622. doi:10.1037/0278- 7393.32.3.609
31. Kornell, N., & Son, L. K. (2009). Learners' choices and beliefs about self-testing. Memory, 17, 493-501. doi:10.1080/09658210902832915
32. Lipko, A. R., Dunlosky, J., Hartwig, M. K., Rawson, K. A., Swan, K., & Cook, D. (2009). Using standards to improve middle school students' accuracy at evaluating the quality of their recall. Journal of Experimental Psychology: Applied, 15, 307-318. doi:10.1037/a0017599
33. MacLeod, C. M., Gopie, N., Hourihan, K. L., Neary, K. R., & Ozubko, J. D. (2010). The production effect: Delineation of a phenomenon. Journal of Experimental Psychology: Learning, Memory, and Cognition, 36, 671-685. doi:10.1037/a0018785
34. Mason, W., & Suri, S. (2012). Conducting behavioral research on Amazon's Mechanical Turk. Behavior Research Methods, 44, 1-23. doi: 10.3758/s13428-011-0124-6
35. Nelson, D. L., McEvoy, C. L., & Schreiber, T. A. (1998). The University of South Florida word association, rhyme, and word fragment norms. Retrieved from http://w3.usf.edu/FreeAssociation/
36. Nelson, T. O. (1984). A comparison of current measures of the accuracy of feeling-of-knowing predictions. Psychological Bulletin, 95, 109-133. doi:10.1037/0033-2909.95.1.109
37. Nelson, T. O. (1996). Consciousness and metacognition. American Psychologist, 51, 102-116. doi:10.1037/0003-066X.51.2.102
38. Nelson, T. O., & Dunlosky, J. (1991). When people's judgments of learning (JOLs) are extremely accurate at predicting subsequent recall: The "delayed-JOL effect". Psychological Science, 2, 267-270. doi: 10.1111/j.1467-9280.1991.tb00147.x
39. Nelson, T. O., & Narens, L. (1990). Metamemory: A theoretical framework and new findings. In G. H. Bower (Ed.), The psychology of learning and motivation (Vol. 26, pp.125-173). New York, NY: Academic Press. doi:10.1016/S0079-7421(08)60053-5
40. Nelson, T. O., & Narens, L. (1994). Why investigate metacognition? In J. Metcalfe & A. P. Shimamura (Eds.), Metacognition: Knowing about knowing (pp. 1-25). Cambridge, MA: MIT Press.
41. Pashler, H., Cepeda, N. J., Wixted, J. T., & Rohrer, D. (2005). When does feedback facilitate learning of words? Journal of Experimental Psychology: Learning, Memory, and Cognition, 31, 3-8. doi:10.1037/0278- 7393.31.1.3
42. Rawson, K. A., & Dunlosky, J. (2007). Improving students' self-evaluation of learning for key concepts in textbook materials. European Journal of Cognitive Psychology, 19, 559-579. doi:10.1080/09541440701326022 Rhodes, M. G., & Castel, A. D. (2009). Metacognitive illusions for auditory information: Effects on monitoring and control. Psychonomic Bulletin & Review, 16, 550-554. doi:10.3758/PBR.16.3.550
43. Rhodes, M. G., & Tauber, S. K. (2011a). The influence of delaying Judgments of Learning (JOLs) on metacognitive accuracy: A meta-analytic review. Psychological Bulletin, 137, 131-148. doi:10.1037/a0021705
44. Rhodes, M. G., & Tauber, S. K. (2011b). Eliminating the delayed JOL effect: The influence of the veracity of retrieved information on metacognitive accuracy. Memory, 19, 853-870. doi:10.1080/09658211.2011 .613841
45. Richland, L. E., Kornell, N., & Kao, L. S. (2009). The pretesting effect: Do unsuccessful retrieval attempts enhance learning? Journal of Experimental Psychology: Applied, 15, 243-257. doi:10.1037/a0016496
46. Roediger, H. L., III, & Butler, A. C. (2011). The critical role of retrieval practice in long-term retention. Trends in Cognitive Sciences, 15, 20-27. doi:10.1016/j.tics.2010.09.003
47. Roediger, H. L., & Karpicke, J. D. (2006a). Test-enhanced learning: Taking memory tests improves long-term retention. Psychological Science, 17, 249-255. doi:10.1111/j.1467-9280.2006.01693.x
48. Roediger, H. L., & Karpicke, J. D. (2006b). The power of testing memory: Basic research and implications for educational practice. Perspectives on Psychological Science, 1, 181-210. doi:10.1111/j.1745-6916.2006 .00012.x
49. Son, L. K., & Metcalfe, J. (2000). Metacognitive and control strategies in study-time allocation. Journal of Experimental Psychology: Learning, Memory, and Cognition, 26, 204-221. doi:10.1037/0278- 7393.26.1.204
50. Spellman, B. A., & Bjork, R. A. (1992). When predictions create reality: Judgments of learning may alter what they are intended to assess. Psychological Science, 3, 315-316. doi:10.1111/j.1467-9280.1992 .tb00680.x
51. Spellman, B. A., Bloomfield, A., & Bjork, R. A. (2008). Measuring memory and metamemory: Theoretical and statistical problems with assessing learning (in general) and using gamma (in particular) to do so. In J. Dunlosky & R. A. Bjork (Eds.), Handbook of metamemory and memory (pp. 95-114). New York, NY: Psychology Press.
52. Sprouse, J. (2011). A validation of Amazon Mechanical Turk for the collection of acceptability judgments in linguistic theory. Behavior Research Methods, 43, 155-167. doi:10.3758/s13428-010-0039-7
53. Sundqvist, M. L., Todorov, I., Kubik, V., & Jönsson, F. U. (2012). Study for now, but judge for later: Delayed judgments of learning promote long-term retention. Scandinavian Journal of Psychology, 53, 450-454. doi:10.1111/j.1467-9450.2012.00968.x
54. Tauber, S. K., & Rhodes, M. G. (2012). Multiple bases for young and older adults' Judgments-of-learning (JOLs) in multitrial learning. Psychology and Aging, 27, 474-483. doi:10.1037/a0025246
55. Thiede, K. W., & Dunlosky, J. (1999). Toward a general model of self-regulated study: An analysis of selection of items for study and self-paced study time. Journal of Experimental Psychology: Learning, Memory, and Cognition, 25, 1024-1037. doi:10.1037/0278-7393 .25.4.1024
56. Weaver III, C. A., & Kelemen, W. L. (2003). Processing similarity does not improve metamemory: Evidence against transfer-appropriate monitoring. Journal of Experimental Psychology: Learning, Memory, and Cognition, 29, 1058-1065. doi:10.1037/0278-7393.29.6.1058