Metacognition of the testing effect: Guiding learners to predict the benefits of retrieval

Memory and Cognition

Volumn 41, Issue 3, 2013, Pages 429-442

  Tullis, Jonathan G ^a   Finley, Jason R ^a,b   Benjamin, Aaron S ^a  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

^b WASHINGTON UNIVERSITY   (United States)

Author keywords

Guided instruction; JOLs; Metacognition; Monitoring; Testing effect

Indexed keywords

ADULT; ARTICLE; ASSOCIATION; DECISION MAKING; FORECASTING; HUMAN; LEARNING; PHYSIOLOGY; RECALL; TIME; YOUNG ADULT;

ADULT; CUES; FORECASTING; HUMANS; JUDGMENT; LEARNING; MENTAL RECALL; TIME FACTORS; YOUNG ADULT;

EID: 84875036236     PISSN: 0090502X     EISSN: 15325946     Source Type: Journal    
DOI: 10.3758/s13421-012-0274-5     Document Type: Article

References (55)

1. Agarwal, P. K., Karpicke, J. D., Kang, S. H. K., Roediger, H. L., & McDermott, K. B. (2008). Examining the testing effect with open- and closed-book tests. Applied Cognitive Psychology, 22, 861-876.
2. Atkinson, R. C. (1972). Optimizing the learning of a second-language vocabulary. Journal of Experimental Psychology, 96, 124-129.
3. Baddeley, A. D., & Longman, D. J. A. (1978). The influence of length and frequency of training session on the rate of learning to type. Ergonomics, 21, 627-635.
4. Begg, I., Duft, S., Lalonde, P., Melnick, R., & Sanvito, J. (1989). Memory predictions are based on ease of processing. Journal of Memory and Language, 28, 610-632.
5. Benjamin, A. S. (2003). Predicting and postdicting the effects of word frequency on memory. Memory & Cognition, 31, 297-305.
6. Benjamin, A. S., & Bjork, R. A. (1996). Retrieval fluency as a metacognitive index. In L. Reder (Ed.), Implicit Memory and Metacognition. Mahwah: Erlbaum.
7. Benjamin, A. S., Bjork, R. A., & Schwartz, B. L. (1998). The mismeasure of memory: When retrieval fluency is misleading as a metamnemonic index. Journal of Experimental Psychology: General, 127, 55-68.
8. Benjamin, A. S., & Diaz, M. (2008). Measurement of relative metamnemonic accuracy. In J. Dunlosky & R. A. Bjork (Eds.), Handbook of Memory and Metamemory (pp. 73-94). New York: Psychology Press.
9. Bieman-Copland, S., & Charness, N. (1994). Memory knowledge and memory monitoring in adulthood. Psychology & Aging, 9, 287-302.
10. Bjork, R. A. (1999). Assessing our own competence: Heuristics and illusions. In D. Gopher & A. Koriat (Eds.), Attention and performance XVII. Cognitive regulation of performance: Interaction of theory and application (pp. 435-459). Cambridge: MIT Press.
11. Brainard, D. H. (1997). The psychophysics toolbox. Spatial vision, 10(4), 433-436.
12. Brigham, M. C., & Pressley, M. (1988). Cognitive monitoring and strategy choice in younger and older adults. Psychology & Aging, 3, 249-257.
13. Carroll, M., Nelson, T. O., & Kirwan, A. (1997). Tradeoff of semantic relatedness and degree of overlearning: Differential effects on metamemory and on long-term retention. Acta Pscyhologica, 95, 239-253.
14. Coltheart, M. (1981). The MRC psycholinguistic database. The Quarterly Journal of Experimental Psychology A: Human Experimental Psychology, 33(4), 497-505.
15. deWinstanley, P. A., & Bjork, E. L. (2004). Processing strategies and the generation effect: Implications for making a better reader. Memory & cognition, 32(6), 945-955.
16. Diaz, M., & Benjamin, A. S. (2011). Effects of proactive interference (PI) and release from PI on judgments of learning. Memory & Cognition, 39, 196-203.
17. Dunlosky, J., & Nelson, T. O. (1992). Importance of the kind of cue for judgments of learning (JOL) and the delayed-JOL effect. Memory & Cognition, 20, 374-380.
18. Dunlosky, J., & Nelson, T. O. (1994). Does the sensitivity of judgments of learning (JOLs) to the effects of various study activities depend upon when the JOLs occur? Journal of Memory and Language, 33, 545-565.
19. Dunlosky, J., & Hertzog, C. (2000). Updating knowledge about encoding strategies: A componential analysis of learning about strategy effectiveness from task experience. Psychology and Aging, 15, 462-474.
20. Dunlosky, J., & Theide, K. W. (1998). What makes people study more? An evaluation of factors that affect self-paced study. Acta Psychologica, 98, 37-56.
21. Einstein, G. O., Mullet, H. G., & Harrison, T. L. (2012). The testing effect: Illustrating a fundamental concept and changing study strategies. Teaching of Psychology, 39, 190-193.
22. Finley, J. R., Tullis, J. G., & Benjamin, A. S. (2009). Metacognitive control of learning and remembering. In M. S. Khine & I. M. Saleh (Eds.), New Science of Learning: Cognition, Computers and Collaboration in Education. New York: Springer Science & Business Media.
23. Finn, B., & Metcalfe, J. (2008). Judgments of learning are influenced by memory for past test. Journal of Memory and Language, 58, 19-34.
24. Hartwig, M. K., & Dunlosky, J. (2012). Study strategies of college students: Are self-testing and scheduling related to achievement? Psychonomic Bulletin & Review, 19, 126-134.
25. Jacoby, L. L., & Kelley, C. M. (1987). Unconscious influence of memory for a prior event. Personality and Social Psychology Bulletin, 13, 314-336.
26. Karpicke, J. D. (2009). Metacognitive control and strategy selection: Deciding to practice retrieval during learning. Journal of Experimental Psychology: General, 138, 469-486.
27. Karpicke, J. D., Butler, A. C., & Roediger, H. L. (2009). Metacognitive strategies in student learning: Do students practice retrieval when they study on their own? Memory, 17, 471-479.
28. Karpicke, J. D., & Roediger, H. L. (2008). The critical importance of retrieval for learning. Science, 319, 966-968.
29. Karpicke, J. D., & Zaromb, F. M. (2010). Retrieval mode distinguishes the testing effect from the generation effect. Journal of Memory and Language, 62, 227-239.
30. Kelley, C. M., & Jacoby, L. L. (1996). Adult egocentrism: Subjective experience versus analytic bases for judgment. Journal of Memory and Language, 35, 157-175.
31. Klahr, D., & Nigam, M. (2004). The equivalence of learning paths in early science instruction: Effects of direct instruction and discovery learning. Psychological Science, 15, 661-667.
32. Koriat, A. (1997). Monitoring one's own knowledge during study: A cue utilization approach to judgments of learning. Journal of Experimental Psychology: General, 126, 549-570.
33. Kornell, N., & Bjork, R. A. (2007). The promise and perils of self-regulated study. Psychonomic Bulletin & Review, 14, 219-224.
34. Kornell, N., & Bjork, R. A. (2008). Optimizing self-regulated study: The benefits and costs of dropping flashcards. Memory, 16, 125-136.
35. Kornell, N., & Son, L. K. (2009). Learners' choices and beliefs about self-testing. Memory, 17, 493-501.
36. Kucera, H., & Francs, W. N. (1967). Computational analysis of present-day American English. Providence: Brown University Press.
37. Maxwell, S. E., & Delaney, H. D. (2004). Designing experiments and analyzing data: A model comparison perspective (2nd ed.). Mahwah: Lawrence Erlbaum Associates.
38. Mazzoni, G., & Nelson, T. O. (1995). Judgments of learning are affected by the kind of encoding in ways that cannot be attributed to the level of recall. Journal of Experimental Psychology: Learning, Memory, and Cognition, 21, 1263-1274.
39. Metcalfe, J. (2009). Metacognitive judgments and control of study. Current Directions in Psychological Science, 18, 159-163.
40. Metcalfe, J., & Finn, B. (2008). Evidence that judgments of learning are causally related to study choice. Psychonomic Bulletin & Review, 15, 174-179.
41. Metcalfe, J., Schwartz, B. L., & Joaquim, S. G. (1993). The cue-familiarity heuristic in metacognition. Journal of Experimental Psychology: Learning, Memory, & Cognition, 19, 851-861.
42. Nelson, T. O., & Dunlosky, J. (1991). When people's judgments of learning are extremely accurate at predicting subsequent recall: The delayed-JOL effect. Psychological Science, 2, 267-270.
43. Nelson, D. L., McEvoy, C. L. & Schreiber, T. A. (1998). The University of South Florida word association, rhyme, and word fragment norms. http://www. usf. edu/FreeAssociation/.
44. Olejnik, S., & Algina, J. (2000). Measures of effect size for comparative studies: Applications, interpretations, and limitations. Contemporary Educational Psychology, 25, 241-286.
45. Price, J., Hertzog, C., & Dunlosky, J. (2008). Age-related differences in strategy knowledge updating: Blocked testing produces greater improvements in metacognitive accuracy for younger than older adults. Aging, Neuropsychology, and Cognition, 15, 601-626.
46. Roediger, H. L., III, & Karpicke, J. D. (2006). Test-enhanced learning: Taking memory tests improves long-term retention. Psychological Science, 17, 249-255.
47. Schaughnessy, J. J. (1981). Memory monitoring accuracy and modification of rehearsal strategies. Journal of Verbal Learning and Verbal Behavior, 20, 216-230.
48. Shaw, R. J., & Craik, F. I. M. (1989). Age differences in predictions and performance on a cued recall task. Psychology and Aging, 4, 131-135.
49. Son, L. K., & Kornell, N. (2008). Research on the allocation of study time: Studies from 1890 to the present (and beyond). In J. Dunlosky & R. A. Bjork (Eds.), A Handbook of Memory and Metamemory (pp. 333-351). Hillsdale: Psychology Press.
50. Sweller, J., Ayres, P., & Kalyuga, S. (2011). Cognitive Load Theory. New York: Springer.
51. Thiede, K. W., Anderson, M. C. M., & Therriault, D. (2003a). Accuracy of metacognitive monitoring affects learning of texts. Journal of Educational Psychology, 95, 66-73.
52. Tullis, J. G., & Benjamin, A. S. (2011a). On the effectiveness of self-paced learning. Journal of Memory and Language, 64, 109-118.
53. Tullis, J. G., & Benjamin, A. S. (2011). The effectiveness of updating metacognitive knowledge in the elderly: Evidence from metamnemonic judgments of word frequency. Psychology and Aging. Advance online publication. doi: 10. 1037/a0025838.
54. Wissman, K. T., Rawson, K. A., & Pyc, M. A. (2012). How and when do students use flashcards? Memory, 20, 568-579.
55. Zechmeister, E. B., & Shaughnessy, J. J. (1980). When you know that you know and when you think that you know but you don't. Bulletin of the Psychonomic Society, 15, 41-44.