The critical role of retrieval practice in long-term retention

Trends in Cognitive Sciences

Volumn 15, Issue 1, 2011, Pages 20-27

  Roediger, Henry L ^a   Butler, Andrew C ^b  

^a WASHINGTON UNIVERSITY   (United States)

^b DUKE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

LONG-TERM RETENTION;

CLINICAL PRACTICE; DOPAMINERGIC NERVE CELL; EDUCATION; FEEDBACK SYSTEM; HIPPOCAMPUS; HUMAN; INFORMATION RETRIEVAL; LEARNING; LEARNING TEST; LONG TERM MEMORY; MEDICAL EDUCATION; MEMORY CONSOLIDATION; MENTAL TEST; PSYCHOPHYSIOLOGY; READING; RECALL; REINFORCEMENT; REVIEW; SHORT TERM MEMORY; VENTRAL TEGMENTUM;

CUES; EDUCATIONAL MEASUREMENT; HUMANS; KNOWLEDGE OF RESULTS (PSYCHOLOGY); MEMORY; NEUROPSYCHOLOGICAL TESTS; PRACTICE (PSYCHOLOGY); RETENTION (PSYCHOLOGY); TIME FACTORS;

EID: 78650732668     PISSN: 13646613     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.tics.2010.09.003     Document Type: Review

References (95)

1. James W. The Principles of Psychology 1890, Holt.
2. Estes W.K. Learning theory and the new 'mental chemistry'. Psychol. Rev. 1960, 67:207-223.
3. Postman L. One-trial learning. Verbal Behavior and Learning: Problems and Processes 1963, 295-335. McGraw-Hill. C.N. Cofer, B.S. Musgrave (Eds.).
4. Rock I. The role of repetition in associative learning. Am. J. Psychol. 1957, 70:186-193.
5. Underwood B.J., Keppel G. One-trial learning?. J. Verb. Learn. Verb. Behav. 1962, 1:1-13.
6. Roediger H.L., Karpicke J.D. The power of testing memory: basic research and implications for educational practice. Persp. Psychol. Sci. 2006, 1:181-210.
7. Abbott E.E. On the analysis of the factors of recall in the learning process. Psychol. Monogr. 1909, 11:159-177.
8. Marsh E.J., et al. The memorial consequences of multiple-choice testing. Psychonom. Bull. Rev. 2007, 14:194-199.
9. McDaniel M.A., et al. Generalizing test-enhanced learning from the laboratory to the classroom. Psychonom. Bull. Rev. 2007, 14:200-206.
10. Pashler H., et al. Enhancing learning and retarding forgetting: choices and consequences. Psychonom. Bull. Rev. 2007, 14:187-193.
11. Karpicke J.D., Roediger H.L. The critical importance of retrieval for learning. Science 2008, 15:966-968.
12. Carpenter S.K., et al. The effects of tests on learning and forgetting. Mem. Cogn. 2008, 36:438-448.
13. Kuo T., Hirshman E. Investigations of the testing effect. Am. J. Psychol. 1996, 109:451-464.
14. Roediger H.L., Karpicke J.D. Test-enhanced learning: taking memory tests improves long-term retention. Psychol. Sci. 2006, 17:249-255.
15. Toppino T.C., Cohen M.S. The testing effect and the retention interval: questions and answers. Exp. Psychol. 2009, 56:252-257.
16. Wheeler M.A., et al. Different rates of forgetting following study versus test trials. Memory 2003, 11:571-580.
17. Craik F.I.M., Watkins M.J. The role of rehearsal in short-term memory. J. Verb. Learn. Verb. Behav. 1973, 12:599-607.
18. Pyc M.A., Rawson K.A. Examining the efficiency of schedules of distributed retrieval practice. Mem. Cogn. 2007, 35:1917-1927.
19. Kornell N., Bjork R.A. Optimising self-regulated study: the benefits - and costs - of dropping flashcards. Memory 2008, 16:125-136.
20. McDaniel M.A., Butler A.C. A contextual framework for understanding when difficulties are desirable. Successful Remembering and Successful Forgetting: Essays in Honor of Robert A. Bjork 2010, 175-199. Psychology Press. A.S. Benjamin (Ed.).
21. Pyc M.A., Rawson K.A. Testing the retrieval effort hypothesis: does greater difficulty correctly recalling information lead to higher levels of memory?. J. Mem. Lang. 2009, 60:437-447.
22. Carpenter S.K. Cue strength as a moderator of the testing effect: the benefits of elaborative retrieval. J. Exp. Psychol. Learn. Mem. Cogn. 2009, 35:1563-1569.
23. Carpenter S.K., DeLosh E.L. Impoverished cue support enhances subsequent retention: support for the elaborative retrieval explanation of the testing effect. Mem. Cogn. 2006, 34:268-276.
24. Butler A.C., Roediger H.L. Testing improves long-term retention in a simulated classroom setting. Eur. J. Cogn. Psychol. 2007, 19:514-527.
25. Hogan R.M., Kintsch W. Differential effects of study and test trials on long-term recognition and recall. J. Verb. Learn. Verb. Behav. 1971, 10:562-567.
26. Wheeler M.A., Roediger H.L. Disparate effects of repeated testing: reconciling Ballard's (1913) and Bartlett's (1932) results. Psychol. Sci. 1992, 3:240-245.
27. Skinner B.F. The science of learning and the art of teaching. Harv. Educ. Rev. 1954, 24:86-97.
28. Baddeley A.D., Wilson B.A. When implicit learning fails: amnesia and the problem of error elimination. Neuropsychologia 1994, 32:53-68.
29. Landauer T.K., Bjork R.A. Optimum rehearsal patterns and name learning. Practical Aspects of Memory 1978, 625-632. Academic Press. M.M. Gruneberg (Ed.).
30. Skinner B.F. Science and Human Behavior 1953, Macmillan.
31. Cull W.L. Untangling the benefits of multiple study opportunities and repeated testing for cued recall. Appl. Cogn. Psychol. 2000, 14:215-235.
32. Cull W.L., et al. Expanding understanding of the expanding-pattern-of-retrieval mnemonic: toward confidence in applicability. J. Exp. Psychol. Appl. 1996, 2:365-378.
33. Balota D.A., et al. Is expanded retrieval practice a superior form of spaced retrieval? A critical review of the extant literature. The Foundations of Remembering: Essays in Honor of Henry L. Roediger, III 2007, 83-106. Psychology Press. J.S. Nairne (Ed.).
34. Karpicke J.D., Roediger H.L. Expanding retrieval practice promotes short-term retention, but equally spaced retrieval enhances long-term retention. J. Exp. Psychol. Learn. Mem. Cogn. 2007, 33:704-719.
35. Logan J.M., Balota D.A. Expanded vs. equal interval spaced retrieval practice: exploration of schedule of spacing and retention interval in younger and older adults. Aging Neuropsychol. Cogn. 2008, 15:257-280.
36. Roediger H.L., Karpicke J.D. Intricacies of spaced retrieval: a resolution. Successful Remembering and Successful Forgetting: Essays in Honor of Robert A. Bjork 2010, Psychology Press, pp. 23-47. A.S. Benjamin (Ed.).
37. Pashler H., et al. Is temporal spacing of tests helpful even when it inflates error rates? J. Exp. Psychol. Learn. Mem. Cogn. 2003, 29:1051-1057.
38. Bangert-Drowns R.L., et al. The instructional effect of feedback in test-like events. Rev. Educ. Res. 1991, 61:213-238.
39. Kulhavy R.W., Stock W.A. Feedback in written instruction: the place of response certitude. Educ. Psychol. Rev. 1989, 1:279-308.
40. Pashler H., et al. When does feedback facilitate learning of words?. J. Exp. Psychol. Learn. Mem. Cogn. 2005, 31:3-8.
41. Butler A.C., et al. Correcting a meta-cognitive error: feedback enhances retention of low confidence correct responses. J. Exp. Psychol. Learn. Mem. Cogn. 2008, 34:918-928.
42. Kang S.H.K., et al. Test format and corrective feedback modulate the effect of testing on memory retention. Eur. J. Cogn. Psychol. 2007, 19:528-558.
43. Butler A.C., et al. When additional multiple-choice lures aid versus hinder later memory. Appl. Cogn. Psychol. 2006, 20:941-956.
44. Roediger H.L., Marsh E.J. The positive and negative consequences of multiple-choice testing. J. Exp. Psychol. Learn. Mem. Cogn. 2005, 31:1155-1159.
45. Marsh E.J., et al. Memorial consequences of answering SAT II questions. J. Exp. Psychol. Appl. 2009, 15:1-11.
46. Butler A.C., Roediger H.L. Feedback enhances the positive effects and reduces the negative effects of multiple-choice testing. Mem. Cogn. 2008, 36:604-616.
47. Kulik J.A., Kulik C.C. Timing of feedback and verbal learning. Rev. Educ. Res. 1988, 58:79-97.
48. Butler A.C., et al. The effect of type and timing of feedback on learning from multiple-choice tests. J. Exp. Psychol. Appl. 2007, 13:273-281.
49. Kulhavy R.W., Anderson R.C. Delay-retention effect with multiple-choice tests. J. Educ. Psychol. 1972, 63:505-512.
50. Metcalfe J., et al. Delayed versus immediate feedback in children's and adults' vocabulary learning. Mem. Cogn. 2009, 37:1077-1087.
51. Smith T.A., Kimball D.R. Learning from feedback: spacing and the delay-retention effect. J. Exp. Psychol. Learn. Mem. Cogn. 2010, 36:80-95.
52. Cepeda N.J., et al. Distributed practice in verbal recall tasks: a review and quantitative synthesis. Psychol. Bull. 2006, 132:354-380.
53. Cepeda N.J., et al. Spacing effect in learning: a temporal ridgeline of optimal retention. Psychol. Sci. 2008, 19:1095-1102.
54. Melton A.W. The situation with respect to the spacing of repetitions and memory. J. Verb. Learn. Verb. Behav. 1970, 9:596-606.
55. Madigan S.A. Intraserial repetition and coding processes in free recall. J. Verb. Learn. Verb. Behav. 1969, 8:828-835.
56. Barnett S.M., Ceci S.J. When and where do we apply what we learn? A taxonomy for far transfer. Psychol. Bull. 2002, 128:612-637.
57. Johnson C.I., Mayer R.E. A testing effect with multimedia learning. J. Educ. Psychol. 2009, 101:621-629.
58. McDaniel M.A., et al. The read-recite-review study strategy: effective and portable. Psychol. Sci. 2009, 20:516-522.
59. Rohrer D., et al. Tests enhance the transfer of learning. J. Exp. Psychol. Learn. Mem. Cogn. 2010, 36:233-239.
60. Butler A.C. Repeated testing produces superior transfer of learning relative to repeated studying. J. Exp. Psychol. Learn. Mem. Cogn. 2010, 36:1118-1133.
61. Callender A.A., McDaniel M.A. The limited benefits of rereading educational texts. Contemp. Educ. Psychol. 2009, 34:30-41.
62. Slamecka N.J., Katsaiti L.T. Normal forgetting of verbal lists as a function of prior testing. J. Exp. Psychol. Learn. Mem. Cogn. 1988, 14:716-727.
63. Thompson C.P., et al. How recall facilitates subsequent recall: a reappraisal. J. Exp. Psychol. Hum. Learn. Mem. 1978, 4:210-221.
64. Glover J.A. The "testing" phenomenon: not gone but nearly forgotten. J. Educ. Psychol. 1989, 81:392-399.
65. Carrier M., Pashler H. The influence of retrieval on retention. Mem. Cogn. 1992, 20:633-642.
66. Bjork R.A. Retrieval as a memory modifier: an interpretation of negative recency and related phenomena. Information Processing and Cognition 1975, 123-144. Wiley. R.L. Solso (Ed.).
67. McDaniel M.A., Masson M.E.J. Altering memory representations through retrieval. J. Exp. Psychol. Learn. Mem. Cogn. 1985, 11:371-385.
68. Gardiner J.M., et al. Retrieval difficulty and subsequent recall. Mem. Cogn. 1973, 1:213-216.
69. Morris C.D., et al. Levels of processing versus transfer-appropriate processing. J. Verb. Learn. Verb. Behav. 1977, 16:519-533.
70. Roediger H.L., et al. Processing approaches to cognition: the impetus from the levels of processing framework. Memory 2002, 10:319-332.
71. Bjork, R.A. and Bjork, E.L. (1992) A new theory of disuse and an old theory of stimulus fluctuation. In From Learning Processes to Cognitive Processes: Essays in Honor of William K. Estes (Vol. 2) (Healy, A. et al., eds), pp. 35-67, Erlbaum.
72. Pavlik P.I. Understanding and applying the dynamics of test practice and study practice. Instruct. Sci. 2007, 35:407-441.
73. Dudai Y. The neurobiology of consolidations, or, how stable is the engram?. Annu. Rev. Psychol. 2004, 55:51-86.
74. Sara S.J. Retrieval and reconsolidation: toward a neurobiology of remembering. Learn. Mem. 2000, 7:73-84.
75. Lee J.L., et al. Independent cellular processes for hippocampal memory consolidation and reconsolidation. Science 2004, 304:839-843.
76. Nader K., et al. Fear memories require protein synthesis in the amygdala for reconsolidation after retrieval. Nature 2000, 406:722-726.
77. Lisman J.E., Grace A.A. The hippocampal-VTA loop: controlling the entry of information into long-term memory. Neuron 2005, 46:703-713.
78. Dempster F.N. Using tests to promote learning: a neglected classroom resource. J. Res. Dev. Educ. 1992, 25:213-217.
79. Bangert-Drowns R.L., et al. The instructional effect of feedback in test-like events. Rev. Educ. Res. 1991, 61:213-238.
80. McDaniel M.A., et al. Testing the testing effect in the classroom. Eur. J. Cogn. Psychol. 2007, 19:494-513.
81. Lyle, K.B. and Crawford, N.A. Retrieving essential material at the end of lectures improves performance on statistics exams. Teach. Psychol. in press.
82. Larsen D.P., et al. Repeated testing improves long-term retention relative to repeated study: a randomized, controlled trial. Med. Educ. 2009, 43:1174-1181.
83. Carpenter S.K., et al. Using tests to enhance 8th grade students' retention of U.S. history facts. Appl. Cogn. Psychol. 2009, 23:760-771.
84. Roediger, H.L., III et al. (submitted). Test-enhanced learning in the classroom: Long-term improvements from quizzing.
85. McDaniel, M.A. et al. Test-enhanced learning in a middle school science classroom: the effects of quiz frequency and placement. J. Educ. Psychol. in press.
86. Mawhinney V.T., et al. A comparison of students studying-behavior produced by daily, weekly, and three-week testing schedules. J. Appl. Behav. Anal. 1971, 4:257-264.
87. Michael J. A behavioral perspective on college teaching. Behav. Anal. 1991, 14:229-239.
88. Leeming F.C. The exam-a-day procedure improves performance in psychology classes. Teach. Psychol. 2002, 29:210-212.
89. Chan J.C.K. When does retrieval induce forgetting and when does it induce facilitation? Implications for retrieval inhibition, testing effect, and text processing. J. Mem. Lang. 2009, 61:153-170.
90. Chan J.C.K. Long-term effects of testing on the recall of nontested materials. Memory 2010, 18:49-57.
91. Chan J.C.K., et al. Retrieval induced facilitation: initially nontested material can benefit from prior testing. J. Exp. Psychol. Gen. 2006, 135:533-571.
92. Gates A.I. Recitation as a factor in memorizing. Arch. Psychol. 1917, 6:1-104.
93. Jones H.E. The effects of examination on the performance of learning. Arch. Psychol. 1923-1924, 10:1-70.
94. Spitzer H.F. Studies in retention. J. Educ. Psychol. 1939, 30:641-656.
95. Tulving E. The effects of presentation and recall of material in free-recall learning. J. Verb. Learn. Verb. Behav. 1967, 6:175-184.