Ten Benefits of Testing and Their Applications to Educational Practice

Psychology of Learning and Motivation - Advances in Research and Theory

Volumn 55, Issue , 2011, Pages 1-36

  Roediger III, Henry L ^a   Putnam, Adam L ^a   Smith, Megan A ^a  

^a NONE

Author keywords

Learning and Transfer; Retention; Retrieval; Testing

Indexed keywords

EID: 79960316520     PISSN: 00797421     EISSN: None     Source Type: Book Series    
DOI: 10.1016/B978-0-12-387691-1.00001-6     Document Type: Book

References (99)

1. Abbott E.E. On the analysis of the factors of recall in the learning process. Psychological Monographs 1909, 11:159-177.
2. Amlund J.T., Kardash C.A., Kulhavy R.W. Repetitive reading and recall of expository test. Reading Research Quarterly 1986, 21:49-58.
3. Anderson M.C., Bjork R.A., Bjork E.L. Remembering can cause forgetting: Retrieval dynamics in long-term memory. Journal of Experimental Psychology: Learning, Memory, and Cognition 1994, 20:1063-1087.
4. Anderson M.C., McCulloch K.C. Integration as a general boundary condition on retrieval-induced forgetting. Journal of Experimental Psychology: Learning, Memory, and Cognition 1999, 25:608-629.
5. Bacon F.T. Credibility of repeated statements: Memory for trivia. Journal of Experimental Psychology: Human Learning and Memory 1979, 5:241-252.
6. Barnett S.M., Ceci S.J. When and where do we apply what we learn? A taxonomy for far transfer. Psychological Bulletin 2002, 128:612-637.
7. Bäuml, K. H. (2008). Inhibitory processes. In: H. L. Roediger (Ed.), Cognitive psychology of memory (pp. 195-217). Vol. 2 of Learning and Memory: A comprehensive reference, 4 vols (J. Byrne, Ed.). Oxford: Elsevier.
8. Begg I., Armour V., Kerr T. On believing what we remember. Canadian Journal of Behavioral Science 1985, 17:199-214.
9. Bjork R.A., Bjork E.L. A new theory of disuse and an old theory of stimulus fluctuation. From learning processes to cognitive processes: Essays in honor of William K. Estes 1992, Vol. 2:35-67. Erlbaum, Hillsdale, NJ.
10. Black P., Wiliam D. Assessment and classroom learning. Assessment in Education: Principles, Policy & Practice 1998, 5:7-74.
11. Black P., Wiliam D. Inside the black box: Raising standards through classroom assessment. Phi Delta Kappan 1998, 80:139-147.
12. Brown A.S., Schilling H.E.H., Hockensmith M.L. The negative suggestion effect: Pondering incorrect alternatives may be hazardous to your knowledge. Journal of Educational Psychology 1999, 91:756-764.
13. Butler A.C. Repeated testing produces superior transfer of learning relative to repeated studying. Journal of Experimental Psychology: Learning, Memory, and Cognition 2010, 36:1118-1133.
14. Butler A.C., Karpicke J.D., Roediger H.L. The effect and timing of feedback on learning from multiple-choice tests. Journal of Experimental Psychology: Applied 2007, 13:273-281.
15. Butler A.C., Karpicke J.D., Roediger H.L. Correcting a metacognitive error: Feedback increases retention of low-confidence correct responses. Journal of Experimental Psychology: Learning, Memory, and Cognition 2008, 34:918-928.
16. Butler A.C., Roediger H.L. Feedback enhances the positive effects and reduces the negative effects of multiple-choice testing. Memory & Cognition 2008, 36:604-616.
17. Carpenter S.K., DeLosh E.L. Application of the testing and spacing effects to name learning. Applied Cognitive Psychology 2005, 19:619-636.
18. Carpenter S.K., DeLosh E.L. Impoverished cue support enhances subsequent retention: Support for the elaborative retrieval explanation of the testing effect. Memory & Cognition 2006, 34:268-276.
19. Carpenter S.K., Pashler H., Vul E. What types of learning are enhanced by a cued recall test?. Psychonomic Bulletin & Review 2006, 13:826-830.
20. Carrier M., Pashler H. The influence of retrieval on retention. Memory & Cognition 1992, 20:633-642.
21. Chan J.C.K. When does retrieval induce forgetting and when does it induce facilitation? Implications for retrieval inhibition, testing effect, and text processing. Journal of Memory and Language 2009, 61:153-170.
22. Chan J.C.K. Long-term effects of testing on the recall of nontested materials. Memory 2010, 18:49-57.
23. Chan J.C.K., McDermott K.B., Roediger H.L. Retrieval-induced facilitation: Initially nontested material can benefit from prior testing of related material. Journal of Experimental Psychology: General 2006, 135:553-571.
24. Congleton, A., & Rajaram, S. (2010, November). Examining the immediate and delayed aspects of the testing effect. Paper presented at the meeting of Psychonomic Society, St. Louis, MO.
25. Cranney J., Ahn M., McKinnon R., Morris S., Watts K. The testing effect, collaborative learning, and retrieval-induced facilitation in a classroom setting. European Journal of Cognitive Psychology 2009, 21:919-940.
26. Crowder R.G. Principles of learning and memory 1976, Erlbaum, Hillsdale, NJ.
27. Cull W.L. Untangling the benefits of multiple study opportunities and repeated testing for cued recall. Applied Cognitive Psychology 2000, 14:215-235.
28. Detterman D.K. The case for the prosecution: Transfer as an epiphenomenon. Transfer on trial: Intelligence, cognition, and instruction 1993, 1-24. Ablex Publishing, Westport, CT. D.K. Detterman, R.J. Sternberg (Eds.).
29. Dunlosky J., Hertzog C. Training programs to improve learning in later adulthood: Helping older adults educate themselves. Metacognition in educational theory and practice 1998, 249-275. Erlbaum, Mahwah, NJ. D.J. Hacker, J. Dunlosky, A.C. Graesser (Eds.).
30. Ebbinghaus H. Über das Gedächtnis 1885, Duncker & Humblot, Leipzig.
31. Erdelyi M.H., Becker J. Hypermnesia for pictures: Incremental memory for pictures but not words in multiple recall trials. Cognitive Psychology 1974, 6:159-171.
32. Fazio L.K., Agarwal P.K., Marsh E.J., Roediger H.L. Memorial consequences of multiple-choice testing on immediate and delayed tests. Memory & Cognition 2010, 38:407-418.
33. Finn B., Metcalfe J. The role of memory for past test in the under-confidence with practice effect. Journal of Experimental Psychology: Learning, Memory, and Cognition 2007, 33:238-244.
34. Finn B., Metcalfe J. Judgments of learning are influenced by memory for past test. Journal of Memory and Language 2008, 58:19-34.
35. Gates A.I. Recitation as a factor in memorizing. Archives of Psychology 1917, 6(40).
36. Gick M.L., Holyoak K.J. Analogical problem solving. Cognitive Psychology 1980, 12:306-355.
37. Glover J.A. The "testing" phenomenon: Not gone but nearly forgotten. Journal of Educational Psychology 1989, 81:392-399.
38. Hasher L., Goldstein D., Toppino T. Frequency and the conference of referential validity. Journal of Verbal Learning and Verbal Behavior 1977, 16:107-112.
39. Izawa C. Reinforcement-test sequences in paired-associate learning. Psychological Reports 1966, 18:879-919.
40. Izawa C. Function of test trials in paired-associate learning. Journal of Experimental Psychology 1968, 75:194-209.
41. Izawa C. Optimal potentiating effects and forgetting-prevention effects of tests in paired-associate learning. Journal of Experimental Psychology 1970, 83:340-344.
42. Jacoby L.L., Wahlheim C.N., Coane J.H. Test-enhanced learning of natural concepts: Effects on recognition memory, classification, and metacognition. Journal of Experimental Psychology: Learning, Memory, and Cognition 2010, 36:1441-1451.
43. James W. The principles of psychology 1980, Holt, New York.
44. Johnson C.I., Mayer R.E. A testing effect with multimedia learning. Journal of Educational Psychology 2009, 101:621-629.
45. Jones H.E. The effects of examination on the performance of learning. Archives of Psychology 1923/1924, 10:1-70.
46. Karpicke J.D. Metacognitive control and strategy selection: Deciding to practice retrieval during learning. Journal of Experimental Psychology: General 2009, 138:469-486.
47. Karpicke J.D., Blunt J.R. Retrieval practice produces more learning than elaborative studying with concept mapping. Science 2011, 331(6018):772-775.
48. Karpicke J.D., Butler A.C., Roediger H.L. Metacognitive strategies in student learning: Do students practise retrieval when they study on their own?. Memory 2009, 17:471-479.
49. Karpicke J.D., Roediger H.L. Repeated retrieval during learning is the key to long-term retention. Journal of Memory and Language 2007, 57:151-162.
50. Karpicke J.D., Roediger H.L. The critical importance of retrieval for learning. Science 2008, 319:966-968.
51. Kelly, C. M. (1999). Subjective experience as a basis for "objective" judgments: Effects of past experience on judgments of difficulty. In D. Gopher & A. Koriat (Eds.), Attention and Performance XVII, 515-536.
52. Koriat A., Scheffer L., Ma'ayan H. Comparing objective and subjective learning curves: Judgments of learning exhibit increased underconfidence with practice. Journal of Experimental Psychology: General 2002, 131:147-162.
53. Kornell N., Bjork R.A. The promise and perils of self-regulated study. Psychonomic Bulletin & Review 2007, 14:219-224.
54. Kornell N., Metcalfe J. Study efficacy and the region of proximal learning framework. Journal of Experimental Psychology: Learning, Memory, and Cognition 2006, 32:222-609.
55. Kornell N., Son L.K. Learners' choices and beliefs about self-testing. Memory 2009, 17:493-501.
56. Leeming F.C. The exam-a-day procedure improves performance in psychology classes. Teaching of Psychology 2002, 29:210-212.
57. Lyle K.B., Crawford N.A. Retrieving essential material at the end of lectures improves performance on statistics exams. Teaching of Psychology 2011, 38:94-97.
58. MacLeod M.D., Macrae C. Gone but not forgotten: The transient nature of retrieval-induced forgetting. Psychological Science 2001, 12:148-152.
59. Marsh E.J., Agarwal P.K., Roediger H.L. Memorial consequences of answering SAT II questions. Journal of Experimental Psychology: Applied 2009, 15:1-11.
60. Marsh E.J., Roediger H.L., Bjork R.A., Bjork E.L. The memorial consequences of multiple-choice testing. Psychonomic Bulletin & Review 2007, 14:194-199.
61. Masson M.E., McDaniel M.A. The role of organizational processes in long-term retention. Journal of Experimental Psychology: Human Learning and Memory 1981, 2:100-110.
62. Mawhinney V.T., Bostow D.E., Laws D.R., Blumenfeld G.J., Hopkins B.L. A comparison of students studying-behavior produced by daily, weekly, and three-week testing schedules. Journal of Applied Behavior Analysis 1971, 4:257-264.
63. McCabe J Metacognitive awareness of learning strategies in undergraduates. Memory & Cognition 2011, 39:462-476.
64. McDermott, K. B., & Arnold, K. M. (2010, November). Test taking facilitates future learning. Paper presented at the meeting of the Psychonomic Society, St. Louis, MO.
65. Metcalfe J. Is study time allocated selectively to a region of proximal learning?. Journal of Experimental Psychology: General 2002, 131:349-363.
66. Metcalfe J., Finn B. Evidence that judgments of learning are causally related to study choice. Psychonomic Bulletin & Review 2008, 15:174-179.
67. Michael J. A behavioral perspective on college teaching. Behavioral Analysis 1991, 14:229-239.
68. Nelson T.O., Dunlosky J., Graf A., Narens L. Utilization of metacognitive judgments in the allocation of study during multitrial learning. Psychological Science 1994, 5:207-213.
69. Nelson T.O., Leonesio R.J. Allocation of self-paced study time and the "labor-in-vain effect." Journal of Experimental Psychology: Learning, Memory and Cognition 1988, 14:676-686.
70. Newton, L. (1990). Overconfidence in the communication of intent: Heard and unheard melodies. Unpublished doctoral dissertation. Stanford, CA: Stanford University.
71. Pashler H., Cepeda N.J., Wixted J.T., Rohrer D. When does feedback facilitate learning of words?. Journal of Experimental Psychology: Learning, Memory, and Cognition 2005, 31:3-8.
72. Pyc M.A., Rawson K.A. Examining the efficiency of schedules of distributed retrieval practice. Memory & Cognition 2007, 35:1917-1927.
73. Pyc M.A., Rawson K.A. Why testing improves memory: Mediator effectiveness hypothesis. Science 2010, 330:335.
74. Remmers H.H., Remmers E.M. The negative suggestion effect on true-false examination questions. Journal of Educational Psychology 1926, 17:52-56.
75. Roediger H.L. Inhibiting effects of recall. Memory & Cognition 1974, 2:261-269.
76. Roediger H.L. Recall as a self-limiting process. Memory & Cognition 1978, 6:54-63.
77. Roediger H.L., Karpicke J.D. Test enhanced learning: Taking memory tests improves long-term retention. Psychological Science 2006, 17:249-255.
78. Roediger H.L., Karpicke J.D. The power of testing memory: Basic research and implications for educational practice. Perspectives on Psychological Science 2006, 1:181-210.
79. Roediger H.L., Marsh E.J. The positive and negative consequences of multiple-choice testing. Journal of Experimental Psychology: Learning, Memory and Cognitive 2005, 31:1155-1159.
80. Roenker D.L., Thompson C.P., Brown S.C. Comparison of measures for the estimation of clustering in free recall. Psychological Bulletin 1971, 76:45-48.
81. Rohrer K., Taylor K., Sholar B. Tests enhance the transfer of learning. Journal of Experimental Psychology: Learning, Memory, and Cognition 2010, 36:233-239.
82. Shaughnessy J.J., Zechmeister E.B. Memory-monitoring accuracy as influenced by the distribution of retrieval practice. Bulletin of the Psychonomic Society 1992, 30:125-128.
83. Slamecka N.J., Katsaiti L.T. Normal forgetting of verbal lists as a function of prior testing. Journal of Verbal Learning and Verbal Behavior 1988, 10:400-408.
84. Son, L. K., & Kornell, N. (2008). Research on the allocation of study time: Key studies from 1890 to the present (and beyond). In J. Dunlosky, & R. A. Bjork, (Eds.), A handbook ofmemoryand metamemory (pp. 333-351). Hillsdale, NJ: Psychology Press.
85. Spitzer H.F. Studies in retention. Journal of Educational Psychology 1939, 30:641-656.
86. Szpunar K.K., McDermott K.B., Roediger H.L. Expectation of a final cumulative test enhances long-term retention. Memory & Cognition 2007, 35:1007-1013.
87. Szpunar K.K., McDermott K.B., Roediger H.L. Testing during study insulates against the buildup of proactive interference. Journal of Experimental Psychology: Learning, Memory, and Cognition 2008, 34:1392-1399.
88. Thomas A.K., McDaniel M.A. Metacomprehension for educationally relevant materials: Dramatic effects of encoding-retrieval interactions. Psychonomic Bulletin & Review 2007, 14:212-218.
89. Thompson C.P., Wenger S.K., Bartling C.A. How recall facilitates subsequent recall: A reappraisal. Journal of Experimental Psychology: Human Learning and Memory 1978, 4:210-221.
90. Toppino T.C., Brochin H.A. Learning from tests: The case of true-false examinations. Journal of Educational Research 1989, 83:119-124.
91. Toppino T.C., Luipersbeck S.M. Generality of the negative suggestion effect in objective tests. Journal of Educational Psychology 1993, 86:357-362.
92. Tulving E. Subjective organization in free recall of "unrelated" words. Psychological Review 1962, 69:344-354.
93. Tulving E. The effects of presentation and recall of material in free-recall learning. Journal of Verbal Learning and Verbal Behavior 1967, 6:175-184.
94. Tulving E., Arbuckle T. Input and output interference in short-term associative memory. Journal of Experimental Psychology 1966, 72:145-150.
95. Underwood B.J. Interference and forgetting. Psychological Review 1957, 64:49-60.
96. Wheeler M.A., Ewers M., Buonanno J.F. Different rates of forgetting following study versus test trials. Memory 2003, 11:571-580.
97. Wheeler M.A., Roediger H.L. Disparate effects of repeated testing: Reconciling Ballard's (1913) and Bartlett's (1932) results. Psychological Science 1992, 3:240-245.
98. Zaromb, F. M. (2010). Organizational processes contribute to the testing effect in free recall. (Unpublished doctoral dissertation). Washington University of St. Louis, Saint Louis, MO.
99. Zaromb F.M., Roediger H.L. The testing effect in free recall is associated with enhanced organizational processes. Memory & Cognition 2010, 38:995-1008.