Does the benefit of testing depend on lag, and if so, why? Evaluating the elaborative retrieval hypothesis

Memory and Cognition

Volumn 43, Issue 4, 2015, Pages 619-633

  Rawson, Katherine A ^a   Vaughn, Kalif E ^b   Carpenter, Shana K ^c  

^a KENT STATE UNIVERSITY   (United States)

^b WILLIAMS COLLEGE   (United States)

^c IOWA STATE UNIVERSITY   (United States)

Author keywords

Elaborative retrieval hypothesis; Lag effect; Memory; Testing effect

Indexed keywords

ADULT; ASSOCIATION; HUMAN; NEUROPSYCHOLOGICAL TEST; PHYSIOLOGY; RECALL; TIME FACTOR; YOUNG ADULT;

ADULT; CUES; HUMANS; MENTAL RECALL; NEUROPSYCHOLOGICAL TESTS; TIME FACTORS; YOUNG ADULT;

EID: 84940006213     PISSN: 0090502X     EISSN: 15325946     Source Type: Journal    
DOI: 10.3758/s13421-014-0477-z     Document Type: Article

References (101)

1. Arnold, K. M., & McDermott, K. B. (2013a). Free recall enhances subsequent learning. Psychonomic Bulletin & Review, 20, 507–513.
2. Arnold, K. M., & McDermott, K. B. (2013b). Test-potentiated learning: Distinguishing between direct and indirect effects of tests. Journal of Experimental Psychology: Learning, Memory, and Cognition, 39, 940–945. doi:10.1037/a0029199
3. Ausubel, D. P. (1966). Early versus delayed review in meaningful learning. Psychology in the Schools, 3, 195–198.
4. Bahrick, H. P. (1979). Maintenance of knowledge: Questions about memory we forgot to ask. Journal of Experimental Psychology: General, 108, 296–308.
5. Bahrick, H. P., & Hall, L. K. (2005). The importance of retrieval failures to long-term retention: A metacognitive explanation of the spacing effect. Journal of Memory and Language, 52, 566–577. doi:10.1016/j.jml.2005.01.012
6. Bell, M. C., Kawadri, N., Simone, P. M., & Wiseheart, M. (2014). Long-term memory, sleep, and the spacing effect. Memory, 22, 276–283.
7. Bjork, R. A., & Allen, T. W. (1970). The spacing effect: Consolidation or differential encoding? Journal of Verbal Learning and Verbal Behavior, 9, 567–572.
8. Bloom, K. C., & Shuell, T. J. (1981). Effects of massed and distributed practice on the learning and retention of second-language vocabulary. Journal of Educational Research, 74, 245–248.
9. Boywitt, C. D., & Brandt, M. (2012). The primacy effect in memory for repetitions: Evidence for the role of lag between repetitions in source monitoring. Journal of Cognitive Psychology, 24, 295–305.
10. Braun, K., & Rubin, D. C. (1998). The spacing effect depends on an encoding deficit, retrieval, and time in working memory: Evidence from once-presented words. Memory, 6, 37–65.
11. Brennan, M. K., Cho, K. W., & Neely, J. H. (2013). The role of mediators in the testing effect in paired-associate learning. Paper presented at the 54th Annual Meeting of the Psychonomic Society, Toronto, ON.
12. Butler, A. C., & Roediger, H. L., III. (2008). Feedback enhances the positive effects and reduces the negative effects multiple-choice testing. Memory & Cognition, 36, 604–616. doi:10.3758/MC.36.3.604
13. Carpenter, S. K. (2009). Cue strength as a moderator of the testing effect: The benefits of elaborative retrieval. Journal of Experimental Psychology: Learning, Memory, and Cognition, 35, 1563–1569. doi:10.1037/a0017021
14. Carpenter, S. K. (2011). Semantic information activated during retrieval contributes to later retention: Support for the mediator effectiveness hypothesis of the testing effect. Journal of Experimental Psychology: Learning, Memory, and Cognition, 37, 1547–1552. doi:10.1037/a0024140
15. Carpenter, S. K. (2012). Testing enhances the transfer of learning. Current Directions in Psychological Science, 21, 279–283.
16. Carpenter, S. K., & DeLosh, E. L. (2006). Impoverished cue support enhances subsequent retention: Support for the elaborative retrieval explanation of the testing effect. Memory & Cognition, 34, 268–276. doi:10.3758/BF03193405
17. Carpenter, S. K., Pashler, H., & Cepeda, N. J. (2009). Using tests to enhance 8th grade students’ retention of U.S. history facts. Applied Cognitive Psychology, 23, 760–771. doi:10.1002/acp.1507
18. Carpenter, S. K., Pashler, H., & Vul, E. (2006). What types of learning are enhanced by a cued recall test? Psychonomic Bulletin & Review, 13, 826–830. doi:10.3758/BF03194004
19. Cary, M., & Reder, L. M. (2003). A dual-process account of the list-length and strength-based mirror effects in recognition. Journal of Memory and Language, 49, 231–248.
20. Cepeda, N. J., Pashler, H., Vul, E., Wixted, J. T., & Rohrer, D. (2006). Distributed practice in verbal recall tasks: A review and quantitative synthesis. Psychological Bulletin, 132, 354–380. doi:10.1037/0033-2909.132.3.354
21. Challis, B. H. (1993). Spacing effects on cued-memory tests depend on level of processing. Journal of Experimental Psychology: Learning, Memory, and Cognition, 19, 389–396. doi:10.1037/0278-7393.19.2.389
22. Congleton, A., & Rajaram, S. (2012). The origin of the interaction between learning method and delay in the testing effect: The roles of processing and conceptual retrieval organization. Memory & Cognition, 40, 528–539.
23. Coppens, L. C., Verkoeijen, P. P. J. L., & Rikers, R. M. J. P. (2011). Learning Adinkra symbols: The effect of testing. Journal of Cognitive Psychology, 23, 351–357.
24. Cortina, J. M., & Nouri, H. (2000). Effect size for ANOVA designs. Thousand Oaks, CA: Sage.
25. Cuddy, L. J., & Jacoby, L. L. (1982). When forgetting helps memory: An analysis of repetition effects. Journal of Verbal Learning and Verbal Behavior, 21, 451–467. doi:10.1016/S0022-5371(82)90727-7
26. Cull, W. L. (2000). Untangling the benefits of multiple study opportunities and repeated testing for cued recall. Applied Cognitive Psychology, 14, 215–235.
27. Cumming, G. (2014). The new statistics: Why and how. Psychological Science, 25, 7–29. doi:10.1177/0956797613504966
28. Delaney, P. F., Verkoeijen, P. P. J. L., & Spirgel, A. (2010). Spacing and testing effects: A deeply critical, lengthy, and at times discursive review of the literature. In B. H. Ross (Ed.), The psychology of learning and motivation: Advances in research and theory (Vol. 53, pp. 63–147). San Diego, CA: Elsevier.
29. Dellarosa, D., & Bourne, L. E., Jr. (1985). Surface form and the spacing effect. Memory & Cognition, 13, 529–537.
30. Dunlosky, J., Rawson, K. A., Marsh, E. J., Nathan, M. J., & Willingham, D. T. (2013). Improving students’ learning with effective learning techniques: Promising directions from cognitive and educational psychology. Psychological Science in the Public Interest, 14, 4–58.
31. Eich, E. (2014). Business not as usual [Editorial]. Psychological Science, 25, 3–6. doi:10.1177/0956797613512465
32. Elmes, D. G., Dye, C. J., & Herdelin, N. J. (1983). What is the role of affect in the spacing effect? Memory & Cognition, 11, 144–151.
33. Elmes, D. G., Greener, W. I., & Wilkinson, W. C. (1972). Free recall of items presented after massed- and distributed-practice items. American Journal of Psychology, 85, 237–240.
34. Faul, F., Erdfelder, E., Buchner, A., & Lang, A.-G. (2009). Statistical power analyses using G*Power 3.1: Tests for correlation and regression analyses. Behavior Research Methods, 41, 1149–1160. doi:10.3758/BRM.41.4.1149
35. Fishman, E. J., Keller, L., & Atkinson, R. C. (1968). Massed versus distributed practice in computerized spelling drills. Journal of Educational Psychology, 59, 290–296.
36. Gartman, L. M., & Johnson, N. F. (1972). Massed versus distributed repetitions of homographs: A test of the differential-encoding hypothesis. Journal of Verbal Learning and Verbal Behavior, 11, 801–808.
37. Glenberg, A. M. (1977). Influences of retrieval processes on the spacing effect in free recall. Journal of Experimental Psychology: Human Learning and Memory, 3, 282–294. doi:10.1037/0278-7393.3.3.282
38. Glover, J. A. (1989). The “testing” phenomenon: Not gone but nearly forgotten. Journal of Educational Psychology, 81, 392–399.
39. Goossens, N. A. M. C., Camp, G., Verkoeijen, P. P. J. L., Tabbers, H. K., & Zwaan, R. A. (2014). The benefit of retrieval practice over elaborative restudy in primary school vocabulary learning. Journal of Applied Research in Memory and Cognition, 3, 177–182. doi:10.1016/j.jarmac.2014.05.003
40. Halamish, V., & Bjork, R. A. (2011). When does testing enhance retention? A distribution-based interpretation of retrieval as a memory modifier. Journal of Experimental Psychology: Learning, Memory, and Cognition, 37, 801–812.
41. Jacoby, L. L. (1978). On interpreting the effects of repetition: Solving a problem versus remembering a solution. Journal of Verbal Learning and Verbal Behavior, 17, 649–667. doi:10.1016/S0022-5371(78)90393-6
42. Judd, C. M., & McClelland, G. H. (1989). Data analysis: A model comparison approach. New York, NY: Harcourt Brace Jovanovich.
43. Kahana, M. J., & Howard, M. W. (2005). Spacing and lag effects in free recall of pure lists. Psychonomic Bulletin & Review, 12, 159–164. doi:10.3758/BF03196362
44. Kang, S. H. K. (2010). Enhancing visuospatial learning: The benefit of retrieval practice. Memory & Cognition, 38, 1009–1017. doi:10.3758/MC.38.8.1009
45. Kang, S. H. K., McDermott, K. B., & Roediger, H. L., III. (2007). Test format and corrective feedback modify the effect of testing on long-term retention. European Journal of Cognitive Psychology, 19, 528–558.
46. Karpicke, J. D., & Blunt, J. R. (2011). Retrieval practice produces more learning than elaborative studying with concept mapping. Science, 331, 772–775. doi:10.1126/science.1199327
47. Karpicke, J. D., & Roediger, H. L., III. (2007). Repeated retrieval during learning is the key to long-term retention. Journal of Memory and Language, 57, 151–162. doi:10.1016/j.jml.2006.09.004
48. Karpicke, J. D., & Smith, M. A. (2012). Separate mnemonic effects of retrieval practice and elaborative encoding. Journal of Memory and Language, 67, 17–29. doi:10.1016/j.jml.2012.02.004
49. Karpicke, J. D., Lehman, M., & Aue, W. R. (2014). Retrieval-based learning: An episodic context account. In B. H. Ross (Ed.), The psychology of learning and motivation (Vol. 61, pp. 237–284). San Diego, CA: Elsevier Academic Press.
50. Kole, J. A., & Healy, A. F. (2013). Is retrieval mediated after repeated testing? Journal of Experimental Psychology: Learning, Memory, and Cognition, 39, 462–472.
51. Kornell, N. (2009). Optimising learning using flashcards: Spacing is more effective than cramming. Applied Cognitive Psychology, 23, 1297–1317. doi:10.1002/acp.1537
52. Kornell, N., Bjork, R. A., & Garcia, M. A. (2011). Why tests appear to prevent forgetting: A distribution-based bifurcation model. Journal of Memory and Language, 65, 85–97.
53. LeBel, E. P., & Peters, K. R. (2011). Fearing the future of empirical psychology: Bem’s (2011) evidence of psi as a case study of deficiencies in modal research practice. Review of General Psychology, 15, 371–379.
54. Ledgerwood, A., & Sherman, J. W. (2012). Short, sweet, and problematic? The rise of the short report in psychological science. Perspectives on Psychological Science, 7, 60–66.
55. Lehman, M., Smith, M. A., & Karpicke, J. D. (2014). Toward an episodic context account of retrieval-based learning: Dissociating retrieval practice and elaboration. Journal of Experimental Psychology: Learning, Memory, and Cognition. doi:10.1037/xlm0000012
56. McEldoon, K. L., Durkin, K. L., & Rittle-Johnson, B. (2013). Is self-explanation worth the time? A comparison to additional practice. British Journal of Educational Psychology, 83, 615–632.
57. Melton, A. W. (1970). The situation with respect to the spacing of repetitions and memory. Journal of Verbal Learning and Verbal Behavior, 9, 596–606.
58. Nelson, D. L., McEvoy, C. L., & Schreiber, T. A. (2004). The University of South Florida free association, rhyme, and word fragment norms. Behavior Research Methods, Instruments, & Computers, 36, 402–407. doi:10.3758/BF03195588
59. Neuschatz, J. S., Preston, E. L., Toglia, M. P., & Neuschatz, J. S. (2005). Comparison of the efficacy of two name-learning techniques: Expanding rehearsal and name–face imagery. American Journal of Psychology, 118, 79–102.
60. Pashler, H., Cepeda, N. J., Wixted, J. T., & Rohrer, D. (2005). When does feedback facilitate learning of words? Journal of Experimental Psychology: Learning, Memory, and Cognition, 31, 3–8. doi:10.1037/0278-7393.31.1.3
61. Pashler, H., & Harris, C. R. (2012). Is the replicability crisis overblown? Three arguments examined. Perspectives on Psychological Science, 7, 531–536.
62. Pashler, H., Zarow, G., & Triplett, B. (2003). Is temporal spacing of tests helpful even when it inflates error rates? Journal of Experimental Psychology: Learning, Memory, and Cognition, 29, 1051–1057. doi:10.1037/0278-7393.29.6.1051
63. Pavlik, P. I., Jr., & Anderson, J. R. (2005). Practice and forgetting effects on vocabulary memory: An activation-based model of the spacing effect. Cognitive Science, 29, 559–586.
64. Peterson, L. R., & Gentile, A. (1965). Proactive interference as a function of time between tests. Journal of Experimental Psychology, 70, 473–478.
65. Pyc, M. A., & Rawson, K. A. (2007). Examining the efficiency of schedules of distributed retrieval practice. Memory & Cognition, 35, 1917–1927.
66. Pyc, M. A., & Rawson, K. A. (2009). Testing the retrieval effort hypothesis: Does greater difficulty correctly recalling information lead to higher levels of memory? Journal of Memory and Language, 60, 437–447. doi:10.1016/j.jml.2009.01.004
67. Pyc, M. A., & Rawson, K. A. (2010). Why testing improves memory: Mediator effectiveness hypothesis. Science, 330, 335. doi:10.1126/science.1191465
68. Pyc, M. A., & Rawson, K. A. (2012a). Are judgments of learning made after correct responses during retrieval practice sensitive to lag and criterion level effects? Memory & Cognition, 40, 976–988.
69. Pyc, M. A., & Rawson, K. A. (2012b). Why is test–restudy practice beneficial for memory? An evaluation of the mediator shift hypothesis. Journal of Experimental Psychology: Learning, Memory, and Cognition, 38, 737–746. doi:10.1037/a0026166
70. Rawson, K. A. (2012). Why do rereading lag effects depend on test delay? Journal of Memory and Language, 66, 870–884.
71. Rawson, K. A., & Dunlosky, J. (2011). Optimizing schedules of retrieval practice for durable and efficient learning: How much is enough? Journal of Experimental Psychology: General, 140, 283–302. doi:10.1037/a0023956
72. Rawson, K. A., & Dunlosky, J. (2013). Relearning attenuates the benefits and costs of spacing. Journal of Experimental Psychology: General, 142, 1113–1129.
73. Rawson, K. A., & Kintsch, W. (2005). Rereading effects depend upon time of test. Journal of Educational Psychology, 97, 70–80.
74. Roediger, H. L. III. (2012, February). Psychology’s woes and a partial cure: The value of replication. APS Observer, 25(2), 9, 27–29. Retrieved from www.psychologicalscience.org/index.php/publications/observer/2012/february-11-2012-observer-publications/psychology’s-woes-and-a-partial-cure-the-value-of-replication.html
75. Roediger, H. L., III, & Karpicke, J. D. (2006). Test-enhanced learning: Taking memory tests improves long-term retention. Psychological Science, 17, 249–255. doi:10.1111/j.1467-9280.2006.01693.x
76. Roediger, H. L., III, Putnam, A. L., & Smith, M. A. (2011). Ten benefits of testing and their applications to educational practice. In J. P. Mestre & B. H. Ross (Eds.), The psychology of learning and motivation: Cognition in education (Vol. 55, pp. 1–36). San Diego, CA: Elsevier Academic Press.
77. Rohrer, D. (2009). Avoidance of overlearning characterizes the spacing effect. European Journal of Cognitive Psychology, 21, 1001–1012.
78. Rose, R. J. (1984). Processing time for repetitions and the spacing effect. Canadian Journal of Psychology, 83, 537–550.
79. Rosenthal, R., & Rosnow, R. L. (1985). Contrast analysis: Focused comparisons in the analysis of variance. Cambridge, UK: Cambridge University Press.
80. Sahakyan, L., & Hendricks, H. E. (2012). Context change and retrieval difficulty in the list-before-last paradigm. Memory & Cognition, 40, 844–860.
81. Schmidt, S. (2009). Shall we really do it again? The powerful concept of replication is neglected in the social science. Review of General Psychology, 13, 90–100.
82. Siegel, L. L., & Kahana, M. J. (2014). A retrieved context account of spacing and repetition effects in free recall. Journal of Experimental Psychology: Learning, Memory, and Cognition, 40, 755–764.
83. Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011). False positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science, 22, 1359–1366. doi:10.1177/0956797611417632
84. Simone, P. M., Bell, M. C., & Cepeda, N. J. (2013). Diminished but not forgotten: Effects of aging on magnitude of spacing effect benefits. Journals of Gerontology, 68B, 674–680. doi:10.1093/geronb/gbs096
85. Simons, D. J. (2014). The value of direct replication. Perspectives on Psychological Science, 9, 76–80. doi:10.1177/1745691613514755
86. Sobel, H. S., Cepeda, N. J., & Kapler, I. V. (2011). Spacing effects in real-world classroom vocabulary learning. Applied Cognitive Psychology, 25, 763–767.
87. Szpunar, K. K., McDermott, K. B., & Roediger, H. L., III. (2008). Testing during study insulates against the buildup of proactive interference. Journal of Experimental Psychology: Learning, Memory, and Cognition, 34, 1392–1399. doi:10.1037/a0013082
88. Tabachnik, B. G., & Fidell, L. S. (2001). Using multivariate statistics (4th ed.). Boston, MA: Allyn & Bacon.
89. Thios, S. J. (1972). Memory for words in repeated sentences. Journal of Verbal Learning and Verbal Behavior, 11, 789–793.
90. Thios, S. J., & D’Agostino, P. R. (1976). Effects of repetition as a function of study-phase retrieval. Journal of Verbal Learning and Verbal Behavior, 15, 529–536.
91. Toppino, T. C., & Bloom, L. C. (2002). The spacing effect, free recall, and two-process theory: A closer look. Journal of Experimental Psychology: Learning, Memory, and Cognition, 28, 437–444. doi:10.1037/0278-7393.28.3.437
92. Toppino, T. C., & Cohen, M. S. (2009). The testing effect and the retention interval. Experimental Psychology, 56, 252–257.
93. Toppino, T. C., & Gracen, T. F. (1985). The lag effect and differential organization theory: Nine failures to replicate. Journal of Experimental Psychology: Learning, Memory, and Cognition, 11, 185–191. doi:10.1037/0278-7393.11.1.185
94. Underwood, B. J., Kapelak, S. M., & Malmi, R. A. (1976). The spacing effect: Additions to the theoretical and empirical puzzle. Memory & Cognition, 4, 391–400. doi:10.3758/BF03213195
95. Vaughn, K. E., & Rawson, K. A. (2011). Diagnosing criterion level effects on memory: What aspects of memory are enhanced by repeated retrieval? Psychological Science, 22, 1127–1131. doi:10.1177/0956797611417724
96. Vojdanoska, M., Cranney, J., & Newell, B. R. (2010). The testing effect: The role of feedback and collaboration in a tertiary classroom setting. Applied Cognitive Psychology, 24, 1183–1195.
97. Ward, G., & Tan, L. (2004). The effect of the length of to-be-remembered lists and intervening lists on free recall: A reexamination using overt rehearsal. Journal of Experimental Psychology: Learning, Memory, and Cognition, 30, 1196–1210. doi:10.1037/0278-7393.30.6.1196
98. Waugh, N. C. (1970). On the effective duration of a repeated word. Journal of Verbal Learning and Verbal Behavior, 9, 587–595.
99. Wenger, S. K. (1979). The within-list distributed practice effect: More evidence for the inattention hypothesis. American Journal of Psychology, 92, 105–113.
100. Wissman, K. T., Rawson, K. A., & Pyc, M. A. (2011). The interim test effect: Testing prior material can facilitate the learning of new material. Psychonomic Bulletin & Review, 18, 1140–1147. doi:10.3758/s13423-011-0140-7
101. Zaromb, F. M., & Roediger, H. L., III. (2010). The testing effect in free recall is associated with enhanced organizational processes. Memory & Cognition, 38, 995–1008. doi:10.3758/MC.38.8.995