Mechanisms underlying the spacing effect in learning: A comparison of three computational models

Journal of Experimental Psychology: General

Volumn 147, Issue 9, 2018, Pages 1325-1348

  Walsh, Matthew M ^a   Gluck, Kevin A ^b   Gunzelmann, Glenn ^b   Jastrzembski, Tiffany ^b   Krusmark, Michael ^b,c   Myung, Jay I ^d   Pitt, Mark A ^d   Zhou, Ran ^d  

^a RAND CORPORATION   (United States)

^b AIR FORCE RESEARCH LABORATORY   (United States)

^c WRIGHT PATTERSON AIR FORCE BASE   (United States)

^d OHIO STATE UNIVERSITY   (United States)

Author keywords

ACT R; Education; Predictive performance equation; Relearning; Spacing effect

Indexed keywords

EID: 85053520818     PISSN: 00963445     EISSN: None     Source Type: Journal    
DOI: 10.1037/xge0000416.supp     Document Type: Article

References (85)

1. Anderson, J. R. (2002). Spanning seven orders of magnitude: A challenge for cognitive modeling. Cognitive Science, 26, 85-112. http://dx.doi.org/ 10.1207/s15516709cog2601_3
2. Anderson, J. R. (2007). How can the human mind occur in the physical universe. New York, NY: Oxford University Press. http://dx.doi.org/10.1093/acprof:oso/9780195324259.001.0001
3. Anderson, J. R., & Lebiere, C. (1998). The atomic components of thought. Mahwah, NJ: Erlbaum, Inc
4. Anderson, J. R., & Schunn, C. D. (2000). Implications of the ACT-R learning theory: No magic bullets. In R. Glaser (Ed.), Advances in instructional psychology: Educational design and cognitive science (Vol. 5). Mahwah, NJ: Erlbaum
5. Bahrick, H. P. (1979). Maintenance of knowledge: Questions about memory we forgot to ask. Journal of Experimental Psychology: General, 108, 296-308. http://dx.doi.org/10.1037/0096-3445.108.3.296
6. Bahrick, H. P., Bahrick, L. E., Bahrick, A. S., & Bahrick, P. E. (1993). Maintenance of foreign language vocabulary and the spacing effect. Psychological Science, 4, 316-321. http://dx.doi.org/10.1111/j.1467-9280.1993.tb00571.x
7. Barnes, B. E. (1998). Creating the practice-learning environment: Using information technology to support a new model of continuing medical education. Academic Medicine, 73, 278-281. http://dx.doi.org/10.1097/ 00001888-199803000-00016
8. Bates, D. M., Maechler, M., & Bolker, B. (2014). lme4: Linear mixed-effects models using S4 classes (R package version 0.999999-0). Retrieved from http://CRAN.R-project.org/package=lme4
9. Benjamin, A. S., & Tullis, J. (2010). What makes distributed practice effective? Cognitive Psychology, 61, 228-247. http://dx.doi.org/10.1016/j.cogpsych.2010.05.004
10. Bjork, R. A. (1994). Memory and metamemory considerations in the training of human beings. In J. Metcalfe & A. Shimamura (Eds.), Metacognition: Knowing about knowing (pp. 185-205). Cambridge, MA: MIT Press
11. Bjork, R. A., & Bjork, E. L. (1992). A new theory of disuse and an old theory of stimulus fluctuation. In A. Healy, S. Kosslyn, & R. Shiffrin (Eds.), From learning processes to cognitive processes: Essays in honor of William K. Estes (Vol. 2, pp. 35-67). Hillsdale, NJ: Erlbaum
12. Brainard, D. H. (1997). The psychophysics toolbox. Spatial Vision, 10, 433-436. http://dx.doi.org/10.1163/156856897X00357
13. Braun, K., & Rubin, D. C. (1998). The spacing effect depends on an encoding deficit, retrieval, and time in working memory: Evidence from oncepresented words. Memory, 6, 37-65. http://dx.doi.org/10.1080/741941599
14. Buhrmester, M., Kwang, T., & Gosling, S. D. (2011). Amazon's Mechanical Turk a new source of inexpensive, yet high-quality, data? Perspectives on Psychological Science, 6, 3-5. http://dx.doi.org/10.1177/174569. 1610393980
15. Carpenter, S., Cepeda, N., Rohrer, D., Kang, S. K., & Pashler, H. (2012). Using spacing to enhance diverse forms of learning: Review of recent research and implications for instruction. Educational Psychology Review, 24, 369-378. http://dx.doi.org/10.1007/s10648-012-9205-z
16. Carpenter, S. K., Pashler, H., & Cepeda, N. J. (2009). Using tests to enhance 8th grade students' retention of U.S. history facts. Applied Cognitive Psychology, 23, 760-771. http://dx.doi.org/10.1002/acp.1507
17. Cepeda, N. J., Pashler, H., Vul, E., Wixted, J. T., & Rohrer, D. (2006). Distributed practice in verbal recall tasks: A review and quantitative synthesis. Psychological Bulletin, 132, 354-380. http://dx.doi.org/10.1037/ 0033-2909.132.3.354
18. Cepeda, N. J., Vul, E., Rohrer, D., Wixted, J. T., & Pashler, H. (2008). Spacing effects in learning: A temporal ridgeline of optimal retention. Psychological Science, 19, 1095-1102. http://dx.doi.org/10.1111/j.1467-9280.2008.02209.x
19. Crowder, R. G. (1976). Principles of learning and memory. Hillsdale, NJ: Erlbaum
20. de Jonge, M., Tabbers, H. K., & Rikers, R. M. (2014). Retention beyond the threshold: Test-enhanced relearning of forgotten information. Journal of Cognitive Psychology, 26, 58-64. http://dx.doi.org/10.1080/20445911.2013.858721
21. Delaney, P. F., Verkoeijen, P. P., & Spirgel, A. (2010). Spacing and testing effects: A deeply critical, lengthy, and at times discursive review of the literature. Psychology of Learning and Motivation, 53, 63-147. http:// dx.doi.org/10.1016/S0079-7421(10)53003-2
22. Dempster, F. N. (1988). The spacing effect: A case study in the failure to apply the results of psychological research. American Psychologist, 43, 627-634. http://dx.doi.org/10.1037/0003-066X.43.8.627
23. Dunlosky, J., Rawson, K. A., Marsh, E. J., Nathan, M. J., & Willingham, D. T. (2013). Improving students' learning with effective learning techniques promising directions from cognitive and educational psychology. Psychological Science in the Public Interest, 14, 4-58. http://dx.doi.org/ 10.1177/1529100612453266
24. Ebbinghaus, H. (1964).Über das Gedachtnis: Untersuchungen zur experimentellen psychologie [Memory: A contribution to experimental psychology]. Leipzig, Germany: Duncker & Humblot. (Original work published 1885)
25. Estes, W. K. (1955). Statistical theory of distributional phenomena in learning. Psychological Review, 62, 369-377. http://dx.doi.org/10.1037/ h0046888
26. Estes, W. K. (1960). Learning theory and the new 'mental chemistry.' Psychological Review, 67, 207-223. http://dx.doi.org/10.1037/h0041624
27. Gelman, A., Carlin, J. B., Stern, H. S., Dunson, D. B., Vehtari, A., & Rubin, D. B. (2014). Bayesian data analysis (3rd ed.). Boca Raton, FL: CRC Press
28. Glenberg, A. M. (1976). Monotonic and nonmonotonic lag effects in pairedassociate and recognition memory paradigms. Journal of Verbal Learning and Verbal Behavior, 15, 1-16. http://dx.doi.org/10.1016/S0022-5371(76)90002-5
29. Glenberg, A. M. (1979). Component-levels theory of the effects of spacing of repetitions on recall and recognition. Memory & Cognition, 7, 95-112. http://dx.doi.org/10.3758/BF03197590
30. Goodman, J. K., Cryder, C. E., & Cheema, A. (2013). Data collection in a flat world: The strengths and weaknesses of Mechanical Turk samples. Journal of Behavioral Decision Making, 26, 213-224. http://dx.doi.org/ 10.1002/bdm.1753
31. Greene, R. L. (1989). Spacing effects in memory: Evidence for a twoprocess account. Journal of Experimental Psychology: Learning, Memory, and Cognition, 15, 371-377. http://dx.doi.org/10.1037/0278-7393.15.3.371
32. Greeno, J. G. (1964). Paired-associate learning with massed and distributed repetitions of items. Journal of Experimental Psychology, 67, 286-295. http://dx.doi.org/10.1037/h0044977
33. Groninger, L. K., & Groninger, L. D. (1980). A comparison of recognition and savings as retrieval measures: A reexamination. Bulletin of the Psychonomic Society, 15, 263-266. http://dx.doi.org/10.3758/BF03334527
34. Hintzman, D. L. (1974). Theoretical implications of the spacing effect. In R. L. Solso (Ed.), Theories in cognitive psychology: The Loyola symposium (pp. 77-97). Potomac, MD: Erlbaum
35. Hintzman, D. L. (2004). Judgment of frequency versus recognition confidence: Repetition and recursive reminding. Memory & Cognition, 32, 336-350. http://dx.doi.org/10.3758/BF03196863
36. Hintzman, D. L., & Rogers, M. K. (1973). Spacing effects in picture memory. Memory & Cognition, 1, 430-434. http://dx.doi.org/10.3758/ BF03208903
37. Janiszewski, C., Noel, H., & Sawyer, A. G. (2003). A meta-analysis of the spacing effect in verbal learning: Implications for research on advertising repetition and consumer memory. The Journal of Consumer Research, 30, 138-149. http://dx.doi.org/10.1086/374692
38. Jastrzembski, T. S., & Gluck, K. A. (2009). A formal comparison of model variants for performance prediction. Retrieved from https://www.semantic scholar.org/paper/A-Formal-Comparison-of-Model-Variants-for-Performa-Jast rzembski-Gluck/17b21f5666afb559d6d60c7df9565211ff0a68ba
39. Jost, A. (1897). Die Assoziationsfestigkeit in ihrer Abhangigkeit von der Verteilung der Wiederholungen [The strength of associations in their dependence on the distribution of repetitions]. Zeitschrift für Psychologie und Physiologie der Sinnesorgane, 14, 436-472
40. Kass, R. E., & Raftery, A. E. (1995). Bayes factors. Journal of the American Statistical Association, 90, 773-795. http://dx.doi.org/10.1080/01621459.1995.10476572
41. Khajah, M. M., Lindsey, R. V., & Mozer, M. C. (2014). Maximizing students' retention via spaced review: Practical guidance from computational models of memory. Topics in Cognitive Science, 6, 157-169. http://dx.doi.org/10.1111/tops.12077
42. Koedinger, K. R., Booth, J. L., & Klahr, D. (2013). Education research. Instructional complexity and the science to constrain it. Science, 342, 935-937. http://dx.doi.org/10.1126/science.1238056
43. Lee, T. D., & Genovese, E. D. (1988). Distribution of practice in motor skill acquisition: Learning and performance effects reconsidered. Research Quarterly for Exercise and Sport, 59, 277-287. http://dx.doi.org/ 10.1080/02701367.1988.10609373
44. Lindsey, R. V., Shroyer, J. D., Pashler, H., & Mozer, M. C. (2014). Improving students' long-term knowledge retention through personalized review. Psychological Science, 25, 639-647. http://dx.doi.org/10.1177/0956797613504302
45. MacLeod, C. M. (1976). Bilingual episodic memory: Acquisition and forgetting. Journal of Verbal Learning and Verbal Behavior, 15, 347-364. http://dx.doi.org/10.1016/S0022-5371(76)90031-1
46. MacLeod, C. M. (1988). Forgotten but not gone: Savings for pictures and words in long-term memory. Journal of Experimental Psychology: Learning, Memory, and Cognition, 14, 195-212. http://dx.doi.org/10.1037/0278-7393.14.2.195
47. Maner, J. K. (2014). Let's put our money where our mouth is. If authors are to change their ways, reviewers (and editors) must change with them. Perspectives on Psychological Science, 9, 343-351. http://dx.doi.org/10.1177/1745691614528215
48. Mazza, S., Gerbier, E., Gustin, M. P., Kasikci, Z., Koenig, O., Toppino, T. C., & Magnin, M. (2016). Relearn faster and retain longer. Psychological Science, 27, 1321-1330. http://dx.doi.org/10.1177/0956797616659930
49. Melton, A. W. (1970). The situation with respect to the spacing of repetitions and memory. Journal of Verbal Learning and Verbal Behavior, 9, 596-606. http://dx.doi.org/10.1016/S0022-5371(70)80107-4
50. Mettler, E., Massey, C. M., & Kellman, P. J. (2016). A comparison of adaptive and fixed schedules of practice. Journal of Experimental Psychology: General, 145, 897-917. http://dx.doi.org/10.1037/xge0000170
51. Moulton, C. A. E., Dubrowski, A., Macrae, H., Graham, B., Grober, E., & Reznick, R. (2006). Teaching surgical skills: What kind of practice makes perfect? A randomized, controlled trial. Annals of Surgery, 244, 400-409
52. Mozer, M. C., Pashler, H., Cepeda, N., Lindsey, R., & Vul, E. (2009). Predicting the optimal spacing of study: A multiscale context model of memory. In Y. Bengio, D. Schuurmans, J. Lafferty, C. K. I. Williams, & A. Culotta (Eds.), Advances in neural information processing systems (Vol. 22, pp. 1321-1329). La Jolla, CA: NIPS Foundation
53. Myung, I. J. (2003). Tutorial on maximum likelihood estimation. Journal of Mathematical Psychology, 47, 90-100. http://dx.doi.org/10.1016/ S0022-2496(02)00028-7
54. Nelson, T. O. (1978). Detecting small amounts of information in memory: Savings for nonrecognized items. Journal of Experimental Psychology: Human Learning and Memory, 4, 453-468. http://dx.doi.org/10.1037/ 0278-7393.4.5.453
55. Nelson, T. O. (1985). Ebbinghaus's contribution to the measurement of retention: Savings during relearning. Journal of Experimental Psychology: Learning, Memory, and Cognition, 11, 472-479. http://dx.doi.org/ 10.1037/0278-7393.11.3.472
56. Oermann, M. H., Kardong-Edgren, S. E., & Odom-Maryon, T. (2011). Effects of monthly practice on nursing students' CPR psychomotor skill performance. Resuscitation, 82, 447-453. http://dx.doi.org/10.1016/j.resuscitation.2010.11.022
57. Paolacci, G., & Chandler, J. (2014). Inside the Turk understanding mechanical Turk as a participant pool. Current Directions in Psychological Science, 23, 184-188. http://dx.doi.org/10.1177/0963721414531598
58. Pashler, H., Zarow, G., & Triplett, B. (2003). Is temporal spacing of tests helpful even when it inflates error rates? Journal of Experimental Psychology: Learning, Memory, and Cognition, 29, 1051-1057. http:// dx.doi.org/10.1037/0278-7393.29.6.1051
59. Pavlik, P. I., & Anderson, J. R. (2008). Using a model to compute the optimal schedule of practice. Journal of Experimental Psychology: Applied, 14, 101-117. http://dx.doi.org/10.1037/1076-898X.14.2.101
60. Pavlik, P. I., Jr., & Anderson, J. R. (2005). Practice and forgetting effects on vocabulary memory: An activation-based model of the spacing effect. Cognitive Science, 29, 559-586. http://dx.doi.org/10.1207/s15516709. cog0000_14
61. Pyc, M. A., & Rawson, K. A. (2012). Why is test-restudy practice beneficial for memory? An evaluation of the mediator shift hypothesis. Journal of Experimental Psychology: Learning, Memory, and Cognition, 38, 737-746. http://dx.doi.org/10.1037/a0026166
62. Raaijmakers, J. G. W. (2003). Spacing and repetition effects in human memory: Application of the SAM model. Cognitive Science, 27, 431-452. http://dx.doi.org/10.1207/s15516709cog2703_5
63. Rawson, K. A., & Dunlosky, J. (2011). Optimizing schedules of retrieval practice for durable and efficient learning: How much is enough? Journal of Experimental Psychology: General, 140, 283-302. http://dx.doi.org/10.1037/a0023956
64. Rawson, K. A., & Dunlosky, J. (2013). Relearning attenuates the benefits and costs of spacing. Journal of Experimental Psychology: General, 142, 1113-1129. http://dx.doi.org/10.1037/a0030498
65. Rawson, K. A., Vaughn, K. E., & Carpenter, S. K. (2015). Does the benefit of testing depend on lag, and if so, why? Evaluating the elaborative retrieval hypothesis. Memory & Cognition, 43, 619-633. http://dx.doi.org/10.3758/s13421-014-0477-z
66. Rawson, K., Vaughn, K., Walsh, M., & Dunlosky, J. (in press). Successive relearning: The next frontier for educationally relevant memory research. Journal of Experimental Psychology: Applied
67. Roediger, H. L., III, & Butler, A. C. (2011). The critical role of retrieval practice in long-term retention. Trends in Cognitive Sciences, 15, 20-27. http://dx.doi.org/10.1016/j.tics.2010.09.003
68. Rohrer, D., & Taylor, K. (2006). The effects of overlearning and distributed practice on the retention of mathematics knowledge. Applied Cognitive Psychology, 20, 1209-1224. http://dx.doi.org/10.1002/acp.1266
69. Schmidt, R. A., & Bjork, R. A. (1992). New conceptualizations of practice: Common principles in three paradigms suggest new concepts for training. Psychological Science, 3, 207-217. http://dx.doi.org/10.1111/j.1467-9280.1992.tb00029.x
70. Seabrook, R., Brown, G. D. A., & Solity, J. E. (2005). Distributed and massed practice: From laboratory to classroom. Applied Cognitive Psychology, 19, 107-122. http://dx.doi.org/10.1002/acp.1066
71. Shiffrin, R. M., Lee, M. D., Kim, W., & Wagenmakers, E. J. (2008). A survey of model evaluation approaches with a tutorial on hierarchical Bayesian methods. Cognitive Science, 32, 1248-1284. http://dx.doi.org/ 10.1080/03640210802414826
72. Simcox, T., & Fiez, J. A. (2014). Collecting response times using Amazon Mechanical Turk and Adobe Flash. Behavior Research Methods, 46, 95-111. http://dx.doi.org/10.3758/s13428-013-0345-y
73. Simons, D. J. (2014). The value of direct replication. Perspectives on Psychological Science, 9, 76-80. http://dx.doi.org/10.1177/174569. 1613514755
74. Smolen, P., Zhang, Y., & Byrne, J. H. (2016). The right time to learn: Mechanisms and optimization of spaced learning. Nature Reviews Neuroscience, 17, 77-88. http://dx.doi.org/10.1038/nrn.2015.18
75. Sobel, H. S., Cepeda, N. J., & Kapler, I. V. (2011). Spacing effects in real-world classroom vocabulary learning. Applied Cognitive Psychology, 25, 763-767. http://dx.doi.org/10.1002/acp.1747
76. Soderstrom, N. C., & Bjork, R. A. (2015). Learning versus performance: An integrative review. Perspectives on Psychological Science, 10, 176-199. http://dx.doi.org/10.1177/1745691615569000
77. Thorndike, E. L. (1912). The curve of work. Psychological Review, 19, 165-194. http://dx.doi.org/10.1037/h0073541
78. Toppino, T. C., & Gerbier, E. (2014). About practice: Repetition, spacing, and abstraction. Psychology of Learning and Motivation, 60, 113-189. http://dx.doi.org/10.1016/B978-0-12-800090-8.00004-4
79. Vaughn, K. E., Dunlosky, J., & Rawson, K. A. (2016). Effects of successive relearning on recall: Does relearning override the effects of initial learning criterion? Memory & Cognition, 44, 897-909. http://dx.doi.org/ 10.3758/s13421-016-0606-y
80. Verkoeijen, P. P., Rikers, R. M., & Schmidt, H. G. (2004). Detrimental influence of contextual change on spacing effects in free recall. Journal of Experimental Psychology: Learning, Memory, and Cognition, 30, 796-800. http://dx.doi.org/10.1037/0278-7393.30.4.796
81. Wagenmakers, E.-J., Grunwald, P. D., & Steyvers, M. (2006). Accumulative prediction error and the selection of time series models. Journal of Mathematical Psychology, 50, 149-166. http://dx.doi.org/10.1016/j.jmp.2006.01.004
82. Wagenmakers, E.-J., Morey, R. D., & Lee, M. D. (2016). Bayesian benefits for the pragmatic researcher. Current Directions in Psychological Science, 25, 169-176. http://dx.doi.org/10.1177/0963721416643289
83. Walsh, M. M., Gluck, K. A., Gunzelmann, G., Jastrzembski, T., & Krusmark, M. (in press). Evaluating the theoretical adequacy and applied potential of computational models of the spacing effect. Cognitive Science
84. Wixted, J. T., & Ebbesen, E. B. (1997). Genuine power curves in forgetting: A quantitative analysis of individual subject forgetting functions. Memory & Cognition, 25, 731-739. http://dx.doi.org/10.3758/ BF03211316
85. Young, J. L. (1971). Reinforcement-test intervals in paired-associate learning. Journal of Mathematical Psychology, 8, 58-81. http://dx.doi.org/ 10.1016/0022-2496(71)90023-X