Working memory training revisited: A multi-level meta-analysis of n-back training studies

Psychonomic Bulletin and Review

Volumn 24, Issue 4, 2017, Pages 1077-1096

  Soveri, Anna ^a   Antfolk, Jan ^a   Karlsson, Linda ^a   Salo, Benny ^a   Laine, Matti ^a,b  

^a ÅBO AKADEMI UNIVERSITY   (Finland)

^b University of Turku and Turku University Hospital   (Finland)

Author keywords

Cognitive training; Executive functions; Meta analysis; N back; Working memory

Indexed keywords

COGNITION; EXECUTIVE FUNCTION; HUMAN; LEARNING; META ANALYSIS; SHORT TERM MEMORY;

COGNITION; EXECUTIVE FUNCTION; HUMANS; LEARNING; MEMORY, SHORT-TERM;

EID: 85010739033     PISSN: 10699384     EISSN: 15315320     Source Type: Journal    
DOI: 10.3758/s13423-016-1217-0     Document Type: Article

References (87)

1. *Anguera, J. A., Bernard, J. A., Jaeggi, S. M., Buschkuehl, M., Benson, B. L. Jennett, S., …Seidler, R. D. (2012). The effects of working memory resource depletion and training on sensorimotor adaptation. Behavioral Brain Research, 228(1), 107–115. doi:10.1016/j.bbr.2011.11.040
2. Au, J., Buschkuehl, M., Duncan, G. J., & Jaeggi, S. M. (2016). There is no convincing evidence that working memory training is NOT effective: A reply to Melby-Lervåg and Hulme (2015). Psychonomic Bulletin & Review, 23(1), 331–337. doi:10.3758/s13423-015-0967-4
3. Au, J., Sheehan, E., Tsai, N., Duncan, G. J., Buschkuehl, M., & Jaeggi, S. M. (2015). Improving fluid intelligence with training on working memory: A meta-analysis. Psychonomic Bulletin & Review, 22(2), 366–377. doi:10.3758/s13423-014-0699-x
4. Bäckman, L., Nyberg, L., Soveri, A., Johansson, J., Andersson, M., Dahlin, E., … Rinne, J. O. (2011). Effects of working-memory training on striatal dopamine release. Science, 333(6043), 718. doi: 10.1126/science.1204978
5. Baddeley, A. (2000). The episodic buffer: A new component of working memory? Trends in Cognitive Sciences, 4(11), 417–423. doi:10.1016/S1364-6613(00)01538-2
6. *Beavon, P. (2012). Improving memory using n-back training (Bachelor’s thesis). Retrieved from http://ro.ecu.edu.au/theses_hons/65/
7. Becker, B. J. (2000). Multi-variate meta-analysis. In H. E. A. Tinsley & E. D. Brown (Eds.), Handbook of Applied Multivariate Statistics and Mathematical Modelling (pp. 499–525). Orlando: Academic Press.
8. Bishop, D. V., & Thompson, P. A. (2016). Problems in using p-curve analysis and text-mining to detect rate of p-hacking and evidential value. PeerJ, 4, e1715. doi:10.7717/peerj.1715
9. Bogg, T. & Lasecki, L. (2014). Reliable gains? Evidence for substantially underpowered designs in studies of working memory training transfer to fluid intelligence. Frontiers in Psychology, 22(5). doi: 10.3389/fpsyg.2014.01589
10. Brehmer, Y., Westerberg, H., & Bäckman, L. (2012). Working-memory training in younger and older adults: Training gains, transfer, and maintenance. Frontiers in Human Neuroscience, 6(63). doi:10.3389/fnhum.2012.00063
11. *Bürki, C. N., Ludwig, C., Chicherio, C., & De Ribaupierre, A. (2014). Individual differences in cognitive plasticity: An investigation of training curves in younger and older adults. Psychological Research, 78(6), 821–835. doi:10.1007/s00426-014-0559-3
12. *Buschkuehl, M., Hernandez-Garcia, L., Jaeggi, S.M., Bernard, J. A., & Jonides, J. (2014). Neural effects of short-term training on working memory. Cognitive, Affective, & Behavioral Neuroscience, 14(1), 147–160. doi: 10.3758/s13415-013-0244-9
13. *Chooi, W.-T., & Thompson, L. A. (2012). Working memory training does not improve intelligence in healthy young adults. Intelligence, 40(6), 531–542. doi:10.1016/j.intell.2012.07.004
14. *Colom, R., Román, F. J., Abad, F. J., Shih, P. C., Privado, J., Froufe, M., … Jaeggi, S.M. (2013). Adaptive n-back training does not improve fluid intelligence at the construct level: Gains on individual tests suggest that training may enhance visuospatial processing. Intelligence, 41(5), 712–727. doi:10.1016/j.intell.2013.09.002
15. Dahlin, E., Neely, A. S., Larsson, A., Bäckman, L., & Nyberg, L. (2008). Transfer of learning after updating training mediated by the striatum. Science, 320(5882), 1510–1512. doi:10.1126/science.1155466
16. Dougherty, M. R., Hamovitz, T., & Tidwell, J. W. (2016). Reevaluating the effectiveness of n-back training on transfer through the Bayesian lens: Support for the null. Psychonomic Bulletin & Review, 23(1), 306–316. doi:10.3758/s13423-015-0865-9
17. Duval, S., & Tweedie, R. (2000). Trim and fill: A simple funnel-plot based method of testing and adjusting for publication bias in meta-analysis. Biometrics, 56(2), 455–463.
18. Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997). Bias in meta-analysis detected by a simple, graphical test. BMJ, 315(7109), 629–634. doi:10.1136/bmj.315.7109.629
19. Engle, R. W. (2002). Working memory capacity as executive attention. Current Directions in Psychological Science, 11(1), 19–23.
20. Gibson, B. S., Gondoli, D. M., Johnson, A. C., Steeger, C. M., & Morrissey, R. M. (2012). The future promise of Cogmed working memory training. Journal of Applied Research in Memory and Cognition, 1(3), 214–216. doi:10.1016/j.jarmac.2012.07.003
21. Green, C. S., & Bavelier, D. (2008). Exercising your brain: A review of human brain plasticity and training-induced learning. Psychology and Aging, 23(4), 692–701. doi:10.1037/a0014345
22. *Heffernan, A. E. (2014). The generalizability of dual n-back training in younger adults (Master’s thesis). Retrieved from http://hdl.handle.net/10222/56021
23. *Heinzel, S., Lorenz, R. C., Pelz, P., Heinz, A., Walter, H., Kathmann, N., … Stelzel, C. (2016). Neural correlates of training and transfer effects in working memory in older adults. NeuroImage, 134, 236–249. doi: 10.1016/j.neuroimage.2016.03.068
24. *Heinzel, S., Schulte, S., Onken, J., Duong, Q-L., Riemer, T. G., Heinz, A., … Rapp, M. A. (2014). Working memory training improvements and gains in non-trained cognitive tasks in young and older adults. Aging, Neuropsychology, and Cognition, 21(2), 146–173. doi:10.1080/13825585.2013.790338
25. Hindin, S. B., & Zelinski, E. M. (2012). Extended practice and aerobic exercise interventions benefit untrained cognitive outcomes in older adults: A meta-analysis. Journal of the American Geriatrics Society, 60(1), 136–141. doi:10.1111/j.1532-5415.2011.03761.x
26. *Jaeggi, S. M., Buschkuehl, M., Jonides, J., & Perrig, W. J. (2008). Improving fluid intelligence with training on working memory. PNAS, 105(19), 6829–6833. doi:10.1073/pnas.0801268105
27. *Jaeggi, S. M., Buschkuehl, M., Shah, P., & Jonides, J. (2014). The role of individual differences in cognitive training and transfer. Memory and Cognition, 42(3), 464–480. doi:10.3758/s13421-013-0364-z
28. *Jaeggi, S. M., Buschkuehl, M., & Jonides, J. (2009). Working memory training and transfer. Unpublished data presented at the ONR contractor's meeting, Arlington, VA.
29. *Jaeggi, S. M., Studer-Luethi, B., Buschkuehl, M., Su, Y.-F., Jonides, J., & Perrig, W. J. (2010). The relationship between n-back performance and matrix reasoning — implications for training and transfer. Intelligence 38(6), 625–635. doi:10.1016/j.intell.2010.09.001
30. *Kane, M. J., Hambrick, D. Z., & Conway, A. R. A. (2005). Working memory capacity and fluid intelligence are strongly related constructs: Comment on Ackerman, Beier, and Boyle (2005). Psychological Bulletin, 131(1), 66–71. doi:10.1037/0033-2909.131.1.66. author reply 72–75.
31. Karbach, J., & Verhaeghen, P. (2014). Making working memory work: A meta-analysis of executive-control and working memory training in older adults. Psychological Science, 25(11), 2027–2037. doi:10.1177/0956797614548725
32. Karr, J. E., Areshenkoff, C. N., Rast, P., & Garcia-Barrera, M. A. (2014). An empirical comparison of the therapeutic benefits of physical exercise and cognitive training on the executive functions of older adults: A meta-analysis of controlled trials. Neuropsychology, 28(6), 829–845. doi:10.1037/neu0000101
33. Kelly, M. E., Loughrey, D., Lawlor, B. A., Robertson, I. H., Walsh, C., & Brennan, S. (2014). The impact of cognitive training and mental stimulation on cognitive and everyday functioning of healthy older adults: A systematic review and meta-analysis. Ageing Research Reviews, 15, 28–43. doi:10.1016/j.arr.2014.02.004
34. Kirchner, W. K. (1958). Age differences in short-term retention of rapidly changing information. Journal of Experimental Psychology, 55(4), 352–358.
35. Klingberg, T. (2010). Training and plasticity of working memory. Trends in Cognitive Sciences, 14(7), 317–324. doi:10.1016/j.tics.2010.05.002
36. Klingberg, T., Fernell, E., Olesen, P. J., Johnson, M., Gustafsson, P., Dahlström, K., … Westerberg, H. (2005). Computerized training of working memory in children with ADHD--a randomized, controlled trial. Journal of the American Academy of Child and Adolescent Psychiatry, 44(2), 177–186.
37. Klingberg, T., Forssberg, H., & Westerberg, H. (2002). Training of working memory in children with ADHD. Journal of Clinical and Experimental Neuropsychology, 24(6), 781–791.
38. Kundu, B., Sutterer, D. W., Emrich, S. M., & Postle, B. R. (2013). Strengthened effective connectivity underlies transfer of working memory training to tests of short-term memory and attention. The Journal of Neuroscience, 33(29), 8705–8715. doi:10.1523/JNEUROSCI.5565-12.2013
39. *Küper, K., & Karbach, J. (2016). Increased training complexity reduces the effectiveness of brief working memory training: Evidence from short-term single and dual n-back training interventions. Journal of Cognitive Psychology, 28(2), 199–208. doi: 10.1080/20445911.2015.1118106
40. Lezak, M. D., Howieson, D. B., & Loring, D. W. (2004). Neuropsychological Assessment. New York: Oxford University Press.
41. *Lilienthal, L., Tamez, E., Shelton, J. T., Myerson, J., & Hale, S. (2013). Dual n-back training increases the capacity of the focus of attention. Psychonomic Bulletin and Review, 20(1), 135–141. doi:10.3758/s13423-012-0335-6
42. Lövdén, M., Bäckman, L., Lindenberger, U., Schaefer, S., & Schmiedek, F. (2010). A theoretical framework for the study of adult cognitive plasticity. Psychological Bulletin, 136(4), 659–676. doi:10.1037/a0020080
43. Melby-Lervåg, M., & Hulme, C. (2013). Is working memory training effective? A meta-analytic review. Developmental Psychology, 49(2), 270–291. doi:10.1037/a0028228
44. Melby-Lervåg, M., & Hulme, C. (2016). There is no convincing evidence that working memory training is effective: A reply to Au et al. (2014) and Karbach and Verhaeghen (2014). Psychonomic Bulletin & Review, 23(1), 324–330. doi:10.3758/s13423-015-0862-z
45. Melby-Lervåg, M., Redick, T., & Hulme, C. (2016). Working memory training does not improve performance on measures of intelligence or other measures of “far transfer”: Evidence from a meta-analytic review. Perspectives on Psychological Science, 11(4), 512–534. doi:10.1177/1745691616635612
46. Miller, K. M., Price, C. C., Okun, M. S., Montijo, H., & Bowers, D. (2009). Is the n-back task a valid neuropsychological measure for assessing working memory? Archives of Clinical Neuropsychology, 24(7), 711–717. doi:10.1093/arclin/acp063
47. Miyake, A., Friedman, N. P., Emerson, M. J., Witzki, A. H., Howerter, A., & Wager, T. D. (2000). The unity and diversity of executive functions and their contributions to complex “frontal lobe” tasks: A latent variable analysis. Cognitve Psychology, 41(1), 49–100.
48. Moreno, S. G., Sutton, A. J., Ades, A. E., Stanley, T. D., Abrams, K. R., Peters, J. L., & Cooper, N. J. (2009). Assessment of regression-based methods to adjust for publication bias through a comprehensive simulation study. BMC Medical Research Methodology, 9(2). doi: 10.1186/1471-2288-9-2
49. Morrison, A. B., & Chein, J. M. (2011). Does working memory training work? The promise and challenges of enhancing cognition by training working memory. Psychonomic Bulletin and Review, 18(1), 46–60. doi:10.3758/s13423-010-0034-0
50. NIMH Research Domain Criteria Workshop (2010). Working memory: Workshop proceedings. Downloaded November 8, 2016 from https://www.nimh.nih.gov/research-priorities/rdoc/working-memory-workshop-proceedings.shtml
51. *Oelhafen, S., Nikolaidis, A., Padovani, T., Blaser, D., Koenig, T., & Perrig, W. J. (2013). Increased parietal activity after training of interference control. Neuropsychologia, 51(13), 2781–90. doi:10.1016/j.neuropsychologia.2013.08.012
52. Peters, J. L., Sutton, A. J., Jobes, D. R., Abrams, K. R., & Rushton, L. (2008). Contour-enhanced meta-analysis funnel plots help distinguish publication bias from other causes of asymmetry. Journal of Clinical Epidemiology, 31(10), 991–996. doi:10.1016/j.jclinepi.2007.11.010
53. *Prandl, A. (2012). Visual memory improvement in recognition (Bachelor’s thesis). Retrieved from http://ro.ecu.edu.au/theses_hons/59/
54. *Preece, D. (2011). The effect of working memory (n-back) training on fluid intelligence (Bachelor’s thesis). Retrieved from http://ro.ecu.edu.au/theses_hons/54/
55. R Core Team. (2008). R: A Language and Environment for Statistical Computing. Vienna: R Foundation for Statistical Computing.
56. Redick, T. S., & Lindsey, D. R. (2013). Complex span and n-back measures of working memory: A meta-analysis. Psychonomic Bulletin & Review, 20(6), 1102–1113. doi:10.3758/s13423-013-0453-9
57. *Redick, T. S., Shipstead, Z., Harrison, T. L., Hicks, K. L., Fried, D. E., Hambrick, D. Z., … Engle, R. W. (2013). No evidence of intelligence improvement after working memory training: A randomized, placebo-controlled study. Journal of Exprimental Psychology: General, 142(2), 359–379. doi:10.1037/a0029082
58. Rothstein, H. R., Sutton, A. J., & Borenstein, M. (2005). Publication Bias in Meta-Analysis: Prevention, Assessment and Adjustments. Chichester: John Wiley & Sons.
59. *Rudebeck, S. R., Bor, D., Ormond, A., O’Reilly, J. X. & Lee, A. C. H. (2012). A potential spatial working memory training task to improve both episodic memory and fluid intelligence. PLoS ONE, 7(11): e50431. doi:10.1371/journal.pone.0050431
60. *Salminen, T., Frensch, P., Strobach, T., & Schubert, T. (2016). Age-specific differeneces of dual n-back training. Aging, Neurospychology, and Cognition, 23(1), 18–39. doi: 10.1080/13825585.2015.1031723
61. *Salminen, T., Strobach, T., & Schubert, T. (2012). On the impacts of working memory training on executive functioning. Frontiers in Human Neuroscience, 6, 166. doi:10.3389/fnhum.2012.00166
62. Schmiedek, F., Lövdén, M., & Lindenberger, U. (2010). Hundred days of cognitive training enhance broad cognitive abilities in adulthood: Findings from the COGITO study. Frontiers in Aging Neuroscience, 2, 27. doi:10.3389/fnagi.2010.00027
63. Schmiedek, F., Lövdén, M., & Lindenberger, U. (2014). A task is a task is a task: Putting complex span, n-back, and other working memory indicators in psychometric context. Frontiers in Psychology, 5. doi: 10.3389/fpsyg.2014.01475
64. Schwaighofer, M., Fischer, F., & Bühner, M. (2015). Does working memory training transfer? A meta-analysis including training conditions as moderators. Educational Psychologist, 50(2), 138–166. doi:10.1080/00461520.2015.1036274
65. *Schwarb, H., Nail, J., & Schumacher, E. H. (2015). Working memory training improves visual short-term memory capacity. Psychological Research, 80(1), 128–148. doi: 10.1007/s00426-015-0648-y
66. *Schweizer, S., Hampshire, A., & Dalgleish, T. (2011). Extending brain-training to the affective domain: Increasing cognitive and affective executive control through emotional working memory training. PLoS ONE, 6(9), 1–5. doi:10.1371/journal.pone.0024372
67. Seidler, R. D., Bernard, J. A., Buschkuehl, M., Jaeggi, S., Jonides, J., & Humfleet, J. (2010). Cognitive training as an intervention to improve driving ability in the older adult. Technical Report No. M-CASTL 2010-01. Ann Arbor: University of Michigan.
68. Shipstead, Z., Hicks, K. L., & Engle, R. W. (2012). Working memory training remains a work in progress. Journal of Applied Research in Memory and Cognition, 1(3), 217–219. doi:10.1016/j.jarmac.2012.07.009
69. Shipstead, Z., Redick, T. S., & Engle, R. W. (2010). Does working memory training generalize? Psychologica Belgica, 50(3 & 4), 245–276.
70. Shipstead, Z., Redick, T. S., & Engle, R. W. (2012). Is working memory training effective? Psychological Bulletin, 138(4), 628–654. doi:10.1037/a0027473
71. Simonsohn, U., Nelson, L. D., & Simmons, J. P. (2014). p-curve and effect size. Correcting for publication bias using only significant results. Perspectives on Psychological Science, 9(6), 666–681. doi:10.1177/1745691614553988
72. *Smith, S. P., Stibric, M., & Smithson, D. (2013). Exploring the effectiveness of commercial and custom-built games for cognitive training. Computers in Human Behavior, 29(6), 2388–2393. doi:10.1016/j.chb.2013.05.014
73. Stanley, T. D., & Doucouliagos, H. (2014). Meta-regression approximations to reduce publication selection bias. Research Synthesis Methods, 5(1), 60–78. doi:10.1002/jrsm.1095
74. *Stepankova, H., Lukavsky, J., Buschkuehl, M., Kopecek, M., Ripova, D., & Jaeggi, S. M. (2013). The malleability of working memory and visuospatial skills: A randomized controlled study in older adults. Developmental Psychology, 50(4), 1049–1059. doi: 10.1037/a0034913
75. *Stephenson, C. L., & Halpern, D. F. (2013). Improved matrix reasoning is limited to training on tasks with a visuospatial component. Intelligence, 4(5), 341–357. doi:10.1016/j.intell.2013.05.006
76. Szmalec, A., Verbruggen, F., Vandierendonck, A., & Kemps, E. (2011). Control of interference during working memory updating. Journal of Experimental Psychology Human Perception & Performance, 37(1), 137–151. doi:10.1037/a0020365
77. *Thompson, T. W., Waskom, M. L., Garel, K.-L. A., Cardenas-Iniguez, C., Reynolds, G. O., Winter, R., … Gabrieli, J. D. E. (2013). Failure of working memory training to enhance cognition or intelligence. PloS ONE, 8(5). doi:10.1371/journal.pone.0063614
78. Unsworth, N., & Engle, R. W. (2007). On the division of short-term and working memory: An examination of simple and complex span and their relation to higher order abilities. Psychological Bulletin, 133(6), 1038–1066. doi: 10.1037/0033-2909.133.6.1038
79. *Urbánek, T., & Marček, V. (2015). Investigating the effectiveness of working memory training in the context of Personality Systems Interaction theory. Psychological Research, 80(5), 877–888, doi: 10.1007/s00426-015-0687-4
80. van den Noortgate, W., López-López, J. A., Marín-Martínez, F., & Sánchez-Meca, J. (2013). Three-level meta-analysis of dependent effect sizes. Behavior Research Methods, 45(2), 576–594. doi:10.3758/s13428-012-0261-6
81. *Vartanian, O., Jobidon, M.-E., Bouak, F., Nakashima, A., Smith, I., Lam, Q., & Cheung, B. (2013). Working memory training is associated with lower prefrontal cortex activation in a divergent thinking task. Neuroscience, 236, 186–194. doi: 10.1016/j.neuroscience.2012.12.060
82. Viechtbauer, W. (2010). Conducting meta-analyses in R with the metafor package. Journal of Statistical Software, 36(3), 1–48.
83. Von Bastian, C. C., & Oberauer, K. (2014). Effects and mechanisms of working memory training: A review. Psychological Research, 78(6), 803–820. doi:10.1007/s00426-013-0524-6
84. Waris, O., Soveri; A., & Laine, M. (2015). Transfer after working memory updating training. PLoS ONE, 10(9). doi:10.1371/journal.pone.0138734
85. Weicker, J., Villringer, A., & Thöne-Otto, A. (2016). Can impaired working memory functioning be improved by training? A meta-analysis with a special focus on brain injured patients. Neuropsychology, 30(2), 190–212. doi:10.1037/neu0000227
86. *Zajac-Lamparska, L., & Trempala, J. (2016). Effects of working memory and attentional control training and their transfer onto fluid intelligence in early and late adulthood. Health Psychology Report, 4(1), 41–53. doi: 10.5114/hpr.2016.56846
87. *Zhang, Q., Buschkuehl, M., Bernat, E., & Jaeggi, S. M. (2014, May 22–25). EEG power changes as a function of working memory training. Poster presented at the 26th annual convention of the Association for Psychological Science, San Francisco, CA.