Reevaluating the effectiveness of n-back training on transfer through the Bayesian lens: Support for the null

Psychonomic Bulletin and Review

Volumn 23, Issue 1, 2016, Pages 306-316

  Dougherty, Michael R ^a   Hamovitz, Toby ^a   Tidwell, Joe W ^a  

^a UNIVERSITY OF MARYLAND   (United States)

Author keywords

Bayes factors; Meta analysis; N back; Placebo effects; Working memory training

Indexed keywords

BAYES THEOREM; HUMAN; INTELLIGENCE; LEARNING; META ANALYSIS (TOPIC); PHYSIOLOGY; SHORT TERM MEMORY; STATISTICAL ANALYSIS;

BAYES THEOREM; DATA INTERPRETATION, STATISTICAL; HUMANS; INTELLIGENCE; MEMORY, SHORT-TERM; META-ANALYSIS AS TOPIC; TRANSFER (PSYCHOLOGY);

EID: 84957441307     PISSN: 10699384     EISSN: 15315320     Source Type: Journal    
DOI: 10.3758/s13423-015-0865-9     Document Type: Article

References (53)

1. Atlas, L. Y., & Wager, T. D. (2012). How expectations shape pain. Neuroscience letters, 520(2), 140–148. doi:10.1016/j.neulet.2012.03.039
2. Au, J., Sheehan, E., Tsai, N., Duncan, G. J., Buschkuehl, M., & Jaeggi, S. M. (2015). Improving fluid intelligence with training on working memory: A meta-analysis. Psychonomic Bulletin & Review, 22, 366–377. doi:10.3758/s13423-014-0699-x
3. Boot, W. R., Simons, D. J., Stothart, C., & Stutts, C. (2013). The pervasive problem with placebos in psychology: Why active control groups are not sufficient to rule out placebo effects. Perspectives on Psychological Science, 8(4), 445–454. doi:10.1177/1745691613491271
4. Chein, J. M., & Morrison, A. B. (2010). Expanding the mind’s workspace: Training and transfer effects with a complex working memory span task. Psychonomic Bulletin & Review, 17(2), 193–199. doi:10.3758/PBR.17.2.193
5. Chooi, W., & Thompson, L. A. (2012). Working memory training does not improve intelligence in healthy young adults. Intelligence, 40, 531–542.
6. Clouter, A. (2013). The effects of dual n-back training on the components of working memory and fluid intelligence: An individual differences approach. Halifax: Dalhousie University.
7. Colagiuri, B., & Boakes, R. A. (2010). Perceived treatment, feedback, and placebo effects in double-blind RCTs: An experimental analysis. Psychopharmacology, 208(3), 433–441. doi:10.1007/s00213-009-1743-9
8. Colom, R., Román, F. J., Abad, F. J., Shih, P. C., Privado, J., Froufe, M., … Jaeggi, S. M. (2013). Adaptive n-back training does not improve fluid intelligence at the construct level: Gains on individual tests suggest that training may enhance visuospatial processing. Intelligence, 41(5), 712–727. doi:10.1016/j.intell.2013.09.002
9. Core Team, R. (2014). R: A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing. Retrieved from http://www.R-project.org/
10. Dougherty, M. R., & Shanteau, J. (1999). Averaging expectancies and perceptual experiences in the assessment of quality. Acta Psychologica, 101(1), 49–67.
11. Engle, R. W. (2002). Working memory capacity as executive attention. Current Directions in Psychological Science, 11(1), 19–23. doi:10.1111/1467-8721.00160
12. Finniss, D. G., Kaptchuk, T. J., Miller, F., & Benedetti, F. (2010). Biological, clinical, and ethical advances of placebo effects. Lancet, 375(9715), 686–695. doi:10.1016/S0140-6736(09)61706-2
13. Harbison, J. I., Atkins, S. M., & Dougherty, M. R. (2015). Working memory training improves recollection: A cognitive model-based analysis of WM-training. Manuscript submitted for publication.
14. Heinzel, S., Schulte, S., Onken, J., Duong, Q., Riemer, T. G., Heinz, A., … Rapp, M. A. (2013). Working memory training improvements and gains in non-trained cognitive tasks in young and older adults. Aging, Neuropsychology, and Cognition, 21(2), 146–173. doi:10.1080/13825585.2013.790338
15. Hróbjartsson, A., Kaptchuk, T. J., & Miller, F. G. (2011). Placebo effect studies are susceptible to response bias and other types of biases. Journal of Clinical Epidemiology, 64, 1223–1229.
16. Jaeggi, S. M., Buschkuehl, M., Jonides, J., & Perrig, W. J. (2008). Improving fluid intelligence with training on working memory. Proceedings of the National Academy of Sciences of the United States of America, 105(19), 6829–6833. doi:10.1073/pnas.0801268105
17. Jaeggi, S. M., Buschkuehl, M., & Jonides, J. (2009). Working memory training and transfer. Arlington: Presented at the annual ONR Contractor’s meeting.
18. Jaeggi, S. M., Studer-Luethi, B., Buschkuehl, M., Su, Y., Jonides, J., & Perrig, W. J. (2010). The relationship between n-back performance and matrix reasoning—Implications for training and transfer. Intelligence, 38(6), 625–635. doi:10.1016/j.intell.2010.09.001
19. Jaeggi, S. M., Buschkuehl, M., Jonides, J., & Shah, P. (2011). Short- and long-term benefits of cognitive training. Proceedings of the National Academy of Sciences, 108, 10081–10086. doi:10.1073/pnas.1103228108
20. Jaeggi, S. M., Buschkuehl, M., Shah, P., & Jonides, J. (2014). The role of individual differences in cognitive training and transfer. Memory & Cognition, 42(3), 464–480. doi:10.3758/s13421-013-0364-z
21. Jeffreys, H. (1961). Theory of probability. New York: Oxford University Press.
22. Kam-Hansen, S., Jakubowski, M., Kelley, J. M., Kirsch, I., Hoaglin, D. C., Kaptchuk, T. J., … Burstein, R. (2014). Altered placebo and drug labeling changes the outcome of episodic migraine attacks. Science translational medicine, 6(218), 218ra5. doi:10.1126/scitranslmed.3006175
23. Karbach, J., & Verhaeghen, P. (2014). Making working memory work: A meta-analysis of executive-control and working memory training in older adults. Psychological Science. doi:10.1177/0956797614548725
24. Kass, R. E., & Raftery, A. E. (1995). Bayes factor. Journal of the American Statistical Association, 90, 773–795.
25. Katz, B., Jaeggi, S. M., Buschkuehl, M., Shah, P., & Jonides, J. (2015). Money can’t buy you fluid intelligence (but it might not hurt either): The effect of compensation on transfer following a working memory intervention. Manuscript under review.
26. Kundu, B., Sutterer, D. W., Emrich, S. M., & Postle, B. R. (2013). Strengthened effective connectivity underlies transfer of working memory training to tests of short-term memory and attention. The journal of Neuroscience, 33(20), 8705–8715. doi:10.1523/JNEUROSCI.5565-12.2013
27. Lilienthal, L., Tamez, E., Shelton, J. T., Myerson, J., & Hale, S. (2013). Dual n-back training increases the focus of attention. Psychonomic Bulletin & Review, 20, 135–141.
28. Melby-Lervåg, M., & Hulme, C. (2012). Is working memory training effective? A meta-analytic review. Developmental Psychology, 49(2), 270–291. doi:10.1037/a0028228
29. Melby-Lervåg, M., & Hulme, C. (2015). There is no convincing evidence that working memory training is effective: A reply to Au, et al. (2015) and Karbach and Verhaeghen (2014). Manuscript submitted for publication.
30. Morey, D., Rouder, J. N., & Jamil, T. (2014). Bayes factor: Computation of Bayes factors for common designs (R package version 0.9.8). Retrieved from http://CRAN.R-project.org/package=BayesFactor
31. Oei, A. C., & Patterson, M. D. (2013). Enhancing cognition with video games: A multiple game training study. PLOS ONE, 8(3), e58546. doi:10.1371/journal.pone.0058546
32. Oelhafen, S., Nikolaidis, A., Padovani, T., Blaser, D., Koenig, T., & Perrig, W. J. (2013). Increased parietal activity after training of interference control. Neuropsychologia, 51(13), 2781–2790. doi:10.1016/j.neuropsychologia.2013.08.012
33. Raftery, A. (1995). Bayesian model selection in social research. Sociological Methodology. Retrieved from https://www.stat.washington.edu/raftery/Research/PDF/socmeth1995.pdf
34. Redick, T. S., Shipstead, Z., Harrison, T. L., Hicks, K. L., Fried, D. E., Hambrick, D. Z., … Engle, R. W. (2013). No evidence of intelligence improvement after working memory training: A randomized, placebo-controlled study. Journal of Experimental Psychology: General, 142(2), 359–379. doi:10.1037/a0029082
35. Rode, C., Robson, R., Purviance, A., Geary, D. C., & Mayr, U. (2014). Is working memory training effective? A study in a school setting. PLOS ONE, 9(8), e104796. doi:10.1371/journal.pone.0104796
36. Rouder, J. N., & Morey, R. D. (2011). A Bayes factor meta-analysis of Bem’s ESP claim. Psychonomic Bulletin & Review, 18(4), 682–689. doi:10.3758/s13423-011-0088-7
37. Rouder, J. N., Speckman, P. L., Sun, D., Morey, R. D., & Iverson, G. (2009). Bayesian t tests for accepting and rejecting the null hypothesis. Psychonomic Bulletin & Review, 16(2), 225–237. doi:10.3758/PBR.16.2.225
38. Rouder, J. N., Morey, R. D., & Province, J. M. (2013). A Bayes factor meta-analysis of recent extrasensory perception experiments: Comment on Storm, Tressoldi, and Di Risio (2010). Psychological Bulletin, 139(1), 241–247. doi:10.1037/a0029008
39. Rudebeck, S. R., Bor, D., Ormond, A., O’Reilly, J. X., & Lee, A. C. H. (2012). A potential spatial working memory training task to improve both episodic memory and fluid intelligence. PLOS OME, 7(11), e50431. doi:10.1371/journal.pone.0050431
40. Salminen, T., Strobach, T., & Schubert, T. (2012). On the impacts of working memory training on executive functioning. Frontiers in human neuroscience, 6(June), 166. doi:10.3389/fnhum.2012.00166
41. Schwarb, H. (2012). Optimized cognitive training: Investigating the limits of brain training on generalized cognitive function (Unpublished doctoral dissertation). Atlanta: Georgia Institute of Technology.
42. Schweizer, S., Hampshire, A., & Dalgleish, T. (2011). Extending brain-training to the affective domain: Increasing cognitive and affective executive control through emotional working memory training. PLOS ONE, 6(9), e24372. doi:10.1371/journal.pone.0024372
43. Seidler, R., Bernard, J., Buschkuehl, M., Jaeggi, S. M., Jonides, J., & Humfleet, J. (2010). Cognitive training as an intervention to improve driving ability in the older adult. Ann Arbor: University of Michigan.
44. Shipstead, Z., Redick, T. S., & Engle, R. W. (2012). Is working memory training effective? Psychological Bulletin, 138(4), 628. doi:10.1037/a0027473
45. Smith, S. P., Stibric, M., & Smithson, D. (2013). Exploring the effectiveness of commercial and custom-built games for cognitive training. Computers in Human Behavior, 29(6), 2388–2393. doi:10.1016/j.chb.2013.05.014
46. Sprenger, A. M., Atkins, S. M., Bolger, D. J., Harbison, J. I., Novick, J. M., Chrabaszcz, J. S., … Dougherty, M. R. (2013). Training working memory: Limits of transfer. Intelligence, 41(5), 638–663. doi:10.1016/j.intell.2013.07.013
47. Stephenson, C. L., & Halpern, D. F. (2013). Improved matrix reasoning is limited to training on tasks with a visuospatial component. Intelligence, 41(5), 341–357. doi:10.1016/j.intell.2013.05.006
48. Thompson, T. W., Waskom, M. L., Garel, K.-L., Cardenas-Iniguez, C., Reynolds, G. O., Winter, R., … Gabrieli, J. D. E. (2013). Failure of working memory training to enhance cognition or intelligence. PLOS ONE, 8(5), e63614. doi:10.1371/journal.pone.0063614
49. Tidwell, J. W., Dougherty, M. R., Chrabaszcz, J. R., Thomas, R. P., & Mendoza, J. L. (2014). What counts as evidence for working memory training? Problems with correlated gains and dichotomization. Psychonomic Bulletin & Review, 21(3), 620–628. doi:10.3758/s13423-013-0560-7
50. von Bastian, C. C., & Eschen, A. (2015). Does working memory training need to be adaptive? Psychological Research. doi:10.1007/s00426-015-0655-z
51. Wagenmakers, E.-J. (2007). A practical solution to the pervasive problems of p values. Psychonomic Bulletin & Review, 14(5), 779–804.
52. Wetzels, R., Matzke, D., Lee, M. D., Rouder, J. N., Iverson, G. J., & Wagenmakers, E. (2011). Statistical evidence in experimental psychology: An empirical comparison using 855 t tests. Perspectives on Psychological Science, 6(3), 291–298. doi:10.1177/1745691611406923
53. Willcutt, E. G., Doyle, A. E., Nigg, J. T., Faraone, S. V., & Pennington, B. F. (2005). Validity of the executive function theory of attention-deficit/hyperactivity disorder: A meta-analytic review. Biological Psychiatry, 57(11), 1336–1346. doi:10.1016/j.biopsych.2005.02.006