No evidence of intelligence improvement after working memory training: A randomized, placebo-controlled study

Journal of Experimental Psychology: General

Volumn 142, Issue 2, 2013, Pages 359-379

  Redick, Thomas S ^a   Shipstead, Zach ^a   Harrison, Tyler L ^a   Hicks, Kenny L ^a   Fried, David E ^b   Hambrick, David Z ^b   Kane, Michael J ^c   Engle, Randall W ^a  

^a GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

^b MICHIGAN STATE UNIVERSITY   (United States)

^c UNIVERSITY OF NORTH CAROLINA AT GREENSBORO   (United States)

Author keywords

Attention; Intelligence; Multitasking; Training; Working memory

Indexed keywords

EID: 84881252086     PISSN: 00963445     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0029082     Document Type: Article

References (83)

1. Anguera, J. A., Bernard, J. A., Jaeggi, S. M., Buschkuehl, M., Benson, B. L., Jennett, S., ... Seidler, R. D. (2012). The effects of working memory resource depletion and training on sensorimotor adaptation. Behavioural Brain Research, 228, 107-115. doi:10.1016/j.bbr.2011.11.040
2. Arthur, W., Jr., & Day, D. V. (1994). Development of a short form for the Raven Advanced Progressive Matrices test. Educational and Psychological Measurement, 54, 394-403. doi:10.1177/0013164494054002013
3. Basak, C., Boot, W. R., Voss, M. W., & Kramer, A. F. (2008). Can training in a real-time strategy video game attenuate cognitive decline in older adults? Psychology and Aging, 23, 765-777. doi:10.1037/a0013494
4. Berger, F. R., Gupta, W. B., Berger, R. M., & Skinner, J. (1990). Air Force Officer Qualifying Test (AFOQT) Form P: Test manual (AFHRL Tech. Rep. 89-56). Brooks Air Force Base, TX: Manpower and Personnel Division, Air Force Human Resources Laboratory.
5. Bergman Nutley, S., Söderqvist, S., Bryde, S., Thorell, L. B., Humphreys, K., & Klingberg, T. (2011). Gains in fluid intelligence after training non-verbal reasoning in 4-year-old children: A controlled, randomized study. Developmental Science, 14, 591-601. doi:10.1111/j.1467-7687.2010.01022.x
6. Borella, E., Carretti, B., Riboldi, F., & De Beni, R. (2010). Working memory training in older adults: Evidence of transfer and maintenance effects. Psychology and Aging, 25, 767-778. doi:10.1037/a0020683
7. Brehmer, Y., Westerberg, H., & Bäckman, L. (2012). Working-memory training in younger and older adults: Training gains, transfer, and maintenance. Frontiers in Human Neuroscience, 6, 63. doi:10.3389/fnhum.2012.00063
8. Broadway, J. M., & Engle, R. W. (2010). Validating running memory span: Measurement of working memory capacity and links with fluid intelligence. Behavior Research Methods, 42, 563-570. doi:10.3758/BRM.42.2.563
9. Bühner, M., König, C., Pick, M., & Krumm, S. (2006). Working memory dimensions as differential predictors of the speed and error aspect of multitasking performance. Human Performance, 19, 253-275. doi: 10.1207/s15327043hup1903_4
10. Burgess, G. C., Gray, J. R., Conway, A. A., & Braver, T. S. (2011). Neural mechanisms of interference control underlie the relationship between fluid intelligence and working memory span. Journal of Experimental Psychology: General, 140, 674-692. doi:10.1037/a0024695
11. Buschkuehl, M., & Jaeggi, S. M. (2010). Improving intelligence: A literature review. Swiss Medical Weekly, 140, 266-272.
12. Campbell, D. T., & Stanley, J. C. (1963). Experimental and quasi-experimental designs for research. Chicago, IL: Rand-McNally.
13. Carroll, J. B. (1993). Human cognitive abilities: A survey of factor-analytic studies. New York, NY: Cambridge University Press. doi:10.1017/CBO9780511571312
14. Cattell, R. B. (1973). Measuring intelligence with the Culture Fair tests. Champaign, IL: Institute for Personality and Ability Testing.
15. Chein, J. M., & Morrison, A. B. (2010). Expanding the mind's workspace: Training and transfer effects with a complex working memory span task. Psychonomic Bulletin & Review, 17, 193-199. doi:10.3758/PBR .17.2.193
16. Cohen, G. L., Garcia, J., Apfel, N., & Master, A. (2006). Reducing the racial achievement gap: A social-psychological intervention. Science, 313, 1307-1310. doi:10.1126/science.1128317
17. Colcombe, S., & Kramer, A. F. (2003). Fitness effects on the cognitive function of older adults: A meta-analytic study. Psychological Science, 14, 125-130. doi:10.1111/1467-9280.t01-1-01430
18. Colom, R., Ángeles Quiroga, M., Shih, P.-C., Martínez, K., Burgaleta, M., Martínez-Molina, A., ... Ramírez, I. (2010). Improvement in working memory is not related to increased intelligence scores. Intelligence, 38, 497-505. doi:10.1016/j.intell.2010.06.008
19. Colom, R., Martínez-Molina, A., Shih, P.-C., & Santacreu, J. (2010). Intelligence, working memory, and multitasking performance. Intelligence, 38, 543-551. doi:10.1016/j.intell.2010.08.002
20. Conway, A. R. A., & Getz, S. J. (2010). Cognitive ability: Does working memory training enhance intelligence? Current Biology, 20, R362- R364. doi:10.1016/j.cub.2010.03.001
21. Cronbach, L. J., & Snow, R. E. (1977). Aptitudes and instructional methods: A handbook for research on interactions. Oxford, England: Irvington.
22. Dahlin, E., Nyberg, L., Bäckman, L., & Neely, A. S. (2008). Plasticity of executive functioning in young and older adults: Immediate training gains, transfer, and long-term maintenance. Psychology and Aging, 23, 720-730. doi:10.1037/a0014296
23. Duckworth, A. L., Quinn, P. D., Lynam, D. R., Loeber, R., & Stouthamer-Loeber, M. (2011). Role of test motivation in intelligence testing. Proceedings of the National Academy of Sciences of the United States of America, 108, 7716-7720. doi:10.1073/pnas.1018601108
24. Ekstrom, R. B., French, J. W., Harman, H. H., & Dermen, D. (1976). Manual for kit of factor-referenced cognitive tests. Princeton, NJ: Educational Testing Service.
25. Elsmore, T. F. (1994). SYNWORK: A PC-based tool for assessment of performance in a simulated work environment. Behavior Research Methods, Instrumentation, and Computers, 26, 421-426. doi:10.3758/BF03204659
26. Engle, R. W., Tuholski, S. W., Laughlin, J. E., & Conway, A. R. A. (1999). Working memory, short-term memory, and general fluid intelligence: A latent-variable approach. Journal of Experimental Psychology: General, 128, 309-331. doi:10.1037/0096-3445.128.3.309
27. Fabre, C., Chamari, K., Mucci, P., Masse-Biron, J., & Prefaut, C. (2002). Improvement of cognitive function by mental and/or individualized aerobic training in healthy elderly subjects. International Journal of Sports Medicine, 23, 415-421. doi:10.1055/s-2002-33735
28. Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007). G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods, 39, 175-191. doi: 10.3758/BF03193146
29. Fothergill, S., Loft, S. D., & Neal, A. (2009). ATC-labAdvanced: An air traffic control simulator with realism and control. Behavior Research Methods, 41, 118-127. doi:10.3758/BRM.41.1.118
30. French, J. R. P. (1953). Experiments in field settings. In L. Festinger & D. Katz (Eds.), Research methods in the behavioral sciences (pp. 98-135). New York, NY: Holt, Rinehart, and Wilson.
31. Hambrick, D. Z., Oswald, F. L., Darowski, E. S., Rench, T. A., & Brou, R. (2010). Predictors of multitasking performance in a synthetic work paradigm. Applied Cognitive Psychology, 24, 1149-1167. doi:10.1002/acp.1624
32. Highfield, R. (2008, April 28). "Brain training" games do work, study finds. The Telegraph. Retrieved from http://www.telegraph.co.uk/science/science-news/3340967/Brain-training-games-do-work-study-finds.html
33. Jaeggi, S. M. (2005). Capacity limitations in human cognition: Behavioural and biological considerations (Unpublished doctoral dissertation). University of Bern, Bern, Switzerland.
34. Jaeggi, S. M., Buschkuehl, M., Etienne, A., Ozdoba, C., Perrig, W. J., & Nirkko, A. C. (2007). On how high performers keep cool brains in situations of cognitive control. Cognitive, Affective, & Behavioral Neu-roscience, 7, 75-89. doi:10.3758/CABN.7.2.75
35. Jaeggi, S. M., Buschkuehl, M., Jonides, J., & Perrig, W. J. (2008). Improving fluid intelligence with training on working memory. Proceedings of the National Academy of Sciences of the United States of America, 105, 6829-6833. doi:10.1073/pnas.0801268105
36. Jaeggi, S. M., Buschkuehl, M., Jonides, J., & Shah, P. (2011). Short- and long-term benefits of cognitive training. Proceedings of the National Academy of Sciences of the United States of America, 108, 10081- 10086. doi:10.1073/pnas.1103228108
37. Jaeggi, S. M., Buschkuehl, M., Perrig, W. J., & Meier, B. (2010). The concurrent validity of the N-back task as a working memory measure. Memory, 18, 394-412. doi:10.1080/09658211003702171
38. Jaeggi, S. M., Studer-Luethi, B., Buschkuehl, M., Su, Y.-F., Jonides, J., & Perrig, W. J. (2010). The relationship between n-back performance and matrix reasoning-Implications for training and transfer. Intelligence, 38, 625-635. doi:10.1016/j.intell.2010.09.001
39. Jensen, A. R. (1998). The g factor: The science of mental ability. Westport, CT: Praeger.
40. Kane, M. J., Conway, A. R. A., Hambrick, D. Z., & Engle, R. W. (2007). Variation in working memory capacity as variation in executive attention and control. In A. R. A. Conway, C. Jarrold, M. J. Kane, A. Miyake, & J. N. Towse (Eds.), Variation in working memory (pp. 21-48). New York, NY: Oxford University Press.
41. Kane, M. J., Conway, A. R. A., Miura, T. K., & Colflesh, G. J. H. (2007). Working memory, attention control, and the n-back task: A question of construct validity. Journal of Experimental Psychology: Learning, Memory, and Cognition, 33, 615-622. doi:10.1037/0278-7393.33.3.615
42. Kane, M. J., Hambrick, D. Z., & Conway, A. R. A. (2005). Working memory capacity and fluid intelligence are strongly related constructs: Comment on Ackerman, Beier, and Boyle (2005). Psychological Bulletin, 131, 66-71. doi:10.1037/0033-2909.131.1.66
43. Kane, M. J., Poole, B. J., Tuholski, S. W., & Engle, R. W. (2006). Working memory capacity and the top-down control of visual search: Exploring the boundaries of "executive attention." Journal of Experimental Psychology: Learning, Memory, and Cognition, 32, 749-777. doi:10.1037/0278-7393.32.4.749
44. Klingberg, T. (2010). Training and plasticity of working memory. Trends in Cognitive Sciences, 14, 317-324. doi:10.1016/j.tics.2010.05.002
45. Klingberg, T., Fernell, E., Olesen, P., Johnson, M., Gustafsson, P., Dahl-ström, K., ... Westerberg, H. (2005). Computerized training of working memory in children with ADHD-A randomized, controlled trial. Journal of the American Academy of Child & Adolescent Psychiatry, 44, 177-186. doi:10.1097/00004583-200502000-00010
46. Klingberg, T., Forssberg, H., & Westerberg, H. (2002). Training of working memory in children with ADHD. Journal of Clinical and Experimental Neuropsychology, 24, 781-791. doi:10.1076/jcen.24.6.781.8395
47. Kyllonen, P. C., Lohman, D. F., & Snow, R. E. (1984). Effects of aptitudes, strategy training, and task facets on spatial task performance. Journal of Educational Psychology, 76, 130-145. doi:10.1037/0022-0663.76.1.130
48. Li, S.-C., Schmiedek, F., Huxhold, O., Röcke, C., Smith, J., & Linden-berger, U. (2008). Working memory plasticity in old age: Practice gain, transfer, and maintenance. Psychology and Aging, 23, 731-742. doi: 10.1037/a0014343
49. Loosli, S. V., Buschkuehl, M., Perrig, W. J., & Jaeggi, S. M. (2012). Working memory training improves reading processes in typically developing children. Child Neuropsychology, 18, 62-78. doi:10.1080/09297049.2011.575772
50. Marshalek, B., Lohman, D. F., & Snow, R. E. (1983). The complexity continuum in the radex and hierarchical models of intelligence. Intelligence, 7, 107-127. doi:10.1016/0160-2896(83)90023-5
51. Medalia, A., & Freilich, B. (2008). The Neuropsychological Educational Approach to Cognitive Remediation (NEAR) model: Practice principles and outcome studies. American Journal of Psychiatric Rehabilitation, 11, 123-143. doi:10.1080/15487760801963660
52. Melby-Lervåg, M., & Hulme, C. (2012). Is working memory training effective? A meta-analytic review. Developmental Psychology. Advance online publication. doi:10.1037/a0028228
53. Morrison, A. M., & Chein, J. M. (2011). Does working memory training work? The promise and challenges of enhancing cognition by training working memory. Psychonomic Bulletin & Review, 18, 46-60. doi: 10.3758/s13423-010-0034-0
54. Oberauer, K. (2005). Binding and inhibition in working memory: Individual and age differences in short-term recognition. Journal of Experimental Psychology: General, 134, 368-387. doi:10.1037/0096-3445.134.3.368
55. Oberauer, K., Schulze, R., Wilhelm, O., & Süß, H.-M. (2005). Working memory and intelligence-Their correlation and their relation: Comment on Ackerman, Beier, and Boyle (2005). Psychological Bulletin, 131, 61-65. doi:10.1037/0033-2909.131.1.61
56. Olesen, P. J., Westerberg, H., & Klingberg, T. (2004). Increased prefrontal and parietal activity after training of working memory. Nature Neuro-science, 7, 75-79. doi:10.1038/nn1165
57. Owen, A. M., Hampshire, A., Grahn, J. A., Stenton, R., Dajani, S., Burns, A. S., ... Ballard, C. G. (2010). Putting brain training to the test. Nature, 465, 775-778. doi:10.1038/nature09042
58. Perrig, W. J., Hollenstein, M., & Oelhafen, S. (2009). Can we improve fluid intelligence with training on working memory in persons with intellectual disabilities? Journal of Cognitive Education and Psychology, 8, 148-164. doi:10.1891/1945-8959.8.2.148
59. Pratkanis, A. R., Eskenazi, J., & Greenwald, A. G. (1994). What you expect is what you believe (but not necessarily what you get): A test of the effectiveness of subliminal self-help audiotapes. Basic and Applied Social Psychology, 15, 251-276. doi:10.1207/s15324834basp1503_3
60. Raven, J., Raven, J. C., & Court, J. H. (1998). Manual for Raven's Progressive Matrices and Vocabulary Scales. New York, NY: Psychological Corporation.
61. Redick, T. S., Broadway, J. M., Meier, M. E., Kuriakose, P. S., Unsworth, N., Kane, M. J., & Engle, R. W. (2012). Measuring working memory capacity with automated complex span tasks. European Journal of Psychological Assessment. Advance online publication. doi:10.1027/1015-5759/a000123
62. Redick, T. S., Shipstead, Z., Meier, M. E., Evans, J., Hicks, K. L., Unsworth, N., ... Engle, R. W. (2012). Cognitive predictors of multitasking performance. Manuscript in preparation.
63. Richmond, L. L., Morrison, A. B., Chein, J. M., & Olson, I. R. (2011). Working memory training and transfer in older adults. Psychology and Aging, 26, 813-822. doi:10.1037/a0023631
64. Rosenthal, R. (1979). The file drawer problem and tolerance for null results. Psychological Bulletin, 86, 638-641. doi:10.1037/0033-2909.86.3.638
65. Salomon, G. (1974). Internalization of filmic schematic operations in interaction with learners' aptitudes. Journal of Educational Psychology, 66, 499-511. doi:10.1037/h0036753
66. Salthouse, T. A., & Babcock, R. L. (1991). Decomposing adult age differences in working memory. Developmental Psychology, 27, 763- 776. doi:10.1037/0012-1649.27.5.763
67. Salthouse, T. A., Siedlecki, K. L., & Krueger, L. E. (2006). An individual differences analysis of memory control. Journal of Memory and Language, 55, 102-125. doi:10.1016/j.jml.2006.03.006
68. Schmiedek, F., Hildebrandt, A., Lövdén, M., Wilhelm, O., & Linden-berger, U. (2009). Complex span versus updating tasks of working memory: The gap is not that deep. Journal of Experimental Psychology: Learning, Memory, and Cognition, 35, 1089-1096. doi:10.1037/a0015730
69. Schmiedek, F., Lövdén, M., & Lindenberger, U. (2010). Hundred days of cognitive training enhance broad abilities in adulthood: Findings from the COGITO study. Frontiers in Aging Neuroscience, 2, 27. doi: 10.3389/fnagi.2010.00027
70. Schweizer, S., Hampshire, A., & Dalgleish, T. (2011). Extending brain-training to the affective domain: Increasing cognitive and affective executive control through emotional working memory training. PLoSONE, 6, e24372. doi:10.1371/journal.pone.0024372
71. Seidler, R. D., Bernard, J. A., Buschkuehl, M., Jaeggi, S., Jonides, J., & Humfleet, J. (2010). Cognitive training as an intervention to improve driving ability in the older adult (Tech. Rep. No. M-CASTL 2010-01). Ann Arbor: University of Michigan.
72. Shellenbarger, S. (2011, November 29). Ways to inflate your IQ. New York Times. Retrieved from http://online.wsj.com/article/SB1000142405297020 3935604577066293669642830.html
73. Shipstead, Z., Redick, T. S., & Engle, R. W. (2010). Does working memory training generalize? Psychologica Belgica, 50, 245-276.
74. Shipstead, Z., Redick, T. S., & Engle, R. W. (2012). Is working memory training effective? Psychological Bulletin. Advance online publication. doi:10.1037/a0027473
75. Sternberg, R. J. (2008). Increasing fluid intelligence is possible after all. Proceedings of the National Academy of Sciences of the United States of America, 105, 6791-6792. doi:10.1073/pnas.0803396105
76. Thorell, L. B., Lindqvist, S., Bergman, S., Bohlin, G., & Klingberg, T. (2009). Training and transfer effects of executive functions in preschool children. Developmental Science, 12, 106-113. doi:10.1111/j.1467-7687.2008.00745.x
77. Thorndike, E. L., & Woodworth, R. S. (1901). The influence of improvement in one mental function upon the efficiency of other functions. (I.) Psychological Review, 8, 247-261. doi:10.1037/h0074898
78. Thurstone, L. L. (1938). Primary mental abilities. Chicago, IL: University of Chicago Press.
79. Wang, S., & Aamodt, S. (2009, March 10). Guest column: Can we increase our intelligence? New York Times. Retrieved from http://judson.blogs.nytimes.com/2009/03/10/guest-column-can-we-increase-our-intelligence/
80. Westerberg, H., & Klingberg, T. (2007). Changes in cortical activity after training of working memory-A single-subject analysis. Physiology & Behavior, 92, 186-192. doi:10.1016/j.physbeh.2007.05.041
81. Willis, S. L., Tennstedt, S. L., Marsiske, M., Ball, K., Elias, J., Mann Koepke, K., ... Wright, E. (2006). Long-term effects of cognitive training on everyday functional outcomes in older adults. Journal of the American Medical Association, 296, 2805-2814. doi:10.1001/jama.296.23.2805
82. Zachary, R. A. (1986). Shipley Institute of Living Scale: Revised manual. Los Angeles, CA: Western Psychological Services.
83. Zinke, K., Zeintl, M., Eschen, A., Herzog, C., & Kliegel, M. (2012). Potentials and limits of plasticity induced by working memory training in old-old age. Gerontology, 58, 79-87. doi:10.1159/000324240