Adaptive n-back training does not improve fluid intelligence at the construct level: Gains on individual tests suggest that training may enhance visuospatial processing

Intelligence

Volumn 41, Issue 5, 2013, Pages 712-727

  Colom, Roberto ^a   Román, Francisco J ^a   Abad, Francisco J ^a   Shih, Pei Chun ^a   Privado, Jesús ^b   Froufe, Manuel ^a   Escorial, Sergio ^b   Martínez, Kenia ^a   Burgaleta, Miguel ^a,c   Quiroga, M A ^b   Karama, Sherif ^d   Haier, Richard J ^e   Thompson, Paul M ^f,g   Jaeggi, Susanne M ^e  

^a UNIVERSIDAD AUTÓNOMA DE MADRID   (Spain)

^b UNIVERSIDAD COMPLUTENSE DE MADRID   (Spain)

^c UNIVERSITAT POMPEU FABRA   (Spain)

^d MCGILL UNIVERSITY   (Canada)

^e UNIVERSITY OF CALIFORNIA   (United States)

^f UNIVERSITY OF CALIFORNIA   (United States)

^g UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

Attention; Cognitive training; Intelligence; Working memory

Indexed keywords

EID: 84885812906     PISSN: 01602896     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.intell.2013.09.002     Document Type: Article

References (63)

1. Adair J.G., Sharpe D., Huynh C.L. Hawthorne control procedures in educational experiments: A reconsideration of their use and effectiveness. Review of Educational Research 1989, 59(2):215-228.
2. Anastasi A. Practice and variability. Psychological Monographs 1934, 45:5.
3. Bjorner J.B., Smith K.J., Stone C., Sun X. IRTFIT: A macro for item fit and local dependence tests under IRT models 2007, Quality Metric, Inc., Lincoln.
4. Bock R.D., Aitkin M. Marginal maximum likelihood estimation of item parameters: Application of an EM algorithm. Psychometrika 1981, 46:443-459.
5. Cai L., du Toit S.H.C., Thissen D. IRTPRO: Flexible, multidimensional, multiple categorical IRT modeling [computer software and manual] 2011, Scientific Software International, Chicago, IL.
6. Carpenter P.A., Just M.A., Shell P. What one intelligence test measures: A theoretical account of the processing in the Raven Progressive Matrices Test. Psychological Review 1990, 97:404-431.
7. Carroll J.B. Human cognitive abilities 1993, Cambridge University Press, Cambridge.
8. Carroll J.B. The higher-stratum structure of cognitive abilities: Current evidence supports g and about 10 broad factors. The scientific study of general intelligence: Tribute to Arthur R. Jensen 2003, 5-21. Pergamon, Amsterdam. H. Nyborg (Ed.).
9. Cattell R.B. Intelligence: Their structure, growth and action 1987, North-Holland, Amsterdam.
10. Chooi W., Thompson L.A. Working memory training does not improve intelligence in healthy young adults. Intelligence 2012, 40:531-542.
11. Colom R., Abad F.J., Quiroga Ma.A., Shih P.C., Flores-Mendoza C. Working memory and intelligence are highly related constructs, but why?. Intelligence 2008, 36:584-606.
12. Colom R., Jung R.E., Haier R.J. General intelligence and memory span: Evidence for a common neuro-anatomic framework. Cognitive Neuropsychology 2007, 24:867-878.
13. Colom R., Quiroga Ma.A., Shih P.C., Martínez K., Burgaleta M., Martínez-Molina A., et al. Improvement in working memory is not related to increased intelligence scores. Intelligence 2010, 38:497-505.
14. Colom R., Quiroga Ma.Á., Solana A.B., Burgaleta M., Román F.J., Privado J., et al. Structural changes after videogame practice related to a brain network associated with intelligence. Intelligence 2012, 40:479-489.
15. Colom R., Rebollo I., Abad F.J., Shih P.C. Complex span tasks, simple span tasks, and cognitive abilities: A re-analysis of key studies. Memory & Cognition 2006, 34:158-171.
16. Colom R., Rebollo I., Palacios A., Juan-Espinosa M., Kyllonen P. Working memory is (almost) perfectly predicted by g. Intelligence 2004, 32:277-296.
17. Embretson S.E., Reise S.P. Item response theory 2000, Psychology Press.
18. Faul F., Erdfelder E., Lang A.G., Buchner A. G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods 2007, 39:175-191.
19. Gottfredson L., et al. Mainstream science on intelligence: An editorial with 52 signatories, history, and bibliography. Intelligence 1997, 24:13-23.
20. Gray J., Chabris C., Braver T. Neural mechanisms of general fluid intelligence. Nature Neuroscience 2003, 6:316-322.
21. Halford G.S., Cowan N., Andrews G. Separating cognitive capacity from knowledge: A new hypothesis. Trends in Cognitive Sciences 2007, 11:236-242.
22. Hambleton R.K.y, Swaminathan H. Item response theory. Principles and applications 1985, Kluwer Nijhoff Publishing, Boston, MA.
23. Hindin S.B., Zelinski E.M. Extended practice and aerobic exercise interventions benefit untrained cognitive outcomes in older adults: A meta-analysis. Journal of the American Geriatrics Society 2012, 60(1):136-141. 10.1111/j.1532-5415.2011.03761.x.
24. Hu L., Bentler P.M. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling 1999, 6:1-55.
25. Hunt E.B. Will we be smart enough?. A cognitive analysis of the coming workforce 1995, Russell Sage Foundation, New York.
26. Hunt E.B. Human intelligence 2011, Cambridge University Press, Cambridge.
27. Irwing P., Hamza A., Khaleefa O., Lynn R. Effects of abacus training on the intelligence of Sudanese children. Personality and Individual Differences 2008, 45(7):694-696.
28. Jaeggi S.M., Buschkuehl M., Jonides J., Perrig W.J. Improving fluid intelligence with training on working memory. PNAS 2008, 105:6829-6833.
29. Jaeggi S.M., Buschkuehl M., Jonides J., Shah P. Short- and long-term benefits of cognitive training. PNAS 2011, 108:10081-10086.
30. Jaeggi S.M., Buschkuehl M., Shah P., Jonides J. The role of individual differences in cognitive training and transfer. Memory & Cognition 2013, (in press).
31. Jaeggi S.M., Studer-Luethi B., Buschkuehl M., Su Y., Jonides J., Perrig W.J. The relationship between n-back performance and matrix reasoning - Implications for training and transfer. Intelligence 2010, 38:625-635.
32. Jaušovec N., Jaušovec K. Working memory training: Improving intelligence - Changing brain activity. Brain and Cognition 2012, 79:96-106.
33. Jensen A.R. The g factor 1998, Praeger, New York.
34. Johnson W., Bouchard T. The structure of human intelligence: It is verbal, perceptual, and image rotation (VPR), not fluid and crystallized. Intelligence 2005, 33:393-416.
35. Klauer K.J., Phye G.D. Inductive reasoning: A training approach. Review of Educational Research 2008, 78:1142. 10.3102/0034654308327416.
36. Kompier M.A. The "Hawthorne effect" is a myth, but what keeps the story going?. Scandinavian Journal of Work, Environment and Health 2006, 32(5):402-412.
37. Martínez K., Burgaleta M., Román F.J., Escorial S., Shih P.C., Quiroga Ma.A., et al. Can fluid intelligence be reduced to 'simple' short-term storage?. Intelligence 2011, 39:473-480.
38. Martínez K., Solana A.B., Burgaleta M., Hernández-Tamames J.A., Álvarez-Linera J., Román F.J., et al. Changes in resting-state functionally connected parieto-frontal networks after videogame practice. Human Brain Mapping 2013, (in press).
39. McGrew K. CHC theory and the human cognitive abilities project: Standing on the shoulders of the giants of psychometric intelligence research. Intelligence 2009, 37:1-10.
40. Melby-Lervåg M., Hulme C. Is working memory training effective? A meta-analytic review. Developmental Psychology 2012, (Advance online publication). 10.1037/a0028228.
41. Moody D.E. Can intelligence be increased by training on a task of working memory?. Intelligence 2009, 37:327-328.
42. Muthén L.K., Muthén B.O. Mplus user's guide 1998-2012, Muthén & Muthén, Los Angeles, CA. 7th ed.
43. Neisser U., Boodoo G., Bouchard T., Boykin A., Brody N., Ceci S., et al. Intelligence: Knowns and unknowns. The American Psychologist 1996, 51:77-101.
44. Nisbett R.E., Aronson J., Blair C., Dickens W., Flynn J., Halpern D.F., et al. Intelligence: New findings and theoretical developments. American Psychologist 2012, (Advance online publication). 10.1037/a0026699.
45. Oberauer K., Schulze R., Wilhelm O., Süb H. Working memory and intelligence - Their correlation and their relation: Comment on Ackerman, Beier, and Boyle (2005). Psychological Bulletin 2005, 131:61-65.
46. Oldfield R.C. The assessment and analysis of handedness: The Edinburgh Inventory. Neuropsychologia 1971, 9:97-113.
47. Posner M.I., Rothbart M.K. Educating the human brain 2007, American Psychological Association, Washington, DC.
48. Reckase M.D., Ackerman T.A., Carlson J.E. Building a unidimensional test using multidimensional items. Journal of Educational Measurement 1988, 25:193-203.
49. Redick T.S., Shipstead Z., Harrison T.L., Hicks K.L., Fried D.E., Hambrick D.Z., et al. No evidence of intelligence improvement after working memory training: A randomized, placebo-controlled study. Journal of Experimental Psychology: General 2012, (Advance online publication). 10.1037/a0029082.
50. Reeve B.B., Hays R.D., Bjorner J.B., et al. Psychometric evaluation and calibration of health-related quality of life item banks: Plans for the Patient-Reported Outcomes Measurement Information System (PROMIS). Medical Care 2009, 45(Suppl. 1):22-31.
51. Reeve C.L., Lam H. The psychometric paradox of practice effects due to retesting: Measurement invariance and stable ability estimates in the face of observed score changes. Intelligence 2005, 33:535-549.
52. Reise S.P., Haviland M.G. Item response theory and the measurement of clinical change. Journal of Personality Assessment 2005, 84(3):228-238.
53. Rudebeck S.R., Bor D., Ormond A., O'Reilly J.X., Lee A.C. A potential spatial working memory training task to improve both episodic memory and fluid intelligence. PLoS One 2012, 7(11):e50431. 10.1371/journal.pone.0050431.
54. Samejima F. Estimation of latent ability using a response pattern of graded scores 1969, Psychometrika, Monograph, No, 17.
55. Shipstead Z., Redick T.S., Engle R.W. Is working memory training effective?. Psychological Bulletin 2012, (Advance online publication). 10.1037/a0027473.
56. Stephenson C.L., Halpern D.F. Improved matrix reasoning is limited to training on tasks with a visuospatial component. Intelligence 2013, 41:341-357.
57. Stone C.A., Zhang B. Assessing goodness of fit of item response theory models: A comparison of traditional and alternative procedures. Journal of Educational Measurement 2003, 331-352.
58. te Nijenhuis J., van Vianen A.E.M., van der Flier H. Score gains on g loaded tests: No g. Intelligence 2007, 35:283-300.
59. Thissen D., Wainer H. Test scoring 2001, Erlbaum, Mahwah.
60. Uttal D.H., Meadow N.G., Tipton E., Hand L.L., Alden A.R., Warren C., et al. The malleability of spatial skills: A meta-analysis of training studies. Psychological Bulletin 2013, 139(2):352-402.
61. von Bastian C.C., Oberauer K. Distinct transfer effects of training different facets of working memory capacity. Journal of Memory and Language 2013, 10.1016/j.jml.2013.02.002.
62. Wickstrom G., Bendix T. The "Hawthorne effect" - What did the original Hawthorne studies actually show?. Scandinavian Journal of Work, Environment and Health 2000, 26(4):363-367.
63. World Medical Association Declaration of Helsinki - Ethical principles for medical research involving human subjects. 59th WMA General Assembly, Seoul, Korea 2008.