The Role of Working Memory in Multimedia Instruction: Is Working Memory Working During Learning from Text and Pictures?

Educational Psychology Review

Volumn 23, Issue 3, 2011, Pages 389-411

  Schüler, Anne ^a   Scheiter, Katharina ^a   van Genuchten, Erlijn ^a  

^a KNOWLEDGE MEDIA RESEARCH CENTER   (Germany)

Author keywords

Cognitive Load Theory; Cognitive Theory of Multimedia Learning; Dual task methodology; Multimedia learning; Working memory; Working memory capacity

Indexed keywords

EID: 80955181017     PISSN: 1040726X     EISSN: 1573336X     Source Type: Journal    
DOI: 10.1007/s10648-011-9168-5     Document Type: Review

References (78)

1. Aiken, L., and West, S. G. (1991). Multiple regression: Testing and interpreting interactions. Newbury Park: Sage.
2. Andrade, J. (2001). Working memory in perspective. Hove: Psychology Press.
3. Antonenko, P. D., Paas, F., Grabner, R., and van Gog, T. (2010). Using electroencephalography to measure cognitive load. Educational Psychology Review, 22, 425-438. doi: 10. 1007/s10648-010-9130-y.
4. Atkinson, R. C., and Shiffrin, R. M. (1968). Human memory: A proposed system and its control processes. In K. W. Spence and J. T. Spence (Eds.), The psychology of learning and motivation: Advances in research and theory (pp. 89-195). New York: Academic.
5. Austin, K. A. (2009). Multimedia learning: Cognitive individual differences and display design techniques predict transfer learning with multimedia learning modules. Computers and Education, 53, 1339-1354. doi: 10. 1016/j. compedu. 2009. 06. 017.
6. Baddeley, A. D. (1996). Exploring the central executive. The Quarterly Journal of Experimental Psychology, 49, 5-28. doi: 10. 1080/027249896392784.
7. Baddeley, A. D. (1998). Recent developments in working memory. Current Opinion in Neurobiology, 8, 234-238. doi: 10. 1016/S0959-4388(98)80145-1.
8. Baddeley, A. D. (1999). Essentials of Human Memory. Hove: Psychology Press.
9. Baddeley, A. D. (2000). The episodic buffer: A new component of working memory? Trends in Cognitive Sciences, 4, 417-423. doi: 10. 1016/S1364-6613(00)015382.
10. Baddeley, A. D., Emslie, H., Kolodny, J., and Duncan, J. (1998). Random generation and the executive control of working memory. Quarterly Journal of Experimental Psychology, 51, 819-852. doi: 10. 1080/027249898391413.
11. Brünken, R., Steinbacher, S., Plass, J. L., and Leutner, D. (2002). Assessment of cognitive load in multimedia learning using dual task methodology. Experimental Psychology, 49, 109-119. doi: 10. 1027//1618-3169. 49. 2. 109.
12. Brünken, R., Plass, J. L., and Leutner, D. (2004). Assessment of Cognitive Load in Multimedia Learning with Dual-Task Methodology: Auditory Load and Modality Effects. Instructional Science, 32, 115-132. doi: 10. 1023/B: TRUC. 0000021812. 96911. c5.
13. Brunyé, T. T., Taylor, H. A., Rapp, D. N., and Spiro, A. B. (2006). Learning procedures: The role of working memory in multimedia learning experiences. Applied Cognitive Psychology, 20, 917-940. doi: 10. 1002/acp. 1236.
14. Carney, R. N., and Levin, R. N. (2002). Pictorial illustrations still improve students' learning from text. Educational Psychology Review, 14, 5-26. doi: 10. 1023/A: 1013176309260.
15. Carretti, B., Borella, E., Cornoldi, C., and De Beni, R. (2009). Role of working memory in explaining the performance of individuals with specific reading comprehension difficulties: A meta-analysis. Learning and Individual Differences, 19, 246-251. doi: 10. 1016/j. lindif. 2008. 10. 002.
16. Cierniak, G., Scheiter, K., and Gerjets, P. (2009). Explaining the split-attention effect: Is the reduction of extraneous cognitive load accompanied by an increase in germane cognitive load? Computers in Human Behavior, 25(2), 315-324. doi: 10. 1016/j. chb. 2008. 12. 020.
17. Cocchini, G., Logie, R. H., Della Sala, S., MacPherson, S. E., and Baddeley, A. D. (2002). Concurrent performance of two memory tasks: Evidence for domain-specific working memory systems. Memory and Cognition, 30, 1086-1095.
18. Colle, H. A., and Welsh, A. (1976). Acoustic masking in primary memory. Journal of Verbal Learning and Verbal Behaviour, 15, 17-31. doi: 10. 1016/S0022-5371(76)90003-7.
19. Conway, A. R. A., Kane, M. J., and Engle, R. W. (2003). Working memory capacity and its relation to general intelligence. Trends in Cognitive Science, 7, 547-552. doi: 10. 1016/j. tics. 2003. 10. 005.
20. Conway, A. R. A., Kane, M. J., Bunting, M. F., Hambrick, D. Z., Wilhelm, O., and Engle, R. W. (2005). Working memory span tasks: A methodological review and user's guide. Psychonomic Bulletin and Review, 12, 769-786.
21. Daneman, M., and Carpenter, P. A. (1980). Individual differences in working memory and reading. Journal of Learning and Verbal Behavior, 19, 450-466. doi: 10. 1016/S0022-5371(80)90312-6.
22. De Beni, R., Pazzaglia, F., Gyselinck, V., and Meneghetti, C. (2005). Visuospatial working memory and mental representation of spatial description. European Journal of Cognitive Psychology, 17, 77-95. doi: 10. 1080/09541440340000529.
23. Della Sala, S., Gray, C., Baddeley, A. D., and Wilson, L. (1997). Visual Pattern Test: A test of short-term visual recall. London: Harcourt Assessment.
24. Della Sala, S., Gray, C., Baddeley, A., Allamano, N., and Wilson, L. (1999). Pattern spans: A tool for unwelding visuo-spatial memory. Neuropsychologia, 37, 1189-1199. doi: 10. 1016/S0028-3932(98)00159-6.
25. Doolittle, P. E., and Mariano, G. J. (2008). Working memory capacity and mobile multimedia learning environments: Individual differences in learning while mobile. Journal of Educational Multimedia and Hypermedia, 17, 511-530.
26. Doolittle, P. E., Terry, K. P., and Mariano, G. J. (2009). Multimedia learning and working memory capacity. In R. Zheng (Ed.), Cognitive effects of multimedia learning (pp. 17-33). London: Premier Reference Source.
27. Dutke, S., and Rinck, M. (2006). Multimedia learning: Working memory and the learning of word and picture diagrams. Learning and Instruction, 16, 526-537. doi: 10. 1016/j. learninstruc. 2006. 10. 002.
28. Engle, R. W., Tuholski, S. W., Laughlin, J. E., and Conway, A. R. A. (1999). Working memory, short-term memory, and general fluid intelligence: A latent-variable approach. Journal of Experimental Psychology, 128, 309-331. doi: 10. 1037/0096-3445. 128. 3. 309.
29. Farmer, E. W., Berman, J. V. F., and Fletcher, Y. L. (1986). Evidence for a visuo-spatial scratch-pad in working memory. The Quarterly Journal of Experimental Psychology, 38(4-A), 675-688.
30. Fischer, M. H., and Zwaan, R. A. (2008). Embodied language: A review of the role of the motor system in language comprehension. Quarterly Journal of Experimental Psychology, 61, 825-850. doi: 10. 1080/17470210701623605.
31. Gathercole, S., and Baddeley, A. (1993). Working memory and language processing. Hove: Erlbaum.
32. Ginns, P. (2005). Meta-analysis of the modality effect. Learning and Instruction, 15, 313-331. doi: 10. 1016/j. learninstruc. 2005. 07. 001.
33. Gyselinck, V., Ehrlich, M.-F., Cornoldi, C., de Beni, R., and Dubois, V. (2000). Visuospatial working memory in learning from multimedia systems. Journal of Computer Assisted Learning, 16, 166-176. doi: 10. 1046/j. 1365-2729. 2000. 00128. x.
34. Gyselinck, V., Cornoldi, C., Dubois, V., de Beni, R., and Ehrlich, M.-F. (2002). Visuospatial memory and phonological loop in learning from multimedia. Applied Cognitive Psychology, 16, 665-685. doi: 10. 1002/acp. 823.
35. Gyselinck, V., Jamet, E., and Dubois, V. (2008). The role of working memory components in multimedia comprehension. Applied Cognitive Psychology, 22, 353-374. doi: 10. 1002/acp. 1411.
36. Irwin, J. R., and McClelland, G. H. (2003). Negative consequences of dichotomizing continuous predictor variables. Journal of Market Research, 40, 366-371. doi: 10. 1509/jmkr. 40. 3. 366. 19237.
37. Kane, M. J., Hambrick, D. Z., Tuholski, S. W., Wilhelm, O., Payne, T. W., and Engle, R. W. (2004). The generality of working memory capacity: A latent-variable approach to verbal and visospatial memory span and reasoning. Journal of Experimental Psychology: General, 133, 189-217. doi: 10. 1037/0096-3445. 133. 2. 189.
38. Kruley, P., Sciama, S. C., and Glenberg, A. M. (1994). On-line processing of textual illustrations in the visuospatial sketchpad: Evidence from dual-task studies. Memory and Cognition, 22, 261-272.
39. Lawrence, B. M., Myerson, J., Oonk, H. M., and Abrams, R. A. (2001). The effect of eye and limb movements on working memory. Memory, 9, 433-444. doi: 10. 1080/09658210143000047.
40. Lehman, M. T., and Tompkins, C. A. (1998). Reliability and validity of and auditory working memory measure: Data from elderly and right-hemisphere damaged adults. Aphasiology, 12, 771-785. doi: 10. 1080/02687039808249572.
41. Logie, R. H. (1995). Visuo-spatial working memory. Aberdeen: Lawrence Erlbaum Associates.
42. Logie, R. H., and Marchetti, C. (1991). Visuo-spatial working memory: Visual, spatial or central executive? In R. H. Logie and M. Denis (Eds.), Mental images in human cognition (pp. 105-115). Amsterdam: North-Holland Press.
43. Logie, R. H., and Pearson, D. G. (1997). The inner eye and the inner scribe of visuo-spatial working memory: Evidence from developmental fractionation. European Journal of Cognitive Psychology, 9, 241-257. doi: 10. 1080/713752559.
44. Lusk, D. L., Evans, A. D., Jeffrey, T. R., Palmer, K. R., Wikstrom, C. S., and Doolittle, P. F. (2009). Multimedia learning and individual differences: Mediating the effects of working memory capacity with segmentation. British Journal of Developmental Psychology, 40(4), 636-651. doi: 10. 1111/j. 1467-8535. 2008. 00848. x.
45. MacCallum, R. C., Zhang, S., Preacher, K. J., and Rucker, D. D. (2002). On the practice of dichotomization of quantitative variables. Psychological Methods, 7, 19-40. doi: 10. 1037//1082-989X. 7. 1. 19.
46. Mayer, R. E. (2005). Cognitive Theory of Multimedia Learning. In R. E. Mayer (Ed.), The Cambridge handbook of multimedia learning (pp. 31-48). New York: Cambridge University Press.
47. Mayer, R. E. (2009). Multimedia learning (2nd ed.). Cambridge: Cambridge University Press.
48. McConnell, J., and Quinn, J. G. (2000). Interference in visual working memory. The Quarterly Journal of Experimental Psychology, 53, 53-67. doi: 10. 1080/027249800390664.
49. Milner, B. (1971). Interhemispheric differences in the localization of psychological processes in man. British Medical Bulletin, 27(3), 272-277.
50. Miyake, A., and Shah, P. (1999). Models of working memory. Mechanisms of active maintenance and executive control. Cambridge: Cambridge University Press.
51. Miyake, A., Emerson, M. J., Padilla, F., and Ahn, J. (2004). Inner speech as a retrieval aid for task goals: The effects of cue type and articulatory suppression in the random task cuing paradigm. Acta Psychologica, 115, 123-142. doi: 10. 1016/j. actpsy. 2003. 12. 004.
52. Murray, D. J. (1967). The role of speech responses in short-term memory. Canadian Journal of Psychology, 21, 263-276. doi: 10. 1037/h0082978.
53. Nam, C. S., and Pujari, A. (2005). The role of working memory in multimedia learning. In Proceedings of the 11th International Conference on Human-Computer Interaction (HCII '05). Las Vegas: Mira Digital Publishing. CD-ROM.
54. Norman, D., and Shallice, T. (1986). Attention to action: Willed and automatic control of behavior. In R. Davidson, G. Schwartz, and D. Shapiro (Eds.), Consciousness and self regulation: Advances in research and theory (Vol. 4, pp. 1-18). New York: Plenum.
55. Osaka, N., Logie, R. H., and D'Esposito, M. (2007). The cognitive neuroscience of working memory. Oxford: Oxford University Press.
56. Pazzaglia, F., Toso, C., and Cacciamani, S. (2008). The specific involvement of verbal and visuospatial working memory in hypermedia learning. British Journal of Educational Technology, 39(1), 110-124.
57. Pearson, D. G. (2006). The episodic buffer. Implications and connections with visuo- spatial research. In T. Vecchi and G. Bottini (Eds.), Imagery and spatial cognition (pp. 139-153). Amsterdam: John Benjamins.
58. Quinn, J. G., and McConnell, J. (1996). Irrelevant pictures in visual working memory. The Quarterly Journal of Experimental Psychology, 49, 200-215. doi: 10. 1080/027249896392865.
59. Rummer, R., Schweppe, J., Fürstenberg, A., Seufert, T., and Brünken, R. (2010). Working memory interference during processing texts and pictures: Implications for the explanation of the modality effect. Applied Cognitive Psychology, 24, 164-176. doi: 10. 1002/acp. 1546.
60. Rummer, R., Schweppe, J., Fürstenberg, A., Scheiter, K., and Zindler, A. (2011). The perceptual basis of the modality effect in multimedia learning. Journal of Experimental Psychology: Applied (in press).
61. Salthouse, T. A., and Pink, J. E. (2008). Why is working memory related to fluid intelligence? Psychonomic Bulletin and Review, 15, 364-371. doi: 10. 3758/PBR. 15. 2. 364.
62. Sanchez, C. A., and Wiley, J. (2006). An examination of the seductive details effect in terms of working memory capacity. Memory and Cognition, 34, 344-355.
63. Schmidt-Weigand, F., and Scheiter, K. (2011). The role of spatial descriptions in learning from multimedia. Computers in Human Behavior, 27, 22-28. doi: 10. 1016/j. chb. 2010. 05. 007.
64. Schmidt-Weigand, F., Kohnert, A., and Glowalla, U. (2010). Explaining the modality and contiguity effects: New insights from investigating students' viewing behavior. Applied Cognitive Psychology, 24, 226-237. doi: 10. 1002/acp. 1554.
65. Seufert, T., Schütze, M., and Brünken, R. (2009). Memory characteristics and modality in multimedia learning: An aptitude-treatment-interaction study. Learning and Instruction, 19, 28-42. doi: 10. 1016/j. learninstruc. 2008. 01. 002.
66. Shah, P., and Miyake, A. (1996). The separability of working memory resources for spatial thinking and language processing: An individual differences approach. Journal of Experimental Psychology: General, 125, 4-27. doi: 10. 1037/0096-3445. 125. 1. 4.
67. Smith, E. E., and Jonides, J. (1997). Working memory: A view from neuroimaging. Cognitive Psychology, 33, 5-42. doi: 10. 1006/cogp. 1997. 0658.
68. Smith, E. E., and Jonides, J. (1999). Storage and executive processes in the frontal lobes. Science, 283, 1657-1661. doi: 10. 1126/science. 283. 5408. 1657.
69. Spinnler, H., and Tognoni, G. (1987). Italian standardization and classification of neuropsychological tests. Italian Journal of Neurological Science, 6, 1-120.
70. Spreen, O., and Strauss, E. (1998). A Compendium of Neuropsychological Tests. New York: Oxford University Press.
71. Sweller, J. (2005). Implications of cognitive load theory for multimedia learning. In R. E. Mayer (Ed.), The Cambridge handbook of multimedia learning (pp. 19-30). New York: Cambridge University Press.
72. Sweller, J., van Merriëboer, J. J. G., and Paas, F. G. W. C. (1998). Cognitive architecture and instructional design. Educational Psychology Review, 10, 251-285. doi: 10. 1023/A: 1022193728205.
73. Tardieu, H., and Gyselinck, V. (2003). Working memory constraints in the integration and comprehension of information in a multimedia context. In H. van Oostendorp (Ed.), Cognition in a Digital World (pp. 3-24). London: Lawrence Erlbaum Associates.
74. Turner, M. L., and Engle, R. W. (1989). Is working memory capacity task dependent? Journal of Memory and Language, 28, 127-154. doi: 10. 1016/0749-596X(89)90040-5.
75. Vandierendonck, A., Kemps, E., Fastame, M. C., and Szmalec, A. (2004). Working memory components of the Corsi blocks task. British Journal of Psychology, 95, 57-79. doi: 10. 1348/000712604322779460.
76. Waters, G. S., and Caplan, D. (1996). The measurement of verbal working memory capacity and its relation to reading comprehension. The Quarterly Journal of Experimental Psychology, 49A, 51-79. doi: 10. 1080/027249896392801.
77. Wechsler, D. (1958). The measurement and appraisal of adult intelligence. Baltimore: Williams and Wilkins.
78. Wechsler, D. (1997). WAIS-III and working memoryS-III: Technical manual. San Antonio: Harcourt Brace and Company.