Explaining the modality effect in multimedia learning: Is it due to a lack of temporal contiguity with written text and pictures?

Learning and Instruction

Volumn 22, Issue 2, 2012, Pages 92-102

  Schüler, Anne ^a   Scheiter, Katharina ^a   Rummer, Ralf ^b   Gerjets, Peter ^a  

^a KNOWLEDGE MEDIA RESEARCH CENTER   (Germany)

^b UNIVERSITY OF ERFURT   (Germany)

Author keywords

Modality effect; Multimedia learning; Temporal contiguity; Text picture sequence; Working memory

Indexed keywords

EID: 83555173192     PISSN: 09594752     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.learninstruc.2011.08.001     Document Type: Article

References (36)

1. Aiken L., West S.G. Multiple regression: Testing and interpreting interactions 1991, Sage, Newbury Park, CA.
2. Baddeley A.D. Working memory. Science 1992, 255:556-559. 10.1126/science.1736359.
3. Baggett P., Ehrenfeucht A. Encoding and retaining information in the visuals and verbals of an educational movie. Educational Communications and Technology Journal 1983, 31:23-32.
4. Bortz J., Döring N. Forschungsmethoden und Evaluation: für Human- und Sozialwissenschaftler 2002, Springer, Berlin, Germany. 3rd ed.
5. Brünken R., Plass J.L., Leutner D. Assessment of cognitive load in multimedia learning with dual task methodology: auditory load and modality effects. Instructional Science 2004, 32:115-132. 10.1023/B:TRUC.0000021812. 96911.c5.
6. Brünken R., Steinbacher S., Plass J.L., Leutner D. Assessment of cognitive load in multimedia learning using dual task methodology. Experimental Psychology 2002, 49:109-119. 10.1027//1618-3169.49.2.109.
7. Cierniak G., Scheiter K., Gerjets P. Explaining the split-attention effect: is the reduction of extraneous cognitive load accompanied by an increase in germane cognitive load?. Computers in Human Behavior 2009, 25:315-324. 10.1016/j.chb.2008.12.020.
8. Cohen J. Statistical power analysis for the behavioral sciences 1988, Erlbaum. 2nd ed.
9. Daneman M., Carpenter P.A. Individual differences in working memory and reading. Journal of Learning and Verbal Behavior 1980, 19:450-466. 10.1016/S0022-5371(80)90312-6.
10. Field A. Discovering statistics using SPSS (and sex and drugs and rock'n'roll) 2009, Sage, Los Angeles. Third edition.
11. Gathercole S.E., Baddeley A.D. Working memory and language 1993, Lawrence Erlbaum Associates, Hove.
12. Ginns P. Meta-analysis of the modality effect. Learning and Instruction 2005, 15:313-331. 10.1016/j.learninstruc.2005.07.001.
13. Ginns P. Integrating information: a meta-analysis of the spatial contiguity and temporal contiguity effects. Learning and Instruction 2006, 16:511-525. 10.1016/j.learninstruc.2006.10.001.
14. Gyselinck V., Jamet E., Dubois V. The role of working memory components in multimedia comprehension. Applied Cognitive Psychology 2008, 22. 353-374. 10.1002/acp.823.
15. Jeung H., Chandler P., Sweller J. The role of visual indicators in dual sensory mode instruction. Educational Psychology 1997, 17:329-343. 10.1080/0144341970170307.
16. Mayer R.E. Multimedia learning 2009, Cambridge University Press, Cambridge. 2nd edition.
17. Mayer R.E., Moreno R. A split attention effect in multimedia learning: evidence for dual processing systems in working memory. Journal of Educational Psychology 1998, 90:312-320. 10.1037/0022-0663.90.2.312.
18. Mayer R.E., Moreno R., Boire M., Vagge S. Maximizing constructivist learning from multimedia communications by minimizing cognitive load. Journal of Educational Psychology 1999, 91:638-643. 10.1037/0022-0663.91.4.638.
19. Michas I.C., Berry D.C. Learning a procedural task: effectiveness of multimedia presentations. Applied Cognitive Psychology 2000, 14:555-575. 10.1002/1099-0720(200011/12).
20. Moreno R., Mayer R.E. Cognitive principles of multimedia learning: the role of modality and contiguity. Journal of Educational Psychology 1999, 91:358-368. 10.1037/0022-0663.91.2.358.
21. Moreno R., Mayer R.E. Learning science in virtual reality multimedia environments: role of methods and media. Journal of Educational Psychology 2002, 94:598-610. 10.1037/0022-0663.94.3.598.
22. Mousavi S.Y., Low R., Sweller J. Reducing cognitive load by micing auditory and visual presentation modes. Journal of Educational Psychology 1995, 87:319-334. 10.1037/0022-0663.87.2.319.
23. Oberauer K., Süß H.-M., Schulze R., Wilhelm O., Wittmann W.W. Working memory capacity - facets of a cognitive ability construct. Personality and Individual Differences 2000, 29:1017-1045. 10.1016/S0191-8869(99)00251-2.
24. Penney C.G. Modality effects and the structure of short term verbal memory. Memory & Cognition 1989, 17:398-422. 10.3758/BF03202613.
25. Rummer R., Schweppe J. Evidence for a modality effect in sentence retention. Psychonomic Bulletin & Review 2005, 12:1094-1099. 10.3758/BF03206449.
26. Rummer R., Schweppe J., Fürstenberg A., Scheiter K., Zindler A. The perceptual basis of the modality effect in multimedia learning. Journal of Experimental Psychology: Applied 2011, 17:159-173. 10.1037/a0023588.
27. Rummer R., Schweppe J., Fürstenberg A., Seufert T., Brünken R. Working memory interference during processing texts and pictures: implications for the explanation of the modality effect. Applied Cognitive Psychology 2010, 24:164-176. 10.1002/acp.1546.
28. Schmidt-Weigand F., Kohnert A., Glowalla U. Explaining the modality and contiguity effects: new insights from investigating students' viewing behaviour. Applied Cognitive Psychology 2010, 24:226-237. 10.1002/acp.1554.
29. Schüler, A., Scheiter, K., & Gerjets, P. Does the modality effect in multimedia learning appear only with text containing spatial information? Zeitschrift für Pädagogische Psychologie, in press.
30. Schüler, A., Scheiter, K., & van Genuchten, E. (2011). The role of working memory in multimedia instruction: is working memory working during learning from text and pictures? Educational Psychology Review. 23, 389-411. doi:10.1007/s10648-011-9168-5.
31. Seufert T., Schütze M., Brünken R. Memory characteristics and modality in multimedia learning: an aptitude-treatment-interaction study. Learning and Instruction 2009, 19:28-42. 10.1016/j.learninstruc.2008.01.002.
32. Smith E.E., Jonides J. Storage and executive processes in the frontal lobes. Science 1999, 283:1657-1661. 10.1126/science.283.5408.1657.
33. Tabbers, H. K. (2002). The modality of text in multimedia instructions: Refining the design guidelines. Unpublished doctoral dissertation. Heerlen: Open University of the Netherlands.
34. Tiene D. Sensory mode and information load: examining the effects of timing on multisensory processing. International Journal of Instructional Media 2000, 27:183-197.
35. Tindall-Ford S., Chandler P., Sweller J. When two sensory modes are better than one. Journal of Experimental Psychology: Applied 1997, 3:257-287. 10.1037/1076-898X.3.4.257.
36. Wechsler D. Wechsler-Gedächtnistest - Revidierte Fassung: WMS-R. Deutsche Adaptation der revidierten Fassung der Wechsler Memory Scale. Manual 2000, Huber, Bern, [Wechsler Memory Scale-Revised Version: WMS-R. German adapation of the revised version of the Wechsler Memory Scale. Manual]. C. Härting, H.J. Markowitsch, H. Neufeld, P. Calabrese, K. Deisinger, J. Kessler (Eds.).