Does the modality effect in multimedia learning appear only with text containing spatial information?

Zeitschrift fur Padagogische Psychologie

Volumn 25, Issue 4, 2011, Pages 257-267

  Schüler, Anne ^a   Scheiter, Katharina ^a   Gerjets, Peter ^a  

^a KNOWLEDGE MEDIA RESEARCH CENTER   (Germany)

Author keywords

Modality effect; Multimedia learning; Spatial text information; Working memory

Indexed keywords

EID: 80054678705     PISSN: 10100652     EISSN: None     Source Type: Journal    
DOI: 10.1024/1010-0652/a000050     Document Type: Article

References (47)

1. Baddeley, A. D. (1992). Working memory. Science, 255, 556-559.
2. Brooks, L. R. (1967). The suppression of visualization by reading. Quarterly Journal of Experimental Psychology, 19A, 289-299.
3. Cierniak, G., Scheiter, K. & Gerjets, P. (2009). Explaining the split-attention effect: Is the reduction of extraneous cognitive load accompanied by an increase in germane cognitive load? Computers in Human Behavior, 25, 315-324.
4. De Beni, R., & Moè, A. (1997). Learning from texts or lectures: Loci mnemonics can interfere with reading but not with listening. European Journal of Cognitive Psychology, 9, 401-415. (Pubitemid 127442070)
5. De Beni, R., Pazzaglia, F., Gyselinck, V. & Meneghetti, C. (2005). Visuospatial working memory and mental representation of spatial description. European Journal of Cognitive Psychology, 17, 77-95.
6. Della Sala, S., Gray, C., Baddeley, A., Allamano, N. & Wilson, L. (1999). Pattern spans: A tool for unwelding visuo-spatial memory. Neuropsychologia, 37, 1189-1199. (Pubitemid 29376476)
7. Deyzack, E., Logie, R. H. & Denis, M. (2006). Visuospatial work ing memory and the processing of spatial description. British Journal of Psychology, 97, 217-243. (Pubitemid 43781323)
8. Doolittle, P. E., Terry, K. P. & Mariano, G. J. (2009). Multimedia learning and working memory capacity. In R. Zheng (Ed.), Cognitive effects of multimedia learning (pp. 17-33). London: Premier Reference Source.
9. Flesch, R. (1948). A new readability yardstick. Journal of Applied Psychology, 32, 221-233.
10. Furnham, A., de Siena, S. & Gunter, B. (2002). Children's and adults recall of children's news stories in both print and audiovisual presentation modalities. Applied Cognitive Psychology, 16, 191-210. (Pubitemid 39517179)
11. Gerjets, P., Scheiter, K., Opfermann, M., Hesse, F. W. & Eysink, T. H. S. (2009). Learning with hypermedia: The influence of representational formats and different levels of learner control on performance and learning behavior. Computers in Human Behavior, 25, 360-370.
12. Ginns, P. (2005). Meta-analysis of the modality effect. Learning & Instruction, 15, 313-331. (Pubitemid 41288290)
13. Glass, A., Millen, D., Beck, L. & Eddy, J. (1985). Representations of images in sentence verification. Journal of Memory and Language, 24, 442-465.
14. Gyselinck, V., Jamet, E. & Dubois, V. (2008). The role of working memory components in multimedia comprehension. Applied Cognitive Psychology, 22, 353-374. (Pubitemid 351560009)
15. Harskamp, E., Mayer, R. E., Suhre, C., & Jansma, J. (2007). Does the modality principle for multimedia learning apply to science classrooms? Learning and Instruction, 17, 465-477.
16. Hyönä, J. (2010). The use of eye movements in the study of multimedia learning. Learning and Instruction, 20, 172-176.
17. Jahn, G. (2004). Three turtles in danger: Spontaneous construction of causally relevant spatial situation models. Journal of Experimental Psychology: Learning, Memory, and Cognition, 30, 969-987. (Pubitemid 39210012)
18. Jeung, H., Chandler, P. & Sweller, J. (1997). The role of visual indicators in dual sensory mode instruction. Educational Psychology, 17, 329-343.
19. Kalyuga, S., Chandler, P. & Sweller, J. (2000). Incorporating learner experience into the design of multimedia instruction. Journal of Educational Psychology, 92, 126-136.
20. Kürschner, C., Schnotz, W. & Eid, M. (2007). Welchen Einfluss haben Präsentationsmodalität und Repräsentationsmodalität auf die kognitive Verarbeitung von Text mit Bildern. Zeitschrift für Entwicklungspsychologie und Pädagogische Psychologie, 39, 70-83.
21. Levie, W. & Lentz, R. (1982). Effects of text illustrations: A review of research. Educational Communication and Technology Journal, 30, 195-232.
22. Leahy, W. & Sweller, J. (2011). Cognitive load theory, modality of presentation and the transient information effect. Applied Cognitive Psychology. http://onlinelibrary.wiley.com/ doi/10.1002/acp.1787/pdf (Accessed on 23 Feb. 2011).
23. Lindow, S., Fuchs, H. M., Fürstenberg, A., Kleber, J., Schweppe, J. & Rummer, R. (2011). On the robustness of the modality effect: Attempting to replicate a basic finding. Zeitschrift für Pädagogische Psychologie, 25, 231-243.
24. Logie, R. H. (1995). Visuo-spatial working memory. Aberdeen: Lawrence Erlbaum.
25. Logie, R. H. & Marchetti, H. (1991). Visuo-spatial working memory: Visuo, spatial or central executive? In R. H. Logie & M. Denis (Eds.), Images in human cognition (pp.105-117). Amsterdam: North-Holland.
26. Mayer, R. E. (2001). Multimedia learning. Cambridge: Cambridge University Press.
27. Mayer, R. E. (2009). Multimedia learning. Second Edition. Cambridge: Cambridge University Press.
28. Mayer, R. E. & Moreno R. (1998). A split-attention effect in multimedia learning: Evidence for dual processing systems in working memory. Journal of Educational Psychology, 90, 312-320.
29. Moreno, R. (2006). Does the modality principle hold for different media? A test of the method-affects-learning hypothesis. Journal of Computer Assisted Learning, 22, 149-158. (Pubitemid 43937507)
30. Moreno, R., Mayer, R. E., Spires, H. A. & Lester, J. C. (2001). The case for social agency in computer based multimedia learning: Do students learn more deeply when they interact with animated pedagogical agents? Cognition and Instruction, 19, 177-214.
31. Paivio, A. (1990). Mental representations. New York: Oxford University Press.
32. Postle, B. R., Idzikowski, Z., Della Sala, S., Logie R. H. & Baddeley, A. (2006). The selective disruption of spatial working memory by eye movements. The Quarterly Journal of Experimental Psychology, 59, 100-120. (Pubitemid 43421098)
33. Preacher, K. J. & Hayes, A. F. (2004). SPSS and SAS procedures for estimating indirect effects in simple mediation models. Behavior Research Methods, Instruments & Computers, 36, 717-731. (Pubitemid 40251423)
34. Rummer, R., Schweppe, J., Fürstenberg, A., Scheiter, K. & Zindler, A. (2011). The perceptual basis of the modality effect in multimedia learning. Journal of Experimental Psychology: Applied, 17, 159-173.
35. Rummer, R., Schweppe, J., Fürstenberg, A., Seufert, T. & Brünken, R. (2010). What causes the modality effect in multimedia learning? Testing a specification of the modality assumption. Applied Cognitive Psychology, 24, 164-176.
36. Schmidt-Weigand, F. (2011). Does animation amplify the modality effect - or is there any modality effect at all? Zeitschrift für Pädagogische Psychologie, 25, 245-256.
37. Schmidt-Weigand, F., Kohnert, A. & Glowalla, U. (2010). A closer look at split visual attention in system- and self-paced instruction in multimedia learning. Learning and Instruction, 20, 100-110.
38. Schüler, A., Scheiter, K. & Gerjets, P. (2011). Verbal descriptions of spatial information interfere with picture processing. Manuscript submitted for publication.
39. Schüler, A., Scheiter, K., Rummer, R. & Gerjets, P. (in press). Explaining the modality effect in multimedia learning: Is it due to a lack of temporal contiguity with written text and pictures? Learning and Instruction.
40. Schüler, A., Scheiter, K. & Schmidt-Weigand, F. (2011). Boundary conditions and constraints of the modality effect. Zeitschrift für Pädagogische Psychologie, 25, 211-220.
41. Segers, E., Verhoeven, L. & Hulstijn-Hendrikse, N. (2008). Cognitive processes in children's multimedia text learning. Applied Cognitive Psychology, 22, 375-387. (Pubitemid 351560010)
42. Sweller, J., van Merriënboer, J. J. G. & Paas, F. G. W. C. (1998). Cognitive architecture and instructional design. Educational Psychology Review, 10, 251-296.
43. Tabbers, H. K. (2002). The modality of text in multimedia instructions - refining the design guidelines. Unpublished Dissertation, Open University of the Netherlands, Heerlen. Retrieved December 16, 2004 from the World Wide Web: http://www.ou.nl/Docs/Expertise/OTEC/Publicaties/huib%20tabbers/ doctoral%20dissertation%20Huib%20Tabbers%20-%20web%20version.pdf.
44. Tabbers, H. K. & van der Spoel, W. (2011). Where did the modality principle in multimedia learning go? A double replication failure that questions both theory and practical use. Zeitschrift für Pädagogische Psychologie, 25, 221-230.
45. Taylor. A. & Tversky, B. (1992). Spatial mental models derived from survey and route descriptions. Journal of Memory and Language, 31, 261-292.
46. Tindall-Ford, S., Chandler, P. & Sweller, J. (1997). When two sensory modes are better than one. Journal of Experimental Psychology: Applied, 3, 257-287. (Pubitemid 127462889)
47. Woodman, G. F. & Luck, S. J. (2004). Visual search is slowed when visuospatial working memory is occupied. Psychonomic Bulletin and Review, 11, 269-274. (Pubitemid 39436169)