Colorful bouquets in multimedia research: A closer look at the modality effect

Zeitschrift fur Padagogische Psychologie

Volumn 25, Issue 4, 2011, Pages 269-276

  Schnotz, Wolfgang ^a  

^a University of Koblenz Landau ^*  (Germany)

Author keywords

Boundary conditions; Modality effect; Multimedia learning; Split attention

Indexed keywords

EID: 80054707570     PISSN: 10100652     EISSN: None     Source Type: Journal    
DOI: 10.1024/1010-0652/a000055     Document Type: Review

References (46)

1. Baddeley, A. D. (1986). Working memory. Oxford: Clarendon Press.
2. Baddeley, A. D. (1999). Essentials of human memory. Hove, UK: Psychology Press.
3. Chandler, P. & Sweller, J. (1996). Cognitive load while learning to use a computer program. Applied Cognitive Psychology, 10, 151-170. (Pubitemid 126482120)
4. Cooney, J. B. & Swanson, H. L. (1987) Memory and learning disabilities: An overview. In H. L. Swanson (Ed.), Memory and learning disabilities: Advances in learning and behavioral disabilities (pp. 1-40). Greenwich, CT: JAI.
5. Cortina, J. M. & Folger, R. G. (1998). When is it acceptable to accept a null hypothesis: no way, Jose? Organizational Research Methods, 1, 334-350. (Pubitemid 128543601)
6. Cowan, N. (2001). The magical number 4 in short-term memory: A reconsideration of mental storage capacity. Behavioral and Brain Sciences, 24, 87-185.
7. Ginns, P. (2005). Meta-analysis of the modality effect. Learning & Instruction, 15, 313-331. (Pubitemid 41288290)
8. Green, R. (1981). Remembering ideas form text: The effect of modality of presentation. British Journal of Educational Psychology, 51, 83-89.
9. Gyselinck, V., Jamet, E. & Dubois, V. (2008). The role of working memory components in multimedia comprehension. Applied Cognitive Psychology, 22, 353-374. (Pubitemid 351560009)
10. Hannus, M. & Hyönä, J. (1999). Utilization of illustrations during learning of science: textbook passages among low- and high-ability children. Contemporary Educational Psychology, 24, 95-123.
11. Harlow, L. L., Mulaik, S. A. & Steiger, J. H. (1997). What if there were no significance texts? Mahwah, NJ: Erlbaum.
12. Hegarty, M. & Just, M. A. (1993). Constructing mental models of machines from text and diagrams. Journal of Memory and Language, 32, 717-742.
13. Hildyard, A. & Olson, D. R. (1978). Memory and inference in the comprehension of oral and written discourse. Discourse Processes, 1, 91-117.
14. Kalyuga, S., Chandler, P. & Sweller, J. (2000). Incorporating learner experience into the design of multimedia instruction. Journal of Educational Psychology, 92, 126-136.
15. Kürschner, C. & Schnotz, W. (2008). Das Verhältnis gesprochener und geschriebener Sprache bei der Konstruktion mentaler Repräsentationen. Psychologische Rundschau, 59, 139-149.
16. Kürschner, C., Schnotz, W., Eid, M. & Hauck, G. (2005). Individuelle Modalitätspräferenzen beim Textverstehen: Präferenzen für auditive oder visuelle Sprachverarbeitung in unterschiedlichen Bevölkerungsgruppen. Zeitschrift für Entwicklungspsychologie und Pädagogische Psychologie, 37, 2-16. (Pubitemid 40317596)
17. Leahy, W., Chandler, P. & Sweller, J. (2003). When auditory presentations should and should not be a component of multimedia instruction. Applied Cognitive Psychology, 17, 401-418. (Pubitemid 39517259)
18. Leahy, W. & Sweller, J. (2011). Cognitive load theory, modality of presentation and the transient information effect. Applied Cognitive Psychology. Advance online publication.
19. Levie, H. W. & Lentz, R. (1982). Effects of text illustrations: A review of research. Educational Communication and Technology Journal, 30, 195-232.
20. Lindow, S., Fuchs, H. M., Fürstenberg, A., Kleber, J., Schweppe, J. & Rummer, R. (2011). On the robustness of the modality effect: Attempting to replicate a basic finding. Zeitschrift für Pädagogische Psychologie, 25, 231-243.
21. Mastropieri, M. A. & Scruggs, T. E. (1989). Constructing more meaningful relationships: Mnemonic instruction for special populations. Educational Psychology Review, 1, 83-111.
22. Mayer, R. E. (2005). Principles for managing essential processing in multimedia learning: segmenting, pretraining, and modality principles. In R. E. Mayer (Ed.), The Cambridge handbook of multimedia learning (pp. 169-182). Cambridge: Cambridge University Press.
23. Mayer, R. E. (2009). Multimedia learning (2nd ed.). Cambridge: University Press.
24. Mayer, R. E. & Moreno R. (1998). A split-attention effect in multimedia learning: Evidence for dual processing systems in working memory. Journal of Educational Psychology, 90, 312-320.
25. Mayrath, M. C., Nihalani, P. K. & Robinson, D. H. (2011). Varying tutorial modality and interface restrictions to maximize transfer in a complex simulation environment. Journal of Educational Psychology, 103, 257-268.
26. Miller, G. A. (1956). The magical number seven, plus or minus two: Some limits on our capacity for processing information. Psychological Review, 63, 81-97.
27. Moreno, R. & Mayer, R. E. (1999). Cognitive principles of multimedia learning: The role of modality and contiguity. Journal of Educational Psychology, 91, 358-368.
28. Mousavi, S. Y., Low, R. & Sweller, J. (1995). Reducing cognitive load by minimizing auditory and visual presentation modes. Journal of Educational Psychology, 87, 319-334.
29. Peterson, L. & Peterson, M. (1959). Short-term retention of individual verbal items. Journal of Experimental Psychology, 58, 193-198.
30. Rickheit, G. & Strohner, H. (1983). Medienspezifische Textverarbeitung. In P. Finke (Hrsg.), Sprache im politischen Kontext (S. 175-207). Tübingen: Max Niemeyer Verlag.
31. Rickheit, G., Strohner, H. & Müsseler, J. (1987). Modalitätsspezifische Textverarbeitung bei Personen mit unterschiedlichem Kommunikationsschwerpunkt. Zeitschrift für Entwicklungspsychologie und Pädagogische Psychologie, 19, 65-77.
32. Rieben, L. & Perfetti, C. (1991). Learning to read: Basic research and its implications. Hillsdale, NJ: Erlbaum.
33. Rubin, D. L., Hafer, T. & Arata, K. (2000). Reading and listening to oral-based versus literate-based discourse. Communication Education, 49, 121-133.
34. Rummer, R., Schweppe, J., Fürstenberg, A., Seufert, T. & Brünken, R. (2010). Working memory interference during processing texts and pictures: Implications for the explanation of the modality effect. Applied Cognitive Psychology, 24, 164-176.
35. Schmidt-Weigand, F. (2011). Does animation amplify the modality effect - or is there any modality effect at all? Zeitschrift für Pädagogische Psychologie, 25, 245-256.
36. Schmidt-Weigand, F., Kohnert, A. & Glowalla, U. (2010a). A closer look at split visual attention in system- and self-paced instruction in multimedia learning. Learning and Instruction, 20, 100-110.
37. Schmidt-Weigand, F., Kohnert, A. & Glowalla, U. (2010b). Explaining the modality and contiguity effects: New insights from investigating students' viewing behavior. Applied Cognitive Psychology, 24, 226-237
38. Schnotz, W. (2005). An Integrated Model of Text and Picture Comprehension. In R. E. Mayer (Ed.), Cambridge Handbook of Multimedia Learning (pp. 49-69). Cambridge: Cambridge University Press.
39. 'Schnotz, W. & Lowe, R. K. (2008). A unified view of learn ing from animated and static graphics. In R.K. Lowe & W. Schnotz (Eds.), Learning with animation. Research implications for design (pp. 304-356). New York: Cambridge University Press.
40. Schüler, A., Scheiter, K. & Gerjets, P. (2011). Does the modality effect in multimedia learning appear only with text containing spatial information? Zeitschrift für Pädagogische Psychologie, 25, 257-267.
41. Schüler, A., Scheiter, K. & Schmidt-Weigand, F. (2011). Boundary conditions and constraints of the modality effect. Zeitschrift für Pädagogische Psychologie, 25, 211-220.
42. Stiller, K. D., Freitag, A., Zinnbauer, P. & Freitag, C. (2009). How pacing of multimedia instructions can influence modality effects: A case of superiority of visual texts. Australasian Journal of Educational Technology, 25, 184-203.
43. Sweller, J. (2005). Implications of cognitive load theory for multimedia learning. In R. E. Mayer (Ed.), The Cambridge handbook of multimedia learning (pp. 19-30). New York: Cambridge University Press.
44. Sweller, J., van Merriënboer, J. J. G. & Paas, F. G. W. C. (1998). Cognitive architecture and instructional design. Educational Psychology Review, 10, 251-296.
45. Tabbers, H. K. & van der Spoel, W. (2011). Where did the modality principle in multimedia learning go? A double replication failure that questions both theory and practical use. Zeitschrift für Pädagogische Psychologie, 25, 221-230.
46. Tindall-Ford, S., Chandler, P. & Sweller, J. (1997). When two sensory modes are better than one. Journal of Experimental Psychology: Applied, 3, 257-287. (Pubitemid 127462889)