The Perceptual Basis of the Modality Effect in Multimedia Learning

Journal of Experimental Psychology: Applied

Volumn 17, Issue 2, 2011, Pages 159-173

  Rummer, Ralf ^a   Schweppe, Judith ^a   Fürstenberg, Anne ^a   Scheiter, Katharina ^b   Zindler, Antje ^a  

^a UNIVERSITY OF ERFURT   (Germany)

^b KNOWLEDGE MEDIA RESEARCH CENTER   (Germany)

Author keywords

Modality effect; Multimedia learning; Sensory memory; Temporal contiguity; Working memory

Indexed keywords

ARTICLE; DEPTH PERCEPTION; FEMALE; HEARING; HUMAN; LEARNING; MALE; MULTIMEDIA; PHYSIOLOGY; SHORT TERM MEMORY; VISION;

AUDITORY PERCEPTION; FEMALE; HUMANS; LEARNING; MALE; MEMORY, SHORT-TERM; MULTIMEDIA; SPACE PERCEPTION; VISUAL PERCEPTION;

EID: 79959865201     PISSN: 1076898X     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0023588     Document Type: Article

References (43)

1. Ayres P., Sweller J. The split-attention principle in multimedia learning. The Cambridge handbook of multimedia learning 2005, 135-146. Cambridge University Press, New York. R.E. Mayer (Ed.).
2. Baddeley A.D. Working memory 1986, Oxford University Press, Oxford, UK.
3. Baddeley A.D. Essentials of human memory 1999, Psychology Press, Hove, UK.
4. Baddeley A.D. The episodic buffer: A new component of working memory?. Trends in Cognitive Sciences 2000, 4:417-423.
5. Baddeley A.D., Hitch G. Working memory. Psychology of Learning and Motivation 1974, 8:47-89.
6. Baggett P., Ehrenfeucht A. Encoding and retaining information in the visuals and verbals of an educational movie. Educational Communication and Technology Journal 1983, 31:23-32.
7. Banks W. Signal detection theory and human memory. Psychological Bulletin 1970, 74:81-99.
8. Bazerman C. Physicists reading physics: Schema-laden purposes and purpose-laden schema. Written Communication 1985, 2:3-23.
9. Bétrancourt M., Bisseret A. Integrating textual and pictorial information via pop windows: An experimental study. Behavior and Information Technology 1998, 17:263-273.
10. Brunyé T.T., Taylor H.A., Rapp D.N., Spiro A.B. Learning procedures: The role of working memory in multimedia learning experiences. Applied Cognitive Psychology 2006, 20:917-940.
11. Chandler P., Sweller J. Cognitive load theory and the format of instruction. Cognition and Instruction 1992, 8:293-332.
12. Conrad R., Hull A.J. Input modality and the serial position curve in short-term memory. Psychonomic Science 1968, 10:135-136.
13. Crowder R.G., Morton J. Precategorical acoustic storage (PAS). Perception & Psychophysics 1969, 5:365-373.
14. Eddy J.K., Glass A.L. Reading and listening to high and low imagery sentences. Journal of Verbal Learning and Verbal Behavior 1981, 20:333-345.
15. Furnham A., De Siena S., Gunter B. Children's and adults' recall of children's news stories in both print and audio-visual presentation modalities. Applied Cognitive Psychology 2002, 16:191-210.
16. Ginns P. Meta-analysis of the modality effect. Learning and Instruction 2005, 15:313-331.
17. Gyselinck V., Cornoldi C., Dubois V., De Beni R., Ehrlich M. Visuospatial memory and phonological loop in learning from multimedia. Applied Cognitive Psychology 2002, 16:665-685.
18. Gyselinck V., Jamet E., Dubois V. The role of working memory components in multimedia comprehension. Applied Cognitive Psychology 2008, 22:353-374.
19. Hegarty M., Just M.A. Constructing mental models of machines from text and diagrams. Journal of Memory and Language 1993, 32:717-742.
20. Kalyuga S., Chandler P., Sweller J. Managing split-attention and redundancy in multimedia instruction. Applied Cognitive Psychology 1999, 13:351-371.
21. Levie H.W., Lentz R. Effects of text illustrations: A review of research. Educational Technology Research and Development 1982, 30:195-232.
22. Logie R.H., Della Sala S., Wynn V., Baddeley A.D. Visual similarity effects in immediate verbal serial recall. The Quarterly Journal of Experimental Psychology 2000, 53:626-646.
23. Mayer R.E. Multimedia learning 2009, Cambridge University Press, Cambridge, UK.
24. Mayer R.E., Moreno R. A split-attention effect in multimedia learning: Evidence for dual processing systems in working memory. Journal of Educational Psychology 1998, 90:312-320.
25. Moreno R., Mayer R.E. Cognitive principles of multimedia learning: The role of modality and contiguity. Journal of Educational Psychology 1999, 91:358-368.
26. Mousavi S., Low R., Sweller J. Reducing cognitive load by mixing auditory and visual presentation modes. Journal of Educational Psychology 1995, 87:319-334.
27. Neath I. Human memory: An introduction to research, data, and theory 1998, Brooks/Cole, Pacific Grove, CA.
28. Penney C.G. Modality effects and the structure of short term verbal memory. Memory & Cognition 1989, 17:398-422.
29. Rummer R., Engelkamp J. Phonological information contributes to short-term recall of auditorily presented sentences. Journal of Memory and Language 2001, 45:451-467.
30. Rummer R., Engelkamp J. Phonological information in immediate and delayed sentence recall. The Quarterly Journal of Experimental Psychology 2003, 56:83-95.
31. Rummer R., Schweppe J. Evidence for a modality effect in sentence retention. Psychonomic Bulletin & Review 2005, 12:1094-1099.
32. Rummer R., Schweppe J., Fürstenberg A., Seufert T., Brünken R. What causes the modality effect in multimedia learning? Testing a specification of the modality assumption. Applied Cognitive Psychology 2010, 24:164-176.
33. Rummer, R., Schweppe, J., Fürstenberg, A. & Zindler, A. (2010). Does visuo-spatial working memory contribute to attention of visually presented verbal stimuli? Poster presented at EWOMS 5, September 2010, Civita Castellana, Italy.
34. Schmidt-Weigand F., Kohnert A., Glowalla U. A closer look at split visual attention in system- and self-paced instruction in multimedia learning. Learning and Instruction 2010, 20:100-110.
35. Schüler, A., Scheiter, K., & Schmidt-Weigand, F. (Eds.). (2010). Boundary conditions and constraints for the modality-effect. Manuscript in preparation.
36. Segers E., Verhoeven L., Hulstijn-Hendrikse N. Cognitive processes in children's multimedia text learning. Applied Cognitive Psychology 2008, 22:375-387.
37. Sperling G. The information available in brief visual presentation. Psychological Monographs 1960, 74:1-29.
38. Tabbers, H. K. (2002). The modality of text in multimedia instructions: Refining the design guidelines (Unpublished doctoral dissertation). Open University of the Netherlands, Heerlen.
39. Tabbers, H. K., & van der Spoel, W. (2006). Explaining why animations need narrations: A loading task paradigm. Paper presented at AERA April 2006, San Francisco.
40. Tiene D. Sensory load and information load: Examining the effects of timing on multisensory processing. International Journal of Instructional Media 2000, 27:183-199.
41. Unnava H.R., Agarwal S., Haugtvedt C.P. The interactive effects of presentation modality and message-generated imagery on recall of advertising information. Journal of Consumer Research 1996, 23:81-87.
42. Witteman M., Segers E. The modality effect tested in children in a user-paced multimedia environment. Journal of Computer Assisted Learning 2010, 26:132-142.
43. Wouters P.J.M., Paas F., van Merriënboer J.J.G. Observational learning from animated models: Effects of modality and reflection on transfer. Contemporary Educational Psychology 2008, 34:1-8.