Instructional benefits of spoken words: A review of cognitive load factors

Educational Research Review

Volumn 7, Issue 2, 2012, Pages 145-159

  Kalyuga, Slava ^a  

^a UNIVERSITY OF NEW SOUTH WALES   (Australia)

Author keywords

Audiovisual instruction; Cognitive load theory; Dual modality presentations; Modality effect; Verbal redundancy effect

Indexed keywords

EID: 84861185538     PISSN: 1747938X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.edurev.2011.12.002     Document Type: Review

References (94)

1. Atkinson R.K. Optimizing learning from examples using animated pedagogical agents. Journal of Educational Psychology 2002, 94:416-427.
2. Atkinson R.K., Mayer R.E., Merrill M.M. Fostering social agency in multimedia learning: Examining the impact of an animated agent's voice. Contemporary Educational Psychology 2005, 30:117-139.
3. Ayres P., Sweller J. The split-attention principle in multimedia learning. The Cambridge handbook of multimedia learning 2005, 135-146. Cambridge University Press, New York, NY. R.E. Mayer (Ed.).
4. Baddeley A. Working memory 1986, Oxford University Press, New York, NY.
5. Baddeley A., Hitch G.J. Development of working memory: Should the Pascual-Leone and the Baddeley and Hitch models be merged?. Journal of Experimental Child Psychology 2000, 77:128-137.
6. Bobis J., Sweller J., Cooper M. Cognitive load effects in a primary-school geometry task. Learning and Instruction 1993, 3:1-21.
7. Borrás I., Lafayette R.C. Effects of multimedia courseware subtitling on the speaking performance of college students of French. Modern Language Journal 1994, 78:61-75.
8. Brünken R., Plass J.L., Leutner D. Assessment of cognitive load in multimedia learning with dual-task methodology: Auditory load and modality effects. Instructional Science 2004, 32:115-132.
9. Brunyé T.T., Taylor H.A., Rapp D.N., Spiro A.B. Learning procedures: The role of working memory in multimedia learning experiences. Applied Cognitive Psychology 2006, 20:917-940.
10. Byrne M., Curtis R. Designing health communication: Testing the explanations for the impact of communication medium on effectiveness. British Journal of Health Psychology 2000, 5:189-199.
11. Case R. Intellectual development: Birth to adulthood 1985, Academic Press, San Diego.
12. Chandler P., Sweller J. Cognitive load theory and the format of instruction. Cognition and Instruction 1991, 8:293-332.
13. Clark R.C., Mayer R.E. E-learning and the science of instruction 2003, Jossey-Bass/Pfeiffer, San Francisco, CA.
14. Cowan N. The magical number 4 in short-term memory: A reconsideration of mental storage capacity. Behavioral and Brain Sciences 2001, 24:87-185.
15. Craig S.D., Gholson B., Driscoll D.M. Animated pedagogical agents in multimedia educational environments: Effects of agent properties, picture features and redundancy. Journal of Educational Psychology 2002, 94:428-434.
16. de Ribaupierre A. Working memory and attentional processes across the lifespan. Lifespan development of human memory 2001, 59-80. MIT Press, Cambridge, MA. P. Graf, N. Otha (Eds.).
17. De Westelinck K., Valcke M., De Craene B., Kirschner P. Multimedia learning in social sciences: Limitations of external graphical representations. Computers in Human Behavior 2005, 21:555-573.
18. DeLoache J.S. Becoming symbol-minded. Trends in Cognitive Sciences 2004, 8:66-70.
19. DeLoache J.S., Uttal D.H., Pierroutsakos S.L. The development of early symbolization: Educational implications. Learning and Instruction 1998, 8:325-339.
20. Demetriou A., Christou C., Spanoudis G., Platsidou M. The development of metal processing: Efficiency, working memory, and thinking. Monographs of the Society for Research in Child Development 2002, 67(1). (Serial No. 268).
21. Diao Y., Chandler P., Sweller J. The effect of written text on comprehension of spoken English as a foreign language. The American Journal of Psychology 2007, 120:237-261.
22. Diao Y., Sweller J. Redundancy in foreign language reading comprehension instruction: Concurrent written and spoken presentations. Learning and Instruction 2007, 17:78-88.
23. Dunsworth Q., Atkinson R.K. Fostering multimedia learning of science. Exploring the role of an animated agent's image. Computers & Education 2007, 49:677-690.
24. Furnham A., Benson I., Gunter B. Memory for television commercials as a function of the channel of communication. Social Behaviour 1989, 3:105-112.
25. Furnham A., De Siena B., Gunter B. Children's and adults' recall of children's news stories in both print and audio-visual presentation modalities. Applied Cognitive Psychology 2002, 4:203-212.
26. Furnham A., Gunter B., Green A. Remembering science: The recall of factual information as a function of the presentation mode. Applied Cognitive Psychology 1990, 4:203-212.
27. Garza T.J. Evaluating the use of captioned video materials in advanced foreign language learning. Foreign Language Annals 1991, 24:239-258.
28. Geary D.C. Educating the evolved mind: Conceptual foundations for an evolutionary educational psychology. Psychological perspectives on contemporary educational issues 2007, 1-99. Information Age Publishing, Greenwich, CT. J.S. Carlson, J.R. Levin (Eds.).
29. Geary D.C. An evolutionarily informed education science. Educational Psychologist 2008, 43:179-195.
30. Gerjets P., Scheiter K., Opfermann M., Hesse F.W., Eysink T.H.S. Learning with hypermedia: The influence of representational formats and different levels of learner control on performance and learning behavior. Computers in Human Behavior 2009, 25:360-370.
31. Gerjets P., Scheiter K., Schuh J. Information comparisons in example-based hypermedia environments: Supporting learners with processing prompts and an interactive comparison tool. Educational Technology Research and Development 2008, 56:73-92.
32. Ginns P. Meta-analysis of the modality effect. Learning and Instruction 2005, 15:313-331.
33. Goolkasian P. Pictures, words, and sounds: From which format are we best able to reason?. Journal of General Psychology 2000, 127:439-459.
34. Gyselinck V., Cornoldi C., Dubois V., De Beni R., Ehrlich M. Visuospatial memory and phonological loop in learning from multimedia. Applied Cognitive Psychology 2002, 16:665-685.
35. Gyselinck V., Jamet E., Dubois V. The role of working memory components in multimedia comprehension. Applied Cognitive Psychology 2008, 22:353-374.
36. Halford G.S., Maybery M.T., O'Hare A.W., Grant P. The development of working memory capacity. Child Development 1994, 65:1338-1356.
37. Harskamp E.G., Mayer R.E., Suhre C. Does the modality principle for multimedia learning apply to science classrooms?. Learning and Instruction 2007, 17:465-477.
38. Hirai A. The relationship between listening and reading rates of Japanese EFL learners. Modern Language Journal 1999, 83:367-384.
39. Jeung H.-J., Chandler P., Sweller J. The role of visual indicators in dual sensory mode instruction. Educational Psychology 1997, 17:329-343.
40. Kalyuga S. Expertise reversal effect and its implications for learner-tailored instruction. Educational Psychology Review 2007, 19:509-539.
41. Kalyuga S., Chandler P., Sweller J. Levels of expertise and instructional design. Human Factors 1998, 40:1-17.
42. Kalyuga S., Chandler P., Sweller J. Managing split-attention and redundancy in multimedia instruction. Applied Cognitive Psychology 1999, 13:351-371.
43. Kalyuga S., Chandler P., Sweller J. Incorporating learner experience into the design of multimedia instruction. Journal of Educational Psychology 2000, 92:126-136.
44. Kalyuga S., Chandler P., Sweller J. When redundant on-screen text in multimedia technical instruction can interfere with learning. Human Factors 2004, 46:567-581.
45. Kintsch W., Kozminsky E., Streby W.J., Mckoon G., Keenan J.M. Comprehension and recall of text as a function of content variables. Journal of Verbal Learning and Verbal Behavior 1975, 14:196-214.
46. Kühl T., Scheiter K., Gerjets P., Edelmann J. The influence of text modality on learning with static and dynamic visualizations. Computers in Human Behavior 2011, 27:29-35.
47. Larkin J.H., Simon H.A. Why a diagram is (sometimes) worth ten thousand words. Cognitive Science 1987, 11:65-99.
48. Leahy, W., & Sweller, J. (2010). The effect of length of auditory instructions on the modality effect: The transitory information effect. The paper presented at the 4th International Cognitive Load Theory Conference, 22-25 November 2010, Hong Kong and Macau.
49. Leahy W., Sweller J. Cognitive load theory, modality of presentation and the transient information effect. Applied Cognitive Psychology 2011, 25(6):943-951.
50. Lee C.H., Kalyuga S. Effectiveness of on-screen pinyin in learning Chinese: An expertise reversal for multimedia redundancy effect. Computers in Human Behavior 2011, 27:11-15.
51. Markham P.L. Captioned videotape and second-language listening word recognition. Foreign Language Annals 1999, 32:321-328.
52. Mayer R.E. Multimedia learning: Are we asking the right questions?. Educational Psychologist 1997, 32:1-19.
53. Mayer R.E. Multimedia learning 2009, Cambridge University Press, New York, NY. 2nd Ed.
54. Mayer R.E., Anderson R.B. Animations need narrations: An experimental test of a dual-coding hypothesis. Journal of Educational Psychology 1991, 83:484-490.
55. Mayer R.E., Anderson R.B. The instructive animation: Helping students build connections between words and pictures in multimedia learning. Journal of Educational Psychology 1992, 84:444-452.
56. Mayer R.E., Dow G.T., Mayer S. Multimedia learning in an interactive self-explaining environment: What works in the design of agent-based microworlds?. Journal of Educational Psychology 2003, 95:806-812.
57. Mayer R.E., Heiser J., Lonn S. Cognitive constraints on multimedia learning: When presenting more material results in less understanding. Journal of Educational Psychology 2001, 93:187-198.
58. Mayer R.E., Johnson C.I. Revising the redundancy principle in multimedia learning. Journal of Educational Psychology 2008, 100:380-386.
59. Mayer R.E., Moreno R. A split-attention effect in multimedia learning: Evidence for dual processing systems in working memory. Journal of Educational Psychology 1998, 90:312-320.
60. Mayer R.E., Moreno R. Aids to computer-based multimedia learning. Learning and Instruction 2002, 12:107-119.
61. Mayer R.E., Moreno R. Nine ways to reduce cognitive load in multimedia learning. Educational Psychologist 2003, 38:43-52.
62. Mayer R.E., Sobko K., Mautone P.D. Social cues in multimedia learning: Role of speaker's voice. Journal of Educational Psychology 2003, 95:419-425.
63. Miller G.A. The magical number seven, plus or minus two: Some limits on our capacity for processing information. Psychological Review 1956, 63:81-97.
64. Moreno R., Durán R. Do multiple representations need explanations? The role of verbal guidance and individual differences in multimedia mathematics learning. Journal of Educational Psychology 2004, 96:492-503.
65. Moreno R., Mayer R.E. Cognitive principles of multimedia learning: The role of modality and contiguity. Journal of Educational Psychology 1999, 91:358-368.
66. Moreno R., Mayer R.E. Verbal redundancy in multimedia learning: When reading helps listening. Journal of Educational Psychology 2002, 94:156-163.
67. Moreno R., Mayer R.E., Spires H.A., Lester J.C. The case for social agency in computer-based teaching: Do students learn more deeply when they interact with animated pedagogical agents?. Cognition and Instruction 2001, 19:177-213.
68. Mousavi S.Y., Low R., Sweller J. Reducing cognitive load by mixing auditory and visual presentation modes. Journal of Educational Psychology 1995, 87:319-334.
69. Moussa J., Ayres P., Sweller J. Cognitive load and the impact of spoken English on learning English as a foreign language 2007, Paper presented at the the International Conference on Cognitive Load Theory, Sydney, UNSW.
70. O'Neil H.F., Chuang S.S. An audio/text after-action review in a computer-Based collaborative problem solving task 2007, National Center for Research on Evaluation, Standards, and Student Testing (CRESST). University of California, Los Angeles, LA.
71. Paas F., Camp G., Rikers R. Instructional compensation for age-related cognitive declines: Effects of goal specificity in maze learning. Journal of Educational Psychology 2001, 93:181-186.
72. Paivio A. Mental representations: A dual coding approach 1986, Oxford University Press, Oxford.
73. Pascual-Leone J. Reflections on working memory: Are the two models complementary?. Journal of Experimental Child Psychology 2000, 77:138-154.
74. Penney C.G. Modality effects and the structure of short-term verbal memory. Memory & Cognition 1989, 17:398-422.
75. Peterson L., Peterson M.J. Short-term retention of individual verbal items. Journal of Experimental Psychology 1959, 58:193-198.
76. Plass J.L., Chun D.M., Mayer R.E., Leutner D. Cognitive load in reading a foreign language text with multimedia aids and the influence of verbal and spatial abilities. Computers in Human Behavior 2003, 19:221-243.
77. Pociask F.D., Morrison G.R. Controlling split attention and redundancy in physical therapy instruction. Educational Technology Research and Development 2008, 56:379-399.
78. Rummer, R., Schweppe, J., Fürstenberg, A., Scheiter, K., & Zindler, A. (2011, May 23). The perceptual basis of the modality effect in multimedia learning. Journal of Experimental Psychology: Applied. Advance online publication. doi:10.1037/a0023588.
79. Rummer R., Schweppe J., Fürstenberg A., Seufert T., Brünken R. Working memory interference during processing texts and pictures: Implications for the explanation of the modality effect. Applied Cognitive Psychology 2010, 24:164-176.
80. Sadoski M., Paivio A. Imagery and text: A dual coding theory of reading and writing 2001, Lawrence Erlbaum, Mahwah, NJ.
81. Sannomiya M. Modality effect on text processing as a function of ability to comprehend. Perceptual and Motor Skills 1984, 58:379-382.
82. Schmidt-Weigand F., Kohnert A., Glowalla U. A closer look at split visual attention in system- and self-paced instruction in multimedia learning. Learning and Instruction 2010, 20:100-110.
83. Schnotz W. An integrated model of text and picture comprehension. The Cambridge handbook of multimedia learning 2005, 49-69. Cambridge University Press, Cambridge, UK. R.E. Mayer (Ed.).
84. Segers E., Verhoeven L., Hulstijn-Hendrikse N. Cognitive processes in children's multimedia text learning. Applied Cognitive Psychology 2008, 22:375-387.
85. Seufert T., Schütze M., Brünken R. Memory characteristics and modality in multimedia learning: An aptitude-treatment-interaction study. Learning and Instruction 2009, 19:28-42.
86. Stiller K.D., Freitag A., Zinnbauer P., Freitag C. How pacing of multimedia instructions can influence modality effects: A case of superiority of visual texts. Australasian Journal of Educational Technology 2009, 25:184-203.
87. Sweller J. Instructional implications of David C. Geary's evolutionary educational psychology. Educational Psychologist 2008, 43:214-216.
88. Sweller J., Ayres P., Kalyuga S. Cognitive load theory 2011, Springer, New York.
89. Tabbers H.K., Martens R.L., van Merriënboer J.J.G. Multimedia instructions and cognitive load theory: Effects of modality and cueing. British Journal of Educational Psychology 2004, 74:71-81.
90. Tiene D. Sensory mode and information load: Examining the effects of timing on multisensory processing. International Journal of Instructional Media 2000, 27:183-197.
91. Tindall-Ford S., Chandler P., Sweller J. When two sensory modes are better than one. Journal of Experimental Psychology: Applied 1997, 3:257-287.
92. Van Gerven P.W.M., Paas F., Van Merriënboer J.J.G., Schmidt H.G. Cognitive load theory and aging: Effects of worked examples on training efficiency. Learning and Instruction 2002, 38:87-107.
93. Witteman M.J., Segers E. The modality effect tested in children in a user-paced multimedia environment. Journal of Computer Assisted Learning 2010, 26:132-142.
94. Wouters P., Paas F., Van Merriënboer J.J.G. Observational learning from animated models: Effects of modality and reflection on transfer. Contemporary Educational Psychology 2009, 34:1-8.