Is spoken text always better? Investigating the modality and redundancy effect with longer text presentation

Computers in Human Behavior

Volumn 29, Issue 4, 2013, Pages 1590-1601

  Schüler, Anne ^a   Scheiter, Katharina ^a   Gerjets, Peter ^a  

^a KNOWLEDGE MEDIA RESEARCH CENTER   (Germany)

Author keywords

Learner pacing; Modality effect; Multimedia learning; Redundancy effect; Text processing strategies

Indexed keywords

COGNITIVE EFFORTS; LEARNER-PACING; LEARNING ENVIRONMENTS; LEARNING OUTCOME; MODALITY EFFECT; MULTI-MEDIA LEARNING; TEXT SEGMENTS; TRANSFER PERFORMANCE;

ANIMATION; COMPUTER AIDED INSTRUCTION; EXPERIMENTS; REDUNDANCY;

LEARNING SYSTEMS;

EID: 84874880988     PISSN: 07475632     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.chb.2013.01.047     Document Type: Article

References (87)

1. R.K. Atkinson Optimizing learning from examples using animated pedagogical agents Journal of Educational Psychology 94 2002 416 427
2. K.A. Austin Multimedia learning: Cognitive individual differences and display design techniques predict transfer learning with multimedia learning modules Computers & Education 53 2009 1339 1354
3. A.D. Baddeley Essentials of human memory 1999 Psychology Press Hove
4. C. Bazerman Physicists reading physics: Schema laden purposes and purpose laden schema Written Communication 2 1985 3 24
5. R.A. Bjork Institutional impediments to effective training D. Druckman, R.A. Bjork, Learning, remembering, believing: Enhancing human performance 1994 National Academy Press Washington, DC 295 306
6. R. Brünken, T. Seufert, and S. Zander Förderung der Kohärenzbildung beim Lernen mit multiplen Repräsentationen [Fostering coherence formation in learning with multiple representations] Zeitschrift für Pädagogische Psychologie 19 2005 61 75 (Pubitemid 40551606)
7. M. Byrne, and R. Curtis Designing health communication: Testing the explanations for the impact of communication medium on effectiveness British Journal of Health Psychology 5 2000 189 199 (Pubitemid 30248881)
8. K.K.H. Chung What effect do mixed sensory mode instructional formats have on both novice and experienced learners of Chinese characters? Learning and Instruction 18 2008 96 108
9. Chung, W., & Robinson, D. H. (2006). The failure to find modality effects with interactive 3D maps. Paper presented at the American educational research association, San Francisco, CA.
10. S.D. Craig, B. Gholson, and D. Driscoll Animated pedagogical agents in multimedia educational environments: Effects of agent properties, picture features, and redundancy Journal of Educational Psychology 94 2002 428 434
11. F.I.M. Craik, and E. Tulving Depth of processing and retention of words in episodic memory Journal of Experimental Psychology: General 104 1975 268 294
12. J.H. Danks, and L.J. End Processing strategies for reading and listening R. Horowitz, S.J. Samuels, Comprehending oral and written language 1987 Academic press San Diego 271 294
13. K. De Westelinck, M. Valcke, B. De Craene, and P. Kirschner Multimedia learning in social sciences: Limitations of external graphical representations Computers in Human Behavior 21 2005 555 573 (Pubitemid 40183434)
14. A. Field Discovering statistics using SPSS (and sex and drugs and rock'n'roll) 3rd ed. 2009 Sage Los Angeles
15. L. Frazier, and K. Rayner Making and correcting errors during sentence comprehension: Eye movements in the analysis of structurally ambiguous sentences Cognitive Psychology 14 1982 178 210
16. A. Furnham Remembering stories as a function of the medium of presentation Psychological Reports 89 2001 483 486 (Pubitemid 33614936)
17. A. Furnham, S. de Siena, and B. Gunter Children's and adults recall of children's news stories in both print and audio-visual presentation modalities Applied Cognitive Psychology 16 2002 191 210 (Pubitemid 39517179)
18. A. Furnham, and B. Gunter Sex, presentation mode and memory for violent and non violent news Journal of Educational Television 11 1985 99 105
19. A. Furnham, and B. Gunter The primacy of print: Immediate cued recall of news as a function of the channel of communication Journal of General Psychology 116 1989 305 310
20. A. Furnham, B. Gunter, and A. Green Remembering science: The recall of factual information as a function of the presentation mode Applied Cognitive Psychology 4 1990 203 212
21. A. Furnham, E. Proctor, and B. Gunter Memory for material presented in the media: The superiority of written communication Psychological Reports 63 1988 935 938 (Pubitemid 19045888)
22. R.M. Gagné The conditions of learning 1977 Holt, Rinehart, and Winston New York
23. P. Gerjets, K. Scheiter, M. Opfermann, F.W. Hesse, and T.H.S. Eysink Learning with hypermedia: The influence of representational formats and different levels of learner control on performance and learning behavior Computers in Human Behavior 25 2009 360 370
24. P. Ginns Meta-analysis of the modality effect Learning and Instruction 15 2005 313 331 (Pubitemid 41288290)
25. B. Gunter, and A. Furnham Sex and personality differences in recall of violent and non violent news from three presentational modalities Personality and Individual Differences 7 1986 829 837
26. B. Gunter, A. Furnham, and G. Gietson Memory for the news as a function of the channel of communication Human Learning 3 1984 265 271
27. V. Gyselinck, E. Jamet, and V. Dubois The role of working memory components in multimedia comprehension Applied Cognitive Psychology 22 2008 353 374 (Pubitemid 351560009)
28. E.G. Harskamp, R.E. Mayer, and C. Suhre Does the modality principle for multimedia learning apply to science classrooms? Learning and Instruction 17 2007 465 477
29. A. Hron, I. Kurbjuhn, H. Mandl, and W. Schnotz Structural inferences in reading and listening G. Rickheit, H. Strohner, Inferences in text processing 1985 North-Holland Amsterdam 221 245
30. J. Hyönä, and A.-M. Nurminen Do adult readers know how they read? Evidence from eye movement patterns and verbal reports British Journal of Psychology 97 2006 31 50 (Pubitemid 43310250)
31. M.A. Just, and P.A. Carpenter The psychology of reading and language comprehension 1987 Allyn & Bacon Boston
32. W. Kintsch, E. Kozminsky, J.W. Streby, G. McKoon, and J. Keenan Comprehension and recall of text as a function of content variables Journal of Verbal Learning and Verbal Behavior 14 1975 196 214
33. L. Klenberg, M. Korkman, and P. Lathi-Nuuttila Differential development of attention and executive functions in 3- to 12-year-old finnish children Developmental Neuropsychology 20 2001 407 428 (Pubitemid 34106516)
34. R.B. Kozma Learning with media Review of Educational Research 61 1991 179 211
35. J.H. Larkin, and H.A. Simon Why a diagram is (sometimes) worth ten thousand words Cognitive Science 11 1987 65 99
36. W. Leahy, and J. Sweller Cognitive load theory, modality of presentation and the transient information effect Applied Cognitive Psychology 25 2011 943 951
37. W. Levie, and R. Lentz Effects of text illustrations: A review of research Educational Communication and Technology Journal 30 1982 195 232
38. S. Lindow, H.M. Fuchs, A. Fürstenberg, J. Kleber, J. Schweppe, and R. Rummer On the robustness of the modality effect: Attempting to replicate a basic finding Zeitschrift für Pädagogische Psychologie 25 2011 231 243
39. B. Mann, P. Newhouse, J. Pagram, A. Campbell, and H. Schulz A comparison of temporal speech and text cueing in educational multimedia Journal of Computer Assisted Learning 18 2002 296 308 (Pubitemid 36836940)
40. R.E. Mayer The Cambridge handbook of multimedia learning 2005 University Press Cambridge
41. R.E. Mayer Multimedia learning 2nd ed. 2009 University Press Cambridge
42. R.E. Mayer, G.T. Dow, and S. Mayer Multimedia learning in an interactive self-explaining environment: What works in the design of agent-based microworlds? Journal of Educational Psychology 95 2003 806 813 (Pubitemid 37514218)
43. R.E. Mayer, J. Heiser, and S. Lonn Cognitive constraints on multimedia learning: When presenting more material results in less understanding Journal of Educational Psychology 93 2002 187 198
44. R.E. Mayer, and R. Moreno A split-attention effect in multimedia learning: Evidence for dual processing systems in working memory Journal of Educational Psychology 90 1998 312 320
45. M.C. Mayrath, P.K. Nihalani, and D.H. Robinson Varying tutorial modality and interface restriction to maximize transfer in a complex simulation environment Journal of Educational Psychology 103 2011 257 268
46. R. Moreno Does the modality principle hold for different media? A test of the method-affects-learning hypothesis Journal of Computer Assisted Learning 22 2006 149 158 (Pubitemid 43937507)
47. R. Moreno, and R.E. Mayer Cognitive principles of multimedia learning: The role of modality and contiguity Journal of Educational Psychology 91 1999 358 368
48. R. Moreno, and Mayer Learning science in virtual reality multimedia environments: Role of methods and media Journal of Educational Psychology 2002 2002 598 610
49. R. Moreno, and R.E. Mayer Verbal redundancy in multimedia learning: When reading helps listening Journal of Educational Psychology 94 2002 156 163
50. R. Moreno, R.E. Mayer, H.A. Spires, and J.C. Lester The case for social agency in computer-based teaching: Do students learn more deeply when they interact with animated pedagogical agents? Cognition and Instruction 19 2001 177 213 (Pubitemid 33595878)
51. J. Müsseler, G. Rickheit, and H. Strohner Influences of modality, text difficulty and processing control on inferences in text processing G. Rickheit, H. Strohner, Inferences in text processing 1985 North-Holland Amsterdam 247 265
52. A. Paivio Mental representations 1990 Oxford University Press New York
53. C.G. Penney Modality effects and the structure of short-term verbal memory Memory & Cognition 17 1989 398 422
54. K.J. Preacher, and A.F. Hayes SPSS and SAS procedures for estimating indirect effects in simple mediation models Behavior Research Methods, Instruments & Computers 36 2004 717 731 (Pubitemid 40251423)
55. J. Reinwein Does the modality effect exist? And if so, which modality effect? Journal of Psycholinguistic Research 41 2012 1 32
56. R. Rummer, and J. Engelkamp Phonological information in immediate and delayed sentence recall The Quarterly Journal of Experimental Psychology 56A 2003 83 95 (Pubitemid 37513346)
57. R. Rummer, A. Fürstenberg, and J. Schweppe Lernen mit Texten und Bildern. Der Anteil akustisch sensorischer Informationen am Zustandekommen des Modalitätseffekts. [The modality effect in learning with texts and pictures: On the impact of the auditory recency effect] Zeitschrift für Pädagogische Psychologie 22 2008 37 45
58. R. Rummer, and J. Schweppe Evidence for a modality effect in sentence retention Psychonomic Bulletin & Review 12 2005 1094 1099 (Pubitemid 43751214)
59. R. Rummer, J. Schweppe, A. Fürstenberg, K. Scheiter, and A. Zindler The perceptual basis of the modality effect in multimedia learning Journal of Experimental Psychology: Applied 2011 159 173
60. R. Rummer, J. Schweppe, A. Fürstenberg, T. Seufert, and R. Brünken Working memory interference during processing texts and pictures: Implications for the explanation of the modality effect Applied Cognitive Psychology 24 2010 164 176
61. J.R. Sanders Adjunct questions and written and oral recall Journal of Educational Psychology 65 1973 181 186
62. M. Sannomiya The modality effect on text processing as a function of presentation rate Japanese Journal of Psychonomic Science 3 1981 17 20
63. M. Sannomiya The modality effect on text processing as a function of organization A. Flammer, W. Kintsch, Discourse processing 1982 North Holland Amsterdam 263 268
64. M. Sannomiya Modality effect on text comprehension as a function of ability to comprehend Perceptual and Motor Skills 58 1984 379 382
65. M. Scaife, and Y. Rogers External cognition: How do graphical representations work? International Journal of Human-Computer Studies 45 1996 185 213 (Pubitemid 126360243)
66. K. Scheiter, P. Gerjets, T. Huk, B. Imhof, and Y. Kammerer The effects of realism in learning with dynamic visualizations Learning and Instruction 19 2009 481 494
67. S. Schlag, and R. Plötzner Supporting learning from illustrated texts: Conceptualizing and evaluating a learning strategy Instructional Science 39 2011 921 937
68. F. Schmidt-Weigand Does animation amplify the modality effect-Or is there any modality effect at all? Zeitschrift für Pädagogische Psychologie 25 2011 245 256
69. F. Schmidt-Weigand, A. Kohnert, and U. Glowalla Explaining the modality and contiguity effects: New insights from investigating students' viewing behavior Applied Cognitive Psychology 24 2010 226 237
70. F. Schmidt-Weigand, and K. Scheiter The role of spatial descriptions in learning from multimedia Computers in Human Behavior 27 2011 22 28
71. W. Schnotz An integrated model of text and picture comprehension R.E. Mayer, The Cambridge handbook of multimedia learning 2005 University Press Cambridge 49 69
72. A. Schüler, K. Scheiter, and P. Gerjets Does the modality effect in multimedia learning appear only with text containing spatial information? Zeitschrift für Pädagogische Psychologie 25 2011 257 267
73. A. Schüler, K. Scheiter, R. Rummer, and P. Gerjets Explaining the modality effect in multimedia learning: Is it due to a lack of temporal contiguity with written text and pictures? Learning and Instruction 22 2012 92 102
74. A. Schüler, K. Scheiter, and F. Schmidt-Weigand Boundary conditions and constraints of the modality effect Zeitschrift für Pädagogische Psychologie 25 2011 211 220
75. A. Schüler, K. Scheiter, and van Genuchten The role of working memory in multimedia instruction: Is working memory working during learning from text and pictures? Educational Psychology Review 23 2011 389 411
76. Schweppe, J., & Rummer, R. (2011). Does obeying the modality principle improve learning in the long run?, submitted for publication.
77. E. Segers, L. Verhoeven, and N. Hulstijn-Hendrikse Cognitive processes in children's multimedia text learning Applied Cognitive Psychology 22 2008 375 387 (Pubitemid 351560010)
78. K. Stenning, and J. Oberlander A cognitive theory of graphical and linguistic reasoning: Logic and implementation Cognitive Science 19 1995 97 140
79. K.D. Stiller, A. Freitag, P. Zinnbauer, and C. Freitag How pacing of multimedia instructions can influence modality effects: A case of superiority of visual texts Australasian Journal of Educational Technology 25 2009 184 203
80. J. Sweller Implications of cognitive load theory for multimedia learning R.E. Mayer, The Cambridge handbook of multimedia learning 2005 University Press Cambridge 19 30
81. J. Sweller, J.J.G. van Merriënboer, and F.G.W.C. Paas Cognitive architecture and instructional design Educational Psychology Review 10 1998 251 296
82. H.K. Tabbers, R.L. Martens, and J.J.G. van Merriënboer Multimedia instructions and cognitive load theory: Effects of modality and cueing British Journal of Educational Psychology 74 2004 71 81 (Pubitemid 38422580)
83. H.K. Tabbers, and W. van der Spoel Where did the modality principle in multimedia learning go? A double replication failure that questions both theory and practical use Zeitschrift für Pädagogische Psychologie 25 2011 221 230
84. E. van Genuchten, K. Scheiter, and A. Schüler Examining learning from text and pictures for different task types: Does the multimedia effect differ for conceptual, causal, and procedural tasks? Computers in Human Behavior 28 2012 2209 2218
85. M.J. Witteman, and E. Segers The modality effect tested in children in a user-paced multimedia environment Journal of Computer Assisted Learning 26 2010 132 142
86. A. Wong, W. Leahy, N. Marcus, and J. Sweller Cognitive load theory, the transient information effect and e-learning Learning and Instruction 22 2012 449 457
87. P. Wouters, F.G.W.C. Paas, and J.J.G. Van Merriënboer Observational learning from animated models: Effects of modality and reflection on transfer Contemporary Educational Psychology 34 2009 1 8