Learning from multimedia: Cognitive processes and instructional support

The Psychology of Digital Learning: Constructing, Exchanging, and Acquiring Knowledge with Digital Media

Volumn , Issue , 2017, Pages 1-19

  Scheiter, Katharina ^a   Schüler, Anne ^a   Eitel, Alexander ^b  

^a KNOWLEDGE MEDIA RESEARCH CENTER   (Germany)

^b UNIVERSITY OF FREIBURG   (Germany)

Author keywords

Dual coding; Instructional guidance; Integration of text and pictures; Multimedia learning

Indexed keywords

EID: 85033356112     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1007/978-3-319-49077-9_1     Document Type: Chapter

References (67)

1. Anglin, G. J., Vaez, H., & Cunningham, K. L. (2004). Visual representations and learning: The role of static and animated graphics. In D. Jonassen (Ed.), Handbook of research on educational communications and technology (Vol. 2, pp. 865-916). Mahwah, NJ: Erlbaum.
2. Arndt, J., Schüler, A., & Scheiter, K. (2015). Text-picture integration: How delayed testing moderates recognition of pictorial information in multimedia learning. Applied Cognitive Psychology, 29, 702-712.
3. Atkinson, R. C., & Shiffrin, R. M. (1968). Human memory: A proposed system and its control processes. In K. W. Spence & J. T. Spence (Eds.), The psychology of learning and motivation (Vol. 2, pp. 89-195). London: Academic Press.
4. Baddeley, A. D. (1999). Essentials of human memory. Hove, UK: Psychology Press.
5. Bartholomé, T., & Bromme, R. (2009). Coherence formation when learning from text and pictures: What kind of support for whom? Journal of Educational Psychology, 101, 282-293.
6. Berthold, K., Eysink, T. H., & Renkl, A. (2009). Assisting self-explanation prompts are more effective than open prompts when learning with multiple representations. Instructional Science, 37, 345-363.
7. Berthold, K., & Renkl, A. (2009). Instructional aids to support a conceptual understanding of multiple representations. Journal of Educational Psychology, 101, 70-87.
8. Bodemer, D., & Faust, U. (2006). External and mental referencing of multiple representations. Computers in Human Behavior, 22, 27-42.
9. Butcher, K. R. (2006). Learning from text with diagrams: Promoting mental model development and inference generation. Journal of Educational Psychology, 98, 182-197.
10. Cierniak, G., Scheiter, K., & Gerjets, P. (2009). Explaining the split-attention effect: Is the reduction of extraneous cognitive load accompanied by an increase in germane cognitive load? Computers in Human Behavior, 25, 315-324.
11. De Koning, B. B., Tabbers, H. K., Rikers, R. M. J. P., & Paas, F. (2009). Towards a framework for attention cueing in instructional animations: Guidelines for research and design. Educational Psychology Review, 21, 113-140.
12. Eitel, A. (2016). How repeated studying and testing affects multimedia learning: Evidence for adaptation to task demands. Learning and Instruction, 41, 70-84.
13. Eitel, A., Scheiter, K., & Schüler, A. (2012). The time course of information extraction from instructional diagrams. Perceptual and Motor Skills, 115, 677-701.
14. Eitel, A., Scheiter, K., & Schüler, A. (2013). How inspecting a picture affects processing of text in multimedia learning. Applied Cognitive Psychology, 27, 451-461.
15. Eitel, A., Scheiter, K., Schüler, A., Nyström, M., & Holmqvist, K. (2013). How a picture facilitates the process of learning from text: Evidence for scaffolding. Learning and Instruction, 28, 48-63.
16. Gentner, D., & Loftus, E. F. (1979). Integration of verbal and visual information as evidenced by distortions in picture memory. The American Journal of Psychology, 92, 363-375.
17. Ginns, P. (2006). Integrating information: A meta-analysis of the spatial contiguity and temporal contiguity effects. Learning and Instruction, 16, 511-525.
18. Glenberg, A., & Langston, W. E. (1992). Comprehension of illustrated text: Pictures help to build mental models. Journal of Memory and Language, 31, 129-151.
19. Gollwitzer, P. M. (1999). Implementation intentions: Strong effects of simple plans. American Psychologist, 54, 493-503.
20. Gollwitzer, P. M., & Sheeran, P. (2006). Implementation intentions and goal achievement: A meta-analysis of effects and processes. In M. P. Zanna (Ed.), Advances in experimental social psychology (Vol. 38, pp. 69-119). San Diego, CA: Elsevier Academic Press.
21. Greene, M. R., & Oliva, A. (2009). The briefest of glances: The time course of natural scene understanding. Psychological Science, 20, 464-472.
22. Hannus, M., & Hyönä, J. (1999). Utilization of illustrations during learning of science textbook passages among low- and high-ability children. Contemporary Educational Psychology, 24, 95-123.
23. Hegarty, M., & Just, M. A. (1993). Constructing mental models of machines from text and diagrams. Journal of Memory and Language, 32, 717-742.
24. Jamet, E. (2014). An eye-tracking study of cueing effects in multimedia learning. Computers in Human Behavior, 32, 47-53.
25. Jarodzka, H., Balslev, T., Holmqvist, K., Nyström, M., Scheiter, K., Gerjets, P., & Eika, B. (2012). Conveying clinical reasoning based on visual observation via eye-movement modelling examples. Instructional Science, 40, 813-827.
26. Jarodzka, H., van Gog, T., Dorr, M., Scheiter, K., & Gerjets, P. (2013). Learning to see: Guiding students' attention via a model's eye movements fosters learning. Learning and Instruction, 25, 62-70.
27. Johnson, C. I., & Mayer, R. E. (2012). An eye movement analysis of the spatial contiguity effect in multimedia learning. Journal of Experimental Psychology: Applied, 18, 178-191.
28. Johnson-Laird, P. N. (1983). Mental models: Towards a cognitive science of language, inference, and consciousness. Cambridge: Cambridge University Press.
29. Just, M. A., & Carpenter, P. A. (1980). A theory of reading: From eye fixations to comprehension. Psychological Review, 87, 329-354.
30. Kombartzky, U., Plötzner, R., Schlag, S., & Metz, B. (2010). Developing and evaluating a strategy for learning from animations. Learning and Instruction, 20, 424-433.
31. Levin, J. R., Anglin, G. J., & Carney, R. N. (1987). On empirically validating functions of pictures in prose. In D. M. Willows & H. A. Houghton (Eds.), The psychology of illustration (Vol. 1, pp. 51-85). New York: Springer.
32. Mason, L., Pluchino, P., & Tornatora, M. C. (in press). Using eye-tracking technology as an indirect instruction tool to improve text and picture processing and learning. British Journal of Educational Technology. doi:10.1111/bjet.12271.
33. Mason, L., Pluchino, P., & Tornatora, M. C. (2015). Eye-movement modeling of integrative reading of an illustrated text: Effects on processing and learning. Contemporary Educational Psychology, 41, 172-187.
34. Mason, L., Pluchino, P., & Tornatora, M. C. (2013). Effects of picture labeling on science text processing and learning: Evidence from eye movements. Reading Research Quarterly, 48, 199-214.
35. Mason, L., Tornatora, M. C., & Pluchino, P. (2013). Do fourth graders integrate text and picture in processing and learning from an illustrated science text? Evidence from eye-movement patterns. Computers & Education, 60, 95-109.
36. Mason, L., Tornatora, M. C., & Pluchino, P. (2015). Integrative processing of verbal and graphical information during re-reading predicts learning from illustrated text: An eye-movement study. Reading and Writing, 28, 851-872.
37. Mayer, R. E. (1997). Multimedia learning: Are we asking the right questions? Educational Psychologist, 32, 1-19.
38. Mayer, R. E. (2009). Multimedia learning (2nd ed.). New York, NY: Cambridge University Press.
39. McNamara, T. P., Halpin, J. A., & Hardy, J. K. (1992). The representation and integration in memory of spatial and nonspatial information. Memory & Cognition, 20, 519-532.
40. O'Keefe, P. A., Letourneau, S. M., Homer, B. D., Schwartz, R. N., & Plass, J. L. (2014). Learning from multiple representations: An examination of fixation patterns in a science simulation. Computers in Human Behavior, 35, 234-242.
41. Oliva, A., & Torralba, A. (2001). Modeling the shape of the scene: A holistic representation of the spatial envelope. International Journal of Computer Vision, 42, 145-175.
42. Ozcelik, E., Arslan-Ari, I., & Cagiltay, K. (2010). Why does signaling enhance multimedia learning? Evidence from eye movements. Computers in Human Behavior, 26, 110-117.
43. Ozcelik, E., Karakus, T., Kursun, E., & Cagiltay, K. (2009). An eye-tracking study of how color coding affects multimedia learning. Computers & Education, 53, 445-453.
44. Paivio, A. (1991). Dual coding theory: Retrospect and current status. Canadian Journal of Psychology, 45, 255-287.
45. Renkl, A., & Scheiter, K. (in press). Studying visual displays: How to instructionally support learning. Educational Psychology Review. doi:10.1007/s10648-015-9340-4.
46. Rey, G. D. (2012). How seductive are decorative elements in learning material? Journal of Educational Multimedia and Hypermedia, 21, 257-283.
47. Richter, J., Scheiter, K., & Eitel, A. (2016). Signaling text-picture relations in multimedia learning: A comprehensive meta-analysis. Educational Research Review, 17, 19-36.
48. Rummer, R., Schweppe, J., Scheiter, K., & Gerjets, P. (2008). Lernen mit Multimedia: Die kognitiven Grundlagen des Modalitätseffekts. Psychologische Rundschau, 59, 98-107.
49. Scheiter, K., & Eitel, A. (2015). Signals foster multimedia learning by supporting integration of highlighted text and diagram elements. Learning and Instruction, 36, 11-26.
50. Schmidt-Weigand, F., Kohnert, A., & Glowalla, U. (2010). A closer look at split visual attention in system-and self-paced instruction in multimedia learning. Learning and Instruction, 20, 100-110.
51. Schmidt-Weigand, F., & Scheiter, K. (2011). The role of spatial descriptions in learning from multimedia. Computers in Human Behavior, 27, 22-28.
52. Schnotz, W. (2002). Commentary: Towards an integrated view of learning from text and visual displays. Educational Psychology Review, 14, 101-120.
53. Schnotz, W. (2005). An integrated model of text and picture comprehension. In R. E. Mayer (Ed.), The Cambridge handbook of multimedia learning (pp. 49-69). New York, NY: Cambridge University Press.
54. Schnotz, W., Ludewig, U., Ullrich, M., Horz, H., McElvany, N., & Baumert, J. (2014). Strategy shifts during learning from texts and pictures. Journal of Educational Psychology, 106, 974-989.
55. Schubert, C., Scheiter, K., & Schüler, A. (2014). Modeling eye movements to support multimedia learning. Poster presented at the Meeting of the EARLI SIG2 Text and Graphics Comprehension. Rotterdam, The Netherlands.
56. Schüler, A., Arndt, J., & Scheiter, K. (2015). Processing multimedia material: Does integration of text and pictures result in a single or two interconnected mental representations? Learning and Instruction, 35, 62-72.
57. Schüler, A., Scheiter, K., & Gerjets, P. (2013). Is spoken text always better? Investigating the modality and redundancy effect with longer text presentation. Computers in Human Behavior, 29, 1590-1601.
58. Schüler, A., Scheiter, K., & van Genuchten, E. (2011). The role of working memory in multimedia instruction: Is working memory working during learning from text and pictures? Educational Psychology Review, 23, 389-411.
59. Schwan, S. (this volume). Digital pictures, videos, and beyond: Knowledge acquisition with realistic images.
60. Serra, M. J., & Dunlosky, J. (2010). Metacomprehension judgements reflect the belief that diagrams improve learning from text. Memory, 18, 698-711.
61. Seufert, T. (2003). Supporting coherence formation in learning from multiple representations. Learning and Instruction, 13, 227-237.
62. Stalbovs, K., Scheiter, K., & Gerjets, P. (2015). Implementation intentions during multimedia learning: Using if-then plans to facilitate cognitive processing. Learning and Instruction, 35, 1-15.
63. Stokes, D. E. (1997). Pasteur's quadrant-Basic science and technological innovation. Washington, DC: Brookings Institution Press.
64. Ullrich, M., Schnotz, W., Horz, H., McElvany, N., Schroeder, S., & Baumert, J. (2015). Kognitionspsychologische Aspekte eines Kompetenzmodells zur Bild-Text-Integration. Psychologische Rundschau, 63, 11-17.
65. Van Gog, T. (2014). The signaling (or cueing) principle in multimedia learning. In R. E. Mayer (Ed.), The Cambridge handbook of multimedia learning (2nd ed., pp. 263-278). New York: Cambridge University Press.
66. Veenman, M. V. J., Hout-Wolters, B. H. A. M., & Afflerbach, P. (2006). Metacognition and learning: Conceptual and methodological considerations. Metacognition and Learning, 1, 3-14.
67. Zahn, C. (this volume). Digital design and learning.