How inspecting a picture affects processing of text in multimedia learning

Applied Cognitive Psychology

Volumn 27, Issue 4, 2013, Pages 451-461

  Eitel, Alexander ^a   Scheiter, Katharina ^a   Schüler, Anne ^a  

^a KNOWLEDGE MEDIA RESEARCH CENTER   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; COMPREHENSION; CONTROLLED STUDY; FEMALE; HUMAN; HUMAN EXPERIMENT; LEARNING; LINGUISTICS; MALE; MULTIMEDIA; NORMAL HUMAN; PHOTOGRAPHY; PRIORITY JOURNAL; READING; RECALL; SELF CONCEPT; VERBAL COMMUNICATION;

EID: 84880817570     PISSN: 08884080     EISSN: 10990720     Source Type: Journal    
DOI: 10.1002/acp.2922     Document Type: Article

References (60)

1. Ainsworth, S. (2006). DeFT: A conceptual framework for considering learning with multiple representations. Learning and Instruction, 16, 183-198. doi:10.1016/j.learninstruc.2006.03.001
2. Anglin, G. J., Vaez, H., & Cunningham, K. L. (2004). Visual representations and learning: The role of static and animated graphics. In D. H. Jonassen (Ed.), Handbook of research on educational communications and technology (pp. 865-916). Mahwah, NJ: Lawrence Erlbaum.
3. Baggett, P. (1984). Role of temporal overlap of visual and auditory material in forming dual media associations. Journal of Educational Psychology, 76, 408-417. doi:10.1037//0022-0663.76.3.408
4. Boucheix, J.-M., & Schneider, E. (2009). Static and animated presentations in learning dynamic mechanical systems. Learning and Instruction, 19, 112-127. doi:10.1016/j.learninstruc.2008.03.004
5. Carroll, P. J., Young, J. R., & Guertin, M. S. (1991). Visual analysis of cartoons: A view from the far side. In K. Rayner (Ed.), Eye movements and visual cognition: Scene perception and reading (pp. 444-461). New York: Springer.
6. Castelhano, M. S., & Henderson, J. M. (2007). Initial scene representations facilitate eye movement guidance in visual search. Journal of Experimental Psychology. Human Perception and Performance, 33, 753-763. doi:10.1037/0096-1523.33.4.753
7. Cierniak, G., Scheiter, K., & Gerjets, P. (2009). Explaining the split-attention effect: Is the reduction of extraneous cognitive load accompanied by an increase in germane cognitive load? Computers in Human Behavior, 25(2), 315-324. doi:10.1016/j.chb.2008.12.020
8. Clarke, T., Ayres, P., & Sweller, J. (2005). The impact of sequencing and prior knowledge on learning mathematics through spreadsheet applications. Educational Technology Research and Development, 53, 15-24. doi:10.1007/BF02504794
9. Conway, M. A., Gardiner, J. M., Perfect, T. J., & Cohen, G. M. (1997). Changes in memory awareness during learning: The acquisition of knowledge by psychology undergraduates. Journal of Experimental Psychology. General, 126, 393-413. doi:10.1037/0096-3445.126.4.393
10. Eitel, A., Scheiter, K., & Schüler, A. (2010). What can information extraction from scenes and causal systems tell us about learning from text and pictures? In S. Ohlsson, & R. Catrambone (Eds.), Proceedings of the 32nd Annual Conference of the Cognitive Science Society (pp. 2822-2827). Austin, TX: Cognitive Science Society.
11. Eitel, A., Scheiter, K., & Schüler, A. (2012). The time course of information extraction from instructional diagrams. Perceptual and Motor Skills, 155, 677-701. doi:10.2466/22.23.PMS.115.6.677-701
12. Ekstrom, R. B., French, J. W., & Harman, H. H. (1976). Manual for kit of factor-referenced cognitive tests. Princeton: Educational Testing Service.
13. Fei-Fei, L., Iyer, A., Koch, C., & Perona, P.(2007). What do we perceive in a glance at a real-world scene? Journal of Vision, 7, 1-29. doi:10.1167/7.1.10
14. Folker, S., Ritter, H., & Sichelschmidt, L. (2005). Processing and integrating multimodal material: The influence of color-coding. In B. G. Bara, L. Barsalou, & M. Bucciarelli (Eds.), Proceedings of the 27th annual conference of the cognitive science society (pp. 690-695). Mahwah, NJ: Erlbaum.
15. Gernsbacher, M. A., Varner, K. R., & Faust, M. (1990). Investigating differences in general comprehension skill. Journal of Experimental Psychology: Learning, Memory, and Cognition, 16, 430-445.
16. Ginns, P. (2006). Integrating information: A meta-analysis of the spatial contiguity and temporal contiguity effects. Learning and Instruction, 16, 511-525. doi:10.1016/j.learninstruc.2006.10.001
17. Greene, M. R., & Oliva, A. (2009). Recognition of natural scenes from global properties: Seeing the forest without representing the trees. Cognitive Psychology, 58, 137-176. doi:10.1016/j.cogpsych.2008.06.001
18. Gyselinck, V., Jamet, E., & Dubois, V. (2008). The role of working memory components in multimedia comprehension. Applied Cognitive Psychology, 22, 353-374. doi:10.1002/acp.1411
19. Hegarty, M. (1992). Mental animation: Inferring motion from static displays of mechanical systems. Journal of Experimental Psychology: Learning, Memory, and Cognition, 18, 1084-1102. doi:10.1037/0278-7393.18.5.1084
20. Hegarty, M. (2004). Mechanical reasoning by mental simulation. Trends in Cognitive Sciences, 8, 280-285. doi:10.1016/S1364-6613(04)00100-7
21. Hegarty, M., & Just, M. A. (1993). Constructing mental models of machines from text and diagrams. Journal of Memory and Language, 32, 717-742. doi:10.1006/jmla.1993.1036
22. Hegarty, M., Kriz, S., & Cate, C. (2003). The roles of mental animations and external animations in understanding mechanical systems. Cognition and Instruction, 21, 325-360. doi:10.1207/s1532690xci2104_1
23. Henderson, J. M., & Hollingworth, A. (1999). High level scene perception. Annual Review of Psychology, 50, 243-271. doi:10.1146/annurev.psych.50.1.243
24. Kulhavy, R. W., Lee, J. B., & Caterino, L. C. (1985). Conjoint retention of maps and related discourse. Contemporary Educational Psychology, 10, 28-37. doi:10.1016/0361-476X(85)90003-7
25. Kulhavy, R. W., Stock, W. A., & Kealy, W. A. (1993). How geographic maps increase recall of instructional text. Educational Technology Research and Development, 41, 47-62. doi:10.1007/BF02297511
26. Larkin, J. H., & Simon, H. A. (1987). Why a diagram is (sometimes) worth ten thousand words. Cognitive Science, 11, 65-99. doi:10.1016/S0364-0213(87)80026-5
27. Levie, W. H., & Lentz, R. (1982). Effects of text illustrations: A review of research. Educational Communication and Technology, 30, 195-232.
28. Liu, K., & Jiang, Y. (2005). Visual working memory for briefly presented scenes. Journal of Vision, 5, 650-658. doi:10.1167/5.7.5
29. Loftus, G. R., & Harley, E. M. (2004). How different spatial-frequency components contribute to visual information acquisition. Journal of Experimental Psychology. Human Perception and Performance, 30, 104-118. doi:10.1037/0096-1523.30.1.104
30. Mayer, R. E. (2009). Multimedia learning, 2nd edition. Cambridge: Cambridge University Press.
31. Mayer, R. E., & Chandler, P. (2001). When learning is just a click away: Does simple user interaction foster deeper understanding of multimedia messages? Journal of Educational Psychology, 93, 390-397. doi:10.1037//0022-0663.93.2.390
32. Mayer, R. E., & Moreno, R. (2002). Aids to computer-based multimedia learning. Learning and Instruction, 12, 107-119. doi:10.1016/S0959-4752(01)00018-4
33. Mayer, R. E., Mathias, A., & Wetzell, K. (2002). Fostering understanding of multimedia messages through pre-training: Evidence for a two-stage theory of mental model construction. Journal of Experimental Psychology. Applied, 8, 147-154. doi:10.1037//1076-898X.8.3.147
34. Michas, I. C., & Berry, D. C. (2000). Learning a procedural task: Effectiveness of multimedia presentations. Applied Cognitive Psychology, 14, 555-575. doi:10.1002/1099-0720(200011/12)14:6<555::AID-ACP677>3.3.CO;2-W
35. Narayanan, N. H., & Hegarty, M. (2002). Multimedia design for communication of dynamic information. International Journal of Human Computer Studies, 57, 279-315. doi:10.1006/ijhc.1019
36. Navon, D. (1977). Forest before trees: The precedence of global features in visual perception. Cognitive Psychology, 9, 353-383. doi:10.1016/0010-0285(77)90012-3
37. Oliva, A. (2005). Gist of the Scene. In L. Itti, G. Rees, & J. K. Tsotsos (Eds.). Neurobiology of attention (pp. 251-256). San Diego, CA: Elsevier.
38. Oliva, A., & Schyns, P. G. (2000). Diagnostic colors mediate scene recognition. Cognitive Psychology, 41, 176-210. doi:10.1006/cogp.1999.0728
39. Oliva, A., & Torralba, A. (2001). Modeling the shape of the scene: A holistic representation of the spatial envelope. International Journal of Computer Vision, 42, 145-175.
40. Oliva, A., & Torralba, A. (2006). Building the gist of a scene: The role of global image features in recognition. Progress in Brain Research, 155, 23-36. doi:10.1016/S0079-6123(06)55002-2
41. Ozcelik, E., Arslan-Ari, I., & Cagiltay, K. (2010). Why does signaling enhance multimedia learning? Evidence from eye movements. Computers in Human Behavior, 26, 110-117. doi:10.1016/j.chb.2009.09.001
42. Rayner, K., Miller, B., & Rotello, C. M. (2008). Eye movements when looking at print advertisements: The goal of the viewer matters. Applied Cognitive Psychology, 22, 697-707. doi:10.1002/acp.1389
43. Rayner, K., Rotello, C. M., Stewart, A. J., Keir, J., & Duffy, S. A. (2001). Integrating text and pictorial information: Eye movements when looking at print advertisements. Journal of Experimental Psychology: Applied, 7, 219-226. doi:10.1037//1076-898X.7.3.219
44. Rousselet, G. A., Joubert, O. R., & Fabre-Thorpe, M. (2005). How long to get to the "gist" of real-world natural scenes? Visual Cognition, 12, 852-877. doi:10.1080/13506280444000553
45. Rummer, R., Schweppe, J., Fürstenberg, A., Scheiter, K., & Zindler, A. (2011). The perceptual basis of the modality effect in multimedia learning. Journal of Experimental Psychology: Applied, 17, 159-173. doi:10.1037/a0023588
46. Scaife, M., & Rogers, Y. (1996). External cognition: How do graphical representations work? International Journal of Human Computer Studies, 45, 185-213. doi:10.1006/ijhc.1996.0048
47. Scheiter, K., & Eitel, A. (2010). Getting a clue: Gist extraction from scenes and causal systems. In A. K. Goel, M. Jamnik, & N. H. Narayanan (Eds.), Diagrammatic representation and inference-6th International Conference, Diagrams 2010 (LNAI 6170, pp. 264-270). Heidelberg: Springer. doi:10.1007/978-3-642-14600-8_26
48. Schmidt-Weigand, F., Kohnert, A., & Glowalla, U. (2010a). A closer look at split visual attention in system- and self-paced instruction in multimedia learning. Learning and Instruction, 20, 100-110. doi:10.1016/j.learninstruc.2009.02.011
49. Schmidt-Weigand, F., Kohnert, A., & Glowalla, U. (2010b). Explaining the modality and contiguity effects: New insights from investigating students' viewing behaviour. Applied Cognitive Psychology, 24, 226-237. doi:10.1002/acp.1554
50. Schnotz, W. (2005). An integrated model of text and picture comprehension. In R. E. Mayer (Ed.), Cambridge handbook of multimedia learning (pp. 49-69). New York: Cambridge University Press.
51. Schnotz, W., & Bannert, M. (2003). Construction and interference in learning from multiple representations. Learning and Instruction, 13, 141-156. doi:10.1016/S0959-4752(02)00017-8
52. Schnotz, W., & Kürschner, C. (2008). External and internal representations in the acquisition and use of knowledge: Visualization effects on mental model construction. Instructional Science, 36, 175-190. doi:10.1007/s11251-007-9029-2
53. Schüler, A., Scheiter, K., Rummer, R., & Gerjets, P. (2012). Explaining the modality effect in multimedia learning: Is it due to a lack of temporal contiguity with written text and pictures? Learning and Instruction, 22, 92-102. doi:10.1016/j.learninstruc.2011.08.001
54. Schwonke, R., Berthold, K., & Renkl, A. (2009). How multiple external representations are used and how they can be made more useful. Applied Cognitive Psychology, 23, 1227-1243. doi:10.1037/a0013247
55. Stenning, K., & Oberlander, J. (1995). A cognitive theory of graphical and linguistic reasoning: Logic and implementation. Cognitive Science, 19, 97-140. doi:10.1016/0364-0213(95)90005-5
56. Stone, D. E., & Glock, M. E. (1981). How do young adults read directions with and without pictures? Journal of Educational Psychology, 73, 419-426. doi:10.1037//0022-0663.73.3.419
57. Ullrich, M., & Schnotz, W. (2008). Integration of picture and text: Effects of sequencing and redundancy on learning outcomes. In A. Maes, & S. Ainsworth (Eds.), Proceedings EARLI Special Interest Group Text and Graphics: Exploiting the opportunities-Learning with textual, graphical, and multimodal representations (pp. 148-151). Tilburg: Tilburg University.
58. Underwood, G., Jebbett, L., & Roberts, K. (2004). Inspecting pictures for information to verify a sentence: Eye movements in general encoding and in focused search. The Quarterly Journal of Experimental Psychology. A, 57, 165-182. doi:10.1080/02724980343000189
59. Van Dijk, T. A., & Kintsch, W. (1983). Strategies of discourse comprehension. New York: Academic Press.
60. Van Gog, T., Kester, L., Nievelstein, F., Giesbers, B., & Paas, F. (2009). Uncovering cognitive processes: Different techniques that can contribute to cognitive load research and instruction. Computers in Human Behavior, 25, 325-331. doi:10.1016/j.chb.2008.12.021