How a picture facilitates the process of learning from text: Evidence for scaffolding

Learning and Instruction

Volumn 28, Issue , 2013, Pages 48-63

  Eitel, Alexander ^a   Scheiter, Katharina ^a   Schüler, Anne ^a   Nyström, Marcus ^b   Holmqvist, Kenneth ^b  

^a KNOWLEDGE MEDIA RESEARCH CENTER   (Germany)

^b LUND UNIVERSITY   (Sweden)

Author keywords

Comprehension of text and graphics; Eye movements; Mental model construction; Picture perception; Text processing

Indexed keywords

EID: 84879590625     PISSN: 09594752     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.learninstruc.2013.05.002     Document Type: Article

References (72)

1. Ainsworth S. DeFT: a conceptual framework for considering learning with multiple representations. Learning and Instruction 2006, 16:183-198. 10.1016/j.learninstruc.2006.03.001.
2. Altmann G.T.M. Language-mediated eye movements in the absence of a visual world: the 'blank screen paradigm'. Cognition 2004, 93:B79-B87. 10.1016/j.cognition.2004.02.005.
3. Anglin G.J., Vaez H., Cunningham K.L. Visual representations and learning: the role of static and animated graphics. Handbook of research on educational communications and technology 2004, 865-916. Lawrence Erlbaum, Mahwah, NJ. D.H. Jonassen (Ed.).
4. Antes J.R., Penland J.G., Metzger R.L. Processing global information in briefly presented pictures. Psychological Research 1981, 43:277-292. 10.1007/BF00308452.
5. Biederman I., Rabinowitz J.C., Glass A.L., Stacy E.W. On the information extracted from a glance at a scene. Journal of Experimental Psychology: General 1974, 103:597-600. 10.1037/h0037158.
6. Boucheix J.-M., Schneider E. Static and animated presentations in learning dynamic mechanical systems. Learning and Instruction 2009, 19:112-127. 10.1016/j.learninstruc.2008.03.004.
7. Brandt S.A., Stark L.W. Spontaneous eye movements during visual imagery reflect the content of the visual scene. Journal of Cognitive Neuroscience 1997, 9:27-38. 10.1162/jocn.1997.9.1.27.
8. Butcher K.R. Learning from text with diagrams: promoting mental model development and inference generation. Journal of Educational Psychology 2006, 98:182-197. 10.1037/0022-0663.98.1.182.
9. Castelhano M.S., Henderson J.M. Initial scene representations facilitate eye movement guidance in visual search. Journal of Experimental Psychology: Human Perception and Performance 2007, 33:753-763. 10.1037/0096-1523.33.4.753.
10. Chi M.T.H. Self-explaining expository texts: the dual process of generating inferences and repairing mental models. Advances in instructional psychology 2000, 161-238. Lawrence Erlbaum, Mahwah, NJ. R. Glaser (Ed.).
11. Cierniak G., Scheiter K., Gerjets P. Explaining the split-attention effect: is the reduction of extraneous cognitive load accompanied by an increase in germane cognitive load?. Computers in Human Behavior 2009, 25(2):315-324. 10.1016/j.chb.2008.12.020.
12. Conway M.A., Gardiner J.M., Perfect T.J., Cohen G.M. Changes in memory awareness during learning: the acquisition of knowledge by psychology undergraduates. Journal of Experimental Psychology: General 1997, 126:393-413. 10.1037//0096-3445.126.4.393.
13. van Dijk T.A., Kintsch W. Strategies of discourse comprehension 1983, Academic Press, New York.
14. Eitel A., Scheiter K., Schüler A. The time course of information extraction from instructional diagrams. Perceptual and Motor Skills 2012, 115:677-701. 10.2466/22.23.PMS.115.6.677-701.
15. Eitel A., Scheiter K., Schüler A. How inspecting a picture affects processing of text in multimedia learning. Applied Cognitive Psychology 2013, 10.1002/acp.2922.
16. Ekstrom R.B., French J.W., Harman H.H. Manual for kit of factor referenced cognitive tests 1976, Educational Testing Service, Princeton.
17. Fei-Fei L., Iyer A., Koch C., Perona P. What do we perceive in a glance at a real-world scene?. Journal of Vision 2007, 7:1-29. 10.1167/7.1.10.
18. Fletcher J.D., Tobias S. The multimedia principle. The Cambridge handbook of multimedia learning 2005, 117-133. Cambridge University Press, Cambridge, MA. R.E. Mayer (Ed.).
19. Folker S., Ritter H., Sichelschmidt L. Processing and integrating multimodal material: the influence of color-coding. Proceedings of the 27th annual conference of the cognitive science society 2005, 690-695. Erlbaum, Mahwah, NJ. B.G. Bara, L. Barsalou, M. Bucciarelli (Eds.).
20. Ginns P. Integrating information: a meta-analysis of the spatial contiguity and temporal contiguity effects. Learning and Instruction 2006, 16:511-525. 10.1016/j.learninstruc.2006.10.001.
21. Glenberg A.M., Langston W.E. Comprehension of illustrated text: pictures help to build mental models. Journal of Memory and Language 1992, 31:129-151. 10.1016/0749-596X(92)90008-L.
22. Gyselinck V., Jamet E., Dubois V. The role of working memory components in multimedia comprehension. Applied Cognitive Psychology 2008, 22:353-374. 10.1002/acp.1411.
23. Gyselinck V., Tardieu H. The role of illustrations in text comprehension: what, when, for whom, and why?. The construction of mental representations during reading 1999, 195-218. Lawrence Erlbaum, Mahwah, NJ. H. van Oostendorp, S. Goldman (Eds.).
24. Hegarty M. Mental animation: inferring motion from static displays of mechanical systems. Journal of Experimental Psychology: Learning, Memory, and Cognition 1992, 18:1084-1102. 10.1037/0278-7393.18.5.1084.
25. Hegarty M. Mechanical reasoning by mental simulation. Trends in Cognitive Sciences 2004, 8:280-285. 10.1016/S1364-6613(04)00100-7.
26. Hegarty M. The cognitive science of visual-spatial displays: implications for design. Topics in Cognitive Science 2011, 3:446-474. 10.1111/j.1756-8765.2011.01150.x.
27. Hegarty M., Just M.A. Constructing mental models of machines from text and diagrams. Journal of Memory and Language 1993, 32:717-742. 10.1006/jmla.1993.1036.
28. Johansson R., Holsanova J., Dewhurst R., Holmqvist K. Eye movements during scene recollection have a functional role, but they are not reinstatements of those produced during encoding. Journal of Experimental Psychology: Human Perception and Performance 2011, 38:1289-1314. 10.1037/a0026585.
29. Johansson R., Holsanova J., Holmqvist K. Pictures and spoken descriptions elicit similar eye movements during mental imagery, both in light and in complete darkness. Cognitive Science 2006, 30:1053-1079. 10.1207/s15516709cog0000_86.
30. Johnson-Laird P.N. Mental models in cognitive science. Cognitive Science 1980, 4:71-115. 10.1016/S0364-0213(81)80005-5.
31. Johnson-Laird P.N. Mental models: Towards a cognitive science of language, inference, and consciousness 1983, Harvard University Press, Cambridge, MA.
32. Johnson-Laird Mental models and thought. The Cambridge handbook of thinking and reasoning 2005, 185-208. Cambridge University Press, Cambridge. K. Holyoak, R.J. Sternberg (Eds.).
33. Johnson C.I., Mayer R.E. An eye movement analysis of the spatial contiguity effect in multimedia learning. Journal of Experimental Psychology: Applied 2012, 18:178-191. 10.1037/a0026923.
34. Just M.A., Carpenter P.A. Atheory of reading: from eye fixations to comprehension. Psychological Review 1980, 87:329-354. 10.1037//0033-295X.87.4.329.
35. Kaakinen J.K., Hyönä J., Keenan J.M. How prior knowledge, WMC, and relevance of information affect eye fixations in expository text. Journal of Experimental Psychology: Learning, Memory, and Cognition 2003, 29:447-457. 10.1037/0278-7393.29.3.447.
36. Kozhevnikov M., Motes M.A., Hegarty M. Spatial visualization in physics problem solving. Cognitive Science 2007, 31:549-579. 10.1080/15326900701399897.
37. Kulhavy R.W., Lee J.B., Caterino L.C. Conjoint retention of maps and related discourse. Contemporary Educational Psychology 1985, 10:28-37. 10.1016/0361-476X(85)90003-7.
38. Kulhavy R.W., Stock W.A., Kealy W.A. How geographic maps increase recall of instructional text. Educational Technology Research and Development 1993, 41:47-62. 10.1007/BF02297511.
39. Laeng B., Teodorescu D.-S. Eye scanpaths during visual imagery reenact those of perception of the same visual scene. Cognitive Science 2002, 26:207-231. 10.1016/S0364-0213(01)00065-9.
40. Larkin J.H., Simon H.A. Why a diagram is (sometimes) worth ten thousand words. Cognitive Science 1987, 11:65-99. 10.1016/S0364-0213(87)80026-5.
41. Levie W.H., Lentz R. Effects of text illustrations: a review of research. Educational Communication and Technology 1982, 30:195-232.
42. Liu K., Jiang Y. Visual working memory for briefly presented scenes. Journal of Vision 2005, 5:650-658. 10.1167/5.7.5.
43. Lowe R. Extracting information from an animation during complex visual processing. European Journal of the Psychology of Education 1999, 14:225-244. 10.1007/BF03172967.
44. Mason L., Tornatora M.C., Pluchino P. Do fourth graders integrate text and picture in processing and learning from an illustrated science text? Evidence from eye-movement patterns. Computers & Education 2013, 60:95-109.
45. Mayer R.E. Rote versus meaningful learning. Theory into Practice 2002, 41:226-232. 10.1207/s15430421tip4104_4.
46. Mayer R.E. Multimedia learning 2009, Cambridge University Press, Cambridge. 2nd ed.
47. Mayer R.E., Gallini J.K. When is an illustration worth ten thousand words?. Journal of Educational Psychology 1990, 82:715-726. 10.1037/0022-0663.82.4.715.
48. Mayer R.E., Moreno R. Aids to computer-based multimedia learning. Learning and Instruction 2002, 12:107-119. 10.1016/S0959-4752(01)00018-4.
49. McCrudden M.T., Magliano J.P., Schraw G. The effect of diagrams on online reading processes and memory. Discourse Processes 2011, 48:69-92. 10.1080/01638531003694561.
50. Narayanan N.H., Hegarty M. Multimedia design for communication of dynamic information. International Journal of Human-Computer Studies 2002, 57:279-315.
51. Navon D. Forest before trees: the precedence of global features in visual perception. Cognitive Psychology 1977, 9:353-383. 10.1016/0010-0285(77)90012-3.
52. Oliva A. Gist of the scene. Neurobiology of attention 2005, 251-256. Elsevier, San Diego, CA. L. Itti, G. Rees, J.K. Tsotsos (Eds.).
53. Oliva A., Schyns P.G. Diagnostic colors mediate scene recognition. Cognitive Psychology 2000, 41:176-210. 10.1006/cogp.1999.0728.
54. Oliva A., Torralba A. Building the gist of a scene: the role of global image features in recognition. Progress in Brain Research 2006, 155:23-36. 10.1016/S0079-6123(06)55002-2.
55. Ozcelik E., Arslan-Ari I., Cagiltay K. Why does signaling enhance multimedia learning? Evidence from eye movements. Computers in Human Behavior 2010, 26:110-117. 10.1016/j.chb.2009.09.001.
56. Rayner K. Eye movements and attention in reading, scene perception, and visual search. Quarterly Journal of Experimental Psychology 2009, 62:1457-1506. 10.1080/17470210902816461.
57. Rayner K., Chace K.H., Slattery T.J., Ashby J. Eye movements as reflections of comprehension processes in reading. Scientific Studies of Reading 2006, 10:241-255. 10.1207/s1532799xssr1003_3.
58. Rousselet G.A., Joubert O.R., Fabre-Thorpe M. How long to get to the "gist" of real-world natural scenes?. Visual Cognition 2005, 12:852-877. 10.1080/13506280444000553.
59. Rummer R., Schweppe J., Fürstenberg A., Scheiter K., Zindler A. The perceptual basis of the modality effect in multimedia learning. Journal of Experimental Psychology: Applied 2011, 17:159-173. 10.1037/a0023588.
60. Scaife M., Rogers Y. External cognition: how do graphical representations work?. International Journal of Human-Computer Studies 1996, 45:185-213. 10.1006/ijhc.1996.0048.
61. Scheiter K., Eitel A. Getting a clue: gist extraction from scenes and causal systems. Diagrammatic representation and inference - 6th International conference, diagrams 2010 2010, 264-270. Springer, Heidelberg, LNAI 6170. 10.1007/978-3-642-14600-8_26. A.K. Goel, M. Jamnik, N.H. Narayanan (Eds.).
62. Schmidt-Weigand F., Kohnert A., Glowalla U. Acloser look at split visual attention in system- and self-paced instruction in multimedia learning. Learning and Instruction 2010, 20:100-110. 10.1016/j.learninstruc.2009.02.011.
63. Schmidt-Weigand F., Kohnert A., Glowalla U. Explaining the modality and contiguity effects: new insights from investigating students' viewing behaviour. Applied Cognitive Psychology 2010, 24:226-237. 10.1002/acp.1554.
64. Schnotz W. Towards an integrated view of learning from text and visual displays. Educational Psychology Review 2002, 14:101-120. 10.1023/A:1013136727916.
65. Schnotz W., Bannert M. Construction and interference in learning from multiple representations. Learning and Instruction 2003, 13:141-156. 10.1016/S0959-4752(02)00017-8.
66. Schnotz W., Kürschner C. External and internal representations in the acquisition and use of knowledge: visualization effects on mental model construction. Instructional Science 2008, 36:175-190. 10.1007/s11251-007-9029-2.
67. Schwonke R., Berthold K., Renkl A. How multiple external representations are used and how they can be made more useful. Applied Cognitive Psychology 2009, 23:1227-1243. 10.1037/a0013247.
68. Stalbovs, K., Eitel, A., & Scheiter, K. (2013, August). In Which cognitive processes predict successful learning with multimedia? Paper presented at the Fifteenth Biennial Conference of the European Association for Research on Learning and Instruction (EARLI), Munich, Germany.
69. Stenning K., Oberlander J. Acognitive theory of graphical and linguistic reasoning: logic and implementation. Cognitive Science 1995, 19:97-140. 10.1016/0364-0213(95)90005-5.
70. Vekiri I. What is the value of graphical displays in learning?. Educational Psychology Review 2002, 14:261-312.
71. Winn W. Learning from maps and diagrams. Educational Psychology Review 1991, 3:211-247. 10.1007/BF01320077.
72. Winn W. An account of how readers search for information in diagrams. Contemporary Educational Psychology 1993, 18:162-185. 10.1006/ceps.1993.1016.