An eye-tracking study of learning from science text with concrete and abstract illustrations

Journal of Experimental Education

Volumn 81, Issue 3, 2013, Pages 356-384

  Mason, Lucia ^a   Pluchino, Patrik ^a   Tornatora, Maria Caterina ^a   Ariasi, Nicola ^a  

^a UNIVERSITY OF PADOVA   (Italy)

Author keywords

eye movements; instructional pictures; learning from text; text comprehension; text processing

Indexed keywords

EID: 84877991832     PISSN: 00220973     EISSN: 19400683     Source Type: Journal    
DOI: 10.1080/00220973.2012.727885     Document Type: Article

References (85)

1. Ainsworth, S. (1999). The functions of multiple representations. Computers and Education, 33, 131-152. doi: 10.1016/S0360-1315(99)00029-9
2. Ainsworth, S. (2006). DeFT: A conceptual framework for considering learning with multiple representations. Learning and Instruction, 16, 183-198. doi: 10.1016/j.learninstruc.2006.03.001
3. Alexander,P. A. (1998). The nature of disciplinary and domain learning: The knowledge, interest, and strategic dimensions of learning from subject-matter text. In C. Hynd (Ed.), Learning from text across conceptual domains (pp. 263-287). Mahwah NJ Erlbaum.
4. Mahwah, NJ: Erlbaum. Ariasi, N., & Mason, L. (2011a, September). Eye-movement analysis for a process approach to the refutation text effect: Where and When it occurs during reading. Paper presented at the biennial meeting of the European Association for Research on Learning and Instruction, Exeter, UK.
5. Ariasi, N., & Mason, L. (2011b). Uncovering the effect of text structure in learning from a science text: An eye-tracking study. Instructional Science, 39, 581-601. doi: 10.1007/s11251-010-9142-5
6. Bartholomé, T., & Bromme, R. (2009). Coherence formation when learning from text and pictures: What kind of support for whom Journal of Educational Psychology, 101, 282-293. doi: 10.1037/a0014312
7. Boucheix, J-M., & Lowe, R. (2010). An eye tracking comparison of external pointing cues and internal continuous cues in learning with complex animations. Learning and Instruction, 20, 123-135. doi: 10.1016/j.learninstruc. 2009.02.015
8. Britton, B. K. (1994). Understanding expository text: Building mental structures to induce insights. In M. A. Gernsbacher (Ed.), Handbook of psycholinguistics (pp. 641-674). San Diego CA Academic Press.
9. San Diego, CA: Academic Press. Broughton, S. H., & Sinatra, G. M. (2010). Text in the science classroom: Promoting engagement to facilitate conceptual change. In M. G. McKeown & L. Kucan (Eds.), Bringing reading research to life (pp. 232-256). New York NY Guilford Press.
10. Broughton, S. H., Sinatra, G. M., & Reynolds, R. E. (2010). The nature of the refutation text effect: An investigation of attention allocation. Journal of Educational Research, 103, 407-423. doi: 10.1080/00220670903383101
11. Butcher, K. R. (2006). Learning from text with diagrams: Promoting mental model development and inference generation. Journal of Educational Psychology, 98, 182-197. doi: 10.1037/0022-0663.98.1.182
12. Canham, M., & Hegarty, M. (2010). Effects of knowledge and display design on comprehension of complex graphics. Learning and Instruction, 20, 155-166. doi: 10.1016/j.learninstruc.2009.02.014
13. Carney, R. N., & Levin, J. R. (2002). Pictorial illustrations still improve students' learning from text. Educational Psychology Review, 14, 5-26. doi: 10.1023/A:1013176309260
14. Colin, P., Chauvet, F., & Viennot, L. (2002). Reading images in optics: Students' difficulties and teachers' views. International Journal of Science Education, 24, 313-332. doi: 10.1080/09500690110078923
15. Cornoldi, C., Pra Baldi, A., & Friso, G. (2010). MT avanzate-2. Prove MT avanzate di lettura e matematica per il biennio della scuola secondaria superiore [Advanced MT tests-2. Advanced MT tests of reading and mathematics for upper secondary school]. Firenze, Italy: O.S. (in Italian).
16. Corsi, P. M. (1972). Human memory and the medial temporal region of the brain. Unpublished doctoral dissertation, McGill University, Montreal, Quebec, Canada.
17. Cromley, J. G. (2009). Reading achievement and science proficiency: International comparisons from the Programme on International Student Assessment. Reading Psychology, 30, 89-118. doi: 10.1080/02702710802274903
18. Cromley, J. G., Snyder-Hogan, L. E., & Luciw-Dubas, U. A. (2010). Reading comprehension of scientific text: A domain-specific test of the direct and inferential mediation model of reading comprehension. Journal of Educational Psychology, 102, 687-700. doi: 10.1037/a0019452
19. Daneman, M., & Carpenter, P. A. (1980). Individual differences in working memory and reading. Journal of Verbal Learning and Verbal Behavior, 19, 450-466. doi: 10.1016/S0022-5371(80)90312-6
20. Daneman, M., & Merikle, P. M. (1996). Working memory and language comprehension: A meta-analysis. Psychonomic Bulletin and Review, 3, 422-443. doi:10.3758/BF03214546
21. Ericsson, K. A., & Kintsch, W. (1995). Long-term working memory. Psychological Review, 102, 211-245. doi: 10.1037/0033-295X.102.2.211
22. Fitzhugh, S. L., Cromley, J. G., Wills, T., & Bergey, B. (2011, April). The effect on diagrammatic reasoning intervention on students' attention to text and diagrams: An examination of eye movements. Poster presented at the annual meeting of the American Educational Research Association, New Orleans, Louisiana.
23. Florax, M., & Ploetzner, R. (2010). What contributes to the split-attention effect The role of text segmentation, picture labelling, and spatial proximity. Learning and Instruction, 20, 216-224. doi: 10.1016/j.learninstruc.2009.02.021
24. Fox, E. (2009). The role of reader characteristics inprocessing and learning from informational text. Review of Educational Research, 79(1), 197-261. doi: 10.3102/0034654308324654
25. Friedman, N. P., & Miyake, A. (2005). Comparison of four scoring methods for the reading span test. Behavior Research Methods, 37, 581-590. doi: 10.3758/BF03192728
26. Geiser, C., Lehmann, W., & Eid, M. (2006). Separating "rotators" from "non rotators" in the Mental Rotations Test: A multigroup latent class analysis. Multivariate Behavioral Research, 41, 261-293. doi: 10.1207/s15327906mbr41032
27. Gentner, D. (1989). The mechanisms of analogical learning. In S. Vosniadou & Ortony, A. (Eds.), Similarity and analogical reasoning (pp. 199-241). New York NY: Cambridge University Press.
28. New York, NY: Cambridge University Press. Ginns, P. (2006). Integrating information: A meta-analysis of the spatial contiguity and temporal contiguity effects. Learning and Instruction, 16, 511-525. doi: 10.1016/j.learninstruc. 2006.10.001
29. Haskell, R. E. (2001). Transfer of learning: Cognition, instruction, and reasoning. San Diego, CA: Academic Press.
30. Hannus, M., & Hyönä (1999). Utilization of illustrations during learning of science textbook passages among low-and high-ability children. Contemporary Educational Psychology, 24, 95-123. doi: 10.1006/ceps.1998.0987
31. Hegarty, M., Carpenter, P. A., & Just, M. A. (1991). Diagrams in the comprehension of scientific texts. In R. Barr, M. L. Kamil, P. Mosenthal, & P. D. Pearson (Eds.), Handbook of reading research (Vol 2, pp. 641-668).
32. Hegarty, M., & Just, M. A. (1993). Constructing mental models of machines from text and diagrams. Journal of Memory and Language, 32, 717-742. doi: 10.1006/jmla.1993.1036
33. Holsanova, J., Holmberg, N., & Holmqvist, K. (2009). Reading information graphics: The role of spatial contiguity and dual attentional guidance. Applied Cognitive Psychology, 23, 1215-1226. doi: 10.1002/acp.1525
34. Hyönä, J. (2010). The use of eye movements in the study of multimedia learning. Learning and Instruction, 20, 172-176. doi: 10.1016/j.learninstruc.2009.02.013
35. Hyönä, J., & Lorch, R. F. (2004). Effects of topic headings on text processing: Evidence from adult readers' eye fixation patterns. Learning and Instruction, 14, 131-152. doi: 10.1016/j.learninstruc.2004.01.001
36. Hyönä, J., Lorch, R. F., & Kaakinen, J. (2002). Individual differences in reading to summarize expository text: Evidence from eye fixation patterns. Journal of Educational Psychology, 94, 44-55. doi: 10.1037/0022-0663.94.1.44
37. Hyönä, J., Lorch, R. F., & Rinck, M. (2003). Eye movement measures to study global text processing. In J. Hyönä, R. Radach, & H. Deubel (Eds.), The mind's eye: Cognitive and applied aspects of eye movement research (pp. 313-334).
38. Hyönä, J., & Nurminen, A.-M. (2006). Do adult readers know how they read Evidence from eye movement patterns and verbal reports. British Journal of Educational Psychology, 97, 31-50. doi: 10.1348/000712605×53678
39. Jarodzka, H., Scheiter, K., Gerjets, P., & van Gog, T. (2010). In the eyes of the beholder: How experts and novices interpret dynamic stimuli. Learning and Instruction, 20, 146-154. doi: 10.1016/j.learninstruc.2009.02.019
40. Just, M. A., & Carpenter, P. A. (1980). A theory of reading: From eye fixations to comprehension. Psychological Review, 87, 329-354. doi: 10.1037/0033-295X.87.4.329
41. Kaakinen, J. K., & Hyönä, J. (2007). Strategy use in the reading span test: An analyses of eye movements and reported encoding strategies. Memory, 15, 634-646. doi: 10.1080/09658210701457096
42. Kendeou, P., & van den Broek, P. (2005). The effects of readers' misconceptions on comprehension of scientific text. Journal of Educational Psychology, 97, 235-245. doi: 10.1037/0022-0663.97.2.235
43. Kintsch, W. (1998). Comprehension: A paradigm for cognition. Cambridge, England: Cambridge.
44. Kintsch, W., & van Dijk, T. A. (1978). Toward a model of text comprehension and production. Psychological Review, 85, 363-394. doi: 10.1037/0033-295X.85.5.363
45. Koedinger, K. R., Alibali, M. W., & Nathan, M. J. (2008). Trade-offs between grounded and abstract representations. Evidence from algebra problems. Cognitive Science, 32, 366-397. doi: 10.1080/03640210701863933
46. Koedinger, K. R., & Nathan, M. J. (2004). The real story behind story problems: Effects of representations on quantitative reasoning. Journal of the Learning Sciences, 13, 29-164. doi: 10.1207/s15327809jls1302 1
47. Larkin, J. H., & Simon, H. A. (1987). Why a diagram is (sometimes) worth ten thousand words. Cognitive Science, 11, 65-100.
48. Lorch Jr., R. F., Lorch, E. P., & Matthews, P. D. (1985). On-line processing of the topic structure of a text. Journal of Memory and Language, 24, 350-362. doi: 10.1016/0749-596X(85)90033-6
49. Mammarella, I. C., Pazzaglia, F., & Cornoldi, C. (2008). Evidence for different components in children's visuospatial working memory. British Journal of Develomental Psychology, 26, 337-355. doi: 10.1348/026151007×236061
50. Mammarella, I. C., Toso, C., Pazzaglia, F., & Cornoldi, C. (2008). Bvs-Corsi. Batteria per la valutazione della memoria visiva spaziale [Bvs-Corsi. A test battery for the evaluation of visual spatial memory]. Trento, Italy: Erikson.
51. Mayer, R. E. (1989). Systematic thinking fostered by illustrations in scientific text. Journal of Educational Psychology, 81, 240-246. doi: 10.1037/0022-0663.81.2.240
52. Mayer, R. E. (2001). Multimedia learning. New York, NY: Cambridge University Press.
53. Mayer, R. E. (Ed.). (2005). The Cambridge handbook of multimedia learning. New York, NY: Cambridge University Press.
54. Mayer, R. E. (2010). Unique contributions of eye-tracking research to the study of learning with graphics. Learning and Instruction, 20, 167-171. doi: 10.1016/j.learninstruc.2009.02.012.
55. Mayer, R. E., Bove, W., Bryman, A., Mars, R., & Tapangco, L. (1996). When less is more: Meaningful learning from visual and verbal summaries of science textbook lessons. Journal of Educational Psychology, 88, 64-73. doi: 10.1037/0022-0663.88.1.64
56. Mayer, R. E., & Gallini, J. K. (1990). When is an illustration worth ten thousand words Journal of Educational Psychology, 82, 715-726. doi: 10.1037/0022-0663.82.4.715
57. Mayer, R. E., & Sims, V. K. (1994). For whom is a picture worth a thousand words Extensions of a dual-coding theory of multimedia learning. Journal of Educational Psychology, 86, 389-401.
58. McCrudden, M. T., Magliano, J. P., & Schraw, G. (2010). Exploring how relevance instructions affect personal reading intentions, reading goals and text processing: A mixed methods study. Contemporary Educational Psychology, 35, 229-241. doi: 10.1016/j.cedpsych.2009.12.001
59. McCrudden, M. T., Magliano, J. P., & Schraw, G. (2011). The effect of diagrams on online reading processes and memory. Discourse Processes, 48, 69-82. doi: 10.1080/01638531003694561
60. McNamara, D. S., Kintsch, E., Songer, N. B., & Kintsch, W. (1996). Are good texts always better Interactions of text coherence, background knowledge, and levels of understanding in learning from text. Cognition and Instruction, 14, 1-43. doi: 10.1207/s1532690xci1401
61. McNamara, D. S., & Kintsch, W. (1996). Learning from texts: Effects of prior knowledge and text coherence. Discourse Processes, 22, 247-288. doi: 10.1080/01638539609544975
62. Mikkilä-Erdmann, M., Penttinen, M., Anto, E.,&Olkinuora, E. (2008).Modelling individual conceptual change processes during science text comprehension: Evidence from eye tracking and stimulated interviews. Paper presented at the 6th meeting of the Special Interest Group "Conceptual Change" of the European Association for Research on Learning and Instruction, Turku, Finland.
63. Moreno, R., & Mayer, R. E. (1999). Cognitive principles of multimedia learning: The role of modality and contiguity. Journal of Educational Psychology, 91, 358-368. doi: 10.1037/0022-0663.91.2.358
64. Moreno, R., & Mayer, R. E. (2000). A coherence effect in multimedia learning: The case for minimizing irrelevant sounds in the design of multimedia instructional messages. Journal of Educational Psychology, 92, 117-125. doi: 10.1037/0022-0663.92.1.117
65. Moreno, R., Ozogul G., & Reisslein, M. (2011). Teaching with concrete and abstract visual representations: Effects on students' problem solving, problem representations, and learning perceptions. Journal of Educational Psychology, 103, 32-47. doi: 10.1037/a0021995
66. Otero, J., León, J. A., & Graesser, A. C. (Eds.). (2002). The psychology of science text comprehension. Mahwah, NJ: Erlbaum.
67. Paivio, A. (1986). Mental representations: A dual-coding approach. New York, NY: Oxford University Press.
68. Pazzaglia, F., Palladino, P., & De Beni, R. (2000). Presentazione di uno strumento per la valutazione della memoria di lavoro verbale e sua relazione con i disturbi della comprensione [An instrument for the assessment of verbal working memory and its relation with comprehension difficulties]. Psicologia Clinica dello Sviluppo, 3, 465-486.
69. Perry, B., Howard, P., & Tracey, D. (1999). Head mathematics teachers' beliefs about the learning and teaching of mathematics. Mathematics Education Research Journal, 11, 39-53.
70. Ramsay, C. M., Sperling, R. A., & Dornisch, M. M. (2010). A comparison of the effects of students' expository text comprehension strategies. Instructional Science, 38, 551-570. doi: 10.100s11251-008-9081-6
71. Rayner, K. (1998). Eye movements in reading and information processing: 20 years of research. Psychological Bulletin, 124, 372-422. doi: 10.1037/0033-2909.124.3.372
72. Rayner, K. (2009). Eye movements and attention in reading, scene perception, and visual search. Quarterly Journal of Experimental Psychology, 62, 1457-1506. doi: 10.1080/17470210902816461
73. Rayner, K., Chace, K. H., Slattery, T. J., & Ashby, J. (2006). Eye movements as reflections of comprehension processes in reading. Scientific Studies of Reading, 10, 241-155. doi: 10.1207/s1532799xssr1003 3
74. Sanchez, C. A., & Wiley, J. (2006). An examination of the seductive details effect in terms of working memory capacity. Memory & Cognition, 34, 344-355. doi: 10.3758/BF03193412
75. Schnotz, W. (2002). Commentary: Towards an integrated view of learning from text and visual displays. Educational Psychology Review, 14, 101-120. doi: 10.1023/A:1013136727916
76. Schnotz, W. (2005). An integrated model of text and picture comprehension. In R. E. Mayer (Ed.), The Cambridge handbook of multimedia learning (pp. 48-69). New York, NY: Cambridge University Press.
77. Schnotz, W., & Bannert, M. (2003). Construction and interference in learning from multiple representations. Learning and Instruction, 13, 141-156. doi: 10.1016/S0959-4752(02)00017-8
78. Schroeder, S., Richter, T., McElvany, N., Hachfeld, A., Baumert, J., Schnotz, W., . . . Ulrich, M. (2011). Teachers' beliefs, instructional behaviors, and students' engagement in learning from texts with instructional pictures. Learning and Instruction, 21, 403-415. doi: 10.1016/j.learninstruc. 2010.06.001
79. Schwonke, R., Berthold, K., & Renkl, A. (2009). How multiple external representations are used and how they can be made more useful. Applied Cognitive Psychology, 23, 1227-1243. doi: 10.1002/acp.1526
80. Torsten, R., & Schnotz, W. (2009). Interactive and non-interactive pictures in multimedia learning environments: Effects on learning outcomes and learning efficiency. Learning and Instruction, 19, 411-422. doi: 10.1016/j.learninstruc.2009.02.008
81. van den Broek, P. (2010). Using texts in science education. Cognitive processes and knowledge representation. Science, 328, 543-456. doi: 10.1126/science.1182594
82. van Gog, T., & Scheiter, K. (2010). Eye tracking as a tool to study and enhance multimedia learning. Learning and Instruction, 20, 95-99. doi: 10.1016/j.learninstruc.2009.02.009
83. Vandenberg, S. G., & Kuse, A. R. (1978). Mental rotations. A group test of three-dimensional spatial visualization. Perceptual and Motor Skills, 47, 599-604.
84. Veenman, M. V. J., Van Hout-Wolters, B. H. A. M., & Afflerbach, P. (2006). Metacognition and learning: Conceptual and methodological considerations. Metacognition and Learning, 1, 3-14. doi: 10.1007/s11409-006- 6893-0
85. Weidenmann, B. (1989). When good pictures fail. In H. Mandl & I. R. Levin (Eds.), Knowledge acquisition from text and pictures (pp. 157-170). Amsterdam, The Netherlands: North-Holland.