Do fourth graders integrate text and picture in processing and learning from an illustrated science text? Evidence from eye-movement patterns

Computers and Education

Volumn 60, Issue 1, 2013, Pages 95-109

  Mason, Lucia ^a   Tornatora, Maria Caterina ^a   Pluchino, Patrik ^a  

^a UNIVERSITY OF PADOVA   (Italy)

Author keywords

Comprehension of science text; Eye movements; Learning from text; Text and picture comprehension; Text processing

Indexed keywords

COMPREHENSION OF SCIENCE TEXT; EYE-TRACKING; FACTUAL KNOWLEDGE; HIGHER LEARNING; INDIVIDUAL DIFFERENCES; LEARNING FROM TEXT; LEARNING TASKS; ONLINE PROCESSING; PRIOR KNOWLEDGE; READING COMPREHENSION; SPATIAL ABILITIES; TEXT AND PICTURE COMPREHENSION; VISUAL BEHAVIOR;

CLUSTER ANALYSIS; TEXT PROCESSING;

EYE MOVEMENTS;

EID: 84866494282     PISSN: 03601315     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.compedu.2012.07.011     Document Type: Article

References (78)

1. P. Afflerbach The influence of prior knowledge and text genre on readers' prediction strategies Journal of Reading Behavior 22 1990 131 148 10.1080/10862969009547700
2. S. Ainsworth The functions of multiple representations Computers & Education 33 1999 131 152 10.1016/S0360-1315(99)00029-9
3. S. Ainsworth DeFT: a conceptual framework for considering learning with multiple representations Learning and Instruction 16 2006 183 198 10.1016/j.learninstruc.2006.03.001
4. P.A. Alexander, and E. Fox Reading in perspective M.J. Fresch, An essential history of current reading practices 2008 International Reading Association Newark, DE 12 32
5. N. Ariasi, and L. Mason Uncovering the effect of text structure in learning from a science text: an eye-tracking study Instructional Science 39 2011 581 601 10.1007/s11251-010-9142-5
6. T. Bartholomé, and R. Bromme Coherence formation when learning from text and pictures: what kind of support for whom? Journal of Educational Psychology 101 2009 282 293 10.1037/a0014312
7. P. van den Broek, K. Risden, C.R. Fletcher, and R. Thurlow A "landscape" view of reading: fluctuating patterns of activation and the construction of a stable memory representation B.K. Britton, A.C. Graesser, Models of understanding text 1996 Erlbaum Hillsdale, NJ 165 187
8. A. Brook, R. Driver, and in collaboration with D. Hind The development of pupils' understandings of physical characteristics of air across the age range 5-16 1989 Centre for Studies in Science and Mathematics Education- University of Leeds Leeds, UK
9. S.H. Broughton, and G.M. Sinatra Text in science classroom: promoting engagement to facilitate conceptual change M.G. McKeown, L. Kucan, Bringing reading research to life 2010 The Guilford Press New York 232 256
10. S.H. Broughton, G.M. Sinatra, and R.E. Reynolds The nature of the refutation text effect: an investigation of attention allocation Journal of Educational Research 103 2010 407 423 10.1080/00220670903383101
11. S. Carey Conceptual change in childhood 2005 MIT Press Cambridge, MA
12. R.N. Carney, and J.R. Levin Pictorial illustrations still improve students' learning from text Educational Psychology Review 14 2002 5 26 10.1023/A:1013176309260
13. M.T.H. Chi, J.D. Slotta, and N. de Leeuw From things to processes: a theory of conceptual change for learning science concepts Learning and Instruction 4 1994 27 43 10.1016/0959-4752(94)90017-5
14. C. Cornoldi, and G. Colpo Prove di lettura MT per la scuola elementare 2 [New MT tests of reading comprehension for the elementary school] 1998 Organizzazioni Speciali Florence, Italy
15. N. Coté, and S.R. Goldman Building representations of informational text: evidence from children's think-aloud protocols H. van Oostendorp, S.R. Goldman, The construction of mental representations during reading 1999 Erlbaum Mahwah, NJ 169 193
16. J.G. Cromley Reading achievement and science proficiency: international comparisons from the Programme on International Student Assessment Reading Psychology 30 2009 89 118 10.1080/02702710802274903
17. J.G. Cromley, L.E. Snyder-Hogan, and U.A. Luciw-Dubas Reading comprehension of scientific text: a domain-specific test of the direct and inferential mediation model of reading comprehension Journal of Educational Psychology 102 2010 687 700 10.1037/a0019452
18. Q. Dunsworth, and R.K. Atkinson Fostering multimedia learning of science: exploring the role of an animated agent's image Computers & Education 49 2007 677 690
19. M. Florax, and R. Ploetzner What contributes to the split-attention effect? The role of text segmentation, picture labelling, and spatial proximity Learning and Instruction 20 2010 216 224 10.1016/j.learninstruc.2009.02.021
20. E. Fox The role of reader characteristics in processing and learning from informational text Review of Educational Research 79 2009 197 261 10.3102/0034654308324654
21. T. van Gog, H. Jarodzka, K. Scheiter, P. Gerjets, and F. Paas Attention guidance during example study via the model's eye movements Computers in Human Behavior 25 2009 785 791 10.1016/j.chb.2009.02.007
22. T. van Gog, F. Paas, and J.J.G. van Merrienboer Uncovering expertise related differences in troubleshooting performance: combining eye movement and concurrent verbal protocol data Applied Cognitive Psychology 19 2005 205 221 10.1002/acp.1112
23. T. van Gog, and K. Scheiter Eye tracking as a tool to study and enhance multimedia learning Learning and Instruction 20 2010 95 99 10.1016/j. learninstruc.2009.02.009
24. P. Ginns Integrating information: a meta-analysis of the spatial contiguity and temporal contiguity effects Learning and Instruction 16 2006 511 525 10.1016/j.learninstruc.2006.10.001
25. M. Hannus, and J. Hyönä Utilization of illustrations during learning of science textbook passages among low- and high-ability children Contemporary Educational Psychology 24 1999 95 123 10.1006/ceps.1998.0987
26. M. Hegarty, and M.A. Just Constructing mental models of machines from text and diagrams Journal of Memory and Language 32 1993 717 742 10.1006/jmla.1993.1036
27. M. Hegarty, and S. Kriz Effects of knowledge and spatial ability on learning from animation R.K. Lowe, W. Schnotz, Learning with animation: Research implications for design 2008 Cambridge University Press New York 3 29
28. T.N. Höffler Spatial ability: its influence on learning with visualizations - a meta-analytic review Educational Psychology Review 22 2010 245 269 10.1007/s10648-010-9126-7
29. T.N. Höffler, and D. Leutner The role of spatial ability in learning from instructional animations - evidence for an ability as compensator hypothesis Computers in Human Behavior 27 2011 209 216 10.1016/j.chb.2010.07.042
30. J. Hyönä The use of eye movements in the study of multimedia learning Learning and Instruction 20 2010 172 176 10.1016/j.learninstruc.2009. 02.013
31. J. Hyönä, and R.F. Lorch Effects of topic headings on text processing: evidence from adult readers' eye fixation patterns Learning and Instruction 14 2004 131 152 10.1016/j.learninstruc.2004.01.001
32. J. Hyönä, R.F. Lorch, and J. Kaakinen Individual differences in reading to summarize expository text: evidence from eye fixation patterns Journal of Educational Psychology 94 2002 44 55 10.1037/0022-0663.94.1.44
33. J. Hyönä, R.F. Lorch, and M. Rinck Eye movement measures to study global text processing J. Hyönä, R. Radach, H. Deubel, The mind's eye: Cognitive and applied aspects of eye movement research 2003 Elsevier Amsterdam 313 334
34. J. Hyönä, and A.-M. Nurminen Do adult readers know how they read? Evidence from eye movement patterns and verbal reports British Journal of Educational Psychology 97 2006 31 50 10.1348/000712605x53678
35. Johnson, C. I.; & Mayer, R. E. An eye movement analysis of the spatial contiguity effect in multimedia learning. Journal of Experimental Psychology: Applied, doi:10.1037/a0026923 in press.
36. M.A. Just, and P.A. Carpenter A theory of reading: from eye fixations to comprehension Psychological Review 87 1980 329 354 10.1037/0033-295X.87.4.329
37. Y. Kali, and M.C. Linn Designing effective visualizations for elementary school science The Elementary School Journal 109 2008 181 198 10.1086/590525
38. P. Kendeou, and P. van den Broek The effects of readers' misconceptions on comprehension of scientific text Journal of Educational Psychology 97 2005 235 245 10.1037/0022-0663.97.2.235
39. P. Kendeou, and P. van den Broek The effects of prior knowledge and text structure on comprehension processes during reading of scientific texts Memory and Cognition 35 2007 1567 1577 10.3758/BF03193491
40. W. Kintsch Comprehension: A paradigm for cognition 1998 Cambridge Cambridge, UK
41. W. Kintsch, and T.A. van Dijk Toward a model of text comprehension and production Psychological Review 85 1978 363 394 10.1037/0033-295X.85.5.363
42. M. Kozhevnikov, M.A. Motes, and M. Hegarty Spatial visualization in physics problem solving Cognitive Science 31 2007 549 579 10.1080/ 15326900701399897
43. T. Linderholm, and P. van den Broek The effects of reading purpose and working memory capacity on the processing of expository text Journal of Educational Psychology 94 2002 778 784 10.1037/0022-0663.94.4.778
44. D.S. McNamara, and W. Kintsch Learning from texts: effects of prior knowledge and text coherence Discourse Processes 22 1996 247 288 10.1080/01638539609544975
45. D.S. McNamara, and J.P. Magliano Towards a comprehensive model of comprehension B. Ross, The psychology of learning and motivation Vol. 51 2009 Elsevier New York 297 384
46. S.H. Martin A description of cognitive processes during reading and writing Reading Psychology 9 1988 1 15 10.1080/0270271880090102
47. Mason, L.; Pluchino, P.; Tornatora, M. C.; & Ariasi, N. An eye-tracking study of learning from science text with concrete and abstract illustrations. Journal of Experimental Education, in press.
48. R.E. Mayer The Cambridge handbook of multimedia learning 2005 Cambridge University Press New York
49. R.E. Mayer Multimedia learning 2nd ed. 2009 Cambridge University Press New York
50. R.E. Mayer Unique contributions of eye-tracking research to the study of learning with graphics Learning and Instruction 20 2010 167 171 10.1016/j.learninstruc.2009.02.012
51. R.E. Mayer, and V.K. Sims For whom is a picture worth a thousand words? Extensions of a dual-coding theory of multimedia learning Journal of Educational Psychology 86 1994 389 401 10.1037/0022-0663.86.3.389
52. M. Mikkilä-Erdmann, M. Penttinen, E. Anto, and E. Olkinuora Problems of constructing mental models during learning from science text. Eye tracking methodology meets conceptual change D. Ifenthaler, P. Pirnay-Dummer, J. Michael Spector, Understanding models for learning and instruction: Essays in honor of Norbert M. Seel 2008 Routledge New York 63 79
53. J.C. Nunnally Psychometric theory 1978 McGraw Hill New York
54. J. Otero, J.A. León, and A.C. Graesser The psychology of science text comprehension 2002 Lawrence Erlbaum Mahwah, NJ
55. E. Ozcelik, T. Karakus, E. Kursun, and K. Cagiltay An eye-tracking study of how color coding affects multimedia learning Computers & Education 53 2009 445 453 10.1016/j.compedu.2009.03.002
56. Y. Ozuru, K. Dempsey, and D.S. McNamara Prior knowledge, reading skill, and text cohesion in the comprehension of science texts Learning and Instruction 19 2009 228 242 10.1016/j.learninstruc.2008.04.003
57. A. Paivio Mental representations: A dual-coding approach 1986 Oxford University Press New York
58. K. Rayner Eye movements in reading and information processing: 20 years of research Psychological Bulletin 124 1998 372 422 10.1037/0033-2909.124.3.372
59. K. Rayner Eye movements and attention in reading, scene perception, and visual search Quarterly Journal of Experimental Psychology 62 2009 1457 1506 10.1080/17470210902816461
60. K. Rayner, K.H. Chace, T.J. Slattery, and J. Ashby Eye movements as reflections of comprehension processes in reading Scientific Studies of Reading 10 2006 241 255 10.1207/s1532799xssr1003-3
61. C.A. Sanchez, and J. Wiley An examination of the seductive details effect in terms of working memory capacity Memory & Cognition 34 2006 344 355 10.3758/BF03193412
62. G. Schellings, C. Aarnoutse, and J. van Leeuwe Third graders' think-aloud protocols: types of reading activities in reading an expository text Learning and Instruction 16 2006 549 568 10.1016/j.learninstruc.2006.10.004
63. S. Schlag, and R. Ploetzner Supporting learning from illustrated texts: conceptualizing and evaluating a learning strategy Instructional Science 39 2011 921 937 10.1007/s11251-010-9160-3
64. W. Schnotz Commentary: towards an integrated view of learning from text and visual displays Educational Psychology Review 14 2002 101 120 10.1023/A:1013136727916
65. W. Schnotz An integrated model of text and picture comprehension R.E. Mayer, The Cambridge handbook of multimedia learning 2005 Cambridge University Press New York 48 69
66. W. Schnotz, and M. Bannert Construction and interference in learning from multiple representations Learning and Instruction 13 2003 141 156 10.1016/S0959-4752(02)00017-8
67. S. Schroeder, T. Richter, N. McElvany, A. Hachfeld, J. Baumert, and W. Schnotz Teachers' beliefs, instructional behaviors, and students' engagement in learning from texts with instructional pictures Learning and Instruction 21 2011 403 415 10.1016/j.learninstruc.2010.06.001
68. H.-C. She, and Y.-Z. Chen The impact of multimedia effect on science learning: evidence from eye movements Computers & Education 53 2009 1297 1307
69. J. Shen, E.M. Reingold, and M. Pomplun Distractor ratio influences patterns of eye movements during visual search Perception 29 2000 241 250 10.1068/p2933
70. G.M. Sinatra, and S.H. Broughton Bridging reading comprehension and conceptual change in science education: the promise of refutation text Reading Research Quarterly 46 2011 374 393 10.1002/RRQ.005
71. G.M. Sinatra, and L. Mason Beyond knowledge: learner characteristics influencing conceptual change S. Vosniadou, International handbook of research on conceptual change 2008 Routledge New York 560 582
72. P.C. Stacey, S. Walker, and J.D.M. Underwood Face processing and familiarity: evidence from eye-movement data British Journal of Psychology 96 2005 407 422 10.1348/000712605X47422
73. T.G. Thurstone, and L.L. Thurstone Primary mental ability 1963 Science Research Associates Chicago, IL
74. C.-C. Tsai Reinterpreting and reconstructing science: teachers' view changes toward the nature of science by courses of science education Teaching and Teacher Education 22 2006 363 375 http://dx.doi.org/10.1016/j.tate.2004.06. 010
75. M.-J. Tsai, H.-T. Hou, M.-L. Lai, Y.-Y. Liu, and F.-Y. Yang Visual attention for solving multiple-choice science problem: an eye-tracking analysis Computers & Education 58 2012 375 385 10.1016/j.compedu.2011.07.012
76. M.V.J. Veenman, B.H.A.M. Van Hout-Wolters, and P. Afflerbach Metacognition and learning: conceptual and methodological considerations Metacognition and Learning 1 2006 3 14 10.1007/s11409-006-6893-0
77. S. Vosniadou Capturing and modeling the process of conceptual change Learning and Instruction 4 1994 45 69 10.1016/0959-4752(94)90018-3
78. M.B.W. Wolfe, and S.R. Goldman Relations between adolescents' text processing and reasoning Cognition and Instruction 23 2005 467 502 10.1207/s1532690xci2304-2