Image-language interaction in online reading environments: Challenges for students' reading comprehension

Australian Educational Researcher

Volumn 38, Issue 2, 2011, Pages 181-202

  Chan, Eveline ^a   Unsworth, Len ^a  

^a UNIVERSITY OF NEW ENGLAND   (Australia)

Author keywords

Image text relations; Literacy assessment; Literacy instruction; Online reading; Reading comprehension; Reading hypertext

Indexed keywords

EID: 79959484935     PISSN: 03116999     EISSN: 22105328     Source Type: Journal    
DOI: 10.1007/s13384-011-0023-y     Document Type: Article

References (46)

1. Ainsworth, S. E. (2006). DeFT: A conceptual framework for considering learning with multiple representations. Learning and Instruction, 16(3), 183-198.
2. Australian Bureau of Statistics (ABS). (2009). Household use of information technology, Australia, 2008-09. Retrieved February 15, 2010, from http://abs. gov. au/ausstats/abs@. nsf/mf/8146. 0/#.
3. Australian Museum Education (2003). Wild kids. Retrieved March 2, 2010, from http://www. amonline. net. au/wild_kids/index. cfm.
4. Bezemer, J., & Kress, G. (2008). Writing in multimodal texts: A social semiotic account of designs for learning. Written Communication, 25, 166-195.
5. Chan, E. (2010). Integrating visual and verbal meaning in multimodal text comprehension: Towards a model of inter-modal relations. In S. Dreyfus, S. Hood, & M. Stenglin (Eds.), Semiotic margins: Meaning in multimodalities (pp. 144-167). London: Continuum International Publishing Group.
6. Coiro, J. (2003). Reading comprehension on the internet: Expanding our understanding of reading comprehension to encompass new literacies. The Reading Teacher, 56(5), 458-464.
7. Coiro, J., & Dobler, E. (2007). Exploring the online strategies used by sixth-grade skilled readers to search for and locate information on the internet. Reading Research Quarterly, 42(2), 214-257.
8. Dalton, B., & Proctor, C. P. (2008). The changing landscape of text and comprehension in the age of new literacies. In D. Leu, J. Corio, M. Knobel, & C. Lankshear (Eds.), Handbook of research on new literacies (pp. 297-324). Mahwah, NJ: Lawrence Erlbaum Associates.
9. Djonov, E. (2007). Website hierarchy and the interaction between content organization, webpage and navigation design: A systemic functional hypermedia discourse analysis perspective. Information Design Journal, 15(2), 144-162.
10. Djonov, E. (2008). Children's website structure and navigation. In L. Unsworth (Ed.), Multimodal semiotics: Functional analysis in contexts of education (pp. 216-235). London: Continuum International Publishing Group.
11. Halliday, M. A. K. (2004). An Introduction to functional grammar (3rd ed.). (Revised by Christian M. I. M. Matthiessen). London: Arnold.
12. Henry, L. A. (2006). SEARCHing for an answer: The critical role of new literacies while reading on the Internet. The Reading Teacher, 59(7), 614-627.
13. Jewitt, C. (2006). Technology, literacy and learning: A multimodal approach. London: Routledge.
14. Jewitt, C. (Ed.). (2009). Routledge handbook for multimodal analysis. London: Routledge.
15. Kress, G. (2005). Gains and losses: New forms of texts, knowledge and learning. Computers and Composition, 22, 5-22.
16. Kress, G., & van Leeuwen, T. (2006). Reading images: The grammar of visual design (2nd ed.). London: Routledge.
17. Lawless, K. A., & Schrader, P. G. (2008). Where do we go now? Understanding research on navigation in complex digital environments. In D. Leu, J. Corio, M. Knobel, & C. Lankshear (Eds.), Handbook of research on new literacies (pp. 267-295). Mahwah, NJ: Lawrence Erlbaum Associates.
18. Lawless, K. A., Schrader, P. G., & Mayall, H. J. (2007). Acquisition of information online: Knowledge, navigation and learning outcomes. Journal of Literacy Research, 39(3), 289-306.
19. Lemke, J. (1998). Multiplying meaning: Visual and verbal semiotics in scientific text. In J. R. Martin & R. Veel (Eds.), Reading science: Critical and functional perspectives on discourses of science (pp. 87-113). London: Routledge.
20. Lemke, J. (2002). Travels in hypermodality. Visual Communication, 1(3), 299-325.
21. Lemke, J. (2005a). Multimedia genres and traversals. Folia Linguistica, 39(1-2), 45-56.
22. Lemke, J. (2005b). Towards critical multimedia literacy: Technology, research and politics. In M. McKenna, D. Reinking, L. Labbo, & R. Kieffer (Eds.), Handbook of literacy and technology (Vol. 2. 0). Mahwah, NJ: Lawrence Erlbaum Associates.
23. Leu, D. (2007). Expanding the literacy framework of PISA 2009 to include online reading comprehension: A working paper commissioned by the PISA 2009 Reading Expert Group. Retrieved January 15, 2010, from http://www. newliteracies. uconn. edu/pub_files.
24. Leu, D. J., Kinzer, C. K., Coiro, J., & Cammack, D. (2004). Toward a theory of new literacies emerging from the Internet and other information and communication technologies. In R. B. Ruddell & N. Unrau (Eds.), Theoretical models and processes of reading (5th ed., pp. 1568-1611). Newark, DE: International Reading Association.
25. Leu, D., Corio, J., Knobel, M., & Lankshear, C. (Eds.). (2008). Handbook of research on new literacies. Mahwah, NJ: Lawrence Erlbaum Associates.
26. Matthiessen, C. M. I. M. (2007). The multimodal page: A systemic functional exploration. In T. D. Royce & W. L. Bowcher (Eds.), New directions in the analysis of multimodal discourse. Mahwah, NJ: Lawrence Erlbaum Associates.
27. Mayer, R. E. (2008). Multimedia literacy. In D. Leu, J. Corio, M. Knobel, & C. Lankshear (Eds.), Handbook of research on new literacies (pp. 359-375). Mahwah, NJ: Lawrence Erlbaum Associates.
28. New South Wales Department of Education and Training (2005a). Year 3 2005 Basic Skills Test. Water [stimulus material]. Sydney: NSW Department of Education and Training.
29. New South Wales Department of Education and Training (2005b). Year 5 2005 Basic Skills Test. Water [stimulus material]. Sydney: NSW Department of Education and Training.
30. New South Wales Department of Education and Training (2007a). Year 3 2007 Basic Skills Test. Puzzles and problems [stimulus material]. Sydney: NSW Department of Education and Training.
31. New South Wales Department of Education and Training (2007b). Year 5 2007 Basic Skills Test. Puzzles and problems [stimulus material]. Sydney: NSW Department of Education and Training.
32. New South Wales Department of Education and Training (2007c). Year 7 2007 English Language and Literacy Assessment. Places and possibilities [stimulus material]. Sydney: NSW Department of Education and Training.
33. O'Halloran, K. L. (Ed.). (2004). Multimodal discourse analysis: Systemic-functional perspectives. London: Continuum International Publishing Group.
34. O'Halloran, K. L. (2008). Systemic functional-multimodal discourse analysis (SF-MDA): Constructing ideational meaning using language and visual imagery. Visual Communication, 7, 443-475.
35. Organisation for Economic Co-operation and Development (OECD) (2006). Assessing scientific, reading and mathematical literacy: A framework for PISA 2006. Retrieved February 12, 2010, from OECD online http://www. oecd. org.
36. Organisation for Economic Co-operation and Development (OECD) (2009). PISA 2009 assessment framework: Key competencies in reading, mathematics and science. Retrieved February 12, 2010, from OECD online http://www. oecd. org/dataoecd/11/40/44455820. pdf.
37. Palinscar, A. S., & Dalton, B. (2005). Speaking literacy and learning to technology: Speaking technology to literacy and learning. In B. Maloch (Ed.), 54th Yearbook of the National Reading Conference (pp. 83-102). Oak Creek, WI: National Reading Conference, Inc.
38. Royce, T. D., & Bowcher, W. L. (Eds.). (2007). New directions in the analysis of multimodal discourse. Mahwah, NJ: Lawrence Erlbaum Associates.
39. Unsworth, L. (2006). Towards a metalanguage for multiliteracies education: Describing the meaning-making resources of language-image interaction. English Teaching: Practice and Critique, 5(1), 55-76.
40. Unsworth, L. (2008a). Multiliteracies and metalanguage: Describing image/text relations as a resource for negotiating multimodal texts. In D. Leu, J. Coiro, M. Knobel, & C. Lankshear (Eds.), Handbook of research on new literacies. Mahwah, NJ: Lawrence Erlbaum Associates.
41. Unsworth, L. (Ed.). (2008b). Multimodal semiotics: Functional analysis in contexts of education. London: Continuum International Publishing Group.
42. Unsworth, L. (Ed.). (2008c). New literacies and the English curriculum: Multimodal perspectives. London: Continuum International Publishing Group.
43. Unsworth, L., & Chan, E. (2008). Assessing integrative reading of images and text in group reading comprehension tests. Curriculum Perspectives, 28(3), 71-76. [Special Issue: Literacy and national testing: National and international perspectives.].
44. Unsworth, L., Barnes, G., & O'Donnell, K. (2006-2008). New dimensions of group literacy tests for schools: Multimodal reading comprehension in conventional and computer-based formats. A linkage project funded by the Australian Research Council conducted by the University of New England and the New South Wales Department of Education and Training.
45. Walsh, M. (2006). The "Textual Shift": Examining the reading process with print, visual and multimodal texts. Australian Journal of Language and Literacy, 29(1), 24-37.
46. Wyatt-Smith, C., & Elkins, J. (2008). Multimodal reading and comprehension in online environments. In D. Leu, J. Corio, M. Knobel, & C. Lankshear (Eds.), Handbook of research on new literacies (pp. 899-940). Mahwah, NJ: Lawrence Erlbaum Associates.