Integrating Visual and Verbal Meaning in Multimodal Text Comprehension: Towards a Model of Intermodal Relations

Semiotic Margins: Meaning in Multimodalities

Volumn , Issue , 2010, Pages 144-167

  Chan, Eveline ^a  

^a UNIVERSITY OF NEW ENGLAND   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85186979181     PISSN: None     EISSN: None     Source Type: Book    
DOI: None     Document Type: Chapter

References (34)

1. ACARA (Australian Curriculum, Assessment and Reporting Authority) (2009). Shape of the Australian Curriculum: English. Canberra: Commonwealth of Australia. Available from http://www.acara.edu.au/verve/_resources/Australian_Curriculum_English.pdf.
2. Allen, P. (1980). Mr. Archimedes’ bath. New York: Angus & Robertson/Harper Collins Publishers.
3. Briggs, R. (2004). The Puddleman. London: Random House Group.
4. Browne, A. (1992). Zoo. London: Red Fox.
5. Djonov, E. (2005). Analysing the organisation of information in websites: From hypermedia design to systemic functional hypermedia discourse analysis. PhD Thesis, University of New South Wales, Sydney.
6. Gill, T. (2002). Visual and verbal playmates: An exploration of visual and verbal modalities in children’s picture books. Unpublished BA (Hons) Thesis, University of Sydney.
7. Halliday, M.A.K. (1994). An Introduction to functional grammar (2nd edn). London: Edward Arnold.
8. Halliday, M.A.K. (2004). An Introduction to functional grammar (3rd edn). Revised by C.M.I.M. Matthiessen. London: Edward Arnold.
9. Halliday, M.A.K. & Hasan, R. (1985). Language, context, and text: Aspects of language in a social-semiotic perspective. Geelong: Deakin University Press.
10. Heffernan, J. & Blackwood, F. (2003). Two summers. Lindfi eld: Scholastic.
11. Kress, G. & van Leeuwen, T. (2006). Reading images: A grammar of visual design 2nd edn). London: Routledge.
12. Lemke, J. (1998). Multiplying meaning: Visual and verbal semiotics in scientific text. In J.R. Martin & R. Veel (Eds), Reading science: Critical and functional perspectives on discourses of science (pp. 87–113). London: Routledge.
13. Lemke, J. (2006). Towards critical multimedia literacy: Technology, research, and politics. In M. McKenna, D. Reinking, L. Labbo & R. Kieffer (Eds), International Handbook of Literacy & Technology, volume 2.0. (pp. 3–14). Mahwah, NJ: Lawrence Erlbaum Associates.
14. Lim, V.F. (2004). Developing an integrative multi-semiotic model. In K. O’Halloran (Ed.), Multimodal discourse analysis: Systemic functional perspectives (pp. 220–246). London and New York: Continuum.
15. Martinec, R. & Salway, A. (2005). A system for image-text relations in new (and old) media. Visual Communication, 4(3), 337–371.
16. Matthiessen, C.M.I.M. (2007). The multimodal page: A systemic functional exploration. In T.D. Royce & W.L. Bowcher (Eds), New directions in the analysis of multimodal discourse. Mahwah, NJ: Lawrence Erlbaum Associates.
17. McCloud, S. (1994). Understanding comics: The invisible art. New York: Harper Collins.
18. MCEETYA (Ministerial Council on Education, Employment, Training and Youth Affairs) (2007). National Assessment Program Literacy and Numeracy (NAPLAN). Reading sample questions. Accessed on 18 Feb 2008 from www.naplan.edu.au/test_samples/test_samples.html.
19. NSW DET (New South Wales Department of Education and Training) (2005a). Basic Skills Tests. Water, Year 3 BST 2005 (Stimulus material).
20. NSW DET (New South Wales Department of Education and Training) (2005b). Basic Skills Tests. Water, Year 5 BST 2005 (Stimulus material).
21. NSW DET (New South Wales Department of Education and Training) (2007a). Basic Skills Tests. Puzzles and problems, Year 3 BST 2007 (Stimulus material).
22. NSW DET (New South Wales Department of Education and Training) (2007b). Basic Skills Tests. Puzzles and problems, Year 5 BST 2007 (Stimulus material).
23. NSW DET (New South Wales Department of Education and Training) (2007c). English Language and Literacy Assessment. Places and possibilities, ELLA 2007 (Stimulus material).
24. OECD (Organisation for Economic Co-operation and Development) (2006). Assessing scientifi c, reading and mathematical literacy: A framework for PISA [Electronic Version]. Retrieved 02.03.2007 from www.oecd.org.
25. O’Halloran, K.L. (Ed.). (2004). Multimodal discourse analysis: Systemic-functional perspectives. London and New York: Continuum.
26. Royce, T. (2007). Intersemiotic complementarity: A framework for multimodal discourse analysis. In T. Royce & W. Bowcher (Eds), New directions in the analysis of multimodal discourse (pp. 63–109). Malwah, NJ and London: Lawrence Erlbaum Associates.
27. Royce, T.D. & Bowcher, W.L. (Eds). (2007). New directions in the analysis of multimodal discourse. Mahwah, NJ: Lawrence Erlbaum Associates.
28. Unsworth, L. (2006). Towards a metalanguage for multiliteracies education: Describing the meaning-making resources of language-image interaction. English Teaching: Practice and Critique, 5(1), 55–76.
29. Unsworth, L. (2008). Multiliteracies and metalanguage: Describing image/text relations as a resource for negotiating multimodal texts. In D. Leu, J. Corio, M. Knobel & C. Lankshear (Eds), Handbook of research on new literacies. NJ: Lawrence Erlbaum Associates.
30. Unsworth, L., Barnes, G. & O’Donnell, K. (2006–2008). New dimensions of group literacy tests for schools: Multimodal reading comprehension in conventional and computer-based formats. A linkage project funded by the Australian Research Council conducted by the University of New England and the New South Wales Department of Education and Training.
31. Unsworth, L. & Chan, E. (2008). Assessing integrative reading of images and text in group reading comprehension tests. Curriculum Perspectives, 28(3), 71–76.
32. Unsworth, L. & Cléirigh, C. (2009). Multimodality and reading: The Construction of meaning through image-text interaction. In C. Jewitt (Ed.), The Routledge handbook of multimodal analysis (pp. 151–164). London: Routledge.
33. Unsworth, L., Thomas, A. & Bush, R. (2004). The role of images and image-text relations in group ‘basic skills tests’ of literacy for children in the primary school years. Australian Journal of Language and Literacy, 27(1), 46–65.
34. van Leeuwen, T. (2005). Introducing social semiotics. Abingdon and New York: Routlegde.