The interface between rhetoric and layout in multimodal artefacts

Literary and Linguistic Computing

Volumn 28, Issue 3, 2013, Pages 461-471

  Hiippala, Tuomo ^a  

^a UNIVERSITY OF HELSINKI   (Finland)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84883174360     PISSN: 02681145     EISSN: 14774615     Source Type: Journal    
DOI: 10.1093/llc/fqs064     Document Type: Article

References (54)

1. Bateman, J. A. (2008). Multimodality and Genre: A Foundation for the Systematic Analysis of Multimodal Documents. London: Palgrave Macmillan.
2. Bateman, J. A. (2009). Discourse Across Semiotic Modes. In Renkema, J. (ed.), Discourse, of Course: An Overview of Research in Discourse Studies. Amsterdam/ Philadelphia: Benjamins, pp. 55-66.
3. Bateman, J. A. (2011). The Decomposability of Semiotic Modes. In O'Halloran, K. L. and Smith, B. A. (eds), Multimodal Studies: Multiple Approaches and Domains, Routledge Studies in Multimodality. London: Routledge, pp. 17-38.
4. Bateman, J. A. (forthcoming). Genre in the Age of Multimodality: Some Conceptual Refinements for Practical Analysis. In Evangelisti-Allori, P., Bhatia, V. K., and Bateman, J. A. (eds), Evolution in Genres: Emergence, Variation, Multimodality. Frankfurt am Main: Peter Lang.
5. Bateman, J. A., Delin, J. L., and Henschel, R. (2004). Multimodality and Empiricism: Preparing for a Corpus-Based Approach to the Study of Multimodal Meaning-Making. In Ventola, E., Charles, C., and Kaltenbacher, M. (eds), Perspectives on Multimodality. Amsterdam: Benjamins, pp. 65-89.
6. Cheong, Y. Y. (2004). The Construal of Ideational Meaning in Print Advertisements. In O'Halloran, K. L. (ed.), Multimodal Discourse Analysis: Systemic Functional Perspectives. London: Continuum, pp. 163-95.
7. Delin, J., Bateman, J. A., and Allen, P. (2003). A model of genre in document layout. Information Design Journal, 11: 54-66.
8. Elleström, L. (2010). The Modalities of Media: A Model for Understanding Intermedial Relations. In Elleström, L. (ed.), Media Borders, Multimodality and Intermediality. London: Palgrave, pp. 11-48.
9. Forceville, C. (2007). Book review: multimodal transcription and text analysis: a multimedia toolkit and coursebook. Journal of Pragmatics, 39: 1235-8.
10. Francesconi, S. (2011). Images and writing in tourist brochures. Journal of Tourism and Cultural Change, 9: 341-56.
11. Guijarro, A. J. (2011). Engaging readers through language and pictures: a case study. Journal of Pragmatics, 43: 2982-91.
12. Guijarro, A. J. and Pinar Sanz, M. J. (2008). Compositional, interpersonal and representational meanings in a children's narrative: a multimodal discourse analysis. Journal of Pragmatics, 40: 1601-19.
13. Guo, L. (2004). Multimodality in a Biology Textbook. In O'Halloran, K. L. (ed.), Multimodal Discourse Analysis: Systemic Functional Perspectives. London: Continuum, pp. 196-219.
14. Halliday, M. A. K. (1978). Language as a Social Semiotic: The Social Interpretation of Language and Meaning. London: Arnold.
15. Halliday, M. A. K. and Matthiessen, C. M. I. M. (2004). An Introduction to Functional Grammar, 3rd edn. London: Arnold.
16. Held, G. (2005). Magazine covers-a multimodal pretext-genre. Folia Linguistica XXXIX, pp. 173-96.
17. Hiippala, T. (2007). Helsinki: A Multisemiotic Analysis of Tourist Brochures. Master's thesis, University of Helsinki.
18. Hiippala, T. (2012a). The Localisation of Advertising Print Media as a Multimodal Process. In Bowcher, W. L. (ed.), Multimodal Texts from Around the World: Linguistic and Cultural Insights. London: Palgrave, pp. 97-122.
19. Hiippala, T. (2012b). Reading paths and visual perception in multimodal research, psychology and brain sciences. Journal of Pragmatics, 44: 315-27.
20. Hofinger, A. and Ventola, E. (2004). Multimodality in Operation: Language and Picture in a Museum. In Ventola, E., Charles, C., and Kaltenbacher, M. (eds), Perspectives on Multimodality. Amsterdam: Benjamins, pp. 193-210.
21. Holsanova, J., and Nord, A. (2010). Multimodal Design: Media Structures, Media Principles and Users Meaning-Making in Printed and Digital Media. In Bucher, H.-J., Gloning, T., and Lehnen, K. (eds), Neue Medie - neue Formate: Ausdifferenzierung und Konvergenz in der Medienkommunikation. Frankfurt/ New York: Campus, pp. 81-103.
22. Jewitt, C. (2009). Different Approaches to Multimodality. In Jewitt, C. (ed.), The Routledge Handbook of Multimodal Analysis. London: Routledge, pp. 28-39.
23. Kong, K. (2006). A taxonomy of the discourse relations between words and visuals. Information Design Journal, 14: 207-30.
24. Kostelnick, C., and Hassett, M. (2003). Shaping Information: The Rhetoric of Visual Conventions. Carbondale: Southern Illinois University Press.
25. Kress, G. (1998). Visual and Verbal Modes of Representation in Electronically Mediated Communication: The Potentials of New Forms of Text. In Snyder, I. (ed.), Page to Screen: Taking Literacy into the Electronic Era. London and New York: Routledge, pp. 53-79.
26. Kress, G. (2009). What is Mode? In Jewitt, C. (ed.), The Routledge Handbook of Multimodal Analysis. London: Routledge, pp. 54-67.
27. Kress, G. (2010). Multimodality: A Social Semiotic Approach to Contemporary Communication. London: Routledge.
28. Kress, G., and van Leeuwen, T. (2002). Colour as a semiotic mode: notes for a grammar of colour. Visual Communication, 1: 343-68.
29. Kress, G., and van Leeuwen, T. (2006). Reading Images: The Grammar of Visual Design, 2nd edn. London: Routledge.
30. Kvåle, G. (2010). Invitasjon til Destinasjon: Multimodal Retorikk i Turistkommunikasjon. In Engebretsen, M. (ed.), Skrift/Bilde/Lyd: Analyse av Sammensatte Tekster. Kristiansand: Høyskoleforlaget, pp. 39-55.
31. Mann, W. C., and Thompson, S. A. (1988). Rhetorical structure theory: toward a functional theory of text organization. Text, 8: 243-81.
32. Martinec, R. (2003). The social semiotics of text and image in Japanese and English software manuals and other procedures. Social Semiotics, 13: 43-69.
33. Martinec, R., and Salway, A. (2005). A system for image-text relations in new (and old) media. Visual Communication, 4: 337-71.
34. Molina, A., and Esteban, A. (2006). Tourism brochures: usefulness and image. Annals of Tourism Research, 33: 1036-56.
35. O'Halloran, K. L. (2008). Systemic functionalmultimodal discourse analysis (SF-MDA): constructing ideational meaning using language and visual imagery. Visual Communication, 7: 443-75.
36. O'Halloran, K. L. (2004). Multimodal Discourse Analysis: Systemic Functional Perspectives. London: Continuum.
37. O'Halloran, K. L., and Lim, F. V. (2009). Sequential Visual Discourse Frames. In Ventola, E., and Guijarro, A. J. (eds), The World Told and the World Shown: Multisemiotic Issues. London: Palgrave, pp. 139-56.
38. O'Halloran, K. L., Tan, S., Smith, B. A., and Podlasov, A. (2010). Challenges in designing digital interfaces for the study of multimodal phenomena. Information Design Journal, 18: 2-21.
39. O'Halloran, K. L., Tan, S., Smith, B. A., and Podlasov, A. (2011). Multimodal analysis within an interactive software environment: critical discourse perspectives. Critical Discourse Studies, 8: 109-25.
40. O'Toole, M. (2010). The Language of Displayed Art, 2nd edn. New York: Routledge.
41. Parodi, G. (2010). Research challenges for corpus cross-linguistics and multimodal texts. Information Design Journal, 18: 69-73.
42. Reichenberger, K., Rondhuis, K., Kleinz, J., and Bateman, J. A. (1996). Effective Presentation of Information Through Page Layout: A Linguistically- Based Approach [Technical Report Arbeitspapiere der GMD 970]. Darmstadt: Institut für Integrierte Publikations-und Informationssysteme (IPSI), GMD http://www.cs.uic.edu/~ifc/mmwsproc/reichen/pagelayout.html (accessed 20 November 2012).
43. Royce, T. D. (1998). Synergy on the page: exploring intersemiotic complementarity in page-based multimodal text. JASFL Occasional Papers, 1: 25-49.
44. Smith, B. A., Tan, S., Podlasov, A., and O'Halloran, K. L. (2011). Analyzing multimodality in an interactive digital environment: software as metasemiotic tool. Social Semiotics, 21: 369-80.
45. Stenglin, M. (2009). Space and Communication in Exhibitions: Unravelling the Nexus. In Jewitt, C. (ed.), The Routledge Handbook of Multimodal Analysis. London: Routledge, pp. 272-83.
46. Taboada, M., and Mann, W. C. (2006). Rhetorical structure theory: looking back and moving ahead. Discourse Studies, 8: 423-59.
47. Thomas, M. (2007). Querying multimodal annotation: A concordancer for GeM, Proceedings of the Linguistic Annotation Workshop, Prague, Czech Republic, Association for Computational Linguistics, pp. 57-60. http://acl.ldc.upenn.edu/W/W07/W07-15.pdf#page=71 (accessed 20 November 2012).
48. Thomas, M. (2009a). Developing Multimodal Texture. In Ventola, E., and Guijarro, A. J. (eds), The World Told and the World Shown: Multisemiotic Issues. London: Palgrave, pp. 39-55.
49. Thomas, M. (2009b). Localizing Pack Messages: A Framework for Corpus-Based Cross-Cultural Multimodal Analysis, Ph.D. thesis, University of Leeds.
50. van Leeuwen, T. (1993). Genre and field in critical discourse analysis: a synopsis. Discourse and Society, 4: 193-223.
51. van Leeuwen, T. (2005a). Introducing Social Semiotics. London: Routledge.
52. van Leeuwen, T. (2005b). Multimodality, Genre and Design. In Norris, S., and Jones, R. H. (eds), Discourse in Action: Introducing Mediated Discourse Analysis. London: Routledge, pp. 73-94.
53. van Leeuwen, T. (2011). The Language of Colour: An Introduction. London: Routledge.
54. White, P. (2010). Grabbing attention: the importance of modal density in advertising. Visual Communication, 9: 371-97.