Systemic functional-multimodal discourse analysis (SF-MDA): Constructing ideational meaning using language and visual imagery

Visual Communication

Volumn 7, Issue 4, 2008, Pages 443-475

  O'Halloran, Kay L ^a  

^a NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

Content expression stratum; Cross functional systems; Digital technology; Grammatical metaphor; Intersemiosis; Multimodal discourse analysis (MDA); Semiotic metaphor (SM); Social semiotics; Systemic functional linguistics (SFL); Topological typological representation

Indexed keywords

EID: 55349091704     PISSN: 14703572     EISSN: 17413214     Source Type: Journal    
DOI: 10.1177/1470357208096210     Document Type: Article

References (75)

1. Baldry, A.P. (2004) 'Phase and Transition Type and Instance: Patterns in Media Texts as Seen through a Multimodal Concordancer', in K.L. O'Halloran (ed.) Multimodal Discourse Analysis, pp. 83-108. London: Continuum.
2. Baldry, A.P. (2006) 'The Role of Multimodal Concordancers in Multimodal Corpus Linguistics', in T. Royce and W. Bowcher (eds) New Directions in the Analysis of Multimodal Discourse, pp. 173-94. Mahwah, NJ: Erlbaum.
3. Baldry, A.P. and Thibault, P.J. (2006a) Multimodal Transcription and Text. London: Equinox.
4. Baldry, A.P. and Thibault, P.J. (2006b) 'Multimodal Corpus Linguistics', in G. Thompson and S. Hunston (eds), System and Corpus: Exploring Connections, pp. 164-83. London: Equinox.
5. Bateman, J. (2008) Multimodality and Genre: A Foundation for the Systematic Analysis of Multimodal Documents. Basingstoke: Palgrave Macmillan.
6. Bateman, J., Delin, J. and Henschel, R. (2004) 'Multimodality and Empiricism: Preparing for a Corpus-Based Approach to the Study of Multimodal Meaning-Making', in E. Ventola, C. Charles and M. Kaltenbacher (eds) Perspectives on Multimodality, pp. 65-87. Amsterdam: John Benjamins.
7. Cheong, Y.Y. (2004) 'The Construal of Ideational Meaning in Print Advertisements', in K.L. O'Halloran (ed.) Multimodal Discourse Analysis, pp. 163-95. London: Continuum.
8. Djonov, E. (2006) 'Analysing the Organisation of Information in Websites: From Hypermedia Design to Systemic Functional Hypermedia Discourse Analysis', PhD Thesis, School of English and School of Modern Language Studies, University of New South Wales.
9. Eggins, S. (2004) An Introduction to Systemic Functional Linguistics, 2nd edn. London: Continuum.
10. Guo, L. (2004) 'Multimodality in a Biology Textbook', in K.L. O'Halloran (ed.) Multimodal Discourse Analysis, pp. 196-219. London: Continuum.
11. Halliday, M.A.K. (1967) Intonation and Grammar in British English. The Hague: Mouton.
12. Halliday, M.A.K. (1970) A Course in Spoken English: Intonation. London: Oxford University Press.
13. Halliday, M.A.K. (1978) Language as Social Semiotic: The Social Interpretation of Language and Meaning. London: Edward Arnold.
14. Halliday, M.A.K. (1994) An Introduction to Functional Grammar, 2nd edn. London: Arnold.
15. Halliday, M.A.K. (2002) The Collected Works of M.A.K. Halliday, ed. Jonathan Webster (Vol. 1 of 10-vol. set). London: Continuum.
16. Halliday, M.A.K. (2004) An Introduction to Functional Grammar, 3rd edn, rev. by C.M.I.M. Matthiessen. London: Arnold.
17. Halliday, M.A.K. and Greaves, W.S. (2008) Intonation in the Grammar of English. London: Equinox.
18. Halliday, M.A.K. and Hasan, R. (1976) Cohesion in English. London: Longmans.
19. Halliday, M.A.K. and Hasan, R. (1985) Language, Context, and Text: Aspects of Language in a Social-Semiotic Perspective. Geelong, VIC: Deakin University Press. (Republished by Oxford University Press in 1989.)
20. Halliday, M.A.K. and Matthiessen, C.M.I.M. (1999) Construing Experience through Meaning: A Language Based Approach to Cognition. London: Cassell.
21. Iedema, R. (2001a) 'Resemioticization', Semiotica 137-1/4: 23-39.
22. Iedema, R. (2001b) 'Analysing Film and Television: A Social Semiotic Account of Hospital: An Unhealthy Business', in T. van Leeuwen and C. Jewitt (eds) Handbook of Visual Analysis, pp. 183-204. London: Sage.
23. Iedema, R. (2003) 'Multimodality, Resemioticization: Extending the Analysis of Discourse as a Multisemiotic Practice', Visual Communication 2(1): 29-57.
24. Ivry, R.B. and Robertson, L.C. (1998) The Two Sides of Perception. Cambridge, MA: MIT Press.
25. Kok, K.C.A. (2004) 'Multisemiotic Mediation in Hypertext', in K.L. O'Halloran (ed.) Multimodal Discourse Analysis, pp. 131-59. London: Continuum.
26. Kosslyn, S.M. (1987) 'Seeing and Imaging in the Cerebral Hemispheres: A Computational Approach', Pyschological Review 94: 148-75.
27. Kress, G. and Van Leeuwen, T. (1996) Reading Images: The Grammar of Visual Design. London: Routledge.
28. Kress, G. and Van Leeuwen, T. (2001) Multimodal Discourse: The Modes and Media of Contemporary Communication Discourse. London: Arnold.
29. Kress, G. and Van Leeuwen, T. (2002) 'Colour as a Semiotic Mode: Notes for a Grammar of Colour', Visual Communication 1(3): 343-68.
30. Kress, G. and Van Leeuwen, T. (2006) Reading Images: The Grammar of Visual Design, 2nd edn. London: Routledge.
31. Kress, G. et al. (2001) Multimodal Teaching and Learning: The Rhetorics of the Science Classroom. London: Continuum.
32. Lemke, J.L. (1998) 'Multiplying Meaning: Visual and Verbal Semiotics in Scientific Text', in J.R. Martin and R. Veel (eds), Reading Science: Critical and Functional Perspectives on Discourses of Science, pp. 87-113. London: Routledge.
33. Lemke, J.L. (2000) 'Opening Up Closure: Semiotics Across Scales', in J. Chandler and G. van de Vijver (eds) Closure: Emergent Organizations and their Dynamics, pp. 100-11. New York: New York Academy of Science Press.
34. Lemke, J.L. (2002) 'Travels in Hypermodality', Visual Communication 1(3): 299-325.
35. Lim, F.V. (2004) 'Developing an Integrative Multisemiotic Model', in K.L. O'Halloran (ed.) Multimodal Discourse Analysis, pp. 220-46. London: Continuum.
36. Martin, J.R. (1992) English Text: System and Structure. Amsterdam: John Benjamins.
37. Martin, J.R. (1997) 'Analysing Genre: Functional Parameters', in F. Christie and J.R. Martin (eds) Genre and Institutions: Social Processes in the Workplace and School, pp. 3-39. London: Continuum.
38. Martin, J.R. (2002) 'Fair Trade: Negotiating Meaning in Multimodal Texts', in P. Coppock (ed.) The Semiotics of Writing: Transdisciplinary Perspectives on the Technology of Writing, pp. 311-38. Turnhout, Belgium: Brepols.
39. Martin, J.R. and Rose, D. (2003) Working with Discourse: Meaning Beyond the Clause. London: Continuum.
40. Martin, J.R. and Veel, R. (eds) (1998) Reading Science: Critical and Functional Perspectives on Discourses of Science. London: Routledge.
41. Martinec, R. (2000) 'Types of Processes in Action', Semiotica 130-3/4: 243-68.
42. Martinec, R. (2001) 'Interpersonal Resources in Action', Semiotica 135-1/ 4: 117-45.
43. Martinec, R. (2004) 'Gestures that Co-Concur with Speech as a Systematic Resource: The Realization of Experiential Meanings in Indexes', Social Semiotics 14(2): 193-213.
44. Martinec, R. (2005) 'A System for Image-Text Relations in New (and Old) Media', Visual Communication 4(3): 337-71.
45. Matthiessen, C.M.I.M. et al. (2005) 'A Case Study of Multi-Stratal Analysis', Australian Review of Applied Linguistics 19 (Series S): 123-50.
46. O'Halloran, K.L. (1999) 'Interdependence, Interaction and Metaphor in Multisemiotic Texts', Social Semiotics 9(3): 317-54.
47. O'Halloran, K.L. (2003) 'Intersemiosis in Mathematics and Science: Grammatical Metaphor and Semiotic Metaphor', in A.-M. Simon-Vandenbergen, M. Taverniers and L. Ravelli (eds) Grammatical Metaphor: Views from Systemic Functional Linguistics, pp. 337-65. Amsterdam: John Benjamins.
48. O'Halloran, K.L. (ed.) (2004a) Multimodal Discourse Analysis. London: Continuum.
49. O'Halloran, K.L. (2004b) 'Visual Semiosis in Film', in K.L. O'Halloran (ed.) Multimodal Discourse Analysis, pp. 109-30. London: Continuum.
50. O'Halloran, K.L. (2005) Mathematical Discourse: Language, Symbolism and Visual Images. London: Continuum.
51. O'Halloran, K.L. (2007a) 'Mathematical and Scientific Forms of Knowledge: A Systemic Functional Multimodal Grammatical Approach', in F. Christie and J.R. Martin (eds) Language, Knowledge and Pedagogy: Functional Linguistic and Sociological Perspectives, pp. 205-36. London: Continuum.
52. O'Halloran, K.L. (2007b) 'Systemic Functional Multimodal Discourse Analysis (SF-MDA) Approach to Mathematics, Grammar and Literacy', in A. McCabe, M. O'Donnell and R. Whittaker (eds) Advances in Language and Education, pp. 75-100. London: Continuum.
53. O'Toole, M. (1994) The Language of Displayed Art. London: Leicester University Press.
54. O'Toole, M. (1999) Engaging with Art (CD ROM). Perth: Murdoch University.
55. Pang, K.M.A. (2004) 'Making History in From Colony to Nation: A Multimodal Analysis of a Museum Exhibition in Singapore', in K.L. O'Halloran (ed.) Multimodal Discourse Analysis, pp. 28-54. London: Continuum.
56. Pike, K.L. (1982) Linguistic Concepts: An Introduction to Tagmemics. Lincoln: University of Nebraska Press.
57. Ravelli, L.J. (2000) 'Beyond Shopping: Constructing the Sydney Olympics in Three Dimensional Text', Text 20(4): 489-515.
58. Royce, T. (1998) 'Synergy on the Page: Exploring Intersemiotic Complementarity in Page-Based Multimodal Text', JASFL Occasional Papers 1(1): 25-49.
59. Royce, T. (2002) 'Multimodality in the TESOL Classroom: Exploring Visual-Verbal Synergy', TESOL Quarterly 36(2): 191-205.
60. Simon-Vandenbergen, A.-M., Taverniers, M. and Ravelli, L. (eds) (2003) Grammatical Metaphor: Views from Systemic Functional Linguistics. Amsterdam: John Benjamins.
61. Smith, B.A. (2008) 'Intonational Systems and Register: A Multidimensional Exploration', PhD thesis, Department of Linguistics, Macquarie University, Sydney, Australia.
62. Steiner, E. (1988) 'The Interaction of Language and Music as Semiotic Systems: The Example of the Folk Ballad', in J.D. Benson, M.J. Cummings and W.S. Greaves (eds) Linguistics in a Systemic Perspective, pp. 393-441. Amsterdam: John Benjamins.
63. Stenglin, M.K. (2004) 'Packing Curiosities: Towards a Grammar of Three Dimensional Space', PhD thesis, Linguistics Department, University of Sydney.
64. Tench, P. (1992) Studies in Systemic Phonology. Pinter: London.
65. Tench, P. (1996) The Intonation Systems of English. London: Cassell.
66. Thibault, P. (2000) 'The Multimodal Transcription of a Television Advertisement: Theory and Practice', in A.P. Baldry (ed.) Multimodality and Multimediality in the Distance Learning Age, pp. 311-85. Campobasso: Palladino Editore.
67. Thibault, P. (2004a) Agency and Consciousness in Discourse: Self-Other Dynamics as a Complex System. London: Continuum.
68. Thibault, P. (2004b) Brain, Mind, and the Signifying Body: An Ecosocial Semiotic Theory. London: Continuum.
69. Towne, R. (1974) Chinatown (DVD 1999, dir. R. Polanski). Paramount Studios, Hollywood, CA.
70. Unsworth, L. (2001) Teaching Multiliteracies across the Curriculum: Changing Contexts of Text and Image in Classroom Practice. Buckingham: Open University Press.
71. Van Leeuwen, T. (1985) 'Rhythmic Structure of the Film Text', in T.A. van Dijk (ed.) Discourse and Communication: New Approaches to the Analysis of Mass Media Discourse and Communication, pp. 216-32. Berlin: Walter de Gruyter.
72. Van Leeuwen, T. (1999) Speech, Music, Sound. London: Macmillan.
73. Van Leeuwen, T. (2005) Introducing Social Semiotics. London: Routledge.
74. Ventola, E., Charles, C. and Kaltenbacher, M. (eds) (2004) Perspectives on Multimodality. Amsterdam: John Benjamins.
75. Wertheimer, M. (1938) 'The General Theoretical Situation', in W.D. Ellis (ed.) A Source Book of Gestalt Psychology. London: Kegan, Paul & Trench/Trubner & Co. Ltd.