Perspectives on multimodality

Information Design Journal

Volumn 12, Issue 3, 2004, Pages 190-207

  Kaltenbacher, Martin ^a  

^a NONE

Author keywords

Corpus analysis; Hypertext; Learning; Medicine; Multimodality; Semiotics; Speech synthesis and automation; Translation; Typography

Indexed keywords

EID: 77649090032     PISSN: 01425471     EISSN: 1569979X     Source Type: Journal    
DOI: 10.1075/idjdd.12.3.05kal     Document Type: Article

References (79)

1. Alias, S. (2004). A semiotic study of Singapore's Orchard and Marriott Hotel. In K. O'Halloran (Ed.), Multimodal discourse analysis: Systemic functional perspectives (pp. 55-79). London: Continuum.
2. Baldry, A. (Ed.) (2000a). Multimodality and multimediality in the distant learning age. Campopasso: Palladino Editore.
3. Baldry, A. (2000b). English in a visual society: Comparative and historical dimensions in multimodality and multimediality. In A. Baldry (Ed.), Multimodality and multimediality in the distant learning age (pp. 41-89). Campopasso: Palladino Editore.
4. Baldry, A. (2004). Phase and transition, type and instance: Patterns in media texts as seen through a multimodal concordancer. In K. O'Halloran (Ed.), Multimodal discourse analysis: Systemic functional perspectives (pp. 83-108). London: Continuum.
5. Baldry, A. & Thibault, P. (2004). Multimodal transcription and text analysis. London: Equinox Publishing.
6. Bateman, J., Delin, J. & Henschel, R. (forthcoming). Multimodality and empiricism: Preparing for a corpus-based approach to the study of multimodal meaning-making. In E. Ventola, C. Charles, & M. Kaltenbacher (Eds.), Perspectives on multimodality (pp. 65-88). Amsterdam & Philadelphia: John Benjamins.
7. Beskow, J. (2003). Talking heads-Models and applications for multimodal speech synthesis. Unpublished Doctoral Thesis. Department of Speech, Music and Hearing, KTH, Stockholm. http://www.speech.kth.se/beskow/thesis
8. Buhrig, K. (forthcoming). On the "multimodality" of interpreting in medical briefings for informed consent: using diagrams to impart knowledge. In E. Ventola, C. Charles, & M. Kaltenbacher (Eds.), Perspectives on multimodality (pp. 227-214). Amsterdam & Philadelphia: John Benjamins.
9. Clark, R.C. & Mayer, R. (2003). E-learning and the science of instruction. Proven guidelines for consumers and designers of multimedia learning. San Francisco, CA: Jossey-Bass/Pfeiffer.
10. Colby, J. (2002). Multimodality: The next wave of mobile interaction. Speech Technology Magazine, November/December 2002. http://www.speechtechmag.com
11. Davis, B. & Mason, P. (2004). Trying on voices: Using questions to establish authority, identity, and recipient design in electronic discourse. In P. Levine & R. Scollon (Eds.), Discourse & technology. Multimodal discourse analysis (pp. 47-58). Georgetown, Washington, D.C.: Georgetown University Press.
12. De Beaugrande, R.A. & Dressler W.U. (1981). Einfuhrung in die Textlinguistik. Tubingen: Niemeyer.
13. De Jong, M. & van der Geest, T. (2000). Characterizing web heuristics. Technical Communication 3, 311-324.
14. De Saint-Georges, I. (2004). Materiality in discourse: The influence of space and layout in meaning making. In P. Levine & R. Scollon (Eds.), Discourse & technology. Multimodal discourse analysis (pp. 71-87). Georgetown, Washington, D.C.: Georgetown University Press.
15. Eco, U. (1980). Il nome della rosa. Milano: Bompiani.
16. Eco, U. (1983). The name of the rose. New York: Harcourt.
17. Eckkrammer, E.M. (forthcoming). Drawing on theories of inter-semiotic layering to analyse multimodality in medical self-counselling texts and hypertexts. In E. Ventola, C. Charles, & M. Kaltenbacher (Eds.), Perspectives on Multimodality (pp. 211-226). Amsterdam & Philadelphia: John Benjamins.
18. Everts, E. (2004). Modalities of turn-taking in blind/sighted interaction: better to be seen and not heard? In P. Levine & R. Scollon (Eds.), Discourse & technology. Multimodal discourse analysis (pp. 128-145). Georgetown, Washington, D.C.: Georgetown University Press.
19. Farkas, D. & Farkas, J (2000). Guidelines for designing web navigation. Technical Communication 3, 341-358.
20. Filliettaz, L. (2004). The multimodal negotiation of service encounters. In P. Levine & R. Scollon (Eds.), Discourse & technology. Multimodal discourse analysis (pp. 88-100). Georgetown, Washington, D.C.: Georgetown University Press.
21. Goethe, J. W. (1798/1998). Uber Laokoon. In F. Apel (Ed.), Goethe-Asthetische Schriften 1771-1805 (pp. 489-500). Frankfurt a. Main: Deutscher Klassiker Verlag.
22. Halliday, M.A.K. (1961). Categories of the theory of grammar. Word, 17, 3, 242-292.
23. Halliday, M.A.K. (1975). Language as social semiotic: towards a general sociolinguistic theory. Columbia: Hornbeam Press.
24. Halliday, M.A.K. (1978). Language as social semiotic: The social interpretation of language and meaning. London: Arnold.
25. Halliday, M.A.K. & Hasan, R. (1976). Cohesion in English. London: Longman.
26. Hodge, R. & Kress, G. (1988). Social semiotics. Cambridge: Polity Press.
27. Hofinger, A., & Ventola, E. (forthcoming). Multimodality in operation: Language and Picture in a Museum. In E. Ventola, C. Charles, & M. Kaltenbacher (Eds.), Perspectives on multimodality (pp. 193-2210). Amsterdam & Philadelphia: John Benjamins.
28. Iedema, R. (2003) Multomodality, resemiotization: Extending the analysis of discourse as multi-semiotic practice. Visual Communication, 2,1, 29-57.
29. Jakobi-Mirwald, C. (1997). Buchmalerei: ihre Terminologie in der Kunstgeschichte. Berlin: Reimer.
30. Jewitt, C. (2004). Multimodality and new communication technologies. In P. Levine & R. Scollon (Eds.), Discourse & technology. Multimodal discourse analysis (pp. 184-195). Georgetown, Washington, D.C.: Georgetown University Press.
31. Johnston, A. (2004). Files, forms, and fonts: mediational means and identity negotiation in immigration interviews. In P. Levine & R. Scollon (Eds.), Discourse & technology. Multimodal discourse analysis (pp. 116-127). Georgetown, Washington, D.C.: Georgetown University Press.
32. Jones, R. (2004). The problem of context in computer-mediated communication. In P. Levine & R. Scollon (Eds.), Discourse & technology. Multimodal discourse analysis (pp. 20-33). Georgetown, Washington, D.C.: Georgetown University Press.
33. Kaindl, K. (forthcoming). Multimodality in the translation of humour in comics. In E. Ventola, C. Charles, & M. Kaltenbacher (Eds.), Perspectives on multimodality (pp. 173-192). Amsterdam & Philadelphia: John Benjamins.
34. Kaltenbacher, M. 2003. Language learning via CD-Rom-Old wine in new bottles. In D. Newby (Ed.), Mediating between theory and practice in the context of different learning cultures and languages (pp. 171-175). Strasbourg: Council of Europe Publishing.
35. Kaltenbacher, M. (forthcoming). Multimodality in language teaching CD-ROMs. In E. Ventola, C. Charles, & M. Kaltenbacher (Eds.), Perspectives on multimodality (pp. 119-136). Amsterdam & Philadelphia: John Benjamins.
36. Kendon, A. (1990). Conducting interaction: Patterns of behavior in focused encounters. Cambridge: Cambridge University Press.
37. Kok, A. (2004). Multisemiotic mediation in hypertext. In K. O'Halloran (Ed.), Multimodal discourse analysis: Systemic functional perspectives (pp. 131-159). London: Continuum.
38. Kress, G., Jewitt, C., Ogborn, J. & Tsatsarelis, C. (2001). Multimodal teaching and learning. The rhetorics of the science classroom. London and New York: Continuum.
39. Kress, G. & van Leeuwen, T. (1990). Reading images. Geelong: Deakin University Press.
40. Kress, G. & van Leeuwen, T. (1996). Reading images: The grammar of visual design. London: Routledge.
41. Kress, G. & van Leeuwen, T. (2001). Multimodal discourse. The modes and media of contemporary communication. London: Arnold.
42. Kress, G. & van Leeuwen, T. (2002). Colour as a semiotic mode: Notes for a grammar of colour. Visual Communication, 1,3, 343-368.
43. Lee, J. (Ed.) (1997). Intelligence and multimodality in multimedia interfaces: Research and applications. Menlo Park, CA: AAAI Press.
44. Lemke, J. (2002). Travels in hypermodality. Visual Communication, 1(3), 299-325.
45. Lessing, G.E. (1766/1990). Laokoon: Oder uber die Grenzen der Malerei und Poesie. In W. Barner (Ed.), Gotthold Ephraim Lessing-Werke und Briefe, 5/2 (pp. 11-321). Frankfurt a. Main: Deutscher Klassiker Verlag.
46. Levine, P. & Scollon, R. (Eds.) (2004). Discourse & technology. Multimodal discourse analysis. Georgetown, Washington, D.C.: Georgetown University Press.
47. Lim, V.F. (forthcoming). Problematising 'semiotic resource'. In E. Ventola, C. Charles, & M. Kaltenbacher (Eds.), Perspectives on multimodality (pp. 51-63). Amsterdam & Philadelphia: John Benjamins.
48. Lutz, B. (1998). Hypertext: das Medium und der Autor. Ein Erfahrungsbericht. In B. Kettemann, M. Stegu, & H. Stockl (Eds.), Mediendiskurse. Verbal-Workshop Graz 1996 (pp. 151-162). Frankfurt am Main: Peter Lang Verlag.
49. Mazal, O. (1985). Das Buch der Initialen. Wien: Edition Tusch.
50. McNeill, D. (1992). Hand and mind: What gestures reveal about thought. Chicago: University of Chicago Press.
51. McNeill, D. (Ed.) (2001). Language and gesture. Cambridge: Cambridge University Press.
52. Muntigl, P. (forthcoming). Modelling multiple semiotic systems. In E. Ventola, C. Charles, & M. Kaltenbacher (Eds.), Perspectives on multimodality (pp. 31-50). Amsterdam & Philadelphia: John Benjamins.
53. Murray, G. & Costanzo, T. (1999) Usability and the web: An overview. In Network Notes 61. Information Technology Services. National Library of Canada. http://www.collectionscanada.ca/9/1/pl-260-e.html
54. Nijholt, A. (2003). Multimodality and ambient intelligence. In W.F.J. Verhaegh, E.H.L. Aarts & J. Korst (Eds.), Algorithms and ambient intelligence. Dordrecht et al.: Kluwer Academic Publishers. (Available at: http://doc.utwente.nl/fid/1144).
55. O'Halloran, K. (2004a). Visual semiosis in film. In K. O'Halloran (Eds.), Multimodal discourse analysis: Systemic functional perspectives (pp. 109-130). London: Continuum.
56. O'Halloran, K. (Ed.) (2004b). Multimodal discourse analysis: Systemic functional perspectives. London: Continuum.
57. O'Toole, M. (2004). The language of displayed art. Rutherford: Fairleigh Dickinson University Press.
58. O'Toole, M. (1994). Opera Ludentes: The Sydney Opera House at work and play. In K. O'Halloran (Ed.), Multimodal discourse analysis: Systemic functional perspectives (pp. 11-27). London: Continuum.
59. Pang, A. (2004). Making history in 'From Colony to Nation': A multimodal analysis of a museum exhibition in Singapore. In K. O'Halloran (Ed.), Multimodal discourse analysis: Systemic functional perspectives (pp. 28-54). London: Continuum.
60. Raisamo, R. (1999). Multimodal human-computer interaction: a constructive and empirical study. Unpublished Doctoral Thesis. Department of Computer Science, University of Tampere. http://acta.uta.fi/pdf/951-44-4702-6.pdf
61. Rheindorf, M. (forthcoming). The multiple modes of dirty dancing: a cultural studies approach to multimodal discourse analysis. In E. Ventola, C. Charles, & M. Kaltenbacher (Eds.), Perspectives on multimodality (pp. 137-152). Amsterdam & Philadelphia: John Benjamins.
62. Sajor, M. (2002). Multimodality: The coming revolution. Wireless Future Magazine, September/October 2002. http://www.wirelessfuturemagazine.com
63. Schiller, F. (1793/1962). Uber das Pathetische. In B. von Wiese (Ed.), Schillers Werke, 20-Philosophische Schriften, 1. Teil (pp. 196-221). Weimar: Bohlau.
64. Scollon, R. & Levine, P. (2004). Multimodal discourse analysis as the confluence of discourse and technology. In P. Levine & R. Scollon (Eds.), Discourse & technology. Multimodal discourse analysis (pp. 1-6). Georgetown, Washington, D.C.: Georgetown University Press.
65. Stockl, H. (1998). Bild-Text-Verknupfung. In B. Kettemann, M. Stegu & H. Stockl (Eds.), Mediendiskurse. Verbal-Workshop Graz 1996 (pp. 73-92). Frankfurt am Main: Peter Lang Verlag.
66. Stockl, H. (forthcoming). In between modes: Language and image in printed media. In E. Ventola, C. Charles, & M. Kaltenbacher (Eds.), Perspectives on multimodality (pp. 9-30). Amsterdam & Philadelphia: John Benjamins.
67. Taylor, C. (2000). Text analysis and translation: An interactive, self-Access computer application incorporating a functional approach. In A. Baldry (Ed.), Multimodality and multimediality in the distant learning age (pp. 295-309). Campopasso: Palladino Editore.
68. Taylor, C. (forthcoming). Multimodal text analysis and subtitling. In E. Ventola, C. Charles, & M. Kaltenbacher (Eds.), Perspectives on multimodality (pp. 153-172). Amsterdam & Philadelphia: John Benjamins.
69. Thibault, P. (2000). The multimodal transcription of a television advertisement: Theory and practice. In A. Baldry (Ed.), Multimodality and multimediality in the distant learning age (pp. 311-385). Campopasso: Palladino Editore.
70. Usability.gov (2004). Methods for designing usable web-sites. Collecting, writing and revising content. US Department of Health and Human Services (Ed.). http://www.usability.gov/methods
71. Van Der Geest, T. (2001). Web site design is communication design. Amsterdam: Benjamins.
72. Van Der Geest, T. & Spyridakis, J. (2000). Developing heuristics for web communication. Technical Communication 3, 301-310.
73. Van Leeuwen, T. (1999). Speech, music, sound. London: Macmillan.
74. Van Leeuwen, T. (forthcoming). Introducing social semiotics. An introductory textbook. London: Routledge.
75. Ventola, E. & Kaltenbacher, M. (2003). Lexicogrammar and language teaching materials-A social semiotic and discourse perspective. In J.E. Joyce (Ed.), Grammar in the language classroom (pp. 158-201). Singapore: SEAMEO Regional Language Centre.
76. Ventola, E., Charles, C. & Kaltenbacher, M. (Eds.) (forthcoming). Perspectives on multimodality. Amsterdam: Benjamins.
77. Vergilius, P.M. (1988). Aeneis. In J. Gotte (Ed.), Munchen & Zurich: Artemis Verlag.
78. Williams, T. (2000). Guidelines for designing and evaluation the display of information on the web. Technical Communication, 3, 383-396.
79. Winckelmann, J.J. (1755/1969). Gedanken uber die Nachahmung der griechischen Werke in der Malerei und Bildhauerkunst. Stuttgart: Reclam.