Methodology for multimodality

Human Cognitive Processing

Volumn 18, Issue , 2007, Pages 225-248

  Mittelberg, Irene ^a  

^a NONE

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85190114851     PISSN: 13876724     EISSN: None     Source Type: Book Series    
DOI: 10.1075/hcp.18.16mit     Document Type: Chapter

References (119)

1. Aitkinson, H. M. & Heritage, J. (Eds.). (1984). Structures as social action: Studies in conversation analysis. Cambridge: Cambridge University Press.
2. Barcelona, A. (Ed.). (2000). Metaphor and metonymy at the crossroads: A cognitive perspective. Berlin/New York: Mouton de Gruyter.
3. Beattie, G. (2003). Visible thought: A new psychology of body language. Hove: Routledge.
4. Bouvet, D. (1997). Le corps et la métaphore dans les langues gestuelles: A la recherche des modes de production des signes. Paris: L’Harmattan.
5. Bouvet, D. (2001). La dimension corporelle de la parole. Les marques posturo-mimo-gestuelles de la parole, leurs aspects métonymiques et métaphoriques, et leur rôle au cours d’un récit. Paris: Peeters.
6. Calbris, G. (1990). The semiotics of French gestures. Bloomington: University of Indiana Press.
7. Calbris, G. (2003). From cutting an object to a clear cut analysis: Gesture as the representation of a preconceptual schema linking concrete actions to abstract notions. Gesture, 3(1), 19–46.
8. Cameron, D. (2001). Working with spoken discourse. London/Thousand Oaks: Sage.
9. Chafe, W. (1987). Cognitive constraints on information flow. In R. Tomlin (Ed.), Coherence and grounding in discourse. Amsterdam/Philadelphia: John Benjamins.
10. Chafe, W. (1998). Language and the flow of thought. In M. Tomasello (Ed.), The new psychology of language: Cognitive and functional approaches to language structure, volume 1 (pp. 93–111). Mahwah, NJ: Erlbaum.
11. Cienki, A. (1998). Metaphoric gestures and some of their relations to verbal metaphoric expressions. In J.-P. Koenig (Ed.), Discourse and cognition: Bridging the gap (pp. 189–204). Stanford: CSLI Publications.
12. Cienki, A. (2005). Image schemas and gesture. In B. Hampe (Ed.), in cooperation with J. Grady, From perception to meaning: Image schemas in Cognitive Linguistics (pp. 421–442). Berlin/New York: Mouton de Gruyter.
13. Cienki, A. & Müller, C. (Eds.). (Fc.). Metaphor and gesture. Amsterdam/ New York: John Benjamins.
14. Clark, H. (1996). Using language. Cambridge: Cambridge University Press.
15. De Stefani, E. (Ed.). (Fc.). Les données vidéo dans la recherche linguistique Looking at language. [Video data in linguistic research. /Regards sur la langue.] Special issue of the Bulletin Suisse de linguistique appliquée VALS/ASLA.
16. Dirven, R. & Pörings, R. (2002). Metaphor and metonymy in comparison and contrast. Berlin/New York: Mouton de Gruyter.
17. Du Bois, J. W., Schuetze-Coburn, S., Cumming, S., & Paolino, D. (1992). Discourse transcription. Santa Barbara Papers in Linguistics, 4, 1–225.
18. Du Bois, J. W., Schuetze-Coburn, S., Cumming, S., & Paolino, D. (1993). Outline of discourse transcription. In J. A. Edwards & M. D. Lampert (Eds.), Talking data: Transcription and coding in discourse research (pp. 45–87). Mahwah, NJ: Lawrence Erlbaum Assoc.
19. Dudis, P. G. (2004). Body partitioning and real-space blends. Cognitive Linguistics, 15(2), 223–238.
20. Duncan, S. (2003). Gesture, verb aspect, and the nature of iconic imagery in natural discourse. Gesture, 2(2), 183–206.
21. Duranti, A. (1997). Linguistic anthropology. Cambridge: Cambridge University Press.
22. Edwards, J. A. & Lampert, M. D. (Eds.). (1993). Talking data: Transcription and coding in discourse research. Hillsdale, NJ: Lawrence Erlbaum.
23. Efron, D. (1972). Gesture, race, and culture. Preface by Paul Ekman. The Hague: Mouton and Co.
24. Emmorey, K. & Casey, S. (2001). Gesture, thought, and spatial language. Gesture, 1(1), 35–50.
25. Emmorey, K. & Reilly, J. S. (Ed.). (1995). Language, gesture, and space. Hillsdale, NJ: Erlbaum.
26. Fauconnier, G. & Turner, M. (2002). The way we think: Conceptual integration and the mind’s hidden complexities. New York: Basis Books.
27. Fricke, E. (2002). Origo, pointing, and speech: The impact of co-speech gestures on linguistic deixis theory. Gesture, 2(2), 207–226.
28. Fricke, E. (2004). Origo, Geste und Raum – Lokaldeixis im Deutschen. Doctoral Dissertation, Technische Universität Berlin.
29. Furuyama, N. (2000a). Gestural interaction between the instructor and the learner in origami instructions. In D. McNeill (Ed.), Language and gesture (pp. 99–117). Cambridge: Cambridge University Press.
30. Furuyama, N. (2000b). The semiotic making of speech and gesture and how it contributes to the structuring of discourse. Cognitive Studies, 7(1), 71–77.
31. Gibbs, R. W., Jr. (1994). The poetics of mind: Figurative thought, language, and understanding. Cambridge, UK: Cambridge University Press.
32. Goldin-Meadow, S. (2003). Hearing gesture: How hands help us think. Cambridge, MA/London: The Belknap Press of Harvard University Press.
33. Goodwin, C. (1986). Gesture as a resource for the organization of mutual orientation. Semiotica, 62(1–2), 29–49.
34. Goodwin, C. (1993). Recording human interaction in natural settings. Pragmatics, 3(2), 181–209.
35. Goodwin, C. (2001). Practices of seeing visual analysis: An ethnomethodological approach. In T. van Leeuwen & C. Jewitt (Eds.), Handbook of Visual Analysis (pp. 157–182). London: Sage Publications.
36. Goodwin, C. (2003). Pointing as situated practice. In S. Kita (Ed.), Pointing: Where Language, Culture, and Cognition Meet (pp. 217–241). Mahwah, NJ: Lawrence Erlbaum Associates.
37. Goossens, L. (1995). Metaphtonymy: The interaction of metaphor and metonymy in figurative expressions for linguistic action. In L. Goosens, P. Pauwels, B. Rudzka-Ostyn, A.-M. Simon-Vandenbergen, & J. Vanparys (Eds.), By word of mouth. Metaphor, Metonymy and Linguistic action in cognitive perspective (pp. 159–174). Amsterdam/Philadelphia: John Benjamins.
38. Gullberg, M. (1998). Gesture as a communication strategy in second language discourse. A study of learners of French and Swedish. Lund University Press.
39. Hampe, B. (Ed.). (2005). From perception to meaning: Image schemas in cognitive linguistics. Berlin: Mouton de Gruyter.
40. Haviland, J. (2000). Pointing, gesture spaces, and mental maps. In D. McNeill (Ed.), Language and gesture (pp. 13–46). Cambridge: Cambridge University Press.
41. Hopper, P. (1998). Emergent grammar. In M. Tomasello (Ed.), The new psychology of language: Cognitive and functional approaches to language structure. Mahwah, NJ: Lawrence Erlbaum.
42. Jakobson, R. (1990 [1956]). Two aspects of language and two types of aphasic disturbances. In L. R. Waugh & M. Monville-Burston (Eds.), Roman Jakobson, On Language (pp. 115–133). Cambridge/London: Harvard University Press.
43. Jakobson, R. (1960). Closing statement: Linguistics and poetics. In T. A. Sebeok (Ed.), Style in Language (pp. 350–377). Cambridge, MA: MIT Press.
44. Jakobson, R. (1971[1964]). Visual and auditory Signs. Phonetica XI, 216–220; reprinted in Selected Writings II (pp. 334–337). The Hague: Mouton.
45. Jakobson, R. (1990 [1966]). Quests for the essence of language. In L. R. Waugh & M. Monville-Burston (Eds.), Roman Jakobson, On Language (pp. 407–421). Cambridge/ London: Harvard University Press.
46. Jakobson, R. (1990 [1974]). Linguistics in relation to other sciences. In L. R. Waugh & M. Monville-Burston (Eds.), Roman Jakobson, On Language (pp. 451–488). Cambridge/ London: Harvard University Press.
47. Jakobson, R. (1987). On the Relation between Auditory and Visual Signs. In K. Pomorska & S. Rudy (Eds.), Roman Jakobson, Language in literature (pp. 467–473). Cambridge/London: Belknap Press of Harvard University Press.
48. Jakobson, R. & Pomorska, K. (1980). Dialogues. Paris: Flammarion. Eng. Trans. 1983. Cambridge, MA: MIT Press.
49. Jaworski, A. & Coupland, N. (Eds.). (1999). The discourse reader. London/New York: Routledge.
50. Johnson, M. (1987). The body in the mind: The bodily basis of meaning, imagination, and reason. Chicago: University of Chicago Press.
51. Kendon, A. (1995). Gestures as illocutionary and discourse structure markers in southern Italian conversation. Journal of Pragmatics, 23(3), 247–279.
52. Kendon, A. (1997). Gesture. Annual Review of Anthropology, 26, 109–128.
53. Kendon, A. (2000). Language and gesture: Unity or duality? In D. McNeill (Ed.), Language and gesture (pp. 47–63). Cambridge: Cambridge University Press.
54. Kendon, A. (2004). Gesture: Visible action as utterance. Cambridge: Cambridge University Press.
55. Kita, S. (1993). Language and thought interface: A study of spontaneous gestures and Japanese mimetics. Doctoral Dissertation, University of Chicago.
56. Kita, S. (2000). How representational gestures help speaking. In D. McNeill (Ed.), Language and gesture (pp. 162–185). Cambridge: Cambridge University Press.
57. Kita, S. (Ed.). (2003). Pointing: Where language, culture, and cognition meet. Mahwah, NJ: Lawrence Erlbaum Assoc.
58. Kita, S. & Özyürek, A. (2003). What does cross-linguistic variation in semantic coordination of speech and gesture reveal? Evidence for an interface representation of spatial thinking and speaking. Journal of Memory and Language, 48, 16–32.
59. Kramsch, C. (2002). ‘How can we tell the dancer form the dance?’ Introduction to C. Kramsch (Ed.), Language acquisition and language socialization: Ecological perspectives (pp. 1–30). London/New York: Continuum.
60. Kress, G., Jewitt, C., Ogborn, J., & Tsatsarelis, C. (2001). Multimodal teaching and learning: The rhetorics of the science classroom. London/New York: Continuum.
61. Lakoff, G. (1987). Women, fire, and dangerous Things. What categories reveal about the mind. Chicago: University of Chicago Press.
62. Lakoff, G. (1993). The contemporary theory of metaphor. In A. Ortony (Ed.), Metaphor and thought (pp. 202–251) (2nd ed.). Cambridge: Cambridge University Press.
63. Lakoff, G. & Johnson, M. (1980). Metaphors we live by. Chicago: University of Chicago Press.
64. Lakoff, G. & Johnson, M. (1999). Philosophy in the flesh: The embodied mind and its challenge to western thought. New York: Basic Books.
65. Langacker, R. W. (1993). Reference-point constructions. Cognitive Linguistics, 4, 1–38.
66. Lantolf, J. P. & Thorne, S. (Ed.). (2006). Sociocultural theory and the genesis of second language development. Oxford: Oxford University Press.
67. LeBaron, C. & Streeck, J. (2000). Gestures, knowledge, and the world. In D. McNeill (Ed.), Language and gesture (pp. 118–138). Cambridge: Cambridge University Press.
68. Levinson, J. (1997) Language and cognition: The cognitive consequences of spatial description in Guugu Yimithirr. Journal of Linguistic Anthropology, 7(1), 93–131.
69. Levinson, J. (2003) Space in language and cognition: Explorations in cognitive diversity. Cambridge: Cambridge University Press.
70. Liddell, S. (2003). Grammar, gesture, and meaning in American Sign Language. Cambridge: Cambridge University Press.
71. Mandler, J. (1996). Preverbal representation and language. In P. Bloom, M. A. Peterson, L. Nadel, & M. F. Garrett (Eds.), Language and space (pp. 365–384). Cambridge, MA: MIT Press.
72. McCafferty, S. G. (2004). Space for cognition: Gesture and second language learning. International Journal for Applied Linguistics, 14(1), 148–165.
73. McNeill, D. (1992). Hand and mind: What gestures reveal about thought. Chicago: Chicago University Press.
74. McNeill, D. (Ed.). (2000). Language and gesture. Cambridge: Cambridge University Press.
75. McNeill, D. (2005). Gesture and thought. Chicago: Chicago University Press.
76. McNeill, D. & Duncan, S. (2000). Growth points in thinking-for-speaking. In D. McNeill (Ed.), Language and gesture (pp. 141–161). Cambridge: Cambridge University Press.
77. McNeill, D. & Levy, E. T. (1982). Conceptual representations in language activity and gesture. In R. Jarvella & W. Klein (Eds.), Speech, place, and action (pp. 271–295). Chichester, England: Wiley & Sons.
78. McNeill, D., Quek, F., McCullough, K.-E., Duncan, S. D., Furuyama, N., Bryll, R., Ma, X.-F., & Ansari, R. (2001). Catchments, prosody and discourse. Gesture, 1(1), 9–33.
79. Mittelberg, I. (2002). The visual memory of grammar: Iconographical and metaphorical insights. Metaphorik.de, 2/2002, 69–89.
80. Mittelberg, I. (2006). Metaphor and metonymy in language and gesture: Discourse evidence for multimodal models of grammar. Doctoral Dissertation, Cornell University.
81. Mittelberg, I. (fc./a). Peircean semiotics meets conceptual metaphor: Iconic modes in gestural representations of grammar. In A. Cienki & C. Müller (Eds.), Metaphor and gesture. Amsterdam/New York: John Benjamins.
82. Mittelberg, I. (fc./b). Geometric patterns in gesture space. In V. Evans & P. Chilton (Eds.), Language, cognition, and space: The state of the art and new directions. London: Equinox.
83. Müller, C. (1998). Redebegleitende Gesten. Kulturgeschichte – Theorie – Sprachvergleich. Berlin: Berlin Verlag A. Spitz.
84. Müller, C. (2004a). Forms and uses of the palm up open hand: A case of a gesture family? In R. Posner & C. Müller (Eds.), The semantics and pragmatics of everyday gestures. The Berlin conference (pp. 233–256). Berlin: Weidler Verlag.
85. Müller, C. (2004b). Metaphors. Dead and alive, sleeping and waking. A cognitive approach to metaphors in language use. Habilschrift, Freie Universität Berlin.
86. Negueruela, E., Lantolf, J. P., Jordan S. R., & Gelabert, J. (2004). The “private function of gesture in second language speaking activity: A study of motion verbs and gesturing in English and Spanish. International Journal of Applied Linguistics, 14(1), 113–147.
87. Nobe, S. (1996). Representational gestures, cognitive rhythms, and acoustic aspects of speech: A network/ threshold model of gesture production. Doctoral Dissertation, University of Chicago.
88. Núñez, R. E. & Sweetser, E. E. (2006). Aymara, where the future is behind you: Convergent evidence from language and gesture in the cross-linguistic comparison of spatial construals of time. Cognitive Science, 30, 1–49.
89. Ochs, E. (1979). Transcription as theory. In E. Ochs & B. Schiefflin (Eds.), Developmental pragmatics. New York: Academic Press.
90. A. Jaworski & N. Coupland (1999) (Eds.), The Discourse reader (pp. 167–182). London/New York: Routledge.
91. Ochs, E., Gonzalez, P., & Jacoby, S. (1996). “When I come down I’m in the domain state”: Grammar and graphic representation in the interpretive activity of physics. In E. Ochs, E. A. Schegloff, & S. A. Thompson (Eds.), Interaction and grammar (pp. 329–369). Cambridge: Cambridge University Press.
92. Panther, K.-U. & Thornburg, L. L. (2004). The role of conceptual metonymy in meaning construction. Metaphorik.de, 06/2004, 91–113.
93. Parrill, F. (2003). Intuitions and violations of good form in metaphoric conduit gestures. Paper presented at the theme session “Metaphor and Gesture,” 8th International Cognitive Linguistics Conference, Logroño, Spain, July 23.
94. Parrill, F. & Sweetser, E. E. (2004). What we mean by meaning: Conceptual integration in gesture analysis and transcription. Gesture, 4(2), 197–219.
95. Peirce, C. S. (1955). Logic as semiotic: The theory of signs (1893–1920). In J. Bucher (Ed.), Philosophical writings of Peirce (pp. 98–119). New York: Dover.
96. Peirce, C. S. (1960). Collected papers of Charles Sanders Peirce (1931–1958). Vol. I.: Principles of philosophy, Vol. II: Elements of logic. C. Hartshorne & P. Weiss (Eds.). Cambridge: The Belknap Press of Harvard University Press.
97. Radden, G. & Kövecses, Z. (1999). Towards a theory of metonymy. In K.-U. Panther & G. Radden (Eds.), Metonymy in language and thought (pp. 17–59). Amsterdam/ Philadelphia: John Benjamins.
98. Roth, W.-A. (2003). From epistemic (ergotic) actions to scientific discourse: The bridging function of gestures. Pragmatics & Cognition, 11(1), 141–170.
99. Schegloff, E. A. (1984). On some gestures’ relation to talk. In J. M. Atkinson & J. Heritage (Ed.), Structures of social action (pp. 266–296). Cambridge: Cambridge University Press.
100. Settekorn, W. (1993). Das Auge und der Körper des Linguisten. Für eine Medien- Technik- und Sozialgeschichte (nicht nur) der Sprachwissenschaft, Linguistik und Literaturwissenschaft, 90/91, 195–234.
101. Settekorn, W. (1996). Vor-Film. Zur Geschichte der Inkorporation von Sprache, Bild und Raum. In H. Segeberg (Ed.), Die Mobilisierung des Sehens. Zur Vor- und Frühgeschichte des Films in Literatur und Kunst (pp. 13–43). München: Fink.
102. Settekorn, W. (2003). Representation: The influence of history, culture, and (mass) media on the evolution of a concept central to cognitive science. Presentation given at the EMCL Workshop at Cornell University.
103. Slobin, D. (1987). Thinking for speaking. In J. Aske, N. Beery, L. Michaelis, & H. Filip (Eds.), Proceedings of the Thirteenth Annual Meeting of the Berkeley Linguistic Society (pp. 435–445). Berkeley: Berkeley Linguistics Society.
104. Slobin, D. (1996). From ‘thought and language’ to ‘thinking for speaking’. In J. J. Gumperz & S. C. Levinson (Eds.), Rethinking linguistic relativity (pp. 97–114). Cambridge: Cambridge University Press.
105. Smith, N. (2003). Gesture and beyond. Honors Thesis, Program in Cognitive Science, University of California at Berkeley.
106. Solnit, R. (2003). River of shadows: Eadweard Muybridge and the technological Wild West. London/New York: Penguin.
107. Streeck, J. (1993). Gesture as communication I: Its coordination with gaze and speech. Communication Monographs, 60, 275–299.
108. Streeck, J. (1994). Gesture as communication II: The audience as co-author. Research on Language and Social Interaction, 3, 239–276.
109. Streeck, J. (2002). A body and its gestures. Gesture, 2(1), 19–44.
110. Sweetser, E. E. (1990). From Etymology to Pragmatics: Metaphorical and Cultural Aspects of Semantic Structure. Cambridge: Cambridge University Press.
111. Sweetser, E. E. (1998). Regular metaphoricity in gesture: Bodily-based models of speech interaction. Actes du 16e Congrès International des Linguistes (CD-ROM), Elsevier.
112. Tabensky, A. (2001). Gesture and speech rephrasing in conversation. Gesture, 1(2), 213–235.
113. Talmy, L. (1985). Lexicalization patterns: Semantic structure in lexical forms. In T. Shopen (Ed.), Language typology and syntactic description, Vol. 3: Grammatical categories and the lexicon (pp. 57–149). Cambridge: Cambridge University Press.
114. Tao, H. (1999). Body movement and participant alignment in Mandarin conversational interactions. Papers from the 35th regional meeting of the Chicago Linguistic Society, Vol. II: The panels (pp. 125–139). Chicago: Chicago Linguistics Society.
115. Taub, S. (2001). Language from the body: Iconicity and metaphor in American Sign Language. Cambridge: Cambridge University Press.
116. Waugh, L. (1982). Marked and unmarked – a choice between unequals in semiotic structure. Semiotica, 39, 3/4, 299–318.
117. Webb, R. (1996). Linguistic features of metaphoric gestures. Doctoral Dissertation, University of Rochester.
118. Wilcox, P. P. (2004). A cognitive key: Metonymic and metaphorical mappings in ASL. Cognitive Linguistics, 15(2), 197–222.
119. Williams, R. (2004). Making meaning from a clock: Material artifacts and conceptual blending in time-telling instruction. Doctoral Dissertation, University of California at San Diego.