A spreading-activation model of the semantic coordination of speech and gesture

Cooperative Minds: Social Interaction and Group Dynamics - Proceedings of the 35th Annual Meeting of the Cognitive Science Society, CogSci 2013

Volumn , Issue , 2013, Pages 823-828

  Kopp, Stefan ^a   Bergmann, Kirsten ^a   Kahl, Sebastian ^a  

^a BIELEFELD UNIVERSITY   (Germany)

Author keywords

activation spreading; conceptualization; gesture; semantic coordination; Speech

Indexed keywords

CHEMICAL ACTIVATION;

ACTIVATION MODELS; ACTIVATION SPREADING; COGNITIVE PROCESS; CONCEPTUALIZATION; GESTURE; MODEL-BASED OPC; MULTI-MODAL; NATURALLY OCCURRING; SEMANTIC COORDINATION; SPREADING ACTIVATIONS;

SEMANTICS;

EID: 84892576940     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (21)

1. Anderson, J., Bothell, D., Byrne, M., Lebiere, C., & Qin, Y. (2004). An integrated theory of the mind. Psychological Review, 111(4), 1036-1060.
2. Bavelas, J., Kenwood, C., Johnson, T., & Philips, B. (2002). An experimental study of when and how speakers use gestures to communicate. Gesture, 2(1), 1-17.
3. Bergmann, K., & Kopp, S. (2006). Verbal or visual: How information is distributed across speech and gesture in spatial dialog. In D. Schlangen & R. Fernandez (Eds.), Proceedings of the 10th workshop on the semantics and pragmatics of dialogue (pp. 90-97).
4. Bergmann, K., & Kopp, S. (2009). Increasing expressiveness for virtual agents - autonomous generation of speech and gesture for spatial description tasks. In Proc. of AAMAS 2009 (p. 361-368).
5. Breslow, L., Harrison, A., & Trafton, J. (2010). Linguistic spatial gestures. In D. Salvucci & G. Gunzelmann (Eds.), Proceedings of the 10th international conference on cognitive modeling (pp. 13-18).
6. Collins, A. M., & Loftus, E. F. (1975). A spreading-activation theory of semantic processing. Psychological Review, 82(6), 407-428.
7. Hostetter, A., & Alibali, M. (2007). Raise your hand if you're spatial-relations between verbal and spatial skills and gesture production. Gesture, 7, 73-95.
8. Hostetter, A., & Alibali, M. (2008). Visible embodiment: Gestures as simulated action. Psychonomic Bulletin and Review, 15/3, 495-514.
9. Hostetter, A., & Alibali, M. (2011). Cognitive skills and gesture-speech redundancy. Gesture, 11(1), 40-60.
10. Kita, S., & Davies, T. S. (2009). Competing conceptual representations trigger co-speech representational gestures. Language and Cognitive Processes, 24(5), 761-775.
11. Kita, S., & Özyürek, A. (2003). What does cross-linguistic variation in semantic coordination of speech and gesture reveal?: Evidence for an interface representation of spatial thinking and speaking. Journal of Memory and Language, 48, 16-32.
12. Kita, S., Özyürek, A., Allen, S., Brown, A., Furman, R., & Ishizuka, T. (2007). Relations between syntactic encoding and co-speech gestures: Implications for a model of speech and gesture production. Language and Cognitive Processes, 22, 1212-1236.
13. Kopp, S., Bergmann, K., & Wachsmuth, I. (2008). Multimodal communication from multimodal thinking - towards an integrated model of speech and gesture production. Semantic Computing, 2(1), 115-136.
14. Krauss, R., Chen, Y., & Gottesman, R. (2000). Lexical gestures and lexical access: A process model. In D. McNeill (Ed.), Language and gesture (pp. 261-283). Cambridge, UK: Cambridge University Press.
15. Levelt, W. J. M. (1989). Speaking: From intention to articulation. MIT Press.
16. McNeill, D., & Duncan, S. (2000). Growth points in thinking-for-speaking. In D. McNeill (Ed.), Language and gesture (pp. 141-161). Cambridge, UK: Cambridge University Press.
17. Melinger, A., & Kita, S. (2007). Conceptualisation load triggers gesture production. Language and Cognitive Processes, 22(4), 473-500.
18. Özyürek, A. (2002). Speech-gesture relationship across languages and in second language learners: Implications for spatial thinking and speaking. In Proceedings of the 26th annual boston university conference on language development (pp. 500-509).
19. Ruiter, J. de. (2000). The production of gesture and speech. In D. McNeill (Ed.), Language and gesture (pp. 284-311). Cambridge, UK: Cambridge University Press.
20. Slobin, D. I. (1996). From”thought and language” to”thinking for speaking”. In J. J. Gumperz & S. C. Levison (Eds.), Rethinking linguistic relativity (p. 70-96). Cambridge Univ. Press.
21. Sowa, T., & Kopp, S. (2003). A cognitive model for the representation and processing of shape-related gestures. In Proc. European Cognitive Science Conference.