Gestural Alignment in Natural Dialogue

Building Bridges Across Cognitive Sciences Around the World - Proceedings of the 34th Annual Meeting of the Cognitive Science Society, CogSci 2012

Volumn , Issue , 2012, Pages 1326-1331

  Bergmann, Kirsten ^a   Kopp, Stefan ^a  

^a BIELEFELD UNIVERSITY   (Germany)

Author keywords

Alignment; co speech gestures; natural interaction

Indexed keywords

BEHAVIORAL RESEARCH;

CO-SPEECH GESTURE; FORM FEATURES; NATURAL INTERACTIONS; NON-VERBAL BEHAVIOURS; SENSITIVE FEATURES; SYSTEMATIC STUDY; TEMPORAL DISTANCE;

ALIGNMENT;

EID: 85109602633     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (28)

1. Bergmann, K. (2012). The production of co-speech iconic gestures: Empirical study and computational simulation with virtual agents. PhD Thesis: Bielefeld University.
2. Branigan, H., Pickering, M., Pearson, J., & McLean, J. (2010). Linguistic alignment between humans and computers. Journal of Pragmatics, 42, 2355—2368.
3. Brennan, S., & Clark, H. (1996). Lexical choice and conceptual pacts in conversation. Journal of Experimental Psychology, 22(6), 1482—1493.
4. Chartrand, T., & Bargh, J. (1999). The chameleon effect: The perception-behavior link and social interaction. Journal of Personality and Social Psychology, 76, 893–910.
5. Chartrand, T., Maddux, W., & Lakin, J. (2005). Beyond the perception-behavior link: The ubiquitous utility and motivational moderators of unconscious mimicry. In R. Hassin, J. Uleman, & J. Bargh (Eds.), The new unconscious (pp. 334—361). New York: Oxford University Press.
6. Dijksterhuis, A., & Bargh, J. (2001). The perception-behavior expressway: Automatic effects of social perception on social behavior. Advances in Experimental Social Psychology, 33, 1–40.
7. Hoetjes, M., Koolen, R., Goudbeek, M., Krahmer, E., & Swerts, M. (2011). Greebles greeble greeb: On reduction in speech and gesture in repeated references. In Proc. of the 33rd annual conference of the cognitive society.
8. Holler, J., & Stevens, R. (2007). An experimental investigation into the effect of common ground on how speakers use gesture and speech to represent size information in referential communication. Journal of Language and Social Psychology, 26, 4–27.
9. Holler, J., & Wilkin, K. (2011). Co-speech gesture mimicry in the process of collaborative referring during face-to-face dialogue. Journal of Nonverbal Behavior, 35, 133–153.
10. Hostetter, A., & Alibali, M. (2007). Raise your hand if you’re spatial—relations between verbal and spatial skills and gesture production. Gesture, 7, 73–95.
11. Howes, C., Healey, P., & Purver, M. (2010). Tracking lexical and syntactic alignment in conversation. In Proc. of the 32nd annual conference of the cognitive science society.
12. Kendon, A. (2004). Gesture—visible action as utterance. Cambridge University Press.
13. Keysar, B., & Henly, A. (2002). Speakers’ overestimation of their effectiveness. Psychological Science, 13, 207–212.
14. Kimbara, I. (2006). On gestural mimicry. Gesture, 6, 39–61.
15. Kimbara, I. (2008). Gesture form convergence in joint description. Journal of Nonverbal Behavior, 32, 123–131.
16. Kita, S., & Özyürek, A. (2003). What does cross-linguistic variation in semantic coordination of speech and gesture reveal?: Evidence for an interface representation of spatial thinking and speaking. Journal of Memory and Language, 48, 16–32.
17. Kopp, S. (2010). Social resonance and embodied coordination in face-to-face conversation with artificial interlocutors. Speech Communication, 52, 587–597.
18. Kopp, S., Bergmann, K., & Wachsmuth, I. (2008). Multimodal communication from multimodal thinking—towards an integrated model of speech and gesture production. Semantic Computing, 2(1), 115–136.
19. Kopp, S., Tepper, P., Ferriman, K., Striegnitz, K., & Cassell, J. (2007). Trading spaces: How humans and humanoids use speech and gesture to give directions. In Conversational informatics (pp. 133–160). New York: John Wiley.
20. Lakin, J., & Chartrand, T. (2003). Using nonconscious behavioral mimicry to create affiliation and rapport. Psychological Science, 14, 334—339.
21. Logan, G. D. (1988). Toward an instance theory of automatization. Psychological Review, 95, 492–527.
22. Lücking, A., Bergmann, K., Hahn, F., Kopp, S., & Rieser, H. (2010). The Bielefeld Speech and Gesture Alignment corpus (SaGA). In Proceedings of the LREC 2010 workshop on multimodal corpora.
23. McNeill, D. (1992). Hand and mind—What gestures reveal about thought. Chicago: University of Chicago Press.
24. Mol, L., Krahmer, E., Maes, A., & Swerts, M. (2012). Adaptation in gesture: Converging hands or converging minds? Journal of Memory and Language, 66, 249–264.
25. Montgomery, K., Isenberg, N., & Haxby, J. (2007). Communicative hand gestures and object-directed hand movements activated the mirror neuron system. Social Cognitive and Effective Neuroscience, 2(2), 114-122.
26. Parrill, F., & Kimbara, I. (2006). Seeing and hearing double: The influence of mimicry in speech and gesture on observers. Journal of Nonverbal Behavior, 30, 157–166.
27. Pickering, M., & Garrod, S. (2004). Toward a mechanistic psychology of dialogue. Behavioral and Brain Sciences, 27, 169–226.
28. Reitter, D. (2008). Context effects in language production: Models of syntactic priming in dialogue corpora. PhD Thesis: University of Edinburgh.