The communicative import of gestures: Evidence from a comparative analysis of human-human and human-machine interactions

Gesture

Volumn 9, Issue 1, 2009, Pages 97-126

  Mol, Lisette ^a   Krahmer, Emiel ^a   Maes, Alfons ^a   Swerts, Marc ^a  

^a TILBURG UNIVERSITY   (Netherlands)

Author keywords

Audience design; Gesture; Human machine interaction; Narration

Indexed keywords

EID: 70349207118     PISSN: 15681475     EISSN: 15699773     Source Type: Journal    
DOI: 10.1075/gest.9.1.04mol     Document Type: Article

References (34)

1. Aharoni, Eyal & Alan J. Fridlund (2007). Social reactions toward people vs. computers: How mere labels shape interactions. Computers in Human Behavior, 23, 2175-2189.
2. Alibali, Martha W., Dana C. Heath, & Heather J. Myers (2001). Effects of visibility between speaker and listener on gesture production: some gestures are meant to be seen. Journal of Memory and Language, 44, 169-188.
3. Bangerter, Adrian & Eric Chevalley (2007). Pointing and describing in referential communication: When are pointing gestures used to communicate? In Ielka Van der Sluis, Mariët Theune, Ehud Reiter, & Emiel Krahmer (Eds.), CTIT Proceedings of the Workshop on Multimodal Output Generation (MOG), Aberdeen, Scotland, January 2007.
4. Bavelas, Janet, Nicole Chovil, Douglas A. Lawrie, & Allan Wade (1992). Interactive gestures. Discourse Processes, 15, 469-489.
5. Bavelas, Janet, Jennifer Gerwing, Chantelle Sutton, & Danielle Prevost (2008). Gesturing on the telephone: Independent effects of dialogue and visibility. Journal of Memory and Language, 58, 495-520.
6. Beattie, Geoffrey W. & Heather Shovelton (1999). Mapping the range of information contained in the iconic hand gestures that accompany spontaneous speech. Journal of Language and Social Psychology, 18, 438-462.
7. Beattie, Geoffrey W. & Heather Shovelton (2002). An experimental investigation of some properties of individual iconic gestures that affect their communicative power. British Journal of Psychology, 93 (2), 179-72.
8. Branigan, Holly P., Martin Pickering, Jamie Pearson, & Janet F. McLean (in press). Linguistic alignment between people and computers, Journal of Pragmatics.
9. Chawla, Purnima & Robert M. Krauss (1994). Gesture and speech in spontaneous and rehearsed narratives. Journal of Experimental Social Psychology, 30, 580-601.
10. Cohen, Akiba A. (1977). The communicative functions of hand illustrators. Journal of Communications, 27 (4), 54-63.
11. Cohen, Akiba A. & Randall P. Harrison (1973). Intentionality in the use of hand illustrators in face-to-face communication situations. Journal of Personality and Social Psychology, 28, 276-279.
12. De Ruiter, Jan Peter (1998). Gesture and speech production. Unpublished dissertation, University of Nijmegen.
13. Dupond, Stéphane & Juergen Luettin (2000). Audio-visual speech modeling for continuous speech recognition. IEEE Transactions on Muldimedia, 2 (3), 141-151.
14. Enfield, Nick J., Sotaro Kita, Jan Peter de Ruiter (2007). Primary and secondary pragmatic functions of pointing gestures. Journal of Pragmatics, 39, 1722-1741.
15. Fish, Robert S., Robert E. Kraut, Robert W. Root, & Ronald E. Rice (1992). Evaluating video as a technique for informal communication. In Proceedings of the SIGCHI conference on human factors in computing systems, Monterey, CA, USA, May 1992.
16. Fisher, Ronald A. (1951). The design of experiments. 6th ed. Edinburgh: Oliver & Boyd.
17. Goldin-Meadow, Susan (1999). The role of gesture in communication and thinking. Trends in Cognitive Sciences, 3 (11), 419-429.
18. Goldin-Meadow, Susan & Catherine Momeni Sandhofer (1999). Gestures convey substantive information about a child's thoughts to ordinary listeners. Developmental Science, 2, 67-74.
19. Goldin-Meadow, Susan, Howard Nusbaum, Spencer D. Kelly, & Susan Wagner (2001). Explaining math: Gesturing lightens the load. Psychological Science, 12 (6), 516-522.
20. Hadar, Uri (1989). Two types of gesture and their role in speech production. Journal of Language and Social Psychology, 8, 221-228.
21. Hostetter, Autumn. B., Martha W. Alibali, & Sotaro Kita (2007). Does sitting on your hands make you bite your tongue? The effects of gesture inhibition on speech during motor descriptions. In Danielle S. McNamara & Greg Trafton (Eds.), Proceedings of the 29th annual meeting of the Cognitive Science Society, 1097-1102. Mawhah, NJ: Erlbaum.
22. Hostetter, Autumn. B., William D. Hopkins (2002). The effect of thought structure on the production of lexical movements. Brain and Language, 82, 22-29.
23. Jacobs, Naomi, & Alan Garnham (2006). The role of conversational hand gestures in a narrative task. Journal of Memory and Language, 26, 291-303.
24. Kendon, Adam (1994). Do gestures communicate? A review. Research on Language and Social Interaction, 27 (3), 175-200.
25. Kendon, Adam (2004). Gesture: visible action as utterance. Cambridge: Cambridge University Press.
26. Keysar, Boaz, Shuhong Lin, & Dale J. Barr (2003). Limits on theory of mind use in adults. Cognition, 89, 25-41.
27. Kita, Sotaro (2000). How representational gestures help speaking. In: David McNeill (Ed.), Language and gesture (pp. 162-185). Cambridge: Cambridge University Press.
28. Krauss, Robert M. (1998). Why do we gesture when we speak? Current Directions in Psychological Science, 7, 54-60.
29. Maes, Alfons, Pascal Marcelis, & Frank Verheyen (2007). Referential collaboration with computers: do we treat computer addressees like humans. In Monika Schwarz-Friesel, Manfred Consten, & Mareile Knees (Eds.), Anaphors in text: cognitive, formal and applied approaches to anaphoric reference (pp. 49-68). Amsterdam: John Benjamins Publishing Company.
30. McCowan, Iain, Daniel Gatica-Perez, Samy Bengio, Guillaume Lathoud, Mark Barnard, & Dong Zhang (2005). Automatic analysis of multimodal group actions in meetings. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27 (3), 305-317.
31. McNeill, David (1992). Hand and mind: what gestures reveal about thought. Chicago: University of Chicago Press.
32. Melinger, Alissa & Willem J. M. Levelt (2004). Gesture and the communicative intention of the speaker. Gesture, 4 (2), 119-141.
33. Özyürek, Asli (2002). Do speakers design their cospeech gestures for their addressees? The effects of addressee location on representational gestures. Journal of Memory and Language, 46, 688-704.
34. Reeves, Byron & Clifford Nass (1996). The Media Equation, how people treat computers, television, and new media like real people and places. New York: Cambridge University Press (CLSI Publications).