Seeing is believing: Body motion dominates in multisensory conversations

ACM Transactions on Graphics

Volumn 29, Issue 4, 2010, Pages

  Ennis, Cathy ^a   McDonnell, Rachel ^a   O'Sullivan, Carol ^a  

^a TRINITY COLLEGE DUBLIN   (Ireland)

Author keywords

Conversational agents; Crowds; Perception

Indexed keywords

BODY MOTIONS; CONVERSATIONAL AGENTS; CROWDS; DESYNCHRONIZATION; HUMAN SENSITIVITY; MOTION CAPTURE DATA; MULTISENSORY; PERCEPTION; VIRTUAL HUMANS;

VIRTUAL REALITY;

EID: 77956362234     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/1778765.1778828     Document Type: Article

References (25)

1. BERNARD, S., THERIEN, J., MALONE, C., BEESON, S., GUBMAN, A., AND PARDO, R., 2008. Taming the Mob: Creating believable crowds in Assassin's Creed. Presented at Game Developers Conference (San Francisco, CA, Feb. 18-22).
2. BICKMORE, T., AND CASSELL, J. 2005. Social Dialogue with Embodied Conversational Agents. In Advances in natural multimodal dialogue systems, 23-54.
3. BRITON, N. J., AND HALL, J. A. 1995. Beliefs about female and male nonverbal communication. Sex Roles: Journal of Research 32, 1-2, 79-90.
4. CASSELL, J., NAKANO, Y., BICKMORE, T., SIDNER, C., and RICH, C. 2001. Non-verbal cues for discourse structure. In Proceedings of the 39th Annual Meeting on Association for Computational Linguistics, 114-123.
5. CASSELL, J., VIHJáLMSSON, H., and BICKMORE, T. 2001. BEAT: the Behavior Expression Animation Toolkit. In Proceedings of SIGGRAPH 2001, 31-486.
6. DURUPINAR, F., ALLBECK, J., PELECHANO, N., AND BADLER, N. 2008. Creating crowd variation with the OCEAN personality model. In Proceedings of the 7th international joint conference on Autonomous agents and multiagent systems, 1217-1220.
7. Edge online: Performance art. http://www.edgeonline.com/magazine/ performance-art.
8. EKMAN, P., AND FRIESEN, W. 1969. The repertoire of nonverbal behavior: Categories, origins, usage, and coding. Semiotica 1, 1, 49-98.
9. EKMAN, P. 1992. An argument for basic emotions. Cognition and Emotion 6, 3, 169-200.
10. GIORGOLO, G., AND VERSTRATEN, F. 2008. Perception of speech-and-gesture integration. In Proceedings of the International Conference on Auditory-Visual Speech Processing 2008, 31-36.
11. GOLDIN-MEADOW, S. 2005. Hearing gesture: How our hands help US think. Belknap Press.
12. JOHANSSON, G. 1973. Visual perception of biological motion and a model for its analysis. Perception and Psychophysics 14, 2, 201-211.
13. KENDON, A. 1994. Do gestures communicate? A review. Research on language and social interaction 27, 3, 175-200.
14. KRAHMER, E., AND SWERTS, M. 2007. The effects of visual beats on prosodic prominence: Acoustic analyses, auditory perception and visual perception. Journal of Memory and Language 57, 3, 396-414.
15. LERNER, A., FITUSI, E., CHRYSANTHOU, Y., AND COHEN-OR, D. 2009. Fitting behaviors to pedestrian simulations. In SCA'09: Proceedings of the 2009 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, 199-208.
16. LEVINE, S., THEOBALT, C., and KOLTUN, V. 2009. Real-time prosody-driven synthesis of body language. ACM Transactions on Graphics 28, 5, 1-10.
17. MCDONNELL, R., LARKIN, M., DOBBYN, S., COLLINS, S., and O'SULLIVAN, C. 2008. Clone attack! perception of crowd variety. ACM Transactions on Graphics 27, 3, 26:1-26:8.
18. MCDONNELL, R., ENNIS, C., DOBBYN, S., AND O'SULLIVAN, C. 2009. Talking bodies: Sensitivity to desynchronization of conversations. ACM Transactions on Applied Perception 6, 4, 22:1-22:8.
19. MCNEILL, D. 1996. Hand and mind: What gestures reveal about thought. University of Chicago Press.
20. MUSICANT, A. D., AND BUTLER, R. A. 1984. The influence of pinnae-based spectral cues on sound localization. The Journal of the Acoustical Society of America 75, 4, 1195-1200.
21. NEFF, M., KIPP, M., ALBRECHT, I., AND SEIDEL, H. 2008. Gesture modeling and animation based on a probabilistic re-creation of speaker style. ACM Transactions on Graphics 27, 1, 1-24.
22. PETERS, C., AND ENNIS, C. 2009. Modeling groups of plausible virtual pedestrians. IEEE Computer Graphics and Applications 29, 4, 54-63.
23. ROSE, D., AND CLARKE, T. J. 2009. Look who's talking: Visual detection of speech from whole-body biological motion cues during emotive interpersonal conversation. Perception 38, 1, 153-156.
24. ROUSE, R. 1998. Embrace your limitations - cut-scenes in computer games. ACM SIGGRAPH Computer Graphics 32, 4, 7-9.
25. VILHJáLMSSON, H., AND CASSELL, J. 1998. Bodychat: autonomous communicative behaviors in avatars. In Proceedings of the second international conference on Autonomous agents, 269-276.