Modeling the production of coverbal iconic gestures by learning bayesian decision networks

Applied Artificial Intelligence

Volumn 24, Issue 6, 2010, Pages 530-551

  Bergmann, Kirsten ^a   Kopp, Stefan ^a  

^a BIELEFELD UNIVERSITY   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

LEARNING ALGORITHMS; LEARNING SYSTEMS;

BAYESIAN DECISION NETWORKS; DISCOURSE CONTEXT; HUMAN COMMUNICATIONS; ICONIC GESTURES; LEARN+; MACHINE LEARNING TECHNIQUES; MODELING RESULTS; SPATIAL DOMAINS; SPATIAL INFORMATIONS; VIRTUAL AGENT;

BAYESIAN NETWORKS;

EID: 77954436119     PISSN: 08839514     EISSN: 10876545     Source Type: Journal    
DOI: 10.1080/08839514.2010.492162     Document Type: Article

References (35)

1. Bavelas, J., J. Gerwing, C. Sutton, and D. Prevost. 2008. Gesturing on the telephone: Independent effects of dialogue and visibility. Journal of Memory and Language 58:495-520.
2. Bergmann, K., and S. Kopp 2009a. GNetIc-Using bayesian decision networks for iconic gesture generation. In: Proceedings of the 9th International Conference on Intelligent Virtual Agents, eds. Z. Ruttkay, M. Kipp, A. Nijholt, and H. Vilhjalmsson, 76-89. Berlin/Heidelberg: Springer.
3. Bergmann, K., and S. Kopp. 2009b. Increasing expressiveness for virtual agents-Autonomous generation of speech and gesture in spatial description tasks. In: Proceedings of the 8th International Conference on Autonomous Agents and Multiagent Systems, eds. K. Decker, J. Sichman, C. Sierra, and C. Castelfranchi, 361-368. Budapest, Hungary. Richland, SC: IFAAMAS.
4. Bergmann, K., and S. Kopp. 2010. Systematicity and idiosyncrasy in iconic gesture use: Empirical analysis and computational modeling. In: Gesture in Embodied Communication and Human-Computer Interaction, eds. S. Kopp, and I. Wachsmuth. Berlin/Heidelberg: Springer.
5. Cassell, J., M. Stone, and H. Yan. 2000. Coordination and context-dependence in the generation of embodied conversation. In: Proceedings of the First International Conference on Natural Language Generation, 171-178. Morristown, NJ: Association for Computational Linguistics.
6. Cooper, G. F., and E. Herskovits. 1992. A Bayesian method for the induction of probabilistic networks from data. Machine Learning Journal 9:308-347.
7. Dale, R., and J. Viethen. 2009. Referring expression generation through attribute-based heuristics. In: Proceedings of the 12th European Workshop on Natural Language Generation, eds. E. Krahmer, and M. Theune, 58-65. Athens, Greece: Association for Computational Linguistics.
8. de Ruiter, J. 2007. Postcards from the mind: The relationship between speech, imagistic gesture, and thought. Gesture 7(1):21-38.
9. Hartmann, B., M. Mancini, and C. Pelachaud. 2006. Implementing expressive gesture synthesis for embodied conversational agents. In: Gesture in Human-Computer Interaction and Simulation, eds. S. Gibet, N. Courty, and J.-F. Kamp, 45-55. Berlin/Heidelberg: Springer.
10. Hostetter, A., and M. Alibali. 2007. Raise your hand if you're spatial-Relations between verbal and spatial skills and gesture production. Gesture 7(1):73-95.
11. Howard, R., and J. Matheson. 2005. Influence diagrams. Decision Analysis 2(3):127-143.
12. Huenerfauth, M. 2008. Spatial, temporal and semantic models for American Sign Language generation: Implications for gesture generation. International Journal of Semantic Computing 2(1):21-45.
13. Kendon, A. 2004. Gesture-Visible Action as Utterance. Cambridge, UK: Cambridge University Press.
14. Kimbara, I. 2006. On gestural mimicry. Gesture 6(1):39-61.
15. Kontkanen, P., P. Myllymäki, T. Silander, and H. Tirri. 1997. Comparing predictive inference methods for discrete domains. In: Proceedings of the 6th International Workshop on Artificial Intelligence and Statistics, 311-318. Ft. Lauderdale, Florida.
16. Kopp, S., P. Tepper, and J. Cassell. 2004. Towards integrated microplanning of language and iconic gesture for multimodal output. In: Proceedings of the 6th International Conference on Multimodal Interfaces, 97-104. New York: ACM Press.
17. Kopp, S., P. Tepper, K. Ferriman, K. Striegnitz, and J. Cassell. 2007. Trading spaces: How humans and humanoids use speech and gesture to give directions. In: Conversational Informatics, ed. T. Nishida, 133-160. New York: John Wiley.
18. Kopp, S., and I. Wachsmuth. 2004. Synthesizing multimodal utterances for conversational agents. Computer Animation and Virtual Worlds 15(1):39-52.
19. Lauritzen, S. L. 1995. The EM algorithm for graphical association models with missing data. Computational Statistics and Data Analysis 19:191-201.
20. Lücking, A., K. Bergmann, F. Hahn, S. Kopp, and H. Rieser. 2010. The Bielefeld speech and gesture alignment corpus (SaGA). In: Proceedings of the LREC 2010 Workshop on Multimodal Corpora, eds. M. Kipp, J.-C. Martin, P. Paggio, and D. Heylen. Paris, France: European Language Resources Association.
21. Madigan, D. and J. York. 1995. Bayesian graphical models for discrete data. International Statistical Review 63:215-232.
22. Madsen, A., F. Jensen, U. Kjærulff, and M. Lang. 2005. HUGIN-The tool for bayesian networks and influence diagrams. International Journal of Artificial Intelligence Tools 14(3):507-543.
23. McNeill, D. 2005. Gesture and Thought. Chicago: University of Chicago Press.
24. Morency, L.-P., I. de Kok, and J. Gratch. 2010. A probabilistic multimodal approach for predicting listener backchannels. Journal of Autonomous Agents and Multi-Agent Systems 20(1):70-84.
25. Müller, C. 1998. Redebegleitende Gesten: Kulturgeschichte-Theorie- Sprachvergleich. Berlin: Berlin Verlag.
26. Murphy, K. 2001. The bayes net toolbox for MATLAB. Computing Science and Statistics 33:61-70.
27. Neff, M., M. Kipp, I. Albrecht, and H.-P. Seidel. 2008. Gesture modeling and animation based on a probabilistic re-creation of speaker style. ACM Transactions on Graphics 27(1):1-24.
28. Ruttkay, Z. 2007. Presenting in style by virtual humans. In: Verbal and Nonverbal Communication Behaviours, ed. A. Esposito, 23-36. Berlin: Springer Verlag.
29. Schwarz, G. E. 1978. Estimating the dimension of a model. Annals of Statistics 6(2):461-464.
30. Sowa, T. and I. Wachsmuth. 2005. A model for the representation and processing of shape in coverbal iconic gestures. In: Proceedings of KogWis05, 183-188. Basel: Schwabe.
31. Spirtes, P., and C. Glymour. 1991. An algorithm for fast recovery of sparse causal graphs. Social Science Computing Review 9(1):62-72.
32. Steck, H. and V. Tresp. 1999. Bayesian belief networks for data mining. In: Proceedings of the 2nd Workshop on Data Mining and Data Warehousing, 145-154. Magdeburg, Germany: Magdeburg University.
33. Stone, M., D. DeCarlo, I. Oh, C. Rodriguez, A. Stere, A. Lees, and C. Bregler. 2004. Speaking with hands: Creating animated conversational characters from recordings of human performance. In: Proceedings of SIGGRAPH '04, ACM Transactions on Graphics 23(3):506-513.
34. Streeck, J. 2008. Depicting by gesture. Gesture 8(3):285-301.
35. Yu, Q. and D. Terzopoulos. 2007. A decision network framework for the behavioral animation of virtual humans. In: Proceedings of SIGGRAPH '07, 119-128. Switzerland: Eurographics Association.