A multimodal analysis of vocal and visual backchannels in spontaneous dialogs

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn , Issue , 2011, Pages 2973-2976

  Truong, Khiet P ^a   Poppe, Ronald ^a   De Kok, Iwan ^a   Heylen, Dirk ^a  

^a UNIVERSITY OF TWENTE   (Netherlands)

Author keywords

Backchannel; Continuer; Gaze; Head nod; Listener response; Pitch; Prediction; Vocalization

Indexed keywords

BACK CHANNELS; CONTINUER; GAZE; HEAD NOD; LISTENER RESPONSE; PITCH; VOCALIZATION;

FORECASTING; TELEPHONE;

TELEPHONE SETS;

EID: 84865741845     PISSN: None     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (15)

1. V. H. Yngve, "On getting a word in edgewise," in Papers from the Sixth Regional Meeting of Chicago Linguistic Society. Chicago Linguistic Society, 1970, pp. 567-577.
2. S. Duncan Jr., "On the structure of speaker-auditor interaction during speaking turns," Language in Society, vol. 3, no. 2, pp. 161-180, 1974.
3. N. Ward and W. Tsukahara, "Prosodic features which cue backchannel responses in English and Japanese," Journal of Pragmatics, vol. 32, no. 8, pp. 1177-1207, 2000.
4. A. Gravano and J. Hirschberg, "Backchannel-inviting cues in task-oriented dialogue," in Proceedings of Interspeech, 2009, pp. 1019-1022.
5. N. Cathcart, J. Carletta, and E. Klein, "A shallow model of backchannel continuers in spoken dialogue," in Proceedings of EACL, 2003, pp. 51-58.
6. H. Koiso, Y. Horiuchi, S. Tutiya, A. Ichikawa, and Y. Den, "An analysis of turn-taking and backchannels based on prosodic and syntactic features in Japanese Map Task dialogs," Language and Speech, vol. 41, no. 3-4, pp. 295-321, 1998.
7. A. T. Dittmann and L. G. Llewellyn, "Relationship between vocalizations and head nods as listener responses," Journal of Personality and Social Psychology, vol. 9, no. 1, pp. 79-84, 1968.
8. J. Allwood and L. Cerrato, "A study of gestural feedback expressions," in Proceedings of the First Nordic Symposium on Multimodal Communication, 2003, pp. 7-22.
9. L.-P. Morency, I. de Kok, and J. Gratch, "A probabilistic multimodal approach for predicting listener backchannels," Autonomous Agents and Multi-Agent Systems, vol. 20, pp. 70-84, 2010.
10. R. Bertrand, G. Ferré, P. Blache, R. Espesser, and S. Rauzy, "Backchannels revisited from a multimodal perspective," in Proceedings of AVSP, 2007.
11. R. J. J. H. van Son, W. Wesseling, E. Sanders, and H. van den Heuvel, "The IFADV corpus: a free dialog video corpus," in Proceedings of LREC, 2008, pp. 501-508.
12. K. P. Truong, R. Poppe, and D. Heylen, "A rule-based backchannel prediction model using pitch and pause information," in Proceedings of Interspeech, 2010, pp. 3058-3061.
13. P. Boersma and D. Weenink, "Praat, a system for doing phonetics by computer," Glot International, vol. 5, no. 9/10, pp. 341-345, 2001.
14. A. Kendon, "Some functions of gaze-direction in social interaction," Acta Psychologica, vol. 26, pp. 22-63, 1967.
15. R. Poppe, K. P. Truong, and D. K. J. Heylen, "Backchannels: quantity, type and timing matters," in Proceedings of IVA, 2011, to appear.