Predicting listener backchannels: A probabilistic multimodal approach

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 5208 LNAI, Issue , 2008, Pages 176-190

  Morency, Louis Philippe ^a   De Kok, Iwan ^b   Gratch, Jonathan ^a  

^a University of Southern California   (United States)

^b UNIVERSITY OF TWENTE   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

FLOW INTERACTIONS; FORECASTING; HIDDEN MARKOV MODELS; INTELLIGENT AGENTS; MARKOV PROCESSES; MATHEMATICAL MODELS; PROBABILITY;

AUTOMATIC SELECTION; CONDITIONAL RANDOM FIELDS; EYE GAZE; FACE-TO-FACE INTERACTIONS; FEATURE REPRESENTATION; HIDDEN MARKOV MODELING; HUMAN INTERACTIONS; INTELLIGENT VIRTUAL AGENTS; INTERNATIONAL CONFERENCES; MULTI-MODAL APPROACH; MULTIMODAL OUTPUT; PREDICTION MODELING; PROBABILISTIC MODELLING; SPOKEN WORDS; VIRTUAL HUMANS;

VIRTUAL REALITY;

EID: 52149113331     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-540-85483-8_18     Document Type: Conference Paper

References (29)

1. Drolet, A., Morris, M.: Rapport in conflict resolution: accounting for how face-to-face contact fosters mutual cooperation in mixed-motive conflicts. Experimental Social Psychology 36, 26-50 (2000)
2. Goldberg, S.: The secrets of successful mediators. Negotiation Journal 21(3), 365- 376 (2005)
3. Tsui, P., Schultz, G.: Failure of rapport: Why psychotheraputic engagement fails in the treatment of asian clients. American Journal of Orthopsychiatry 55, 561-569 (1985)
4. Fuchs, D.: Examiner familiarity effects on test performance: implications for training and practice. Topics in Early Childhood Special Education 7, 90-104 (1987)
5. Burns, M.: Rapport and relationships: The basis of child care. Journal of Child Care 2, 47-57 (1984)
6. Cassell, J., Vilhjlmsson, H., Bickmore, T.: Beat: The behavior expressive animation toolkit. In: Proceedings of the SIGGRAPH (2001)
7. Lee, J., Marsella, S.: Nonverbal behavior generator for embodied conversational agents. In: Gratch, J., Young, M., Aylett, R.S., Ballin, D., Olivier, P. (eds.) IVA 2006. LNCS (LNAI), vol. 4133, pp. 243-255. Springer, Heidelberg (2006)
8. Kipp, M., Neff, M., Kipp, K., Albrecht, I.: Toward natural gesture synthesis: Evaluating gesture units in a data-driven approach. In: Pélachaud, C., Martin, J.-C., André, E., Chollet, G., Karpouzis, K., Pelé, D. (eds.) IVA 2007. LNCS (LNAI), vol. 4722, pp. 15-28. Springer, Heidelberg (2007)
9. Thiebaux, M., Marshall, A., Marsella, S., Kallmann, M.: Smartbody: Behavior realization for embodied conversational agents. In: AAMAS (2008)
10. Morency, L.P., Sidner, C., Lee, C., Darrell, T.: Contextual recognition of head gestures. In: ICMI (October 2005)
11. Demirdjian, D., Darrell, T.: 3-d articulated pose tracking for untethered deictic reference. In: Int'l Conf. on Multimodal Interfaces (2002)
12. Heylen, D., Bevacqua, E., Tellier, M., Pelachaud, C.: Searching for prototypical facial feedback signals. In: Pélachaud, C., Martin, J.-C., André, E., Chollet, G., Karpouzis, K., Pelé, D. (eds.) IVA 2007. LNCS (LNAI), vol. 4722, pp. 147-153. Springer, Heidelberg (2007)
13. Kopp, S., Stocksmeier, T., Gibbon, D.: Incremental multimodal feedback for conversational agents. In: Pélachaud, C., Martin, J.-C., André, E., Chollet, G., Kar-pouzis, K., Pelé, D. (eds.) IVA 2007. LNCS (LNAI), vol. 4722, pp. 139-146. Springer, Heidelberg (2007)
14. Ward, N., Tsukahara, W.: Prosodic features which cue back-channel responses in english and japanese. Journal of Pragmatics 23, 1177-1207 (2000)
15. Gratch, J., Wang, N., Gerten, J., Fast, E.: Creating rapport with virtual agents. In: Pélachaud, C., Martin, J.-C., André, E., Chollet, G., Karpouzis, K., Pelé, D. (eds.) IVA 2007. LNCS (LNAI), vol. 4722. Springer, Heidelberg (2007)
16. Jónsdóttir, G.R., Gratch, J., Fast, E., Thórisson, K.R.: Fluid semantic back-channel feedback in dialogue: Challenges and progress. In: Pélachaud, C., Martin, J.-C., André, E., Chollet, G., Karpouzis, K., Pelé, D. (eds.) IVA 2007. LNCS (LNAI), vol. 4722. Springer, Heidelberg (2007)
17. Allwood, J.: Dimensions of Embodied Communication - towards a typology of embodied communication. In: Embodied Communication in Humans and Machines, Oxford University Press, Oxford
18. Yngve, V.: On getting a word in edgewise. In: Proceedings of the Sixth regional Meeting of the Chicago Linguistic Society (1970)
19. Bavelas, J., Coates, L., Johnson, T.: Listeners as co-narrators. Journal of Personality and Social Psychology 79(6), 941-952 (2000)
20. Nishimura, R., Kitaoka, N., Nakagawa, S.: A spoken dialog system for chat-like conversations considering response timing. In: Matoušek, V., Mautner, P. (eds.) TSD 2007. LNCS (LNAI), vol. 4629, pp. 599-606. Springer, Heidelberg (2007)
21. Cathcart, N., Carletta, J., Klein, E.: A shallow model of backchannel continuers in spoken dialogue. In: European ACL, pp. 51-58 (2003)
22. Anderson, H., Bader, M., Bard, E., Doherty, G., Garrod, S., Isard, S., Kowtko, J., McAllister, J., Miller, J., Sotillo, C., Thompson, H., Weinert, R.: The mcrc map task corpus. Language and Speech 34(4), 351-366 (1991)
23. Fujie, S., Ejiri, Y., Nakajima, K., Matsusaka, Y., Kobayashi, T.: A conversation robot using head gesture recognition as para-linguistic information. In: RO-MAN, pp. 159-164 (September 2004)
24. Maatman, M., Gratch, J., Marsella, S.: Natural behavior of a listening agent. In: Panayiotopoulos, T., Gratch, J., Aylett, R.S., Ballin, D., Olivier, P., Rist, T. (eds.) IVA 2005. LNCS (LNAI), vol. 3661. Springer, Heidelberg (2005)
25. Kang, S.H., Gratch, J., Wang, N., Watt, J.: Does the contingency of agents' nonverbal feedback affect users' social anxiety? In: AAMAS (2008)
26. Rabiner, L.R.: A tutorial on hidden Markov models and selected applications in speech recognition. Proceedings of the IEEE 77(2), 257-286 (1989)
27. Lafferty, J., McCallum, A., Pereira, F.: Conditional random fields: probabilistic models for segmenting and labelling sequence data. In: ICML (2001)
28. Igor, S., Petr, S., Pavel, M., Luk, B., Michal, F., Martin, K., Jan, C.: Comparison of keyword spotting approaches for informal continuous speech. In: MLMI (2005)
29. hCRF library, http://sourceforge.net/projects/hcrf/