Generating listening behaviour

Cognitive Technologies

Volumn , Issue 9783642151835, 2011, Pages 321-347

  Heylen, Dirk ^a   Bevacqua, Elisabetta ^b   Pelachaud, Catherine ^c   Poggi, Isabella ^d   Gratch, Jonathan ^e   Schröder, Marc ^f  

^a UNIVERSITY OF TWENTE   (Netherlands)

^b UNIVERSITÉ PARIS 8   (France)

^c INSTITUT TELECOM   (France)

^d ROMA TRE UNIVERSITY   (Italy)

^e UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^f GERMAN RESEARCH CENTER FOR ARTIFICIAL INTELLIGENCE DFKI   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

BACK CHANNELS; CONVERSATIONAL AGENTS; FACE-TO-FACE CONVERSATION; JOINT ACTIVITY; NON-VERBAL SIGNALS; REAL TIME; REALTIME PROCESSING;

EID: 85028861265     PISSN: 16112482     EISSN: None     Source Type: Book Series    
DOI: 10.1007/978-3-642-15184-2_17     Document Type: Chapter

References (86)

1. Allwood J (1993) Feedback in second language acquisition. In: Perdue C. (edi) Adult language acquisition. Cross linguistic perspectives. Cambridge University Press, Cambridge, NY, pp 196-232
2. Allwood J, Cerrato L (2003) A study of gestural feedback expressions. In: Paggio P, Jokinen K, Jonsson A. (eds) First nordic symposium on multimodal communication, Copenhagen, 23-24 September, pp 7-22
3. Allwood J, Nivre J, Ahlsén E (1992) On the semantics and pragmatics of linguistic feedback. Semantics 9(1):1-26
4. Ambady N, Bernieri FJ, Richeson JA (2000) Toward a histology of social behavior = Judgment accuracy from thin slices of the behavioral stream. Academic, San Diego, CA, pp 201-271
5. Austin JA (1962) How to do things with words. Oxford University Press, London
6. Bailenson JN, Yee N (2005) Digital chameleons = automatic assimilation of nonverbal gestures in immersive virtual environments. Psychol Sci 16:814-819
7. Bakhtin M (1999) The problem of speech genres. In: Jaworski A, Coupland N. (eds) The discourse reader. Routledge
8. Bavelas JB, Chovil N (1997) Faces in dialogue. In: Russell J, Fernandez-Dols JM, (ed) The psychology of facial expressions. Cambridge University Press, Cambridge, pp 334-346
9. Bavelas JB, Coates L, Johnson T (2000) Listeners as co-narrators. J Pers Soc Psychol 79(6): 941-952
10. Bernieri FJ, Rosenthal R (1991) Interpersonal coordination, behavior matching and interactional synchrony. In: Feldman RS, Rimé B, (ed) Fundamentals of nonverbal behavior. Cambridge University Press, Cambridge
11. Bevacqua E, Heylen D, Pelachaud C, Tellier M (2007) Facial feedback signals for ECAs. In: Proceedings of AISB’07: artificial and ambient intelligence, Newcastle University, Newcastle upon Tyne, UK, April 2007
12. Bouhuys AL, van den Hoofdakker RH (1991) The interrelatedness of observed behavior of depressed patients and of a psychiatrist. An ethological study on mutual influence. J Affect Disorders 23:63-74
13. Brand M (1999) Voice puppetry. In: ACM SIGGRAPH. ACM Press/Addison-Wesley, New York, NY
14. Breazeal C, Aryananda L (2002) Recognition of affective communicative intent in robot-directed speech. Autono Robots 12:83-104
15. Burgoon J, Hale J (1987) Validation and measurement of the fundamental themes of relational communication. Commun Monogr 54:19-41
16. Burns M (1984) Rapport and relationships. The basis of child care. J Child Care 2:47-57
17. Capella JN (1990) On defining conversational coordination and rapport. Psychol Inquiry 1(4): 303-305
18. Cassell J, Thorisson KR (1999) The power of a nod and a glance, envelope vs. emotional feedback in animated conversational agents. Int J Appl Artif Intell 13(4-5):519-538
19. Cassell J, Bickmore T, Billinghurst M, Campbell L, Chang K, Vilhjalmsson H, Yan H (1999) Embodiment in conversational interfaces. Rea. In: Conference on human factors in computing systems, Pittsburgh, PA, pp 520-527
20. Castelfranchi C (2000) Affective appraisal versus cognitive evaluation in social emotions and interactions. In: Paiva A, (ed) Affective interactions. Towards a new generation of computer interfaces. Springer, Berlin
21. Cauldwell R (2000) Where did the anger go? The role of context in interpreting emotion in speech. In: Proceedings of the ISCA workshop on speech and emotion, Northern Ireland, pp 127-131
22. Chartrand TL, Bargh JA (1999) The chameleon effect, the perception-behavior link and social interaction. J Personal Soc Psychol 76(6):893-910
23. Chovil N (1991) Social determinants of facial displays. J Nonverbal Behav 15:141-154
24. Clark H, Krych MA (2004) Speaking while monitoring addressees for understanding. J Mem Lang 50:62-81 Clark.Krych.04.pdf
25. Clark H, Schaefer E (1991) Contributing to discourse. Cogn Sci 13:259-294
26. Clark HH (1996) Using language. Cambridge University Press, Cambridge
27. Cogger JW (1982) Are you a skilled interviewer? Personnel J 61:840-843
28. Condon WS, Ogston WD (1966) Sound film analysis of normal and pathological behavior patterns. J Nerv Dis 143(4):338-347
29. Drolet AL, Morris MW (2000) Rapport in conflict resolution = accounting for how face-to-face contact fosters mutual cooperation in mixed-motive conflicts. Exp Soc Psych 36:26-50
30. Duncan S, Fiske DW (1977) Face-to-face Interaction. Erlbaum, Hillsdale NJ
31. Duncan SD, Niederehe G (1974) On signalling that its your turn to speak. J Exp Soc Psychol 10:234-47
32. Ekman P (1977) Biological and cultural contributions to body and facial movement. In: Blacking J, (ed) The anthropology of the body. Academic, London, pp 39-84
33. Ekman P (1979) About brows: emotional and conversational signals. In: Cranach von M, Foppa K, Lepenies W, Ploog D, (ed) Human ethology. Cambridge University Press/Editions de la Maison des Sciences del’Homme, Cambridge, pp 169-202
34. Fuchs D (1987) Examiner familiarity effects on test performance, implications for training and practice. Top Early Child Spec Educ 7:90-104
35. Goffman E (1976) Replies and responses. Lang Soc 5(3):2257-313
36. Goodwin C (1984) Notes on story structure and the organization of participation. In: Atkinson MJ, Heritage J, (ed) Structures of social action. studies in conversation analysis. Cambridge University Press, Cambridge, pp 225-246
37. Grahe JE, Bernieri FJ (1999) The importance of nonverbal cues in judging rapport. J Nonverbal Behav 23:253-269
38. Gratch J, Okhmatovskaia A, Duncan S (2006a) Virtual humans for the study of rapport in cross cultural settings. In: 25th army science conference, Orlando, FL, 27-30 November 2006
39. Gratch J, Okhmatovskaia A, Lamothe F, Marsella S, Morales M, van der Werf R, Morency LP (2006b) Virtual rapport. In: 6th international conference on intelligent virtual agents, Springer, Berlin Marina del Rey, CA
40. Gratch J, Wang N, Gerten J, Fast E (2007a) Creating rapport with virtual agents. In: 7th international conference on intelligent virtual agents, Paris, France, 2007a
41. Gratch J, Wang N, Okhmatovskaia A, Lamothe F, Morales M, van der Weif R, Morency L-P (2007b) Can virtual humans be more engaging than real ones? In 12th international conference on human-computer interaction, Beijing, China
42. Grice HP (1975a) Logic and conversation. In: Cole P, Morgan JL, (ed) Syntax and semantics: Vol 3: speech acts. Academic, San Diego, CA, pp 41-58
43. Grice HP (1975b) Meaning. Phil Rev 66(3):377-388
44. Gumperz J (1982) Discourse strategies. Cambridge University Press, Cambridge, England
45. Hadar U, Steiner TJ, Rose CF (1985) Head movement during listening turns in conversation. J Nonverbal Behav 9(4):214-228
46. Hall J, Bernieri F. (ed) Interpersonal sensitivity. LEA, Mahwah, NJ
47. Heylen D (2007) Multimodal backchannel generation for conversational agents. In: Proceedings of the workshop on multimodal output generation (MOG 2007), University of Twente, 2007. CTIT Series, p 8192, 25-26 January 2007
48. Heylen D, Bevacqua E, Tellier M, Pelachaud C (2007a) Searching for prototypical facial feedback signals. In: Proceedings of the 7th international conference on intelligent virtual agents, Paris, France, 17-19 September, pp 147-153
49. Heylen D, Nijholt A, Poel M (2007b) Generating nonverbal signals for a sensitive artificial listener. In: Esposito A, Faunder-Zanny M, Keller E, Marinaro M. (ed) Verbal and nonverbal communication behaviours, Lecture notes in computer science. Springer, Berlin, pp 264-274
50. Jefferson G (1984) Notes on a systematic deployment of the acknowledgement tokens ‘yeah’ and ‘mm hm’. Papers in Linguistics, 17:197-206
51. Jonsdottir GR, Gratch J, Fast E, Thórisson KR (2007) Fluid semantic back-channel feedback in dialogue: challenges and progress. In Proceedings of the 7th international conference on intelligent virtual agents, Paris, France, 17-19 September, pp 154-160
52. Kallmann M, Marsella S (2005) Hierarchical motion controllers for real-time autonomous virtual humans. In: Intelligent virtual agents, Kos, Greece, 2005. Springer, Berlin
53. Kendon A (1970) Movement coordination in social interaction: some examples described. Acta Psychol 32:100-125
54. Kendon A (1967) Some functions of gaze direction in social interaction. Acta Psychol 26:22-63
55. Kraut RE, Lewis SH, Swezey LW (1982) Listener responsiveness and the coordination of conversation. J Pers Soc Psychol 43(4):718-731
56. LaFrance M (1979) Nonverbal synchrony and rapport: analysis by the cross-lag panel technique. Soc Psychol Quart 42(1):66-70
57. Lafrance M, Ickes W (1981) Posture mirroring and interactional involvement: sex and sex typing effects. J nonverb behav 5:139-154
58. Lakin JL, Jefferis VA, Cheng CM, Chartrand TL (2003) Chameleon effect as social glue, evidence for the evolutionary significance of nonconscious mimicry. J Nonverb Behav 27(3):145-162
59. McClave EZ (2000) Linguistic functions of head movements in the context of speech. Journal of Pragmatics, 32:855-878
60. Morency L-P, Sidner C, Lee C, Darrell T (2005) Contextual recognition of head gestures. In: 7th international conference on multimodal interactions, Torento, Italy, 4-6 October 2005, pp 18-24
61. Oppenheim AV, Schafer RW (2004) From frequency to quefrency. A history of the cepstrum. IEEE Signal Process Mag September:95-106
62. Pelachaud C, Bilvi M (2003) Computational model of believable conversational agents. In: Huget M-P (ed) Communication in multiagent systems, vol 2650 of Lecture notes in computer science. Springer, Berlin, pp 300-317
63. Pertaub D-P, Slater M, Barker C (2001) An experiment on public speaking anxiety in response to three different types of virtual audience. Presence Teleoperators and Virtual Environ 11(1): 68-78
64. Poggi I (2007) Minds, hands, face and body. Weidler Buchverlag, Berlin
65. Poggi I, Germani M (2003) Emotions at work. In: International conference on human aspects of advanced manufacturing: agility and hybrid automation, Rome, Italy, 27-30 May 2003, pp 461-468
66. Rosenfeld HM (1987) Conversational control functions of nonverbal behavior. In: Siegman AW, Feldstein S (eds) Nonverbal behavior and communication. Lawrence Erlbaum Associates, Hillsdale NY, pp 563-601
67. Rosenfeld HM, Hancks M (1980) The nonverbal context of verbal listener responses. In: Key MR (ed) The relationship of verbal and nonverbal communication. Mouton, The Hague, pp 193-206
68. Sacks H, Schegloff EA, Jefferson G (1974) A simplest systematics for the organization of turn-taking for conversation. Language 50:696-735
69. Schegloff EA (1982) Discourse as interactional achievement: some uses of “uh huh” and other things that come between sentences. In: Tannen D. (ed) Analyzing discourse, text, and talk. Georgetown University Press, Washington, DC, pp 71-93
70. Schegloff EA, Sacks H (1973) Opening up closings. Semiotica 8:289-327
71. Scherer K (1994) Affect bursts. In: van Goozen SHM, van de Poll NE, Sergeant JA. (ed) Emotions: Essays on emotion theory. Lawrence Erlbaum, Hillsdale, NJ, pp 161-193
72. Schröder M (2003) Experimental study of affect bursts. Speech Commun SpecialIssue Speech a Emot 40(1-2):99-116
73. Schröder M, Heylen D, Poggi I (2006) Perception of non-verbal emotional listener feedback. In: Proceedings of speech prosody 2006, Dresden, Germany, 2-5 May 2006
74. Searle JR (1969) Speech acts: an essay in the philosophy of language. Cambridge University Press, Cambridge
75. Sidner CL, Lee C (2007) Attentional gestures in dialogues between people and robots. In: Nishida T (ed) Conversational informatics. Wiley, New York, NY
76. Sonnby-Borgstrom M, Jonsson P, Svensson O (2003) Emotional empathy as related to mimicry reactions at different levels of information processing. J Nonverb Behav 27(1):3-23
77. Tatar D (1997) Social and personal consequences of a preoccupied listener. PhD thesis, Department of Psychology, Stanford University, Stanford, CA
78. Thórisson KR (1996) Communicative Humanoids: a computational model of psycho-social dialogue skills. PhD thesis, Massachusetts Institute of Technology
79. Tickle-Degnen L, Rosenthal R (1990) The nature of rapport and its nonverbal correlates. Psychol Inquiry 1(4):285-293
80. Tosa N (1993) Neurobaby. In: SIGGRAPH-93 visual proceedings, tomorrow’s realities, ACM, pp 212-213
81. Trouvain J (2004) Non-verbal vocalisations - the case of laughter. Paper presented at Evolution of Language: Fifth International Conference, 2004. Max Planck Institute for Evolutionary Anthropology, Leipzig, Germany, 31 March - 3 April 2004
82. Trouvain J, Schröder M (2004) How (not) to add laughter to synthetic speech. In: Proceedings of Workshop on affective dialogue systems, Kloster Irsee, Germany, 14-16 June 2004, pp 229-232
83. Tsui P, Schultz GL (1985) Failure of rapport. Why psychotherapeutic engagement fails in the treatment of Asian clients. Am J Orthopsychiatry, 55:561-569
84. Vilhjalmsson H, Cantelmo N, Cassell J, Chafai NE, Kipp M, Kopp S, Mancini M, Marsella S, Marshall AN, Pelachaud C, Ruttkay ZS, Thorisson KR, van Welbergen H, van der Werf R (2007) The behavior markup language, recent developments and challenges. In: International conference on intelligent virtual agents, Paris, France, 2007. Springer, Berlin
85. Ward N, Tsukahara W (2000) Prosodic features which cue back-channel responses in English and Japanese. J Pragmatics 23:1177-1207
86. Yngve VH (1970) On getting a word in edgewise. In: Papers from the sixth regional meeting of the Chicago Linguistic Society. Chicago Linguistic Society, Chicago, IL, pp 567-577