Mutual stance building in dyad of virtual agents: Smile alignment and synchronisation

Proceedings - 2012 ASE/IEEE International Conference on Privacy, Security, Risk and Trust and 2012 ASE/IEEE International Conference on Social Computing, SocialCom/PASSAT 2012

Volumn , Issue , 2012, Pages 938-943

  Prepin, Ken ^a   Ochs, Magalie ^a   Pelachaud, Catherine ^a  

^a INSTITUT TELECOM   (France)

Author keywords

alignment; dynamical systems; smile; social interaction; stance; synchrony; virtual agent

Indexed keywords

SMILE; SOCIAL INTERACTIONS; STANCE; SYNCHRONY; VIRTUAL AGENT;

DYNAMICAL SYSTEMS; SPEECH COMMUNICATION;

ALIGNMENT;

EID: 84873643129     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SocialCom-PASSAT.2012.134     Document Type: Conference Paper

References (42)

1. S. Garrod and M. J. Pickering, "Why is conversation so easy?" TRENDS in Cognitve Sciences, vol. 8, no. 1, pp. 8-11, 2004
2. K. Scherer, "What are emotions? and how can they be measured?" Social Science Information, vol. 44, no. 4, pp. 695-729, December 2005
3. C. Debras and A. Cienki Some uses of head tilts and shoulder shrugs during human interaction, and their relation to stancetaking Proceedings of the International Workshop of SocialCom 2012 Exploring Stances in Interactions 2012 6 Amsterdam, The Netherlands
4. D. Biber and E. Finegan, "Styles of stance in english: lexical and grammatical marking of evidentiality and affect," Interdisciplinary Journal for the Study of Discourse, vol. 9, no. 1, pp. 93-124, 1989
5. R. Englebretson, Stancetaking in Discourse. Subjectivity, evaluation, interaction, 2007
6. M. B. Paradowski, "The Embodied Language: Why Language Should Not Be Conceived of in Abstraction from the Brain and Body, and the Consequences for Robotics," SSRN eLibrary, 2011
7. A. Kendon, Conducting Interaction: Patterns of Behavior in Focused Encounters, A. Kendon, Ed. Cambridge, UK: Cambridge University Press, 1990
8. V. H. Yngve, "On getting a word in edgewise," C. L. Society, Ed., April 1970, pp. 567-578
9. E. Bevacqua, S. Hyniewska, and C. Pelachaud, "Positive influence of smile backchannels in ecas," in International Workshop on Interacting with ECAs as Virtual Characters (AAMAS 2010), Toronto, Canada, Oct. 2010
10. L. Huang, L.-P. Morency, and J. G. V. R. . I. . 68-79, "Virtual rapport 2.0," in Proceedings of 11th International Conference on Intelligent Virtual Agents:IVA'11, Sept 2011, pp. 68-79
11. W. S. Condon and W. D. Ogston, "Sound film analysis of normal and pathological behavior patterns," Journal of Nervous and Mental Disease, vol. 143, pp. 338-347, 1966
12. E. Tronick, H. Als, L. Adamson, S. Wise, and T. Brazelton, "The infants' response to entrapment between contradictory messages in face-to-face interactions." Journal of the American Academy of Child Psychiatry (Psychiatrics)., vol. 17, pp. 1-13, 1978
13. L. Murray and C. Trevarthen, "Emotional regulation of interactions vetween two-month-olds and their mothers," Social perception in infants, pp. 101-125, 1985
14. J. Nadel and H. Tremblay-Leveau, Early social cognition. Lawrence Erlbaum Associates, 1999, ch. Early perception of social contingencies and interpersonal intentionality: dyadic and triadic paradigms, pp. 189-212
15. M. Chammat, A. Foucher, J. Nadel, and S. Dubal, "Reading sadness beyond human faces," Brain Research, vol. 1348, pp. 95-104, 2010
16. S. Dubal, A. F. R. Jouvent, and J. Nadel, "Human brain spots emotion in non humanoid robots," Social Cognitive and Affective Neuroscience, vol. 6, no. 1, pp. 90-97, 2011
17. E. Hatfield, J. L. Cacioppo, and R. L. Rapson, "Emotional contagion," Current Directions in Psychological Sciences, vol. 2, pp. 96-99, 1993
18. F. J. Bernieri, "Coordinated movement and rapport in teacher-student interactions," Journal of Nonverbal Behavior, vol. 12, no. 2, pp. 120-138, 1988
19. M. LaFrance, "Nonverbal synchrony and rapport: Analysis by the crosslag panel technique," Social Psychology Quarterly, vol. 42, no. 1, pp. 66-70, 1979
20. I. Poggi and C. Pelachaud, "Emotional meaning and expression in animated faces," Lecture Notes in Computer Science, pp. 182-195, 2000
21. K. Prepin and P. Gaussier, "How an agent can detect and use synchrony parameter of its own interaction with a human?" in COST Action2102, Int. Traing School 2009, Active Listening and Synchrony. LNCS 5967, A. E. et al., Ed. Springer-Verlag, Berlin Heidelberg, 2010, pp. 50-65
22. P. Ekman and W. V. Friesen, "Felt, False, And Miserable Smiles," Journal of Nonverbal Behavior, vol. 6, pp. 238-252, 1982
23. M. Rehm and E. André, "Catch me if you can ? Exploring lying agents in social settings," in AAMAS. Academic Press Inc, 2005, pp. 937-944
24. M. Ochs, R. Niewiadmoski, and C. Pelachaud, "How a virtual agent should smile? morphological and dynamic characteristics of virtual agent's smiles," in Intelligent Virtual Agent (IVA), 2010
25. Z. Ambadar, J. F. Cohn, and L. I. Reed, "All Smiles are Not Created Equal: Morphology and Timing of Smiles Perceived as Amused, Polite, and Embarrassed/Nervous," Journal of Nonverbal Behavior, vol. 17-34, pp. 238-252, 2009
26. E. Krumhuber and A. Manstead, "Can Duchenne smiles be feigned? New evidence on felt and false smiles," Emotion, vol. 9, no. 6, pp. 807-820, 2009
27. M. Ochs, R. Niewiadomski, P. Brunet, and C. Pelachaud, "Smiling virtual agent in social context," Cognitive Processing, Special Issue on "Social Agents", 2011
28. K. Prepin and C. Pelachaud, "Shared understanding and synchrony emergence: Synchrony as an indice of the exchange of meaning between dialog partners," in Third International Conference on Agents and Artificial Intelligence, ICAART2011, J. Filipe, Ed. Springer, 2011, pp. 1-10
29. K. Scherer and S. Delplanque, "Emotions, signal processing, and behaviour." Geneva: Firmenich, march 2009
30. D. Sperber and D. Wilson, Relevance: Communication and Cognition. Oxford, UK: Blackwell Publishing, 1986
31. D. Wilson and D. Sperber, Handbook of Pragmatics. Oxford, UK: Blackwell Publishing, 2002, ch. Relevance Theory
32. D. Matsumoto and B. Willingham, "Spontaneous facial expressions of emotion in congenitally and non-congenitally blind individuals," Journal of Personality and Social Psychology, vol. 96, no. 1, pp. 1-10, January 2009
33. K. Prepin and A. Revel, "Human-machine interaction as a model of machine-machine interaction: how to make machines interact as humans do," Advanced Robotics, vol. 21, no. 15, pp. 1709-1723, 2007
34. M. Auvray, C. Lenay, and J. Stewart, "Perceptual interactions in a minimalist virtual environment," New ideas in psychology, vol. 27, pp. 32-47, 2009
35. M. Black, A. Katsamanis, C.-C. Lee, A. C. Lammert, B. R. Baucom, A. Christensen, P. G. Georgiou, and S. S. Narayanan, "Automatic classification of married couples' behavior using audio features," in 11th Annual Conference of the International Speech Communication Association, INTERSPEECH-2010, Makuhari, Chiba, Japan, 2010, pp. 2030-2033
36. B. Vaughan, "Prosodic synchrony in co-operative task-based dialogues: A measure of agreement and disagreement," in 12th Annual Conference of the International Speech Communication Association, INTERSPEECH-2011, Florence, Italy, 2012, pp. 1865-1868
37. K. Prepin and C. Pelachaud, "Live generation of interactive non-verbal behaviours," in 11th International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2012, Conitzer, Winikoff, Padgham, and van der Hoek, Eds. IFAAMAS, 2012, pp. 1-2
38. J. Gratch, A. Okhmatovskaia, F. Lamothe, S. Marsella, M. Morales, R. J. Werf, and L.-P. Morency, "Virtual rapport," in Proceedings of 6th International Conference on Intelligent Virtual Agents:IVA'06, Sept 2006, pp. 14-27
39. J. Nadel, M. Simon, P. Canet, R. Soussignan, P. Blancard, L. Canamero, and P. Gaussier, "Human responses to an expressive robot," in Proceedings of the Sixth International Workshop on Epigenetic Robotics, Lund University, 2006, pp. 79-86
40. A. Kappas, U. Hess, and K. R. Scherer, Fundamentals of Nonverbal Behavior, 1991, ch. Voice and emotion, pp. 200-233
41. P. Ekman, W. Friesen, and J. Hager, Facial Action Coding Sysem, 2002
42. K. Prepin and C. Pelachaud, "Effect of time delays on agents' interaction dynamics," in The Tenth International Conference on Autonomous Agents and Multi Agents Systems, AAMAS2011, Tumer, Yolum, Sonenberg, and Stone, Eds. IFAAMAS, 2011, pp. 1-8.