Automatic understanding of affective and social signals by multimodal mimicry recognition

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 6975 LNCS, Issue PART 2, 2011, Pages 289-296

  Sun, Xiaofan ^a   Nijholt, Anton ^a   Truong, Khiet P ^a   Pantic, Maja ^a,b  

^a UNIVERSITY OF TWENTE   (Netherlands)

^b IMPERIAL COLLEGE LONDON   (United Kingdom)

Author keywords

affective computing; embodied conversational agent; mimicry behavior encoding; Mimicry detection; mimicry expression classification; mimicry expression information extraction; social signal processing

Indexed keywords

AFFECTIVE COMPUTING; EMBODIED CONVERSATIONAL AGENT; INFORMATION EXTRACTION; MIMICRY BEHAVIOR ENCODING; MIMICRY DETECTION; MIMICRY EXPRESSION CLASSIFICATION; SOCIAL SIGNALS; AFFECT RECOGNITION; AUTOMATIC UNDERSTANDING; HUMAN MACHINE INTERACTION; INTERPERSONAL ATTITUDES; SOCIAL INTERACTIONS; SOCIAL SIGNAL PROCESSING;

GESTURE RECOGNITION; INTELLIGENT COMPUTING; MAN MACHINE SYSTEMS; SIGNAL PROCESSING; CLASSIFICATION (OF INFORMATION); HUMAN COMPUTER INTERACTION; SOCIAL SCIENCES;

ECONOMIC AND SOCIAL EFFECTS;

EID: 80054842243     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-24571-8_32     Document Type: Conference Paper

References (15)

1. Chartrand, T.L., Bargh, J.A.: The chameleon effect: The perception-behavior link and social interaction. Journal of Personality and Social Psychology 76, 893-910 (1999)
2. Bernieri, F.J.: Coordinated movement and rapport in teacher-student interactions. Journal of Nonverbal Behavior 12, 120-138 (1988)
3. Chartrand, T.L., Jefferis, V.E.: Consequences of automatic goal pursuit and the case of nonconscious mimicry. In: Forgas, J.P., Williams, K.D., von Hippel, W. (eds.) Responding to the Social World: Implicit and Explicit Processes in Social Judgments and Decisions, pp. 290-305. Psychology Press, Philadelphia (2003)
4. Dijksterhuis, A.: Automatic social influence: The perception-behavior link as an explanatory mechanism for behavior matching. In: Forgas, J.P., Williams, K.D. (eds.) Social Influence: Direct and Indirect Processes, pp. 95-108. Psychology Press, Philadelphia (2001)
5. Dijksterhuis, A., Bargh, J.A.: The perception-behavior expressway: Automatic effects of social perception on social behavior. In: Zanna, M. (ed.) Advances in Experimental Social Psychology, pp. 1-40. Academic Press, San Diego (2001) (Pubitemid 33804394)
6. Gueguen, N., Jacob, C., Martin, A.: Mimicry in social interaction: Its effect on human judgment and behavior. European Journal of Sociences 8 (2009)
7. Lakin, J.L., Chartrand, T.L.: Using nonconscious behavioral mimicry to create affiliation and rapport. Psychological Science 14, 334-339 (2003)
8. Lakin, J.L., Jefferis, V.E., Cheng, C.M., Chartrand, T.L.: The Chameleon Effect as social glue: Evidence for the evolutionary significance of nonconscious mimicry. Journal of Nonverbal Behavior 27, 145-162 (2003)
9. Huang, H.H., Cerekovic, A., Tarasenko, K., Levacic, V., Zoric, G., Pandzic, I.S., Nakano, Y., Nishida, Y.: Integration embodied conversational agent components with generic framework. Multiagent and Grid Systems-An Interational Journal 4, 371-386 (2008)
10. Kopp, S.: Social resonance and embodied coordination in face-to- face conversation with artificial interlocutors. Speech Communication 52(6), 587-597 (2010)
11. Pantic, M., Nijholt, A., Plentland, A., Huang, T.S.: Human-Centred Intelligent Human-Computer Interaction (HCI2)): how far are we from attaining it? Journal of Autonomous and Adaptive Communications Systems 1(2), 168-187 (2008)
12. Sun, X.F., Lichtenauer, J., Valstar, M., Nijholt, A., Pantic, M.: A Multimodal Database for Mimicry Analysis. In: D'Mello, S., et al. (eds.) ACII 2011, Part I, vol. 6974, pp. 367-376. Springer, Heidelberg (2011)
13. Sun, X.F., Truong, K., Nijholt, A., Pantic, M.: Automatic Visual Mimicry Expression Analysis in Interpersonal Interaction. In: Fourth IEEE Workshop on CVPR for Human Communicative Behavior Analysis, Held in Conjunction with CVPR 2011, Colorado Springs, USA (to appear, 2011)
14. Sun, X.F., Nijholt, A., Pantic, M.: Towards Mimicry Recognition during Human Interactions: Automatic Feature Selection and Representation. In: Proceedings 4th International ICST Conference on Intelligent Technologies for Interactive Entertainment (INTETAIN 2011), Genoa, Italy, May 25-27 (to appear, 2011)
15. Sun, X.F., Truong, K.P., Pantic, M., Nijholt, A.: Towards Visual and Vocal Mimicry Recognition in Human-Human Interactions. In: Proceedings 2011 IEEE International Conference on Systems, Man, and Cybernetics (IEEE SMC 2011), Special Session on Social Signal Processing, Anchorage, Alaska, October 9-12 (to appear, 2011)