Towards visual and vocal mimicry recognition in human-human interactions

Conference Proceedings - IEEE International Conference on Systems, Man and Cybernetics

Volumn , Issue , 2011, Pages 367-373

  Sun, Xiaofan ^a   Truong, Khiet P ^a   Pantic, Maja ^a,b   Nijholt, Anton ^a  

^a UNIVERSITY OF TWENTE   (Netherlands)

^b IMPERIAL COLLEGE LONDON   (United Kingdom)

Author keywords

human behavior analysis; human human interaction; interpersonal synchrony; mimicry representation; visual mimicry; vocal mimicry

Indexed keywords

HUMAN BEHAVIORS; HUMAN-HUMAN INTERACTIONS; INTERPERSONAL SYNCHRONY; MIMICRY REPRESENTATION; VISUAL MIMICRY; VOCAL MIMICRY;

CYBERNETICS; FACE RECOGNITION; FEATURE EXTRACTION; HUMAN COMPUTER INTERACTION;

BEHAVIORAL RESEARCH;

EID: 83755196234     PISSN: 1062922X     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICSMC.2011.6083693     Document Type: Conference Paper

References (36)

1. F.J. Bernieri, : Coordinated movement and rapport in teacher student interactions. Journal of Nonverbal Behavior, vol. 12, no. 2, pp. 120-138, 1998.
2. F.J. Bernieri, J.S. Reznick, R. Rosenthal : Synchrony, pseudosynchrony, and dissynchrony: Measuring the entrainment process in mother-infant interactions. Journal of Personality and Social Psychology, vol. 54, no. 2, pp. 243-253, 1988.
3. T.L. Chartrand, and R. van Baaren, Chapter 5 Human Mimicry. Academic Press, pp. 219-274, 2009.
4. T.L. Chartrand, J.A. Bargh : The chameleon effect: the perception-behavior link and social interaction. Journal of Personality and Social Psychology, vol. 76, no. 6, pp. 893-910, 1999.
5. T.L. Chartrand, V.E. Jefferis : Consequences of automatic goal pursuit and the case of nonconscious mimicry. Philadelphia: Psychology Press, pp. 290-305, 2003.
6. T.L. Chartrand, W. Maddux, J.L. Lakin : Beyond the perception behavior link: The ubiquitous utility and motivational moderators of nonconscious mimicry. New York: Oxford University Press, pp. 334-361, 2005.
7. H. Giles, P.F. Powesland, : Speech style and social evaluation. London: Academic Press, 1975.
8. N. Gueguen, C. Jacob, A. Martin : Mimicry in social interaction: Its effect on human judgment and behavior. European Journal of Sciences, vol. 8, no. 2, pp. 253-259, 2009.
9. U. Hess, S.Blairy : Facial mimicry and emotional contagion to dynamic emotional facial expressions and their influence on decoding accuracy. Int J Psychophysiology, vol. 40, no. 2, pp. 129-141, 2001. (Pubitemid 32109244)
10. V. E. Jefferis, R. van Baaren, T. L. Chartrand : The functional purpose of mimicry for creating interpersonal closeness. Manuscript, The Ohio State University, 2003.
11. S. Kopp : Social resonance and embodied coordination in face-to- face conversation with artificial interlocutors. Speech Communication, vol. 52, no. 6, pp. 587-597, 2010.
12. M. LaFrance : Nonverbal synchrony and rapport: Analysis by the cross-lag panel technique. Social Psychology Quarterly, vol. 42, no. 1, pp. 66-70, 1979.
13. J. L. Lakin, T. L. Chartrand, and R. M. Arkin : Exclusion and nonconscious behavioral mimicry: Mimicking others to resolve threatened belongingness needs. Manuscript, 2004.
14. J.L. Lakin, V.E. Jefferis, C.M.Cheng, T.L. Chartrand : The chameleon effect as social glue: Evidence for the evolutionary significance of nonconscious mimicry. Journal of Nonverbal Behavior, vol. 27, no. 3, pp. 145-162, 2003.
15. L.K. Miles, L.K. Nind, C.N. Macrae,: The rhythm of rapport: Interpersonal synchrony and social perception. Journal of Experimental Social Psychology, vol. 45, no. 3, pp. 585-589, 2009.
16. A. Briassouli and I. Kompatsiaris, Robust temporal activity templates using higher order statistics., IEEE Transactions on Image Processing, vol. 18, no. 12, pp. 2756-2768, 2009.
17. V. H. Chandrashekhar and K. S. Venkatesh, Action energy images for reliable human action recognition, in Proceedings of the Asian Symposium on Information Display (ASID '06), pp. 484-487, October, 2006.
18. C. Nagaoka, M. Komori, T. Nakamura and M.R.Draguna : Effects of receptive listening on the congruence of speakers' response latencies in dialogues. Psychological Reports 97, 265-274, 2005. (Pubitemid 41625281)
19. A. F. Bobick and J. W. Davis, The recognition of human movement using temporal templates, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 23, no. 3, pp. 257-267, 2001.
20. E. Shechtman and M. Irani, Matching local self-similarities across images and videos, in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '07), pp. 1-8, Minneapolis, Minn, USA, June 2007.
21. N. Dalal and B. Triggs, Histograms of oriented gradients for human detection, in Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '05), vol. 1, pp. 886-893, San Diego, Calif, USA, June 2005.
22. H. Giles, Accent mobility: A model and some data. Anthropological Linguistics, 15, 87-105, 1973.
23. H. Giles, A Study of Speech Patterns in Social Interaction: Acccent Evaluation and Accent Change,PhD Thesis, University of Bristol.
24. Dekens, Tomas. Demol, Mike. Verhelst, Werner .Verhoeve, Piet: A comparative study of speech rate estimation techniques, 510-513.
25. N. H. de Jong, and T. Wempe, Automatic measurement of speech rate in spoken Dutch. ACLC Working Papers, 2(2), 51-60, 2007.
26. A. L. Gonzales, J. T. hancock, and J. W. Pennebaker, Language Style Matching as a Predictor of Social Dynamics in Small Groups. Communication Research, vol. 37, 3-19, 2010.
27. J. T. Webb, Interview synchrony: An investigation of two speech rate measures in an automated standardized interview, in B. Pope and A.W. Siegman (Eds.), Studies in dyadic communication (pp. 115-133), New York: Pergamon, 1972.
28. J. N. Cappella and S. Palnap, Talk and silence sequences in informal conversations III: Interspeaker influence, Human Communication Research, 7, 117-132, 1981.
29. J. D. Matarazzo, A. N. Weins, R. G. Matarazzo, and G. Saslow, Speech and silence behavior in clinical psychotherapy and its laboratory correlates, in J. Schlier, H. Hunt, J. D. Matarazzo, and C. Savage (Eds.). Research in psychotherapy (pp. 347-394), Washington, DC: American Psychological Association, 1968.
30. E. Couper-Kuhlen, The prosody of repetition: On quoting and mimicry, in: E. Couper-Kuhlen and Margret Selting, eds., Prosody in Conversation: Interactional studies, Cambridge: Cambridge University Press, 366-405, 1996.
31. J. Jaffe and S. Feldstein, Rhythms of dialogue, New York, NY: Academic, 1970.
32. M. Natale, Convergence of mean vocal intensity in dyadic communications as a function of social desirability, Journal of Personality and Social Psychology, 32, 790-804, 1975.
33. J. S. Gillis, F. J. Bernieri, and E. Wooten, The effects of stimulus medium and feedback on the judgment of rapport, Organizational Behavior and Human Decision Processes, 63, 33-45, 1995.
34. J. E. Grahe and F. J. Bernieri, Self-awareness of judgment policies of rapport, Personality and Social Psychology Bulletin, 28, 1407-1418, 2002.
35. P. Boersma and D. Weenink, Praat, a System for Doing Phonetics by Computer, Glot International, 5(9/10), 341-345, 2001.
36. R. Banse and K. R. Scherer, Acoustic Profiles in Vocal Emotion Expression, Journal of Personality and Social Psychology, 70, 614-636, 1996. (Pubitemid 126420699)