Social resonance and embodied coordination in face-to-face conversation with artificial interlocutors

Speech Communication

Volumn 52, Issue 6, 2010, Pages 587-597

  Kopp, Stefan ^a  

^a BIELEFELD UNIVERSITY   (Germany)

Author keywords

Coordination; Embodied conversational agents; Gesture; Social Resonance

Indexed keywords

COORDINATION; EMBODIED CONVERSATIONAL AGENT; FACE-TO-FACE COMMUNICATIONS; FACE-TO-FACE CONVERSATION; FLEXIBLE MODULES; HUMANOID ROBOT; MUTUAL ADAPTATION; TOPDOWN;

ANTHROPOMORPHIC ROBOTS;

RESONANCE;

EID: 77951142168     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2010.02.007     Document Type: Article

References (62)

1. Allwood J., Nivre J., and Ahlsén E. On the semantics and pragmatics of linguistic feedback. Journal of Semantics 9 (1992) 1-26
2. Amit, R., Mataric, M., 2002. Learning movement sequences from demonstration. In: Proceedings of the Second International Conference on Development and Learning (ICDL'02), pp. 203-208.
3. Bailenson J.N., Yee N., Patel K., and Beall A.C. Detecting digital chameleons. Computers in Human Behavior 24 (2008) 66-87
4. Bergmann, K., Kopp, S., 2009a. Genetic - using bayesian decision networks for iconic gesture generation. In: Intelligent Virtual Agents, LNAI 5773. Springer-Verlag, pp. 76-89.
5. Bergmann, K., Kopp, S., 2009b. Increasing expressiveness for virtual agents - autonomous generation of speech and gesture. In: Proceedings of AAMAS 2009, pp. 361-368.
6. Bernieri F., and Rosenthal R. Coordinated movement in human interaction. In: Feldman, and Rime (Eds). Fundamentals of Nonverbal Behavior (1991), Cambridge University Press, New York 401-432
7. Bernieri F.J., Davis J.M., Rosenthal R., and Knee C.R. Interactional synchrony and rapport: measuring synchrony in displays devoid of sound and facial affect. Personality and Social Psychology Bulletin 20 3 (1994) 303-311
8. Bertenthal B.I., Longo M.R., and Kosobud A. Imitative response tendencies following observation of intransitive actions. Journal of Experimental Psychology: Human Perception and Performance 32 2 (2006) 210-225
9. Bickmore, T., 2003. Relational Agents: Effecting Change through Human-Computer Relationships. Ph.D. Thesis. Massachusetts Institute of Technology.
10. Bickmore, T., Schulman, D., 2006. The comforting presence of relational agents. In: Proceedings of CHI 2006, pp. 550-555.
11. Billard A. Imitation: a means to enhance learning of a synthetic proto-language in an autonomous robot. In: Dautenhahn K., and Nehaniv C. (Eds). Imitation in Animals and Artifacts (2002), MIT Press, Cambridge, MA 281-310
12. Branigan, H., Pickering, M., Pearson, J., McLean, J., 2010. Linguistic alignment between humans and computers. Journal of Pragmatics, in press. Available online 6 February 2010.
13. Breazeal C., Buchsbaum D., Gray J., Gatenby D., and Blumberg B. Learning from and about others: toward using imitation to bootstrap the social understanding of others by robots. Artificial Life 11 1-2 (2005) 31-62
14. Brennan S., and Clark H. Lexical choice and conceptual pacts in conversation. Journal of Experimental Psychology: Learning, Memory and Cognition 22 6 (1996) 1482-1493
15. Buschmeier, H., Bergmann, K., Kopp, S., 2009. An alignment-capable microplanner for natural language generation. In: 12th Eur. Workshop on Natural Language Generation, pp. 82-89.
16. Cassell, J., Bickmore, T., 2001. A relational agent: a model and implementation of building user trust. In: Proceedings of CHI'01, pp. 396-403.
17. Cassell, J., Stone, M., Yan, H., 2000a. Coordination and context-dependence in the generation of embodied conversation. In: Proceedings of the First International Conference on Natural Language Generation, pp. 171-178.
18. In: Cassell J., Sullivan J., Prevost S., and Churchill E. (Eds). Embodied Conversational Agents (2000), MIT Press, Cambridge, MA
19. Cassell, J., Gill, A., Tepper, P., 2007. Coordination in conversation and rapport. In: ACL Workshop on Embodied Language Processing, pp. 40-50.
20. Chartrand T., and Bargh J. The chameleon effect: the perception-behavior link and social interaction. Journal of Personality and Social Psychology 76 (1999) 893-910
21. Clark H.H. Using Language (1996), Cambridge University Press
22. Condon W.S., and Ogston W.D. Sound-film analysis of normal and pathological behavior patterns. Journal of Nervous and Mental Disease 143 (1960) 338-347
23. Duncan, S., Franklin, A., Parrill, F., Welji, H., 2007. Cognitive processing effects of 'social resonance' in interaction. In: Proceedings Gesture 2007 - The Conference of the International Society of Gesture Studies, Evanston, IL.
24. Finkel E., Campbell W., Brunell A., Dalton A., Scarbeck S., and Chartrand T. High-maintenance interaction: inefficient social coordination impairs self-regulation. Journal of Personality and Social Psychology 91 3 (2006) 456-475
25. Gallese V., Keysers C., and G. R. A unifying view of the basis of social cognition. Trends in Cognitive Science 8 (2004) 396-403
26. Gärdenfors, P., 1996. Human communication: what happens? In: Reichert, B. (Ed.), The Contribution of Science and Technology to the Development of Human Society.
27. Giles H. Accomodation theory: some new directions. In: DeSilva S. (Ed). Aspects of Linguistic Behaviour: A Festschrift in Honour of Robert Le Page (1980), University of York Press 105-136
28. Giles H., and Coupland N. Language: Contexts and Consequences (1991), Wadsworth Publishing, Belmond, CA
29. Gratch, J., Okhmatovskaia, A., Lamothe, F., Marsella, S., Morales, M., van der Werf, R., Morency, P.-L., 2006. Virtual rapport. In: Proceedings of IVA '06, LNAI 4133. Springer-Verlag, pp. 14-27.
30. In: Hall J., and Bernieri F. (Eds). Interpersonal Sensitivity (2001), Lawrence Erlbaum Assoc., Mahwah, NJ
31. Hamilton A., and Grafton S.T. The motor hierarchy: from kinematics to goals and intentions. In: Rosetti Y., Kawato M., and Haggard P. (Eds). Attention and Performance Vol. 22 (2008), Oxford University Press
32. Hsee C.K., Hatfield E., Carlson J., and Chemtob C. The effect of power on susceptibility to emotional contagion. Cognition and Emotion 4 (1990) 327-340
33. Kang, S.-H., Gratch, J., Wang, N., Watt, J., 2008. Does contingency of agents' nonverbal feedback affect users' social anxiety? In: Proceedings of International Conference on Autonomous Agents and Multiagent Systems (AAMAS '08), pp. 120-127.
34. Kendon A. The role of visible behavior in the organization of social interaction. In: Cranach M., and Vine I. (Eds). Social Communication and Movement (1973), Wiley, London 29-74
35. Kimbara I. On gestural mimicry. Gesture 6 1 (2005) 39-61
36. Kopp S., and Wachsmuth I. Synthesizing multimodal utterances for conversational agents. Computer Animation and Virtual Worlds 15 1 (2004) 39-52
37. Kopp, S., Tepper, P., Cassell, J., 2004. Towards integrated microplanning of language and iconic gesture for multimodal output. In: Proceedings of the International Conference on Multimodal Interfaces (ICMI'04), pp. 97-104.
38. Kopp, S., Gesellensetter, L., Krämer, N., Wachsmuth, I., 2005. A conversational agent as museum guide - design and evaluation of a real-world application. In: Intelligent Virtual Agents, LNAI 3661. Springer-Verlag, pp. 329-345.
39. Krämer N.C. Social effects of virtual assistants. A review of empirical results with regard to communication. In: Prendinger H., Lester J., and Ishizuka M. (Eds). Intelligent Virtual Agents (2008), Springer-Verlag 507-508
40. Lakin J., Jefferis V., Cheng C., and Chartrand T. The chameleon effect as social glue: evidence for the evolutionary significance of nonconscious mimicry. Nonverbal Behavior 27 3 (2003) 145-162
41. Lakin J., Chartrand T., and Arkin R. I am too just like you: nonconscious mimicry as an automatic behavioral response to social exclusion. Psychological Science 19 8 (2008) 816-822
42. McNeill D. Hand and Mind - What Gestures Reveal about Thought (1992), University of Chicago Press, Chicago
43. Miles L., Nind L., and Macrae C. The rhythm of rapport: interpersonal synchrony and social perception. Journal of Experimental Social Psychology (2009) 585-589
44. Montgomery K., Isenberg N., and Haxby J. Communicative hand gestures and object-directed hand movements activated the mirror neuron system. Social Cognitive and Affective Neuroscience 2 (2007) 114-122
45. Pickering M.J., and Garrod S. Toward a mechanistic psychology of dialogue. Behavioral and Brain Sciences 27 (2004) 169-226
46. Press C., Gillmeister H., and Heyes C. Bottom-up, not top-down, modulation of imitation by human and robotic models. European Journal of Neuroscience 24 (2006) 2415-2419
47. Reddy M. The conduit metaphor - a case of frame conflict in our language about language. In: Ortony A. (Ed). Metaphor and Thought (1979), Cambridge University Press, Cambridge, UK 284-297
48. Reeves B., and Nass C.I. The media equation: how people treat computers, television and new media like real people and places (1996), Cambridge University Press
49. Rizzolatti G., Fogassi L., and Gallese V. Neurophysiological mechanisms underlying the understanding and imitation of action. Nature Reviews Neuroscience 2 (2001) 661-670
50. Sadeghipour, A., Kopp, S., 2009. A probabilistic model of motor resonance for embodied gesture perception. In: Intelligent Virtual Agents, LNAI 5773. Springer-Verlag, pp. 80-103.
51. Scheflen A.E. The significance of posture in communication systems. Psychiatry 27 (1964) 316-321
52. Scheflen A. Comments on the significance of interaction rhythms. In: Davis M. (Ed). Interaction Rhythms (1982), Human Sciences Press 13-22
53. Shockley K., Santana M., and Fowler C.A. Mutual interpersonal postural constraints are involved in cooperative conversation. Journal of Experimental Psychology: Human Perception and Performance 29 (2003) 326-332
54. Shon, A., Storz, J., Rao, R., 2007. Towards a real-time bayesian imitation system for a humanoid robot. In: 2007 IEEE International Conference on Robotics and Automation, pp. 2847-2852.
55. Sowa, T., Wachsmuth, I., 2005. A model for the representation and processing of shape in coverbal iconic gestures. In: Proceedings of the KogWis05. Schwabe, Basel, pp. 183-188.
56. Stronks, B., Nijholt, A., van der Vet, P., Heylen, D., 2002. Friendship relations with embodied conversational agents: integrating social psychology in ECA design. In: Proceedings CHI'02 Workshop Philosophy and Design of Socially Adept Technologies, pp. 25-28.
57. Tickle-Degnen L., and Rosenthal R. The nature of rapport and its nonverbal correlates. Psychological Inquiry 1 4 (1990) 285-293
58. Traum, D., Allen, J., 1992. A "speech acts" approach to grounding in conversation. In: Second International Conference on Spoken Language Processing (ICSLP'92), pp. 137-140.
59. Uldall, B., Hall, C., Chartrand, T.L., in preparation. Optimal distinctiveness theory and mimicry: when being distinct leads to an affiliation goal and greater nonconscious mimicry, Ohio State University.
60. Wallbott H.G. Congruence, contagion, and motor mimicry: mutualities in nonverbal exchange. In: Markova I., Graumann C.F., and Foppa K. (Eds). Mutualities in Dialogue (1995), Cambridge University Press 82-98 (Chapter 4)
61. Wilson M., and Knoblich G. The case for motor involvement in perceiving conspecifics. Psychological Bulletin 131 (2005) 460-473
62. Yngve, V., 1970. On getting a word in edgewise. In: Papers from the 6th Regional Meeting of the Chicago Linguistics Society. University of Chicago, pp. 567-578.