Theory of mind as a theoretical prerequisite to model communication with virtual humans

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 4930 LNAI, Issue , 2008, Pages 222-240

  Krämer, Nicole C ^a  

^a UNIVERSITY OF DUISBURG ESSEN   (Germany)

Author keywords

Common ground; Embodied conversational agents; Human computer interaction; Perspective taking; Theory of mind

Indexed keywords

HUMAN COMPUTER INTERACTION; MATHEMATICAL MODELS; USER INTERFACES; VIRTUAL REALITY;

EMBODIED CONVERSATIONAL AGENTS; PERSPECTIVE TAKING; THEORY OF MIND;

COMMUNICATION SYSTEMS;

EID: 43149105946     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-540-79037-2_12     Document Type: Conference Paper

References (106)

1. Cassell, J., Sullivan, J., Prevost, S., Churchill, E. (eds.): Embodied conversational agents. MIT Press, Cambridge (2000)
2. Takeuchi, A., Naito, T.: Situated facial displays: towards social interaction. In: Katz, I., Mack, R., Marks, L., Rosson, M.B., Nielsen, J. (eds.) Human factors in computing Systems: CHI 1995 Conference Proceedings, pp. 450-455. ACM Press, New York (1995)
3. Burgoon, J.K., Bacue, A.E.: Nonverbal communication skills. In: Greene, J.O., Burleson, B.R. (eds.) Handbook of communication and social interaction skills, pp. 179-220. Lawrence Erlbaum Associates, Mahwah (2003)
4. Shannon, C., Weaver, W.: A Mathematical theory of communication. Univ. of Illinois Press (1948)
5. Maturana, H.R., Varela, F.J.: Autopoiesis and cognition. Reidel, Dordrecht (1980)
6. Watzlawick, P., Beavin, J.H., Jackson, D.: Pragmatics of Human Communication. Norton, New York (1967)
7. Nickerson, R.S.: How we know - and sometimes misjudge - what others know: Imputing one's knowledge to others. Psychological Bulletin 125, 737-759 (1999)
8. Nickerson, R.S.: The projective way of knowing: A useful heuristic that sometimes misleads. Current Directions in Psychological Science 10, 168-172 (2001)
9. Clark, H.H.: Using language. Cambridge University Press, Cambridge (1996)
10. Clark, H.H., Brennan, S.A.: Grounding in communication. In: Resnick, L.B., Levine, J.M., Teasley, S.D. (eds.) Perspectives on socially shared cognition, pp. 127-149. APA Books, Washington (1991)
11. Eisenberg, N., Murphy, B.C., Shepard, S.: The development of empathic accuracy. In: Ickes, W. (ed.) Empathic accuracy, pp. 73-116. Guilford Press, New York (1997)
12. Premack, D., Premack, A.J.: Origins of human social competence. In: Gazzaniga, M.S. (ed.) The cognitive neurosciences, pp. 205-218. MIT Press, Cambridge (1995)
13. Premack, D., Woodruff, G.: Does the chimpanzee have a theory of mind? The Behavioral and Brain Sciences 4, 512-526 (1978)
14. Krämer, N.C.: Soziale Wirkungen virtueller Helfer. Gestaltung und Evaluation von Mensch-Computer-Interaktionen, Kohlhammer, Stuttgart (in press)
15. Dehn, D.M., van Mulken, S.: The impact of animated interface agents: a review of empirical research. International Journal of Human-Computer Studies 52, 1-22 (2000)
16. Krämer, N.C.: Social communicative effects of a virtual program guide. In: Panayiotopoulos, T., et al. (eds.) Intelligent Virtual Agents 2005, pp. 442-543. Springer, Hamburg (2005)
17. Ruttkay, Zs., Pelachaud, C.: From Brows to Trust: Evaluating Embodied Conversational Agents. Kluwer, Dordrecht (2004)
18. Krämer, N.C., Nitschke, J.: Ausgabemodalitäten im Vergleich: Verändern sie das Eingabeverhalten der Benutzer? In: Marzi, R., Karavezyris, V., Erbe, H.-H., Timpe, K.-P. (Hrsg.) (eds.) (Hrsg.) Bedienen und Verstehen. 4. Berliner Werkstatt Mensch-Maschine-Systeme, pp. 231-248. VDI-Verlag, Düsseldorf (2002)
19. Krämer, N.C., Bente, G.: Virtuelle Helfer: Embodied Conversational Agents in der Mensch-Computer-Interaktion. In: Bente, G., Krämer, N.C., Petersen, A. (Hrsg.) (eds.) Virtuelle Realitäten, pp. 203-225. Hogrefe, Göttingen (2002)
20. Krämer, N.C., Bente, G., Piesk, J.: The ghost in the machine. The influence of Embodied Conversational Agents on user expectations and user behaviour in a TV/VCR application. In: Bieber, G., Kirste, T. (eds.) IMC Workshop 2003, Assistance, Mobility, Applications, Rostock, pp. 121-128 (2003)
21. Smith, J.: GrandChair: Conversational Collection of Family Stories. Media Lab. MIT, Cambridge (2000)
22. Cassell, J., Bickmore, T.: External manifestations of trustworthiness in the interface. Communications of the ACM 43(12), 50-56 (2000)
23. Kaiser, S., Wehrle, T.: Animating and analyzing facial expressions in human-computer interactions: An appraisal based approach. Paper presented at the ISRE General Meeting, Bari (July 2005)
24. Kaiser, S., Wehrle, T., Schmidt, S.: Emotional episodes, facial expression, and reported feelings in human-computer interactions. In: Fischer, A.H. (ed.) Proceedings of the Xth Conference of the International Society for Research on Emotions, pp. 82-86. ISRE Publications Würzburg (1998)
25. Nass, C., Steuer, J., Tauber, E.R.: Computers are Social Actors. In: Adelson, B., Dumais, S., Olson, J. (eds.) Human Factors in Computing Systems: CHI 1994 Conference Proceedings, pp. 72-78. ACM Press, New York (1994)
26. Oviatt, S.L., Darves, C., Coulston, R.: Toward adaptive Conversational interfaces: Modeling speech convergence with animated personas. ACM Transactions on Computer-Human Interaction 3, 300-328 (2004)
27. Burgoon, J., Stern, L., Dillman, L.: Interpersonal Adaptation: Dyadic Interaction Patterns. Cambridge Univ. Press, Cambridge (1995)
28. Bell, L., Gustafson, J.: Repetition and its phonetic realizations: Investigating a Swedish database of spontaneous computer-directed speech. Proceedings of the International Conference on Phonetic Sciences 2, 1221-1224 (1999)
29. Kopp, S., Gesellensetter, L., Krämer, N.C., Wachsmuth, I.: A conversational agent as a museum, guide. Design and evaluation of a real-world application. In: Panayiotopoulos, T., et al. (eds.) Intelligent Virtual Agents 2005, pp. 329-343. Springer, Heidelberg (2005)
30. Gong, L., Nass, C., Simard, C., Takhteyev, Y.: When non-human is better than semihuman: Consistency in speech interfaces. In: Smith, M., Salvendy, G., Harris, D., Koubek, R. (eds.) Usability Evaluation and Interface Design: Cognitive Engineering, Intelligent Agents and Virtual Reality, LEA, Mahwah, N.J, vol. 1, pp. 390-394 (2001)
31. Krämer, N.C., Simons, N., Kopp, S.: The effects of an embodied conversational agent's nonverbal behavior on user's evaluation and behavioral mimicry. In: Pelachaud, C., et al. (eds.) Intelligent Virtual Agents 2007, pp. 238-251. Springer, Hamburg (2007)
32. Rickenberg, R., Reeves, B.: The effects of animated characters on anxiety, task performance, and evaluations of user interfaces. In: Letters of CHI 2000, pp. 49-56 (April 2000)
33. Heylen, D., Es, I., van, N.A., Dijk, B.: Experimenting with the gaze of a conversational agent. In: van Kuppevelt, J., Dybkjaer, L., Bernsen, N. (eds.) Proceedings of the International CLASS Workshop on Natural, Intelligent and Effective Interaction with Multimodal Dialogue Systems, Kluwer Academic, New York (2002)
34. Cowell, A.J., Stanney, K.M.: Embodiment and interaction guidelines for designing credible, trustworthy embodied conversational agents. In: Rist, T., Aylett, R.S., Ballin, D., Rickel, J. (eds.) IVA 2003. LNCS (LNAI), vol. 2792, pp. 301-309. Springer, Heidelberg (2003)
35. McBreen, H., Jack, M.: Empirical evaluation of animated agents in a multi-modal e-retail application. In: Proceedings of the AAAI Fall Symposium on socially intelligent agents (2000)
36. Buisine, S., Abrilian, S., Martin, J.-C.: Evaluation of multimodal behaviour of agents. Cooperation between speech and gestures in ECAs. In: Ruttkay, Z., Pelachaud, C. (eds.) From Brows to trust. Evaluating Embodied Conversational Agents, pp. 217-238. Kluwer, Dordrecht (2004)
37. Cassell, J., Thorisson, K.R.: The Power of a Nod and a Glance: Envelope vs. Emotional Feedback in Animated Conversational Agents. Applied Artificial Intelligence 13, 519-538 (1999)
38. Krämer, N.C., Tietz, B., Bente, G.: Effects of embodied interface agents and their gestural activity. In: Aylett, R., Ballin, D., Rist, T., Rickel, J. (eds.) 4th International Working Conference on Intelligent Virtual Agents, pp. 292-300. Springer, Hamburg (2003)
39. Krämer, N.C.: Bewegende Bewegung. Sozio-emotionale Wirkungen nonverbalen Verhaltens und deren experimentelle Untersuchung mittels Computeranimation, Pabst, Lengerich (2001)
40. Toby, J., Cosmides, L.: Foreword. In: Baron-Cohen, S. (ed.) Mindblindness. An essay on autism and theory of mind, MIT Press, Cambridge (1995)
41. Clark, H.H.: Arenas of language use. University of Chicago Press, Chicago (1992)
42. Fussell, S.R., Krauss, R.M.: Coordination of knowledge in communication: Effects of audience design on message comprehension: Reference in a common ground framework. Journal of Experimental Social Psychology 25, 203-219 (1992)
43. Krauss, R.M., Fussell, S.R.: Perspective taking in communication: Representation of others' knowledge in reference. Social Cognition 9, 2-24 (1991)
44. Bakhtin, M.M.: Discourse in the novel. In: Holquist, M. (ed.) The dialog imagination, University of Texas Press, Austin (1981)
45. Clark, H.H.: Language use and language users. In: Lindzey, G., Aronson, E. (eds.) Handbook of Social Psychology, pp. 179-231. Random House, New York (1985)
46. Clark, H.H., Marshall, C.E.: Definite reference and mutual knowledge. In: Joshi, A.K., Sag, I., Webber, B. (eds.) Elements of discourse understanding, pp. 10-63. Cambridge University Press, Cambridge (1981)
47. Graumann, C.F., Herrmann, T.: Speakers: The role of the listener, Multilingual Matters, Ltd. Clevedon, UK (1989)
48. Mead, G.H.: Mind, Self and Society. University of Chicago Press, Chicago (1934)
49. Baldwin, J.M.: Social and ethical interpretations of mental development. Macmillan, New York (1906)
50. Kohlberg, L.: Stage and sequence: The cognitive-developmental approach to socialization. In: Goslin, D.A. (ed.) Handbook of socialization theory and research, pp. 347-480. Rand McNally, Chicago (1969)
51. Rommeveit, R.: On message structure: A framework for the study of language and communication. Wiley, New York (1974)
52. Ross, L., Greene, D., House, P.: The false consensus phenomenon: An attributional bias in self-perception and social perception processes. Journal of Experimental Social Psychology 13, 279-301 (1977)
53. Burgoon, J.K., White, C.H.: Researching Nonverbal Message Production: A View from Interaction Adaptation Theory. In: Greene, J.O. (ed.) Message Production, pp. 280-312. Lawrence Erlbaum Ass., Mahwah (1997)
54. Stalnaker, R.C.: Assertion. In: Cole, P. (ed.) Syntax and semantics 9: Pragmatics, pp. 315-332. Academic Press, New York (1978)
55. Karttunen, L., Peters, S.: Conventional implicature of Montague grammar, Paper presented at the Berkeley Linguistics Society, Berkeley, CA (1975)
56. Norman, D.A.: The design of everyday things. Doubleday, New York (1988)
57. Ickes, W.: Empathic accuracy. Journal of Personality 61, 587-610 (1993)
58. Gordon, R.: Folk psychology as simulation. In: Davies, M., Stone, T. (eds.) Folk psychology, vol. 3, pp. 60-73. Blackwell, Oxford, England (1995)
59. Lillard, A.: Ethnopsychologies: Cultural variations in theories of mind. Psychological Bulletin 123, 3-32 (1998)
60. Shantz, C.U.: Social cognition. In: Mussen, P. (ed.) Handbook of child psychology, vol. 3, pp. 495-555. Wiley, New York (1983)
61. Piaget, J.: The language and thought of the child. Harcourt, New York (1921)
62. Goethals, G.F., Allison, S.J., Frost, M.: Perception of the magnitude and diversity of social support. Journal of Experimental Social Psychology 15, 570-581 (1979)
63. Tversky, A., Kahnemann, D.: Judgment under uncertainty: Heuristics and biases. Science 185, 1124-1131 (1974)
64. Clark, H.H., Carlson, T.B.: Context for comprehension. In: Long, J., Baddeley, A. (eds.) Attention and performance IX, pp. 313-330. Lawrence Erlbaum Ass, Hillsdale (1981)
65. Clark, H.H., Haviland, S.E.: Comprehension and the given-new contract. In: Freedle, R.O. (ed.) Discourse production and comprehension, pp. 1-40. Ablex, Norwwod (1977)
66. Ross, M., Holmberg, D.: Recounting the past: Gender differences in the recall of events in the history of a close relationship. In: Olson, J.M., Zanna, M.P. (eds.) Self-inferences processes: The Ontario Symposium, vol. 6, pp. 135-152. Lawrence Erlbaum Ass., Hillsdale (1988)
67. Carruthers, P., Smith, P.K. (eds.): Theories of theories of mind. Cambridge University Press, Cambridge (1996)
68. Whiten, A.: Natural theories of mind: Evolution, development and simulation of everyday mindreading. Basil Blackwell, Oxford (1991)
69. Frith, U., Frith, C.D.: Development of neurophysiology of mentalizing. Phil. Trans. R. Soc. Lond 358, 459-473 (2003)
70. Baron-Cohen, S.: Mindblindness. An essay on autism and theory of mind. MIT Press, Cambridge (1995)
71. Dennett, D.C.: The intentional stance. MIT Press, Cambridge (1987)
72. Sperber, D.: Paper presented at conference on Darwin and the Human Sciences, London School of Economics (1993)
73. Grice, H.P.: Meaning. Philosophical Review 66, 377-388 (1957)
74. Sperber, D., Wilson, D.: Relevance: Communication and Cognition. Blackwell, Malden (1995)
75. David, N., Bewernick, B., Cohen, M.X., Newen, A., Lux, S., Fink, G.R., Shah, N.J., Vogeley, K.: Neural Representations of Self versus Other: Visual-Spatial Perspective-Taking and Agency in a Virtual Ball-Tossing Game. Journal of Cognitive Neuroscience 18, 898-910 (2006)
76. Vogeley, K., Bussfeld, P., Newen, A., Herrmann, S., Happé, F., Falkai, P., Maier, W., Shah, N.J., Fink, G.R., Zilles, K.: Mind Reading: Neural Mechanisms of Theory of Mind and Self-Perspective. NeuroImage 14, 170-181 (2001)
77. Shamay-Tsoory, S.G., Tibi-Elhanany, Y., Aharon-Peretz, J.: The ventromedial prefrontal cortex is involved in understanding affective but not cognitive theory of mind stories. Social Neuroscience 1, 149-166 (2006)
78. Shamay-Tsoory, S.G., Tomer, R., Berger, B.D., Goldsher, D., Aharon-Peretz, J.: Impaired affective theory of mind is associated with right ventromedial prefrontal damage. Cognitive Behavioral Neurology 18, 55-67 (2005)
79. Kalbe, E., Grabenhorst, F., Brand, M., Kessler, J., Hilker, R., Markowitsch, H.J.: Elevated emotional reactivity in affective but not cognitive components of theory of mind: A psychophysiological study. Journal of Neuropsychology 1, 27-38 (2007)
80. Gopnik, A.: How we know our minds: The illusion of first-person knowledge of intentionality. Behavioral and Brain Sciences 16, 1-14 (1993)
81. Wellman, H.M.: The child's theory of mind. MIT Press, Cambridge (1990)
82. Heal, J.: Replication and functionalism. In: Butterfield, J. (ed.) Language, Mind, and Logic, pp. 135-150. Cambridge University Press, Cambridge (1986)
83. Harris, P.L.: Children and emotion: The development of Psychological understanding. Basil Blackwell, Oxford (1989)
84. Gordon, R.M.: Folk psychology as simulation. Mind and Language 1, 158-171 (1986)
85. Humphrey, N.: Consciousness regained. Oxford University Press, Oxford (1984)
86. Gordon, R.M.: "Radical" simulationism. In: Carruthers, P., Smith, P.K. (eds.) Theories of theories of mind, pp. 11-21. Cambridge University Press, Cambridge (1996)
87. Grammer, K., Filova, V., Fieder, M.: The communication paradox and a possible solution: Toward a radical empiricism. In: Schmitt, A., Atzwanger, K., Grammer, K., Schäfer, K. (eds.) New aspects of human ethology, pp. 91-120. Plenum, New York (1997)
88. Gopnik, A.: Theories and modules: creation myths, developmental realities and Neurath's boat. In: Carruthers, P., Smith, P.K. (eds.) Theories of theories of mind, pp. 169-183. Cambridge University Press, Cambridge (1996)
89. Astington, J.: What is theoretical about the child's theory of mind? A Vygotskian view of its development. In: Carruthers, P., Smith, P.K. (eds.) Theories of theories of mind, pp. 184-199. Cambridge University Press, Cambridge (1996)
90. Heal, J.: Simulation, theory, and content. In: Carruthers, P., Smith, P.K. (eds.) Theories of theories of mind, pp. 75-89. Cambridge University Press, Cambridge (1996)
91. Perner, J.: Simulation as explicitation of predication-implicit knowledge about the mind: arguments for a simulation-theory mix. In: Carruthers, P., Smith, P.K. (eds.) Theories of theories of mind, pp. 90-104. Cambridge University Press, Cambridge (1996)
92. Frith, CD., Frith, U.: How we predict what other people are going to do. Brain Research 1079, 36-46 (2006)
93. Minsky, M.L.: A. framework for representing knowledge. In: Winston, P.H. (ed.) The psychology of computer vision, McGraw-Hill, New York (1975)
94. Schank, R.C., Abelson, R.P.: Scripts, plans, goals, and understanding: An inquiry into human knowledge structures. Lawrence Erlbaum Ass., Hillsdale (1977)
95. Marsella, S.C., Pynadath, D.V.: Modeling influence and theory of mind. Artificial Intelligence and the Simulation of Behavior.In: Joint Symposium on Virtual Social Agents, pp. 199-206 (2005)
96. Peters, C.: Designing Synthetic Memory Systems for Supporting Autonomous Embodied Agent Behaviour. In: 15th IEEE International Symposium on Robot and Human Interactive Communication (ROMAN) (2006)
97. Traum, D.A.: Computational Theory of Grounding in Natural Language Conversation. Ph.D. Thesis, Computer Science Dept., U. Rochester (1994)
98. Traum, D.: Conversational Agency: The Trains-93 Dialogue Manager. In: Proceedings of the Twente Workshop on Language Technology 11: Dialogue Management in Natural Language Systems, pp. 1-11 (1996)
99. Traum, D., Dillenbourg, P.: Miscommunication in Multi-modal Collaboration. In: Working notes of the AAAI Workshop on Detecting, Repairing, and Preventing Human-Machine Miscommunication, pp. 37-46 (1996)
100. Breazeal, C., Buchsbaum, D., Gray, J., Gatenby, D., Blumberg, B.: Learning from and about Others: Towards Using Imitation to Bootstrap the Social Understanding of Others by Robots. In: Rocha, L., Almedia e Costa, F. (eds.) Artificial Life, pp. 31-62. MIT Press, Cambridge (2004a)
101. Breazeal, C., Brooks, A., Gray, J., Hoffman, G., Kidd, C., Lee, H., Lieberman, J., Lockerd, A., Mulanda, D.: Humanoid Robots as Cooperative Partners for People. IJHR [24.7.2005] (2004b), Available: http://web.media.mit.edu/ ~cynthiab/NewFiles/pubs.html
102. Cohen, P., Levesque, H.: Teamwork. Nous 25, 487-512 (1991)
103. Cohen, P., Levesque, H.: Persistence, Intention, and Commitment. In: Cohen, P.R., Morgan, J., Pollack, M.E. (eds.) Intentions in Communication, pp. 33-69. MIT Press, Cambridge (1990)
104. Meltzoff, A., Moore, M.K.: Explaining facial imitation: A theoretical model. Early Development and Parenting 6, 179-192 (1997)
105. Rizzolatti, G., Fadiga, L., Matelli, M., Bettinardi, V., Paulesu, E., Perani, D., Fazio, F.: Localization of grasp representations in humans by PET: 1. Observation vs. execution. Experimental Brain Research 111, 246-252 (1996)
106. Williams, J.H., Whiten, A., Suddendorf, T., Perrett, D.: Imitation, mirror neurons and autism. Neuroscience and Biobehavioral Reviews 25, 287-295 (2001)