Mind model for multimodal communicative creatures and humanoids

Applied Artificial Intelligence

Volumn 13, Issue 4-5, 1999, Pages 449-486

  Thórisson, Kristinn R ^a,b  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b Humanoid   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMMUNICATION; COMPUTER SIMULATION; HUMAN COMPUTER INTERACTION; SOFTWARE PROTOTYPING; SPEECH; USER INTERFACES;

COMMUNICATIVE COMPUTER AGENTS; REAL TIME TASK ORIENTED DIALOG SKILLS;

ARTIFICIAL INTELLIGENCE;

EID: 0344286008     PISSN: 08839514     EISSN: 10876545     Source Type: Journal    
DOI: 10.1080/088395199117342     Document Type: Article

References (72)

1. Adler, R. 1989. Blackboard systems. In The encyclopedia of artificial intelligence, 2nd ed., ed. S. C. Shapiro, 110-116. New York: Wiley Interscience.
2. Agre, P., and D. Chapman. 1987. Pengi: An implementation of a theory of activity. In Proc. 6th AAAI, 268-272.
3. Albus, J., H. McCain, and R. Lumia. 1987. NASA/NBS Standard Reference Model for Telerobot Control System Architecture (NASREM), Technical Report Technical Note 1235, National Bureau of Standards, Gaithersburg, Md.
4. Arbib, M. A. 1992. Schema theory. In The encyclopedia of artificial intelligence, 2nd ed., ed. S. C. Shapiro, 1427-1443. New York: Wiley Interscience.
5. Badler, N. I., C. B. Phillips, and B. L. Webber. 1993. Simulating humans: Computer graphics animation and control. New York: Oxford University Press.
6. Bates, J., A. Loyall, and W. S. Reilly. 1994. An architecture for action, emotion, and social behavior. In Artificial social systems: Fourth European workshop on modelling autonomous agents in a multiagent world. New York: Springer-Verlag.
7. Bers, J. 1995. Directing animated creatures through gesture and speech. Master’s thesis, Media Arts and Sciences, Massachusetts Institute of Technology, Cambridge, Mass.
8. Bers, J. 1996. A body model server for human motion capture and representation. Presence: Teleoperators Virtual Environ. 5(3):381-392.
9. Blumberg, B. M. 1996. Old tricks, new dogs: Ethology and interactive creatures. Ph.D. thesis, Media Laboratory, Massachusetts Institute of Technology, Cambridge, Mass.
10. Blumberg, B. M., and T. A. Galyean. 1995. Multi-level direction of autonomous creatures for real-time virtual environments. Proc. SIGGRAPH ’95, 47-54.
11. Bolt, R. A. 1987. The integrated multi-modal interface. Trans. Inst. Electron. Inf. Commun. Eng. Jpn. J79-D(11):2017-2025.
12. Brooks, R., and L. A. Stein. 1993. Building brains for bodies. MIT Artificial Intelligence Laboratory Memo No. 1439, August.
13. Brown, G. J., and M. Cooke. 1994. Computational auditory scene analysis. Comput. Speech Language 8:297-336.
14. Bryson, J., and B. McGonigle. 1998. Agent architecture as object oriented design. In The Fourth International Workshop on Agent Theories, Architecture and Languages (ATAL ’97), eds. M. P. Singh, A. S. Rao, and M. J. Wooldridge.New York: Spring-Verlag.
15. Cassell, J., and K. R. Thorisson. This issue. The power of a nod and a glance: Envelope vs. emotional feedback in animated conversational agents. Applied Artificial Intelligence.
16. Cassell, J., M. Stone, B. Douville, S. Prevost, B. Achorn, M. Steedman, N. Badler, and C. Pelachaud. 1994. Modeling the interaction between speech and gesture. In Sixteenth Annual Conference of the Cognitive Science Society, Atlanta, Georgia, August 13-16,153-158.
17. Chin, D. N. 1991. Intelligent interfaces as agents. In Intelligent user interfaces, eds. J. W. Sullivan and S. W. Tyler, 177-206. New York: Addison-Wesley.
18. Clark, H. H. 1992. Arenas of language use. Chicago, Ill.: University of Chicago Press.
19. Clark, H. H., and S. E. Brennan. 1990. Grounding in communication. In Perspectives on socially shared cognition, eds. L. B. Resnick, J. Levine, and S. D. Bahrend, 127-149. American Psychological Association.
20. Dean, T. L. 1987. Intractability and time-dependent planning. In Proceedings of the 1986 Workshop on reasoning About Actions and Plans, eds. M. P. Georgeff and A. L. Lansky. Los Altos, Calif.: Morgan Kaufmann.
21. Digital Equipment Corporation. 1985. DECtalk and DTC03 text-to-speech system owner’s manual. Bedford, Mass.: Digital Equipment Corporation.
22. Duncan, S., Jr. 1972. Some signals and rules for taking speaking turns in conversations. J. Personality Soc. Psych. 23(2):283-292.
23. Ekman, P., and W. Friesen. 1969. The repertoire of non-verbal behavior: Categories, origins, usage, and coding. Semiotica 1:49-98.
24. Ekman, P., and W. Friesen. 1978. Facial action coding system. Palo Alto, Calif.: Consulting Psychologists Press.
25. Engelmore, R., and T. Morgan (eds.): 1988. Blackboardsystems. Wokingham, England: Addison-Wesley.
26. Essa, I. A., T. Darrell, and A. Pentland. 1994. Modeling and interactive animation of facial expression using vision. MIT Media Laboratory Perceptual Computing Section Technical Report No. 256.
27. Fehling, M. R., A. M. Altman, and B. M. Wilber. 1989. The heuristic control virtual machine: An implementation of the schemer computational model of reflective, real-time problem-solving. In Blackboard architectures and applications, eds. Jagannathan, R. Dodhiawala, and L. S. Buam, 191-218. Boston, Mass.: Academic Press.
28. Goodwin, C. 1981. Conversational organization: Interaction between speakers and hearers. New York: Academic Press.
29. Goodwin, C. 1986. Gestures as a resource for the organization of mutual orientation. Semiotica 62(1/2):29-49.
30. Grice, H. P. 1989. Studies in the way of words. Cambridge, Mass.: Harvard University Press.
31. Grosz, B. J., and C. L. Sidner. 1986. Attention, intentions, and the structure of discourse. Comput. Linguistics 12(3):175-204.
32. Hayes-Roth, B., F. Hayes-Roth, S. Rosenschein, and S. Cammarata. 1988. Modeling planning as an incremental, opportunistic process. In Blackboard systems, eds. R. Engelmore and T. Morgan, 231-245. Reading, Mass.: Addison-Wesley.
33. International MIDI Association. 1983. MIDI: Musical instrument digital interface specification 1.0. North Hollywood, Calif.: International MIDI Association.
34. Kahneman, D. 1973. Attention and effort. Englewood Cliffs, N.J.: Prentice-Hall.
35. Kleinke, C. 1986. Gaze and eye contact: A research review. Psych. Bull. 100(1):78-100.
36. Laird, J. E., and P. S. Rosenbloom. 1995. The evolution of the soar cognitive architecture. In Mind matters: Contributions to cognitive and computer science in honor of Allen Newell, eds. D. Steier and T. Mitchell. Hillsdale, N.J.: Lawrence Earlbaum Associates.
37. Laurel, B. 1990. Interface agents: Metaphors with character. In The art of human-computer interface design, ed. B. Laurel, 355-365. Reading, Mass.: Addison-Wesley.
38. Litman, D. J. 1996. Cue phrase classification using machine learning. J. Artificial Intelligence Res., 5:53-94.
39. Logall, B. A., and J. Bates. 1993. Real-time control of animated broad agents. Proc. Of the 15th Annual Conf. ofthe Cognitive Science Society, June, Boulder, Colorado.
40. Maes, P. 1989. How to do the right thing. AI Memo No. 1180, December, Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Cambridge, Mass.
41. Maes, P. 1990. Designing autonomous agents: Theory and practice from biology to engineering and back. In Designing autonomous agents, ed. P. Maes, 1-2. Cambridge, Mass.: MIT Press.
42. Maes, P., T. Darrell, B. Blumberg, and A. Pentland. 1995. The ALIVE system: Full-body interaction with autonomous agents. IEEE Comput. Spec. Issue Virtual Environ., 11-18.
43. McNeill, D. 1992. Hand and mind: What gestures reveal about thought. Chicago, Ill.: University of Chicago Press.
44. Nespolous, J.-L., and A. R. Lecours. 1986. Gestures: nature and function. In The biological foundations of gestures: Motor and semiotic aspects, eds. J.-L. Nespolous, P. Perron, and A. R. Lecours, 49-62. Hillsdale, N.J.: Lawrence Earlbaum Associates.
45. Newell, A. 1990. Unified theories of cognition. Cambridge, Mass.: Harvard University Press.
46. Nii, P. 1989. Blackboard systems. In The handbook of artificial intelligence, vol. IV, eds. A. Barr, P. R. Cohen, and E. A. Feigenbaum, 1-74. Reading, Mass.: Addison-Wesley.
47. Pelachaud, C., N. I. Badler, and M. Steedman. 1996. Generating facial expressions for speech. Cognitive Sci. 20(1):1-46.
48. Pierrehumbert, J., and J. Hirschberg. 1990. The meaning of intonational contours in the interpretation of discourse. In Intentions in communication, eds. P. R. Cohen, J. Morgan, and M. E. Pollack. Cambridge, Mass.: MIT Press.
49. Poesio, M., and D. R. Traum. 1995. Miscommunication in multi-modal collaboration. In Proc. IJCAI Workshop on Context in Natural Language Processing, August, 103-111.
50. Prevost, S. 1996. A semantics of contrast and information structure for specifying intonation in spoken language generation. Ph.D. thesis, University of Pennsylvania.
51. Prevost, S., and M. Steedman. 1994. Specifying intonation from context for speech synthesis. Speech Commun. 15:139-153.
52. Rime, B., and L. Schiaratura. 1991. Gesture and speech. In Fundamentals of nonverbal behavior, eds. R. S. Feldman and B. Rime, 239-281. New York: Press Syndicate of the University of Cambridge.
53. Rosenbaum, D. A., and H. Kirst. 1992. Antecedents of action. In Handbook of motor skills, eds. H. Heuer and S. W. Keele. New York: Academic Press.
54. Sacks, H., E. A. Schegloff, and G. A. Jefferson. 1974. A simplest systematics for the organization of turn-taking in conversation. Language 50:696-735.
55. Searle, J. R. 1969. Speech acts: An essay in the philosophy of language. Cambridge: Cambridge University Press.
56. Selfridge, O. 1959. Pandemonium: A paradigm for learning. In Proc. Symposium on the Mechanization of Thought Processes, 511-529.
57. Sparrell, C. J. 1993. Coverbal iconic gesture in human-computer interaction. Master’s thesis, Massachusetts Institute of Technology, Cambridge, Mass.
58. Steele, G. L. 1990. Common lisp the language, 2nd ed. Cambridge, Mass.: Digital Press.
59. Thorpe, C. E. 1992. Robots, mobile. In The encyclopedia of artificial intelligence, 2nd ed., ed. S. C. Shapiro, 1409-1416.New York: Wiley Interscience.
60. Thórisson, K. R. 1995. Computational characteristics of multimodal dialogue. In AAAI Fall Symposium Series on Embodied Language and Action, November 10-12, 102-108. Massachusetts Institute of Technology, Cambridge, Mass.
61. Thórisson, K. R. 1996. Communicative humanoids: A computational model of psychosocial dialogue skills. Ph.D. thesis, Massachusetts Institute of Technology, Cambridge, Mass.
62. Thórisson, K. R. 1997. Layered, modular action control in communicative humanoids. In Proc. Computer Graphics Europe ’97, June 5-7, Geneva, 134-143.
63. Thórisson, K. R. 1998. Decision making in real-time face-to-face multimodal communication. Presented at Second ACM International Conference on Autonomous Agents ’98, Minneapolis, Minnesota, May 12-15, pp. 16-23.
64. Todd, N. P. M., and G. J. Brown. 1994. A computational model of prosody perception. In Proceedings of the International Conference on Spoken Dialogue Processing, Yokohama, Japan, Sept. 18-22, 127-130.
65. Traum, D., and P. Dillenbourg. 1996. Miscommunication in multi-modal collaboration. In Working Notes of the AAAI Workshop on Detecting, Repairing, and Preventing Human-Machine Miscommuni-cation, August, 37-46.
66. Wahlster, W. 1991. User and discourse models for multimodal communication. In Intelligent user interfaces, eds. J. W. Sullivan and S. W. Tyler, 45-67. New York: ACM Press, Addison-Wesley.
67. Walker, M., and S. Whittaker. 1990. Mixed initiative in dialogue: An investigation into discourse segmentation. Presented at the 28th Annual Meeting of the Association for Computational Linguistics.
68. Waters, K. 1990. Modeling 3D facial expressions. In ACM SIGGRAPH ’90 Course Notes, State of the Art in Facial Animation, 108-129.
69. Wexelblatt, A. 1994. A feature-based approach to continuous-gestures analysis. Master’s thesis, Media Arts and Sciences, Massachusetts Institute of Technology, Cambridge, Mass.
70. Whittaker, S., and P. Stenton. 1988. Cues and control in expert-client dialogues. In Proc. 26th Annual Meeting of the Association of Computational Linguistics, 123-130.
71. Wilson, S. W. 1991. The Animat path to AI. In From animals to animats, eds. J.-A. Meyer and S. W. Wilson. Cambridge, M ass.: MIT Press.
72. Yngve, V. H. 1970. On getting a word in edgewise. In Papers from the Sixth Regional Meeting, 567-578. Chicago Linguistics Society.