Object schemas for responsive robotic language use

HRI 2008 - Proceedings of the 3rd ACM/IEEE International Conference on Human-Robot Interaction: Living with Robots

Volumn , Issue , 2008, Pages 233-240

  Hsiao, Kai Yuh ^a   Vosoughi, Soroush ^a   Tellex, Stefanie ^a   Kubat, Rony ^a   Roy, Deb ^a  

^a MIT MEDIA LAB   (United States)

Author keywords

Affordances; Behavior based; Language grounding; Object schema; Robot

Indexed keywords

AFFORDANCES; BEHAVIOR-BASED; COLLISION DETECTION; CONCURRENT INTERACTIONS; DISCRETE STRUCTURE; INTERACTION PROCESS; LANGUAGE GROUNDING; MULTIPLE SOURCE; NATURAL LANGUAGES; PHYSICAL OBJECTS; ROBOT SYSTEM; SCHEMAS; VERBAL INTERACTION;

HUMAN COMPUTER INTERACTION; LINGUISTICS; MAN MACHINE SYSTEMS;

HUMAN ROBOT INTERACTION;

EID: 77649240655     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1349822.1349853     Document Type: Conference Paper

References (35)

1. C. Bauckhage, J. Fritsch, K. Rohlfing, S. Wachsmuth, and G. Sagerer. Evaluating integrated speech and image understanding. In Proceedings of the IEEE International Conference on Multimodal Interfaces (ICMI), pages 9-14, 2002.
2. P. Beeson, M. MacMahon, J. Modayil, A. Murarka, B. Kuipers, and B. Stankiewicz. Integrating multiple representations of spatial knowledge for mapping, navigation, and communication. In Proceedings of the AAAI 2007 Spring Symposium on Control Mechanisms for Spatial Knowledge Processing in Cognitive / Intelligent Systems, 2007.
3. S. Belongie, J. Malik, and J. Puzicha. Shape matching and object recognition using shape contexts. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(24):509-522, 2002.
4. M. Berlin, J. Gray, A. L. Thomaz, and C. Breazeal. Perspective taking: An organizing principle for learning in human-robot interaction. In Proceedings of AAAI 2006, 2006.
5. C. Breazeal, M. Berlin, A. Brooks, J. Gray, and A. L. Thomaz. Using perspective taking to learn from ambiguous demonstrations. Journal of Robotics and Autonomous Systems Special Issue on Robot Programming by Demonstration, 54(5), 2006.
6. R. A. Brooks. A robust layered control system for a mobile robot. IEEE Journal of Robotics and Automation, 2:14-23, 1986.
7. R. A. Brooks. Intelligence without representation. Artificial Intelligence, 47:139-160, 1991.
8. J. Bruce, T. Balch, and M. Veloso. Fast and inexpensive color image segmentation for interactive robots. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2000.
9. J. J. Bryson. Intelligence by Design: Principles of Modularity and Coordination for Engineering Complex Adaptive Agents. PhD thesis, MIT, Department of EECS, Cambridge, MA, June 2001. AI Technical Report 2001-003.
10. J. J. Bryson and L. A. Stein. Modularity and design in reactive intelligence. In Proceedings of the International Joint Conference on Artificial Intelligence, pages 1115-1120, August 2001.
11. R. Burke, D. Isla, M. Downie, Y. Ivanov, and B. Blumberg. Creature smarts: The art and architecture of a virtual brain. In Proceedings of the Game Developers Conference, pages 147-166, 2001.
12. A. Cangelosi. The grounding and sharing of symbols. Pragmatics and Cognition, 14:275-285, 2006.
13. D. Comaniciu and P. Meer. Mean shift: A robust approach toward feature space analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(5), May 2002.
14. G. Drescher. Made-Up Minds: A Constructivist Approach to Artificial Intelligence. MIT Press, 1991.
15. P. Fitzpatrick. From First Contact to Close Encounters: A Developmentally Deep Perceptual System for a Humanoid Robot. PhD thesis, Massachusetts Institute of Technology, 2003.
16. P. Fitzpatrick and G. Metta. Grounding vision through experimental manipulation. Philosophical Transactions of the Royal Society: Mathematical, Physical, and Engineering Sciences, 361(1811):2165-2185, 2003.
17. E. Gat. Integrating planning and reaction in a heterogeneous asynchronous architecture for controlling mobile robots. In Proceedings of the Tenth National Conference on Artificial Intelligence (AAAI), 1992.
18. E. Gat. Three-layer architectures. In D. Krotenkamp, R. P. Bannasso, and R. Murphy, editors, Artificial Intelligence and Mobile Robots. AAAI Press, 1998.
19. J. J. Gibson. The Ecological Approach to Visual Perception. Erlbaum, 1979.
20. P. Gorniak and D. Roy. Situated language understanding as filtering perceived affordances. Cognitive Science, 31(2):197-231, 2007.
21. K. Hsiao and D. Roy. A habit system for an interactive robot. In AAAI Fall Symposium: From Reactive to Anticipatory Cognitive Embodied Systems, 2005.
22. D. Isla, R. Burke, M. Downie, and B. Blumberg. A layered brain architecture for synthetic creatures. In Proceedings of IJCAI, 2001.
23. L. S. Lopes and J. H. Connell. Semisentient robots: Routes to integrated intelligence. IEEE Intelligent Systems, 16:10-14, 2001.
24. J. Modayil and B. Kuipers. Where do actions come from? Autonomous robot learning of objects and actions. In Proceedings of the AAAI 2007 Spring Symposium on Control Mechanisms for Spatial Knowledge Processing in Cognitive / Intelligent Systems, 2007.
25. J. Piaget. The Construction of Reality in the Child. Basic Books, 1955.
26. T. Regier and L. Carlson. Grounding spatial language in perception: An empirical and computational investigation. Journal of Experimental Psychology, 130(2):273-298, 2001.
27. D. Roy. Grounding words in perception and action: computational insights. Trends in Cognitive Science, 9(8):389-396, 2005.
28. D. Roy. Semiotic schemas: A framework for grounding language in action and perception. Artificial Intelligence, 167(1-2):170-205, 2005.
29. D. Roy, K. Hsiao, and N. Mavridis. Mental imagery for a conversational robot. IEEE Transactions on Systems, Man, and Cybernetics, 34:1374-1383, 2004.
30. J. M. Siskind. Grounding the lexical semantics of verbs in visual perception using force dynamics and event logic. Journal of Artificial Intelligence Research, 15:31-90, August 2001.
31. M. Skubic, D. Perzanowski, S. Blisard, A. Schultz, W. Adams, M. Bugajska, and D. Brock. Spatial language for human-robot dialogs. IEEE Transactions on SMC Part C, Special Issue on Human-Robot Interaction, 34(2):154-167, May 2004.
32. L. Steels and T. Belpaeme. Coordinating perceptually grounded categories through language: A case study for colour. Behavioral and Brain Sciences, 28:469-529, 2005.
33. A. Stoytchev. Behavior-grounded representation of tool affordances. In Proceedings of IEEE International Conference on Robotics and Automation (ICRA), 2005.
34. P. Vogt and F. Divina. Social symbol grounding and language evolution. Interaction Studies, 8(1):31-52, 2007.
35. T. Winograd. Understanding Natural Language. Academic Press, 1972.