Integrating vision and audition within a cognitive architecture to track conversations

HRI 2008 - Proceedings of the 3rd ACM/IEEE International Conference on Human-Robot Interaction: Living with Robots

Volumn , Issue , 2008, Pages 201-208

  Trafton, J Gregory ^a   Bugajska, Magda D ^a   Fransen, Benjamin R ^a   Ratwani, Raj M ^a  

^a NAVAL RESEARCH LABORATORY   (United States)

Author keywords

ACT R; Cognitive modeling; Conversation following; Human robot interaction

Indexed keywords

COGNITIVE ARCHITECTURES; COGNITIVE MODELING; DYNAMIC ENVIRONMENTS; EMPIRICAL EVALUATIONS; HUMAN ROBOT INTERACTIONS; TRACKING SYSTEM;

HUMAN COMPUTER INTERACTION; MAN MACHINE SYSTEMS;

HUMAN ROBOT INTERACTION;

EID: 57749099744     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1349822.1349849     Document Type: Conference Paper

References (45)

1. J. Anderson. How Can the Human Mind Occur in the Physical Universe? Oxford University Press, 2007.
2. J. Anderson, D. Bothell, M. Byrne, S. Douglass, C. Lebiere, and Y. Qin. An integrated theory of the mind. Psychological Review, 111(4):1036-1060, 2004.
3. M. Argyle and M. Cook. Gaze and mutual gaze. Cambridge University press, Cambridge, MA, 1976.
4. M. Argyle and J. Graham. The Central Europe Experiment-looking at persons and looking at things. Journal of Environmental Psychology and Nonverbal Behaviour, 1(1977):6-16, 1977.
5. B. Best and C. Lebiere. Cognitive agents interacting in real and virtual worlds. In R. Sun, editor, Cognition and Multi-Agent Interaction: From Cognitive Modeling to Social Simulation, pages 186-218, New York, NY, 2006. Cambridge University press.
6. C. Breazeal, G. Hoffman, and A. Lockerd. Teaching and working with robots as a collaboration. Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004. Proceedings of the Third International Joint Conference on, pages 1030-1037, 2004.
7. M. Bull and M. Aylett. An analysis of the timing of turn-taking in a corpus of goal-oriented dialog. In Proceedings of the IC-SLP'98, volume volumne 4, pages 1175-1178, Sydney, Australia, 1998.
8. L. Cepstral. Swift TM: Small Footprint Text-to-Speech Synthesizer, 2005.
9. C. Choi, D. Kong, S. Lee, K. Park, S. Hong, H. Lee, S. Bang, Y. Lee, and S. Kim. Real-time audio-visual localization of user using microphone array and vision camera. Intelligent Robots and Systems, 2005.(IROS 2005). 2005 IEEE/RSJ International Conference on, pages 1935-1940, 2005.
10. H. Clark. Using Language. Cambridge University Press, 1996.
11. N. Fay, S. Garrod, and J. Carletta. Group discussion as interactive dialogue or as serial monologue: the influence of group size. Psychol Sci, 11(6):481-6, 2000.
12. B. R. Fransen, V. I. Morariu, E. Martinson, S. Blisard, M. Marge, S. Thomas, A. C. Schultz, and D. Perzanowski. Using vision, acoustics, and natural language for disambiguation. In HRI, pages 73-80. ACM, 2007.
13. T. Kanda, H. Ishiguro, and T. Ono. Development and evaluation of an interactive humanoid robot robovie. Proc. Intl Conf Robotics and Automation, 2002.
14. M. Katzenmaier, R. Stiefelhagen, and T. Schultz. Identifying the addressee in human-human-robot interactions based on head pose and speech. Proceedings of the 6th international conference on Multimodal interfaces, pages 144-151, 2004.
15. W. G. Kennedy, M. Bugajska, M. Marge, W. Adams, B. R. Fransen, D. Perzanowski, A. C. Schultz, and J. G. Trafton. Spatial representation and reasoning for human-robot collaboration. In The Proceedings of the AAAI national Conference on Artificial Intelligence, 2007.
16. D. Kieras and D. E. Meyer. An overview of the epic architecture for cognition and performance with application to human-computer interaction. Human Computer Interaction, 12:391-438, 1997.
17. H. Kim, J. Choi, and M. Kim. Speaker Localization among multi-faces in noisy environment by audio-visual Integration. Robotics and Automation, 2006. ICRA 2006. Proceedings 2006 IEEE International Conference on, pages 1305-1310, 2006.
18. H. Kozima, C. Nakagawa, and H. Yano. Can a robot empathize with people? Artificial Life and Robotics, 8(1):83-88, 2004.
19. J. E. Laird, A. Newell, and P. S. Rosenbloom. SOAR: An architecture for general intelligence. Artificial Intelligence, 33:1-64, 1987.
20. C. Lalanne and J. Lorenceau. Crossmodal integration for perception and action. Journal of Physiology-Paris, 98(1-3):265-279, 2004.
21. R. Lienhart and J. Maydt. An extended set of haar-like features for rapid object detection. In Proc. IEEE International Conference on Image Processing ICIP 2002, volume 1, pages 900-903, 2002.
22. E. Martinson and D. P. Brock. Improving human-robot interaction through adaptation to the auditory scene. In Proceedings of the 2007 conference on Human Robot Interaction, pages 113-120. ACM Press New York, NY, USA, 2007.
23. E. Martinson and A. C. Schultz. Auditory evidence grids. In Proc. of the International Conference on Intelligent Robots and Systems (IROS), pages 1139-1144, 2006.
24. L. Meltzer. Interruption Outcomes and Vocal Amplitude: Explorations in Social Psychophysics. Journal of Personality and Social Psychology, 18(3):392-402, 1971.
25. A. Newell. Unified theories of cognition. Harvard University Press, Cambridge, MA, 1990.
26. G. Nielsen. Studies in self confrontation. Monksgaard, Copenhagen, 1962.
27. H. Okuno, K. Nakadai, K. Hidai, H. Mizoguchi, and H. Kitano. Human-robot interaction through real-time auditory and visualmultiple-talker tracking. Intelligent Robots and Systems, 2001. Proceedings. 2001 IEEE/RSJ International Conference on, 3, 2001.
28. J. Ou, L. Oh, S. Fussell, T. Blum, and J. Yang. Analyzing and predicting focus of attention in remote collaborative tasks. Proc. of the 7th international conference on Multimodal interfaces, pages 116-123, 2005.
29. J. Ou, Y. Shi, J. Wong, S. Fussell, and J. Yang. Combining audio and video to predict helpers' focus of attention in multiparty remote collaboration on physical tasks. Proc. of the 8th int. conference on Multimodal interfaces, pages 217-224, 2006.
30. F. Parke and K. Waters. Computer facial animation. AK Peters, Ltd. Natick, MA, USA, 1996.
31. P. Qvarfordt and S. Zhai. Conversing with the user based on eye-gaze patterns. Proceedings of the SIGCHI conference on Human factors in computing systems, pages 221-230, 2005.
32. S. Raidt, G. Bailly, and F. Elisei. Basic components of a face-to-face interaction with a conversational agent: mutual attention and deixis. Proceedings of the 2005 joint conference on Smart objects and ambient intelligence: innovative context-aware services: usages and technologies, pages 247-252, 2005.
33. F. Ritter, D. Van Rooy, R. Amant, and K. Simpson. Providing user models direct access to interfaces: an exploratory study of a simple interface with implications for HRI and HCI. IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans, 36(3):592-601, 2006.
34. H. Sacks, E. A. Schegloff, and G. Jefferson. A simplest systematics for the organization of turn taking for conversation. Language, 50(4):696-735, 1974.
35. B. Scassellati. Theory of Mind for a Humanoid Robot. Autonomous Robots, 12(1):13-24, 2002.
36. A. Schultz, W. Adams, and B. Yamauchi. Integrating Exploration, Localization, Navigation and Planning with a Common Representation. Autonomous Robots, 6(3):293-308, 1999.
37. C. Sidner, C. Kidd, C. Lee, and N. Lesh. Where to look: a study of human-robot engagement. Proceedings of the 9th international conference on Intelligent user interfaces, pages 78-84, 2004.
38. R. Simmons, W. Adams, A. Atrash, M. Bugajska, M. Coblenz, M. MacMahon, D. Perzanowski, I. Horswill, R. Zubek, D. Kortenkamp, et al. GRACE: an autonomous robot for the AAAI Robot challenge. AI Magazine, 24(2):51-72, 2003.
39. N. Taatgen, H. van Rijn, and J. Anderson. An Integrated Theory of Prospective Time Interval Estimation: The Role of Cognition, Attention, and Learning. Psychological Review, 114:577-598, 2007.
40. J. Trafton, A. Schultz, M. Bugajska, and F. Mintz. Perspective-taking with robots: experiments and models. ROMAN 2005, pages 580-584, 2005.
41. J. G. Trafton, N. L. Cassimatis, M. D. Bugajska, D. P. Brock, F. E. Mintz, and A. C. Schultz. Enabling effective human-robot interaction using perspective-taking in robots. IEEE Transactions on Systems, Man, and Cybernetics, 35(4):460-470, 2005.
42. J. G. Trafton, A. C. Schultz, N. L. Cassimatis, L. M. Hiatt, D. Perzanowski, D. P. Brock, M. D. Bugajska, and W. Adams. Cognition and multi-agent interaction: From cognitive modeling to social simulation. In R. Sun, editor, Communicating and collaborating with robotic agents, in press.
43. J. G. Trafton, A. C. Schultz, D. Perzanowski, W. Adams, M. D. Bugajska, N. L. Cassimatis, and D. P. Brock. Children and robots learning to play hide and seek. In A. C. Schultz and M. Goodrich, editors, Proceedings of the 2006 ACM conference on HRI. ACM Press, 2006.
44. R. Vertegaal, R. Slagter, G. van der Veer, and A. Nijholt. Eye gaze patterns in conversations: there is more to conversational agents than meets the eyes. Proceedings of the SIGCHI conference on Human factors in computing systems, pages 301-308, 2001.
45. Y. Yoshikawa, K. Shinozawa, H. Ishiguro, N. Hagita, and T. Miyamoto. Responsive robot gaze to interaction partner. Proceedings of robotics: Science and systems, 2006.