Enabling effective human-robot interaction using perspective-taking in robots

IEEE Transactions on Systems, Man, and Cybernetics Part A:Systems and Humans.

Volumn 35, Issue 4, 2005, Pages 460-470

  Trafton, J Gregory ^a   Cassimatis, Nicholas L ^b   Bugajska, Magdalena D ^a   Brock, Derek P ^a   Mintz, Farilee E ^a   Schultz, Alan C ^a  

^a NAVAL RESEARCH LABORATORY   (United States)

^b RENSSELAER POLYTECHNIC INSTITUTE   (United States)

Author keywords

Cognitive modeling; Human robot interaction; Perspective taking

Indexed keywords

AEROSPACE ENGINEERING; COGNITIVE SYSTEMS; COMPUTER SIMULATION; COMPUTER SUPPORTED COOPERATIVE WORK; HEURISTIC METHODS; HUMAN COMPUTER INTERACTION; INTEGRATED CONTROL; MAN MACHINE SYSTEMS; MOBILE ROBOTS; SYSTEMS ANALYSIS;

COGNITIVE MODELLING; HUMAN-ROBOT INTERACTION (HRI); PERSPECTIVE TAKING; POLYSCHEME; ROBOT SYSTEM;

ROBOTICS;

EID: 22244461883     PISSN: 10834427     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCA.2005.850592     Document Type: Article

References (58)

1. D. Norman, Things That Make Us Smart: Defending Human Attributes in the Age of the Machine. Cambridge, MA: Perseus, 1993.
2. H. Petroski, The Evolution of Everyday Things. New York: Vintage, 1994.
3. J. Rubin, Handbook of Usability Testing. New York: Wiley, 1994.
4. A. D. Galinsky and G. Ku, "The effects of perspective-taking on prejudice: the moderating role of self-evaluation," Personal. Social Psych. Bull., vol. 30, pp. 594-604, 2004.
5. D. J. Laible and R. A. Thompson, "Attachment and emotional understanding in preschool children," Develop. Psych., vol. 34, pp. 1038-1045, 1998.
6. B. Tversky, P. Lee, and S. Mainwaring, "Why do speakers mix perspectives?," Spatial Cogn. Computat., vol. 1, pp. 312-399, 1999.
7. K. Emmorey, B. Tversky, and H. A. Taylor, "Using space to describe space: Perspective in speech, sign, and gesture," Spatial Cogn. Computat., vol. 2, pp. 157-180, 2000.
8. M. Hegarty and D. Waller, "A dissociation between mental rotation and perspective-taking spatial abilities," Intelligence, vol. 32, pp. 175-191, 2004.
9. H. A. Taylor and B. Tversky, "Spatial mental models derived from survey and route descriptions," J. Memory Lang., vol. 31, pp. 261-292, 1992.
10. N. Franklin, B. Tversky, and V. Coon, "Switching points of view in spatial mental models," Memory Cogn., vol. 20, pp. 507-518, 1992.
11. J. Huttenlocher and L. Kubicek, "The coding and transformation of spatial information," Cogn. Psych., vol. 11, pp. 375-394, 1979.
12. J. Huttenlocher, N. Newcombe, and E. H. Sandberg, "The coding of spatial location in young children," Cogn. Psych., vol. 27, pp. 115-147, 1994.
13. N. Newcombe and J. Huttnelocher, "Children's early ability to solve perspective-taking problems," Develop. Psych., vol. 28, pp. 654-664, 1992.
14. R. Wallace, K. L. Allan, and C. T. Tribol, "Spatial perspective-taking errors in children," Perceptual Motor Skills, vol. 92, pp. 633-639, 2001.
15. J. H. Flavell, E. R. Flavell, F. L. Green, and S. A. Wilcox, "The development of three spatial perspective-taking roles," Child Develop., vol. 51, pp. 356-358, 1981.
16. J. E. Laird, A. Newell, and P. S. Rosenbloom, "Soar: an architecture for general intelligence," Artif. Intell., vol. 33, pp. 1-64, 1987.
17. A. Newell, Unified Theories of Cognition. Cambridge, MA: Harvard Univ. Press, 1990.
18. J. E. Laird, "It knows what you're going to do: adding anticipation to a Quakebot," in Proceedings of the Fifth International Conference on Autonomous Agents, J. P. Muller, E. Andre, S. Sen, and C. Frasson, Eds. Montreal, QC. Canada: ACM Press, 2001, pp. 385-392.
19. W. Bluethmann, R. D. Ambrose, M. S. Askew, E. Huber, M. Goza, F. Rehnmark, C. Lovchik, and D. Magruder, "Robonaut: A robot designed to work with humans in space," Auton. Robots, vol. 14, pp. 179-197, 2003.
20. W. J. M. Levelt, "Some perceptual limitations on talking about space," in Limits in Perception, A. J. van Doom, W. A. van der Grind, and J. J. Koenderink, Eds. Utrecht: VNU Sci. Press, 1984, pp. 323-358.
21. L. A. Carson-Radvansky and G. A. Radvansky, "The influence of functional relations on spatial term selection," Psych. Sci., vol. 7, pp. 56-60, 1996.
22. L. A. Carson-Radvansky and G. D. Logan, "The influence of functional relations on spatial template construction," J. Mem. Lang., vol. 37, pp. 411-437, 1997.
23. S. Goldin-Meadow, "When gestures and words speak differently," Current Directions Psych. Sci., vol. 6, pp. 138-143, 1997.
24. D. McNeill, Hand and Mind: What Gestures Reveal About Thought. Chicago, IL: Univ. Chicago Press, 1992.
25. F. Mintz, J. G. Trafton, E. Marsh, and D. Perzanowski, "Choosing frames of reference: Perspective-taking in a 2-D and 3-D navigational task," in Proc. Human Factors Ergon. Soc., New Orleans, LA, 2004.
26. J. G. Trafton, S. B. Trickett, C. A. Stitzlein, L. D. Saner, C. D. Schunn, and S. S. Kirschenbaum, "The relationship between spatial transformations and iconic gestures," Spatial Cogn. Computat., submitted for publication.
27. K. A. Ericsson and H. A. Simon, Protocol Analysis: Verbal Reports as Data, 2nd ed. Cambridge, MA: MIT Press, 1993.
28. K. Emmorey, B. Tversky, and H. A. Taylor, "Using space to describe space: Perspective in speech, sign, and gesture," Spatial Cogn. Computat., vol. 2, pp. 157-180, 2000.
29. H. A. Taylor and B. Tversky, "Perspective in spatial descriptions," J. Mem. Lang., vol. 35, pp. 371-391, 1996.
30. J. G. Trafton, A. C. Schultz, N. L. Cassimatis, L. M. Hiatt, D. Perzanowski, D. P. Brock, M. D. Bugajska, and W. Adams, "Communicating and collaborating with robotic agents," in Cognition and MultiAgent Interaction: From Cognitive Modeling to Social Simulation, R. Sun, Ed. Cambridge, U.K.: Cambridge Univ. Press, to be published.
31. E. M. Altmann and J. G. Trafton, "Memory for goals: An activation-based model," Cogn. Sci., vol. 26, pp. 39-83, 2002.
32. J. R. Anderson, F. G. Conrad, and A. T. Corbett, "Skill acquisition and the LISP tutor," Cogn. Sci., vol. 13, pp. 467-505, 1989.
33. J. R. Anderson and C, Lebiere, Atomic Components of Thought. Mahwah, NJ: Erlbaum, 1998.
34. R. Shepard and J. Metzler, "Mental rotation of three-dimensional objects," Science, vol. 171, pp. 701-703, 1971.
35. J. G. Trafton, S. S. Kirschenbaum, T. L. Tsui, R. T. Miyamoto, J. A. Ballas, and P. D. Raymond, "Turning pictures into numbers: Extracting and generating information from complex visualizations," Int. J. Human Comput. Studies, vol. 53, pp. 827-850, 2000.
36. S. B. Trickett, R. M. Ratwani, and J. G. Trafton, "Real-world graph comprehension: High-level questions, complex graphs, and spatial cognition," under review.
37. M. Skubic and G. Chronis, "Robot navigation using qualitative landmark states from sketched route maps," in Proc. IEEE Int. Conf. Robot. Autom., New Orleans, LA, 2004, pp. 1530-1535.
38. M. Skubic, S. Blisard, C. Bailey, J. A. Adams. and P. Matsakis, "Qualitative analysis of sketched route maps: translating a sketch into linguistic descriptions," IEEE Trans. Syst., Man. Cyber. B, Cybern., submitted for publication. J.A. Adams. P. Matsakis
39. D. E. Meyer and D. E. Kieras, "A computational theory of executive cognitive processes and multiple-task performance: Part 1. Basic mechanisms," Psych. Rev., vol. 104, pp. 3-65, 1997.
40. J. A. Fodor, Modularity of Mind. Cambridge, MA: MIT Press, 1983.
41. M. D. Byrne and J. R. Anderson, "Serial modules in parallel: The psychological refractory period and perfect time-sharing," Psych. Rev., vol. 108, pp. 847-869, 2001.
42. L. M. Hiatt, J. G. Trafton, A. Harrison, and A. Schultz, "A cognitive model for spatial perspective-taking," in Proc. 6th Int. Conf. Cogn. Model., M. Lovett, C. D. Schunn, C. Lebiere, and P. Munro, Eds., Pittsburgh, PA, 2004.
43. N. L. Cassimatis, J. G. Trafton, M. D. Bugajska, and A. C. Schultz, "Integrating cognition, perception and action through mental simulation in robots," J. Robot. Auton. Syst., vol. 49, no. 1-2, pp. 12-23, 2004.
44. N. L. Cassimatis, "A cognitive architecture for integrating multiple representation and inference schemes," in Media Laboratory. Cambridge, MA: Mass. Inst. Technol., 2002.
45. D. Gentner and A. Stevens, Mental Models. Mahwah, NJ: Erlbaum, 1983.
46. P. N. Johnson-Laird and R. M. J. Byrne, Deduction. Mahwah, NJ: Erlbaum, 1991.
47. J. F. Allen, "Maintaining knowledge about temporal intervals," Commun. ACM, vol. 26, pp. 832-843, 1983.
48. D. Perzanowski, A. Schultz, and W. Adams, "Integrating natural language and gesture in a robotics domain," in Proc. IEEE Int. Symp. Intell. Contr.: ISIC/CIRA/ISAS Joint Conf., Gaithersburg, MD, 1998, pp. 247-252.
49. D. Perzanowski, A. Schultz, W. Adams, and E. Marsh, "Using a natural language and gesture interface for unmanned vehicles," in Proc. Soc. Photo-Opt. Instrum. Eng., vol. 4024, G. R. Gerhart, R. W. Gunderson, and C. M. Shoemaker, Eds., 2000, pp. 341-347.
50. D. Perzanowski, A. Schultz, W. Adams, E. Marsh, and M. Bugajska, "Building a multimodal human-robot interface," IEEE Intell. Syst., vol. 16, no. 1, pp. 16-20, Jan./Feb. 2001.
51. D. Perzanowski, A. Schultz, W. Adams, M. Bugajska, E. Marsh, J. G. Trafton, D. P. Brock, M. Skubic, and M. Abramson, "Communicating with teams of cooperative robots," in Multi-Robot Systems: From Swarms to Intelligent Automata, A. C. Schultz and L. E. Parker, Eds. Amsterdam, The Netherlands: Kluwer, 2002, pp. 16-20.
52. J. G. Trafton, A. C. Schultz, D. Perzanowski, W. Adams, M. D. Bugajska, N. L. Cassimatis, and D. P. Brock, "Children and robots learning to play hide and seek," under review.
53. A. Schultz, W. Adams, and B. Yamauchi, "Integrating exploration, localization, navigation and planning with a common representation," Auton. Robots, vol. 6, pp. 293-308, 1999.
54. J. Bruce, T. Balch, and M. Veloso, "Fast and inexpensive color mage segmentation for interactive robots," in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., vol. 3, Takamatsu, Japan, 2000, pp. 2061-2066.
55. D. Perzanowski, A. Schultz, W. Adams, and E. Marsh, "Goal tracking in a natural language interface: Toward achieving adjustable autonomy," in Proc. IEEE Int. Symp. Computat. Intell. Robot. Autom., Monterey, CA, 1999, pp. 208-213.
56. K. Wauchope, Eucalyptus: Integrating Natural Language Input With a Graphical User Interface. Washington, DC: Naval Res. Lab., 1994.
57. H. H. Clark, Using Language. New York: Cambridge Univ. Press, 1996.
58. D. E. Kieras and D. E. Meyer, "An overview of the EPIC architecture for cognition and performance with application to human-computer interaction," Human-Comput. Interaction, vol. 12, pp. 391-438, 1997.