Incremental referent grounding with NLP-biased visual search

AAAI Workshop - Technical Report

Volumn WS-12-07, Issue , 2012, Pages 9-15

  Cantrell, Rehj ^a   Krause, Evan ^b   Scheutz, Matthias ^b   Zillich, Michael ^c   Potapova, Ekaterina ^c  

^a INDIANA UNIVERSITY   (United States)

^b TUFTS UNIVERSITY   (United States)

^c VIENNA UNIVERSITY OF TECHNOLOGY   (Austria)

Author keywords

[No Author keywords available]

Indexed keywords

BETTER PERFORMANCE; LINGUISTIC CONSTRAINTS; NATURAL LANGUAGE PROCESSING; ROBOTIC ARCHITECTURES; TIMING REQUIREMENTS; VISION SYSTEMS; VISUAL SEARCH; VISUAL-PROCESSING;

COMPUTER VISION; HUMAN COMPUTER INTERACTION; HUMAN ROBOT INTERACTION; MAN MACHINE SYSTEMS;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 84875594357     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (23)

1. Allen, J.; Dzikovska, M.; Manshadi, M.; and Swift, M. 2007. Deep linguistic processing for spoken dialogue systems. In Proceedings of the ACL Workshop on Deep Linguistic Processing.
2. Bergstrom, N.; Bjorkman, M.; and Kragic, D. 2011. Generating Object Hypotheses in Natural Scenes through Human-Robot Interaction. In IEEE/RSJ Intl. Conference on Intelligent Robots and Systems, 827-833.
3. Brick, T., and Scheutz, M. 2007. Incremental natural language processing for HRI. In HRI, 263-270.
4. Choi, S.-B.; Ban, S.-W.; Lee, M.; Shin, J.-K.; Seo, D.-W.; and Yang, H.-S. 2004. Biologically motivated trainable selective attention model using adaptive resonance theory network. In Ijspeert, A.; Murata, M.; and Wakamiya, N., eds., Biologically inspired approaches to advanced information technology. Springer Berlin / Heidelberg. 456-471.
5. Clark, H., and Marshall, C. 1981. Definite reference and mutual knowledge. In Joshi, A. K.; Webber, B. L.; and Sag, I. A., eds., Elements of discourse understanding. Cambridge: Cambridge University Press. 10-63.
6. Firby, R. J. 1989. Adaptive Execution in Complex Dynamic Worlds. Ph.D. Dissertation, Yale University.
7. Frintrop, S.; Backer, G.; and Rome, E. 2005. Selecting what is important: Training visual attention. In Proc. of the 28th Annual German Conference on AI (KI'05).
8. Johnson-Roberson, M.; Bohg, J.; Bjorkman, M.; and Kragic, D. 2010. Attention based active 3D point cloud segmentation. In IEEE/RSJ International Conference on Intelligent Robots and Systems.
9. Johnson-Roberson, M.; Bohg, J.; Skantze, G.; Gustavson, J.; Carlsson, R.; and Kragic, D. 2011. Enhanced Visual Scene Understanding through Human-Robot Dialog. In In IEEE/RSJ International Conference on Intelligent Robots and Systems, 3342-3348.
10. Lison, P., and Kruijff, G.-J. M. 2009. Efficient parsing of spoken inputs for human-robot interaction. In Proceedings of the 18th IEEE International Symposium on Robot and Human Interactive Communication.
11. Michalowski, M. P.; Sabanovic, S.; DiSalvo, C.; Font, D. B.; Hiatt, L.; Melchoir, N.; and Simmons, R. 2007. Socially distributed perception: GRACE plays social tag at AAAI 2005. Autonomous Robots 22(4):385-397. (Pubitemid 46473831)
12. Mishra, A., and Aloimonos, Y. 2009. Active Segmentation for Robots. In IEEE/RSJ International Conference on Intelligent Robots and Systems.
13. Moratz, R.; Fischer, K.; and Tenbrink, T. 2001. Cognitive modeling of spatial refernce for human-robot interaction. International Journal on Artificial Intelligence Tools 10(4):589-611.
14. Müller, R.; Rofer, T.; Landkenau, A.; Musto, A.; Stein, K.; and Eisenkolb, A. 1998. Coarse qualitative description in robot navigation. In Freksa, C.; Braner, W.; Habel, C.; and Wender, K., eds., Spatial Cognition II. Berlin: Spinger-Verlag. 265-276.
15. Navalpakkam, V., and Itti, L. 2006. A theory of optimal feature selection during visual search. In Proc. Computational and Systems Neuroscience (COSYNE).
16. Rusu, R. B., and Cousins, S. 2011. 3D is here: Point Cloud Library (PCL). In International Conference on Robotics and Automation.
17. Schiffrin, D. 1988. Discourse Markers. Cambridge University Press.
18. Schuler, W.; Wu, S.; and Schwartz, L. 2009. A framework for fast incremental interpretation during speech decoding. Computational Linguistics 35(3).
19. Skocaj, D.; Janicek, M.; Kristan, M.; Kruijff, G.-J. M.; Leonardis, A.; Lison, P.; Vrecko, A.; and Zillich, M. 2010. A basic cognitive system for interactive continuous learning of visual concepts. In ICRA 2010 Workshop ICAIR - Interactive Communication for Autonomous Intelligent Robots, 30-36.
20. Toyama, K., and Hager, G. 1996. Incremental focus of attention for robust visual tracking. In Proceedings of the IEEE Conf. on Computer Vision and Pattern Recognition, 189-195.
21. Wohlkinger, W., and Vincze, M. 2011. Shape-Based Depth Image to 3D Model Matching and Classification with Inter-View Similarity. In IEEE/RSJ Intl. Conference on Intelligent Robots and Systems, 4865-4870.
22. Yu, C.; Scheutz, M.; and Schermerhorn, P. 2010. Investigating multimodal real-time patterns of joint attention in an hri word learning task. In 5th ACM/IEEE International Conference on HRI, 309-316.
23. Zillich, M. 2007. Incremental Indexing for Parameter-Free Perceptual Grouping. In Proc. of the 31st Workshop of the Austrian Association for Pattern Recognition (OAGM/AAPR), 25-32.