Incrementally biasing visual search using natural language input

12th International Conference on Autonomous Agents and Multiagent Systems 2013, AAMAS 2013

Volumn 1, Issue , 2013, Pages 31-38

  Krause, Evan ^a   Cantrell, Rehj ^b   Potapova, Ekaterina ^c   Zillich, Michael ^c   Scheutz, Matthias ^a  

^a TUFTS UNIVERSITY   (United States)

^b INDIANA UNIVERSITY   (United States)

^c VIENNA UNIVERSITY OF TECHNOLOGY   (Austria)

Author keywords

Incremental natural language processing; Object detection and recognition; Visual search

Indexed keywords

AUTONOMOUS AGENTS; COMPUTER VISION; HUMAN ROBOT INTERACTION; MULTI AGENT SYSTEMS;

LINGUISTIC CONSTRAINTS; NATURAL INTERACTIONS; NATURAL LANGUAGE PROCESSING; OBJECT DETECTION AND RECOGNITION; REAL-TIME OPERATION; ROBOTIC ARCHITECTURES; TIGHT INTEGRATIONS; VISUAL SEARCH;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 84899420171     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (23)

1. J. Allen, M. Dzikovska, M. Manshadi, and M. Swift. Deep linguistic processing for spoken dialogue systems. In Proceedings of the ACL Workshop on Deep Linguistic Processing, Prague, Czech Republic, 2007.
2. N. Bergstrom, M. Bjorkman, and D. Kragic. Generating Object Hypotheses in Natural Scenes through Human-Robot Interaction. In IROS, pages 827-833, 2011.
3. S.-B. Choi, S.-W. Ban, M. Lee, J.-K. Shin, D.-W. Seo, and H.-S. Yang. Biologically motivated trainable selective attention model using adaptive resonance theory network. In A. Ijspeert, M. Murata, and N. Wakamiya, editors, Biologically inspired approaches to advanced information technology, pages 456-471. Springer Berlin / Heidelberg, 2004.
4. H. Clark and C. Marshall. Definite reference and mutual knowledge. In A. K. Joshi, B. L. Webber, and I. A. Sag, editors, Elements of discourse understanding, pages 10-63. Cambridge University Press, Cambridge, 1981.
5. K. M. Eberhard, M. J. Spivey-Knowlton, J. C. Sedivy, and M. K. Tanenhaus. Eye movements as a window into real-time spoken language comprehension in natural contexts. Journal of Psycholinguistic Research, 24: 409-436, 1995.
6. R. J. Firby. Adaptive Execution in Complex Dynamic Worlds. PhD thesis, Yale University, 1989.
7. S. Frintrop, G. Backer, and E. Rome. Selecting what is important: Training visual attention. In Proc. of the 28th Annual German Conference on AI (KI'05), 2005.
8. M. Johnson-Roberson, J. Bohg, M. Bjorkman, and D. Kragic. Attention based active 3D point cloud segmentation. In IROS, 2010.
9. M. Johnson-Roberson, J. Bohg, G. Skantze, J. Gustavson, R. Carlsson, and D. Kragic. Enhanced Visual Scene Understanding through Human-Robot Dialog. In IROS, pages 3342-3348, 2011.
10. P. Lison and G.-J. M. Kruijff. Efficient parsing of spoken inputs for human-robot interaction. In RO-MAN, 2009.
11. M. P. Michalowski, S. Sabanovic, C. DiSalvo, D. B. Font, L. Hiatt, N. Melchoir, and R. Simmons. Socially distributed perception: GRACE plays social tag at AAAI 2005. Autonomous Robots, 22(4): 385-397, 2007.
12. A. Mishra and Y. Aloimonos. Active Segmentation for Robots. In IEEE/RSJ International Conference on Intelligent Robots and Systems, 2009.
13. R. Moratz, K. Fischer, and T. Tenbrink. Cognitive modeling of spatial refernce for human-robot interaction. International Journal on Artificial Intelligence Tools, 10(4): 589-611, 2001.
14. R. Müller, T. Rofer, A. Landkenau, A. Musto, K. Stein, and A. Eisenkolb. Coarse qualitative description in robot navigation. In C. Freksa, W. Braner, C. Habel, and K. Wender, editors, Spatial Cognition II, pages 265-276. Spinger-Verlag, 1998.
15. V. Navalpakkam and L. Itti. A theory of optimal feature selection during visual search. In Proc. Computational and Systems Neuroscience, Mar 2006.
16. R. B. Rusu and S. Cousins. 3D is here: Point Cloud Library (PCL). In ICRA, 2011.
17. D. Schiffrin. Discourse Markers. Cambridge University Press, 1988.
18. W. Schuier, S. Wu, and L. Schwartz. A framework for fast incremental interpretation during speech decoding. Computational Linguistics, 35(3), 2009.
19. D. Skocaj, M. Janicek, M. Kristan, G.-J. M. Kruijff, A. Leonardis, P. Lison, A. Vrecko, and M. Zillich. A basic cognitive system for interactive continuous learning of visual concepts. In ICRA 2010 Workshop ICAIR. - Interactive Communication for Autonomous Intelligent Robots, pages 30-36, 2010.
20. K. Toyama and G. Hager. Incremental focus of attention for robust visual tracking. In Proceedings of the IEEE Conf. on Computer Vision and Pattern Recognition, pages 189-195, 1996.
21. W. Wohlkinger and M. Vincze. Shape-Based Depth Image to 3D Model Matching and Classification with Inter-View Similarity. In IROS, pages 4865-4870, 2011.
22. C. Yu, M. Scheutz, and P. Schermerhorn. Investigating multimodal real-time patterns of joint attention in an hri word learning task. In HRI, pages 309-316, 2010.
23. M. Zillich. Incremental Indexing for Parameter-Free Perceptual Grouping. In Proc. of the 31st Workshop of the Austrian Association for Pattern Recognition (OAGM/AAPR), pages 25-32, 2007.