Open-vocabulary Object Retrieval

Robotics: Science and Systems

Volumn , Issue , 2014, Pages

  Guadarrama, Sergio ^a   Rodner, Erik ^b   Saenko, Kate ^c   Zhang, Ning ^a   Farrell, Ryan ^a,b   Donahue, Jeff ^a   Darrell, Trevor ^a,b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b INTERNATIONAL COMPUTER SCIENCE INSTITUTE   (United States)

^c UNIVERSITY OF MASSACHUSETTS   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; NATURAL LANGUAGE PROCESSING SYSTEMS; OBJECT RECOGNITION;

BEST MATCH; BRAND NAMES; FINE GRAINED; LARGE-SCALE OBJECTS; NATURAL LANGUAGE QUERIES; NATURAL LANGUAGES; OBJECT BASED; OBJECT RETRIEVAL; OBJECTS RECOGNITION; OBJECTS-BASED;

SEMANTICS;

EID: 85131224768     PISSN: None     EISSN: 2330765X     Source Type: Conference Proceeding    
DOI: 10.15607/RSS.2014.X.041     Document Type: Conference Paper

References (56)

1. Freebase API. https://developers.google.com/freebase/.
2. Google image search. http://www.images.google.com/.
3. IQ Engines: Image Recognition APIs for photo albums and mobile commerce. https://www.iqengines.com/.
4. R. Agrawal, A. Gupta, Y. Prabhu, and M. Varma. Multi-label learning with millions of labels: Recommending advertiser bid phrases for web pages. In WWW, 2013.
5. Relja Arandjelovic and Andrew Zisserman. Multiple queries for large scale specific object retrieval. In BMVC, 2012.
6. K. Barnard and D. Forsyth. Learning the semantics of words and pictures. In ICCV, 2001.
7. A. Berg, R. Farrell, A. Khosla, J. Krause, L. Fei-Fei, L. Jia, and S. Maji. Fine-Grained Challenge 2013. https://sites.google.com/site/fgcomp2013/, 2013.
8. David M. Blei and Michael I. Jordan. Modeling annotated data. In SIGIR, 2003.
9. Kurt Bollacker, Colin Evans, Praveen Paritosh, Tim Sturge, and Jamie Taylor. Freebase: a collaboratively created graph database for structuring human knowledge. In SIGMOD, 2008.
10. C. Carpineto and G. Romano. A survey of automatic query expansion in information retrieval. CSUR, 2012.
11. Ken Chatfield and Andrew Zisserman. Visor: Towards on-the-fly large-scale object category retrieval. In ACCV 2012, pages 432–446. Springer, 2013.
12. Ondrej Chum, James Philbin, Josef Sivic, Michael Isard, and Andrew Zisserman. Total recall: Automatic query expansion with a generative feature model for object retrieval. In ICCV, 2007.
13. Jeffrey Dalton, James Allan, and Pranav Mirajkar. Zero-shot video retrieval using content and concepts. In Proceedings of the 22nd ACM international conference on Conference on information & knowledge management, pages 1857–1860. ACM, 2013.
14. Thomas Dean, Mark A Ruzon, Mark Segal, Jonathon Shlens, Sudheendra Vijayanarasimhan, and Jay Yagnik. Fast, accurate detection of 100,000 object classes on a single machine. In CVPR, 2013.
15. Jia Deng, Alexander C. Berg, Kai Li, and Li Fei-Fei. What Does Classifying More Than 10,000 Image Categories Tell Us? In ECCV, 2010.
16. Jia Deng, Jonathan Krause, Alex Berg, and Li Fei-Fei. Hedging Your Bets: Optimizing Accuracy-Specificity Trade-offs in Large Scale Visual Recognition. In CVPR, 2012.
17. J. Donahue, Y. Jia, O. Vinyals, J. Hoffman, N. Zhang, E. Tzeng, and T. Darrell. DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition. ArXiv e-prints, 2013.
18. Ali Farhadi, Mohsen Hejrati, Mohammad Amin Sadeghi, Peter Young, Cyrus Rashtchian, Julia Hockenmaier, and David Forsyth. Every picture tells a story: Generating sentences from images. In ECCV. Springer, 2010.
19. Ryan Farrell, Om Oza, Ning Zhang, Vlad I Morariu, Trevor Darrell, and Larry S Davis. Birdlets: Subordinate categorization using volumetric primitives and pose-normalized appearance. In ICCV, 2011.
20. Andrea Frome, Greg Corrado, Jon Shlens, Samy Bengio, Jeffrey Dean, Marc’Aurelio Ranzato, and Tomas Mikolov. DeViSE: A deep visual-semantic embedding model. In NIPS, 2013.
21. George W. Furnas, Thomas K. Landauer, Louis M. Gomez, and Susan T. Dumais. The vocabulary problem in human-system communication. Communications of the ACM, 30(11):964–971, 1987.
22. Albert Gordoa, José A Rodríguez-Serrano, Florent Per-ronnin, and Ernest Valveny. Leveraging category-level labels for instance-level image retrieval. In CVPR, 2012.
23. David Grangier and Samy Bengio. A discriminative kernel-based model to rank images from text queries. PAMI, 2007.
24. S. Guadarrama, L. Riano, D. Golland, D. Gohring, Y. Jia, D. Klein, P. Abbeel, and T. Darrell. Grounding spatial relations for human-robot interaction. In IROS, 2013.
25. S. Hwang and K. Grauman. Reading between the lines: Object localization using implicit cues from image tags. TPAMI, 2012.
26. J. Krapac, M. Allan, J. Verbeek, and F. Jurie. Improving web image search results using query-relative classifiers. In CVPR, 2010.
27. Jayant Krishnamurthy and Thomas Kollar. Jointly learning to parse and perceive: Connecting natural language to the physical world. Transactions of the Association for Computational Linguistics, 1(2):193–206, 2013.
28. Alex Krizhevsky, Ilya Sutskever, and Geoff Hinton. Imagenet classification with deep convolutional neural networks. In NIPS, 2012.
29. Girish Kulkarni, Visruth Premraj, Sagnik Dhar, Siming Li, Yejin Choi, Alexander C. Berg, and Tamara L. Berg. Baby talk: Understanding and generating simple image descriptions. In CVPR, 2011.
30. Polina Kuznetsova, Vicente Ordonez, Alexander Berg, Tamara Berg, and Yejin Choi. Generalizing image captions for image-text parallel corpus. In ACL, 2013.
31. Xirong Li, Dong Wang, Jianmin Li, and Bo Zhang. Video search in concept subspace: a text-like paradigm. In Proceedings of the 6th ACM international conference on Image and video retrieval, pages 603–610. ACM, 2007.
32. Yuanqing Lin, Fengjun Lv, Shenghuo Zhu, Kai Yu, Ming Yang, and Timothee Cour. Large-scale image classification: fast feature extraction and SVM training. In CVPR, 2011.
33. Yiming Liu, Dong Xu, and Ivor W. Tsang. Using large-scale web data to facilitate textual query based retrieval of consumer photos. In ACM-MM, 2009.
34. David G. Lowe. Object recognition from local scale-invariant features. In ICCV, 1999.
35. Aurelien Lucchi and Jason Weston. Joint image and word sense discrimination for image retrieval. In ECCV, 2012.
36. Christopher D Manning, Prabhakar Raghavan, and Hin-rich Schütze. Introduction to information retrieval, volume 1. Cambridge university press Cambridge, 2008.
37. Pierre Moreels, Michael Maire, and Pietro Perona. Recognition by probabilistic hypotheis construction. In ECCV, 2004.
38. Apostol Paul Natsev, Alexander Haubold, Jelena Tešić, Lexing Xie, and Rong Yan. Semantic concept-based query expansion and re-ranking for multimedia retrieval. In Proceedings of the 15th international conference on Multimedia, pages 991–1000. ACM, 2007.
39. Shi-Yong Neo, Jin Zhao, Min-Yen Kan, and Tat-Seng Chua. Video retrieval using high level features: Exploiting query matching and confidence-based weighting. In Image and Video Retrieval, pages 143–152. Springer, 2006.
40. David Nister and Henrik Stewenius. Scalable recognition with a vocabulary tree. In CVPR, 2006.
41. Vicente Ordonez, Jia Deng, Yejin Choi, Alexander C Berg, and Tamara L Berg. From large scale image categorization to entry-level categories. In ICCV, 2013.
42. O. M. Parkhi, A. Vedaldi, C. V. Jawahar, and A. Zisserman. Cats and dogs. In CVPR, 2012.
43. James Philbin, Ondrej Chum, Michael Isard, Josef Sivic, and Andrew Zisserman. Object retrieval with large vocabularies and fast spatial matching. In CVPR, 2007.
44. John C Platt. Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods. In Advances in Large-margin Classifiers, 1999.
45. Nikhil Rasiwasia, Pedro J Moreno, and Nuno Vascon-celos. Bridging the gap: Query by semantic example. Multimedia, IEEE Transactions on, 9(5):923–938, 2007.
46. Abhishek Sharma, Abhishek Kumar, H Daume, and David W Jacobs. Generalized multiview analysis: A discriminative latent space. In CVPR, 2012.
47. J. Sivic and A. Zisserman. Video Google: A text retrieval approach to object matching in videos. In ICCV, 2003.
48. Cees GM Snoek, Bouke Huurnink, Laura Hollink, Maarten De Rijke, Guus Schreiber, and Marcel Worring. Adding semantics to detectors for video retrieval. Multimedia, IEEE Transactions on, 9(5):975–986, 2007.
49. Richard Socher, Brody Huval, Christopher D Manning, and Andrew Y Ng. Semantic compositionality through recursive matrix-vector spaces. In EMNLP, 2012.
50. Jie Tang, Stephen Miller, Arjun Singh, and Pieter Abbeel. A textured object recognition pipeline for color and depth image data. In Robotics and Automation (ICRA), 2012 IEEE International Conference on, pages 3467–3474. IEEE, 2012.
51. Stefanie Tellex, Thomas Kollar, Steven Dickerson, Matthew R Walter, Ashis Gopal Banerjee, Seth Teller, and Nicholas Roy. Understanding natural language commands for robotic navigation and mobile manipulation. In AAAI, 2011.
52. Stefanie Tellex, Pratiksha Thaker, Robin Deits, Dimitar Simeonov, Thomas Kollar, and Nicholas Roy. Toward a probabilistic approach to acquiring information from human partners using language. Technical report, MIT, 2012.
53. J. Uijlings, K. van de Sande, T. Gevers, and A. Smeul-ders. Selective search for object recognition. IJCV, 2013.
54. Joost Van De Weijer, Cordelia Schmid, Jakob Verbeek, and Diane Larlus. Learning color names for real-world applications. TIP, 2009.
55. Jason Weston, Samy Bengio, and Nicolas Usunier. Wsa-bie: Scaling up to large vocabulary image annotation. In IJCAI, 2011.
56. Ziang Xie, Arjun Singh, Justin Uang, Karthik S Narayan, and Pieter Abbeel. Multimodal blending for high-accuracy instance recognition. In Intelligent Robots and Systems (IROS), 2013 IEEE/RSJ International Conference on, pages 2214–2221. IEEE, 2013.