Using multi-view recognition and meta-data annotation to guide a robot's attention

International Journal of Robotics Research

Volumn 28, Issue 8, 2009, Pages 976-998

  Thomas, Alexander ^a   Ferrari, Vittorio ^b   Leibe, Bastian ^c   Tuytelaars, Tinne ^a   Van Gool, Luc ^a,b  

^a UNIVERSITY OF LEUVEN   (Belgium)

^b ETH ZURICH   (Switzerland)

^c RWTH AACHEN UNIVERSITY   (Germany)

Author keywords

Computer vision.; Object class recognition

Indexed keywords

FERRARI; MULTI-VIEWS; MULTIPLE VIEWPOINTS; OBJECT CLASS RECOGNITION; SERVICE ROBOTICS; SHAPE MODEL; VARIABLE ENVIRONMENT;

COMPUTER VISION; LABELS; ROBOTS;

OBJECT RECOGNITION;

EID: 69249154652     PISSN: 02783649     EISSN: 17413176     Source Type: Journal    
DOI: 10.1177/0278364909340444     Document Type: Article

References (46)

1. Bay, H., Tuytelaars, T. and Van Gool, L. (2006). SURF: speeded up robust features. Proceedings of ECCV (Lecture Notes in Computer Science, Vol. 3951). Berlin, Springer, pp. 404-417.
2. Belongie, S., Malik, J. and Puzicha, J. (2000). Shape context: a new descriptor for shape matching and object recognition. Proceedings of NIPS, pp. 831-837.
3. Brostow, G., Shotton, J., Fauqueur, J. and Cipolla, R. (2008). Segmentation and recognition using structure from motion point clouds. Proceedings of the European Conference on Computer Vision.
4. Cheng, L., Vishwanathan, S.V.N. and Zhang, X. (2008). Consistent image analogies using semi-supervised learning. Proceedings of CVPR, pp. 1-8.
5. Cheng, Y. (1995). Mean shift, mode seeking, and clustering. IEEE Transactions on Pattern Analysis and Machine Intelligence, 17 (8). 790-799.
6. Cornelis, N., Leibe, B., Cornelis, K. and Van Gool, L.J. (2006). 3D city modeling using cognitive loops. Proceedings of 3DPVT, pp. 9-16.
7. Everingham, M., Van Gool, L., Williams, C.K.I., Winn, J. and Zisserman, A. (2007). The PASCAL Visual Object Classes Challenge 2007 (VOC2007) Results. http://www.pascal-network.org/challenges/VOC/voc2007/workshop/index.html.
8. Everingham, M., Zisserman, A., Williams, C., Gool, L.V., Allan, M., Bishop, C., et al. (2006). The 2005 PASCAL visual object classes challenge. Selected Proceedings of the First PASCAL Challenges Workshop (Lecture Notes in Artificial Intelligence, Vol. ). Berlin, Springer.
9. Ferrari, V., Tuytelaars, T. and Gool, L.V. (2006). Simultaneous object recognition and segmentation from single or multiple model views. International Journal of Computer Vision 67 (2). 159-188.
10. Ferrari, V., Tuytelaars, T. and Van Gool, L. (2004). Simultaneous object recognition and segmentation by image exploration. Proceedings of ECCV.
11. Fraundorfer, F., Engels, C. and Nister, D. (2007). Topological mapping, localization and navigation using image collections. Proceedings of IROS.
12. Goedemé, T., Nuttin, M., Tuytelaars, T. and Van Gool, L. (2007). Omnidirectional vision based topological navigation. The International Journal on Computer Vision and The International Journal of Robotics Research, 74 (3). 219-236.
13. Goedemé, T., Tuytelaars, T. and Van Gool, L.J. (2004). Fast wide baseline matching for visual navigation. Proceedings of CVPR, Vol. 1, pp. 24-29.
14. Han, F. and Zhu, S.-C. (2003). Bayesian reconstruction of 3D shapes and scenes from a single image. Proceedings of the Workshop Higher-Level Knowledge in 3D Modeling Motion Analysis, pp. 12-20.
15. Hassner, T. and Basri, R. (2006). Example based 3D reconstruction from single 2D images. Beyond Patches Workshop at IEEE CVPR06, p. 15.
16. Hertzmann, A., Jacobs, C., Oliver, N., Curless, B. and Salesin, D. (2001). Image analogies. SIGGRAPH Conference Proceedings. New York, ACM Press, pp. 327-340.
17. Hoiem, D., Efros, A. and Hebert, M. (2006). Putting objects in perspective. Proceedings of CVPR, pp. 2137- 2144.
18. Hoiem, D., Efros, A.A. and Hebert, M. (2005). Geometric context from a single image. Proceedings of ICCV, pp. 654-661.
19. Hoiem, D., Rother, C. and Winn, J. (2007). 3D LayoutCRF for multi-view object class recognition and segmentation. Proceedings of CVPR, pp. 1-8.
20. Kushal, A., Schmid, C. and Ponce, J. (2007). Flexible object models for category-level 3D object recognition. Proceedings of CVPR.
21. Leibe, B., Cornelis, N., Cornelis, K. and Van Gool, L. (2007). Dynamic 3D scene analysis from a moving vehicle. Proceedings of CVPR, pp. 1-8.
22. Leibe, B., Leonardis, A. and Schiele, B. (2008). Robust object detection with interleaved categorization and segmentation. The International Journal of Computer Vision, 77 (1-3). 259-289.
23. Leibe, B. and Schiele, B. (2003). Interleaved object categorization and segmentation. Proceedings of BMVC, pp. 759- 768.
24. Leibe, B. and Schiele, B. (2005). Pedestrian detection in crowded scenes. Proceedings of CVPR, pp. 878-885.
25. Liebelt, J., Schmid, C. and Schertler, K. (2008). Viewpoint-independent object class detection using 3D feature maps. IEEE Conference on Computer Vision and Pattern Recognition.
26. Liu, C., Yuen, J., Torralba, A., Sivic, J. and Freeman, W.T. (2008). SIFT Flow: dense correspondence across different scenes. European Conference on Computer Vision, pp. 28- 42.
27. Lowe, D.G. (2001). Local feature view clustering for 3D object recognition. IEEE Conference on Computer Vision and Pattern Recognition, pp. 682-688.
28. Lowe, D.G. (2004). Distinctive image features from scale-invariant keypoints. The International Journal of Computer Vision, 60 (2). 91-110.
29. Meger, D., Forssén, P., Lai, K., Helmer, S., McCann, S., Southey, T., Baumann, M., Little, J.J. and Lowe, D.G. (2008). Curious george: An attentive semantic robot. Robotics and Autonomous Systems, 56: 503-511.
30. Mikolajczyk, K. and Schmid, C. (2004). Scale and affine invariant interest point detectors. The International Journal of Computer Vision, 60 (1). 63-86.
31. Mumford, D. (1994). Neuronal architectures for pattern-theoretic problems. Large-scale Neuronal Theories of the Brain, pp. 125-152.
32. Munoz, D., Vandapel, N. and Hebert, M. (2008). Directional associative Markov network for 3-D point cloud classification. Fourth International Symposium on 3-D Data Processing, Visualization, and Transmission (3DPVT).
33. Pantofaru, C., Unnikrishnan, R. and Hebert, M. (2003). Toward generating labeled maps from color and range data for robot navigation. Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Vol. 2, pp. 1314-1321.
34. Posner, I., Schroeter, D. and Newman, P. (2007). Describing composite urban workspaces. Proceedings of the International Conference on Robotics and Automation.
35. Rockland, K. and Hoesen, G.V. (1994). Direct temporal-occipital feedback connections to striate cortex (V1) in the macaque monkey. Cerebral Cortex, 4: 300-313.
36. Rothganger, F., Lazebnik, S., Schmid, C. and Ponce, J. (2006). 3D object modeling and recognition using local affine-invariant image descriptors and multi-view spatial constraints. The International Journal of Computer Vision, 66 (3). 231-259.
37. Russell, B., Torralba, A., Murphy, K. and Freeman, W. (2005). LabelMe: a database and web-based tool for image annotation. MIT AI Lab Memo AIM-2005-025, MIT, Cambridge, MA.
38. Savarese, S. and Fei-Fei, L. (2007). 3D generic object categorization, localization and pose estimation. Proceedings of ICCV, pp. 1-8.
39. Saxena, A., Driemeyer, J., Kearns, J. and Ng, A.Y. (2006). Robotic grasping of novel objects. Proceedings of NIPS, Vol. 19, pp. 1209-1216.
40. Saxena, A., Schulte, J. and Ng, A.Y. (2005). Learning depth from single monocular images. Proceedings of NIPS, Vol. 18, 1-8.
41. Seemann, E., Leibe, B., Mikolajczyk, K. and Schiele, B. (2005). An evaluation of local shape-based features for pedestrian detection. Proceedings of the 16th British Machine Vision Conference, Oxford, UK, pp. 11-20.
42. Segvic, S., Remazeilles, A., Diosi, A. and Chaumette, F. (2007). Large scale vision-based navigation without an accurate global reconstruction. Proceedings of CVPR.
43. Thomas, A., Ferrari, V., Leibe, B., Tuytelaars, T., Schiele, B. and Van Gool, L. (2006). Towards multi-view object class detection. Proceedings of CVPR, Vol. 2, pp. 1589-1596.
44. Thomas, A., Ferrari, V., Leibe, B., Tuytelaars, T., Schiele, B. and Van Gool, L. (2008). Using recognition to guide a robot's attention. Robotics: Science and Systems, Vol. IV.
45. Thomas, A., Ferrari, V., Leibe, B., Tuytelaars, T., Schiele, B. and Van Gool, L. (2009). Shape-from recognition: Recognition enables meta-data transfer. Computer Vision and Image Understanding (in press ).
46. Yan, P., Khan, S.M. and Shah, M. (2007). 3D model based object class detection in an arbitrary view. Proceedings of ICCV.