Contextual object category recognition for RGB-D scene labeling

Robotics and Autonomous Systems

Volumn 62, Issue 2, 2014, Pages 241-256

  Ali, Haider ^a   Shafait, Faisal ^b   Giannakidou, Eirini ^c   Vakali, Athena ^c   Figueroa, Nadia ^d   Varvadoukas, Theodoros ^d   Mavridis, Nikolaos ^d  

^a GERMAN AEROSPACE CENTER DLR   (Germany)

^b UNIVERSITY OF WESTERN AUSTRALIA   (Australia)

^c ARISTOTLE UNIVERSITY OF THESSALONIKI   (Greece)

^d NEW YORK UNIVERSITY ABU DHABI   (United Arab Emirates)

Author keywords

3D scene labeling; Contextual modeling; Object recognition; RGB D scenes; Social media

Indexed keywords

3D SCENES; CONTEXTUAL MODELING; IMAGING TECHNOLOGY; OBJECT CATEGORY RECOGNITION; RGB-D SCENES; SOCIAL MEDIA; SOCIAL MEDIA MININGS; UNIVERSITY OF WASHINGTON;

THREE DIMENSIONAL;

OBJECT RECOGNITION;

EID: 84891488671     PISSN: 09218890     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.robot.2013.10.001     Document Type: Article

References (52)

1. K. Lai, L. Bo, X. Ren, D. Fox, A large-scale hierarchical multi-view RGB-D object dataset, in: Robotics and Automation, ICRA, Shanghai, China, pp. 1817-1824.
2. N. Silberman, D. Hoiem, P. Kohli, R. Fergus, Indoor segmentation and support inference from RGBD images, in: 2012 European Conference on Computer Vision, ECCV, Florence, Italy, pp. 746-760.
3. D.G. Lowe Distinctive image features from scale-invariant keypoints International Journal of Computer Vision 60 2004 91 110
4. H. Bay, A. Ess, T. Tuytelaars, and L. van Gool SURF: speeded up robust features Computer Vision and Image Understanding 110 2008 346 359
5. P. Henry, M. Krainin, E. Herbst, X. Ren, and D. Fox RGB-D mapping: using kinect-style depth cameras for dense 3D modeling of indoor environments International Journal of Robotics Research 31 2012 647 663
6. X. Ren, L. Bo, D. Fox, RGB-(D) scene labeling: features and algorithms, in: IEEE Conference on Computer Vision and Pattern Recognition, 2012, CVPR 2012, 2012, pp. 2759-2766.
7. R. Rusu, S. Cousins, 3D is here: point cloud library, in: Robotics and Automation, ICRA, 2011.
8. L.A. Alexandre, 3D descriptors for object and category recognition: a comparative evaluation, in: Workshop on Color-Depth Camera Fusion in Robotics at the 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Vilamoura, Portugal.
9. F. Tombari, S. Salti, L. Di Stefano, A combined texture-shape descriptor for enhanced 3D feature matching, in: 2011 18th IEEE International Conference on Image Processing, ICIP, pp. 809-812.
10. N. Figueroa, H. Ali, F. Schmidt, 3D registration for verification of humanoid Justin's upper body kinematics, in: 2012 Ninth Conference on Computer and Robot Vision, CRV, pp. 276-283.
11. M. Blum, J.T. Springenberg, J. Wülfing, M. Riedmiller, On the applicability of unsupervised feature learning for object recognition in RGB-D data, in: Workshop on Deep Learning and Unsupervised Feature Learning at the NIPS 2011, Granada, Spain.
12. K. Lai, L. Bo, X. Ren, D. Fox, Detection-based object labeling in 3D scenes, in: Robotics and Automation, ICRA, 2012, pp. 1330-1337.
13. L. Bo, X. Ren, D. Fox, Unsupervised feature learning for RGB-D based object recognition, in: Experimental Robotics, ISER, 2012.
14. H. Ali, F. Shafait, E. Giannakidou, A. Vakali, N. Figueroa, T. Varvadoukas, N. Mavridis, Addendum to contextual object category recognition for RGB-D scene labeling, 2013. http://oswinds2.csd.auth.gr/~irini/.
15. M. Blum, J.T. Springenberg, J. Wulfing, and M. Riedmiller A learned feature descriptor for object recognition in RGB-D data Robotics and Automation, 2012 ICRA 2012 IEEE 1298 1303
16. E. Nascimento, G. Oliveira, M. Campos, A. Vieira, W. Schwartz, Brand: a robust appearance and depth descriptor for RGB-D images, in: Intelligent Robots and Systems, IROS, 2012, pp. 1720-1726.
17. R.B. Rusu, N. Blodow, Z.C. Marton, M. Beetz, Aligning point cloud views using persistent feature histograms, in: 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS, pp. 3384-3391.
18. A. Zaharescu, E. Boyer, K. Varanasi, R. Horaud, Surface feature detection and description with applications to mesh matching, in: Computer Vision and Pattern Recognition, 2009, CVPR 2009, pp. 373-380.
19. A. Kanezaki, Z.-C. Marton, D. Pangercic, T. Harada, Y. Kuniyoshi, M. Beetz, Voxelized shape and color histograms for RGB-D, in: Intelligent Robots and Systems, IROS, 2011, Workshop on Active Semantic Perception and Object Search in the Real World, San Francisco.
20. R.B. Rusu, G.R. Bradski, R. Thibaux, J. Hsu, Fast 3D recognition and pose using the viewpoint feature histogram, in: IEEE Intelligent Robots and Systems, IROS, 2010, pp. 2155-2162.
21. T. Malisiewicz, A. Efros, Recognition by association via learning per-exemplar distances, in: IEEE Conference on Computer Vision and Pattern Recognition, 2008, CVPR 2008, pp. 1-8.
22. S. Golder, and B. Huberman The structure of collaborative tagging systems Journal of Information Science 32 2005 198 208
23. C. Marlow, M. Naaman, D. Boyd, M. Davis, HT06, tagging paper, taxonomy, Flickr, academic article, to read, in: Hypertext and Hypermedia, Odense, Denmark, 2006, pp. 31-40.
24. X. Olivares, M. Ciaramita, R. van Zwol, Boosting image retrieval through aggregating search results based on visual annotations, in: Multimedia, Vancouver, British Columbia, Canada, 2008, pp. 189-198.
25. L. Kennedy, M. Naaman, S. Ahern, R. Nair, T. Rattenbury, How Flickr helps us make sense of the world: context and content in community-contributed media collections, in: Multimedia, 2007, pp. 631-640.
26. D. Crandall, L. Backstrom, D. Huttenlocher, J. Kleinberg, Mapping the World's photos, in: World Wide Web, Madrid, 2009, pp. 761-770.
27. T. Rattenbury, N. Good, M. Naaman, Towards automatic extraction of event and place semantics from Flickr tags, in: Research and Development in Information Retrieval, Amsterdam, 2007, pp. 103-110. (Pubitemid 350164950)
28. T. Quack, B. Leibe, L. Van Gool, World-scale mining of objects and events from community photo collections, in: Content-based Image and Video Retrieval, Niagara Falls, Canada, 2008, pp. 47-56.
29. G. Begelman, P. Keller, F. Smadja, Automated tag clustering: improving search and exploration in the tag space, in: WWW'06 Conference on Collaborative Web Tagging Workshop, Edinburgh, UK, 2008, pp. 22-26.
30. F. Eggenberger, and G. Polya Uber die statistik verketter vorgage (the statistics of chained operations) ZAMM - Journal of Applied Mathematics and Mechanics 1 1923 279 289
31. H. Halpin, V. Robu, H. Shepherd, The complex dynamics of collaborative tagging, in: World Wide Web, Banff, 2007, pp. 211-220. (Pubitemid 47582251)
32. A. Nüchter, and J. Hertzberg Towards semantic maps for mobile robots Robotics and Autonomous Systems 56 2008 915 926
33. X. Xiong, and D. Huber Using context to create semantic 3D models of indoor environments Proceedings of the British Machine Vision Conference 2010 BMVA Press 45.1 45.11
34. H. Koppula, A. Anand, T. Joachims, A. Saxena, Semantic labeling of 3D point clouds for indoor scenes, in: Conference on Neural Information Processing Systems, NIPS, 2011, pp. 244-252.
35. A. Oliva, and A. Torralba Modeling the shape of the scene: a holistic representation of the spatial envelope International Journal of Computer Vision 42 2001 145 175 (Pubitemid 32680801)
36. A. Oliva, and A. Torralba et al. The role of context in object recognition Trends in Cognitive Sciences 11 2007 520 527 (Pubitemid 350181571)
37. C. Galleguillos, A. Rabinovich, and S. Belongie Object categorization using co-occurrence, location and appearance CVPR 2008 2008 IEEE 1 8
38. T. Kollar, and N. Roy Utilizing object-object and object-scene context when planning to find things ICRA, 2009 2009 IEEE 2168 2173
39. Y. Jiang, C. Ngo, S. Chang, Semantic context transfer across heterogeneous sources for domain adaptive video search, in: Multimedia, Beijing, China, 2009, pp. 155-164.
40. E. Chatzilari, S. Nikolopoulos, I. Kompatsiaris, E. Giannakidou, A. Vakali, Leveraging social media for training object detectors, in: Digital Signal Processing, Santorini, Greece, 2009, pp. 232-239.
41. T. Leung, and J. Malik Representing and recognizing the visual appearance of materials using three-dimensional Textons International Journal of Computer Vision 43 2001 29 44 (Pubitemid 32720091)
42. R.-E. Fan, K.-W. Chang, C.-J. Hsieh, X.-R. Wang, and C.-J. Lin LIBLINEAR: a library for large linear classification Journal of Machine Learning Research 9 2008 1871 1874
43. C.-C. Chang, and C.-J. Lin LIBSVM: a library for support vector machines ACM Transactions on Intelligent Systems and Technology 2 2011 27:1 27:27
44. M.A. Fischler, and R.C. Bolles Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography Communications of the ACM 24 1981 381 395
45. R.B. Rusu, Semantic 3D object maps for everyday manipulation in human living environments, Ph.D. Thesis, Computer Science department, Technische Universitaet Muenchen, Germany, 2009.
46. J. Zhang, M. Marszalek, S. Lazebnik, and C. Schmid Local features and kernels for classification of texture and object categories: a comprehensive study International Journal of Computer Vision 73 2007 213 238 (Pubitemid 46181625)
47. A. Janoch, S. Karayev, Y. Jia, J. Barron, M. Fritz, K. Saenko, T. Darrell, A category-level 3-D object dataset: putting the kinect to work, in: Computer Vision Workshops, ICCV Workshops, pp. 1168-1174.
48. C. Cortes, L. Jackel, S. Solla, V. Vapnik, S. Denker, Learning curves: asymptotic values and rate of convergence, in: Neural Information Processing Systems, NIPS, Denver, Colorado, 1993, pp. 327-334.
49. P. Billingsley Convergence of Probability Measures second ed. 1999 John Wiley and Sons USA
50. N. Breslow A generalized Kruskal-Wallis test for comparing k samples to unequal patterns of censorship Biometrika 57 1970 579 594
51. E. Giannakidou, V. Koutsonikola, A. Vakali, I. Kompatsiaris, Co-clustering tags and social data sources, in: Web-Age Information Management, Zhangjiajie, China, 2008, pp. 317-324.
52. D. Koller, and N. Friedman Probabilistic Graphical Models: Principles and Techniques 2009 MIT Press