Contextually guided semantic labeling and search for three-dimensional point clouds

International Journal of Robotics Research

Volumn 32, Issue 1, 2013, Pages 19-34

  Anand, Abhishek ^a   Koppula, Hema Swetha ^a   Joachims, Thorsten ^a   Saxena, Ashutosh ^a  

^a Cornell University ^*  (United States)

Author keywords

3D context; 3D perception; object recognition; object search; parsimonious model; structure learning

Indexed keywords

3D CONTEXT; 3D PERCEPTION; 3D SCENES; CO-OCCURRENCE; CONTEXTUAL INFORMATION; GEOMETRIC RELATIONSHIPS; GRAPHICAL MODEL; LABELINGS; LEARNING APPROACH; OBJECT CLASS; OBJECT SEARCH; POINT CLOUD; RGB IMAGES; SEMANTIC LABELING; STRUCTURE-LEARNING; THREE-DIMENSIONAL POINT CLOUDS; VISUAL APPEARANCE;

CAMERAS; OBJECT RECOGNITION; THREE DIMENSIONAL COMPUTER GRAPHICS;

THREE DIMENSIONAL;

EID: 84872740146     PISSN: 02783649     EISSN: 17413176     Source Type: Journal    
DOI: 10.1177/0278364912461538     Document Type: Article

References (59)

1. Anguelov D, Taskar B, Chatalbashev V, Koller D, Gupta D, Heitz G, Ng A. Discriminative learning of markov random fields for segmentation of 3d scan data. Computer Vision and Pattern Recognition (CVPR) ; 2005 San Diego, USA ; 2005.
2. Batra D, Saxena A. Learning the right model: Efficient max-margin learning in laplacian crfs. Computer Vision and Pattern Recognition (CVPR) ; 2012 Providence, USA ; 2012.
3. Boros E, Hammer P. Pseudo-boolean optimization. Discrete Applied Mathematics. 2002 ; 123 (1-3). 155-225
4. ColletAMartinezMSrinivasaSS (2011) The moped framework: Object recognition and pose estimation for manipulation. International Journal of Robotics Research doi = 10.1177/0278364911401765, eprint = http://ijr.sagepub. com/content/early/2011/03/31/0278364911401765.full.pdf+html.
5. Collet Romea A, Srinivasa S, Hebert M. Structure discovery in multi-modal data: a region-based approach. IEEE International Conference on Robotics and Automation ; 2011 Shanghai, China ; 2011. 665.
6. Csurka G, Dance C, Fan L, Willamowski J, Bray C. Visual categorization with bags of keypoints. Workshop on Statistical Learning in Computer Vision, European Conference on Computer Vision (ECCV) ; 2004 2004 Prague ; 2004 2004. 22.
7. Dalal N, Triggs B. Histograms of oriented gradients for human detection. Computer Vision and Pattern Recognition (CVPR) ; 2005 San Diego, USA ; 2005.
8. Denzler J, Brown C. Information theoretic sensor data selection for active object recognition and state estimation. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2002 ; 24 (2). 145-157
9. Dima C, Vandapel N, Hebert M. Classifier fusion for outdoor obstacle detection. IEEE International Conference on Robotics and Automation ; 2004 Barcelona, Spain ; 2004.
10. Divvala S, Hoiem D, Hays J, Efros A, Hebert M. An empirical study of context in object detection. Computer Vision and Pattern Recognition (CVPR) ; 2009 Miami, USA ; 2009.
11. Douillard B, Fox D, Ramos F, Durrant-Whyte H. Classification and semantic mapping of urban environments. International Journal of Robotics Research. 2011 ; 30 (1). 5-32
12. Felzenszwalb P, McAllester D, Ramanan D. A discriminatively trained, multiscale, deformable part model. Computer Vision and Pattern Recognition (CVPR) ; 2008 Anchorage, USA ; 2008.
13. Finley T, Joachims T. Training structural svms when exact inference is intractable. International Conference on Machine Learning (ICML) ; 2008 Helsinki, Finland ; 2008.
14. Golovinskiy A, Kim VG, Funkhouser T. Shape-based recognition of 3d point clouds in urban environments. International Conference on Computer Vision (ICCV) ; 2009 Kyoto, Japan ; 2009.
15. GouldSBaumstarckPQuigleyMNgAYKollerD (2008) Integrating visual and range data for robotic object detection. In European Conference on Computer Vision Workshop Multi-camera Multi-modal (M2SFA2).
16. Hammer P, Hansen P, Simeone B. Roof duality, complementation and persistency in quadratic 0-1 optimization. Mathematical Programming. 1984 ; 28 (2). 121-155
17. Hedau V, Hoiem D, Forsyth D. Thinking inside the box: Using appearance models and context based on room geometry. European Conference on Computer Vision ; 2010 Crete, Greece ; 2010.
18. Heitz G, Gould S, Saxena A, Koller D. Cascaded classification models: Combining models for holistic scene understanding. Neural Information Processing Systems (NIPS) ; 2008 Vancouver, Canada ; 2008.
19. Heitz G, Koller D. Learning spatial context: Using stuff to find things. European Conference on Computer Vision ; 2008 Marseille, France ; 2008.
20. HoiemDEfrosAAHebertM (2006) Putting objects in perspective. In Computer Vision and Pattern Recognition.
21. Jia Z, Saxena A, Chen T. Robotic object detection: Learning to improve the classifiers using sparse graphs for path planning. International Joint Conference on Artificial Intelligence (IJCAI) ; 2011a Barcelona, Spain ; 2011a.
22. Jia Z, Saxena A, Chen T. Robotic object detection: Learning to improve the classifiers using sparse graphs for path planning. International Joint Conference on Artificial Intelligence (IJCAI) ; 2011b Barcelona, Spain ; 2011b.
23. Jiang Y, Lim M, Zheng C, Saxena A. Learning to place new objects in a scene. Internationnal Journal of Robotics Research. 2012 ; 31 (9). 1021-1043
24. Joachims T, Finley T, Yu C. Cutting-plane training of structural SVMs. Machine Learning. 2009 ; 77 (1). 27-59
25. Koppula H, Anand A, Joachims T, Saxena A. Semantic labeling of 3d point clouds for indoor scenes. Neural Information Processing Systems (NIPS) ; 2011a Granada, Spain ; 2011a.
26. KoppulaH. SAnandAJoachimsTSaxenaA (2011b) Labeling 3d scenes for personal assistant robots. In RSS workshop RGB-D: Advanced Reasoning with Depth Cameras.
27. Lafferty J. D, McCallum A, Pereira F.C.N. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. International Conference on Machine Learning (ICML) ; 2001 Williamstown, USA ; 2001.
28. Lai K, Bo L, Ren X, Fox D. A large-scale hierarchical multi-view rgb-d object dataset. IEEE International Conference on Robotics and Automation ; 2011a Shanghai, China ; 2011a.
29. Lai K, Bo L, Ren X, Fox D. Sparse distance learning for object recognition combining rgb and depth information. IEEE International Conference on Robotics and Automation ; 2011b Shanghai, China ; 2011b.
30. Lalonde JF, Vandapel N, Huber DF, Hebert M. Natural terrain classification using three-dimensional ladar data for ground robot mobility. Journal of Field Robotics. 2006 ; 23: 839-861
31. Laporte C, Arbel T. Efficient discriminant viewpoint selection for active bayesian recognition. International Journal of Computer Vision. 2006 ; 68: 267-287
32. Laporte C, Brooks R, Arbel T. A fast discriminant approach to active object recognition and pose estimation. International Conference on Pattern Recognition (ICPR) ; 2004 Cambridge, UK ; 2004.
33. Lee DC, Gupta A, Hebert M, Kanade T. Estimating spatial layout of rooms using volumetric reasoning about objects and surfaces. Neural Information Processing Systems (NIPS) ; 2010 Vancouver, Canada ; 2010.
34. Leibe B, Cornelis N, Cornelis K, Gool LV. Dynamic 3d scene analysis from a moving vehicle. Computer Vision and Pattern Recognition (CVPR) ; 2007 Minneapolis, USA ; 2007.
35. Li C, Kowdle A, Saxena A, Chen T. Towards holistic scene understanding: Feedback enabled cascaded classification models. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2012 ; 34 (7). 1394-1408
36. Li C, Saxena A, Chen T. θ-mrf: Capturing spatial and semantic structure in the parameters for scene understanding. Neural Information Processing Systems (NIPS) ; 2011 Granada, Spain ; 2011.
37. Ly D, Saxena A, Lipson H. Co-evolutionary predictors for kinematic pose inference from rgbd images. Genetic and Evolutionary Computation Conference (GECCO) ; 2012 Philadelphia, USA ; 2012.
38. Ma J, Chung TH, Burdick J. A probabilistic framework for object search with 6-dof pose estimation. International Journal of Robotics Research. 2011 ; 30 (10). 1209-1228
39. Meger D, Gupta A, Little J. Viewpoint detection models for sequential embodied object category recognition. IEEE International Conference on Robotics and Automation ; 2010 Anchorage, USA ; 2010.
40. Munoz D, Vandapel N, Hebert M. Onboard contextual classification of 3-d point clouds with learned high-order markov random fields. IEEE International Conference on Robotics and Automation ; 2009 Kobe, Japan ; 2009.
41. Murphy KP, Torralba A, Freeman WT. Using the forest to see the trees: a graphical model relating features, objects and scenes. Neural Information Processing Systems (NIPS) ; 2003 Whistler, Canada ; 2003.
42. Perko R, Leonardis A. A framework for visual-context-aware object detection in still images. Computer Vision and Image Understanding. 2010 ; 114: 700-711
43. Quigley M, Batra S, Gould S, Klingbeil E, Le QV, Wellman A, Ng AY. High-accuracy 3d sensing for mobile manipulation: Improving object detection and door opening. IEEE International Conference on Robotics and Automation ; 2009 Kobe, Japan ; 2009.
44. RotherCKolmogorovVLempitskyVSzummerM (2007) Optimizing binary mrfs via extended roof duality. In Computer Vision and Pattern Recognition.
45. Rusu RB, Marton ZC, Blodow N, Dolha M, Beetz M. Towards 3d point cloud based object maps for household environments. Robot. Auton. Syst. 2008 ; 56: 927-941
46. Saxena A, Chung S, Ng A. Learning depth from single monocular images. Neural Information Processing Systems (NIPS) ; 2005 Whistler, Canada ; 2005.
47. Saxena A, Chung S, Ng A. 3-d depth reconstruction from a single still image. International Journal of Computer Vision. 2008 ; 76 (1). 53-69
48. Saxena A, Sun M, Ng A. Y. Make3d: Learning 3d scene structure from a single still image. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2009 ; 31 (5). 824-840
49. Shapovalov R, Velizhev A. Cutting-plane training of non-associative markov network for 3d point cloud segmentation. IEEE International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission (3DIMPVT) ; 2011 Zurich, Switzerland ; 2011.
50. ShapovalovRVelizhevABarinovaO (2010) Non-associative markov networks for 3d point cloud classification. In ISPRS Commission III Symposium - PCV 2010.
51. Sung J, Ponce C, Selman B, Saxena A. Unstructured human activity detection from rgbd images. IEEE International Conference on Robotics and Automation ; 2012 St. Paul, USA ; 2012.
52. Szeliski R, Zabih R, Scharstein D, Veksler O, Kolmogorov V, Agarwala A, Tappen M, Rother C. A comparative study of energy minimization methods for markov random fields with smoothness-based priors. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2008 ;: 1068-1080
53. Taskar B, Chatalbashev V, Koller D. Learning associative markov networks. International Conference on Machine Learning (ICML) ; 2004 Banff, Canada ; 2004.
54. Taskar B, Guestrin C, Koller D. Max-margin markov networks. ; 2003 Whistler, Canada ; 2003.
55. Torralba A. Contextual priming for object detection. International Journal of Computer Vision. 2003 ; 53 (2). 169-191
56. Tsochantaridis I, Hofmann T, Joachims T, Altun Y. Support vector machine learning for interdependent and structured output spaces. International Conference on Machine Learning (ICML) ; 2004 Banff, Canada ; 2004.
57. Xiao J, Quan L. Multiple view semantic segmentation for street view images. International Conference on Computer Vision (ICCV) ; 2009 Kyoto, Japan ; 2009.
58. Xiong X, Huber D. Using context to create semantic 3d models of indoor environments. British Machine Vision Conference (BMVC) ; 2010 Aberystwyth (Wales, UK) ; 2010.
59. Xiong X, Munoz D, Bagnell JA, Hebert M. 3-d scene analysis via sequenced predictions over points and regions. IEEE International Conference on Robotics and Automation ; 2011 Shanghai, China ; 2011.