Scene parsing using a prior world model

International Journal of Robotics Research

Volumn 30, Issue 12, 2011, Pages 1477-1507

  Hager, Gregory D ^a   Wegbreit, Ben ^b  

^a Johns Hopkins University   (United States)

^b CEO Strider Labs Inc   (United States)

Author keywords

3D scene models; Range sensing; recognition; scene interpretation; sensing and perception computer vision

Indexed keywords

3D SCENES; RANGE SENSING; RECOGNITION; SCENE INTERPRETATION; SENSING AND PERCEPTION;

APPROXIMATION ALGORITHMS; COMPUTER VISION; DYNAMICAL SYSTEMS; MODELS; POLYNOMIAL APPROXIMATION; THREE DIMENSIONAL COMPUTER GRAPHICS;

THREE DIMENSIONAL;

EID: 80054765294     PISSN: 02783649     EISSN: 17413176     Source Type: Journal    
DOI: 10.1177/0278364911399340     Document Type: Article

References (80)

1. Al-Hujazi E, Sood A. Range image segmentation with applications to robot bin-picking using vacuum gripper. IEEE Transactions on Systems, Man, and Cybernetics. 1990 ; 20: 1313-1325
2. Allen P, Stamos I, Troccoli A, Smith B, Leordeanu M, Hsu Y. 3D modeling of historic sites using range and image data. IEEE International Conference on Robotics And Automation ; ;. 145.
3. Arman F, Aggarwal JK. Model-based object recognition in dense-range images-a review. ACM Computing Surveys. 1993 ; 25: 5-43
4. Bao S, Sun M, Savarese S. Toward coherent object detection and scene layout understanding. Computer Vision and Pattern Recognition (CVPR). 2010 ;: 65-72
5. Besl P, McKay H. A method for registration of 3-D shapes. IEEE Transactions on Pattern Analysis and Machine Intelligence. 1992 ; 14: 239-256
6. Besl PJ, Jain RC. Three-dimensional object recognition. ACM Computing Surveys. 1985 ; 17: 75-145
7. Biber P, Andreasson H, Duckett T, Schilling A, et al. 3D modeling of indoor environments by a mobile robot with a laser scanner and panoramic camera. IEEE/RSJ International Conference on Intelligent Robotic Systems ; ;..
8. Bicchi A, Kumar V. Robotic grasping and contact: A review. Proceedings of IEEE International Conference on Robotics and Automation ; ;..
9. Bolles R, Fischler M. A RANSAC-based approach to model fitting and its application to finding cylinders in range data. International Joint Conference on Artificial Intelligence. 1981 ;: 637-643 (Pubitemid 14478736)
10. BougetJY (2010) The Matlab Camera Calibration Toolkit. http://www.vision.caltech.edu/bouguetj/calibdoc/.
11. Boutell M, Luo J, Shen X, Brown C. Learning multi-label scene classification. Pattern Recognition. 2004 ; 37: 1757-1771 (Pubitemid 38804465)
12. Burschka D, Hager G. Scene classification from dense disparity maps in indoor environments. International Conference on Pattern Recognition ; ;. 708.
13. Bustos B, Keim D, Saupe D, Schreck T, Vranić D. Feature-based similarity search in 3D object databases. ACM Computing Surveys. 2005 ; 37: 345-387 (Pubitemid 43892669)
14. Campbell RJ, Flynn PJ. A survey of free-form object representation and recognition techniques. Computer Vision and Image Understanding. 2001 ; 81: 166-210 (Pubitemid 32271703)
15. Chaperon T, Goulette F. Extracting cylinders in full 3-D data using a random sampling method and the gaussian image. Proceedings of the the 6th International Fall Workshop Vision, Modeling, and Visualization (VMV '01) ; ;..
16. Chen H, Bhanu B. 3D free-form object recognition in range images using local surface patches. Pattern Recognition Letters. 2007 ; 28: 1252-1262 (Pubitemid 46710181)
17. Chen H, Meer P. Robust regression with projection based m-estimators. International Conference on Computer Vision ; ;. 878.
18. Cheng Y. Mean shift, mode seeking, and clustering. IEEE Transactions on Pattern Analysis and Machine Intelligence. 1995 ; 17: 790-799
19. Chin RT, Dyer CR. Model-based recognition in robot vision. ACM Comput Surv. 1986 ; 18: 67-108
20. Choset H, Lynch K, Hutchinson S, Kantor G, Burgard W, Kavraki L Principles of Robot Motion. Cambridge, MA: MIT Press ; 2005 :
21. Ciocarlie M, Goldfeder C, Allen P. Dexterous grasping via eigengrasps: A low-dimensional approach to a high-complexity problem. Proceedings of the Robotics: Science & Systems 2007 Workshop-Sensing and Adapting to the Real World ; ;..
22. Comaniciu D, Meer P. Mean shift: A robust approach toward feature space analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2002 ; 24: 603-619 (Pubitemid 34550429)
23. Freixenet J, Muñoz X, Raba D, Mart J, Cuf X. Yet another survey on image segmentation: Region and boundary information integration. ECCV '02: Proceedings of the 7th European Conference on Computer Vision-Part III ; London: Springer-Verlag ;. 408.
24. Funkhouser T, Min P, Kazhdan M, Chen J, Halderman A, Dobkin D, et al. A search engine for 3D models. ACM Transactions on Graphics. 2003 ; 22: 83-105 (Pubitemid 44769059)
25. Goldfeder C, Ciocarlie M, Dang H, Allen P. The Columbia grasp database. IEEE International Conference on Robotics and Automation ; ;..
26. Goldfeder C, Ciocarlie M, Peretzman J, Dang H, Allen P. Data-Driven Grasping with Partial Sensor Data. International Conference on Intelligent Robots and Systems ; ;..
27. Grimson W, Lozano-Pérez T, Huttenlocher D Object Recognition by Computer. Cambridge, MA: MIT Press ; 1990 :
28. Hager G, Dewan M, Stewart C. Multiple kernel tracking with SSD. IEEE Computer Society Conference on Computer Vision and Pattern Recognition 1999 ; ;..
29. HagerGWegbreitE (2003) Acquisition of three-dimensional images by an active stereo technique using locally unique patterns. US Patent App 10/703,831.
30. HagerGWegbreitE (2005) System and method for 3D object recognition using range and intensity. US Patent App 11/159,660.
31. HagerGWegbreitE (2006) System and method for recognition in 2D images using 3D class models. US Patent App 11/452,815.
32. HagerGWegbreitE (2008) System and Method for Constructing a 3D Scene Model from an Image. US Patent App 12/287,315.
33. Hähnel D, Burgard W, Thrun S. Learning compact 3D models of indoor and outdoor environments with a mobile robot. Robotics and Autonomous Systems. 2003 ; 44: 15-27
34. Hetzel G, Leibe B, Levi P, Schiele B. 3D object recognition from range images using local feature histograms. IEEE Computer Society Conference On Computer Vision And Pattern Recognition ; ;..
35. Hoiem D, Efros A, Hebert M. Putting objects in perspective. International Journal of Computer Vision. 2008a ; 80: 3-15
36. Hoiem D, Efros AA, Hebert M. Closing the loop on scene interpretation. Proceedings of Computer Vision and Pattern Recognition (CVPR). 2008b ;:
37. Hoover A, Jean-Baptiste G, Jiang X, Flynn PJ, Bunke H, Goldgof DB, et al. An experimental comparison of range image segmentation algorithms. IEEE Transactions on Pattern Analysis and Machine Intelligence. 1996 ; 18: 673-689 (Pubitemid 126771378)
38. Huber D, Hebert M. Fully automatic registration of multiple 3D data sets. Image and Vision Computing. 2003 ; 21: 637-650
39. Huber D, Kapuria A, Donamukkala R, Hebert M. Parts-based 3d object classification. CVPR 04. 2004 ;:
40. Huber P, Ronchetti E Robust Statistics. Wiley-Blackwell ; 2009 :
41. Ikeuchi K. Generating an interpretation tree from a CAD model for 3D-object recognition in bin-picking tasks. International Journal of Computer Vision. 1987 ; 1: 145-165
42. Iyer N, Jayanti S, Lou K, Kalyanaraman Y, Ramani K. Three-dimensional shape searching: state-of-the-art review and future trends. Computer-Aided Design. 2005 ; 37: 509-530 (Pubitemid 40415193)
43. Jaklic A, Leonardis A, Solina F Segmentation and Recovery of Superquadrics. Boston, MA: Kluwer Academic Publishers ; 2000 :
44. Johnson A, Hebert M. Efficient multiple model recognition in cluttered 3-d scenes. Proceedings of Computer Vision and Pattern Recognition (CVPR 98). 1998 ;: 671-678
45. Kazhdan M, Funkhouser T, Rusinkiewicz S. Rotation invariant spherical harmonic representation of 3D shape descriptors. Proceedings of the 2003 Eurographics/ACM SIGGRAPH Symposium on Geometry Processing ; ;. 164.
46. Kristensen S, Estable S, Kossow M, Brösel R. Bin-picking with a solid state range camera. Robotics and Autonomous Systems. 2001 ; 35: 143-151 (Pubitemid 32543579)
47. LaValle S Planning algorithms. Cambridge, UK: Cambridge University Press ; 2006 :
48. Lipson P, Grimson E, Sinha P. Configuration based scene classification and image indexing. IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 1997 ;: 1007-1013
49. Lu L, Toyama K, Hager G. A two level approach for scene recognition. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 05) ; ;. 695.
50. Mian A, Bennamoun M, Owens R. A novel representation and feature matching algorithm for automatic pairwise registration of range images. International Journal of Computer Vision. 2006a ; 66: 19-40 (Pubitemid 43004670)
51. Mian A, Bennamoun M, Owens R. Three-dimensional model-based object recognition and segmentation in cluttered scenes. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2006b ; 28: 1584-1601 (Pubitemid 46405079)
52. Miller A, Allen P. GraspIt!: A versatile simulator for grasping analysis. Proceedings of the ASME Dynamic Systems and Control Division. 2000 ;:
53. PiaterJGrupenR (2002) Learning appearance features to support robotic manipulation. In: Proceedings of the Cognitive Vision Workshop. Electronically published: http://www.montefiore.ulg.ac.be/piater/papers/Piater-2002-CogVis.pdf.
54. Plaku E, Hager G. Sampling-based motion and symbolic action planning with geometric and differential constraints. Proceedings of ICRA 2010. 2010 ;:
55. Rao K, Nevatia R. Computing volume descriptions from sparse 3-d data. International Journal of Computer Vision. 1988 ; 2: 33-50
56. Saxena A, Driemeyer J, Ng A. Robotic grasping of novel objects using vision. The International Journal of Robotics Research. 2008a ; 27: 157
57. Saxena A, Wong L, Ng A. Learning grasp strategies with partial shape information. AAAI Conference on Artificial Intelligence ; ;. 1491.
58. Serrano N, Savakis A, Luo J. A computationally efficient approach to indoor/outdoor scene classification. International Conference on Pattern Recognition ; ;. 146.
59. SkarbekWKoschanA (1994) Colour Image Segmentation-A Survey. Technical Report, Institute for Technical Informatics, Technical University of Berlin. citeseer.ist.psu.edu/skarbek94colour.html.
60. Skocaj D, Leonardis A. Robust recognition and pose determination of 3-D objects using range images in eigenspace approach. Proceedings of 3DIM 01. 2001 ;: 171-178
61. Solina F, Bajcsy R. Recovery of parametric models from range images: The case for superquadrics with global deformations. IEEE Transactions on Pattern Analysis and Machine Intelligence. 1990 ; 12: 131-147 (Pubitemid 20666139)
62. Stamos I, Allen P. 3-D model construction using range and image data. Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2000 ; ;..
63. Sudderth E, Torralba A, Freeman W, Willsky A. Learning hierarchical models of scenes, objects, and parts. Proceedings of the Tenth IEEE International Conference on Computer Vision ; ;. 1331.
64. Sun Y, Paik J, Koschan A, Page D, Abidi M. Point fingerprint: a new 3-D object representation scheme. IEEE Transactions on Systems, Man, and Cybernetics, Part B. 2003 ; 33: 712-717
65. Surmann H, Nüchter A, Hertzberg J. An autonomous mobile robot with a 3D laser range finder for 3D exploration and digitalization of indoor environments. Robotics and Autonomous Systems. 2003 ; 45: 181-198
66. Tangelder J, Veltkamp R. A survey of content based 3D shape retrieval methods. Multimedia Tools and Applications. 2008 ; 39: 441-471
67. TaylorG (2004) Robust Perceptions and Control for Humanoid Robots in Unstructured Environments using Vision. PhD Thesis. Monash University, Australia.
68. Taylor G, Kleeman L. Grasping unknown objects with a humanoid robot. Proceedings of the 2002 Australasian Conference on Robotics and Automation ; ;. 27.
69. Thrun S, Wegbreit B. Shape from symmetry. Proceedings of the International Conference on Computer Vision (ICCV) ; ;. 1824.
70. Torralba A. Contextual priming for object detection. International Journal of Computer Vision. 2003 ; 53: 169-191
71. Torralba A, Murphy K, Freeman W, Rubin M. Context-based vision system for place and object recognition. Proceedings of the Ninth IEEE International Conference on Computer Vision ; ;. 273.
72. van den Bergen G Collision Detection in Interactive 3D Environments. San Mateo, CA: Morgan Kaufmann ; 2004 :
73. Wang H, Mirota D, Hager GD. A generalized kernel consensus-based robust estimator. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2010 ; 32: 178-184
74. Wang H, Mirota D, Ishii M, Hager G. Robust motion estimation and structure recovery from endoscopic image sequences with an adaptive scale kernel consensus estimator. IEEE Conference on Computer Vision and Pattern Recognition ; ;. 1.
75. Weld D. Recent advances in AI planning. AI magazine. 1999 ; 20: 93
76. Williamson T, Thorpe C. A trinocular stereo system for highway obstacle detection. IEEE International Conference on Robotics and Automation ; ;. 2267.
77. Wixson L, Ballard D. Using intermediate objects to improve the efficiency of visual search. International Journal of Computer Vision. 1994 ; 12: 209-230
78. Wixson LE Computer Science Dept University of Rochester ; 1992 1992 :
79. Wu C, Clipp B, Li X, Frahm J, Pollefeys M. 3D model matching with Viewpoint-Invariant Patches (VIP). IEEE Conference on Computer Vision and Pattern Recognition ; ;. 1.
80. Zhang Z. A flexible new technique for camera calibration. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2000 ; 22: 1330-1334