Manipulator and object tracking for in-hand 3D object modeling

International Journal of Robotics Research

Volumn 30, Issue 11, 2011, Pages 1311-1327

  Krainin, Michael ^a   Henry, Peter ^a   Ren, Xiaofeng ^b   Fox, Dieter ^a,b  

^a University of Washington   (United States)

^b INTEL CORPORATION   (United States)

Author keywords

Cognitive robotics; learning and adaptive systems; personal robots; sensing and perception computer vision; sensor fusion; visual tracking

Indexed keywords

COGNITIVE ROBOTICS; LEARNING AND ADAPTIVE SYSTEM; PERSONAL ROBOT; SENSING AND PERCEPTION; SENSOR FUSION; VISUAL TRACKING;

ADAPTIVE SYSTEMS; COMPUTER VISION; CONTENT BASED RETRIEVAL; MANIPULATORS; OBJECT RECOGNITION; ROBOTS; SEMANTICS; SENSORS; TRACKING (POSITION);

THREE DIMENSIONAL;

EID: 80053946706     PISSN: 02783649     EISSN: 17413176     Source Type: Journal    
DOI: 10.1177/0278364911403178     Document Type: Article

References (46)

1. Athitsos V, Sclaroff S. Estimating 3d hand pose from a cluttered image. IEEE Computer Society Conference on Computer Vision and Pattern Recognition ; 2003 ; 2003. 432.
2. Balasubramanian R, Xu L, Brook P, Smith J, Matsuoka Y. Human-guided grasp measures improve grasp robustness on physical robot. Proceedings of the IEEE International Conference on Robotics & Automation (ICRA) ; 2010 ; 2010. 2294.
3. Berenson D, Srinivasa S. Grasp synthesis in cluttered environments for dexterous hands. Proceedings of the IEEE-RAS International Conference on Humanoid Robots (Humanoids) ; 2008 ; 2008..
4. Chen Y, Medioni G. Object modelling by registration of multiple range images. Image Vision Computing. 1992 ; 10: 145-155
5. Ciocarlie M, Goldfeder C, Allen P. Dimensionality reduction for hand-independent dexterous robotic grasping. Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) ; 2007 ; 2007..
6. Collet Romea A, Berenson D, Srinivasa S, Ferguson D. Object recognition and full pose registration from a single image for robotic manipulation. Proceedings of the IEEE International Conference on Robotics & Automation (ICRA) ; 2009 ; 2009..
7. Curless B, Levoy M. A volumetric method for building complex models from range images. ACM Transactions on Graphics (Proceedings of SIGGRAPH). 1996 ;:
8. DiankovR (2010) Automated Construction of Robotic Manipulation Programs. PhD thesis, Robotics Institute, Carnegie Mellon University. http://www. programmingvision.com/rosen-diankov-thesis.pdf.
9. Druon S, Aldon M, Crosnier A. Color constrained ICP for registration of large unstructured 3d color data sets. International Conference on Information Acquisition ; 2006 ; 2006. 249.
10. Ganapathi V, Plagemann C, Koller D, Thrun S. Real time motion capture using a single time-of-flight camera. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR) ; 2010 ; 2010..
11. Glover J, Rus D, Roy N. Probabilistic models of object geometry with application to grasping. International Journal of Robotics Research (IJRR). 2009 ; 28: 999-1019
12. Godin G, Laurendeau D, Bergevin R. A method for the registration of attributed range images. International Conference on 3D Digital Imaging and Modeling ; 2001 ; 2001. 179.
13. Grisetti G, Grzonka S, Stachniss C, Pfaff P, Burgard W. Efficient estimation of accurate maximum likelihood maps in 3d. Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) ; 2007 San Diego, CA, USA ; 2007..
14. Habbecke M, Kobbelt L. A surface-growing approach to multi-view stereo reconstruction. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR) ; 2007 ; 2007..
15. Henry P, Krainin M, Herbst E, Ren X, Fox D. RGB-D mapping: Using depth cameras for dense 3d modeling of indoor environments. In:. Proceedings of the International Symposium on Experimental Robotics (ISER) ; 2010 New Delhi, India ; 2010..
16. JohnsonA (1997) Spin-Images: A Representation for 3-D Surface Matching. PhD thesis, Robotics Institute, Carnegie Mellon University.
17. Johnson A, Kang SB. Registration and integration of textured 3-d data. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (3DIM '97) ; 1997 ; 1997. 234.
18. KashaniAOwenWSHimmelmanNLawrencePDHallRA (2010) Laser Scanner-based End-effector Tracking and Joint Variable Extraction for Heavy Machinery. The International Journal of Robotics Research. http://ijr.sagepub.com/cgi/content/ abstract/0278364909359316v1.
19. Kawewong A, Tangruamsub S, Hasegawa O. Wide-baseline visible features for highly dynamic scene recognition. Proceedings of the 13th International Conference on Computer Analysis of Images and Patterns (CAIP) ; 2009 ; 2009. 723.
20. Kazhdan M, Bolitho M, Hoppe H. Poisson surface reconstruction. Proceedings of the fourth Eurographics Symposium on Geometry Processing ; 2006 ; 2006..
21. Kraft D, Pugeault N, Baseski E, Popovic M, Kragic D, Kalkan S, et al. Birth of the object: Detection of objectness and extraction of object shape through object-action complexes. International Journal of Humanoid Robotics. 2008 ; 5: 247-265
22. Krainin M, Curless B, Fox D. Autonomous Generation of Complete 3D Object Models Using Next Best View Manipulation Planning. Proceedings of the IEEE International Conference on Robotics & Automation (ICRA) ; 2011 Shanghai, China ; 2011. 5031.
23. Lai K, Fox D. 3D laser scan classification using web data and domain adaptation. Proceedings of Robotics: Science and Systems (RSS). 2009 ;:
24. Lemuz-López R, Arias-Estrada M. Iterative closest SIFT formulation for robust feature matching. Proceedings of the Second International Symposium on Advances in Visual Computing ; 2006 Springer ; 2006. 502.
25. Levoy M, Pulli K, Curless B, Rusinkiewicz S, Koller D, Pereira L, et al. The Digital Michelangelo Project: 3d scanning of large statues. ACM Transactions on Graphics (Proceedings of SIGGRAPH). 2000 ;:
26. LiWHKleemanL (2009) Interactive learning of visually symmetric objects. In: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)St Louis, MO, USA. http://www.waiholi.com/papers/li-kleeman- iros09-learn.pdf.
27. Mündermann L, Corazza S, Andriacchi TP. Accurately measuring human movement using articulated ICP with soft-joint constraints and a repository of articulated models. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR) ; 2007 ; 2007..
28. Pai D, van den Doel K, James D, Lang J, Lloyd J, Richmond J, et al. Scanning physical interaction behavior of 3d objects. ACM Transactions on Graphics (Proceedings of SIGGRAPH). 2001 ;: 87-96 (Pubitemid 33047293)
29. Pan Q, Reitmayr G, Drummond T. ProFORMA: Probabilistic Feature-based On-line Rapid Model Acquisition. Proceedings of the 20th British Machine Vision Conference (BMVC) ; 2009 London ; 2009..
30. Pellegrini S, Schindler K, Nardi D. A generalisation of the ICP algorithm for articulated bodies. British Machine Vision Conference (BMVC'08) ; 2008 ; 2008..
31. Pfister H, Zwicker M, van Baar J, Gross M. Surfels: surface elements as rendering primitives. Proceedings of the 27th annual conference on Computer Graphics and Interactive Techniques ; 2000 ; 2000. 335.
32. PrimeSense Home Page. (2010) http://www.primesense.com/.
33. Rasolzadeh B, Bjorkman M, Huebner K, Kragic D. An active vision system for detecting, fixating and manipulating objects in real world. International Journal of Robotics Research (IJRR). 2009 ;:
34. Rusinkiewicz S, Hall-Holt O, Levoy M. Real-time 3D model acquisition. ACM Transactions on Graphics (Proceedings of SIGGRAPH). 2002 ; 21: 438-446
35. Sato Y, Wheeler M, Ikeuchi K. Object shape and reflectance modeling from observation. ACM Transactions on Graphics (Proceedings of SIGGRAPH). 1997 ;: 379-387
36. Saxena A, Driemeyer J, Ng A. Robotic grasping of novel objects using vision. International Journal of Robotics Research (IJRR). 2008 ; 27: 157-173 (Pubitemid 351169712)
37. Sharp GC, Lee SW, Wehe DK. ICP registration using invariant features. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI). 2002 ; 24: 90-102 (Pubitemid 34325618)
38. Strobl K, Mair E, Bodenmuller T, Kielhofer S, Sepp W, Suppa M, et al. The self-referenced DLR 3d-modeler. Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) ; 2009 ; 2009. 21.
39. Sturm J, Plagemann C, Burgard W. Body schema learning for robotic manipulators from visual self-perception. Journal of Physiology-Paris. 2009 ; 103: 220-231
40. Sudderth EB, Mandel MI, Freeman WT, Willsky AS. Visual hand tracking using nonparametric belief propagation. Computer Vision and Pattern Recognition Workshop. 2004 ; 12: 189
41. Triebel R, Frank B, Meyer J, Burgard W. First steps towards a robotic system for flexible volumetric mapping of indoor environments. Proceedings of the 5th IFAC Symposium on Intelligent Autonomous Vehicles ; 2004 ; 2004..
42. Turk G, Levoy M ACM Transactions on Graphics (Proceedings of SIGGRAPH). New York, NY, USA: ACM ; 1994: 311-318.
43. Ude A, Omrcen D, Cheng G. Making object learning and recognition an active process. International Journal of Humanoid Robotics. 2008 ; 5: 267-286
44. Weik S. Registration of 3-d partial surface models using luminance and depth information. International Conference on 3D Digital Imaging and Modeling ; 1997 ; 1997. 93.
45. Weise T, Wismer T, Leibe B, Gool LV. In-hand scanning with online loop closure. IEEE International Workshop on 3-D Digital Imaging and Modeling ; 2009 ; 2009..
46. WuC (2007) SiftGPU: A GPU implementation of scale invariant feature transform (SIFT). http://cs.unc.edu/ccwu/siftgpu.