Fast object localization and pose estimation in heavy clutter for robotic bin picking

International Journal of Robotics Research

Volumn 31, Issue 8, 2012, Pages 951-973

  Liu, Ming Yu ^a,b   Tuzel, Oncel ^a   Veeraraghavan, Ashok ^a,c   Taguchi, Yuichi ^a   Marks, Tim K ^a   Chellappa, Rama ^b  

^a MITSUBISHI ELECTRIC RESEARCH LABORATORIES   (United States)

^b UNIVERSITY OF MARYLAND   (United States)

^c RICE UNIVERSITY   (United States)

Author keywords

chamfer matching; integral images; line representation; multi flash camera; pose estimation; Robotic bin picking

Indexed keywords

CHAMFER MATCHING; INTEGRAL IMAGES; LINE REPRESENTATION; POSE ESTIMATION; ROBOTIC BIN PICKING;

ALGORITHMS; BINS; CAMERAS; IMAGE MATCHING; IMAGE RECOGNITION; IMAGE SEGMENTATION; ROBOTICS; THREE DIMENSIONAL;

OBJECT RECOGNITION;

EID: 84863639778     PISSN: 02783649     EISSN: 17413176     Source Type: Journal    
DOI: 10.1177/0278364911436018     Document Type: Article

References (55)

1. Agarwal A, Triggs B. Recovering 3D human pose from monocular images. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2006 ; 28: 44-58 (Pubitemid 46395303)
2. Agrawal A, Sun Y, Barnwell J, Raskar R. Vision-guided robot system for picking objects by casting shadows. The International Journal of Robotics Research. 2010 ; 29: 155-173
3. Bariya P, Nishino K. Scale-hierarchical 3D object recognition in cluttered scenes. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition ; 2010 ; 2010..
4. Barrow HG, Tenenbaum JM, Bolles RC, Wolf HC. Parametric correspondence and chamfer matching: Two new techniques for image matching. Proceedings of the 5th international joint conference on Artificial intelligence ; 1977 ; 1977. 659.
5. Basri R, Jacobs DW. Lambertian reflectance and linear subspaces. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2003 ; 25: 218-233
6. Bay H, Ess A, Tuytelaars T, Gool LJV. Speeded-up robust features (SURF). Computer Vision and Image Understanding. 2008 ; 110: 346-359
7. Beleznai C, Bischof H. Fast human detection in crowded scenes by contour integration and local shape estimation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition ; 2009 ; 2009. 2246.
8. Belongie S, Malik J, Puzicha J. Shape matching and object recognition using shape contexts. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2002 ; 24: 509-522 (Pubitemid 34448769)
9. Berg AC, Berg TL, Malik J. Shape matching and object recognition using low distortion correspondences. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition ; 2005 ; 2005. 26.
10. Boyd S, Vandenberghe L Convex Optimization. Cambridge: Cambridge University Press ; 2004:
11. Canny J. A computational approach to edge detection. IEEE Transactions on Pattern Analysis and Machine Intelligence. 1986 ; 8: 679-698
12. Cui Y, Schuon S, Derek C, Thrun S, Theobalt C. 3D shape scanning with a time-of-flight camera. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition ; 2010 ; 2010..
13. Dalal N, Triggs B. Histograms of oriented gradients for human detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition ; 2005 ; 2005. 886.
14. Danielsson O, Carlsson S, Sullivan J. Automatic learning and extraction of multi-local features. Proceedings of the IEEE International Conference on Computer Vision ; 2009 ; 2009..
15. DeMenthon D, Davis L. Model-based object pose in 25 lines of code. Proceedings of the European Conference on Computer Vision ; 1992 ; 1992. 335.
16. Drost B, Ulrich M, Navab N, Ilic S. Model globally, match locally: Efficient and robust 3D object recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition ; 2010 ; 2010. 998.
17. Duygulu P, Barnard K, de Freitas JFG, Forsyth DA. Object recognition as machine translation: Learning a lexicon for a fixed image vocabulary. Proceedings of the European Conference on Computer Vision ; 2002 ; 2002. 97.
18. Fei-Fei L, Fergus R, Perona P. One-shot learning of object categories. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2006 ; 28: 594-611 (Pubitemid 43264657)
19. Felzenszwalb P, Huttenlocher D Distance Transforms of Sampled Functions. Cornell Computing and Information Science ; 2004:
20. Felzenszwalb P, Schwartz J. Hierarchical matching of deformable shapes. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition ; 2007 ; 2007..
21. Ferrari V, Fevrier L, Jurie F, Schmid C. Groups of adjacent contour segments for object detection. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2008 ; 30: 36-51 (Pubitemid 350168354)
22. Ferrari V, Jurie F, Schmid C. From images to shape models for object detection. International Journal of Computer Vision. 2010 ; 87: 284-303
23. Ferrari V, Tuytelaars T, Gool LV. Object detection by contour segment networks. Proceedings of the European Conference on Computer Vision ; 2006 ; 2006. 14.
24. Fischler MA, Bolles RC. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Graphics and Image Processing. 1981 ; 24: 381-395
25. Gavrila DM. Multi-feature hierarchical template matching using distance transforms. Proceedings of the IEEE International Conference on Pattern Recognition ; 1998 ; 1998. 439.
26. Grimson E, Lozano-Pérez T. Model-based recognition and localization from sparse range or tactile data. The International Journal of Robotics Research. 1984 ; 3: 3-35 (Pubitemid 14661313)
27. Horn BKP. Closed-form solution of absolute orientation using unit quaternions. Journal of the Optical Society A. 1987 ; 4: 629-642
28. Johnson AE, Hebert M. Using spin images for efficient object recognition in cluttered 3d scenes. IEEE Transactions on Pattern Analysis and Machine Intelligence. 1999 ; 21: 433-449
29. Lazebnik S, Schmid C, Ponce J. Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition ; 2006 ; 2006. 2169.
30. Ling H, Jacobs DW. Shape classification using the inner-distance. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2007 ; 29: 286-299 (Pubitemid 46420888)
31. Liu M-Y, Tuzel O, Veeraraghavan A, Chellappa R. Fast directional chamfer matching. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition ; 2010a ; 2010a..
32. Liu M-Y, Tuzel O, Veeraraghavan A, Chellappa R, Agrawal A, Okuda H. Pose estimation in heavy clutter using a multi-flash camera. Proceedings of the IEEE International Conference on Robotics and Automation ; 2010b ; 2010b..
33. Lowe D. Three-dimensional object recognition from single two-dimensional images. Artificial Intelligence. 1987 ; 31: 355-395 (Pubitemid 17574777)
34. Lowe D. Fitting parameterized three-dimensional models to images. IEEE Transactions on Pattern Analysis and Machine Intelligence. 1991 ; 13: 441-450 (Pubitemid 21676525)
35. Lowe DG. Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision. 2004 ; 60: 91-110
36. Mori G, Malik J. Estimating human body configurations using shape context matching. Proceedings of the European Conference on Computer Vision ; 2002 ; 2002..
37. Mori G, Ren X, Efros AA, Malik J. Recovering human body configurations: Combining segmentation and recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition ; 2004 ; 2004. 326.
38. Nelson B, Papanikolopoulos N, Khosla P. Robotic visual servoing and robotic assembly tasks. IEEE Robotics and Automation Magazine. 1996 ; 3: 23-31 (Pubitemid 126566748)
39. Niebles JC, Fei-Fei L. A hierarchical model of shape and appearance for human action classification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition ; 2007 ; 2007..
40. Oliva A, Torralba A. Modeling the shape of the scene: A holistic representation of the spatial envelope. International Journal of Computer Vision. 2001 ; 42: 145-175 (Pubitemid 32680801)
41. Olson CF, Huttenlocher DP. Automatic target recognition by matching oriented edge pixels. IEEE Transactions on Pattern Analysis and Machine Intelligence. 1997 ; 6: 103-113 (Pubitemid 127768360)
42. Raskar R, Tan K-H, Feris R, Yu J, Turk M. Non-photorealistic camera: depth edge detection and stylized rendering using multi-flash imaging. ACM Transactions on Graphics. 2004 ; 23: 679-688
43. Ravishankar S, Jain A, Mittal A. Multi-stage contour based detection of deformable objects. Proceedings of the European Conference on Computer Vision ; 2008 ; 2008. 483.
44. Scharstein D, Szeliski R. High-accuracy stereo depth maps using structured light. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition ; 2003 ; 2003..
45. Shirai Y, Inoue H. Guiding a robot by visual feedback in assembling tasks. Pattern Recognition. 1973 ; 5: 99-108
46. Shotton J, Blake A, Cipolla R. Multi-scale categorical object recognition using contour fragments. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2008 ; 30: 1270-1281
47. Sigal L, Black MJ HumanEva: Synchronized Video and Motion Capture Dataset for Evaluation of Articulated Human Motion. Brown University ; 2006a:
48. Sigal L, Black MJ. Measure locally, reason globally: Occlusion-sensitive articulated pose estimation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition ; 2006b ; 2006b. 2041.
49. Stein F, Medioni G. Structural indexing: Efficient 3-D object recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence. 1992 ; 14: 125-145
50. Sudderth EB, Torralba A, Freeman WT, Willsky AS. Learning hierarchical models of scenes, objects, and parts. Proceedings of the IEEE International Conference on Computer Vision ; 2005 ; 2005. 1331.
51. Thayananthan A, Stenger B, Torr PHS, Cipolla R. Shape context and chamfer matching in cluttered scenes. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition ; 2003 ; 2003. 127.
52. Tuzel O, Porikli F, Meer P. Pedestrian detection via classification on riemannian manifolds. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2008 ; 30: 1713-1727
53. Viola P, Jones M. Rapid object detection using a boosted cascade of simple features. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition ; 2001 ; 2001. 511.
54. Zhang Z. Iterative point matching for registration of free-form curves and surfaces. International Journal of Computer Vision. 1994 ; 13: 119-152
55. Zhu Q, Wang L, Wu Y, Shi J. Contour context selection for object detection: A set-to-set contour matching approach. Proceedings of the European Conference on Computer Vision ; 2008 ; 2008. 774.