A Dataset for Improved RGBD-Based Object Detection and Pose Estimation for Warehouse Pick-and-Place

IEEE Robotics and Automation Letters

Volumn 1, Issue 2, 2016, Pages 1179-1185

  Rennie, Colin ^a   Shome, Rahul ^a   Bekris, Kostas E ^a   De Souza, Alberto F ^b  

^a RUTGERS UNIVERSITY   (United States)

^b FEDERAL UNIVERSITY OF ESPÍRITO SANTO   (Brazil)

Author keywords

Manipulators; Manufacturing automation; Object detection; Object recognition; Robot vision systems

Indexed keywords

CLUTTER (INFORMATION THEORY); MANIPULATORS; OBJECT DETECTION; OBJECT RECOGNITION; WAREHOUSES;

DEPTH INFORMATION; GROUND TRUTH DATA; IMPROVE PERFORMANCE; LOW ILLUMINATIONS; MANUFACTURING AUTOMATION; POSE ESTIMATION ALGORITHM; REFLECTIVE OBJECTS; ROBOT VISION SYSTEMS;

GESTURE RECOGNITION;

EID: 85058585231     PISSN: None     EISSN: 23773766     Source Type: Journal    
DOI: 10.1109/LRA.2016.2532924     Document Type: Article

References (36)

1. N. Correll et al., "Lessons from the Amazon picking challenge," arxiv.org/abs/1601.05484, 2016.
2. T. Wisspeintner, T. Van Der Zant, L. Iocchi, S. Schiffer, "RoboCup@ Home: Scientific competition and benchmarking for domestic service robots," Interact. Stud., vol. 10, no. 3, pp. 392-426, 2009.
3. S. Hinterstoisser, C. Cagniart, S. Ilic, P. Sturm, N. Navab, P. Fua, V. Lapetit, "Gradient response maps for real-time detection of texture-less objects," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 5, pp. 876-888, May 2012.
4. G. Bradski, "The openCV library," Dr. Dobb's J. Software Tools, vol. 25, no. 11, pp. 120-126, 2000.
5. J. Stuckler, D. Holz, S. Behnke, "Demonstrating everyday manipulation skills in RoboCup@ home," IEEE Robot. Autom. Mag., vol. 19, no. 2, pp. 34-42, Jun. 2012.
6. A. Krizhevsky and G. Hinton, "CIFAR dataset-learning multiple layers of features from tiny images," M.Sc. thesis, Univ. Toronto, Toronto, ON, Canada, 2009.
7. O. Russakovsky et al., "ImageNet large scale visual recognition challenge," Int. J. Comput. Vis., vol. 115, no. 3, pp. 1-42, Apr. 2015.
8. M. Everingham, S. M. A. Eslami, L. Van Gool, C. K. I. Williams, J. Winn, A. Zisserman, "The Pascal visual object classes challenge: A retrospective," Int. J. Comput. Vis., vol. 111, no. 1, pp. 98-136, Jan. 2015.
9. A. Janoch et al., "A category-level 3D object dataset: Putting the kinect to work," in Consumer Depth Cameras for Computer Vision. New York, NY, USA: Springer, 2013, pp. 141-165.
10. N. Silberman, D. Hoiem, P. Kohli, R. Fergus, "Indoor segmentation and support inference from RGBD images," in Proc. Eur. Conf. Comput. Vis. (ECCV), 2012, pp. 746-760.
11. B. Calli, A. Walsman, A. Singh, S. Srinivasa, P. Abbeel, A.M. Dollar, "Benchmarking in manipulation research: The YCB object and model set and benchmarking protocols," arXiv preprint arXiv:1502.03143, 2015.
12. M. Sun, G. Bradski, B.-X. Xu, S. Savarese, "Depth-encoded hough voting for joint object detection and shape recovery," in Computer Vision-ECCV, Crete, Greece, 2010, pp. 658-671.
13. N. Vaskevicius, K. Pathak, A. Ichim, A. Birk, "The Jacobs robotics approach to object recognition and localization in the context of the ICRA'11 solutions in perception challenge," in Proc. IEEE Int. Conf. Robot. Autom. (ICRA), 2012, pp. 3475-3481.
14. K. Lai, L. Bo, X. Ren, D. Fox, "A large-scale hierarchical multi-view RGB-D object dataset," in Proc. IEEE Int. Conf. Robot. Autom. (ICRA), 2011, pp. 1817-1824.
15. S. Hinterstoisser et al., "Model-based training, detection and pose estimation of texture-less 3D objects in heavily cluttered scenes," in Computer Vision-ACCV 2012. New York, NY, USA: Springer, 2013, pp. 548-562.
16. K. Narayan, J. Sha, A. Singh, P. Abbeel, "Range sensor and silhouette fusion for high-quality 3D scanning," in Proc. IEEE Int. Conf. Robot. Autom. (ICRA), 2015, pp. 3617-3624.
17. L. Ma, M. Ghafarianzadeh, D. Coleman, N. Correll, G. Sibley, "Simultaneous localization, mapping and manipulation for unsupervised object discovery," in Proc. IEEE Int. Conf. Robot. Autom. (ICRA), 2015, pp. 1344-1351.
18. L. Ma and G. Sibley, "Unsupervised dense object discovery, detection, tracking and reconstruction," in Computer Vision-ECCV, Zurich, Switzerland, 2014, pp. 80-95.
19. C. Choi and H. I. Cristensen, "3D pose estimation of daily objects using an RGB-D camera," in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst. (IROS), Algarve, Portugal, 2012, pp. 3342-3349.
20. C. Choi, Y. Taguchi, O. Tuzel, M. Liu, S. Ramalingam, "Voting-based pose estimation for robotic assembly using a 3D sensor," in Proc. IEEE Int. Conf. Robot. Autom. (ICRA), 2012, pp. 1724-1731.
21. K. Lai, L. Bo, X. Ren, D. Fox, "A scalable tree-based approach for joint object and pose recognition," in Proc. AAAI Conf. Artif. Intell., 2011, pp. 1474-1480.
22. A. Aldoma et al., "CAD-model recognition and 6DOF pose estimation using 3D cues," in Proc. Int. Conf. Comput. Vis. Workshops, 2011, pp. 585-592.
23. M. Pham, O. Woodford, F. Perbet, A. Maki, B. Stenger, R. Cipolla, "A new distance for scale-invariant 3D shape recognition and registration," in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), 2011, pp. 145-152.
24. M. Muja, R. B. Rusu, G. Bradski, D. G. Lowe, "REIN-A fast, robust, scalable recongition infrastructure," in Proc. IEEE Int. Conf. Robot. Autom. (ICRA), Shanghai, China, 2011, pp. 2939-2946.
25. E. Kim and G. Medioni, "3D object recognition in range images using visibility context," in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst. (IROS), 2011, pp. 3800-2807.
26. K. K. B. Steder, R. B. Rusu, W. Burgard, "NARF: 3D range image features for object recognition," in Proc. (IEEE/RSJ IROS) Workshop Defin. Solv. Realistic Percept. Prob. Pers. Robot., Taipei, Taiwan, Oct. 18, 2010.
27. B. Drost, M. Ulrich, N. Navab, S. Ilic, "Model globally, match locally: Efficient and robust 3D object recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), 2010, pp. 998-1005.
28. R. Triebel, J. Shin, R. Siegwart, "Segmentation and unsupervised part-based discovery of repetive objects," in Robotics: Science and Systems (RSS), Ann Arbor, MI, USA, 2010.
29. A. Collet, D. Berenson, S. S. Srinivasa, D. Ferguson, "Object recognition and full pose registration from a single image for robotic manipulation," in Proc. IEEE IEEE Int. Conf. Robot. Autom. (ICRA), 2009, pp. 48-55.
30. M. Quigley et al., "ROS: An open-source robot operating system," in Proc. ICRA Workshop Open Source Software, 2009, vol. 3, no. 3.2, p. 5.
31. M. D. Ozturk, M. Ersen, M. Kapotoglu, C. Koc, S. Sariel-Talay, H. Yalcin, "Scene interpretation for self-aware cognitive robots," in Proc. AAAI-14 Spring Symp. Qual. Represent. Robots, Palo Alto, CA, USA, Mar. 24-26, 2014.
32. I. Lysenkov, V. Eruhimov, G. Bradski, "Recognition and pose estimation of rigid transparent objects with a kinect sensor," in Robotics: Science and Systems (RSS), Sydney, Australia, 2012.
33. A. Krontiris and K. E. Bekris, "Dealing with Difficult Instances of Object Rearrangement," in Robotics: Science and Systems (RSS), Rome, Italy, 2015.
34. K. E. Bekris, R. Shome, A. Krontiris, A. Dobson, "Cloud automation: Precomputing roadmaps for flexible manipulation," IEEE Robot. Autom. Mag., vol. 22, no. 2, pp. 41-50, Jun. 2015.
35. A. Ten Pas and R. Platt, "Localizing handle-like grasp affordances in 3D point clouds," in Proc. Int. Symp. Exp. Robot. (ISER), 2014, pp. 623-638.
36. A. Ten Pas and R. Platt, "Using geometry to detect grasps in 3D point clouds," Tech. Rep., arXiv:1501.03100v3, Jan. 15 2015.