A comparative study of registration methods for RGB-D video of static scenes

Sensors (Switzerland)

Volumn 14, Issue 5, 2014, Pages 8547-8576

  Morell Gimenez, Vicente ^a   Saval Calvo, Marcelo ^a   Azorin Lopez, Jorge ^a   Garcia Rodriguez, Jose ^a   Cazorla, Miguel ^a   Orts Escolano, Sergio ^a   Fuster Guillo, Andres ^a  

^a UNIVERSITY OF ALICANTE   (Spain)

Author keywords

Object reconstruction; Registration; RGB D sensor; Robotics mapping

Indexed keywords

ROBOTICS;

COMPARATIVE ANALYSIS; COMPARATIVE STUDIES; OBJECT RECONSTRUCTION; REGISTRATION; REGISTRATION METHODS; REGISTRATION PROBLEMS; RGB-D SENSORS; VIRTUAL RECONSTRUCTION;

SENSORS;

EID: 84900841749     PISSN: 14248220     EISSN: None     Source Type: Journal    
DOI: 10.3390/s140508547     Document Type: Article

References (63)

1. Yang, F.; Ding, M.; Zhang, X.; Wu, Y.; Hu, J. Two Phase Non-Rigid Multi-Modal Image Registration Using Weber Local Descriptor-Based Similarity Metrics and Normalized Mutual Information. Sensors 2013, 13, 7599-7617.
2. Duan, L.; Guan, T.; Yang, B. Registration CombiningWide and Narrow Baseline Feature Tracking Techniques for Markerless AR Systems. Sensors 2009, 9, 10097-10116.
3. Cazorla, M.; Viejo, D.; Pomares, C. Study of the SR4000 camera. In Proceedings of XI Workshop of Physical Agents Físicos, Valencia, Spain, September 2010.
4. Lowe, D.G. Distinctive Image Features from Scale-Invariant Keypoints. Int. J. Comput. Vis. 2004, 60, 91-110.
5. Khoshelham, K.; Elberink, E.O. Accuracy and resolution of kinect depth data for indoor mapping applications. Sensors 2012, 2, 1437-1454.
6. Zitov, B.; Flusser, J. Image registration methods: A survey. Image Vis. Comput. 2003, 21, 977-1000.
7. Tam, G.; Cheng, Z.Q.; Lai, Y.K.; Langbein, F.; Liu, Y.; Marshall, D.; Martin, R.; Sun, X.F.; Rosin, P. Registration of 3D Point Clouds and Meshes: A Survey from Rigid to Nonrigid. IEEE Trans. Vis. Comput. Gr. 2013, 19, 1199-1217.
8. Rusinkiewicz, S.; Levoy, M. Efficient variants of the ICP algorithm. In Proceedings of the 3rd International Conference on 3-D Digital Imaging and Modeling, Quebec City, QC, Canada, 28 May-1 June 2001; pp. 145-152.
9. Pomerleau, F.; Colas, F.; Siegwart, R.; Magnenat, S. Comparing ICP variants on real-world data sets. Auton. Robots 2013, 34, 133-148.
10. Fischler, M.A.; Bolles, R.C. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 1981, 24, 381-395.
11. Hetzel, G.; Leibe, B.; Levi, P.; Schiele, B. 3D object recognition from range images using local feature histograms. In Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Kauai, HI, USA, 8-14 December 2001; Volume 2, pp. 394-399.
12. Chen, Y.; Medioni, G. Object modeling by registration of multiple range images. In Proceedings of 1991 IEEE International Conference on Robotics and Automation, Sacramento, CA, USA, 9-11 April 1991; Volume 3, pp. 2724-2729.
13. Besl, P.; McKay, N. A method for registration of 3-D shapes. IEEE Trans. Pattern Anal. Mach. Intell. 1992, 14, 239-256.
14. Salvi, J.; Matabosch, C.; Fofi, D.; Forest, J. A review of recent range image registration methods with accuracy evaluation. Image Vis. Comput. 2007, 25, 578-596.
15. Campbell, R.J.; Flynn, P.J. A Survey of Free-form Object Representation and Recognition Techniques. Comput. Vis. Image Underst. 2001, 81, 166-210.
16. Crum, W.R.; Hartkens, T.; Hill, D.L.G. Non-rigid image registration: Theory and practice. Br. J. Radiol. 2004, 77, S140-S153.
17. Henry, P.; Krainin, M.; Herbst, E.; Ren, X.; Fox, D. RGB-D mapping: Using depth cameras for dense 3D modeling of indoor environments. In Experimental Robotics; Springer: Berlin Heidelberg, Germany, 2014; pp. 477-491.
18. Raguram, R.; Frahm, J.M.; Pollefeys, M. A Comparative Analysis of RANSAC Techniques Leading to Adaptive Real-Time Random Sample Consensus. In Proceedings of the 10th European Conference on Computer Vision, Marseille, France, 12-18 October 2008; pp. 500-513.
19. Izadi, S.; Kim, D.; Hilliges, O.; Molyneaux, D.; Newcombe, R.A.; Kohli, P.; Shotton, J.; Hodges, S.; Freeman, D.; Davison, A.J.; et al. KinectFusion: Real-time 3D reconstruction and interaction using a moving depth camera. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology, Honolulu, HI, USA, 2011; pp. 559-568.
20. Steinbrucker, F.; Sturm, J.; Cremers, D. Real-time visual odometry from dense RGB-D images. In Proceedings of 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops), Barcelona, Spain, 6-13 November 2011; pp. 719-722.
21. Kramer, J.; Burrus, N.; Echtler, F.; Parker, M.; Herrera C., D. Object Modeling and Detection. In Hacking the Kinect; Apress: New York, NY, USA, 2012; Chapter 9, pp. 173-206.
22. Bay, H.; Ess, A.; Tuytelaars, T.; Gool, L.V. Speeded-up Robust Features (SURF). Comput. Vis. Image Underst. 2008, 110, 346-359.
23. Gil, A.; Mozos, O.; Ballesta, M.; Reinoso, O. A comparative evaluation of interest point detectors and local descriptors for visual SLAM. Mach. Vis. Appl. 2010, 21, 905-920.
24. Gomb, P. Detection of Interest Points on 3D Data: Extending the Harris Operator. In Computer Recognition Systems 3; Kurzynski, M., Wozniak, M., Eds.; Springer: Berlin Heidelberg, Germany, 2009; Volume 57, pp. 103-111.
25. Rusu, R.; Blodow, N.; Beetz, M. Fast Point Feature Histograms (FPFH) for 3D registration. In Proceedings of IEEE International Conference on Robotics and Automation, Kobe, Japan, 12-17 May 2009; pp. 3212-3217.
26. Johnson, A. Spin-Images: A Representation for 3-D Surface Matching. PhD Thesis, Robotics Institute, Carnegie Mellon University, Pittsburgh, PA, USA, 1997.
27. Viejo, D.; Cazorla, M. 3D Model Based Map Building. In Proceedings of Comunicacin presentada en el IX Workshop de Agentes Fsicos, Vigo, Spain, 11-12 September 2008.
28. Viejo, D.; Cazorla, M. A robust and fast method for 6DoF motion estimation from generalized 3D data. Auton. Robots 2014, 36, 295-308.
29. Koser, K.; Koch, R. Perspectively Invariant Normal Features. In Proceedings of IEEE 11th International Conference on Computer Vision, Rio de Janeiro, Brazil, 14-20 October 2007; pp. 1-8.
30. Wu, C.; Clipp, B.; Li, X.; Frahm, J.M.; Pollefeys, M. 3D model matching with Viewpoint-Invariant Patches (VIP). In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, AL, USA, 24-26 June 2008; pp. 1-8.
31. Zeisl, B.; Köser, K.; Pollefeys, M. Automatic Registration of RGBD Scans via Salient Directions. In Proceedings of IEEE 16th International Conference on Computer Vision, Sydney, Australia, 3-6 December 2013.
32. Brunnstrom, K.; Eklundh, J.; Uhlin, T. Active Fixation for Scene Exploration. Int. J. Comput. Vis. 1996, 17, doi:10.1007/BF00058749.
33. Stückler, J.; Behnke, S. Model Learning and Real-Time Tracking Using Multi-Resolution Surfel Maps. In Proceedings of the 26th AAAI Conference on Artificial Intelligence, Toronto, ON, Canada, 22-26 July 2012.
34. Lucas, B.D.; Kanade, T. An Iterative Image Registration Technique with an Application to Stereo Vision. In Proceedings of the 7th International Joint Conference on Artificial Intelligence, San Francisco, CA, USA, 24-28 August 1981; Volume 2, pp. 674-679.
35. Druon, S.; Aldon, M.J.; Crosnier, A. Color Constrained ICP for Registration of Large Unstructured 3D Color Data Sets. In Proceedings of 2006 IEEE International Conference on Information Acquisition, Shandong, China, 20-23 August 2006; pp. 249-255.
36. Kerl, C.; Sturm, J.; Cremers, D. Robust Odometry Estimation for RGB-D Cameras. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Karlsruhe, Germany, 6-10 May 2013.
37. Turk, G.; Levoy, M. Zippered polygon meshes from range images. In Proceedings of the 21st Annual Conference on Computer Graphics and Interactive Techniques, Orlando, FL, USA, 24-29 July 1994; pp. 311-318.
38. Masuda, T.; Sakaue, K.; Yokoya, N. Registration and Integration of Multiple Range Images for 3-D Model Construction. In Proceedings of the 1996 International Conference on Pattern Recognition (ICPR '96), Vienna, Austria, 29 August 1996; Volume 1, p. 879.
39. Weik, S. Registration of 3-D partial surface models using luminance and depth information. In Proceedings of International Conference on Recent Advances in 3-D Digital Imaging and Modeling, Ottawa, ON, Canada, 12-15 May 1997; pp. 93-100.
40. Simon, D.A. Fast and Accurate Shape-Based Registration. PhD Thesis, Carnegie Mellon University, Pittsburgh, PA, USA, 1996.
41. Godin, G.; Rioux, M.; Baribeau, R. Three-dimensional registration using range and intensity information. In Proceedings of Photonics for Industrial Applications. International Society for Optics and Photonics, Boston, Massachusetts, 31 October-4 November 1994; pp. 279-290.
42. Pulli, K. Multiview registration for large data sets. In Proceedings of the 2nd International Conference on 3-D Digital Imaging and Modeling, Ottawa, ON, Canada, 4-8 October 1999; pp. 160-168.
43. Zinsser, T.; Schmidt, J.; Niemann, H. A refined ICP algorithm for robust 3-D correspondence estimation. In Proceedings of 2003 International Conference on Image Processing, Barcelona, Spain, 14-18 September 2003; pp. 695-698.
44. Zhang, L.; Choi, S.I.; Park, S.Y. Robust ICP Registration Using Biunique Correspondence. In Proceedings of 2011 International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission (3DIMPVT), Hangzhou, China, 16-19 May 2011; pp. 80-85.
45. Curless, B.; Levoy, M. A Volumetric Method for Building Complex Models from Range Images. In Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques, New Orleans, LA, USA, 4-9 August 1996; pp. 303-312.
46. Whelan, T.; Kaess, M.; Fallon, M.; Johannsson, H.; Leonard, J.; McDonald, J. Kintinuous: Spatially Extended KinectFusion. In Proceedings of RSS Workshop on RGB-D: Advanced Reasoning with Depth Cameras, Sydney, Australia, 9-10 July 2012.
47. Whelan, T.; Johannsson, H.; Kaess, M.; Leonard, J.; McDonald, J. Robust Real-Time Visual Odometry for Dense RGB-D Mapping. In Proceedings of IEEE International Conference on Robotics and Automation, Karlsruhe, Germany, 6-10 May 2013.
48. Huang, A.S.; Bachrach, A.; Henry, P.; Krainin, M.; Maturana, D.; Fox, D.; Roy, N. Visual Odometry and Mapping for Autonomous Flight Using an RGB-D Camera. In Proceedings of International Symposium on Robotics Research (ISRR), Flagstaff, AZ, USA, 28 August-1 September 2011.
49. Whelan, T.; Kaess, M.; Leonard, J.; McDonald, J. Deformation-based Loop Closure for Large Scale Dense RGB-D SLAM. In Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Tokyo, Japan, 3-8 November 2013.
50. Koch, R. Dynamic 3D Scene Analysis through Synthesis Feedback Control. IEEE Trans. Pattern Anal. Mach. Intell. 1993, 15, 556-568.
51. Comport, A.; Malis, E.; Rives, P. Accurate Quadrifocal Tracking for Robust 3D Visual Odometry. In Proceedings of 2007 IEEE International Conference on Robotics and Automation, Roma, Italy, 10-14 April 2007; pp. 40-45.
52. Audras, C.; Comport, A.; Meilland, M.; Rives, P. Real-time dense RGB-D localisation and mapping. In Proceedings of Australian Conference on Robotics and Automation, Melbourne, Australia, 7-9 December 2011.
53. Dissanayake, M.; Newman, P.; Clark, S.; Durrant-Whyte, H.; Csorba, M. A solution to the simultaneous localization and map building (SLAM) problem. IEEE Trans. Robot. Autom. 2001, 17, 229-241.
54. Endres, F.; Hess, J.; Engelhard, N.; Sturm, J.; Cremers, D.; Burgard, W. An Evaluation of the RGB-D SLAM System. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), St. Paul, MN, USA, 14-18 May 2012.
55. Chang, P.; Shen, J.; Cheung, S.C. A Robust RGB-D SLAM System for 3D Environment with Planar Surfacess. In Proceedings of the IEEE International Conference on Image Processing, Melbourne, Australia, 15-18 September 2013.
56. Shen, J.; Su, P.C.; Cheung, S.; Zhao, J. Virtual Mirror RenderingWith Stationary RGB-D Cameras and Stored 3-D Background. IEEE Trans. Image Process. 2013, 22, 3433-3448.
57. Rosten, E.; Drummond, T. Fusing points and lines for high performance tracking. In Proceedings of IEEE International Conference on Computer Vision, Beijing, China, 17-20 October 2005; Volume 2, pp. 1508-1511.
58. Rosten, E.; Drummond, T. Machine learning for high-speed corner detection. In Proceedings of European Conference on Computer Vision, Graz, Austria, 7-13 May 2006; Volume 1, pp. 430-443.
59. Calonder, M.; Lepetit, V.; Ozuysal, M.; Trzcinski, T.; Strecha, C.; Fua, P. BRIEF: Computing a Local Binary Descriptor very Fast. IEEE Trans. Pattern Anal. Mach. Intell. 2012, 34, 1281-1298.
60. Sturm, J.; Engelhard, N.; Endres, F.; Burgard, W.; Cremers, D. A Benchmark for the Evaluation of RGB-D SLAM Systems. In Proceedings of the International Conference on Intelligent Robot Systems (IROS), Vilamoura, Algarve, Portugal, 7-12 October 2012.
61. Chane, C.S.; Schtze, R.; Boochs, F.; Marzani, F.S. Registration of 3D and Multispectral Data for the Study of Cultural Heritage Surfaces. Sensors 2013, 13, 1004-1020.
62. Newcombe, R.A.; Izadi, S.; Hilliges, O.; Molyneaux, D.; Kim, D.; Davison, A.J.; Kohli, P.; Shotton, J.; Hodges, S.; Fitzgibbon, A.W. KinectFusion: Real-time dense surface mapping and tracking. In Proceedings of 2011 10th IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Basel, Switzerland, 26-29 October 2011; pp. 127-136.
63. Saval-Calvo, M.; Azorin-Lopez, J.; Fuster-Guillo, A. Model-Based Multi-view Registration for RGB-D Sensors. In Proceedings of the 12th International Work-Conference on Artificial Neural Networks (IWANN 2013), Tenerife, Spain, 12-14 June 2013; pp. 496-503.