Accuracy and resolution of kinect depth data for indoor mapping applications

Sensors

Volumn 12, Issue 2, 2012, Pages 1437-1454

  Khoshelham, Kourosh ^a   Elberink, Sander Oude ^a  

^a UNIVERSITY OF TWENTE   (Netherlands)

Author keywords

Calibration; Error budget; Imaging; Laser scanning; Point cloud; Range camera; RGB D; Sensor; Triangulation

Indexed keywords

ARTICLE; AUDIOVISUAL EQUIPMENT; AUTOMATED PATTERN RECOGNITION; COMPUTER ASSISTED DIAGNOSIS; EQUIPMENT; EQUIPMENT DESIGN; GEOGRAPHIC INFORMATION SYSTEM; HOUSING; INSTRUMENTATION; METHODOLOGY; TELECOMMUNICATION; TRANSDUCER;

EQUIPMENT DESIGN; EQUIPMENT FAILURE ANALYSIS; GEOGRAPHIC INFORMATION SYSTEMS; HOUSING; IMAGE INTERPRETATION, COMPUTER-ASSISTED; MAPS AS TOPIC; PATTERN RECOGNITION, AUTOMATED; RADAR; TRANSDUCERS;

EID: 84857612141     PISSN: 14248220     EISSN: None     Source Type: Journal    
DOI: 10.3390/s120201437     Document Type: Article

References (38)

1. Microsoft. Kinect. Available online: http://www.xbox.com/en-us/kinect/ (accessed on 14 December 2011).
2. PrimeSense. Available online: http://www.primesense.com/ (accessed on 14 December 2011).
3. Amit, B.; Dagan, E.; Gershom, K.; Alon, L.; Yinon, O.; Yaron, Y. Enhanced interactive gaming by blending full-body tracking and gesture animation. In Proceedings of the ACM SIGGRAPH ASIA 2010 Sketches, Seoul, Korea, 15-18 December 2010.
4. Andrew, D.W. Using a depth camera as a touch sensor. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces, Saarbrucken, Germany, 7-10 November 2010.
5. Chang, Y.J.; Chen, S.F.; Huang, J.D. A Kinect-based system for physical rehabilitation: A pilot study for young adults with motor disabilities. Res. Dev. Disabil. 2011, 32, 2566-2570.
6. Gottfried, J.M.; Fehr, J.; Garbe, C.S. Computing range flow from multi-modal Kinect data. In Proceedings of the 7th International Symposium on Visual Computing, ISVC 2011, Las Vegas, NV, USA, 26-28 September 2011; Volume 6938, pp. 758-767.
7. Stowers, J.; Hayes, M.; Bainbridge-Smith, A. Altitude control of a quadrotor helicopter using depth map from Microsoft Kinect sensor. In Proceedings of the IEEE International Conference on Mechatronics, ICM 2011, Istanbul, Turkey, 13-15 April 2011; pp. 358-362.
8. Walker, B.; Caroline, P.; William, D.S. Using depth information to improve face detection. In Proceedings of the 6th International Conference on Human-Robot Interaction, Lausanne, Switzerland, 6-9 March 2011.
9. Benavidez, P.; Jamshidi, M. Mobile robot navigation and target tracking system. In Proceedings of the 6th International Conference on System of Systems Engineering: SoSE in Cloud Computing, Smart Grid, and Cyber Security, SoSE 2011, Albuquerque, NM, USA, 2011; pp. 299-304.
10. Raptis, M.; Kirovski, D.; Hoppe, H. Real-time classification of dance gestures from skeleton animation. In Proceedings of the 10th Annual ACM SIGGRAPH/Eurographics Symposium on Computer Animation, SCA 2011, Vancouver, BC, Canada, 5-7 August 2011; pp. 147-156.
11. Riche, N.; Mancas, M.; Gosselin, B.; Dutoit, T. 3D Saliency for abnormal motion selection: The role of the depth map. In Proceedings of the 8th International Conference on Computer Vision Systems, ICVS 2011, Sophia Antipolis, France, 20-22 September 2011; Volume 6962, pp. 143-152.
12. Herbst, E.; Ren, X.; Fox, D. Toward object discovery and modeling via 3-D scene comparison. In Proceedings of IEEE International Conference on Robotics and Automation, Shanghai, China, 9-13 May 2011.
13. Menna, F.; Remondino, F.; Battisti, R.; Nocerino, E. Geometric investigation of a gaming active device. In Videometrics, Range Imaging, and Applications XI; Remondino, F., Shortis, M.R., Eds.; SPIE: Munich, Germany, 2011; Volume 8085, p. 80850G.
14. Zollhöfer, M.; Martinek, M.; Greiner, G.; Stamminger, M.; Süaßmuth, J. Automatic reconstruction of personalized avatars from 3D face scans. Comput. Animat. Virtual Worlds 2011, 22, 195-202.
15. Izadi, S.; Kim, D.; Hilliges, O.; Molyneaux, D.; Newcombe, R.; Kohli, P.; Shotton, J.; Hodges, S.; Freeman, D.; Davison, A.; et al. KinectFusion: Real-time 3D reconstruction and interaction using a moving depth camera. In Proceedings of ACM Symposium on User Interface Software and Technology, Santa Barbara, CA, USA, 16-19 October 2011.
16. Henry, P.; Krainin, M.; Herbst, E.; Ren, X.; Fox, D. RGB-D mapping: Using depth cameras for dense 3D modeling of indoor environments. In Proceedings of International Symposium on Experimental Robotics (ISER), Delhi, India, 18-21 December 2010.
17. Khoshelham, K. Automated localization of a laser scanner in indoor environments using planar objects. In Proceedings of International Conference on Indoor Positioning and Indoor Navigation (IPIN), Zürich, Switzerland, 15-17 September 2010.
18. Rusinkiewicz, S.; Levoy, M. Efficient Variants of the ICP Algorithm; IEEE Computer Soc.: Los Alamitos, CA, USA, 2001; pp. 145-152.
19. MESA Imaging. Available online: http://www.mesa-imaging.ch/ (accessed on 14 December 2011).
20. PMD [vision] CamCube 3.0. Available online: http://www.pmdtec.com/products-services/pmdvisionr-cameras/pmdvisionr-camcube-30/ (accessed on 14 December 2011).
21. Breuer, P.; Eckes, C.; Muller, S. Hand gesture recognition with a novel IR time-of-flight range camera-A pilot study. In Lecture Notes in Computer Science; Gagalowicz, A., Philips, W., Eds.; Springer: Berlin, Germany, 2007; Volume 4418, pp. 247-260.
22. Kahlmann, T.; Ingensand, H. Calibration and development for increased accuracy of 3D range imaging cameras. J. Appl. Geod. 2008, 2, 1-11.
23. Kahlmann, T.; Remondino, F.; Ingensand, H. Calibration for increased accuracy of the range imaging camera SwissRanger. In Proceedings of ISPRS Commission V Symposium 'Image Engineering and Vision Metrology', Dresden, Germany, 25-27 September 2006; pp. 136-141.
24. Lichti, D.D. Self-calibration of a 3D range camera. In Proceedings of International Archives of the Photogrammetry Remote Sensing and Spatial Information Sciences, Beijing, China, 3-11 July 2008; pp. 927-932.
25. Lindner, M.; Schiller, I.; Kolb, A.; Koch, R. Time-of-flight sensor calibration for accurate range sensing. Comput. Vis. Image Underst. 2010, 114, 1318-1328.
26. Shahbazi, M.; Homayouni, S.; Saadatseresht, M.; Sattari, M. Range camera self-calibration based on integrated bundle adjustment via joint setup with a 2D digital camera. Sensors 2011, 11, 8721-8740.
27. Freedman, B.; Shpunt, A.; Machline, M.; Arieli, Y. Depth Mapping Using Projected Patterns. U.S. Patent 2010/0118123, 13 May 2010.
28. Fraser, C.S. Digital camera self-calibration. ISPRS J. Photogramm. Remote Sens. 1997, 52, 149-159.
29. Chipworks. Teardown of the Microsoft Kinect-Focused on motion capture. Available online: http://www.chipworks.com/en/technical-competitive-analysis/resources/recent-teardowns/2010/12/teardown-of-the-microsoft-kinect-focused-on-motion-capture/ (accessed on 14 December 2011).
30. Konolige, K.; Mihelich, P. Kinect operation. Available online: http://www.ros.org/wiki/kinect_calibration/technical (accessed on 14 December 2011).
31. Brown, D.C. Close-range camera calibration. Photogramm. Eng. 1971, 37, 855-866.
32. Faro. Laser Scanner LS 880 Techsheet. Available online: http://faro.com/FaroIP/Files/File/Techsheets%20Download/UK_LASER_SCANNER_LS.pdf (accessed on 14 December 2011).
33. Khoshelham, K.; Altundag, D.; Ngan-Tillard, D.; Menenti, M. Influence of range measurement noise on roughness characterization of rock surfaces using terrestrial laser scanning. Int. J. Rock Mech. Mining Sci. 2011, 48, 1215-1223.
34. Besl, P.J.; McKay, N.D. A method for registration of 3-D shapes. IEEE Trans. Pattern Anal. Mach. Intell. 1992, 14, 239-256.
35. Pulli, K. Multiview Registration for large data sets. In Proceedings of Second International Conference on 3D Digital Imaging and Modeling, Ottawa, ON, Canada, 4-8 December 1999.
36. Fischler, M.A.; Bolles, R.C. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 1981, 24, 381-395.
37. Khoshelham, K.; Li, Z.L.; King, B. A split-and-merge technique for automated reconstruction of roof planes. Photogramm. Eng. Remote Sens. 2005, 71, 855-862.
38. van der Sande, C.; Soudarissanane, S.; Khoshelham, K. Assessment of relative accuracy of AHN-2 laser scanning data using planar features. Sensors 2010, 10, 8198-8214.