Kinect range sensing: Structured-light versus Time-of-Flight Kinect

Computer Vision and Image Understanding

Volumn 139, Issue , 2015, Pages 1-20

  Sarbolandi, Hamed ^a   Lefloch, Damien ^a   Kolb, Andreas ^a  

^a UNIVERSITY OF SIEGEN   (Germany)

Author keywords

3D; Depth sensor; Evaluation; Kinect

Indexed keywords

CAMERAS;

APPLICATION SCENARIO; DEPTH SENSORS; EVALUATION; GENERIC BASIS; KINECT; POTENTIAL PROBLEMS; STRUCTURED LIGHT; TIME OF FLIGHT;

RANGE FINDERS;

EID: 84939771517     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2015.05.006     Document Type: Article

References (57)

1. S. Bauer, A. Seitel, H. Hofmann, T. Blum, J. Wasza, M. Balda, H.-P. Meinzer, N. Navab, J. Hornegger, and L. Maier-Hein Real-time range imaging in health care: A survey M. Grzegorzek, C. Theobalt, R. Koch, A. Kolb, Time-of-Flight and Depth Imaging. Sensors, Algorithms, and Applications Lecture Notes in Computer Science 8200 2013 Springer 228 254
2. C. Beder, B. Bartczak, and R. Koch A comparison of PMD-cameras and stereo-vision for the task of surface reconstruction using patchlets Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, 2007 2007 IEEE 1 8
3. K. Berger, S. Meister, R. Nair, and D. Kondermann A state of the art report on kinect sensor setups in computer vision M. Grzegorzek, C. Theobalt, R. Koch, A. Kolb, Time-of-Flight and Depth Imaging. Sensors, Algorithms, and Applications Lecture Notes in Computer Science 8200 2013 Springer 257 272
4. K. Berger, K. Ruhl, C. Brümmer, Y. Schröder, A. Scholz, and M. Magnor Markerless motion capture using multiple color-depth sensors Proceedings of the Vision, Modeling and Visualization (VMV) 2011 317 324
5. J. Blake, F. Echtler, C. Kerl, OpenKinect: open source drivers for the kinect for windows v2 device, 2015 (https://github.com/OpenKinect/libfreenect2). Last visited: 26.01.15.
6. G.R. Bradski The OpenCV library Dr. Dobb's J. Software Tools 25 11 2000 120 126
7. A. Butler, S. Izadi, O. Hilliges, D. Molyneaux, S. Hodges, and D. Kim Shake'n'sense: reducing structured light interference when multiple depth cameras overlap Proceedings of the Human Factors in Computing Systems (ACM CHI) 2012 ACM New York, NY, USA
8. A. Dorrington, J. Godbaz, M. Cree, A. Payne, and L. Streeter Separating true range measurements from multi-path and scattering interference in commercial range cameras Proceedings of the IS&T/SPIE Electronic Imaging 2011 786404-1 786404-10
9. D. Droeschel, D. Holz, and S. Behnke Multi-frequency phase unwrapping for time-of-flight cameras 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) 2010 IEEE 1463 1469
10. R. El-laithy, J. Huang, and M. Yeh Study on the use of Microsoft kinect for robotics applications Proceedings of the IEEE Symposium on Position Location and Navigation (PLANS) 2012 1280 1288
11. G. Evangelidis, M. Hansard, R. Horaud, Fusion of range and stereo data for high-resolution scene-modeling (2015).
12. D. Falie, and V. Buzuloiu Distance errors correction for the time of flight (ToF) cameras Proceedings of European Conference on Circuits and Systems for Communications 2008 193 196
13. P. Fechteler, P. Eisert, and J. Rurainsky Fast and high resolution 3D face scanning International Conference on Image Processing (ICIP) 3 2007 81 84
14. D. Fiedler, and H. Müller Impact of thermal and environmental conditions on the kinect sensor Advances in Depth Image Analysis and Applications 2013 Springer 21 31
15. L. Gallo, A.P. Placitelli, and M. Ciampi Controller-free exploration of medical image data: experiencing the kinect Proceedings of the IEEE International Symposium on Computer-Based Medical Systems (CBMS) 2011 IEEE 1 6
16. O. Hall-Holt, and S. Rusinkiewicz Stripe boundary codes for real-time structured-light range scanning of moving objects Proceedings of the IEEE International Conference on Computer Vision (ICCV) 2 2001 359 366
17. J. Han, L. Shao, D. Xu, and J. Shotton Enhanced computer vision with Microsoft Kinect sensor: a review IEEE Trans. Cybern. 43 5 2013 1318 1334
18. M. Hansard, S. Lee, O. Choi, and R. Horaud Time-of-Flight Cameras: Principles, Methods, and Applications 2013 Springer
19. D. Herrera C., J. Kannala, and J. Heikkilä Joint depth and color camera calibration with distortion correction IEEE Trans. Pattern Anal. Mach. Intell. 34 10 2012 2058 2064
20. T. Högg, D. Lefloch, and A. Kolb Real-time motion artifact compensation for PMD-ToF images Proceedings of the Workshop on Imaging New Modalities, German Conference of Pattern Recognition (GCPR) LNCS 8200 2013 Springer 273 288
21. I. Ihrke, K.N. Kutulakos, H. Lensch, M. Magnor, and W. Heidrich Transparent and specular object reconstruction Computer Graphics Forum 29 2010 2400 2426
22. A. Kadambi, R. Whyte, A. Bhandari, L. Streeter, C. Barsi, A. Dorrington, and R. Raskar Coded time of flight cameras: sparse deconvolution to address multipath interference and recover time profiles ACM Trans. Graphics (TOG) 32 6 2013 167
23. T. Kahlmann, F. Remondino, and S. Guillaume Range imaging technology: new developments and applications for people identification and tracking Proceedings of Videometrics IX - SPIE-IS&T Electronic Imaging 6491 2007 10.1117/12.702512
24. T. Kahlmann, F. Remondino, and H. Ingensand Calibration for increased accuracy of the range imaging camera SwissRanger™ Image Eng. Vision Metrol. (IEVM) 36 3 2006 136 141
25. M. Keller, D. Lefloch, M. Lambers, S. Izadi, T. Weyrich, and A. Kolb Real-time 3D reconstruction in dynamic scenes using point-based fusion Proceedings of Joint 3DIM/3DPVT Conference (3DV) 2013 8
26. K. Khoshelham, and S.O. Elberink Accuracy and resolution of kinect depth data for indoor mapping applications Sensors 12 2 2012 1437 1454 10.3390/s120201437
27. Y.M. Kim, C. Theobalt, J. Diebel, J. Kosecka, B. Miscusik, and S. Thrun Multi-view image and ToF sensor fusion for dense 3D reconstruction Proceedings of the IEEE International Conference on Computer Vision Workshops (ICCV Workshops) 2009 IEEE 1542 1549
28. A. Kolb, E. Barth, R. Koch, and R. Larsen Time-of-flight cameras in computer graphics Comput. Graphics Forum 29 1 2010 141 159
29. K. Konolige, P. Mihelich, OpenKinect: Ros' technical description of kinect calibration, 2012 (http://wiki.ros.org/kinect-calibration/technical). Last edited: 27.12.12.
30. K. Kuhnert, and M. Stommel Fusion of stereo-camera and PMD-camera data for real-time suited precise 3D environment reconstruction Intelligent Robots and Systems (IROS) 2006 4780 4785
31. B. Langmann, K. Hartmann, and O. Loffeld Depth camera technology comparison and performance evaluation. International Conference on Pattern Recognition Applications and Methods (ICPRAM) 2012 438 444
32. D. Lefloch, R. Nair, F. Lenzen, H. Schäfer, L. Streeter, M. Cree, R. Koch, and A. Kolb Technical foundation and calibration methods for time-of-flight cameras M. Grzegorzek, C. Theobalt, R. Koch, A. Kolb, Time-of-Flight and Depth Imaging. Sensors, Algorithms, and Applications Lecture Notes in Computer Science 8200 2013 Springer 3 24
33. M. Lindner, and A. Kolb Lateral and depth calibration of PMD-distance sensors Proceedings of the International Symposium on Visual Computing LNCS 2006 Springer 524 533
34. M. Lindner, and A. Kolb Compensation of motion artifacts for Time-of-Flight cameras Proceedings of Dynamic 3D Imaging LNCS 5742 2009 Springer 16 27
35. M. Lindner, I. Schiller, A. Kolb, and R. Koch Time-of-flight sensor calibration for accurate range sensing Comput. Vision Image Understanding 114 12 2010 1318 1328
36. O. Lottner, B. Langmann, W. Weihs, and K. Hartmann Scanning 2D/3D monocular camera Proceedings of 3DTV Conference: The True Vision-Capture, Transmission and Display of 3D Video 2011 1 4
37. R. Macknojia, A. Chávez-Aragón, P. Payeur, and R. Laganière Calibration of a network of kinect sensors for robotic inspection over a large workspace IEEE Workshop on Robot Vision (WORV) 2013 IEEE 184 190
38. S. Meister, S. Izadi, P. Kohli, M. Hämmerle, C. Rother, and D. Kondermann When can we use KinectFusion for ground truth acquisition? Proceedings of the Workshop on Color-Depth Camera Fusion in Robotics 2012
39. R. Nair, S. Meister, M. Lambers, M. Balda, H. Hofmann, A. Kolb, D. Kondermann, and B. Jähne Ground truth for evaluating time of flight imaging M. Grzegorzek, C. Theobalt, R. Koch, A. Kolb, Time-of-Flight and Depth Imaging. Sensors, Algorithms, and Applications Lecture Notes in Computer Science 8200 2013 Springer 52 74
40. R. Nair, K. Ruhl, F. Lenzen, S. Meister, H. Schäfer, C. Garbe, M. Eisemann, M. Magnor, and D. Kondermann A survey on time-of-flight stereo fusion M. Grzegorzek, C. Theobalt, R. Koch, A. Kolb, Time-of-Flight and Depth Imaging. Sensors, Algorithms, and Applications Lecture Notes in Computer Science 8200 2013 Springer 105 127
41. R.A. Newcombe, A.J. Davison, S. Izadi, P. Kohli, O. Hilliges, J. Shotton, D. Molyneaux, S. Hodges, D. Kim, and A. Fitzgibbon Kinectfusion: real-time dense surface mapping and tracking Proceedings of the IEEE International Symposium on Mixed and Augmented Reality (ISMAR) 2011 127 136
42. C.V. Nguyen, S. Izadi, and D. Lovell Modeling kinect sensor noise for improved 3D reconstruction and tracking 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission (3DIMPVT) 2012 IEEE 524 530
43. M. Nießner, M. Zollhöfer, S. Izadi, and M. Stamminger Real-time 3D reconstruction at scale using voxel hashing ACM Trans. Graphics (TOG) 32 6 2013 169
44. T. Ringbeck, T. Möller, and B. Hagebeuker Multidimensional measurement by using 3-D PMD sensors Adv. Radio Sci. 5 7 2007 135 146
45. A. Sabov, and J. Krüger Identification and correction of flying pixels in range camera data Proceedings of the Spring Conference on Computer Graphics 2010 135 142
46. M. Schmidt, and B. Jahne Efficient and robust reduction of motion artifacts for 3D time-of-flight cameras Proceedings of the International Conference on 3D Imaging (IC3D) 2011 1 8 10.1109/IC3D.2011.6584391
47. J. Smisek, M. Jancosek, and T. Pajdla 3D with kinect IEEE International Conference on Consumer Depth Cameras for Computer Vision (CDC4CV) 2011 1154 1160
48. T. Stoyanov, A. Louloudi, H. Andreasson, and A.J. Lilienthal Comparative evaluation of range sensor accuracy in indoor environments European Conference on Mobile Robots (ECMR) 2011 19 24
49. T. Stoyanov, R. Mojtahedzadeh, H. Andreasson, and A.J. Lilienthal Comparative evaluation of range sensor accuracy for indoor mobile robotics and automated logistics applications Rob. Auton. Syst. 61 10 2013 1094 1105
50. L. Vera, J. Gimeno, I. Coma, and M. Fernández Augmented mirror: interactive augmented reality system based on kinect Human-Computer Interaction-INTERACT LNCS 6949 2011 Springer 483 486
51. M. Wiedemann, M. Sauer, F. Driewer, and K. Schilling Analysis and characterization of the PMD camera for application in mobile robotics Proceedings of the IFAC World Congress 2008 6 11
52. Z. Xu, T. Perry, G. Hills, Method and system for multi-phase dynamic calibration of three-dimensional (3D) sensors in a time-of-flight system, US Patent 8,587,771, 2013.
53. Z. Xu, R. Schwarte, H. Heinol, B. Buxbaum, and T. Ringbeck Smart pixel - photonic mixer device (PMD) Proceedings of the International Conference on Mechatronics & Machine Vision 1998 259 264
54. C. Zach, T. Pock, and H. Bischof A duality based approach for realtime TV-L 1 optical flow Proceedings of German Conference on Pattern Recognition (DAGM) 2007 Springer 214 223
55. L. Zhang, B. Curless, and S.M. Seitz Rapid shape acquisition using color structured light and multi-pass dynamic programming IEEE International Symposium on 3D Data Processing, Visualization, and Transmission 2002 24 36
56. S. Zhang, and P. Huang High-resolution, real-time 3D shape acquisition Proceedings of the 2004 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW) 3 2004 IEEE Computer Society Washington, DC, USA 28 36
57. Z. Zhang A flexible new technique for camera calibration IEEE Trans. Pattern Anal. Mach. Intell. 22 11 2000 1330 1334