Time-of-flight and structured light depth cameras: Technology and applications

Time-of-Flight and Structured Light Depth Cameras: Technology and Applications

Volumn , Issue , 2016, Pages 1-355

  Zanuttigh, Pietro ^a   Mutto, Carlo Dal ^b   Minto, Ludovico ^a   Marin, Giulio ^a   Dominio, Fabio ^a   Cortelazzo, Guido Maria ^c  

^a UNIVERSITY OF PADOVA   (Italy)

^b Aquifi Inc   (United States)

^c NONE   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER VISION; DATA ACQUISITION; GESTURE RECOGNITION; CAMERAS;

3D DATA ACQUISITION; 3D SCENE RECONSTRUCTION; ACQUISITION DEVICE; COMPUTER VISION ALGORITHMS; HUMAN POSE ESTIMATIONS; IMPLEMENTATION ASPECTS; SCENE SEGMENTATION; STRUCTURED LIGHT;

CAMERAS; COMPUTER VISION;

EID: 84986588604     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1007/978-3-319-30973-6     Document Type: Book

References (485)

1. Faro, http://faro.com Accessed March 2016
2. Iee, http://www.iee.lu Accessed March 2016
3. Intel RealSense, www.intel.com/realsense Accessed March 2016
4. Leica, L http://hds.leica-geosystems.comAccessed March 2016
5. Mesa imaging, http://www.mesa-imaging.ch Accessed March 2016
6. OpenCV, http://opencv.org Accessed March 2016
7. Pmd technologies, http://www.pmdtec.com/Accessed March 2016
8. Riegl, R., http://www.riegl.com/ Accessed March 2016
9. Velodyne lidar, http://www.velodynelidar.com Accessed March 2016
10. Zoller Z., and Frolich, F http://www.zf-laser.com/ Accessed March 2016
11. J. Andrews, N. Baker, Xbox 360 system architecture. IEEE Micro 26(2), 25-37 (2006)
12. C. S. Bamji, P. O’Connor, T. Elkhatib, S. Mehta, B. Thompson, L.A. Prather, D. Snow, O.C. Akkaya, A. Daniel, A.D. Payne, T. Perry, M. Fenton, V.-H. Chan, A 0.13 um cmos system-on-chip for a 512 x 424 time-of-flight image sensor with multi-frequency photo-demodulation up to 130 mhz and 2gs/s adc. IEEE J. Solid-State Circuits 50(1), 303-319 (2015)
13. Y. Bar-Shalom, Tracking and Data Association (Academic Press Professional, Inc., San Diego, CA, 1987)
14. F. Bernardini, H.E. Rushmeier, The 3d model acquisition pipeline. Comput. Graphics Forum 21(2), 149-172 (2002)
15. G. Borenstein, Making Things See: 3D Vision with Kinect, Processing, Arduino, and MakerBot (Maker Media, O’Reilly Media Inc., Sebastopol, 2012)
16. J.Y. Bouguet, Camera calibration toolbox for matlab. http://www.vision.caltech.edu/bouguetj/ calib_doc/. Accessed March 2016
17. J.Y. Bouguet, B. Curless, P. Debevec, M. Levoy, S. Nayar, S. Seitz, Overview of active vision techniques, in Proceedings of ACM SIGGRAPH Workshop, Course on 3D Photography (2000)
18. D. Claus, A.W. Fitzgibbon, A rational function lens distortion model for general cameras, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (2005)
19. B. Curless, M. Levoy, A volumetric method for building complex models from range images, in Proceedings of ACM SIGGRAPH (New York, 1996), pp. 303-312
20. B. Cyganek, An Introduction to 3D Computer Vision Techniques and Algorithms (Wiley, New York, 2007)
21. D. Dardari, A. Conti, U. Ferner, A. Giorgetti, M.Z. Win, Ranging with ultrawide bandwidth signals in multipath environments. Proc. IEEE 97(2), 404-426 (2009)
22. E. R. Davies, Computer and Machine Vision, 4th edn. (Academic, Boston, 2012)
23. J. Davis, D. Nehab, R. Ramamoorthi, S. Rusinkiewicz, Spacetime stereo: a unifying framework for depth from triangulation, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (2003)
24. O. Faugeras, Three-Dimensional Computer Vision: A Geometric Viewpoint (MIT Press, Cambridge, 1993)
25. M.A. Fischler, R.C. Bolles, Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography, in Readings in Computer Vision: Issues, Problems, Principles and Paradigms, vol. 1 (M. Kaufmann Publishers, Los Altos, CA, 1987), pp. 726-740
26. D.A. Forsyth, J. Ponce, Computer Vision: A Modern Approach. Prentice Hall Professional Technical Reference (Prentice Hall, London, 2002)
27. A. Fusiello, Visions Computazionale. Tecniche di Ricostruzione Tridimensionale (Franco Angeli, Milano, 2013)
28. A. Fusiello, E. Trucco, A. Verri, A compact algorithm for rectification of stereo pairs. Mach. Vis. Appl. 12, 16-22 (2000)
29. C. Harris, M. Stephens, A combined corner and edge detector. in Proceedings of Alvey Vision Conference (1988), pp. 147-151
30. R.I. Hartley, In defense of the eight-point algorithm. IEEE Trans. Pattern Anal. Mach. Intell. 19(6), 580-593 (1997)
31. R.I. Hartley, P. Sturm, Triangulation, in Procedings of ARPA Image Understanding Workshop (1994)
32. R.I. Hartley, A. Zisserman, Multiple View Geometry in Computer Vision (Cambridge University Press, Cambridge, 2004)
33. J. Heikkila, O. Silven, A four-step camera calibration procedure with implicit image correction, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (1997)
34. A. Heyden, K. Astrom, Euclidean reconstruction from constant intrinsic parameters. in Proceedings ofInternational Conference on Pattern Recognition, pp. 339-343
35. T.S. Huang, O. Faugeras, Some properties of the E matrix in two-view motion estimation. IEEE Trans. Pattern Anal. Mach. Intell. 11(12), 1310-1312 (1989)
36. K. Konolige, Projected texture stereo, in Proceedings of IEEE International Conference on Robotics and Automation (2010)
37. K. Konolige, Sparse sparse bundle adjustment, in Proceedings of British Machine Vision Conference (BMVA Press, Aberystwyth, 2010), pp. 1021-10211
38. R. Lange, 3D Time-of-flight distance measurement with custom solid-state image sensors in CMOS/CCD-technology, Ph.D. thesis, University of Siegen (2000)
39. M. Levoy, K. Pulli, B. Curless, S. Rusinkiewicz, D. Koller, L. Pereira, M. Ginzton, S. Anderson, J. Davis, J. Ginsberg, J. Shade, D. Fulk, The digital michelangelo project: 3d scanning of large statues, in Proceedings of ACM SIGGRAPH (Addison-Wesley Publishing Co., New York, 2000), pp. 131-144
40. H. Li, R. Hartley, Five-point motion estimation made easy, in Proceedings of International Conference on Pattern Recognition (2006), pp. 630-633
41. C. Loop, Z. Zhang, Computing rectifying homographies for stereo vision, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, (1999), p. 131
42. D. G. Lowe, Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91-110(2004)
43. B. D. Lucas, T. Kanade, An iterative image registration technique with an application to stereo vision, in Proceedings of International Joint Conference on Artificial Intelligence (Morgan Kaufmann Publishers Inc., San Francisco, CA, 1981), pp. 674-679
44. Q.T. Luong, O.D. Faugeras, The fundamental matrix: theory, algorithms, and stability analysis. Int. J. Comput. Vis. 17, 43-75 (1995)
45. Y. Ma, S. Soatto, J. Kosecka, S.S. Sastry, An Invitation to 3-D Vision: From Images to Geometric Models (Springer, Berlin, 2003)
46. P.R.S. Mendonca, R. Cipolla, A simple technique for self-calibration in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (1999), p. 505
47. K. Mikolajczyk, C. Schmid, A performance evaluation of local descriptors. IEEE Trans. Pattern Anal. Mach. Intell. 27(10), 1615-1630 (2005)
48. S. J.D. Prince, Computer Vision: Models, Learning, and Inference, 1st edn. (Cambridge University Press, New York, 2012)
49. L. Robert, O. Faugeras, Relative 3d positioning and 3d convex hull computation from a weakly calibrated stereo pair, in Proceedings of International Conference on Computer Vision (1993), pp. 540-544
50. J. Salvi, J. Pages, J. Batlle, Pattern codification strategies in structured light systems. Pattern Recogn. 37, 827-849 (2004)
51. D. Scharstein, R. Szeliski, A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. Int. J. Comput. Vis. 47(1-3), 7-42 (2001)
52. R. Schwarte et al., Pseudo-noise (pn) laser radar without scanner for extremely fast 3d-imaging and navigation, in Proceedings of Microwave and Optronics Conference (1997)
53. N. Snavely, Bundler, B., http://www.cs.cornell.edu/~snavely/bundler/. Accessed March 2016
54. N. Snavely, S.M. Seitz, R. Szeliski, Modeling the world from internet photo collections. Int. J. Comput. Vis. 80(2), 189-210 (2008)
55. G. Stockman, L.G. Shapiro, Computer Vision, 1st edn. (Prentice Hall PTR, Upper Saddle River, 2001)
56. D. Stoppa, F. Remondino (eds.), TOFRange-Imaging Cameras (Springer, Berlin, 2012)
57. R. Szeliski, Computer Vision: Algorithms and Applications (Springer, New York, 2010)
58. C. Tomasi, T. Kanade, Detection and tracking of point features. Technical report, International Journal of Computer Vision (1991)
59. B. Triggs, PF. McLauchlan, R.I. Hartley, A.W. Fitzgibbon, Bundle adjustment - a modern synthesis, in Proceedings of ICCV Workshop, Vision Algorithms: Theory and Practice (Springer, London, 2000), pp. 298-372
60. M. Trobina, Error model of a coded-light range sensor. Technical report, Communication Technology Laboratory Image Science Group, ETH-Zentrum (1995)
61. E. Trucco, A. Verri, Introductory Techniques for 3-D Computer Vision (Prentice Hall PTR, Upper Saddle River, 1998)
62. Z. Xu, Investigation of 3D-Imaging Systems Based on Modulated Light and Optical RF-Interferometry (Shaker Verlag GmbH, Aachen, 1999)
63. Z. Zhang, T. Kanade, Determining the epipolar geometry and its uncertainty: a review. Int. J. Comput. Vis. 27, 161-195 (1998)
64. L. Zhang, B. Curless, S.M. Seitz, Rapid shape acquisition using color structured light and multi-pass dynamic programming, in Proceedings of IEEE International Symposium on 3D Data Processing, Visualization, and Transmission (2002), pp. 24-36
65. L. Zhang, B. Curless, S.M. Seitz, Spacetime stereo: shape recovery for dynamic scenes, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (2003)
66. Asus, Xtion pro, http://www.asus.com/Multimedia/Motion_Sensor/Xtion_PRO/. Accessed in 2016
67. Intel RealSense, www.intel.com/realsense. Accessed in 2016
68. Occipital Structure Sensor, http://structure.io. Accessed in 2016 Patent application us2010 0118123, 2010. Accessed in 2016
69. D. Bergmann, New approach for automatic surface reconstruction with coded light, in Proceedings of Remote Sensing and Reconstruction for Three-Dimensional Objects and Scenes, SPIE (1995)
70. K.L. Boyer, A.C. Kak, Color-encoded structured light for rapid active ranging. IEEE Trans. Pattern Anal. Mach. Intell. 9, 14-28 (1987)
71. B. Carrihill, R.A. Hummel, Experiments with the intensity ratio depth sensor. Comput. Vis. Graph. Image Process. 32(3), 337-358 (1985)
72. C. S. Chen, Y.P. Hung, C.C. Chiang, J.L. Wu, Range data acquisition using color structured lighting and stereo vision. Image Vis. Comput. 15(6), 445-456 (1997)
73. J. Davis, D. Nehab, R. Ramamoorthi, S. Rusinkiewicz, Spacetime stereo: a unifying framework for depth from triangulation, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (2003)
74. T.P. Koninckx, L. Van Gool, Real-time range acquisition by adaptive structured light. IEEE Trans. Pattern Anal.Mach. Intell. 28(3), 432-445 (2006)
75. K. Konoldige, P. Mihelich, Technical description of kinect calibration. Technical report, Willow Garage, http://www.ros.org/wiki/kinect_calibration/technical (2011)
76. K. Konolige, Projected texture stereo, in Proceedings of IEEE International Conference on Robotics and Automation (2010)
77. J. Lim, Optimized projection pattern supplementing stereo systems, in Proceedings of International Conference on Robotics and Automation (2009)
78. L. Nanni, A. Lumini, F. Dominio, P. Zanuttigh, Effective and precise face detection based on color and depth data. Appl. Comput. Inform. 10(1-2), 1-13 (2014).
79. J. Salvi, J. Pages, J. Batlle, Pattern codification strategies in structured light systems. Pattern Recogn. 37, 827-849 (2004)
80. D. Scharstein, R. Szeliski, A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. Int. J. Comput. Vis. 47(1-3), 7-42 (2001)
81. J. Smisek, M. Jancosek, T. Pajdla, 3d with kinect, in Proceedings of IEEE Workshop on Consumer Depth Cameras for Computer Vision (2011)
82. R. Szeliski, Computer Vision: Algorithms and Applications (Springer, New York, 2010)
83. M. Trobina, Error model of a coded-light range sensor. Technical report, Communication Technology Laboratory Image Science Group, ETH-Zentrum (1995)
84. R. Zabih, J. Woodfill, Non-parametric Local Transforms for Computing Visual Correspondence. Lecture Notes in Computer Science (Springer, Heidelberg, 1994)
85. L. Zhang, B. Curless, S.M. Seitz, Rapid shape acquisition using color structured light and multi-pass dynamic programming, in Proceedings of IEEE International Symposium on 3D Data Processing, Visualization, and Transmission (2002), pp. 24-36
86. L. Zhang, B. Curless, S.M. Seitz, Spacetime stereo: shape recovery for dynamic scenes, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (2003)
87. Csem (2016), http://www.csem.ch. Last accessed in 2016
88. Fbk (2016), http://www.fbk.eu. Last accessed in 2016
89. Iee (2016), http://www.iee.lu. Last accessed in 2016
90. Mesa Imaging (2016), http://www.mesa-imaging.ch. Last accessed in 2016
91. TM(2016), http://www.xbox.com/en-US/kinect. Last accessed in 2016
92. Microsoft® (2016), http://www.microsoft.com. Last accessed in 2016
93. Panasonic d-imager (2016), http://www.panasonic-electric-works.com. Last accessed in 2016
94. Pmd Technologies (2016), http://www.pmdtec.com/. Last accessed in 2016
95. Softkinetic (2016), http://www.softkinetic.com/. Last accessed in 2016
96. J. Andrews, N. Baker, Xbox 360 system architecture. IEEE Micro 26(2), 25-37 (2016)
97. A. Bhandari, A. Kadambi, R. Whyte, C. Barsi, M. Feigin, A. Dorrington, R. Raskar, Resolving multipath interference in time-of-flight imaging via modulation frequency diversity and sparse regularization. Opt. Lett. 39(6), 1705-1708 (2014)
98. B. Buttgen, P. Seitz, Robust optical time-of-flight range imaging based on smart pixel structures. IEEE Trans. Circuits Syst. I: Regul. Pap. 55(6), 1512-1525 (2008)
99. B. Buttgen, T. Oggier, M. Lehmann, R. Kaufmann, F. Lustenberger, Ccd/cmos lock-in pixel for range imaging: challenges, limitations and state of the art, in 1st Range Imaging Research Day (2005)
100. D. Claus, A.W. Fitzgibbon, A rational function lens distortion model for general cameras, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (2005)
101. A.A. Dorrington, J.P. Godbaz, M.J. Cree, A.D. Payne, L.V. Streeter, Separating true range measurements from multi-path and scattering interference in commercial range cameras, Proceedings of SPIE 7864, 786404-786404-10 (2011)
102. J.P. Godbaz, M.J. Cree, A.A. Dorrington, Closed-form inverses for the mixed pixel/multipath interference problem in amcw lidar, Proceedings of SPIE 8296, 829618-829618-15 (2012)
103. J.P. Godbaz, A.A. Dorrington, M.J. Cree, Understanding and ameliorating mixed pixels and multipath interference in amcw lidar, in TOF Range-Imaging Cameras, ed. by F. Remondino, D. Stoppa (Springer, Berlin/Heidelberg, 2013), pp. 91-116
104. R.I. Hartley, A. Zisserman, Multiple View Geometry in Computer Vision (Cambridge University Press, Cambridge, 2004)
105. J. Heikkila, O. Silven, A four-step camera calibration procedure with implicit image correction, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (1997)
106. A. Kadambi, R. Whyte, A. Bhandari, L. Streeter, C. Barsi, A. Dorrington, R. Raskar, Coded time of flight cameras: sparse deconvolution to address multipath interference and recover time profiles. ACM Trans. Graph. 32(6), 1671-16710 (2013)
107. T. Kahlmann, H. Ingensand, Calibration and development for increased accuracy of 3d range imaging cameras. J. Appl. Geod. 2, 1-11 (2008)
108. A. Kirmani, A. Benedetti, P.A. Chou, Spumic: simultaneous phase unwrapping and multipath interference cancellation in time-of-flight cameras using spectral methods, in Proceedings of IEEE International Conference on Multimedia and Expo, pp. 1-6 (2013)
109. R. Lange, 3D Time-Of-Flight distance measurement with custom solid-state image sensors in CMOS/CCD-technology, Ph.D. thesis, University of Siegen, (2000)
110. F. Mufti, R. Mahony, Statistical analysis of measurement processes for time-of flight cameras, in Proceedings ofSPIE (2009)
111. M. Reynolds, J. Dobos, L. Peel, T. Weyrich, G.J. Brostow, Capturing time-of-flight data with confidence, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (2011)
112. A. Sabov, J. Kruger, Identification and correction of flying pixels in range camera data, in Proceedings of ACM Spring Conference on Computer Graphics (New York, 2010), pp. 135-142
113. D. Stoppa, F. Remondino, TOF Range-Imaging Cameras (Springer, Berlin, 2013)
114. R. Szeliski, Computer Vision: Algorithms and Applications (Springer, New York, 2010)
115. C. Uriarte, B. Scholz-Reiter, S. Ramanandan, D. Kraus, Modeling distance nonlinearity in tof cameras and correction based on integration time offsets, in Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications (Springer, Berlin/Heidelberg, 2011)
116. R. Whyte, L. Streeter, M.J. Cree, A.A. Dorrington, Review of methods for resolving multi-path interference in time-of-flight range cameras, in Proceedings of IEEE Sensors (2014), pp. 629-632
117. Dell Venue 8 7840 (2016), http://www.dell.eom/us/p/dell-venue-8-7840-tablet/pd Oculus
118. Rift (2016), https://www.oeulus.eom
119. OpenCV (2016), http://openev.org
120. L. An, Y. Jia, J. Wang, X. Zhang, M. Li, An efficient rectification method for trinocular stereovision, in Proceedings of International Conference on Pattern Recognition (2004), pp. 56-59
121. J.Y. Bouguet, Camera calibration toolbox for matlab, www.vision.caltech.edu/bouguetj/calib_ doc/
122. G. Bradski, A. Kaehler, Learning OpenCV: Computer Vision with the OpenCV Library (O’Reilly, Sebastopol, CA, 2008)
123. N. Burrus, Kinect Calibration (2016), http://nicolas.burrus.name/index.php/Research/ KinectCalibration
124. D.A. Butler, S. Izadi, O. Hilliges, D. Molyneaux, S. Hodges, D. Kim, Shake‘n’sense: reducing interference for overlapping structured light depth cameras, in Proceedings of ACM Annual Conference on Human Factors in Computing Systems (New York, 2012), pp. 1933-1936
125. B. Buttgen, P. Seitz, Robust optical time-of-flight range imaging based on smart pixel structures. IEEE Trans. Circuits Syst. I: Reg. Pap. 55(6), 1512-1525 (2008)
126. J. Chang, H. Kang, M.G. Kang, Correction of axial and lateral chromatic aberration with false color filtering. IEEE Trans. Image Process. 22(3), 1186-1198 (2013)
127. D. Claus, A.W. Fitzgibbon, A rational function lens distortion model for general cameras, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (2005)
128. C. Dal Mutto, P. Zanuttigh, G.M. Cortelazzo, A probabilistic approach to tof and stereo data fusion, in Proceedings of 3D Data Processing, Visualization and Transmission (Paris, 2010)
129. O. Faugeras, Three-Dimensional Computer Vision: A Geometric Viewpoint (MIT Press, Cambridge, MA, 1993)
130. Y. Furukawa, J. Ponce, Accurate camera calibration from multi-view stereo and bundle adjustment, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (2008), pp. 1-8
131. A. Fusiello, E. Trucco, A. Verri, A compact algorithm for rectification of stereo pairs. Mach. Vis. Appl. 12, 16-22 (2000)
132. R.C. Gonzalez, R.E. Woods, Digital Image Processing (Addison-Wesley Longman Publishing Co., Inc., Reading, Ma, 2001)
133. M. Hansard, R. Horaud, M. Amat, S. Lee, Projective alignment of range and parallax data, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (2011), pp. 3089-3096
134. R.I. Hartley, Estimation of relative camera positions for uncalibrated cameras, in Proceedings of European Conference on Computer Vision (Springer-Verlag, Berlin, 1992), pp. 579-587
135. R.I. Hartley, Euclidean reconstruction from uncalibrated views, in Proceedings of Joint European - US Workshop on Applications ofInvariance in Computer Vision (Springer, London, 1994), pp. 237-256
136. R.I. Hartley, Theory and practice of projective rectification. Int. J. Comput. Vis. 35(2), 115-127 (1999)
137. R.I. Hartley, A. Zisserman, Multiple View Geometry in Computer Vision (Cambridge University Press, Cambridge, 2004)
138. J. Heikkila, O. Silven, A four-step camera calibration procedure with implicit image correction, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (1997)
139. C.D. Herrera, J. Kannala, J. Heikkila, Joint depth and color camera calibration with distortion correction. IEEE Trans. Pattern Anal. Mach. Intell. 34(10), 2058-2064 (2012)
140. B. K.P. Horn, Closed-form solution of absolute orientation using unit quaternions. J. Opt. Soc. Am. 4, 629-642 (1987)
141. B.K.P. Horn, Shape from shading, in Obtaining Shape from Shading Information (MIT Press, Cambridge, MA, 1989), pp. 123-171
142. B. Jin, H. Lei, W. Geng, Accurate intrinsic calibration of depth camera with cuboids, in Proceedings of European Conference on Computer Vision (ECCV). Lecture Notes in Computer Science, vol. 8693 (Springer, Heidelberg, 2014), pp. 788-803
143. T. Kahlmann, H. Ingensand, Calibration and development for increased accuracy of 3d range imaging cameras. J. Appl. Geod. 2, 1-11 (2008)
144. T. Kahlmann, F. Remondino, H. Ingensand, Calibration for increased accuracy of the range imaging camera SwissRangerTM, in Proceedings of ISPRS Com. V Symposium (Dresden, 2006), vol. 36, pp. 136-141.
145. K. Kanatani, Calibration of ultrawide fisheye lens cameras by eigenvalue minimization. IEEE Trans. Pattern Anal. Mach. Intell. 35(4), 813-822 (2013)
146. J. Kannala, S.S. Brandt, A generic camera model and calibration method for conventional, wide-angle, and fish-eye lenses. IEEE Trans. Pattern Anal. Mach. Intell. 28(8), 1335-1340 (2006)
147. Y.M. Kim, D. Chan, C. Theobald, S. Thrun, Design and calibration of a multi-view tof sensor fusion system, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (2008)
148. Y.M. Kim, C. Theobald, J. Diebel, J. Kosecka, B. Miscusik, S. Thrun, Multi-view image and tof sensor fusion for dense 3d reconstruction, in Proceedings of 3DIM Conference (2009)
149. H. Komagata, I. Ishii, A. Takahashi, D. Wakatsuki, H. Imai, A geometric method for calibration of internal camera parameters of fish-eye lenses. Syst. Comput. Jpn. 38(12), 55-65 (2007)
150. R. Kummerle, G. Grisetti, W. Burgard, Simultaneous calibration, localization, and mapping, in Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (2011), pp. 3716-3721
151. E. Lachat, H. Macher, T. Landes, P. Grussenmeyer, Assessment and calibration of a RGB-D camera (Kinect v2 Sensor) towards a potential use for close-range 3D modeling. Remote Sens. 7, 13070-13097 (2015)
152. E. Lachat, H. Macher, M.-A. Mittet, T. Landes, P. Grussenmeyer, First experiences with Kinect v2 sensor for close range 3D modelling, in ISPRS - International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences (2015), pp. 93-100
153. R. Lange, 3D Time-Of-Flight distance measurement with custom solid-state image sensors in CMOS/CCD-technology. Ph.D. thesis, University of Siegen, (2000)
154. D. Lefloch, R. Nair, F. Lenzen, H. Schafer, L. Streeter, M.J. Cree, R. Koch, A. Kolb, Technical foundation and calibration methods for time-of-flight cameras, in Time-of-Flight and Depth Imaging. Sensors, Algorithms, and Applications, ed. by M. Grzegorzek, C. Theobalt, R. Koch, A. Kolb. Lecture Notes in Computer Science, vol. 8200 (Springer, Berlin/Heidelberg, 2013), pp. 3-24
155. M. Lindner, A. Kolb, Calibration of the intensity-related distance error of the pmd tof-camera, in Proceedings of SPIE: Intelligent Robots and Computer Vision XXV, vol. 6764 (2007), pp. 6735-6764
156. M. Lindner, I. Schiller, A. Kolb, R. Koch, Time-of-flight sensor calibration for accurate range sensing. Comput. Vis. Image Underst. 114(12), 1318-1328 (2010)
157. A.L. Lluis-Gomez, E.A. Edirisinghe, Chromatic aberration correction in raw domain for image quality enhancement in image sensor processors, in Proceedings of IEEE International Conference on Intelligent Computer Communication and Processing (2012), pp. 241-244
158. C. Loop, Z. Zhang, Computing rectifying homographies for stereo vision, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (1999), p. 131
159. A. Maimone, H. Fuchs, Reducing interference between multiple structured light depth sensors using motion, in Proceedings of IEEE Virtual Reality (Washington, DC, 2012), pp. 51-54
160. S. J. Maybank, O.D. Faugeras, A theory of self-calibration of a moving camera. Int. J. Comput. Vis. 8(2), 123-151 (1992)
161. G. Medioni, S.B. Kang, Emerging Topics in Computer Vision (Prentice Hall PTR, Upper Saddle River, NJ, 2004)
162. PR.S. Mendonca, R. Cipolla, A simple technique for self-calibration, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (1999), p. 505
163. F. Muft, R. Mahony, Statistical analysis of measurement processes fortime-of flight cameras, in Proceedings ofSPIE (2009)
164. D. Nister, An efficient solution to the five-point relative pose problem. IEEE Trans. Pattern Anal. Mach. Intell. 26(6), 756-770 (2004)
165. J. Nocedal, S. J. Wright, Numerical Optimization (Springer, New York, 2000)
166. M. Pollefeys, R. Koch, L. Van Gool, Self-calibration and metric reconstruction in spite of varying and unknown internal camera parameters, in Proceedings ofInternational Conference on Computer Vision (1998), pp. 90-95
167. S. F. Ray, Applied Photographic Optics, 3rd edn. (Focal Press, Oxford, 2002)
168. I. Schiller, C. Beder, R. Koch, Calibration of a pmd-camera using a planar calibration pattern together with a multi-camera setup, in Proceedings ofISPRS Conference (2008)
169. J. Shi, C. Tomasi, Good features to track, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (1994)
170. J. Smisek, M. Jancosek, T. Pajdla, 3d with kinect, in Proceedings of IEEE Workshop on Consumer Depth Cameras for Computer Vision (2011)
171. C. Steger, M. Ulrich, C. Wiedemann, Machine Vision Algorithms and Applications (Wiley-VCH, New York, 2007)
172. D. Stoppa, F. Remondino (eds.), TOFRange-Imaging Cameras (Springer, Berlin, 2012)
173. T. Svoboda, D. Martinec, T. Pajdla, A convenient multi-camera self-calibration for virtual environments. PRESENCE: Teleoperators Virtual Environ. 14(4), 407-422 (2005)
174. R. Szeliski, Computer Vision: Algorithms and Applications (Springer, New York, 2010)
175. T. Taketomi, J. Heikkila, Zoom factor compensation for monocular slam, in Proceedings of IEEE Virtual Reality (2015), pp. 293-294
176. A. Teichman, S. Miller, S. Thrun, Unsupervised intrinsic calibration of depth sensors via SLAM, in Proceedings of Robotics: Science and Systems (2013)
177. B. Triggs, Autocalibration and the absolute quadric, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (1997), pp. 609-614
178. M. Trobina, Error model of a coded-light range sensor. Technical report, Communication Technology Laboratory Image Science Group, ETH-Zentrum (1995)
179. E. Trucco, A. Verri, Introductory Techniques for 3-D Computer Vision (Prentice Hall PTR, Upper Saddle River, 1998)
180. G. Unal, A. Yezzi, S. Soatto, G. Slabaugh, A variational approach to problems in calibration of multiple cameras. IEEE Trans. Pattern Anal. Mach. Intell. 29(8), 1322-1338 (2007)
181. J. Weng, P. Cohen, M. Herniou, Camera calibration with distortion models and accuracy evaluation. IEEE Trans. Pattern Anal. Mach. Intell. 14(10), 965-980 (1992)
182. R.J. Woodham, Photometric method for determining surface orientation from multiple images. Opt. Eng. 19(1), 191139-191139 (1980)
183. R. Wu, L. Wang, X. Cheng, A piecewise correction method for high-resolution image of wide-angle lens, in Proceedings ofInternational Congress on Image and Signal Processing (2013), pp. 331-335
184. R. Zabih, J. Woodfill, Non-parametric local transforms for computing visual correspondence. Lecture Notes in Computer Science (Springer, Berlin, 1994)
185. Z. Zhang, A flexible new technique for camera calibration. IEEE Trans. Pattern Anal. Mach. Intell. 22, 1330-1334 (1998)
186. Z. Zhang, Camera calibration with one-dimensional objects, IEEE Trans. Pattern Anal. Mach. Intell. 26(7), 892-899 (2004)
187. C. Zhang, Z. Zhang, Calibration between depth and color sensors for commodity depth cameras, in Proceedings of IEEE International Conference on Multimedia and Expo (2011), pp. 1-6
188. L. Zhang, B. Curless, S.M. Seitz, Rapid shape acquisition using color structured light and multi-pass dynamic programming, in Proceedings of IEEE International Symposium on 3D Data Processing, Visualization, and Transmission (2002), pp. 24-36
189. J. Zhu, L. Wang, R. Yang, J. Davis, Fusion of time-of-flight depth and stereo for high accuracy depth maps, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (2008)
190. T.D.A. Prasad, K. Hartmann, W. Wolfgang, S.E. Ghobadi, A. Sluiter, First steps in enhancing 3d vision technique using 2D/3D sensors. O. Chum, V. Franc (eds.), Czech Society for Cybernetics and Informatics, Telc, Czech Republic, pages 82-86 (2006). http://cmp.feik.cvut. cz/cvww2006/
191. C. Beder, B. Barzak, R. Koch, A combined approach for estimating patchlets afrom pmd depth images and stereo intensity images, in Proceedings ofDAGM Conference (2007)
192. C.M. Bishop, Pattern Recognition and Machine Learning. Information Science and Statistics. (Springer, New York, 2007)
193. A. Blake, P. Kohli, C. Rother (eds.), Markov Random Fields for Vision and Image Processing. (MIT Press, Cambridge, 2011)
194. Y. Boykov, V Kolmogorov, An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision. IEEE Trans. Pattern Anal. Mach. Intel! 26, 359-374 (2001)
195. Y. Boykov, O. Veksler, R. Zabih, Fast approximate energy minimization via graph cuts. IEEE Trans. Pattern Anal. Mach. Intell. 23, 1222-1239 (2001)
196. A. Buades, B. Coll, J.-M. Morel, A non-local algorithm for image denoising, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 2 (2005), pp. 6065
197. C. Dal Mutto, P. Zanuttigh, S. Mattoccia, G.M. Cortelazzo, Locally consistent tof and stereo data fusion, in Proceedings of Workshop on Consumer Depth Cameras for Computer Vision (Springer, Berlin/Heidelberg, 2012), pp. 598-607
198. C. Dal Mutto, P. Zanuttigh, G.M. Cortelazzo, A probabilistic approach to tof and stereo data fusion, in Proceedings of 3D Data Processing, Visualization and Transmission (Paris, 2010)
199. C. Dal Mutto, P. Zanuttigh, G.M. Cortelazzo, Probabilistic tof and stereo data fusion based on mixed pixels measurement models. IEEE Trans. Pattern Anal. Mach. Intell. 37(11), 2260-2272 (2015)
200. J. Diebel, S. Thrun, An application of markov random fields to range sensing, in Proceedings of Conference on Neural Information Processing Systems (MIT Press, Cambridge, 2005)
201. G.D. Evangelidis, M. Hansard, R. Horaud, Fusion of range and stereo data for high-resolution scene-modeling. IEEE Trans. Pattern Anal. Mach. Intell. 37(11), 2178-2192 (2015)
202. V. Gandhi, J. Cech, R. Horaud, High-resolution depth maps based on TOF-stereo fusion, in Proceedings of IEEE International Conference on Robotics and Automation (ICRA) (IEEE Robotics and Automation Society, Saint-Paul, 2012), pp. 4742-4749
203. V. Garro, C. Dal Mutto, P. Zanuttigh, G.M. Cortelazzo, A novel interpolation scheme for range data with side information, in Proceedings of Conference on Visual Media Production (2009), pp. 52-60
204. V. Garro, C. Dal Mutto, P. Zanuttigh, G.M. Cortelazzo, Edge-preserving interpolation of depth data exploiting color information. Ann. Telecommun. 68(11-12), 597-613 (2013)
205. S. A. Gudmundsson, H. Aanaes, R. Larsen, Fusion of stereo vision and time of flight imaging for improved 3d estimation. Int. J. Intell. Syst. Technol. Appl. 5, 425-433 (2008)
206. T. Hach, J. Steurer, A novel RGB-Z camera for high-quality motion picture applications, in Proceedings of Conference on Visual Media Production (ACM, New York, 2013), p. 4
207. U. Hahne, M. Alexa, Combining time-of-flight depth and stereo images without accurate extrinsic calibration. Int. J. Intell. Syst. Technol. Appl. 5(3-4), 325-333 (2008)
208. U. Hahne, M. Alexa, Depth imaging by combining time-of-flight and on-demand stereo, in Dynamic 3D Imaging, ed. by A. Kolb, R. Koch. Lecture Notes in Computer Science, vol. 5742 (Springer, Berlin/Heidelberg, 2009), pp. 70-83
209. D.L. Hall, J. Llinas, An introduction to multisensor data fusion. Proc. IEEE 85(1), 6-23 (1997)
210. C. E. Hernandez, G. Vogiatzis, R. Cipolla, Probabilistic visibility for multi-view stereo, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (2007)
211. X. Hu, P. Mordohai, A quantitative evaluation of confidence measures for stereo vision. IEEE Trans. Pattern Anal. Mach. Intell. 34(11), 2121-2133 (2012)
212. B. Huhle, S. Fleck, A. Schilling, Integrating 3d time-of-flight camera data and high resolution images for 3dtv applications, in Proceedings of Conference on 3DTV (2007), pp. 1-4 B.
213. Huhle, T., Schairer, P. Jenke, W. Strasser, Fusion of range and color images for denoising and resolution enhancement with a non-local filter. Comput. Vis. Image Underst. 114(12), 1336-1345 (2010)
214. K. D. Kuhnert, M. Stommel, Fusion of stereo-camera and pmd-camera data for real-time suited precise, pages 4780-4785 (2006)
215. S.Z. Li, Markov Random Field Modeling in Image Analysis, 3rd edn. (Springer, New York, 2009)
216. M. Lindner, A. Kolb, K. Hartmann, Data-fusion of pmd-based distance-information and high-resolution RGB-images, in Proceedings ofInternational Symposium on Signals, Circuits and Systems (2007), pp. 1-4
217. M. Lindner, M. Lambers, A. Kolb, Sub-pixel data fusion and edge-enhanced distance refinement for 2D/3D images. Int. J. Intell. Syst. Technol. Appl., pp. 344-354 (2008)
218. M.Y. Liu, O. Tuzel, Y. Taguchi, Joint geodesic upsampling of depth images, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (2013), pp. 169-176
219. S. Lu, X. Ren, F. Liu, Depth enhancement via low-rank matrix completion, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (2014), pp. 3390-3397
220. S. Mattoccia, A locally global approach to stereo correspondence, in Proceedings of ICCV Workshop, 3D Digital Imaging and Modeling (Kyoto, 2009), pp. 1763-1770
221. R. Nair, F. Lenzen, S. Meister, H. Schafer, C. Garbe, D. Kondermann, High accuracy tof and stereo sensor fusion at interactive rates, in Proceedings of ECCV Workshops and Demonstrations (Springer, Heidelberg, 2012), pp. 1-11
222. R. Nair, K. Ruhl, F. Lenzen, S. Meister, H. Schafer, C.S. Garbe, M. Eisemann, M. Magnor, D. Kondermann, A survey on time-of-flight stereo fusion, in Time-of-Flight and Depth Imaging. Sensors, Algorithms, and Applications, ed. by M. Grzegorzek, C. Theobalt, R. Koch, A. Kolb. Lecture Notes in Computer Science, vol. 8200 (Springer, Berlin/Heidelberg, 2013), pp. 105-127.
223. J. Park, H. Kim, Y.W. Tai, M.S. Brown, I. Kweon, High quality depth map upsampling for 3d-tof cameras, in Proceedings of International Conference on Computer Vision (2011)
224. Project Tango, https://www.google.com/atap/project-tango/Recommendations on uniform color spaces, color difference equations, psychometric color terms. Supplement No. 2 to CIE publication No. 15 (E.-1.3.1) 1971/(TC-1.3.) (1978)
225. R. Reulke, Combination of distance data with high resolution images, in Proceedings of Image Engineering and Vision Metrology (2006)
226. L.I. Rudin, S. Osher, E. Fatemi, Nonlinear total variation based noise removal algorithms. Phys. D Nonlinear Phenom. 60(1), 259-268 (1992)
227. K. Ruhl, F. Klose, C. Lipski, M. Magnor, Integrating approximate depth data into dense image correspondence estimation, in Proceedings of Conference on Visual Media Production (ACM, New York, 2012), pp. 26-31
228. D. Scharstein, R. Szeliski, A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. Int. J. Comput. Vis. 47, 7-42 (2002)
229. Y. Song, C.A. Glasbey, G.W.A.M. van der Heijden, G. Polder, J.A. Dieleman, Combining stereo and time-of-flight images with application to automatic plant phenotyping, in Proceedings of Scandinavian Conference on Image Analysis (Springer, Berlin/Heidelberg, 2011), pp. 467-478
230. J. Sun, N. Zheng, H. Shum, Stereo matching using belief propagation. IEEE Trans. Pattern Anal. Mach. Intell. 25, 787-800 (2003)
231. R. Szeliski, Computer Vision: Algorithms and Applications (Springer, New York, 2010)
232. R. Szeliski, R. Zabih, D. Scharstein, O. Veksler, V. Kolmogorov, A. Agarwala, M. Tappen, C. Rother, A comparative study of energy minimization methods for markov random fields with smoothness-based priors. IEEE Trans. Pattern Anal. Mach. Intell. 30, 1068-1080 (2008)
233. C. Tomasi, R. Manduchi, Bilateral filtering for gray and color images, in Proceedings of International Conference on Computer Vision (1998), pp. 839-846
234. Q. Yang, R. Yang, J. Davis, D. Nister, Spatial-depth super resolution for range images, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2007)
235. Q. Yang, K.H. Tan, B. Culbertson, J. Apostolopoulos, Fusion of active and passive sensors for fast 3D capture, in Proceedings of IEEE International Workshop on Multimedia Signal Processing (2010)
236. J. Zhu, L. Wang, R. Yang, J. Davis, Fusion of time-of-flight depth and stereo for high accuracy depth maps, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (2008)
237. J. Zhu, L. Wang, J. Gao, R. Yang, Spatial-temporal fusion for high accuracy depth maps using dynamic MRFs. IEEE Trans. Pattern Anal. Mach. Intell. 32, 899-909 (2010)
238. J. Zhu, L. Wang, R. Yang, J.E. Davis, Z. Pan, Reliability fusion of time-of-flight depth and stereo geometry for high quality depth maps. IEEE Trans. Pattern Anal. Mach. Intell. 33, 1400-1414 (2011)
239. A. Abramov, K. Pauwels, J. Papon, F. Worgotter, B. Dellen, Depth-supported real-time video segmentation with the kinect, in Proceedings of IEEE Workshop on Applications of Computer Vision (2012), pp. 457-464
240. P Arbelaez, M. Maire, C. Fowlkes, J. Malik, Contour detection and hierarchical image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 33(5), 898-916 (2011)
241. O. Arif, W. Daley, P.A. Vela, J. Teizer, J. Stewart, Visual tracking and segmentation using time-of-flight sensor, in Proceedings of IEEE International Conference on Image Processing (2010), pp. 2241-2244
242. D. Banica, C. Sminchisescu, Second-order constrained parametric proposals and sequential search-based structured prediction for semantic segmentation in RGB-D images, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (2015), pp. 3517-3526
243. A. Bleiweiss, M. Werman, Fusing time-of-flight depth and color for real-time segmentation and tracking, in Proceedings ofDAGM Workshop, Dynamic 3D Imaging (2009), pp. 58-69
244. Y. Boykov, O. Veksler, R. Zabih, Fast approximate energy minimization via graph cuts. IEEE Trans. Pattern Anal. Mach. Intell. 23, 1222-1239 (2001)
245. F. Calderero, F. Marques, Hierarchical fusion of color and depth information at partition level by cooperative region merging, in Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing (2009), pp. 973-976
246. M. Camplani, M. Salgado, Background foreground segmentation with RGB-D kinect data: An efficient combination of classifiers. J. Vis. Commun. Image Represent. 25(1), 122-136 (2014). Visual Understanding and Applications with RGB-D Cameras
247. M. Camplani, C.R. Del Blanco, L. Salgado, F. Jaureguizar, N. Garda, Advanced background modeling with RGB-D sensors through classifiers combination and inter-frame foreground prediction. Mach. Vis. Appl. 25(5), 1197-1210 (2014)
248. Y. Cheng, Mean shift, mode seeking, and clustering, IEEE Trans. Pattern Anal. Mach. Intell. 17(8), 790-799 (1995)
249. Y.Y. Chuang, B. Curless, D.H. Salesin, R. Szeliski, A bayesian approach to digital matting, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (2001), p. 264
250. D. Comaniciu, P. Meer, Mean shift: a robust approach toward feature space analysis. IEEE Trans. Pattern Anal. Mach. Intell. 24, 603-619 (2002)
251. C. Couprie, C. Farabet, L. Najman, Y. LeCun, Convolutional Nets and Watershed Cuts for Real-Time Semantic Labeling of RGBD Videos. J. Mach. Learn. Res. 15(Oct), 3489-3511 (2014)
252. R. Crabb, C. Tracey, A. Puranik, J. Davis, Real-time foreground segmentation via range and color imaging, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition Workshops (2008), pp. 1-5
253. M. J. Dahan, N. Chen, A. Shamir, D. Cohen-Or, Combining color and depth for enhanced image segmentation and retargeting. Vis. Comput. 28(12), 1181-1193 (2012)
254. C. Dal Mutto, P. Zanuttigh, G.M. Cortelazzo, Scene segmentation assisted by stereo vision, in Proceedings ofInternational Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission 2011 (Hangzhou, 2011)
255. C. Dal Mutto, P. Zanuttigh, G.M. Cortelazzo, Fusion of geometry and color information for scene segmentation. Proceedings of IEEE J. Sel. Top. Signal Process. 6(5), 505-521 (2012)
256. N. Dalal, B. Triggs, Histograms of oriented gradients for human detection, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (2005), pp. 886-893
257. C.R. Del-Blanco, T. Mantecon, M. Camplani, F. Jaureguizar, L. Salgado, N. Garda, Foreground segmentation in depth imagery using depth and spatial dynamic models for video surveillance applications. Sensors 14(2), 1961-1987 (2014)
258. B. Dellen, G. Alenya, S. Foix, C. Torras, Segmenting color images into surface patches by exploiting sparse depth data, in Proceedings of Winter Vision Meeting: Workshop on Applications of Computer Vision (2011), pp. 591-598
259. C. Erdogan, M. Paluri, F. Dellaert, Planar segmentation of RGBD images using fast linear fitting and markov chain monte carlo, in Proceedings of Conference on Computer and Robot Vision (Toronto, 2012), pp. 32-39
260. PF. Felzenszwalb, D.P. Huttenlocher, Efficient graph-based image segmentation. Int. J. Comput. Vis. 59 (2004)
261. C. Fowlkes, S. Belongie, Fan Chung, J. Malik, Spectral grouping using the nystrom method. IEEE Trans. Pattern Anal. Mach. Intell. 26(2), 214-225 (2004)
262. J. Gallego, M. Pardas, Region based foreground segmentation combining color and depth sensors via logarithmic opinion pool decision. J. Vis. Commun. Image Represent. 25(1), 184-194 (2014)
263. S. Gupta, P. Arbelaez, R. Girshick, J. Malik. Indoor scene understanding with RGB-D images: Bottom-up segmentation, object detection and semantic segmentation. Int. J. Comput. Vis. 112(2), 133-149 (2015)
264. M. Harville, G. Gordon, J. Woodfill, Foreground segmentation using adaptive mixture models in color and depth, in Proceedings of IEEE Workshop on Detection and Recognition of Events in Video (2001)
265. E. Herbst, P. Henry, D. Fox, Toward online 3-D object segmentation and mapping, in Proceedings of IEEE International Conference on Robotics and Automation (2014)
266. A. Hermans, G. Floros, B. Leibe, Dense 3d semantic mapping of indoor scenes from RGB-D images, in Proceedings of 2014 IEEE International Conference on Robotics and Automation (IEEE, Hong Kong, 2014), pp. 2631-2638
267. S. Hickson, S. Birchfield, I. Essa, H. Christensen, Efficient hierarchical graph-based segmentation of RGBD videos, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (Columbus, 2014)
268. N. Hoft, H. Schulz, S. Behnke, Fast semantic segmentation of RGB-D scenes with gpu-accelerated deep neural networks, in Proceedings of Conference on Advances in Artificial Intelligence (Springer, Cham, 2014), pp. 80-85
269. D. Holz, S. Holzer, R. Bogdan Rusu, S. Behnke, Real-time plane segmentation using RGB-D cameras, in Proceedings of RoboCup International Symposium, Istanbul (2011)
270. A. E. Johnson, M. Hebert, Using spin images for efficient object recognition in cluttered 3d scenes. IEEE Trans. Pattern Anal. Machine Intell. 21(5), 433-449 (1999)
271. V. Kolmogorov, A. Criminisi, A. Blake, G. Cross, C. Rother, Bi-layer segmentation of binocular stereo video, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (2005), p. 1186
272. L. Ladicky, P Sturgess, C. Russell, S. Sengupta, Y. Bastanlar, W. Clocksin, P. Torr, Joint optimisation for object class segmentation and dense stereo reconstruction. International Journal of Computer Vision, Springer US 100(2), 122-133 (2012)
273. B. Langmann, S.E. Ghobadi, K. Hartmann, O. Loffeld, Multi-modal background subtraction using gaussian mixture models, in Proceedings ofISPRS Technical Commission IIISymposium on Photogrammetry Computer Vision and Image Analysis (2010), pp. 61-66
274. J. Leens, S. Pierard, O. Barnich, M. Van Droogenbroeck, J.M. Wagner, Combining color, depth, and motion for video segmentation, in Proceedings of Conference on Computer Vision Systems (2009)
275. D.G. Lowe, Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91-110(2004)
276. T. Lu, S. Li, Image matting with color and depth information, in Proceedings of 2012 International Conference on Pattern Recognition (2012), pp. 3787-3790
277. A.C. Muller, S. Behnke, Learning depth-sensitive conditional random fields for semantic segmentation of RGB-D images, in Proceedings of 2014 IEEE International Conference on Robotics and Automation (2014), pp. 6232-6237
278. A. Nguyen, B. Le, 3d point cloud segmentation: a survey, in Proceedings of 2013 IEEE Conference on Robotics, Automation and Mechatronics (2013), pp. 225-230
279. T. Ojala, M. Pietikainen, T. Maenpaa, Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. Pattern Anal. Mach. Intell. 24(7), 971-987 (2002)
280. G. Pagnutti, P. Zanuttigh, Scene segmentation from depth and color data driven by surface fitting, in Proceedings of International Conference on Image Processing (2014)
281. G. Pagnutti, P. Zanuttigh, Scene segmentation based on nurbs surface fitting metrics, in Proceedings of Smart Tools andApps in computer Graphics (2015)
282. N.R. Pal, S.K. Pal, A review on image segmentation techniques. Pattern Recogn. 26(9), 1277-1294 (1993)
283. T. Porter, T. Duff, Compositing digital images, in Proceedings of ACM SIGGRAPH (New York, 1984), pp. 253-259
284. T. Rabbani, F. Van Den Heuvel, G. Vosselmann, Segmentation of point clouds using smoothness constraint, in Proceedings ofInternational Archives ofPhotogrammetry, Remote Sensing and Spatial Information Sciences, vol. 36 (Dresden, 2006)
285. Recommendations on uniform color spaces, color difference equations, psychometric color terms. Supplement No. 2 to CIE publication No. 15 (E.-1.3.1) 1971/(TC-1.3.) (1978)
286. X. Ren, L. Bo, D. Fox, RGB-(D) scene labeling: Features and algorithms, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (2012), pp. 2759-2766
287. R. Schnabel, R. Wahl, R. Klein, Efficient ransac for point-cloud shape detection. Comput. Graph. Forum 26(2), 214-226 (2007)
288. J. Shi, J. Malik, Normalized cuts and image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 22, 888-905 (2000)
289. N. Silberman, R. Fergus, Indoor scene segmentation using a structured light sensor, in Proceedings of IEEE International Conference on Computer Vision Workshops (Barcelona, 2011), pp. 601-608
290. N. Silberman, D. Hoiem, O. Kohli, R. Fergus, Indoor segmentation and support inference from RGBD images, in Proceedings of European Conference on Computer Vision (2012)
291. L. Spinello, K.O. Arras, People detection in RGB-D data, in Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (San Francisco, 2011), pp. 3838-3843
292. N. Srinivasan, F. Dellaert, A rao-blackwellized mcmc algorithm for recovering piecewise planar 3d model from multiple view RGBD images, in Proceedings ofInternational Conference on Image Processing (2014)
293. C. Stauffer, W.E.L. Grimson, Learning patterns of activity using real-time tracking. IEEE Trans. Pattern Anal. Mach. Intell. 22(8), 747-757 (2000)
294. A. Stormer, M. Hofmann, G. Rigoll, Depth gradient based segmentation of overlapping foreground objects in range images, in Proceedings of 2010 Conference on Information Fusion (Edinburgh, 2010), pp. 1-4
295. J. Sun, J. Jia, C. Tang, H. Shum, Poisson matting. ACM Trans. Graph. 23, 315-321 (2004)
296. R. Szeliski, Computer Vision: Algorithms and Applications (Springer, New York, 2010)
297. M. Wallenberg, M. Felsberg, P. Forssen, B. Dellen, Channel coding for joint colour and depth segmentation. in Proceedings of Annual Symposium of the German Association for Pattern Recognition, vol. 6835 (Springer, Heidelberg, 2011), pp. 306-315
298. L. Wang, C. Zhang, R. Yang, C. Zhang, Tofcut: Towards robust real-time foreground extraction using time-of-flight camera, in Proceedings of 3D Data Processing, Visualization and Transmission (Paris, 2010)
299. L. Wang, M. Gong, C. Zhang, R. Yang, C. Zhang, Y.-H. Yang, Automatic real-time video matting using time-of-flight camera and multichannel poisson equations. Int. J. Comput. Vis. 97, 1-18(2011)
300. O. Wang, J. Finger, Q. Yang, J. Davis, R. Yang, Automatic natural video matting with depth, in Proceedings of Pacific Conference on Computer Graphics and Applications (2007), pp. 469-472
301. M. Andreetto, N. Brusco, G.M. Cortelazzo, Automatic 3d modeling of textured cultural heritage objects. IEEE Trans. Image Process 13(3), 354-369 (2004)
302. H. Bay, T. Tuytelaars, L. Van Gool, SURF: speeded up robust features, in Proceedings of IEEE European Conference on Computer Vision (Springer, Heidelberg, 2006), pp. 404-417
303. R. Benjemaa, F. Schmitt, Fast global registration of 3d sampled surfaces using a multi-z-buffer technique. Image Vis. Comput. 17(2), 113-123 (1999)
304. R. Bergevin, M. Soucy, H. Gagnon, D. Laurendeau, Towards a general multi-view registration technique. IEEE Trans. Pattern Anal. Mach. Intell. 18(5), 540-547 (1996)
305. F. Bernardini, H.E. Rushmeier, The 3d model acquisition pipeline. Comput. Graph. Forum 21(2), 149-172 (2002)
306. PJ. Besl, Active, optical range imaging sensors. Mach. Vis. Appl. 1(2), 127-152 (1988)
307. PJ. Besl, N.D. McKay, A method for registration of 3-D shapes. IEEE Trans. Pattern Anal. Mach. Intell. 14(2), 239-256 (1992)
308. E. Cappelletto, P. Zanuttigh, G.M. Cortelazzo, Handheld scanning with 3d cameras, in Proceedings of IEEE International Workshop on Multimedia Signal Processing (Pula, 2013), pp. 367-372
309. E. Cappelletto, P. Zanuttigh, G.M. Cortelazzo, 3D scanning of cultural heritage with consumer depth cameras. Multimedia Tools Appl. 75(7), 3631-3654 (2016)
310. Y. Chen, G. Medioni, Object modeling by registration of multiple range images, in Proceedings of IEEE International Conference on Robotics and Automation (Sacramento, 1991), pp. 2724-2729
311. Y. Cui, S. Schuon, D. Chan, S. Thrun, C. Theobalt, 3D shape scanning with a time-of-flight camera, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (2010), pp. 1173-1180
312. Y. Cui, S. Schuon, S. Thrun, D. Stricker, C. Theobalt, Algorithms for 3d shape scanning with a depth camera. IEEE Trans. Pattern Anal. Mach. Intell. 35(5), 1039-1050 (2013)
313. B. Curless, M. Levoy, A volumetric method for building complex models from range images, in Proceedings of ACM SIGGRAPH (New York, 1996), pp. 303-312
314. D.W. Eggert, A.W. Fitzgibbon, R.B. Fisher, Simultaneous registration of multiple range views for use in reverse engineering of cad models. Comput. Vis. Image Underst. 69(3), 253-272 (1998)
315. F. Endres, J. Hess, N. Engelhard, J. Sturm, D. Cremers, W. Burgard, An evaluation of the RGB-D slam system, in Proceedings of IEEE International Conference on Robotics and Automation (2012), pp. 1691-1696
316. M.A. Fischler, R.C. Bolles, Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Read. Comput. Vis. Issues Probl. Princ. Paradig. 1, 726-740 (1987)
317. J. Fuentes-Pacheco, J. Ruiz-Ascencio, J.M. Rendon-Mancha, Visual simultaneous localization and mapping: a survey. Artif. Intell. Rev. 43(1), 55-81 (2015)
318. P. Henry, M. Krainin, E. Herbst, X. Ren, D. Fox, RGB-D mapping: using kinect-style depth cameras for dense 3D modeling of indoor environments. Int. J. Robot. Res. 31(5), 647-663 (2012)
319. B.K.P. Horn, Closed-form solution of absolute orientation using unit quaternions. J. Opt. Soc. Am. 4, 629-642 (1987)
320. D.F. Huber, M. Hebert, Fully automatic registration of multiple 3D data sets. Image Vis. Comput. 21(7), 637-650 (2003)
321. S. Izadi, D. Kim, O. Hilliges, D. Molyneaux, R. Newcombe, P. Kohli, J. Shotton, S. Hodges, D. Freeman, A. Davison, A. Fitzgibbon, KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera, in Proceedings of ACM Symposium on User Interface Software and Technology (2011)
322. A.E. Johnson, M. Hebert, Using spin images for efficient object recognition in cluttered 3D scenes. IEEE Trans. Pattern Anal. Mach. Intell. 21(5), 433-449 (1999)
323. M. Keller, D. Lefloch, M. Lambers, S. Izadi, T. Weyrich, A. Kolb, Real-time 3D reconstruction in dynamic scenes using point-based fusion, in Proceedings of IEEE International Conference on 3D Vision (Washington, 2013), pp. 1-8
324. C. Kerl, J. Sturm, D. Cremers, Dense visual SLAM for RGB-D cameras, in Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (Tokyo, 2013), pp. 2100-2106
325. M. Levoy, K. Pulli, B. Curless, S. Rusinkiewicz, D. Koller, L. Pereira, M. Ginzton, S. Anderson, J. Davis, J. Ginsberg, J. Shade, D. Fulk, The digital michelangelo project: 3D scanning of large statues, in Proceedings of ACM SIGGRAPH (New York, 2000), pp. 131-144
326. W.E. Lorensen, H.E. Cline, Marching cubes: a high resolution 3D surface construction algorithm, in Proceedings of ACM SIGGRAPH (New York, 1987), pp. 163-169
327. D. G. Lowe, Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91-110(2004)
328. R.A. Newcombe, S. Izadi, O. Hilliges, D. Molyneaux, D. Kim, A.J. Davison, P. Kohli, J. Shotton, S. Hodges, A. Fitzgibbon, Kinectfusion: real-time dense surface mapping and tracking, in Proceedings of IEEE International Symposium on Mixed and Augmented Reality (2011)
329. R. Newcombe, D. Fox, S. Seitz, Dynamicfusion: reconstruction and tracking of non-rigid scenes in real-time, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (2015)
330. M. NieBner, M. Zollhofer, S. Izadi, M. Stamminger, Real-time 3D reconstruction at scale using voxel hashing. ACM Trans. Graph. 32(6), 169 (2013)
331. K. Pulli, Surface Reconstruction and Display from Range and Color Data. PhD thesis, University of Washington (1997)
332. K. Pulli, Multiview registration for large data sets, in Proceedings of IEEE International Conference on 3-D Digital Imaging and Modeling (1999), pp. 160-168
333. M. Rioux, Laser range finder based on synchronized scanners. Appl. Opt. 23(21), 3837-3844 (1984)
334. E. Rosten, T. Drummond, Fusing points and lines for high performance tracking, in Proceedings of IEEE International Conference on Computer Vision (Beijing, 2005), pp. 1508-1515
335. H. Roth, M. Vona, Moving volume kinectfusion, in Proceedings of British Machine Vision Conference (2012), pp. 1-11
336. E. Rublee, V. Rabaud, K. Konolige, G. Bradski, ORB: an efficient alternative to sift or surf, in Proceedings of IEEE International Conference on Computer Vision (Barcelona, 2011), pp. 2564-2571
337. S. Rusinkiewicz, M. Levoy, Efficient variants of the ICP algorithm, in Proceedings of IEEE International Conference on 3-D Digital Imaging and Modeling (Quebec City, 2001), pp. 145-152
338. R. B. Rusu, Z.C. Marton, N. Blodow, Mi. Dolha, M. Beetz, Towards 3D point cloud based object maps for household environments. Robot. Auton. Syst. 56(11), 927-941 (2008)
339. S. Schuon, C. Theobalt, J. Davis, S. Thrun, Lidarboost: depth superresolution fortof 3D shape scanning, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (2009), pp. 343-350
340. R. Scopigno, P. Pingi, C. Rocchini, P. Cignoni, C. Montani, 3D scanning and rendering cultural heritage artifacts on a low budget, in Proceedings of European Workshop on High Performance Graphics Systems and Applications (2000), pp. 16-17
341. J. Shotton, B. Glocker, C. Zach, S. Izadi, A. Criminisi, A. Fitzgibbon, Scene coordinate regression forests for camera relocalization in RGB-D images, in Proceedings of IEEE Computer Vision and Pattern Recognition (Washington, 2013)
342. J. Sprickerhof, A. Nuchter, K. Lingemann, J. Hertzberg, An explicit loop closing technique for 6D SLAM, in Proceedings of European Conference on Mobile Robots (2009)
343. C. Tomasi, R. Manduchi, Bilateral filtering for gray and color images, in Proceedings of IEEE International Conference on Computer Vision (1998), pp. 839-846
344. M. Trobina, Error model of a coded-light range sensor. Technical report, Communication Technology Laboratory Image Science Group, ETH-Zentrum, Zurich (1995)
345. G. Turk, M. Levoy, Zippered polygon meshes from range images, in Proceedings of ACM SIGGRAPH (New York, 1994), pp. 311-318
346. M.D. Wheeler, Y. Sato, K. Ikeuchi, Consensus surfaces for modeling 3D objects from multiple range images, in Proceedings of IEEE International Conference on Computer Vision (Bombay, 1998), pp. 917-924
347. T. Whelan, M. Kaess, M. Fallon, H. Johannsson, J. Leonard, J. McDonald, Kintinuous: spatially extended kinectfusion, in Proceedings of RSS Workshop, RGB-D: Advanced Reasoning with Depth Cameras (2012)
348. D. Zhang, M. Hebert, Harmonic maps and their applications in surface matching, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (Fort Collins, 1999)
349. A. Agarwal, B. Triggs, Recovering 3D human pose from monocular images. IEEE Trans. Pattern Anal. Mach. Intell. 28(1), 44-58 (2006)
350. I. Albrecht, J. Haber, H.P. Seidel, Construction and animation of anatomically based human hand models, in Proceedings of ACM SIGGRAPH (Aire-la-Ville, 2003), pp. 98-109
351. M.S. Arulampalam, S. Maskell, N. Gordon, T. Clapp, A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking. IEEE Trans. Signal Process. 50(2), 174-188 (2002)
352. C. Barron, I.A. Kakadiaris, Estimating anthropometry and pose from a single uncalibrated image. Comput. Vis. Image Underst. 81(3), 269-284 (2001)
353. A. Bottino, A. Laurentini, A silhouette based technique for the reconstruction of human movement. Comput. Vis. Image Underst. 83(1), 79-95 (2001)
354. M. Bray, E. Koller-Meier, P. Muller, L. Van Gool, N.N. Schraudolph, 3D hand tracking by rapid stochastic gradient descent using a skinning model, in Proceedings of IEEE European Conference on Visual Media Production (2004), pp. 59-68
355. M. Bray, E. Koller-Meier, L. Van Gool, Smart particle filtering for 3D hand tracking, in Proceedings of IEEE International Conference on Automatic Face and Gesture Recognition (Washington, 2004), pp. 675-680
356. P. Breuer, C. Eckes, S. Muller, Hand gesture recognition with a novel ir time-of-flight range camera: a pilot study, in Proceedings of International Conference on Computer Vision/Computer Graphics Collaboration Techniques (Springer, Berlin, 2007), pp. 247-260
357. N. G. Cho, A.L. Yuille, S.W. Lee, Adaptive occlusion state estimation for human pose tracking under self-occlusions. Pattern Recogn. 46(3), 649-661 (2013)
358. D. Comaniciu, P. Meer, Mean shift: a robust approach toward feature space analysis. IEEE Trans. Pattern Anal. Mach. Intell. 22, 603-619 (2002)
359. Q. Delamarre, O. Faugeras, 3D articulated models and multiview tracking with physical forces. Comput. Vis. Image Underst. 81(3), 328-357 (2001)
360. J. Deutscher, A. Blake, I. Reid, Articulated body motion capture by annealed particle filtering, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (2000), pp. 126-133
361. G. Dewaele, F. Devernay, R. Horaud, Hand motion from 3D point trajectories and a smooth surface model, in Proceedings of IEEE European Conference on Computer Vision (Springer, Berlin/Heidelberg, 2004), pp. 495-507
362. M.A. Fischler, R.A. Elschlager, The representation and matching of pictorial structures. IEEE Trans. Comput. C-22(1), 67-92 (1973)
363. A. Fossati, J. Gall, H. Grabner, X. Ren, K. Konolige, Consumer Depth Cameras for Computer Vision: Research Topics and Applications (Springer, London, 2012)
364. V. Frati, D. Prattichizzo, Using kinect for hand tracking and rendering in wearable haptics, in Proceedings of IEEE World Haptics Conference (2011), pp. 317-321
365. V. Ganapathi, C. Plagemann, D. Koller, S. Thrun, Real-time human pose tracking from range data, in Proceedings of IEEE European Conference on Computer Vision (Springer, Berlin/Heidelberg, 2012), pp. 738-751
366. D.M. Gavrila, L.S. Davis, 3-D model-based tracking of humans in action: a multi-view approach, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (1996), pp. 73-80
367. R. Girshick, J. Shotton, P. Kohli, A. Criminisi, A. Fitzgibbon, Efficient regression of general-activity human poses from depth images, in Proceedings of IEEE International Conference on Computer Vision (Washington, 2011), pp. 415-422
368. D. Grest, J. Woetzel, R. Koch, Nonlinear body pose estimation from depth images, in Proceedings ofDAGM Conference on Pattern Recognition (Springer, Berlin/Heidelberg, 2005), pp. 285-292
369. P. Guan, A. Weiss, A.O. Balan, M.J. Black, Estimating human shape and pose from a single image, in Proceedings of IEEE International Conference on Computer Vision (2009), pp. 1381-1388
370. H. Hamer, K. Schindler, E. Koller-Meier, L. J. Van Gool, Tracking a hand manipulating an object, in Proceedings of IEEE International Conference on Computer Vision (Kyoto, 2009), pp. 1475-1482
371. T.K. Ho, Random decision forests, in Proceedings of International Conference on Document Analysis and Recognition (1995), pp. 278-282
372. D. Hogg, Model-based vision: a program to see a walking person. Image Vis. Comput. 1(1), 5-20 (1983)
373. S.X. Ju, M.J. Black, Y. Yacoob, Cardboard people: a parameterized model of articulated image motion, in Proceedings of IEEE International Conference on Automatic Face and Gesture Recognition (1996), pp. 38-44
374. I. A. Kakadiaris, D. Metaxas, Three-dimensional human body model acquisition from multiple views. Int. J. Comput. Vis. 30(3), 191-218 (1998)
375. R. Kehl, L. Van Gool, Markerless tracking of complex human motions from multiple views. Comput. Vis. Image Underst. 104(2), 190-209 (2006)
376. C. Keskin, F. Kiraf, Y.E. Kara, L. Akarun, Real time hand pose estimation using depth sensors, in Proceedings of IEEE International Conference on Computer Vision Workshops (2011), pp. 1228-1234
377. C. Keskin, F. Kiraf, Y.E. Kara, L. Akarun, Hand pose estimation and hand shape classification using multi-layered randomized decision forests, in Proceedings of IEEE European Conference on Computer Vision (2012)
378. S. Knoop, S. Vacek, R. Dillmann, Sensor fusion for 3D human body tracking with an articulated 3D body model, in Proceedings of IEEE International Conference on Robotics and Automation (Orlando, 2006), pp. 1686-1691
379. J. J. Kuch, T.S. Huang, Human computer interaction via the human hand: a hand model, in Proceedings of Asilomar Conference on Signals, Systems and Computers (1994), pp. 1252-1256
380. J. Lee, T.L. Kunii, Constraint-based hand animation, in Models and Techniques in Computer Animation, ed. by N.M. Thalmann, D. Thalmann. Computer Animation Series (Springer, Tokyo, 1993), pp. 110-127
381. J.P. Lewis, M. Cordner, N. Fong, Pose space deformation: a unified approach to shape interpolation and skeleton-driven deformation, in Proceedings of ACM SIGGRAPH (New York, 2000), pp. 165-172
382. S. Z. Li, Markov Random Field Modeling in Image Analysis, 3rd edn. (Springer, New York, 2009)
383. T. Liu, W. Liang, X. Wu, L. Chen, Tracking articulated hand underlying graphical model with depth cue, in Proceedings of IEEE International Congress on Image and Signal Processing (Washington, 2008), pp. 249-253
384. Z. Liu, J. Zhu, J. Bu, C. Chen, A survey of human pose estimation: the body parts parsing based methods. J. Vis. Commun. Image Represent. 32, 10-19 (2015)
385. T.B. Moeslund, E. Granum, A survey of computer vision-based human motion capture. Comput. Vis. Image Underst. 81(3), 231-268 (2001)
386. A. Mohr, M. Gleicher, Building efficient, accurate character skins from examples, in Proceedings of ACM SIGGRAPH (New York, 2003), pp. 562-568
387. D. D. Morris, J. Rehg, Singularity analysis for articulated object tracking, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (1998), pp. 289-296
388. I. Oikonomidis, N. Kyriazis, A. Argyros, Efficient model-based 3D tracking of hand articulations using kinect, in Proceedings of British Machine Vision Conference (BMVA, Dundee, 2011), pp. 101.1-101.11
389. J. O’Rourke, N.I. Badler, Model-based image analysis of human motion using constraint propagation. IEEE Trans. Pattern Anal. Mach. Intell. 2(6), 522-536 (1980)
390. S. Park, S. Yu, J. Kim, S. Kim, S. Lee, 3D hand tracking using kalman filter in depth space. EURASIP J. Adv. Signal Process. 2012(1) (2012)
391. C. Plagemann, V. Ganapathi, D. Koller, S. Thrun, Real-time identification and localization of body parts from depth images, in Proceedings of IEEE International Conference on Robotics and Automation (2010), pp. 3108-3113
392. J. Rehg, Visual Analysis ofHigh DOF Articulated Objects with Application to Hand Tracking. PhD thesis, Robotics Institute, Carnegie Mellon University, Pittsburgh (1995)
393. J.M. Rehg, T. Kanade, Digiteyes: vision-based hand tracking for human-computer interaction, in Proceedings of IEEE Workshop on Motion of Non-rigid and Articulated Objects (1994), pp. 16-22
394. K. Rohr, Towards model-based recognition of human movements in image sequences. CVGIP Image Underst. 59(1), 94-115 (1994)
395. G. Shakhnarovich, P. Viola, T. Darrell, Fast pose estimation with parameter-sensitive hashing, in Proceedings of IEEE International Conference on Computer Vision (Washington, 2003), p. 750
396. J. Shotton, Conditional regression forests for human pose estimation, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (Washington, 2012), pp. 3394-3401
397. J. Shotton, A. Fitzgibbon, M. Cook, T. Sharp, M. Finocchio, R. Moore, A. Kipman, A. Blake, Real-time human pose recognition in parts from single depth images, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (Washington, 2011), pp. 1297-1304
398. J. Shotton, R. Girshick, A. Fitzgibbon, T. Sharp, M. Cook, M. Finocchio, R. Moore, P. Kohli, A. Criminisi, A. Kipman, Efficient human pose estimation from single depth images. IEEE Trans. Pattern Anal. Mach. Intell. 35(12), 2821-2840 (2013)
399. H. Sidenbladh, M. J. Black, D. J. Fleet, Stochastic tracking of 3D human figures using 2D image motion, in Proceedings of IEEE European Conference on Computer Vision (Springer, London, 2000), pp. 702-718
400. L. Sigal, Human pose estimation, in Computer Vision, ed. by K. Ikeuchi (Springer, New York, 2014), pp. 362-370
401. L. Sigal, M. Isard, B.H. Sigelman, M.J. Black, Attractive people: assembling loose-limbed models using non-parametric belief propagation, in Proceedings of Conference on Neural Information Processing Systems (Cambridge, 2003), pp. 1539-1546
402. B. Stenger, P.R.S. Mendona, R. Cipolla, Model-based 3D tracking of an articulated hand, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (2001)
403. D. Tang, T.H. Yu, T.K. Kim, Real-time articulated hand pose estimation using semi-supervised transductive regression forests, in Proceedings of IEEE International Conference on Computer Vision (2013), pp. 3224-3231
404. M. Ye, X. Wang, R. Yang, L. Ren, M. Pollefeys, Accurate 3D pose estimation from a single depth image, in Proceedings of IEEE International Conference on Computer Vision (2011), pp. 731-738
405. M.A.R. Ahad, J.K. Tan, H. Kim, S. Ishikawa, Motion history image: its variants and applications. Mach. Vis. Appl. 23(2), 255-281 (2012)
406. B. Apostol, C.R. Mihalache, V. Manta, Using spin images for hand gesture recognition in 3D point clouds, in Proceedings of IEEE International Conference on System Theory, Control and Computing (2014), pp. 544-549
407. P. Barros, S. Magg, C. Weber, S. Wermter, A multichannel convolutional neural network for hand posture recognition, in Proceedings of International Conference on Artificial Neural Networks (Springer, Heidelberg, 2014), pp. 403-410
408. L.E. Baum, T. Petrie, Statistical inference for probabilistic functions of finite state Markov chains. Ann. Math. Stat. 37(6), 1554-1563 (1966)
409. R. Bellman, R. Kalaba, On adaptive control processes. IRE Trans. Automat. Control 4(2), 1-9 (1959)
410. C. M. Bishop, Pattern Recognition and Machine Learning. Information Science and Statistics (Springer, Heidelberg, 2007)
411. K. K. Biswas, S.K. Basu, Gesture recognition using microsoft kinect, in Proceedings of International Conference on Automation, Robotics and Applications (2011), pp. 100-103
412. L. Breiman, Random forests. Mach. Learn. 45(1), 5-32 (2001)
413. P. Breuer, C. Eckes, S. Muller, Hand gesture recognition with a novel IR time-of-flight range camera: a pilot study, in Proceedings of International Conference on Computer Vision/Computer Graphics Collaboration Techniques (Springer, Berlin/Heidelberg, 2007), pp. 247-260
414. T.I. Cerlinca, S.G. Pentiuc, Robust 3D hand detection for gestures recognition, in Intelligent Distributed Computing V, ed. by F.M.T. Brazier, K. Nieuwenhuis, G. Pavlin, M. Warnier, C. Badica. Studies in Computational Intelligence, vol. 382 (Springer, Berlin/Heidelberg, 2012), pp. 259-264.
415. C. C. Chang, I.Y. Chen, Y.S. Huang, Hand pose recognition using curvature scale space, in Proceedings of IEEE International Conference on Pattern Recognition (2002), pp. 386-389
416. Y.W. Chen, C.J. Lin, Combining svms with various feature selection strategies, in Feature Extraction, ed. by I. Guyon, M. Nikravesh, S. Gunn, L.A. Zadeh. Studies in Fuzziness and Soft Computing, vol. 207 (Springer, Berlin/Heidelberg, 2006), pp. 315-324
417. D. Comaniciu, P. Meer, Mean shift: a robust approach toward feature space analysis. IEEE Trans. Pattern Anal. Mach. Intell. 24, 603-619 (2002)
418. F. C. Crow, Summed-area tables for texture mapping, in Proceedings of ACM SIGGRAPH (New York, 1984), pp. 207-212
419. N. Dalal, B. Triggs, Histograms of oriented gradients for human detection, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (2005), pp. 886-893 P.
420. Doliotis, V. Athitsos, D. Kosmopoulos, S. Perantonis, Hand shape and 3D pose estimation using depth data from a single cluttered frame, in Advances in Visual Computing, ed. By G. Bebis, R. Boyle, B. Parvin, D. Koracin, C. Fowlkes, S. Wang, M.-H. Choi, S. Mantler, J. Schulze, D. Acevedo, K. Mueller, M. Papka. Lecture Notes in Computer Science, vol. 7431 (Springer, Berlin/Heidelberg, 2012), pp. 148-158
421. F. Dominio, M. Donadeo, G. Marin, P. Zanuttigh, G.M. Cortelazzo, Hand gesture recognition with depth data, in Proceedings of ACM/IEEE International Workshop on Analysis and Retrieval of Tracked Events and Motion in Imagery Stream (New York, 2013), pp. 9-16
422. F. Dominio, M. Donadeo, P. Zanuttigh, Combining multiple depth-based descriptors for hand gesture recognition. Pattern Recogn. Lett. 50, 101-111 (2014). Depth Image Analysis
423. F. Dominio, G. Marin, M. Piazza, P. Zanuttigh, Feature descriptors for depth-based hand gesture recognition, in Computer Vision and Machine Learning with RGB-D Sensors, ed. by L. Shao, J. Han, P. Kohli, Z. Zhang. Advances in Computer Vision and Pattern Recognition (Springer, Cham, 2014), pp. 215-237
424. D. Droeschel, J. Stuckler, S. Behnke, Learning to interpret pointing gestures with a time-of-flight camera, in Proceedings of ACM/IEEE International Conference on Human-Robot Interaction (2011), pp. 481-488
425. D. Gabor, Theory of communication. Part 1: the analysis of information. J. Inst. Electr. Eng. Part III Radio Commun. Eng. 93(26), 429-441 (1946)
426. V. Ganapathi, C. Plagemann, D. Koller, S. Thrun, Real time motion capture using a single time-of-flight camera, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (2010), pp. 755-762
427. X.H. Han, G. Xu, Y.W. Chen, Robust local ternary patterns for texture categorization, in Proceedings of IEEE International Conference on Biomedical Engineering and Informatics (2013), pp. 846-850
428. M. B. Holte, T.B. Moeslund, P. Fihl, Fusion of range and intensity information for view invariant gesture recognition, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition Workshops (2008), pp. 1-7
429. M.K. Hu, Visual pattern recognition by moment invariants. IRE Trans. Inf. Theory 8(2), 179-187 (1962)
430. A.E. Johnson, M. Hebert, Using spin images for efficient object recognition in cluttered 3D scenes. IEEE Trans. Pattern Anal. Mach. Intell. 21(5), 433-449 (1999)
431. T. Kapuscinski, M. Oszust, M. Wysocki, D. Warchol, Recognition of hand gestures observed by depth cameras. Int. J. Adv. Robot. Syst. 12, 12-36 (2015)
432. N. Kumar, P.N. Belhumeur, A. Biswas, D.W. Jacobs, W.J. Kress, I.C. Lopez, J.V.B. Soares, Leafsnap: a computer vision system for automatic plant species identification, in Proceedings of IEEE European Conference on Computer Vision (Springer, Berlin/Heidelberg, 2012), pp. 502-516
433. A. Kurakin, Z. Zhang, Z. Liu, A real time system for dynamic hand gesture recognition with a depth sensor, in Proceedings of European Signal Processing Conference (2012), pp. 1975-1979
434. D. Li, Y. Dong, Deep learning: methods and applications. Found. Trends Signal Process. 7(3-4), 197-387 (2014)
435. W. Li, Z. Zhang, Z. Liu, Expandable data-driven graphical modeling of human actions based on salient postures. IEEE Trans. Circuits Syst. Video Technol. 18(11), 1499-1510 (2008)
436. W. Li, Z. Zhang, Z. Liu, Action recognition based on a bag of 3D points, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition Workshops (2010), pp. 9-14
437. F. Lv, R. Nevatia, Recognition and segmentation of 3-D human action using hmm and multiclass adaboost, in Proceedings of IEEE European Conference on Computer Vision (Springer, Berlin/Heidelberg, 2006), pp. 359-372
438. J. Macqueen, Some methods for classification and analysis of multivariate observations, in Proceedings of Berkeley Symposium on Mathematical Statistics and Probability (1967), pp. 281-297
439. S. Manay, D. Cremers, B.W. Hong, A.J. Yezzi, S. Soatto, Integral invariants for shape matching. IEEE Trans. Pattern Anal. Mach. Intell. 28(10), 1602-1618 (2006)
440. G. Marin, M. Fraccaro, M. Donadeo, F. Dominio, P. Zanuttigh, Palm area detection for reliable hand gesture recognition, in Proceedings of IEEE International Workshop on Multimedia Signal Processing (2013)
441. G. Marin, F. Dominio, P. Zanuttigh, Hand gesture recognition with leap motion and kinect devices, in Proceedings of IEEE International Conference on Image Processing (2014), pp. 1565-1569
442. G. Marin, F. Dominio, P. Zanuttigh, Hand gesture recognition with jointly calibrated leap motion and depth sensor. Multimedia Tools Appl. 75, 1-25 (2015)
443. R.P. Mihail, N. Jacobs, J. Goldsmith, Static hand gesture recognition with 2 Kinect sensors, in Proceedings of International Conference on Image Processing, Computer Vision, and Pattern Recognition (2012), p. 1
444. T. B. Moeslund, A. Hilton, V. Kruger, A survey of advances in vision-based human motion capture and analysis. Comput. Vis. Image Underst. 104(2), 90-126 (2006)
445. P. Molchanov, S. Gupta, K. Kim, J. Kautz, Hand gesture recognition with 3D convolutional neural networks, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition Workshops (2015)
446. C. Myers, L. Rabiner, A.E. Rosenberg, Performance tradeoffs in dynamic time warping algorithms for isolated word recognition. IEEE Trans. Acoust. Speech Signal Process. 28(6), 623-635 (1980)
447. L. Nanni, A. Lumini, F. Dominio, M. Donadeo, P. Zanuttigh, Combination of depth and texture descriptors for gesture recognition, in Advances in Machine Learning Research, ed. by S. Shandilya. Engineering Tools, Techniques and Tables (Nova Science, Commack, 2014)
448. L. Nanni, A. Lumini, F. Dominio, M. Donadeo, P. Zanuttigh, Ensemble to improve gesture recognition. Int. J. Autom. Identif. Technol. 5, 47-56 (2014)
449. I. Oikonomidis, N. Kyriazis, A. Argyros, Efficient model-based 3D tracking of hand articulations using kinect, in Proceedings of British Machine Vision Conference (BMVA, Dundee, 2011), pp. 101.1-101.11
450. T. Ojala, M. Pietikainen, D. Harwood, A comparative study of texture measures with classification based on featured distributions. Pattern Recognit. 29(1), 51-59 (1996)
451. S.C.W. Ong, S. Ranganath, Automatic sign language analysis: a survey and the future beyond lexical meaning. IEEE Trans. Pattern Anal. Mach. Intell. 27(6), 873-891 (2005)
452. S. Oprisescu, M. Ciuc, I. Vasile, Hand posture recognition using the intrinsic dimension, in Proceedings of IEEE International Conference on Optimization of Electrical and Electronic Equipment (2014), pp. 974-979
453. O. Oreifej, Z. Liu, Hon4d: histogram of oriented 4D normals for activity recognition from depth sequences, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (2013), pp. 716-723
454. F. Pedersoli, N. Adami, S. Benini, R. Leonardi, Xkin: extendable hand pose and gesture recognition library for kinect, in Proceedings of ACM International Conference on Multimedia (New York, 2012), pp. 1465-1468
455. F. Pedersoli, S. Benini, N. Adami, R. Leonardi, Xkin: an open source framework for hand pose and gesture recognition using kinect. Vis. Comput. 30(10), 1107-1122 (2014)
456. R. Poppe, A survey on vision-based human action recognition. Image Vis. Comput. 28(6), 976-990 (2010)
457. N. Pugeault, R. Bowden, Spelling it out: real-time asl fingerspelling recognition, in Proceedings of IEEE International Conference on Computer Vision Workshops (2011), pp. 1114-1119
458. L. Rabiner, A tutorial on hidden markov models and selected applications in speech recognition. Proc. IEEE 77(2), 257-286 (1989)
459. E Rahtu, J. Heikkila V, Ojansivu, T. Ahonen, Local phase quantization for blur-insensitive image analysis. Image Vis. Comput. 30(8), 501-512 (2012)
460. Z. Ren, J. Yuan, Z. Zhang, Robust hand gesture recognition based on finger-earth mover’s distance with a commodity depth camera, in Proceedings of ACM International Conference on Multimedia (New York, 2011), pp. 1093-1096
461. M. Reyes, G. Dominguez, S. Escalera, Feature weighting in dynamic timewarping for gesture recognition in depth data, in Proceedings of IEEE International Conference on Computer Vision Workshops (2011), pp. 1182-1188
462. T. Ruckstie, B. C. Osendorfer, P. Van der Smagt, Sequential feature selection for classification, in Proceedings of International Conference on Advances in Artificial Intelligence (2011), pp. 132-141
463. R.B. Rusu, G. Bradski, R. Thibaux, J. Hsu, Fast 3D recognition and pose using the viewpoint feature histogram, in Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (2010), pp. 2155-2162
464. L. Spinello, K.O. Arras, People detection in RGB-D data, in Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (2011), pp. 3838-3843
465. J. Suarez, R.R. Murphy, Hand gesture recognition with depth images: a review, in Proceedings of IEEE International Symposium on Robot and Human Interactive Communication (2012), pp. 411-417
466. J. Sung, C. Ponce, B. Selman, A. Saxena, Unstructured human activity detection from RGBD images, in Proceedings of IEEE International Conference on Robotics and Automation (2012), pp. 842-849
467. P. Suryanarayan, A. Subramanian, D. Mandalapu, Dynamic hand pose recognition using depth data, in Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition (2010), pp. 3105-3108
468. M. Tang, Recognizing hand gestures with microsoft’s kinect. Technical report, Department of Electrical Engineering, Stanford University (2011)
469. M.Z. Uddin, D.T. Nguyen, T.S. Kim, Human activity recognition via 3-D joint angle features and hidden markov models, in Proceedings of IEEE International Conference on Image Processing (2010), pp. 713-716
470. D. Uebersax, J. Gall, M. Van den Bergh, L. Van Gool, Real-time sign language letter and word recognition from depth data, in Proceedings of IEEE International Conference on Computer Vision Workshops (2011), pp. 383-390
471. M. Van den Bergh, L. Van Gool, Combining RGB and ToF cameras for real-time 3D hand gesture interaction, in Proceedings of IEEE Workshop on Applications of Computer Vision (2011), pp. 66-72
472. A.W. Vieira, E.R. Nascimento, G.L. Oliveira, Z. Liu, M.F.M. Campos, Stop: space-time occupancy patterns for 3D action recognition from depth map sequences, in Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications, ed. by L. Alvarez, M. Mejail, L. Gomez, J. Jacobo. Lecture Notes in Computer Science, vol. 7441 (Springer, Berlin/Heidelberg, 2012), pp. 252-259
473. P. Viola, M. Jones, Robust real-time object detection, in Int. J. Comput. Vis. (2001)
474. J.P. Wachs, M. Kolsch, H. Stern, Y. Edan, Vision-based hand-gesture applications. Commun. ACM 54(2), 60-71 (2011)
475. J. Wang, Z. Liu, J. Chorowski, Z. Chen, Y. Wu, Robust 3D action recognition with random occupancy patterns, in Proceedings of IEEE European Conference on Computer Vision (2012), pp. 872-885
476. J. Wang, Z. Liu, Y. Wu, J. Yuan, Mining actionlet ensemble for action recognition with depth cameras, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (2012), pp. 1290-1297
477. J. Wang, Z. Liu, Y. Wu, J. Yuan, Learning actionlet ensemble for 3D human action recognition. IEEE Trans. Pattern Anal. Mach. Intell. 36(5), 914-927 (2014)
478. R. Wang, S. Paris, J. Popovic, 6D hands: markerless hand-tracking for computer aided design, in Proceedings ofAnnual ACM Symposium on User Interface Software and Technology (New York, 2011), pp. 549-558
479. L. Xia, K. Fujimura, Hand gesture recognition using depth data, in Proceedings of IEEE International Conference on Automatic Face and Gesture Recognition (2004), pp. 529-534
480. L. Xia, C.C. Chen, J.K. Aggarwal, View invariant human action recognition using histograms of 3D joints, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition Workshops (Providence, 2012), pp. 20-27
481. C. Yang, Y. Jang, J. Beh, D. Han, K. Hanseok, Gesture recognition using depth-based hand tracking for contactless controller application, in Proceedings of IEEE International Conference on Consumer Electronics (2012), pp. 297-298
482. X. Yang, Y.L. Tian, Eigenjoints-based action recognition using nai've-bayes-nearest-neighbor, in Proceedings of IEEE Conference on Computer Vision and Pattern Recognition Workshops (2012), pp. 14-19
483. X. Yang, C. Zhang, Y. Tian, Recognizing actions using depth motion maps-based histograms of oriented gradients, in Proceedings of ACM International Conference on Multimedia (New York, 2012), pp. 1057-1060
484. W. Yong, Y. Tianli, L. Shi, L. Zhu, Using human body gestures as inputs for gaming via depth analysis, in Proceedings of IEEE International Conference on Multimedia and Expo (2008), pp. 993-996
485. R. Zhou, Y. Junsong, M. Jingjing, Z. Zhengyou, Robust part-based hand gesture recognition using kinect sensor. IEEE Trans. Multimedia 15(5), 1110-1120 (2013)