Photogrammetric bundle adjustment with self-calibration of the primesense 3d camera technology: Microsoft kinect

IEEE Access

Volumn 1, Issue , 2013, Pages 465-474

  Chow, Jacky C K ^a   Lichti, Derek D ^a  

^a UNIVERSITY OF CALGARY   (Canada)

Author keywords

3D stereo scene analysis; Camera calibration; Kinect; Quality assurance; Quantization

Indexed keywords

CALIBRATION; QUALITY ASSURANCE;

3D/STEREO SCENE ANALYSIS; BUNDLE ADJUSTMENT WITH SELF CALIBRATIONS; CAMERA CALIBRATION; DEPTH DISCONTINUITIES; GEOMETRIC MEASUREMENTS; INTRINSIC AND EXTRINSIC PARAMETERS; KINECT; QUANTIZATION;

CAMERAS;

EID: 84894288019     PISSN: None     EISSN: 21693536     Source Type: Journal    
DOI: 10.1109/ACCESS.2013.2271860     Document Type: Article

References (43)

1. P. Loriggio, Toronto Doctors Try Microsoft Kinect in OR, Toronto, ON, Canada: Globe and Mail, 2011.
2. M. Zollner, S. Huber, H.-C. Jetter, and H. Reiterer, "NAVI-A proof of concept of a mobile navigational aid for visually impaired based on the microsoft kinect," in Proc. 13th IFIP TC , Lisbon, Portugal, Sep. 2011, pp. 584-587.
3. M. Johnson and K. Hawick, "Teaching computational science and simulations using interactive depth-of-field technologies," in Proc. Int. Conf Frontiers Educ., Comput. Sci. Comput. Eng., 2012, pp. 1-7.
4. M. Fallon, H. Johannsson, J. Brookshire, S. Teller, and J. Leonard, "Sensor fusion for-exible humanfiportable building-scale mapping," in Proc. IEEE/RSJ Int. Conf. Intell. Robots Syst., Algarve, Portugal, Oct. 2012, pp. 4405-4412.
5. I. Oikonomidis, N. Kyriazis, and A. Argyros, "Efficient model-based 3D tracking of hand articulations using kinect," in Proc. BMVC, Sep. 2011, p. 101.
6. J. Boehm, "Natural user interface sensors for human body measurement," Int. Archive Photogram. Remote Sens., 2012, pp. 531-536.
7. K. Khoshelham, "Accuracy analysis of kinect depth data," in Proc. Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci., 2011, pp. 133-138.
8. F. Menna, F. Remondino, R. Battisti, and E. Nocerino, "Geometric investigation of a gaming active device," Proc. SPIE, vol. 8085, p. 80850G, May 2011.
9. C. Toth, B. Molnar, A. Zaydak, and D. Grejner-Brzezinska, "Calibrating the MS kinect sensor," in Proc. ASPRS, Mar. 2012.
10. N. Burrus. (2012, Mar. 30). RGBDemo [Online]. Available: http://labs.manctl.com/rgbdemo/
11. K. Khoshelham and S. O. Elberink, "Accuracy and resolution of kinect depth data for indoor mapping applications," Sensors, vol. 12, no. 2, pp. 1437-1454, 2012.
12. D. Lichti and C. Kim, "A comparison of three geometric self-calibration methods for range cameras," Remote Sens., vol. 3, no. 5, pp. 1014-1028, 2011.
13. J. Smisek, M. Jancosek, and T. Pajdla, "3D with kinect," in Proc. IEEE ICCV Workshops, Barcelona, Spain, Nov. 2011, pp. 1154-1160.
14. D. Herrera, J. Kannala, and J. Heikkila, "Joint depth and color camera calibration with distortion correction," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 10, pp. 2058-2064, Oct. 2012.
15. M. Draelos, "The Kinect up close: Modifications for short-range depth imaging," M.S. thesis, North Carolina State Univ., Raleigh, NC, USA, 2012.
16. C. Herrera, J. Kannala, and J. Heikkila, "Accurate and practical calibration of a depth and color camera pair," in Proc. 14th Int. Conf. Comput. Anal. Images Patterns, Seville, Spain, 2011, pp. 437-445.
17. C. Zhang and Z. Zhang, "Calibration between depth and color sensors for commodity depth cameras," in Proc. IEEE ICME, Jul. 2011, pp. 1-6.
18. J. Chow, K. Ang, D. Lichti, andW. Teskey, "Performance analysis of a lowcost triangulation-based 3D camera: Microsoft Kinect system," in Proc. Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci., 2012, pp. 175-180.
19. A. Staranowicz and G. Mariottini, "A comparative study of calibration methods for Kinect-style cameras," in Proc. 5th Int. Conf. Pervas. Technol. Rel. Assistive Environ., Jun. 2012, p. 49.
20. W. Zhao and N. Nandhakumar, "Effects of camera alignment errors on stereoscopic depth estimates," Pattern Recognit. vol. 29. no. 12, pp. 2115-2126, 1996.
21. K. Konolige and P. Mihelich. (2013, Feb. 17). Kinect Cal-ibration: Technical [Online]. Available: http://www.ros.org/wiki/kinect-calibration/ technical
22. C. D. Mutto, P. Zanuttigh, and G. Cortelazzo, Time-of-Flight Cam-eras and Microsoft Kinect. New York, NY, USA: Springer-Verlag, 2013.
23. B. Freedman, A. Shpunt, M. Machline, andY. Arieli, U.S. Patent 0 018 123, 2010.
24. (2013, Feb. 19). Hardware Info [Online]. Available: http://openkinect. org/wiki/Hardware-info
25. J. Smisek and T. Pajdla, "3D camera calibration," M.S. thesis, Czech Tech. Univ. Prague, Prague, Czech Republic, 2011.
26. D. Brown, "Close-range camera calibration," Photogram. Eng., vol. 37, no. 8, pp. 855-866, 1971.
27. C. Fraser, "Digital camera self-calibration," ISPRS J. Photogram. Remote Sens., vol. 52, no. 4, pp. 149-159, 1997.
28. G. He, K. Novak, and W. Feng, "Stereo camera system calibration with relative orientation constraints," Proc. SPIE, vol. 1820, pp. 2-8, Nov. 1992.
29. B. King, "Bundle adjustment of constrained stereopairs-Mathematical models," Geomat. Res. Australasia, vol. 63, pp. 67-92, Feb. 1995.
30. A. Tommaselli, M. Galo, J. Marcato, R. Ruy, and R. Lopes, "Registration and fusion of multiple images acquired with medium format cameras," in Proc. Int. Archives Photogram. Remote Sens., 2010, pp. 1-6.
31. N. El-Sheimy, "A mobile multi-sensor system for GIS applications in urban centers," Int. Archives Photogram. Remote Sens., 1992, pp. 95-100.
32. J. Lerma, S. Navarro, M. Cabrelles, and A. Seguí, "Camera calibration with baseline distance constraints," Photogram. Rec., vol. 25, no. 130, pp. 140-158, 2010.
33. A. Tommaselli, M. Moraes, J. Marcato, C. Caldeira, R. Lopes, and M. Galo, "Using relative orientation constraints to produce virtual images from oblique frames," in Proc. Int. Archives Photogram. Remote Sens., 2012, pp. 61-66.
34. A. Habib, A. Kersting, K. Bang, and J. Rau, "A novel single-step procedure for the calibration of the mounting parameters of a multificamera terrestrial mobile mapping system," Archives Photogram., Cartography Remote Sens., vol. 22, pp. 173-185, Jan. 2011.
35. A. Kersting, "Quality assurance of multi-sensor systems," Ph.D. dissertation, Dept. Geomatics Eng., Univ. Calgary, Calgary, AB, Canada, 2011.
36. M. Trobina, "Error model of a coded-light range sensor," Commun. Technol. Lab. Image Science Group, ETH-Zentrum, Zurich, Tech. Rep., 1995.
37. G. Falcao, N. Hurtos, and J. Massich, "Plane-based calibration of a projector-camera system," VIBOT, Le Creusot, France, Tech. Rep., 2008.
38. M. Obaidat and K. Wong, "Geometric calibration of CCD camera using planar object," J. Survey. Eng., vol. 122, no. 3, pp. 97-113, 1996.
39. J. Bouguet. (2012, Mar. 30). Camera Calibra-tion Toolbox for Matlab [Online]. Available: http://www.vision.caltech.edu/bouguetj/calib-doc/index.html
40. D. Lichti and J. Chow, "Inner constraints for planar features," Photogram. Rec., vol. 28, no. 141, pp. 74-85, 2013.
41. W. Forstner and B. Wrobel, "Mathematical concepts in photogrammetry," in Manual of Photogrammetry, 5th ed. Bethesda, MD, USA: American Society of Photogrammetry and Remote Sensing, 2004, pp. 15-180.
42. W. Caspary and J. Rüeger, Concepts of Network and Deformation Analysis, Kensington, Australia: Univ. New South Wales, 1987.
43. B.Widrow, I.Kollar, and M. Liu, "Statistical theory of quantization," IEEE Trans. Intrum. Meas., vol. 45, no. 2, pp. 353-361, Apr. 1996.