Calibrated depth and color cameras for accurate 3D interaction in a stereoscopic augmented reality environment

Journal of Visual Communication and Image Representation

Volumn 25, Issue 1, 2014, Pages 227-237

  Canessa, Andrea ^a   Chessa, Manuela ^a   Gibaldi, Agostino ^a   Sabatini, Silvio P ^a   Solari, Fabio ^a  

^a UNIVERSITY OF GENOA   (Italy)

Author keywords

Calibration and data pre processing; Eyes tracking; Human computer interactions; Kinect device; Mixed reality; RGB D cameras; Spatially variant depth correction; Virtual reality

Indexed keywords

DATA PREPROCESSING; DEPTH CORRECTIONS; KINECT DEVICE; MIXED REALITY; RGB-D CAMERAS;

AUGMENTED REALITY; CALIBRATION; CAMERAS; SENSORS; THREE DIMENSIONAL; VIRTUAL REALITY;

THREE DIMENSIONAL COMPUTER GRAPHICS;

EID: 84891626576     PISSN: 10473203     EISSN: 10959076     Source Type: Journal    
DOI: 10.1016/j.jvcir.2013.02.011     Document Type: Article

References (29)

1. J. Stowers, M. Hayes, A. Bainbridge-Smith, Altitude control of a quadrotor helicopter using depth map from Microsoft Kinect sensor, in: International Conference on Mechatronics, 2011, pp. 358-363.
2. P. Henry, M. Krainin, E. Herbst, X. Ren, and D. Fox RGB-D mapping: using Kinect-style depth cameras for dense 3D modeling of indoor environments International Journal of Robotics Research 31 5 2012 647 663
3. Z. Zafrulla, H. Brashear, T. Starner, H. Hamilton, P. Presti, American sign language recognition with the Kinect, in: Proceedings of the 13th international conference on multimodal interfaces, ICMI '11, 2011, pp. 279-286.
4. V. Frati, D. Prattichizzo, Using Kinect for hand tracking and rendering in wearable haptics, in: World Haptics Conference (WHC), 2011 IEEE, 2011, pp. 317-321.
5. J. Raheja, A. Chaudhary, K. Singal, Tracking of fingertips and centers of palm using Kinect, in: Third International Conference on Computational Intelligence, Modelling and Simulation (CIMSiM), 2011, pp. 248-252.
6. R.A. Clark, Y.-H. Pua, K. Fortin, C. Ritchie, K.E. Webster, L. Denehy, and A.L. Bryant Validity of the Microsoft Kinect for assessment of postural control Gait & Posture 36 3 2012 372 377
7. T. Dutta Evaluation of the Kinect sensor for 3-D kinematic measurement in the workplace Applied Ergonomics 43 4 2012 645 649
8. E.E. Stone, M. Skubic, Evaluation of an inexpensive depth camera for passive in-home fall risk assessment, in: Pervasive Health, 2011, pp. 71-77.
9. T. Franke, S. Kahn, M. Olbrich, Y. Jung, Enhancing realism of mixed reality applications through real-time depth-imaging devices in X3D, in: Proceedings of the 16th International Conference on 3D Web Technology, 2011, pp. 71-79.
10. P. Lensing, W. Broll, Fusing the real and the virtual: a depth-camera based approach to mixed reality, in: IEEE International Symposium on Mixed and Augmented Reality, 2011, pp. 261-262.
11. A. Maimone, J. Bidwell, K. Peng, and H. Fuchs Enhanced personal autostereoscopic telepresence system using commodity depth cameras Computers & Graphics 36 7 2012 791 807
12. T. Sielhorst, C. Bichlmeier, S. Heining, N. Navab, Depth perception a major issue in medical AR: evaluation study by twenty surgeons, in: Medical Image Computing and Computer-Assisted Intervention MICCAI 2006, vol. 4190 of Lecture Notes in Computer Science, 2006, pp. 364-372. (Pubitemid 44609126)
13. H. Liao, T. Inomata, I. Sakuma, and T. Dohi 3-D augmented reality for MRI-guided surgery using integral videography autostereoscopic image overlay IEEE Transactions on Biomedical Engineering 57 6 2010 1476 1486
14. J.E. Cutting, P.M. Vishton, Perceiving layout and knowing distances: the integration, relative potency and contextual use of different information about depth, in: W. Epstein, S. Rogers (Eds.), Handbook of perception and Cognition, Perception of Space and Motion, vol. 5, 1995, pp. 69-117.
15. C.D. Herrera, J. Kannala, J. Heikkilä, Accurate and practical calibration of a depth and color camera pair, in: Proceedings of the 14th International Conference on Computer Analysis of Images and Patterns - Volume Part II, CAIP'11, 2011, pp. 437-445.
16. K. Khoshelham, and S.O. Elberink Accuracy and resolution of Kinect depth data for indoor mapping applications Sensors 12 2 2012 1437 1454
17. D. Herrera, J. Kannala, and J. Heikkila Joint depth and color camera calibration with distortion correction IEEE Transactions on Pattern Analysis and Machine Intelligence 34 10 2012 2058 2064
18. B. De Araujo, G. Casiez, J. Jorge, M. Hachet, Modeling on and above a stereoscopic multitouch display, in: 3DCHI - The 3rd Dimension of CHI, 2012, pp. 79-86.
19. R.Y. Wang, and J. Popović Real-time hand-tracking with a color glove ACM Transactions on Graphics 28 3 2009 1 68
20. I. Oikonomidis, N. Kyriazis, and A. Argyros Efficient model-based 3D tracking of hand articulations using Kinect BMVC 2011 2011 BMVA
21. R. Wang, S. Paris, and J. Popović 6D hands: markerless hand-tracking for computer aided design Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology 2011 ACM 549 558
22. Y. Tang, B. Lam, I. Stavness, and S. Fels Kinect-based augmented reality projection with perspective correction ACM SIGGRAPH 2011 Posters 2011 ACM
23. R.T. Held, M.S. Banks, Misperceptions in stereoscopic displays: a vision science perspective, in: Proceedings of the 5th Symposium on Applied Perception in Graphics and Visualization, APGV '08, 2008, pp. 23-32.
24. M. Chessa, M. Garibotti, A. Canessa, A. Gibaldi, S.P. Sabatini, F. Solari, A stereoscopic augmented reality system for the veridical perception of the 3D scene layout, in: International Conference on Computer Vision Theory and Applications (VISAPP), 2012, pp. 15-23.
25. F. Solari, M. Chessa, M. Garibotti, S.P. Sabatini, Natural perception in dynamic stereoscopic augmented reality environments, Displays. http://dx.doi.org/10.1016/j.displa.2012.08.001.
26. A. Maimone, H. Fuchs, Reducing interference between multiple structured light depth sensors using motion, in: S. Coquillart, S. Feiner, K. Kiyokawa (Eds.), VR, IEEE, 2012, pp. 51-54.
27. Z. Wartell, L. Hodges, and W. Ribarsky A geometric comparison of algorithms for fusion control in stereoscopic HTDs IEEE Transactions on Visualization and Computer Graphics 8 2 2002 129 143 (Pubitemid 34550420)
28. L. Li, Y. Xu, A. König, Robust depth camera based eye localization for human-machine interactions, in: Proceedings of the 15th International Conference on Knowledge-Based and Intelligent Information and Engineering Systems - Volume Part I, 2011, pp. 424-435.
29. J. Heikkila, O. Silven, A four-step camera calibration procedure with implicit image correction, in: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1997, pp. 1106-1112.