Light-Field Correction for Spatial Calibration of Optical See-Through Head-Mounted Displays

IEEE Transactions on Visualization and Computer Graphics

Volumn 21, Issue 4, 2015, Pages 471-480

  Itoh, Yuta ^a   Klinker, Gudrun ^a  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

Author keywords

calibration; eye tracking; INDICA; light field; optical see through display; OST HMD; SPAAM; undistortion

Indexed keywords

ARTIFICIAL INTELLIGENCE; CALIBRATION; ERRORS; FIELD EMISSION DISPLAYS; LEARNING SYSTEMS; LIGHT; SYSTEMATIC ERRORS;

EYE-TRACKING; INDICA; LIGHT FIELDS; OPTICAL SEE-THROUGH DISPLAY; SPAAM; UNDISTORTION;

HELMET MOUNTED DISPLAYS;

CALIBRATION; COMPUTER GRAPHICS; COMPUTER INTERFACE; DEVICES; EQUIPMENT DESIGN; EYE MOVEMENT; HEAD; HUMAN; OPTICS; PHYSIOLOGY;

CALIBRATION; COMPUTER GRAPHICS; EQUIPMENT DESIGN; EYE MOVEMENTS; HEAD; HUMANS; OPTICS AND PHOTONICS; USER-COMPUTER INTERFACE;

EID: 84961317996     PISSN: 10772626     EISSN: None     Source Type: Journal    
DOI: 10.1109/TVCG.2015.2391859     Document Type: Article

References (37)

1. M. Axholt. Pinhole camera calibration in the presence of human noise. Linköping University Electronic Press, 2011.
2. R. Azuma and G. Bishop. Improving static and dynamic registration in an optical see-through HMD. In Proceedings of ACM SIGGRAPH 1994, pages 197-204, 1994.
3. R. Azuma and G. Bishop. A frequency-domain analysis of head-motion prediction. In Proceedings of ACM SIGGRAPH 1995, pages 401-408, 1995.
4. R. T. Azuma. A survey of augmented reality. Presence: Teleoperators and Virtual Environments, 6(4):355-385, Aug. 1997.
5. O. Bimber, A. Grundhöfer, G. Wetzstein, and S. Knödel. Consistent illumination within optical see-through augmented environments. In Proceedings of IEEE International Symposium on Mixed and Augmented Reality (ISMAR) 2003, pages 198-207, 2003.
6. O. Cakmakci, Y. Ha, and J. P. Rolland. A compact optical see-through head-worn display with occlusion support. In Proceedings of IEEE International Symposium on Mixed and Augmented Reality (ISMAR) 2004, pages 16-25, 2004.
7. F. Devernay and O. D. Faugeras. Straight lines have to be straight. Journal of Machine Vision and Applications, 13(1):14-24, 2001.
8. J. Didier, D. Roussel, and M. Mallem. A time delay compensation method improving registration for augmented reality. In Proceedings of IEEE International Conference on Robotics and Automation (ICRA) 2005, April 18-22, 2005, Barcelona, Spain, pages 3384-3389, 2005.
9. S. J. Gilson, A. W. Fitzgibbon, and A. Glennerster. Spatial calibration of an optical see-through head-mounted display. Journal of Neuroscience Methods, 173(1):140-146, 2008.
10. S. J. Gortler, R. Grzeszczuk, R. Szeliski, and M. F. Cohen. The lumigraph. In Proceedings of ACM SIGGRAPH 1996, pages 43-54, 1996.
11. R. R. Hainich and O. Bimber. Displays: fundamentals and applications. CRC press, 2011.
12. R. I. Hartley and S. B. Kang. Parameter-free radial distortion correction with center of distortion estimation. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 29(8):1309-1321, 2007.
13. W. Heidrich, H. P. A. Lensch, M. F. Cohen, and H.-P. Seidel. Light field techniques for reflections and refractions. In Rendering Techniques, pages 187-196, 1999.
14. R. L. Holloway. Registration error analysis for augmented reality. Presence: Teleoperators and Virtual Environments, 6(4):413-432, 1997.
15. F.-C. Huang, G. Wetzstein, B. A. Barsky, and R. Raskar. Eyeglasses-free display: towards correcting visual aberrations with computational light field displays. ACM Transactions on Graphics (TOG), 33(4):59, 2014.
16. Y. Itoh and G. Klinker. Interaction-free calibration for optical see-through head-mounted displays based on 3d eye localization. In Proceedings of IEEE Symposium on 3D User Interfaces (3DUI), Minneapolis, MN, USA, March 29-30, 2014, pages 75-82, 2014.
17. Y. Itoh and G. Klinker. Performance and sensitivity analysis of INDICA: Interaction-free display calibration for optical see-through head-mounted displays. In Proceedings of IEEE International Symposium on Mixed and Augmented Reality (ISMAR) 2014, pages 171-176, 2014.
18. A. Jones, I. McDowall, H. Yamada, M. Bolas, and P. Debevec. Rendering for an interactive 360 light field display. 26(3):40, 2007.
19. K. Kiyokawa, Y. Kurata, and H. Ohno. An optical see-through display for mutual occlusion with a real-time stereovision system. Computers & Graphics, 25(5):765-779, 2001.
20. M. Klemm, H. Hoppe, and F. Seebacher. Non-parametric camera-based calibration of optical see-through glasses for augmented reality applications. In Proceedings of IEEE International Symposium on Mixed and Augmented Reality (ISMAR) 2014, pages 273-274, 2014.
21. S. Lee and H. Hua. A robust camera-based method for optical distortion calibration of head-mounted displays. In Proceedings of IEEE VR 2013, pages 27-30, 2013.
22. M. Levoy and P. Hanrahan. Light field rendering. In Proceedings of ACM SIGGRAPH 1996, pages 31-42, 1996.
23. S. Liu, D. Cheng, and H. Hua. An optical see-through head mounted display with addressable focal planes. In Proceedings of IEEE International Symposium on Mixed and Augmented Reality (ISMAR) 2008, pages 33-42, 2008.
24. K. Moser, Y. Itoh, K. Oshima, E. Swan, G. Klinker, and C. Sandor. Subjective evaluation of a semi-automatic optical see-through head-mounted display calibration technique. IEEE Transactions on Visualization and Computer Graphics (Proceedings Virtual Reality 2015), 21(4):491-500, Aprial 2015.
25. R. Ng, M. Levoy, M. Brédif, G. Duval, M. Horowitz, and P. Hanrahan. Light field photography with a hand-held plenoptic camera. In Computer Science Technical Report CSTR, volume 2, 2005.
26. S. Nicolau, L. Soler, D. Mutter, and J. Marescaux. Augmented reality in laparoscopic surgical oncology. Surgical oncology, 20(3):189-201, 2011.
27. C. B. Owen, J. Zhou, A. Tang, and F. Xiao. Display-relative calibration for optical see-through head-mounted displays. In Proceedings of IEEE International Symposium on Mixed and Augmented Reality (ISMAR) 2004, pages 70-78, 2004.
28. A. Plopski, Y. Itoh, C. Nitschke, K. Kiyokawa, G. Klinker, and H. Takemura. Corneal-imaging calibration for optical see-through head-mounted displays. IEEE Transactions on Visualization and Computer Graphics (Proceedings Virtual Reality 2015), 21(4):481-490, Aprial 2015.
29. M. Qiu and S. D. Ma. The nonparametric approach for camera calibration. In Proceedings of IEEE International Conference on Computer Vision (ICCV) 1995, pages 224-229, 1995.
30. B. Scholkopf and A. J. Smola. Learning with kernels: support vector machines, regularization, optimization, and beyond. MIT press, 2001.
31. M. Stone. Cross-validatory choice and assessment of statistical predictions. Journal of the Royal Statistical Society. Series B (Methodological), pages 111-147, 1974.
32. P. F. Sturm, S. Ramalingam, J. Tardif, S. Gasparini, and J. Barreto. Camera models and fundamental concepts used in geometric computer vision. Foundations and Trends in Computer Graphics and Vision, 6(1-2):1-183, 2011.
33. H. Takeda, S. Farsiu, and P. Milanfar. Kernel regression for image processing and reconstruction. IEEE Transactions on Image Processing, 16(2):349-366, 2007.
34. M. Tuceryan, Y. Genc, and N. Navab. Single-point active alighment method (spaam) for optical see-through hmd calibration for augmented reality. Presence: Teleoperators and Virtual Environments, 11(3):259-276, 2002.
35. C. Y. Vincent and T. Tjahjadi. Multiview camera-calibration framework for nonparametric distortions removal. IEEE Transactions on Robotics, 21(5):1004-1009, 2005.
36. Z. Zhang. A flexible new technique for camera calibration. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 22(11):1330-1334, 2000.
37. F. Zheng, T. Whitte, A. Lastra, P. Lincoln, A. State, A. Maimonek, and H. Fuchs. Minimizing latency for augmented reality displays: Frames considered harmful. In Proceedings of IEEE International Symposium on Mixed and Augmented Reality (ISMAR) 2014, pages 195-200, 2014.