Corneal-Imaging Calibration for Optical See-Through Head-Mounted Displays

IEEE Transactions on Visualization and Computer Graphics

Volumn 21, Issue 4, 2015, Pages 481-490

  Plopski, Alexander ^a   Itoh, Yuta ^b   Nitschke, Christian ^c   Kiyokawa, Kiyoshi ^a   Klinker, Gudrun ^b   Takemura, Haruo ^a  

^a OSAKA UNIVERSITY   (Japan)

^b TECHNICAL UNIVERSITY OF MUNICH   (Germany)

^c KYOTO UNIVERSITY   (Japan)

Author keywords

eye pose estimation; optical see through; OST HMD calibration

Indexed keywords

AUGMENTED REALITY; CALIBRATION; DISPLAY DEVICES; IMAGE PROCESSING; OPTICAL DATA PROCESSING; TRACKING (POSITION);

CONCEPTUAL RESEARCH; HMD CALIBRATIONS; IMAGING CALIBRATION; MANUAL CALIBRATION; OPTICAL SEE-THROUGH; OPTICAL SEE-THROUGH HEAD-MOUNTED DISPLAYS; POSE ESTIMATION; SPATIAL VISUALIZATION;

HELMET MOUNTED DISPLAYS;

ANATOMY AND HISTOLOGY; CALIBRATION; COMPUTER GRAPHICS; CORNEA; DEVICES; EYE MOVEMENT; HEAD; HUMAN; PHYSIOLOGY; PROCEDURES; THREE DIMENSIONAL IMAGING; VISUAL SYSTEM EXAMINATION;

CALIBRATION; COMPUTER GRAPHICS; CORNEA; DIAGNOSTIC TECHNIQUES, OPHTHALMOLOGICAL; EYE MOVEMENTS; HEAD; HUMANS; IMAGING, THREE-DIMENSIONAL;

EID: 84961289181     PISSN: 10772626     EISSN: None     Source Type: Journal    
DOI: 10.1109/TVCG.2015.2391857     Document Type: Article

References (43)

1. A. Agrawal and S. Ramalingam. Single image calibration of multi-axial imaging systems. In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 1399-1406, 2013.
2. M. Axholt, M. A. Skoglund, S. D. O'Connell, M. D. Cooper, S. R. Ellis, and A. Ynnerman. Parameter estimation variance of the single point active alignment method in optical see-through head mounted display calibration. In Proc. IEEE Virtual Reality Conference (VR), pages 27-34, 2011.
3. R. T. Azuma. Predictive Tracking for Augmented Reality. PhD thesis, University of North Carolina, 1995.
4. M. Backes, T. Chen, M. Duermuth, H. Lensch, and M. Welk. Tempest in a teapot: Compromising reflections revisited. In Proc. IEEE Symposium on Security and Privacy (SP), pages 315-327, 2009.
5. M. Backes, M. Durmuth, and D. Unruh. Compromising reflections-or-how to read lcd monitors around the corner. In Proc. IEEE Symposium on Security and Privacy (SP), pages 158-169, 2008.
6. A. Bulling, D. Roggen, and G. Tröster. Wearable eog goggles: Seamless sensing and context-awareness in everyday environments. Journal of Ambient Intelligence and Smart Environments, 1(2):157-171, 2009.
7. T. Caudell and D. Mizell. Augmented reality: An application of heads-up display technology to manual manufacturing processes. In Proc. Hawaii International Conference on System Sciences, volume 2, pages 659-669, 1992.
8. A. Geiger, F. Moosmann, O. Car, and B. Schuster. Automatic calibration of range and camera sensors using a single shot. In Proc. International Conference on Robotics and Automation (ICRA), pages 3936-3943, 2012.
9. Y. Genc, F. Sauer, F. Wenzel, M. Tuceryan, and N. Navab. Optical see-through hmd calibration: A stereo method validated with a video see-through system. In Proc. IEEE/ACM International Symposium on Augmented Reality (ISAR), pages 165-174, 2000.
10. Y. Genc, M. Tuceryan, and N. Navab. Practical solutions for calibration of optical see-through devices. In Proc. IEEE/ACM International Symposium on Mixed and Augmented Reality (ISMAR), pages 169-175, 2002.
11. E. D. Guestrin and M. Eizenman. General theory of remote gaze estimation using the pupil center and corneal reflections. IEEE Transactions on Biomedical Engineering, 53(6):1124-1133, 2006.
12. M. A. Halstead, B. A. Barsky, S. A. Klein, and R. B. Mandell. Reconstructing curved surfaces from specular reflection patterns using spline surface fitting of normals. In Proc. ACM Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH), pages 335-342, 1996.
13. D. Hansen and Q. Ji. In the eye of the beholder: A survey of models for eyes and gaze. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(3):478-500, 2010.
14. R. L. Holloway. Registration error analysis for augmented reality. Presence: Teleoperators and Virtual Environments, 6(4):413-432, 1997.
15. Y. Ishiguro, A. Mujibiya, T. Miyaki, and J. Rekimoto. Aided eyes: Eye activity sensing for daily life. In Proc. Augmented Human International Conference (AH), pages 25:1-25:7, 2010.
16. Y. Itoh and G. Klinker. Interaction-free calibration for optical see-through head-mounted displays based on 3d eye localization. In Proc. IEEE Symposium on 3D User Interfaces (3DUI), pages 75-82, 2014.
17. Y. Itoh and G. Klinker. Performance and sensitivity analysis of indica: Interaction-free display calibration for optical see-through head-mounted displays. In Proc. IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pages 171-176, 2014.
18. Y. Itoh and G. Klinker. Light-field correction for spatial calibration of optical see-through head-mounted displays. IEEE Transactions on Visualization and Computer Graphics (Proceedings Virtual Reality 2015), 21(4):471-480, April 2015.
19. N. Kishishita, K. Kiyokawa, J. Orlosky, T. Mashita, H. Takemura, and E. Kruijff. Analysing the effects of a wide field of view augmented reality display on search performance in divided attention tasks. In Proc. IEEE/ACM International Symposium on Mixed and Augmented Reality (ISMAR), pages 177-186, 2014.
20. M. Klemm, H. Hoppe, and F. Seebacher. Non-parametric camera-based calibration of optical see-through glasses for augmented reality applications. In Proc. IEEE International Symposium on Mixed and Augmented Reality - Arts, Media, and Humanities (ISMAR-AMH), pages 273-274, 2014.
21. G. Liestol and A. Morrison. Views, alignment and incongruity in indirect augmented reality. In Proc. IEEE International Symposium on Mixed and Augmented Reality - Arts, Media, and Humanities (ISMAR-AMH), pages 23-28, 2013.
22. P. Maier, A. Dey, C. A. L. Waechter, C. Sandor, M. Tonnis, and G. Klinker. An empiric evaluation of confirmation methods for optical see-through head-mounted display calibration. In Proc. IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pages 267-268, 2011.
23. A. Nakazawa and C. Nitschke. Point of gaze estimation through corneal surface reflection in an active illumination environment. In Proc. European Conference on Computer Vision (ECCV), pages 159-172, 2012.
24. N. Navab, S. Zokai, Y. Genc, and E. M. Coelho. An on-line evaluation system for optical see-through augmented reality. In Proc. IEEE Virtual Reality Conference (VR), pages 245-246, 2004.
25. K. Nishino, P. N. Belhumeur, and S. K. Nayar. Using eye reflections for face recognition under varying illumination. In Proc. IEEE International Conference on Computer Vision (ICCV), pages 519-526, 2005.
26. K. Nishino and S. K. Nayar. Eyes for relighting. In Proc. ACM Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH), pages 704-711, 2004.
27. K. Nishino and S. K. Nayar. Corneal imaging system: Environment from eyes. International Journal of Computer Vision, 70(1):23-40, 2006.
28. C. Nitschke and A. Nakazawa. Super-resolution from corneal images. In Proc. British Machine Vision Conference (BMVC), pages 22.1-22.12, 2012.
29. C. Nitschke, A. Nakazawa, and H. Takemura. Display-camera calibration using eye reflections and geometry constraints. Computer Vision and Image Understanding, 115(6):835-853, 2011.
30. C. Nitschke, A. Nakazawa, and H. Takemura. Corneal imaging revisited: An overview of corneal reflection analysis and applications. IPSJ Transactions on Computer Vision and Applications, 5:1-18, 2013.
31. C. B. Owen, J. Zhou, A. Tang, and F. Xiao. Display-relative calibration for optical seethrough head-mounted displays. In Proc. IEEE/ACM International Symposium on Mixed and Augmented Reality (ISMAR), pages 70-78, 2004.
32. H. M. Park, S. H. Lee, and J. S. Choi. Wearable augmented reality system using gaze interaction. In Proc. IEEE/ACM International Symposium on Mixed and Augmented Reality (ISMAR), pages 175-176, 2008.
33. J. P. Rolland, R. L. Holloway, and H. Fuchs. Comparison of optical and video see-through, head-mounted displays. In Proc. Photonics for Industrial Applications (SPIE), pages 293-307, 1995.
34. E. Schneider, T. Villgrattner, J. Vockeroth, K. Bartl, S. Kohlbecher, S. Bardins, H. Ulbrich, and T. Brandt. Eyeseecam: An eye movement- driven head camera for the examination of natural visual exploration. Annals of the New York Academy of Sciences, 1164(1):461-467, 2009.
35. D. Schnieders, X. Fu, and K.-Y. K. Wong. Reconstruction of display and eyes from a single image. In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 1442-1449, 2010.
36. S.-W. Shih, Y.-T. Wu, and J. Liu. A calibration-free gaze tracking technique. In Proc. International Conference on Pattern Recognition (ICPR), pages 201-204, 2000.
37. A. Tsukada and T. Kanade. Automatic acquisition of a 3d eye model for a wearable first-person vision device. In Proc. ACM Symposium on Eye Tracking Research and Applications (ETRA), pages 213-216, 2012.
38. A. Tsukada, M. Shino, M. S. Devyver, and T. Kanade. Illumination-free gaze estimation method for first-person vision wearable device. In Proc. IEEE International Conference on Computer Vision Workshops (ICCVW), pages 2084-2091, 2011.
39. N. Tsumura, M. N. Dang, T. Makino, and Y. Miyake. Estimating the directions to light sources using images of eye for reconstructing 3D human face. In Proc. IS&T/SID Color Imaging Conference (CIC), pages 77-81, 2003.
40. M. Tuceryan, Y. Genc, and N. Navab. Single-point active alignment method (spaam) for optical see-through hmd calibration for augmented reality. Presence, 11(3):259-276, 2002.
41. A. Villanueva and R. Cabeza. A novel gaze estimation system with one calibration point. IEEE Transactions on Systems, Man, and Cybernetics Part B: Cybernetics, 38(4):1123-1138, 2008.
42. K.-Y. K. Wong, D. Schnieders, and S. Li. Recovering light directions and camera poses from a single sphere. In Proc. European Conference on Computer Vision (ECCV), pages 631-642, 2008.
43. H. Wu, Q. Chen, and T. Wada. Visual direction estimation from a monocular image. IEICE Transactions on Information and Systems, E88- D(10):2277-2285, 2005.