Automated Spatial Calibration of HMD Systems with Unconstrained Eye-cameras

Proceedings of the 2016 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2016

Volumn , Issue , 2016, Pages 94-99

  Plopski, Alexander ^a   Orlosky, Jason ^b   Itoh, Yuta ^c   Nitschke, Christian ^d   Kiyokawa, Kiyoshi ^b   Klinker, Gudrun ^e  

^a NARA INSTITUTE OF SCIENCE AND TECHNOLOGY   (Japan)

^b OSAKA UNIVERSITY   (Japan)

^c KEIO UNIVERSITY   (Japan)

^d KYOTO UNIVERSITY   (Japan)

^e TECHNICAL UNIVERSITY OF MUNICH   (Germany)

Author keywords

Eye pose estimation; OST HMD calibration

Indexed keywords

AUGMENTED REALITY; AUTOMATION; CALIBRATION; CAMERAS;

ACCURATE MODELING; AUTOMATED METHODS; AUTOMATIC CALIBRATION; HMD CALIBRATIONS; OPTICAL SEE-THROUGH HEAD-MOUNTED DISPLAYS; POSE ESTIMATION; SPATIAL CALIBRATION; VIRTUAL INFORMATION;

HELMET MOUNTED DISPLAYS;

EID: 85010399619     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ISMAR.2016.16     Document Type: Conference Paper

References (22)

1. A. Agrawal. Extrinsic Camera Calibration Without a Direct View Using Spherical Mirror. In Proceedings IEEE International Conference on Computer Vision (ICCV), pages 2368-2375, 2013.
2. A. Agrawal and S. Ramalingam. Single Image Calibration of Multi-Axial Imaging Systems. In Proceedings IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 1399-1406, 2013.
3. R. T. Azuma. Predictive Tracking for Augmented Reality. PhD thesis, University of North Carolina, 1995.
4. P. Bérard, D. Bradley, M. Nitti, T. Beeler, and M. H. Gross. Highquality capture of eyes. ACM Transactions on Graphics (TOG), 33(6):223-1, 2014.
5. Y. Genc, F. Sauer, F. Wenzel, M. Tuceryan, and N. Navab. Optical See-Through HMD Calibration: A Stereo Method Validated with a Video See-Through System. In Proceedings IEEE/ACM International Symposium on Augmented Reality (ISAR), pages 165-174, 2000.
6. Y. Genc, M. Tuceryan, and N. Navab. Practical solutions for calibration of optical see-through devices. In Proceedings IEEE/ACM International Symposium on Mixed and Augmented Reality (ISMAR), pages 169-175, 2002.
7. E. D. Guestrin and M. Eizenman. General Theory of Remote Gaze Estimation Using the Pupil Center and Corneal Reflections. IEEE Transactions on Biomedical Engineering (TBME), 53(6):1124-1133, 2006.
8. D. W. Hansen and Q. Ji. In the Eye of the Beholder: A Survey of Models for Eyes and Gaze. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 32(3):478-500, 2010.
9. B. K. P. Horn. Closed-form solution of absolute orientation using unit quaternions. Journal of the Optical Society of America. A, 4(4):629-642, apr 1987.
10. Y. Itoh and G. Klinker. Interaction-Free Calibration for Optical See-Through Head-Mounted Displays based on 3D Eye Localization. In Proceedings IEEE Symposium on 3D User Interfaces (3DUI), pages 75-82, 2014.
11. Y. Itoh and G. Klinker. Simultaneous Direct and Augmented View Distortion Calibration of Optical See-Through Head-Mounted Displays. In Proceedings IEEE International Symposium on Mixed and Augmented Reality (ISMAR), 2015.
12. M. Jenkinson. Measuring transformation error by rms deviation. Studholme, C., Hill, DLG, Hawkes, DJ, 1999.
13. M. Klemm, H. Hoppe, and F. Seebacher. Non-Parametric Camera-Based Calibration of Optical See-Through Glasses for Augmented Reality Applications. In Proceedings IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pages 273-274, 2014.
14. A. Nakazawa, C. Nitschke, and T. Nishida. Non-calibrated and realtime human view estimation using a mobile corneal imaging camera. In Proceedings International Conference on Multimedia Expo Workshops (ICMEW), pages 1-6, 2015.
15. C. Nitschke. Image-based Eye Pose and Reflection Analysis for Advanced Interaction Techniques and Scene Understanding. PhD thesis, Graduate School of Information Science and Technology, Osaka University, Japan, January 2011.
16. C. Nitschke, A. Nakazawa, and H. Takemura. Display-camera calibration using eye reflections and geometry constraints. Computer Vision and Image Understanding (CVIU), 115(6):835-853, June 2011.
17. C. B. Owen, J. Zhou, A. Tang, and F. Xiao. Display-Relative Calibration for Optical See-Through Head-Mounted Displays. In Proceedings IEEE/ACM International Symposium on Mixed and Augmented Reality (ISMAR), pages 70-78, 2004.
18. A. Plopski, Y. Itoh, C. Nitschke, K. Kiyokawa, G. Klinker, and H. Takemura. Corneal-imaging calibration for optical see-through head-mounted displays. IEEE Transactions on Visualization and Computer Graphics (TVCG), 21(4):481-490, April 2015.
19. A. Plopski, C. Nitschke, K. Kiyokawa, D. Schmalstieg, and H. Takemura. Hybrid eye-pose estimation through corneal imaging. In Proceedings International Conference on Artificial Reality and Telexistence and Eurographics Symposium on Virtual Environments (ICAT-EGVE), pages 183-190, 2015.
20. P. Sturm, S. Ramalingam, J.-P. Tardif, S. Gasparini, and J. Barreto. Camera models and fundamental concepts used in geometric computer vision. Found. Trends. Comput. Graph. Vis., 6:1-183, 2011.
21. M. Tuceryan and N. Navab. Single point active alignment method (SPAAM) for optical see-through HMD calibration for AR. In Proceedings IEEE/ACM International Symposium on Augmented Reality (ISAR), pages 149-158, 2000.
22. K.-Y. K. Wong, D. Schnieders, and S. Li. Recovering light directions and camera poses from a single sphere. In Proceedings European Conference on Computer Vision: Part I, ECCV '08, pages 631-642, Berlin, Heidelberg, 2008. Springer-Verlag.