Gaussian light field: Estimation of viewpoint-dependent blur for optical see-through head-mounted displays

IEEE Transactions on Visualization and Computer Graphics

Volumn 22, Issue 11, 2016, Pages 2368-2376

  Itoh, Yuta ^a   Amano, Toshiyuki ^b   Iwai, Daisuke ^c   Klinker, Gudrun ^a  

^a TECHNICAL UNIVERSITY OF MUNICH   (Germany)

^b WAKAYAMA UNIVERSITY   (Japan)

^c OSAKA UNIVERSITY   (Japan)

Author keywords

calibration; chromatic aberration; light field; optical see through; OST HMD; point spread functions

Indexed keywords

ABERRATIONS; CALIBRATION; CAMERAS; COLOR PHOTOGRAPHY; COMPUTER VISION; FIELD EMISSION DISPLAYS; GAUSSIAN BEAMS; GAUSSIAN DISTRIBUTION; LIGHT; OPTICAL DESIGN; OPTICAL SYSTEMS; OPTICAL TRANSFER FUNCTION; SIGNAL TO NOISE RATIO; X RAY RADIOGRAPHY;

CALIBRATION TECHNIQUES; CHROMATIC ABERRATION; COMPUTATIONAL PHOTOGRAPHY; CORRECTION TECHNIQUES; LIGHT FIELDS; OPTICAL CHARACTERISTICS; OPTICAL SEE-THROUGH; OPTICAL SEE-THROUGH HEAD-MOUNTED DISPLAYS;

HELMET MOUNTED DISPLAYS;

EID: 84990946807     PISSN: 10772626     EISSN: None     Source Type: Journal    
DOI: 10.1109/TVCG.2016.2593779     Document Type: Article

References (39)

1. M. Alonso Jr and A. Barreto. Pre-compensation for high order aberrations of the human eye using on-screen image deconvolution. In Engineering in Medicine and Biology Society. Proceedings of the 25th Annual International Conference of the IEEE, volume 1, pages 556-559. IEEE, 2003.
2. R. Azuma and G. Bishop. Improving static and dynamic registration in an optical see-through HMD. In Proceedings of SIGGRAPH, pages 197-204. ACM, 1994.
3. R. T. Azuma. Predictive tracking for augmented reality. PhD thesis, Citeseer, 1995.
4. A. Bermano, P. Bruschweiler, A. Grundhofer, D. Iwai, B. Bickel, and M.Gross. Augmenting physical avatars using projector-basedillumination. ACM TOG, 32(6):189:1-189:10, Nov. 2013.
5. M. S. Brown, P. Song, and T.-J. Cham. Image pre-conditioning for out-of-focus projector blur. In CVPR 2006, volume 2, pages 1956-1963. IEEE, 2006.
6. D. Cheng, Y. Wang, C. Xu, W. Song, and G. Jin. Design of an ultra-thin near-eye display with geometrical waveguide and freeform optics. Optics express, 22(17):20705-20719, 2014.
7. A. P. Dempster, N. M. Laird, and D. B. Rubin. Maximum likelihood from incomplete data via the em algorithm. Journal of the royal statistical society. Series B (methodological), pages 1-38, 1977.
8. M. Grosse, G. Wetzstein, A. Grundhofer, and O. Bimber. Coded aperture projection. ACM TOG, 29(3):22, 2010.
9. A. Grundhofer and D. Iwai. Robust, error-tolerant photometric projector compensation. Image Processing, IEEE Transactions on, 24(12):5086-5099, Dec 2015.
10. Y. Ha and J. Rolland. Optical assessment of head-mounted displays in visual space. Applied optics, 41(25):5282-5289, 2002.
11. F. Heide, M. Rout, M. B. Hullin, B. Labitzke, W. Heidrich, and A. Kolb. High-quality computational imaging through simple lenses. ACM TOG, 32(5):149, 2013.
12. K. Hong, J. Yeom, C. Jang, J. Hong, and B. Lee. Full-color lens-array holographic optical element for three-dimensional optical see-through augmented reality. Optics letters, 39(1):127-130, 2014.
13. H. Hoshi, N. Taniguchi, H. Morishima, T. Akiyama, S. Yamazaki, and A. Okuyama. Off-axial hmd optical system consisting of aspherical surfaces without rotational summetry. In Electronic Imaging: Science and Technology, pages 234-242. Intl Society for Optics and Photonics, 1996.
14. F. C. Huang, G. Wetzstein, B. A. Barsky, and R. Raskar. Eyeglasses-free display: Towards correcting visual aberrations with computational light field displays. ACM TOG, 33(4):59, 2014.
15. M. Huber, D. Pustka, P. Keitler, F. Echtler, and G. Klinker. A system architecture for ubiquitous tracking environments. In Proceedings of IEEE and ACM ISMAR, pages 1-4. IEEE Computer Society, 2007.
16. Y. Itoh, M. Dzitsiuk, T. Amano, and G. Klinker. Semi-parametric color reproduction method for optical-see through head-mounted displays. IEEE TVCG, 21(11):1269-1278, 2015.
17. Y. Itoh, M. Dzitsiuk, T. Amano, and G. Klinker. Simultaneous Direct and Augmented View Distortion Calibration of Optical See-Through Head-Mounted Displays. In Proceedings of IEEE ISMAR, pages 43-48, 2015.
18. Y. Itoh and G. Klinker. Interaction-free calibration for optical see-through head mounted displays based on 3d eye localization. In IEEE Symposium on 3D User Interfaces (3DUI), pages 75-82, 2014.
19. Y. Itoh and G. Klinker. Light-field correction for spatial calibration of optical see-through head mounted displays. IEEE TVCG (Proceedings Virtual Reality 2015), 21(4):471-480, April 2015.
20. Y. Itoh and G. Klinker. Vision enhancement: defocus correction via optical see-through head-mounted displays. In Proceedings of the 6th Augmented Human International Conference, pages 1-8. ACM, 2015.
21. A. L. Janin, D. W. Mizell, and T. P. Caudell. Calibration of head-mounted displays for augmented reality applications. In Virtual Reality Annual International Symposium, pages 246-255. IEEE, 1993.
22. N. Joshi, R. Szeliski, and D. J. Kriegman. Psf estimation using sharp edge prediction. In CVPR 2008., pages 1-8. IEEE, 2008.
23. D. Lanman, M. Hirsch, Y. Kim, and R. Raskar. Content-adaptive parallax barriers: optimizing dual-layer 3d displays using low-rank light field factorization. ACM TOG, 29(6):163, 2010.
24. S. Lee and H. Hua. Effects of configuration of optical combiner on near-field depth perception in optical see-through head-mounted displays. 22(4):1432-1441, 2016.
25. J. Maiero, E. Kruijff, A. Hinkenjann, and G. Ghinea. Picozoom: A context sensitie multimodal zooming interface. In Multimedia and Expo (ICME), 2015 IEEE International Conference on, pages 1-6, June 2015.
26. H. Mukawa, K. Akutsu, I. Matsumura, S. Nakano, T. Yoshida, M. Kuwahara, K. Aiki, and M. Ogawa. 8.4: distinguished paper: a full color eyewear display using holographic planar waveguides. In SID Symposium Digest of Tech. Papers, volume 39, pages 89-92. Wiley Online Library, 2008.
27. K. Oshima, D. C. Rompapas, K. Moser, E. Swan, S. Ikeda, G. Yamamoto, T. Taketomi, C. Sandor, and H. Kato. Sharpview: Improved legibility of defocussed content on optical see-through head-mounted displays. In Demo under submission for: ACM International Symposium on Mixed and Augmented Reality, 2015.
28. C. B. Owen, J. Zhou, A. Tang, and F. Xiao. Display-relative calibration for optical see-through head-mounted displays. In Proceedings of IEEE ISMAR, pages 70-78, 2004.
29. V. F. Pamplona, M. M. Oliveira, D. G. Aliaga, and R. Raskar. Tailored displays to compensate for visual aberrations. ACM TOG, 31(4):81:1-81:12, July 2012.
30. A. Plopski, Y. Itoh, C. Nitschke, K. Kiyokawa, G. Klinker, and H. Takemura. Corneal-imaging calibration for optical see-through head-mounted displays. IEEE TVCG, 21(4):481-490, 2015.
31. D. Pohl, G. S. Johnson, and T. Bolkart. Improved pre-warping for wide angle, head mounted displays. In Proceedings of the 19th ACM Symposium on Virtual Reality Software and Technology, pages 259-262. ACM, 2013.
32. C. Sandor, M. Fuchs, A. Cassinelli, H. Li, R. Newcombe, G. Yamamoto, and S. Feiner. Breaking the barriers to true augmented reality. arXiv prep rint arXiv: 1512.05471, 2015.
33. H. Takeda, S. Farsiu, and P. Milanfar. Kernel regression for image processing and reconstruction. Image Processing, IEEE Transactions on, 16(2):349-366, 2007.
34. R. Y. Tsai and R. K. Lenz. A new technique for fully autonomous and efficient 3d robotics hand/eye calibration. Robotics and Automation, IEEE Transactions on, 5(3):345-358, 1989.
35. Q. Wang, D. Cheng, Y. Wang, H. Hua, and G. Jin. Design, tolerance, and fabrication of an optical see through head mounted display with free form surface elements. Applied optics, 52(7):C88-C99, 2013.
36. Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli. Image quality assessment: from error visibility to structural similarity. Image Processing, IEEE Transactions on, 13(4):600-612, 2004.
37. J. C. Wyant and K. Creath. Basic wavefront aberration theory for optical metrology. Applied optics and optical engineering, 11(s 29):2, 1992.
38. L. Zhang and S. Nayar. Projection defocus analysis for scene capture and image display. ACM TOG, 25(3):907-915, 2006.
39. F. Zheng, T. Whitted, A. Lastra, P. Lincoln, A. State, A. Maimone, and H. Fuchs. Minimizing latency for augmented reality displays: Frames considered harmful. In Proceedings of IEEE ISMAR, pages 195-200. IEEE, 2014.