Optimal presentation of imagery with focus cues on multi-plane displays

ACM Transactions on Graphics

Volumn 34, Issue 4, 2015, Pages

  Narain, Rahul ^a   Albert, Rachel A ^b   Bulbul, Abdullah ^b   Ward, Gregory J ^c   Banks, Martin S ^b   O'Brien, James F ^b  

^a UNIVERSITY OF MINNESOTA   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c DOLBY LABORATORIES   (United States)

Author keywords

Computational displays; Eye accommodation; Multi plane displays; Retinal blur; Vergence accommodation conflict

Indexed keywords

COMPUTATIONAL GEOMETRY; OPHTHALMOLOGY;

DISCRETE SETS; EXPLICIT KNOWLEDGE; EYE ACCOMMODATION; MULTI PLANES; OPTICAL DISTANCE; OPTIMIZATION ALGORITHMS; RETINAL BLUR; VERGENCES;

INTERACTIVE COMPUTER GRAPHICS;

EID: 84943801262     PISSN: 07300301     EISSN: 15577368     Source Type: Journal    
DOI: 10.1145/2766909     Document Type: Conference Paper

References (65)

1. AKELEY, K.,WATT, S. J., GIRSHICK, A. R., AND BANKS, M. S. 2004. A stereo display prototype with multiple focal distances. ACM Trans. Graph. 23, 3 (Aug.), 804-813.
2. ANDERSEN, A., AND KAK, A. 1984. Simultaneous algebraic reconstruction technique (SART): A superior implementation of the ART algorithm. Ultrasonic Imaging 6, 1, 81-94.
3. BANKS, M. S., BULBUL, A., ALBERT, R. A., NARAIN, R., O'BRIEN, J. F., AND WARD, G. 2014. The perception of surface material from disparity and focus cues. In Proc. Vision Sciences Society 14th Annual Meeting.
4. BUCKLEY, D., AND FRISBY, J. P. 1993. Interaction of stereo, texture and outline cues in the shape perception of three-dimensional ridges. Vision Research 33, 7, 919-933.
5. CAMPBELL, F. 1957. The depth of field of the human eye. Optica Acta: International Journal of Optics 4, 4, 157-164.
6. CHAMBOLLE, A., AND POCK, T. 2011. A first-order primaldual algorithm for convex problems with applications to imaging. Journal of Mathematical Imaging and Vision 40, 1, 120-145.
7. COELHO, J. M. P., BAIÃO, A., AND VIEIRA, P. 2013. Development of an optical simulator of the human eye. Proc. SPIE 8785, 8785CS-8785CS-8.
8. COSSAIRT, O. S., NAPOLI, J., HILL, S. L., DORVAL, R. K., AND FAVALORA, G. E. 2007. Occlusion-capable multiview volumetric three-dimensional display. Appl. Opt. 46, 8 (Mar), 1244-1250.
9. DU, S.-P., MASIA, B., HU, S.-M., AND GUTIERREZ, D. 2013. A metric of visual comfort for stereoscopic motion. ACM Trans. Graph. 32, 6 (Nov.), 222:1-222:9.
10. EMOTO, M., NIIDA, T., AND OKANO, F. 2005. Repeated vergence adaptation causes the decline of visual functions in watching stereoscopic television. Display Technology, Journal of 1, 2, 328-340.
11. ESSER, E., ZHANG, X., AND CHAN, T. 2010. A general framework for a class of first order primal-dual algorithms for convex optimization in imaging science. SIAM Journal on Imaging Sciences 3, 4, 1015-1046.
12. FAVALORA, G. E., NAPOLI, J., HALL, D. M., DORVAL, R. K., GIOVINCO, M., RICHMOND, M. J., AND CHUN, W. S. 2002. 100-million-voxel volumetric display. In Proc. SPIE, vol. 4712, 300-312.
13. GRANGER, E., AND CUPERY, K. 1972. Optical merit function (SQF), which correlates with subjective image judgments. Photographic Science and Engineering 16, 3.
14. HE, B., AND YUAN, X. 2012. Convergence analysis of primaldual algorithms for a saddle-point problem: From contraction perspective. SIAM Journal on Imaging Sciences 5, 1, 119-149.
15. HELD, R. T., COOPER, E. A., O'BRIEN, J. F., AND BANKS, M. S. 2010. Using blur to affect perceived distance and size. ACM Transactions on Graphics 29, 2 (Mar.), 19:1-16.
16. HIRSCH, M., AND LANMAN, D., 2010. Build your own 3D display. ACM SIGGRAPH ASIA Course Notes.
17. HOFFMAN, D. M., GIRSHICK, A. R., AKELEY, K., AND BANKS, M. S. 2008. Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. Journal of Vision 8, 3.
18. HU, X., AND HUA, H. 2013. An optical see-through multi-focalplane stereoscopic display prototype enabling nearly correct focus cues. vol. 8648, 86481A.
19. HU, X., AND HUA, H. 2014. Design and assessment of a depthfused multi-focal-plane display prototype. J. Display Technol. 10, 4 (Apr), 308-316.
20. HU, X., AND HUA, H. 2014. High-resolution optical see-through multi-focal-plane head-mounted display using freeform optics. Opt. Express 22, 11 (Jun), 13896-13903.
21. HUANG, F.-C., LANMAN, D., BARSKY, B. A., AND RASKAR, R. 2012. Correcting for optical aberrations using multilayer displays. ACM Transaction on Graphics 31 (Nov.).
22. HUANG, F.-C., WETZSTEIN, G., BARSKY, B. A., AND RASKAR, R. 2014. Eyeglasses-free display: Towards correcting visual aberrations with computational light field displays. ACM Trans. Graph. 33, 4 (July), 59:1-59:12.
23. IVES, F., 1903. Parallax stereogram and process of making same., Apr. 14. US Patent 725,567.
24. JAKOB, W., 2010. Mitsuba renderer. http://www.mitsubarenderer.org.
25. JONES, A., MCDOWALL, I., YAMADA, H., BOLAS, M., AND DEBEVEC, P. 2007. Rendering for an interactive 360° light field display. ACM Trans. Graph. 26, 3 (July).
26. LAMBOOIJ, M., FORTUIN, M., HEYNDERICKX, I., AND IJSSELSTEIJN, W. 2009. Visual discomfort and visual fatigue of stereoscopic displays: A review. Journal of Imaging Science and Technology 53, 3, 30201-1-30201-14.
27. LANG, M., HORNUNG, A., WANG, O., POULAKOS, S., SMOLIC, A., AND GROSS, M. 2010. Nonlinear disparity mapping for stereoscopic 3D. ACM Trans. Graph. 29, 4 (July), 75:1-75:10.
28. LANMAN, D., AND LUEBKE, D. 2013. Near-eye light field displays. ACM Trans. Graph. 32, 6 (Nov.), 220:1-220:10.
29. LANMAN, D., HIRSCH, M., KIM, Y., AND RASKAR, R. 2010. Content-adaptive parallax barriers: Optimizing dual-layer 3D displays using low-rank light field factorization. ACM Trans. Graph. 29, 6 (Dec.), 163:1-163:10.
30. LANMAN, D., WETZSTEIN, G., HIRSCH, M., HEIDRICH, W., AND RASKAR, R. 2011. Polarization fields: Dynamic light field display using multi-layer LCDs. ACM Trans. Graph. 30, 6.
31. LEVOY, M., NG, R., ADAMS, A., FOOTER, M., AND HOROWITZ, M. 2006. Light field microscopy. ACM Trans. Graph. 25, 3 (July), 924-934.
32. LIPPMANN, G. 1908. Épreuves réversibles donnant la sensation du relief. J. Phys. Theor. Appl. 7, 1, 821-825.
33. LIU, S., AND HUA, H. 2010. A systematic method for designing depth-fused multi-focal plane three-dimensional displays. Opt. Express 18, 11 (May), 11562-11573.
34. LIU, S., HUA, H., AND CHENG, D. 2010. A novel prototype for an optical see-through head-mounted display with addressable focus cues. IEEE Transactions on Visualization and Computer Graphics 16, 3, 381-393.
35. LOVE, G. D., HOFFMAN, D. M., HANDS, P. J., GAO, J., KIRBY, A. K., AND BANKS, M. S. 2009. High-speed switchable lens enables the development of a volumetric stereoscopic display. Opt. Express 17, 18 (Aug), 15716-15725.
36. MACKENZIE, K. J., HOFFMAN, D. M., AND WATT, S. J. 2010. Accommodation to multiple-focal-plane displays: Implications for improving stereoscopic displays and for accommodation control. Journal of Vision 10, 8.
37. MACKENZIE, K., DICKSON, R., AND WATT, S. 2012. Vergence and accommodation to multiple-image-plane stereoscopic displays: "real world" responses with practical image-plane separations? Journal of Electronic Imaging 21, 1.
38. MAIMONE, A., WETZSTEIN, G., LANMAN, D., HIRSCH, M., RASKAR, R., AND FUCHS, H. 2013. Focus 3D: Compressive accommodation display. ACM Trans. Graph. 32, 5, 1-13.
39. MANTIUK, R., KIM, K. J., REMPEL, A. G., AND HEIDRICH, W. 2011. HDR-VDP-2: A calibrated visual metric for visibility and quality predictions in all luminance conditions. ACM Trans. Graph. 30, 4 (July), 40:1-40:14.
40. MARSHALL, J. A., BURBECK, C. A., ARIELY, D., ROLLAND, J. P., AND MARTIN, K. E. 1996. Occlusion edge blur: a cue to relative visual depth. Journal of the Optical Society of America. A, Optics, image science, and vision 13, 4 (Apr.), 681-8.
41. MASIA, B., WETZSTEIN, G., DIDYK, P., AND GUTIERREZ, D. 2013. A survey on computational displays: Pushing the boundaries of optics, computation, and perception. Computers and Graphics 37, 8, 1012-1038.
42. MATHER, G., AND SMITH, D. R. R. 2002. Blur discrimination and its relation to blur-mediated depth perception. Perception 31, 10, 1211-1219.
43. MATHEWS, S., AND KRUGER, P. 1994. Spatiotemporal transfer function of human accommodation. Vision Research 34, 15.
44. MATUSIK, W., AND PFISTER, H. 2004. 3D TV: A scalable system for real-time acquisition, transmission, and autostereoscopic display of dynamic scenes. ACM Trans. Graph. 23, 3 (Aug.), 814-824.
45. MENDIBURU, B. 2009. 3D movie making: Stereoscopic digital cinema from script to screen. Focal Press, Elsevier.
46. NAVARRO, R. 2009. The optical design of the human eye: a critical review. Journal of Optometry 2, 1, 3-18.
47. OWENS, D. 1980. A comparison of accommodative responsiveness and contrast sensitivity for sinusoidal gratings. Vision Research 20, 2, 159-167.
48. PALMER, S. E., AND BROOKS, J. L. 2008. Edge-region grouping in figure-ground organization and depth perception. Journal of Experimental Psychology: Human Perception and Performance 34, 6 (Dec), 1353-1371.
49. PAMPLONA, V. F., OLIVEIRA, M. M., ALIAGA, D. G., AND RASKAR, R. 2012. Tailored displays to compensate for visual aberrations. ACM Trans. Graph. 31, 4 (July), 81:1-81:12.
50. PERLIN, K., PAXIA, S., AND KOLLIN, J. S. 2000. An autostereoscopic display. In Proc. 27th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH '00, 319-326.
51. RAVIKUMAR, S., AKELEY, K., AND BANKS, M. S. 2011. Creating effective focus cues in multi-plane 3D displays. Opt. Express 19, 21 (Oct), 20940-20952.
52. RYAN, L., MACKENZIE, K., AND WATT, S. 2012. Multiplefocal-planes 3D displays: A practical solution to the vergenceaccommodation conflict? In 3D Imaging (IC3D), 2012 International Conference on, 1-6.
53. SHIBATA, T., KIM, J., HOFFMAN, D. M., AND BANKS, M. S. 2011. The zone of comfort: Predicting visual discomfort with stereo displays. Journal of Vision 11, 8.
54. SPRING, K., AND STILES, W. S. 1948. Variation of pupil size with change in the angle at which the light stimulus strikes the retina. British J. Ophthalmol. 32, 6, 340-346.
55. SULLIVAN, A. 2004. DepthCube solid-state 3D volumetric display. In Proc. SPIE, vol. 5291, 279-284.
56. TAKAKI, Y., TANAKA, K., AND NAKAMURA, J. 2011. Super multi-view display with a lower resolution flat-panel display. Opt. Express 19, 5 (Feb), 4129-4139.
57. TAKAKI, Y. 2006. High-density directional display for generating natural three-dimensional images. Proc. IEEE 94, 3, 654-663.
58. VAN EE, R., BANKS, M. S., AND T., B. B. 1999. An analysis of binocular slant contrast. Perception 28, 9, 1121-1145.
59. WATT, S. J., AKELEY, K., ERNST, M. O., AND BANKS, M. S. 2005. Focus cues affect perceived depth. Journal of Vision 5, 10.
60. WETZSTEIN, G., LANMAN, D., HEIDRICH, W., AND RASKAR, R. 2011. Layered 3D: Tomographic image synthesis for attenuationbased light field and high dynamic range displays. ACM Trans. Graph. 30, 4.
61. WETZSTEIN, G., LANMAN, D., GUTIERREZ, D., AND HIRSCH, M., 2012. Computational displays: Combining optical fabrication, computational processing, and perceptual tricks to build the displays of the future. ACM SIGGRAPH Course Notes.
62. WETZSTEIN, G., LANMAN, D., HIRSCH, M., AND RASKAR, R. 2012. Tensor displays: Compressive light field synthesis using multilayer displays with directional backlighting. ACM Trans. Graph. (Proc. SIGGRAPH) 31, 4, 1-11.
63. ZANNOLI, M., ALBERT, R. A., BULBUL, A., NARAIN, R., O'BRIEN, J. F., AND BANKS, M. S. 2014. Correct blur and accommodation information is a reliable cue to depth ordering. In Proc. Vision Sciences Society 14th Annual Meeting.
64. ZHU, M., AND CHAN, T. 2008. An efficient primal-dual hybrid gradient algorithm for total variation image restoration. Tech. rep., University of California, Los Angeles.
65. ZWICKER, M., MATUSIK, W., DURAND, F., PFISTER, H., AND FORLINES, C. 2006. Antialiasing for automultiscopic 3D displays. In ACM SIGGRAPH 2006 Sketches, SIGGRAPH '06.