Foveated gaze-contingent displays for peripheral LOD management, 3D visualization, and stereo imaging

ACM Transactions on Multimedia Computing, Communications and Applications

Volumn 3, Issue 4, 2007, Pages

  Duchowski, Andrew T ^a,c   Çöltekin, Arzu ^b,d  

^a CLEMSON UNIVERSITY   (United States)

^b AALTO UNIVERSITY   (Finland)

^c AMRL   (United States)

^d UNIVERSITY OF ZURICH   (Switzerland)

Author keywords

Eye tracking; Foveation; Gaze contingent displays; Level of detail

Indexed keywords

GAZE-CONTINGENT DISPLAYS; LEVEL-OF-DETAIL; VISION SCIENCES;

COMPUTER HARDWARE; GRAPHIC METHODS; PIXELS; REAL TIME SYSTEMS; THREE DIMENSIONAL;

STEREO VISION;

EID: 38349100181     PISSN: 15516857     EISSN: 15516865     Source Type: Journal    
DOI: 10.1145/1314303.1314309     Document Type: Article

References (54)

1. BAUDISCH, P., DECARLO, D., DUCHOWSKI, A. T., AND GEISLER, W. S. 2003. Focusing on the essential: Considering attention in display design. Commun. ACM 46, 3.
2. BERGSTRÖM, P. 2003. Eye-Movement controlled image coding. Ph.D. thesis, Linköping University, Linköping, Sweden.
3. BERTERA, J. H. AND RAYNER, K. 2000. Eye movements and the span of the effective stimulus in visual search. Percept. Psychophys. 62, 3, 576-585.
4. BÖHME, M., DORR, M., MARTINETZ, T., AND BARTH, E. 2006. Gaze-Contingent temporal filtering of video. In Proceedings of the Eye Tracking Research Applications (ETRA) Symposium. ACM, San Diego, CA, 109-116.
5. BURT, P. J. AND ADELSON, E. H. 1983. The Laplacian pyramid as a compact image code. IEEE Trans. Commun. 31, 4 (Apr.), 532-540.
6. CAMPBELL, F. AND GREEN, D. 1965. Monocular versus binocular visual acuity. Nature 208, 191-192.
7. CÖLTEKIN, A. 2006. Foveation for 3D visualization and stereo imaging. Ph.D. thesis, Helsinki University of Technology, Helsinki, Finland. ISBN 951-22-8017-5, also .
8. CHANG, E.-C., MALLAT, S., AND YAP, C. 2000. Wavelet foveation. J. Appl. Comput. Harmonic Anal. 9, 3, 312-335.
9. DALY, S., MATTHEWS, K., AND RIBAS-CORBERA, J. 2001. As plain as the noise on your face: Adaptive video compression using face detection and visual eccentricity models. J. Electron. Imag. 10, 1, 30-46.
10. DORR, M., BÖHME, M., MARTINETZ, T., AND BARTH, E. 2005. Visibility of temporal blur on a gaze-contingent display. In Proceedings of the 2nd Symposium on Applied Perception in Graphics and Visualization (APGV). ACM.
11. DRASCIC, D. AND MILGAM, P. 1991. Positioning accuracy of a virtual stereographic pointer in a real stereoscopic video world. In the Conference on Stereoscopic Displays and Applications II, Bellingham, WA. SPIE, vol. 1457, 58-69.
12. DUCHOWSKI, A. T. 1998. 3D wavelet analysis of eye movements. In Proceedings of the Wavelet Applications IV Conference, Bellingham, WA. SPIE, vol. 3391.
13. DUCHOWSKI, A. T. 2000. Acuity-Matching resolution degradation through wavelet coefficient scaling. IEEE Trans. Image Process. 9, 8 (Aug.), 1437-1440.
14. DUCHOWSKI, A. T. 2003. Eye Tracking Methodology: Theory and Practice. Springer, London.
15. DUCHOWSKI, A. T. 2004. Hardware-Accelerated real-time simulation of arbitrary visual fields. In Proceedings of the Eye Tracking Research and Applications (ETRA) Symposium, San Antonio, TX, 59.
16. DUCHOWSKI, A. T. AND MCCORMICK, B. H. 1995. Pre-Attentive considerations for gaze-contingent image processing. In Proceedings of the Conference on Human Vision, Visual Processing, and Digital Display VI, Bellingham, WA. SPIE, vol. 2411, 128-139.
17. FERWERDA, J. A., PATTANAIK, S. N., SHIRLEY, P., AND GREENBERG, D. P. 1996. A model of visual adaptation for realistic image synthesis. In Proceedings of the ACM SIGGRAPH International Conference on Computer Graphics and Interactive Techniques. ACM, New York, 249-258.
18. FOLEY, J. D., VAN DAM, A., FEINER, S. K., AND HUGHES, J. F. 1990. Computer Graphics: Principles and Practice, 2nd ed. Addison-Wesley, Reading, MA.
19. FOSTER, D. H., GRAVANO, S., AND TOMOSZEK, A. 1989. Acuity for fine-grain motion and for two-dot spacing as a function of retinal eccentricity: Differences in specialization of the central and peripheral retina. Vision Res. 29, 8, 1017-1031.
20. FUNKHOUSER, T. A. AND SEQUIN, C. H. 1993. Adaptive display algorithm for interactive frame rates during visualization of complex virtual environments. In Proceedings of the ACM SIGGRAPH International Conference on Computer Graphics and Interactive Techniques. ACM, New York.
21. GEISLER, W S. AND PERRY, J. S. 1998. Real-Time foveated multiresolution system for low-bandwidth video communication. In Conference on Human Vision and Electronic Imaging, Bellingham, WA.
22. GEISLER, W. S. AND PERRY, J. S. 2002. Real-Time simulation of arbitrary visual fields. In Proceedings of the Eye Tracking Research and Applications (ETRA) Symposium, New Orleans, LA. ACM, 83-153.
23. HAHN, P. J. AND MATHEWS, V. J. 1997. Perceptually lossless image compression. In Proceedings of the Data Compression Industry Workshop, Snowbird, UT.
24. HOLLIMAN, N. 2005. 3D Display Systems. IOP Press. ISBN: 0 7503 0646 7. also 〈http://www.dur.ac.uk/n.s.holliman/Presentations/3dv3-0. pdf〉, last accessed January 2007.
25. LEVOY, M. AND WHITAKER, R. 1990. Gaze-Directed volume rendering. In Proceedings of the ACM SIGGRAPH International Conference on Computer Graphics and Interactive Techniques. ACM, New York, 217-223.
26. LINDE, I. V. D. 2003. Space-Variant perceptual image compression for gaze-contingent stereoscopic displays. Ph.D. thesis, Anglia Polytechnic University, UK.
27. LIPTON, L. 1982. Foundations of the Stereoscopic Cinema, A Study in Depth. Van Nostrand Reinhold. ISBN 0-442-24724-9. also 〈http://www.stereoscopic.org〉.
28. LOSCHKY, L. C. AND MCCONKIE, G. W. 2000. User performance with gaze contingent multiresolutional displays. In Proceedings of the Eye Tracking Research and Applications Symposium. Palm Beach Gardens, FL, 97-103.
29. LOSCHKY, L. C. AND WOLVERTON, G. S. 2007. How late can you update gaze-contingent multiresolutional displays without detection? ACM Trans. Multimedia Comput. Commun. Appl. 3, 4 (Nov.). this issue.
30. LUEBKE, D. AND ERIKSON, C. 1997. View-Dependent simplification of arbitrary polygonal environments. In Proceedings of the ACM SIGGRAPH International Conference on Computer Graphics and Interactive Techniques. ACM, New York.
31. LUEBKE, D., REDDY, M., COHEN, J. D., VARSHNEY, A., WATSON, B., AND HUEBNER, R. 2003. Level of Detail for 3D Graphics. MorganKauffman/Elsevier, San Francisco, CA. ISBN 1-55860-838-9. also 〈http://www.lodbook.com/〉.
32. LUEBKE, D., VARSHNEY, A., COHEN, J., WATSON, B., AND REDDY, M. 2000. Course 41: Advanced issues in level of detail. In Proceedings of the ACM SIGGRAPH International Conference on Interactive Techniques. New York, NY.
33. MCCONKIE, G. W. AND RAYNER, K 1975. The span of the effective stimulus during a fixation in reading. Percept. Psychophys. 17, 578-586.
34. MON-WILLIAMS, M. AND WANN, J. 1998. Binocular virtual reality displays: When problems do and don't occur. Hum. Factors 40, 18-24. also 〈http://www.abdn.ac.uk/~psy359/dept/Papers/ Human Facts.pdf〉.
35. MURPHY, H. AND DUCHOWSKI, A. T. 2001. Gaze-Contingent level of detail. In EuroGraphics Conference, Manchester, UK.
36. NATIONAL EYE INSTITUTE. 2004. Office of Communication and Health Education. Personal communique.
37. NATIONAL INSTITUTES OF HEALTH. 2003. Age-Related macular degneration: What you should know. Rep. 03-2294, National Eye Institute, National Institutes of Health, also 〈http://www.nei.nih.gov/ health/maculardegen/webAMD.pdf〉, last accessed January 2007.
38. NIKOLOV, S. G., NEWMAN, T. D., BULL, D. R., CANAGARAJAH, N. C., JONES, M. G., AND GILCHRIST, I. D. 2004. Gaze-Contingent display using texture mapping and OpenGL: System and applications. In Proceedings of the Eye Tracking Research and Applications (ETRA) Symposium, San Antonio, TX, 11-18.
39. OHSHIMA, T., YAMAMOTO, H., AND TAMURA, H. 1996. Gaze-Directed adaptive rendering for interacting with virtual space. In Proceedings of the Virtual Reality Annual International Symposium (VRAIS). IEEE, 103-110.
40. O'SULLIVAN, C., DLNGLLANA, J., GLANG, T., AND KAISER, M. K. 2003. Evaluating the visual fidelity of physically based animations. ACM Trans. Graphics 22, 3, 527-536.
41. PARKHURST, D., CULURCIELLO, E., AND NIEBUR, E. 2000. Evaluating variable resolution displays with visual search: Task performance and eye movements. In Proceedings of the Eye Tracking Research and Applications Symposium, Palm Beach Gardens, FL, 105-109.
42. PARKHURST, D. J. AND NIEBUR, E. 2002. Variable resolution displays: A theoretical, practical, and behavioral evaluation. Hum. Factors 44, 4, 611-629.
43. PARKHURST, D. J. AND NIEBUR, E. 2004. A feasibility test for perceptually adaptive level of detail rendering on desktop systems. In Proceedings of the Applied Perception, Graphics and Visualization (APGV) Symposium. ACM, New York, 49-56.
44. RAMASUBRAMANIAN, M., PATTANAIK, S. N., AND GREENBERG, D. P. 1999. A perceptually based physical error metric for realistic image synthesis. In Proceedings of the ACM SIGGRAPH International Conference on Computer Graphics and Interactive Techniques. ACM, New York, NY, 73-82.
45. RAYNER, K. 1998. Eye movements in reading and information processing: 20 years of research. Psychol. Bull. 124, 3, 372-422.
46. RAYNER, K. AND BERTERA, J. H. 1979. Reading without a fovea. Sci. 206, 468-469.
47. REDDY, M. 2001. Perceptually optimized 3D graphics. Comput. Graphics Appl. 21, 5, 68-75.
48. REINGOLD, E. M., LOSCHKY, L. C., MCCONKIE, G. W., AND STAMPE, D. M. 2003. Gaze-Contingent multi-resolutional displays: An integrative review. Hum. Factors 45, 2, 307-328.
49. SHREINER, D., WOO, M., NEIDER, J., AND DAVIS, T. 2006. OpenGL Programming Guide: The Official Guide to Learning OpenGL, Version 2, 5th ed. Addison-Wesley.
50. TOBII TECHNOLOGY AB. 2003. Tobii ET-17 eye-tracker product description (v1.1). &langhttp://www.tobii.se/〉 (last accessed January 2007).
51. WARE, C. 2004. Information Visualization-Perception for Design. Morgan-Kauffman, Elsevier, San Francisco, CA.
52. WATSON, B., WALKER, N., AND HODGES, L. F. 2004. Supra-Threshold control of peripheral LOD. In Proceedings of the ACM SIGGRAPH International Conference on Computer Graphics and Interactive Techniques, 750-759.
53. WATSON, B., WALKER, N., HODGES, L. F., AND WORDEN, A. 1997. Managing level of detail through peripheral degradation: Effects on search performance with a head-mounted display. ACM Trans. Comput.-Hum. Interact. 4, 4 (Dec.), 323-346.
54. WILLIAMS, L. 1983. Pyramidal parametrics. Comput. Graphics 17, 3 (Jul.), 1-11.