Spatiotemporal sensitivity and visual attention for efficient rendering of dynamic environments

ACM Transactions on Graphics

Volumn 20, Issue 1, 2001, Pages 39-65

  Yee, Hector ^a   Pattanaik, Sumanta ^b   Greenberg, Donald P ^c  

^a Westwood Studios   (United States)

^b UNIVERSITY OF CENTRAL FLORIDA   (United States)

^c NONE

Author keywords

Computer graphics : three dimensional graphics and realism; Algorithms; Animation; Computer vision; Human visual perception; I.3.3 computer graphics : picture image generation I.3.7; Illumination; Monte carlo techniques

Indexed keywords

EID: 0003128607     PISSN: 07300301     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/383745.383748     Document Type: Article

References (37)

1. AGRAWALA, M., BEERS, A. C., AND CHADDHA, N. 1995. Model-based motion estimation for synthetic animations. In Proceedings of the 3rd ACM International Conference on Multimedia '95. ACM, New York, pp. 477-488.
2. BOLIN, M. R. AND MEYER, G. W. 1995. A frequency based ray tracer. In SIGGRAPH 95 Conference Proceedings (Los Angeles, Calif., Aug.). ACM, New York, pp. 409-418.
3. BOLIN, M. R. AND MEYER, G. W. 1998. A perceptually based adaptive sampling algorithm. In SIGGRAPH 98 Conference Proceedings (Orlando, Fla., July). ACM, New York, pp. 299-309.
4. BURT, P. J. AND ADELSON, E. H. 1983. The Laplacian pyramid as a compact image code. In IEEE Trans. Commun. Com-31, 4 (Apr.), pp. 532-540.
5. CAMPBELL, F. W. AND ROBSON, J. G. 1968. Application of Fourier analysis to the visibility of gratings. In J. Phys. (London) 197, pp. 551-566.
6. DALY, S. 1993. The visible differences predictor: An algorithm for the assessment of image fidelity. In Digital Images and Human Vision, A. B. Watson, Ed, MIT Press, Cambridge, Mass., pp. 179-206.
7. DALY, S. 1998. Engineering observations from spatiovelocity and spatiotemporal visual Models. In IS&T/SPIE Conference on Human Vision and Electronic Imaging III. SPIE, Vol. 3299, (Jan.), pp. 180-191.
8. DALY, S., MATTHEWS, K., AND RIBAS-CORBERA, J. 1999. Visual eccentricity models in face-based video compression. In IS&T/SPIE Conference on Human Vision and Electronic Imaging IV. SPIE, Vol. 3644, (Jan.), pp. 152-166.
9. FERWERDA, J. A., PATTANAIK, S., SHIRLEY, P., AND GREENBERG, D. P. 1997. A model of visual masking for computer graphics. In Proceedings of the SIGGRAPH 1997 Conference. ACM, New York, pp. 143-152.
10. GIBSON, S. AND HUBBOLD, R. 1997. Perceptually-driven radiosity. Compute. Graph. Forum 16, 2 (June), pp. 192-140.
11. GREENSPAN, H., BELONGIE, S., GOODMAN, R., PERONA, P., RAKSHIT, S., ANDERSON, C. H. 1994. Overcomplete steerable pyramid filters and rotation invariance. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (Seattle, Wash. June). IEEE Computer Society Press, Los Alamitos, Calif., pp. 222-228.
12. HORVITZ, E. AND LENGYEL, J. 1997. Perception, attention, and resources: A decision-theoretic approach to graphics rendering. In Proceedings of the 13th Conference on Uncertainty in Artificial Intelligence (Providence, R.I., Aug.), Don Gelger and Prakash Stenoy, Eds, Morgan Kaufmann Publishers, Inc., San Francisco, Calif., pp. 238-249.
13. ITTI, L. AND KOCH, C. 1999a. A comparison of feature combination strategies for saliency-based visual attention systems. In IS&T/SPIE Conference on Human Vision and Electronic Imaging IV. SPIE, Vol. 3644, (Jan.), pp. 373-382.
14. ITTI, L. AND KOCH, C. 1999b. Learning to detect salient objects in natural scenes using visual attention. In Image Understanding Workshop. (In press. A preprint version of this article is available from http://www.klab.caltech.edul/∼itti/attention).
15. ITTI, L. AND KOCH, C. 2000. A saliency-based search mechanism for overt and covert shifts of visual attention. Vision Res. 40, 10-12, pp. 1489-1506.
16. ITTI, L., KOCH, C., AND NIEBUR, E. 1998. A model of saliency-based visual attention for rapid scene analysis. IEEE Trans. Pattern Anal. Machi. Intell. (PAMI) 20, 11, pp. 1254-1259.
17. KELLY, D. H. 1979. Motion and vision II. Stabilized Spatio-temporal Threshold Surface. Opti. Soci. Ameri. 69, 10 (Oct.), pp. 1340-1349.
18. KOCH, C. AND ULLMAN, S. 1985. Shifts in selective visual attention: Towards the underlying neural circuitry. Human Neurobiology 4, pp. 219-227.
19. LEVENTHAL, A. G. 1991. The neural basis of visual function. In Vision and Visual Dysfunction, vol. 4. CRC Press, Boca Raton, Fla.
20. LUBIN, J. 1995. A visual discrimination model for imaging system design and evaluation. In Vision Models for Target Detection and Recognition, E. Peli, Ed. World Scientific, New Jersey, pp. 245-283.
21. McMILLAN, L. 1997. An image-based approach to 3D computer graphics. Ph.D. dissertation. University of North Carolina, Chapel Hill, N.C.
22. MEYER, G. W. AND LIU, A. 1992 Color spatial acuity control of a screen subdivision image synthesis algorithm. In Human Vision, Visual Processing and Digital Display III, B. E. Rogowitz, Ed. SPIE, vol. 1666, pp. 387-399.
23. MYSZKOWSKI, K. 1998. The visible differences predictor: Applications to global illumination problems. In Proceedings of the 9th Eurographics Workshop on Rendering (Vienna, Austria, June). Springer-Verlag, New York, pp. 223-236.
24. MYSZKOWSKI, K., ROKITA, P., AND TAWARA, T. 1999. Perceptually-informed accelerated rendering of high quality walkthrough sequences. In Proceedings of the 10th Eurographics Workshop on Rendering (Grenada, Spain. June). Springer-Verlag, New York, pp. 5-18.
25. NIEBUR, E. AND KOCH, C. 1998. Computational architectures for attention. In The Attentive Brain, R. Parasuraman, Ed. MIT Press, Cambridge, Mass., pp. 164-186.
26. RAMASUBRAMANIAN, M., PATTANAIK, S. N., AND GREENBERG, D. P. 1999. A perceptually based physical error metric for realistic image synthesis. In SIGGRAPH 99 Proceedings (Los Angeles, Calif.). ACM, New York, pp. 73-82.
27. TEKALP, A. M. 1995. Digital Video Processing. Prentice-Hall, Englewood Cliffs, N.J.
28. TSOTSOS, J. K., CULHANE, S. M., WAI, W. Y. K., LAI, Y., DAVIS, N., AND NUFLO, F. 1995. Modeling visual attention via selective tuning. In Artifi. Intell. 78, pp. 507-545.
29. WALLACH, D., KUNAPALLI, S., AND COHEN, M. 1994. Accelerated MPEG compression of polygonal dynamic scenes. In SIGGRAPH 1994 Proceedings. ACM, New York, pp. 193-196.
30. WANDELL, B. 1995. Foundations of Vision. Sinauer Associates, Inc., Sunderland, MA.
31. WARD, G. 1988. A ray tracing solution for diffuse interreflection. In SIGGRAPH 1988 Proceedings. ACM, New York, pp. 85-92.
32. WARD, G. AND HECKBERT, P. S. 1992. Irradiance gradients. In Proceedings of the 3rd Annual Eurographics Workshop on Rendering. Springer-Verlag, New York, pp. 85-98.
33. WARD-LARSON, G. AND SHAKESPEARE, R. 1998. Rendering with Radiance. Morgan-Kaufmann. San Francisco, Calif.
34. WARD-LARSON, G., RUSHMEIER, H., AND PIATKO, C. 1997. A visibility matching tone reproduction operator for high dynamic range scenes. IEE Trans. Vis. Comput. Graph. 3, 4, (Oct.), pp. 291-306.
35. YANTIS, S. 1996. Attentional capture in vision. In Converging Operations in the Study of Selective Visual Attention, A. Kramer, M. Coles, and G. Logan, Eds, American Psychological Association, Washington, D.C., pp. 45-76.
36. YARBUS, A. L. 1967. Eye Movements and Vision. Plenum Press, New York.
37. ZABIH, R. AND WOODFILL, J. 1994. Non-parametric local transforms for computing visual correspondence. In Proceedings of the 3rd European Conference on Computer Vision (Stockholm, Sweden, May), Vol. 2, Springer-Verlag, New York, pp. 151-158.