A gaze-based study for investigating the perception of visual realism in simulated scenes

ACM Transactions on Applied Perception

Volumn 5, Issue 1, 2008, Pages

  Elhelw, Mohamed ^a   Nicolaou, Marios ^a   Chung, Adrian ^a   Yang, Guang Zhong ^a   Atkins, M Stella ^b  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

^b SIMON FRASER UNIVERSITY   (Canada)

Author keywords

Eye tracking; Human computer interaction; Photorealistic rendering; Simulation environment; Visual perception; Visual realism

Indexed keywords

3D SURFACES; COMPLEX IMAGES; EYE TRACKING; HUMAN-COMPUTER INTERACTION; IMAGE ATTRIBUTES; IMAGE FEATURES; LIGHT TRANSFER; PHOTOREALISM; PHOTOREALISTIC RENDERING; SACCADIC EYE MOVEMENTS; SIMULATION ENVIRONMENT; STATIC IMAGING; VISUAL BEHAVIOR; VISUAL CUES; VISUAL EXPERIENCE; VISUAL PERCEPTION; VISUAL QUALITIES; VISUAL REALISM;

CHLORINE COMPOUNDS; COMPUTATIONAL GEOMETRY; COMPUTER GRAPHICS; EYE MOVEMENTS; IMAGE ENHANCEMENT; TARGET TRACKING;

THREE DIMENSIONAL;

EID: 49449097083     PISSN: 15443558     EISSN: 15443965     Source Type: Journal    
DOI: 10.1145/1279640.1279643     Document Type: Article

References (87)

1. ALDRIDGE, R. 1995. Recency effect in the subjective evaluation of digitally-coded television pictures. In Fifth IEEE International Image Processing Conference, Edinburgh, 1995. IEEE Press, Los Alamitos. CA. 336-339.
2. ATKINS, M. S., MOISE, A., AND ROHLING, R. 2005. An application of eyegaze tracking for designing radiologists' workstations: Insights for comparative visual search tasks. Trans. Appl. Percept. 3, 2, 136-151. ACM Press, New York, NY.
3. BERTIN, J. 1983. The Semiology of Graphics. University of Wisconsin Press, WA.
4. BERTRAND, M. AND MULLAINATHAN, S. 2000. Do People Mean What They Say? Implications for Subjective Survey Data. Mimeo, University of Chicago, http://post.economics.harvard.edu/faculty/ mullainathan/papers /peoplemeansay.pdf. Last accessed 02/08/2006.
5. BLINN, J. F. 1978. Simulation of wrinkled surfaces. In Proceedings of the 5th Annual Conference on Computer Graphics and Interactive Techniques. ACM Press, New York. 286-292.
6. BOLIN, M. R. AND MEYER, G. W. 1995. A frequency based ray tracer. In Proceedings of the 22nd Annual Conference on Computer Graphics and Interactive Techniques. ACM Press, New York. 409-418.
7. BOLIN, M. R. AND MEYER, G. W. 1999. Visual difference metric for realistic image synthesis. In SPIE Human Vision and Electronic Imaging IV, B. E. ROGOWITZ and T. N. Pappas, Eds. SPIE, 106-120.
8. BRUCE, V., GREEN, P. R., AND GEORGESON, M. A. 1996. Visual Perception: Physiology, Psychology, and Ecology. Psychology Press, New York.
9. CATER, K., CHALMERS, A., AND WARD, G. 2003. Detail to attention: Exploiting visual tasks for selective rendering. In Proceedings of the 14th Eurographics Workshop on Rendering, Eurographics Association, Leuven, Belgium. 270-280.
10. CATMULL, E. 1974. A Subdivision Algorithm for Computer Display of Curved Surfaces. PhD Thesis, University of Utah, Salt Lake City, UT.
11. CHUT, K. AND SHIRLEY, P. 1994. Rendering, complexity, and perception. In Photorealistic Rendering Techniques. Eurographics, G. Sakas, P. Shirley, and S. Muller, Eds. Springer-Verlag, New York, 21-36.
12. CHUNG, A. J., DELIGIANNI, F., SHAH, P., WELLS, A., AND YANG, G.-Z. 2004. Enhancement of visual realism with BRDF for patient specific bronchoscopy simulation. Lecture Notes in Computer Science (MICCAI). Springer-Verlag, New York.
13. COOK, R. L. AND TORRANCE, K. E. 1982. A reflectance model for computer graphics. ACM Trans. Graph. 1, 1, 7-24.
14. CORNELL. 2006. Cornell University Program of Computer Graphics-Research Framework for Realistic Image Synthesis. http://www.graphics. cornell.edu/research/globillum/index.html#framework. Last accessed 02/08/2006.
15. DALY, S. 1993. The visible differences predictor: An algorithm for the assessment of image fidelity. In Digital Images and Human Vision, A. B. Watson, Ed. MIT Press, Cambridge, MA. 179-206.
16. DANA, K. J., GINNEKEN, B. V., NAYAR, S. K., AND KOENDERINK, J. J. 1999. Reflectance and texture of real-world surfaces. ACM Trans. Graph. 18, 1, 1-34.
17. DEMPEHE-MARCO, L. 2004. Analysis of visual search for knowledge gathering. PhD Thesis, University of London, London, UK.
18. DEMPERE-MARCO, L., HU, X. P., MACDONALD, S. L. S., ELLIS, S. M., HANSELL, D. M., AND YANG, G. Z. 2002. The use of visual search for knowledge gathering in image decision support. IEEE Transactions on Medical Imaging 21, 7, 741-754.
19. DUCHOWSKI, A. T. 2002. A breadth-first survey of eye-tracking applications. Befiavior Research Methods Instruments & Computers 34, 4, 455-470.
20. DUMONT, O., MASSELUS, V., ZAENEN, P., WAGEMANS, J., AND DUTRÉ, P. 2005. A perceptual quality scale for image-based relighting of glossy surfaces. Department of Computer Science-TR 417, Katholieke Universiteit Leuven, Leuven.
21. EBERT, D. S., MUSGRAVE, F. K., PEACHEY, D., PERLIN, K., AND WORLEY, S. 1998. Texturing & Modeling: A Procedural Approach. AP Professional. San Diego, CA, USA.
22. ELHELW, M. A., LO, B. P., DARZI, A., AND YANG, G.-Z. 2004. Real-time photo-realistic rendering for surgical, simulations with graphics hardware. In Lecture Notes in Computer Science (MIAR), Springer-Verlag, New York. 346-352.
23. FERNANDO, R. AND KILGARD, M. J. 2003. The Cg Tutorial. Addison Wesley, Reading, MA.
24. FERWERDA, J. A., PATTANAIK, S.N., SHIRLEY, P., AND GREENBERG, D. P. 1996. A model of visual adaptation for realistic image synthesis. In Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques. ACM Press, New York. 249-258.
25. FOLEY, J. 2004. The Computer Graphics Grand Challenge: How Much Realism is Enough. Realism? http://fp.tm.tue.nl/jfschouten/colloquia/upcoming/ foleycv.htm. Last accessed 02/08/2006.
26. FREEMAN, J., AVONS, S. E., PEARSON, D. E., AND IJSSELSTELTN, W. A. 1999. Effects of sensory information and prior experience on direct subjective ratings of presence. Presence-Teleoperators and Virtual Environments 8, 1, 1-13.
27. GORAL, C. M., TORRANCE, K. E., GREENBERG, D. P., AND BATTAILE, B. 1984. Modeling the interaction of light between diffuse surfaces. In Proceedings of the 11th Annual, Conference on Computer Graphics and, Interactive Techniques. ACM Press, New York. 213-222.
28. GORTLER, S. J., GRZESZCZUK, R., SZELISKI, R., AND COHEN, M. F. 1996. The lumigraph. In Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques. ACM Press, New York. 43-54.
29. GREENBERG, D. P. 1999. A framework for realistic image synthesis. Commun. ACM 42, 8, 44-53.
30. HACISALIHZADE, S. S., STARK, L. W., AND ALLEN, J. S. 1992. Visual-perception and sequences of eye-movement fixations - a stochastic modeling approach. IEEE Transactions on Systems Man and Cybernetics 22, 3, 474-481.
31. HANRAHAN, P. AND KRUEGER, W. 1993. Reflection from layered surfaces due to subsurface scattering. In Proceedings of the 20th Annual Conference on Computer Graphics and Interactive Techniques. ACM Press, New York. 165-174.
32. HE, X. D., TORRANCE, K. E., SILLION, F. O. X., AND GREENBERG, D. P. 1991. A comprehensive physical, model for light reflection. In Proceedings of the 18th Annual Conference on Computer Graphics and Interactive Techniques. ACM Press, New York. 175-186.
33. HECKBERT, P. S. AND GARLAND, M. 1994. Multiresolution modeling for fast rendering. In Graphics Interface. Banff, Canada, Canadian Inf. Proc. Soc. Banff, Alberta, Canada. 43-50.
34. HENDERSON, J. M. AND FERREIRA, F. 2004. Scene perception for psycholinguists. In The Interface of Language, Vision, and Action: Eyemovements and the Visual World, J. M. Henderson and F. F erreira, Eds. Psychology Press, New York. 1-58.
35. HENDERSON, J. M. AND HOLLINGWORTH, A. 1998. Eye movements during scene viewing: An overview. In Eye guidance in Reading and Scene Perception, G. Underwood, Ed. Elsevier Science, Oxford.
36. HENDERSON, J. M. AND HOLLINGWORTH, A. 1999. High-level scene perception. Annu. Rev. Psychol. 50, 243-271.
37. HOWLETT, S., HAMILL, J., AND O'SULLIVAN, C. 2004. An experimental approach to predicting saliency for simplified polygonal models. In Proceedings of the 1st Symposium on Applied Perception in Graphics and Visualization. Los Angeles, California, ACM Press, New York. 57-64.
38. HU, X. P., DEMPERE-MARCO, L., AND YANG, G. Z. 2003. Hot spot detection based, on feature space representation of visual search. IEEE Trans. Med. Imaging 22, 9, 1152-1162.
39. IJSSELSTEIJN, W., DE RIDDER, H., FREEMAN, J., AND AVONS, S. E. 2000. Presence: Concept, determinants and measurement. In Human Vision and Electronic Imaging V, 520-529.
40. ITTI, L., KOCH, C., AND NIEBUR, E. 1998. A model of saliency-based visual attention for rapid scene analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence 20, 11, 1254-1259.
41. KUNDEL, H., NODINE, C., AND CARMODY, D. 1978. Visual scanning, pattern recognition and decision-making in pulmonary nodule detection. Investigative Radiology 13, 175-181.
42. KUNDEL, H. L. 2004. Reader error, object recognition, and visual search. In Medical Imaging 2004: Image Perception, Observer Performance, and Technology Assessment. D. P. Chakraborty and M. P. Eckstein, Eds. SPIE. 1-11.
43. LARSON, G. W., RUSHMEIER, H., AND PIATKO, C. 1997. A visibility matching tone reproduction operator for high dynamic range scenes. Visualization and Computer Graphics, IEEE Transactions 3, 4, 291-306.
44. LAW, B., ATKINS, M. S., LOMAX, A. J., AND WILSON, J. 2003. Eye trackers in virtual laparoscopic training environment. In Medicine Meets Virtual Reality 11, 2003, IOS/Ohmsha Press. Amsterdam, The Netherlands. 184-186.
45. LAWRENCE, J., RUSINKIEWICZ, S., AND RAMAMOORTHI, R. 2004. Efficient BRDF importance sampling using a factored representation ACM Trans. Graph. 23, 3, A. B. Watson, Ed. 496-505.
46. LEVOY, M. AND HANRAHAN, P. 1996L ight field rendering In Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques. ACM Press, New York. 31-42
47. LI, B., MEYER, G. W., AND KLASSEN, R.V 1.998. A comparison of two image quality models. In Human Vision and Electronic Imaging III. SPIE. 98-109.
48. LIU, A., TENDIOK, F., CLEARY, K., AND KAUFMANN, C. 2003. A survey of surgical simulation: Applications, technology, and education. Presence-Teleoperators and Virtual Environments 12, 6, 599-614.
49. LONGHURST, P. AND CHALMERS, A. 2004. User validation of image quality assessment algorithms. In Procedings of Theory and Practice of Computer Graphics. 196-202.
50. LOSCHKY, L. C. AND MCCONKIE, G. W. 2000. User performance with gaze contingent multiresolutional displays. In Proceedings of the Symposium on Eye Tracking Research & Applications. ACM Press, New York. 97-103.
51. LUBIN, J. 1995. A visual discrimination model for imaging system design and evaluation. In Vision Models for Target Detection and Recognition, E. Peli, Ed. World Scientific, New Jersey. 245-283.
52. MACK, A. AND ROCK, I. 1998. Inattentional Blindness. MIT Press, Cambridge, MA.
53. MATUSIK, W., PFISTER, H., BRAND, M., AND MCMILLAN, L. 2003. A data-driven reflectance model. ACM Transactions on Graphics 22, 3, 759-769.
54. MCCOOL, M. D., ANG, J., AND AHMAD, A. 2001. Homomorphic factorization of BRDFs for high-performance rendering. In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques. ACM Press, New York. 171-178.
55. MCMILLAN, L. 1997. An image-based approach to three-dimensional computer graphics. PhD Thesis. University of North Carolina.
56. MCNAMARA, A. 2001. Visual perception in realistic image synthesis. Computer Graphics Forum 20, 4, 211-224.
57. MCNAMARA, A., CHALMERS, A., TROSCIANKO, T., AND GILCHRIST, I. 2000. Comparing real and synthetic scenes using human judgements of lightness. In Proceedings of the Eurographics Workshop on Rendering Techniques. Springer-Verlag, New York. 207-218.
58. MITCHELL, D. P. 1987. Generating antialiased images at low sampling densities. In Proceedings of the 14th Annual Conference on Computer Graphics and Interactive Techniques. ACM Press, New York. 65-72.
59. MURPHY, H. AND DUCHOWSKI, A. T. 2001. Gaze-contingent level of detail rendering. In EuroGraphics [short presentations]. EuroGraphics Association. Manchester, UK.
60. MYSZKOWSKI, K. 1998. The visible differences predictor: Applications to global illuminations problems. In Eurographics Workshop on Rendering Techniques, G. Drettakis and N. Max, Eds. Springer-Verlag, New York. 223-236.
61. NICOLAOU, M., JAMES, A., DARZI, A., AND YANG, G.-Z. 2004. A study of saccade transition for attention segregation and task strategy in laparoscopic surgery. In MICCAI. 97-104.
62. NODINE, C. F. AND KUNDEL, H. L. 1987. The cognitive side of visual search in radiology. In Eye Movements: From Psychology to Cognition, O. R. JK and L.-S. A, Eds. Elsevier Science, Amsterdam. 572-582.
63. OHSHIMA, T., YAMAMOTO, H., AND TAMURA, H. 1996. Gaze-directed adaptive rendering for interacting with virtual space. In Proceedings of the Virtual Reality Annual International Symposium (VRAIS 96). IEEE Computer Society, Los Alamitos, CA. 103-110.
64. OST, D., DE ROSIERS, A. , BRITT, E. J. , FEIN, A., LESSER, M., AND METHA, A. 2001. Assessment of a bronchoscopy simulator. American Journal of Respiratory and Critical Care Medicine 164, 12, 2248-2255.
65. O'SULLIVAN, C., DINGLIANA, J., AND HOWLETT, S. 2003. Eye-movements and interactive graphics. In The Mind's Eyes: Cognitive and Applied Aspects of Eye Movement Research, R. Radach, J. Hyona, and H. Deubel, Eds., Elsevier Science, Oxford. 555-571.
66. PERLIN, K. 1985. An image synthesizer. In Proceedings of the 12th Annual Conference on Computer Graphics and Interactive Techniques. ACM Press, New York. 287-296.
67. POMPLUN, M., REINGOLD, E. M., AND SHEN, J. Y. 2001. Investigating the visual span in comparative search: The effects of task difficulty and divided attention. Cognition 81, 2, B57-B67.
68. SRADEMACHER, P., LENGYEL, J., CUTRELL, E., AND WHITTED, T. 2001. Measuring the perception of visual realism in images. In Proceedings of the 12th Eurographics Workshop on Rendering Techniques. Springer-Verlag, New York. 235-248.
69. RAYNER, K. 1998. Eye movements in reading and information processing: 20 years of research. Psychological Bulletin 124, 3, 372-422.
70. RENSINK, R. A. 2000. Seeing, sensing, and scrutinizing. Vision Research 40, 10-12, 1469-1487.
71. RUSHMEIER, H., WARD, G. J., PIATKO, C., SANDERS, P., AND RUST, B. 1995. Comparing real and synthetic images: Some ideas about metrics. In Eurographics Workshop on Rendering Techniques, P. M. Hanrahan and W Purgathofer, Eds. Springer-Verlag, New York. 82-91.
72. SIDAK, Z., SEN, P., HAJEK, J. 1999. Theory of Rank Tests (Probability and Mathematical Statistics). Academic Press, New York.
73. SILLION, F. AND PUECH, C. 1989. A general two-pass method integrating specular and diffuse reflection In Proceedings of the 16th Annual Conference on Computer Graphics and Interactive Techniques. ACM Press, New York. 335-344.
74. SPSS. 2006. http://www.spss.com. Last accessed 02/08/2006.
75. STOKES, W A., FERWERDA, J. A., WALTER, B., AND GREENBERG, D. P. 2004. Perceptual illumination components: A new approach to efficient, high quality global illumination rendering. ACM Trans. Graph. 23, 3, 742-749.
76. SUNDSTEDT, V., DEBATTISTA, K., LONGHUHST, P., CHALMERS, A., AND THOSCIANKO, T. 2005. Visual attention for efficient high-fidelity graphics. In Spring Conference on Computer Graphics (SCCG 2005). 162-168.
77. TOBII. 2006. Tobii Technology User Manual, http://www.tobii.se. Last accessed 02/08/2006.
78. TUMBLIN, J. AND RUSHMEIER, H. 1993. Tone reproduction for realistic images. Computer Graphics and Applications. IEEE 13, 6, 42-48.
79. VELICHKOVSKY, B. M., DORNHOEFER, S. M., PANNASCH, S., AND UNEMA, P. J. A. 2000. Visual fixations and level of attentional processing In Proceedings of the Symposium on Eye Traching Research & Applications. ACM Press, New York. 79-85
80. WALLACE, J. R., COHEN, M. F., AND GREENBERG, D. P. 1987. A two-pass solution to the rendering equation: A synthesis of ray tracing and radiosity methods. In Proceedings of the 14th Annual Conference on Computer Graphics and Interactive Techniques. ACM Press, New York. 311-320.
81. WARD, G. J. 1992. Measuring and modeling anisotropic reflection. In Proceedings of the 19th Annual Conference on Computer Graphics and Interactive Techniques. ACM Press, New York. 265-272
82. WARD, G. J. 1994. A contrast-based scalefactor for luminance display In Graphics Gems W. Academic Press Professional. 415-421.
83. WATT, A. AND WATT, M. 1992. Advanced Animation and Rendering Techniques: Theory and Practice. ACM Press, New York.
84. WHITTED, T. 1980. An improved illumination model for shaded display. Commun. ACM 23, 6, 343-349.
85. YANG, G. Z., DEMPERE-MARCO, L., HU, X. P., AND ROWE, A. 2002. Visual search: Psychophysical models and practical applications. Image and Vision Computing 20, 291-305.
86. YARBUS, A. L. 1967. Eye movements during perception of complex objects. In Eye Movements and Vision, L. A. Riggs, Ed. Plenum. Press, New York. 171-196.
87. YEE, H., PATTANAIK, S., AND GREENBERG, D. P. 2001. Sensitivity and visual attention for efficient rendering of dynamic environments. ACM Trans. Graph. 20, 1, 39-65.