Design and application of real-time visual attention model for the exploration of 3D virtual environments

IEEE Transactions on Visualization and Computer Graphics

Volumn 18, Issue 3, 2012, Pages 356-368

  Hillaire, Sébastien ^a   Lécuyer, Anatole ^b   Regia Corte, Tony ^b   Cozot, Rémi ^c   Royan, Jérôme ^a   Breton, Gaspard ^a  

^a ORANGE LABS   (France)

^b INRIA   (France)

^c UNIVERSITÉ DE RENNES 1   (France)

Author keywords

first person exploration; gaze tracking; Visual attention model; visual effects

Indexed keywords

3-D VIRTUAL ENVIRONMENT; 3D OBJECT; BOTTOM-UP AND TOP-DOWN; CAMERA MOTIONS; COGNITIVE PROCESS; DEPTH-OF-FIELD BLUR; DESIGN AND APPLICATION; GAZE BEHAVIOR; GAZE POINT; GAZE TRACKING; HUMAN VISUAL SYSTEM; LEVEL-OF-DETAIL; OBJECT BASED; REAL TIME; STATE-OF-THE-ART APPROACH; VIRTUAL ENVIRONMENTS; VISUAL ATTENTION MODEL; VISUAL EFFECTS; VISUAL FEEDBACK; VISUAL OBJECTS; VISUAL QUALITIES;

THREE DIMENSIONAL; VIRTUAL REALITY; VISUAL COMMUNICATION;

THREE DIMENSIONAL COMPUTER GRAPHICS;

ADULT; ALGORITHM; ARTICLE; BIOLOGICAL MODEL; COMPUTER INTERFACE; COMPUTER PROGRAM; COMPUTER SIMULATION; EYE MOVEMENT; FEMALE; HUMAN; IMAGE PROCESSING; MALE; METHODOLOGY; PHYSIOLOGY; STATISTICS; VISION; VISUAL FIELD;

ADULT; ALGORITHMS; COMPUTER SIMULATION; EYE MOVEMENTS; FEMALE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MALE; MODELS, BIOLOGICAL; SOFTWARE; STOCHASTIC PROCESSES; USER-COMPUTER INTERFACE; VISUAL FIELDS; VISUAL PERCEPTION;

EID: 84855934895     PISSN: 10772626     EISSN: None     Source Type: Journal    
DOI: 10.1109/TVCG.2011.154     Document Type: Article

References (24)

1. D.P. Luebke and B. Hallen, "Perceptually-Driven Simplification for Interactive Rendering," Proc. Eurographics Workshop Rendering Techniques, pp. 223-234, 2001.
2. S. Hillaire, A. Lécuyer, R. Cozot, and G. Casiez, "Using an Eye- Tracking System to Improve Camera Motions and Depth-of-Field Blur Effects in Virtual Environments," Proc. IEEE Virtual Reality Conf., pp. 47-50, 2008.
3. A. Glenstrup and T. Engell-Nielsen, "Eye Controlled Media: Present and Future State," master's thesis, 1995.
4. L. Itti, C. Koch, and E. Niebur, "A Model of Saliency-based Visual Attention for Rapid Scene Analysis," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, no. 11, pp. 1254-1259, Nov. 1998. (Pubitemid 128742001)
5. L. Itti, "Quantifying the Contribution of Low-Level Saliency to Human Eye Movements in Dynamic Scenes," Visual Cognition, vol. 12, pp. 1093-1123, 2005. (Pubitemid 41283179)
6. S. Lee, G. Kim, and S. Choi, "Real-Time Tracking of Visually Attended Objects in Virtual Environments and Its Application to LOD," IEEE Trans. Visualization and Computer Graphics, vol. 15, no. 1, pp. 6-19, Jan./Feb. 2009.
7. S. Hillaire, A. Lécuyer, G. Breton, and T. Regia-Corte, "Gaze Behavior and Visual Attention Model when Turning in Virtual Environments," Proc. ACM Symp. Virtual Reality Software and Technology, pp. 43-50, 2009.
8. K. Cater, A. Chalmers, and G. Ward, "Detail to Attention: Exploiting Visual Tasks for Selective Rendering," Proc. 14th Eurographics Workshop Rendering, pp. 270-280, 2003.
9. A.M. Treisman and G. Gelade, "A Feature-Integration Theory of Attention," Cognitive Psychology, vol. 12, pp. 97-136, 1980.
10. D. Yarbus, Eye Motion and Vision. Plenum Press, 1967.
11. P. Longhurst, K. Debattista, and A. Chalmers, "A GPU Based Saliency Map for High-Fidelity Selective Rendering," Proc. Fourth Int'l Conf. Computer Graphics, Virtual Reality, Visualisation and Interaction in Africa, pp. 21-29, 2006. (Pubitemid 46620964)
12. V. Navalpakkam and L. Itti, "Modeling the Influence of Task on Attention," Vision Research, vol. 45, no. 2, pp. 205-231, 2005. (Pubitemid 39575753)
13. V. Sundstedt, E. Stavrakis, M. Wimmer, and E. Reinhard, "A Psychophysical Study of Fixation Behavior in a Computer Game," Proc. Fifth Symp. Applied Perception in Graphics and Visualization, pp. 43-50, 2008.
14. C. Sears and Z. Pylyshyn, "Multiple Object Tracking and Attentional Processing," J. Experimental Psychology, vol. 54, no. 1, pp. 1-14, 2000.
15. A.R. Robertson, "Historical Development of CIE Recommended Color Difference Equations," Color Research and Application, vol. 15, no. 3, pp. 167-170, 1990.
16. H. Chen and X. Liu, "Lighting and Material of Halo 3," Proc. SIGGRAPH '08 Classes, 2008.
17. S. Hillaire, A. Lécuyer, R. Cozot, and G. Casiez, "Depth-of-Field Blur Effects for First-Person Navigation in Virtual Environments," IEEE Computer Graphics and Applications, vol. 28, no. 6, pp. 47-55, Nov./Dec. 2008.
18. D.A. Robinson, "The Mechanics of Human Smooth Pursuit Eye Movement," J. Physiology, vol. 180, pp. 569-591, 1965.
19. S. Hillaire, G. Breton, N. Ouarti, R. Cozot, and A. Lécuyer, "Using a Visual Attention Model to Improve Gaze Tracking Systems in Interactive 3D Applications," Computer Graphics Forum, vol. 29, pp. 47-55, 2010.
20. M. McGuire and E. Enderton, "Colored Stochastic Shadow Maps," Proc. ACM Symp. Interactive 3D Graphics and Games, 2011.
21. F. Meinl, "Crytek Sponza Atrium," http://www.crytek.com/ cryengine/cryengine3/downloads, 2011.
22. L. Terziman, A. Lécuyer, S. Hillaire, and J. Wiener, "Can Camera Motions Improve the Perception of Traveled Distance in Virtual Environments?," Proc. IEEE Virtual Reality Conf., 2009.
23. M. Moehring, A. Gloystein, and R. Doerner, "Issues with Virtual Space Perception within Reaching Distance: Mitigating Adverse Effects on Applications Using hmds in the Automotive Industry," Proc. IEEE Virtual Reality Conf., pp. 223-226, 2009.
24. E. Reinhard, M. Stark, P. Shirley, and J. Ferwerda, "Photographic Tone Reproduction for Digital Images," Proc. 29th Ann. Conf. Computer Graphics and Interactive Techniques, pp. 267-276, 2002.