Real-time tracking of visually attended objects in virtual environments and its application to LOD

IEEE Transactions on Visualization and Computer Graphics

Volumn 15, Issue 1, 2009, Pages 6-19

  Lee, Sungkil ^a   Kim, G J ^b   Choi, Seungmoon ^a  

^a Pohang University of Science and Technology (POSTECH)   (South Korea)

^b Korea University   (South Korea)

Author keywords

Bottom up feature; Level of detail; Saliency map; Top down context; Virtual environment; Visual attention

Indexed keywords

BOTTOM-UP FEATURE; LEVEL OF DETAIL; SALIENCY MAP; TOP-DOWN CONTEXT; VIRTUAL ENVIRONMENT; VISUAL ATTENTION;

TRACKING (POSITION);

VIRTUAL REALITY;

ALGORITHM; ARTICLE; ATTENTION; COMPUTER ASSISTED DIAGNOSIS; COMPUTER GRAPHICS; COMPUTER INTERFACE; COMPUTER SIMULATION; COMPUTER SYSTEM; ENVIRONMENT; HUMAN; METHODOLOGY; PATTERN RECOGNITION; PHYSIOLOGY; THEORETICAL MODEL;

ALGORITHMS; ATTENTION; COMPUTER GRAPHICS; COMPUTER SIMULATION; COMPUTER SYSTEMS; ENVIRONMENT; HUMANS; IMAGE INTERPRETATION, COMPUTER-ASSISTED; MODELS, THEORETICAL; PATTERN RECOGNITION, VISUAL; USER-COMPUTER INTERFACE;

EID: 59449087750     PISSN: 10772626     EISSN: None     Source Type: Journal    
DOI: 10.1109/TVCG.2008.82     Document Type: Article

References (51)

1. K. Cater, A. Chalmers, and P. Ledda, "Selective Quality Rendering by Exploiting Human Inattentional Blindness: Looking but Not Seeing," Proc. ACM Symp. Virtual Reality Software and Technology (VRST '02), pp. 17-24, 2002.
2. R. Brown, L. Cooper, and B. Pham, "Visual Attention-Based Polygon Level of Detail Management," Proc. Int'l Conf. Computer Graphics and Interactive Techniques in Australasia and South East Asia (GRAPHITE '03), pp. 55-62, 2003.
3. C.H. Lee, A. Varshney, and D.W. Jacobs, "Mesh Saliency," Proc. ACM SIGGRAPH '05, pp. 659-666, 2005.
4. A. Beeharee, A. West, and R. Hubbold, "Visual Attention Based Information Culling for Distributed Virtual Environments," Proc. ACM Symp. Virtual Reality Software and Technology (VRST '03), pp. 213-222, 2003.
5. B. Watson, N. Walker, L.F. Hodges, and A. Worden, "Managing Level of Detail through Peripheral Degradation: Effects on Search Performance with a Head-Mounted Display," ACM Trans. Computer-Human Interaction, vol. 4, no. 4, pp. 323-346, 1997.
6. H. Yee, S. Pattanaik, and D.P. Greenberg, "Spatiotemporal Sensitivity and Visual Attention for Efficient Rendering of Dynamic Environments," ACM Trans. Graphics, vol. 20, pp. 39-65, 2001.
7. P. Longhurst, K. Debattista, and A. Chalmers, "A GPU Based Saliency Map for High-Fidelity Selective Rendering," Proc. Conf. Computer Graphics, Virtual Reality, Visualisation and Interaction in Africa (AFRIGRAPH '06), pp. 21-29, 2006.
8. J. Henderson, "Human Gaze Control During Real-World Scene Perception," Trends in Cognitive Sciences, vol. 7, no. 11, pp. 498-504, 2003.
9. C. Connor, H. Egeth, and S. Yantis, "Visual Attention: Bottom-Up versus Top-Down," Current Biology, vol. 14, no. 19, pp. 850-852, 2004.
10. A.M. Treisman and G. Gelade, "A Feature-Integration Theory of Attention," Cognitive Psychology, vol. 12, pp. 97-136, 1980.
11. G.R. Loftus and N.H. Mackworth, "Cognitive Determinants of Fixation Duration during Picture Viewing," J. Experimental Psychology, vol. 4, pp. 565-572, 1978.
12. J.M. Wolfe, "Guided Search 2.0," Proc. Human Factors and Ergonomics Soc. 37th Ann. Meeting, pp. 1295-1299, 1993.
13. C. Koch and S. Ullman, "Shifts in Selective Visual Attention," Human Neurobiology, vol. 4, pp. 219-227, 1985.
14. S.M. Culhane and J.K. Tsotsos, "An Attentional Prototype for Early Vision," Proc. European Conf. Computer Vision (ECCV '92), pp. 551-560, 1992.
15. M.C. Mozer and M. Sitton, "Computational Modeling of Spatial Attention," Attention, H. Pashler, ed., pp. 341-393, UCL Press, 1998.
16. L. Itti, C. Koch, and E. Niebur, "A Model of Saliency-Based Visual Attention for Rapid Scene Analysis," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, no. 11, pp. 1254-1259, Nov. 1998.
17. G. Backer, B. Mertsching, and M. Bollmann, "Data- and Model-Driven Gaze Control for an Active-Vision System," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 12, pp. 1415-1429, Dec. 2001.
18. D.J. Jobson, Z. ur Rahman, and G.A. Woodell, "Properties and Performance of a Center/Surround Retinex," IEEE Trans. Image Processing, vol. 6, no. 3, pp. 451-462, 1997.
19. U. Rutishauser, D. Walther, C. Koch, and P. Perona, "Is Bottom-Up Attention Useful for Object Recognition?" Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR '04), pp. 37-44, 2004.
20. N. Ouerhani, J. Bracamonte, H. Hugli, M. Ansorge, and F. Pellandini, "Adaptive Color Image Compression Based on Visual Attention," Proc. Int'l Conf. Image Analysis and Processing (ICIAP '01), pp. 416-421, 2001.
21. Y.F. Ma, X.S. Hua, L. Lu, and H. Zhang, "A Generic Framework of User Attention Model and Its Application in Video Summarization," IEEE Trans. Multimedia, vol. 7, no. 5, pp. 907-919, 2005.
22. A.L. Yarbus, Eye Movements and Vision. Plenum Press, 1967.
23. C.L. Folk, R.W. Remington, and J.C. Johnston, "Involuntary Covert Orienting Is Contingent on Attentional Control Settings," J. Experimental Psychology: Human Perception and Performance, vol. 18, no. 4, pp. 1030-1044, 1992.
24. S. Engel, X. Zhang, and B. Wandell, "Colour Tuning in Human Visual Cortex Measured with Functional Magnetic Resonance Imaging," Nature, vol. 388, no. 6637, pp. 68-71, 1997.
25. J. Haber, K. Myszkowski, H. Yamauchi, and H.-P. Seidel, "Perceptually Guided Corrective Splatting," Computer Graphics Forum, vol. 20, no. 3, 2001.
26. R. Peters and L. Itti, "Beyond Bottom-Up: Incorporating Task-Dependent Influences into a Computational Model of Spatial Attention," Proc. IEEE Computer Vision and Pattern Recognition (CVPR '07), pp. 1-8, 2007.
27. N. Ouerhani, R. von Wartburg, and H. Hugli, "Empirical Validation of the Saliency-Based Model of Visual Attention," Electronic Letters on Computer Vision and Image Analysis, vol. 3, no. 1, pp. 13-24, 2004.
28. A. Santella and D. DeCarlo, "Visual Interest and NPR: An Evaluation and Manifesto," Proc. Symp. Non-Photorealistic Animation and Rendering (NPAR '04), pp. 71-150, 2004.
29. J. Duncan, "Selective Attention and the Organization of Visual Information," J. Experimental Psychology: General, vol. 113, no. 4, pp. 501-517, 1984.
30. K.M. O'Craven, P.E. Downing, and N. Kanwisher, "fMRI Evidence for Objects as the Units of Attentional Selection," Nature, vol. 401, no. 6753, pp. 584-587, 1999.
31. C. Sears and Z. Pylyshyn, "Multiple Object Tracking and Attentional Processing," J. Experimental Psychology, vol. 54, no. 1, pp. 1-14, 2000.
32. J. Clark, "Hierarchical Geometric Models for Visible Surface Algorithms," Comm. ACM, vol. 9, no. 10, pp. 547-554, 1976.
33. H. Hoppe, "Progressive Meshes," Proc. ACM SIGGRAPH '96, pp. 99-108, 1996.
34. D. Luebke and C. Erikson, "View-Dependent Simplification of Arbitrary Polygonal Environments," Proc. ACM SIGGRAPH '97, pp. 199-208, 1997.
35. J.C. Xia, J. El-Sana, and A. Varshney, "Adaptive Real-Time Level-of-Detail-Based Rendering for Polygonal Models," IEEE Trans. Visualization and Computer Graphics, vol. 3, no. 2, pp. 171-181, Apr.-June 1997.
36. D. Luebke, B. Watson, J. Cohen, M. Reddy, and A. Varshney, Level of Detail for 3D Graphics. Elsevier Science, 2002.
37. T.A. Funkhouser and C.H. Séquin, "Adaptive Display Algorithm for Interactive Frame Rates during Visualization of Complex Virtual Environments," Proc. ACM SIGGRAPH '93, pp. 247-254, 1993.
38. M. Giegl and M. Wimmer, "Unpopping: Solving the Image-Space Blend Problem for Smooth Discrete LOD Transitions," Computer Graphics Forum, vol. 26, no. 1, pp. 46-49, 2007.
39. A.L. Nagy and R.R. Sanchez, "Critical Color Differences Determined with a Visual Search Task," J. Optical Soc. of Am., vol. 7, no. 7, pp. 1209-1217, 1990.
40. J.T. Enns, "Three-Dimensional Features That Pop Out in Visual Search," Visual Search. Taylor and Francis, pp. 37-45, 1990.
41. K. Nakayama and G. Silverman, "Serial and Parallel Processing of Visual Feature Conjunctions," Nature, vol. 320, pp. 264-265, 1986.
42. H. Weghorst, G. Hooper, and D.P. Greenberg, "Improved Computational Methods for Ray Tracing," ACM Trans. Graphics, vol. 3, no. 1, pp. 52-69, 1984.
43. G. Welsh and G. Bishop, "An Introduction to the Kalman Filter," Technical Report 95-041, Univ. of North Carolina at Chapel Hill, 1995.
44. A.W. Siegel and S.H. White, "The Development of Spatial Representations of Large-Scale Environments," Advances in Child Development and Behavior, H. Reese, ed., vol. 10, pp. 10-55, Academic Press, 1975.
45. B. Kuipers, "Modeling Spatial Knowledge," Cognitive Science, vol. 2, pp. 129-153, 1978.
46. J. Cutting and P. Vishton, "Perceiving Layout and Knowing Distances," Perception of Space and Motion, W. Epstein and S. Rogers, eds., pp. 69-117, Academic Press, 1995.
47. K. Cave and N. Bichot, "Visuospatial Attention: Beyond a Spotlight Model," Psychonomic Bull. & Rev., vol. 6, no. 2, pp. 204-223, 1999.
48. E. Awh and H. Pashler, "Evidence for Split Attentional Foci," J. Experimental Psychology, vol. 26, no. 2, pp. 834-846, 2000.
49. F.M. Speed, R.R. Hocking, and O.P. Hackney, "Methods of Analysis of Linear Models with Unbalanced Data," J. Am. Statistical Assoc., vol. 73, no. 361, pp. 105-112, 1978.
50. E. Gobbetti and E. Bouvier, "Time-Critical Multiresolution Scene Rendering," Proc. IEEE Visualization (VIS '99), pp. 123-130, 1999.
51. M. Garland and P. Heckbert, "Surface Simplification Using Quadric Error Metrics," Proc. ACM SIGGRAPH '97, pp. 209-215, 1997.