GAFFE: A gaze-attentive fixation finding engine

IEEE Transactions on Image Processing

Volumn 17, Issue 4, 2008, Pages 564-573

  Rajashekar, Umesh ^a,b   van der Linde, Ian ^b,c   Bovik, Alan C ^d   Cormack, Lawrence K ^b  

^a NEW YORK UNIVERSITY   (United States)

^b UNIVERSITY OF TEXAS AT AUSTIN   (United States)

^c ANGLIA RUSKIN UNIVERSITY   (United Kingdom)

^d The University of Texas at Austin   (United States)

Author keywords

Eye tracking; Fixation selection; Foveation; Point of gaze

Indexed keywords

FEATURE EXTRACTION; LUMINANCE; STATISTICS; VISION;

EYE TRACKING; FIXATION SELECTION; FOVEATION; POINT-OF-GAZE;

IMAGE ANALYSIS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; ATTENTION; AUTOMATED PATTERN RECOGNITION; BIOLOGICAL MODEL; BIOMIMETICS; COMPUTER ASSISTED DIAGNOSIS; COMPUTER SIMULATION; EYE FIXATION; HUMAN; IMAGE ENHANCEMENT; METHODOLOGY; PATTERN RECOGNITION; PHYSIOLOGY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; ATTENTION; BIOMIMETICS; COMPUTER SIMULATION; FIXATION, OCULAR; HUMANS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; MODELS, BIOLOGICAL; PATTERN RECOGNITION, AUTOMATED; PATTERN RECOGNITION, VISUAL; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY;

EID: 41849125310     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2008.917218     Document Type: Article

References (45)

1. B. A. Wandell, Foundations of Vision. New York: Sinauer, 1995.
2. A. L. Yarbus, Eye Movements and Vision. New York: Plenum, 1967.
3. D. Burr, M. Concetta Morrone, and J. Ross, "Selective suppression of the magnocellular visual pathway during saccadic eye movements," Nature, vol. 371, no. 6497, pp. 511-513, Oct. 1994.
4. A. Moini, Vision Chips or Seeing Silicon, Mar. 1997 [Online]. Available: http://www.eleceng.adelaide.edu.au/Personal/moini
5. S. Xia, R. Sridhar, P. Scott, and C. Bandera, "An all CMOS foveal image sensor chip," in Proc. 11th Annu. IEEE Int. ASIC Conf., 1998, pp. 409-413.
6. R. Etienne-Cummings, J. Van der Spiegel, P. Mueller, and M.-Z. Zhang. "A foveated silicon retina for two-dimensional tracking," IEEE Trans. Circuits Syst. II, Analog Digit. Signal Process., vol. 47, no. 6, pp. 504-517, Jun, 2000.
7. W. Klarquist and A. Bovik, "Fovea: A foveated vergent active stereo vision system for dynamicthree-dimensional scene recovery," IEEE Trans. Robot. Autom., vol. 14, no. 5, pp. 755-770, May 1998.
8. W. Osberger. N. Bergmann, and A. Maeder. "An automatic image quality assessment technique incorporatinghigher level perceptual factors," in Proc. IEEE Int. Conf. Image Processing, 1998, vol. 3, pp. 414-418.
9. S. Lee, M. Pattichis, and A. Bovik, "Foveated video compression with optimal rate control," IEEE Trans. Image Process., vol. 10, no. 7, pp. 977-992, Jul. 2001.
10. Z. Wang, L. Lu, and A. Bovik, "Foveation scalable video coding with automatic fixation selection," IEEE Trans. Image Process., vol. 12, no. 2, pp. 243-254, Feb. 2003.
11. G.-Z. Yang, L. Dempere-Marco, X.-P. Hu, and A. Rowe, "Visual search: Psychophysical models and practical applications," Image Vis. Comput., vol. 20, no. 4, pp. 273-287, Apr. 2002.
12. C. Privitera and L. Stark, "Human-vision-based selection of image processing algorithms for planetary exploration," IEEE Trans. Image Process., vol. 12, no. 8, pp. 917-923, Aug. 2003.
13. W. Geisler and J. Perry, "A real-time foveated multiresolution system for low-bandwidth video communication," in Proc. SPIE Human Vision and Electronic Imaging III, 1998, vol. 3299, pp. 294-305.
14. M. S. Banks, A. B. Sekuler, and S. J. Anderson, "Peripheral spatial vision: Limits imposed ny optics, photoceptors, and receptor pooling," J. Opt. Soc. Amer. A, vol. 8, no. 11, pp. 1775-1787, Nov. 1991.
15. T. Buswell G., How People Look at Pictures: A Study of The Psychology of Perception in Art. Chicago, IL: Univ. Chicago Press, 1935.
16. N. H. Mackworth and A. J. Morandi, "The gaze selects informative details within pictures," Percept. Psychophys., vol. 2, pp. 547-552, 1967.
17. L. E. Wixson and D. H. Ballard, "Using intermediate objects to improve the efficiency of visual search," Int. J. Comput. Vis., vol. 12, no. 2-3, pp. 209-230, Apr. 1994.
18. J. M. Henderson, "Object identification in context: The visual processing of natural scenes," Canad. J. Psych., vol. 46, no. 3, pp. 319-341, Sep. 1992.
19. L. G. Williams, "The effects of target specification on objects fixated during visual search," Acta Psych., vol. 27, pp. 355-60, 1967.
20. C. Privetera and L. Stark, "Algorithms for defining visual regions-of-interest: Comparison with eye fixations," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 9, pp. 970-982, Sep. 2000.
21. L. Itti, C. Koch, and E. Niebur, "A model of saliency-based visual attention for rapid scene analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 11, pp. 1254-1259, Nov. 1998.
22. L. Itti, "Automatic foveation for video compression using a neurobiological model of visual attention," IEEE Trans. Image Process., vol, 13, no. 10, pp. 1304-1318, Oct. 2004.
23. A. Torralba, "Modeling global scene factors in attention," J. Opt. Soc. Amer. A, vol. 20, no. 7, pp. 1407-1418, Jul. 2003.
24. H. B. Barlow, "Possible, principles underlying the transformation of sensory messages," in Sensory Communication. Cambridge, MA: MIT Press, 1961, pp. 217-234.
25. D. Field, "Relations between the statistics of natural images and the response properties of cortical cells," J. Opt. Soc. Amer. A, vol. 4, no. 12, pp. 2379-2394, Dec. 1987.
26. E. P. Simoncelli and B. A. Olshausen, "Natural image statistics and neural representation," Annu. Rev. Neurosci., vol. 24 no. 1, pp. 1193-1216, 2001.
27. P. Reinagel and A. M. Zador, "Natural scene statistics at the centre of gaze," Netw.: Comput. Neural Syst., vol. 10, no. 4, pp. 341-350, 1999.
28. D. J. Parkhurst and E. Niebur, "Scene content selected by active vision," Spatial Vis., vol. 16, no. 2, pp. 125-154, Jun. 2003.
29. D. Parkhurst, K. Law, and E. Niebur, "Modeling the role of salience in the allocation of overt visual attention," Vis. Res., vol. 42, no. 1, pp. 107-123, Jan. 2002.
30. L. Itti, "Quantitative modelling of perceptual salience at human eye position," Vis. Cogn., vol. 14, no. 4-8, pp. 959-984, Aug. 2006.
31. J. H. van Hateren and A. van der Schaaf, "Independent component filters of natural images compared with simple cells in primary visual cortex.," Proc. Biol. Sci., vol. 265, no. 1394, pp. 359-366, Mar. 1998.
32. Applied Science Laboratories, Eye Tracking System Instruction Manual 1998.
33. B. W. Tatler, R. J. Baddeley, and B. T. Vincent, "The Long and the short of it: Spatial statistics at fixation vary with saccade amplitude and task," Vis. Res., vol. 46, no. 12, pp. 1857-1862, Jun. 2006, (Print).
34. B. W. Tatler, R. J. Baddeley, and I. D. Gilchrist, "Visual correlates of fixation selection: Effects of scale and time," Vis. Res., vol. 45, no. 5, pp. 643-659, Mar. 2005.
35. B. Efron, An introduction to the Bootstrap. Boca Raton, FL: Chapman & Hall/CRC, 1994.
36. U. Rajashekar, I. van der Linde, A. C. Bovik, and L. K. Cormack, "Foveated analysis of image features at fixations," Vis. Res., vol. 47, no. 25, pp. 3160-3172, Nov. 2007.
37. S. K. Mannan, K. H. Ruddock, and D. S. Wooding, "The relationship between the locations of spatial features and those of fixations made during visual examination of briefly presented images.," Spat. Vis. vol. 10, no. 3, pp. 165-188, 1996.
38. M. Posner, R. Rafal, L. Choate, and J. Vaughan, "Inhibition of return: Neural basis and function," Cogn. Neuropsych., vol. 2, no. 3, pp. 211-228, 1985.
39. M. Ester, H. Kriegel, J. Sander, and X. Xu, "A density-based algorithm for discovering clusters in large spatial databases with noise," in Proc. 2nd Int. Conf. Knowledge Discovery and Data Mining, 1996, pp. 226-231.
40. D. S. Wooding, M. D. Mugglestone, K. J. Purdy, and A. G. Gale, "Eye movements of large populations: Ii. deriving regions of interest, coverage, and similarity using fixation maps," Behav. Res. Meth., Instrum. Comput., vol. 34, no.4, 1, pp. 509-517, nov. 2002.
41. U. Rajashekar, A. Bovik, and L. Cormack, "Visual search in noise: Revealing the influence of structural cues by gaze-contingent classification image analysis," J. Vis., vol. 6, no. 4, pp. 379-386, 2006.
42. A. Tavassoli, I. van der Linde, A. C. Bovik, and L. K. Cormack, "An efficient technique for revealing visual search strategies with classification images," Percept. Psychophys., vol. 69, no. 1, pp. 103-112, Jan. 2007.
43. U. Rajashekar, L. Cormack, and A. Bovik, "Point-of-gaze analysis reveals visual search strategies," in Prooc. SPIE Human Vision and Electronic Imaging IX, 2004, vol. 5292, no. 1, pp. 296-306.
44. J. Wolfe and T. Horowitz, "What attributes guide the deployment of visual attention and how do they do it?" Nature Rev. Neurosci., vol. 5, no. 6, pp. 495-501, 2004.
45. V. Mante, R. A. Frazor, V. Bonin, W. S. Geisler, and M. Carandini, "Independence of luminance and contrast in natural scenes and in the early visual system," Nat. Neurosci., vol. 8, no. 12, pp. 1690-1697, Dec. 2005.