Comparative study of fixation density maps

IEEE Transactions on Image Processing

Volumn 22, Issue 3, 2013, Pages 1121-1133

  Engelke, Ulrich ^a   Liu, Hantao ^b   Wang, Junle ^c   Le Callet, Patrick ^c   Heynderickx, Ingrid ^a,d   Zepernick, Hans Jürgen ^e   Maeder, Anthony ^f  

^a PHILIPS RESEARCH LABORATORIES   (Netherlands)

^b UNIVERSITY OF HULL   (United Kingdom)

^c INSTITUT DE RECHERCHE EN COMMUNICATIONS ET CYBERNÉTIQUE DE NANTES   (France)

^d DELFT UNIVERSITY OF TECHNOLOGY   (Netherlands)

^e BLEKINGE INSTITUTE OF TECHNOLOGY   (Sweden)

^f UNIVERSITY OF WESTERN SYDNEY   (Australia)

Author keywords

Eye tracking; fixation density maps; inter laboratory differences; visual attention

Indexed keywords

COMPARATIVE STUDIES; DEGREE OF SIMILARITY; DENSITY MAPS; EXPERIMENTAL CONDITIONS; EYE-TRACKING; GROUND TRUTH; HUMAN VISUAL ATTENTION; IMAGE CONTENT; IMAGE PROCESSING APPLICATIONS; IMAGE QUALITY ASSESSMENT; IMAGE RETARGETING; INTER-LABORATORY DIFFERENCES; RESEARCH COMMUNITIES; VISUAL ATTENTION; VISUAL SALIENCY;

EXPERIMENTS; IMAGE PROCESSING;

LABORATORIES;

ADOLESCENT; ADULT; ARTICLE; BIOLOGICAL MODEL; COMPARATIVE STUDY; COMPUTER SIMULATION; EYE FIXATION; EYE MOVEMENT; FEMALE; HUMAN; MALE; MIDDLE AGED; PHYSIOLOGY; STATISTICAL ANALYSIS; STATISTICAL MODEL; VISION;

ADOLESCENT; ADULT; COMPUTER SIMULATION; DATA INTERPRETATION, STATISTICAL; EYE MOVEMENTS; FEMALE; FIXATION, OCULAR; HUMANS; MALE; MIDDLE AGED; MODELS, BIOLOGICAL; MODELS, STATISTICAL; VISUAL PERCEPTION; YOUNG ADULT;

MLCS; MLOWN;

EID: 84873387686     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2012.2227767     Document Type: Article

References (48)

1. B. A. Wandell, Foundations of Vision. Victoria, Australia: Sinauer Associates, 1995.
2. J. Wolfe, "Visual attention," Seeing, K. K. D. Valois, Ed. San Francisco, CA: Academic, 2000, pp. 335-386.
3. K. H. Park and H. W. Park, "Region-of-interest coding based on set partitioning in hierarchical trees," IEEE Trans. Circuits Syst. Video Technol., vol. 12, no. 2, pp. 106-113, Feb. 2002.
4. D. Wang, G. Li, W. Jia, and X. Luo, "Saliency-driven scaling optimization for image retargeting," Visual Comput., vol. 27, no. 9, pp. 853-860, Mar. 2011.
5. K. Vu, K. A. Hua, and W. Tavanapong, "Image retrieval based on regions of interest," IEEE Trans. Knowl. Data Min., vol. 15, no. 4, pp. 1045-1049, Jul. 2003.
6. U. Engelke, H. Kaprykowsky, H.-J. Zepernick, and P. Ndjiki-Nya, "Visual attention in quality assessment: Theory, advances, and challenges," IEEE Signal Process. Mag., vol. 28, no. 6, pp. 50-59, Nov. 2011.
7. L. Itti, C. Koch, and E. Niebur, "A model of saliency-based visual attention for rapid scene analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 11, pp. 1254-1259, Nov. 1998.
8. O. L. Meur, P. L. Callet, D. Barba, and D. Thoreau, "A coherent computational approach to model bottom-up visual attention," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 5, pp. 802-817, May 2006.
9. U. Rajashekar, I. V. D. Linde, A. C. Bovik, and L. K. Cormack, "GAFFE: A gaze-attentive fixation finding engine," IEEE Trans. Image Process., vol. 17, no. 4, pp. 564-573, Apr. 2008.
10. N. D. B. Bruce and J. K. Tsotsos, "Saliency, attention, and visual search: An information theoretic approach," J. Vis., vol. 9, no. 5, pp. 1-24, 2009.
11. U. Engelke and H.-J. Zepernick, "A framework for optimal regionof-interest based quality assessment in wireless imaging," J. Electron. Imag., vol. 19, no. 1, pp. 011005-011008, Jan. 2010.
12. A. J. Maeder, "The image importance approach to human vision based image quality characterization," Pattern Recogn. Lett., vol. 26, no. 3, pp. 347-354, Feb. 2005.
13. J. Wang, D. M. Chandler, and P. L. Callet, "Quantifying the relationship between visual salience and visual importance," in Proc. IS&T/SPIE Human Vis. Electron. Imag., Jan. 2010, pp. 1-9.
14. L. Itti and C. Koch, "Computational modelling of visual attention," Nature Rev. Neurosci., vol. 2, pp. 192-203, Mar. 2001.
15. J. M. Wolfe and T. S. Horowitz, "What attributes guide the deployment of visual attention and how do they do it?" Nature Rev. Neurosci., vol. 5, pp. 1-7, Jun. 2004.
16. A. T. Duchowski, Eye Tracking Methodology: Theory and Practice. New York: Springer-Verlag, 2007.
17. T. Judd, K. Ehinger, F. Durand, and A. Torralba, "Learning to predict where humans look," in Proc. IEEE Int. Conf. Comput. Vis., May 2009, pp. 2106-2113.
18. U. Engelke, A. J. Maeder, and H.-J. Zepernick, "Visual attention modelling for subjective image quality databases," in Proc. IEEE Int. Workshop Multimedia Signal Process. Conf., Oct. 2009, pp. 1-6.
19. H. Liu and I. Heynderickx, "Studying the added value of visual attention in objective image quality metrics based on eye movement data," in Proc. IEEE Int. Conf. Image Process. Conf., Nov. 2009, pp. 3097-3100.
20. M. Cerf, E. P. Frady, and C. Koch, "Faces and text attract gaze independent of the task: Experimental data and computer model," J. Vis., vol. 9, no. 12, pp. 1-15, 2009.
21. A. T. Duchowski, "A breadth-first survey of eye-tracking applications," Behav. Res. Meth., vol. 34, no. 4, pp. 455-470, 2002.
22. U. Engelke, A. Maeder, and H.-J. Zepernick, "Analysing inter-observer saliency variations in task-free viewing of natural images," in Proc. IEEE Int. Conf. Image Process., Sep. 2010, pp. 1085-1088.
23. M. Dorr, T. Martinetz, K. R. Gegenfurtner, and E. Barth, "Variability of eye movements when viewing dynamic natural scenes," J. Vis., vol. 10, no. 28, pp. 1-17, 2010.
24. U. Engelke, H. Liu, H.-J. Zepernick, I. Heynderickx, and A. Maeder, "Comparing two eye-tracking databases: The effect of experimental setup and image presentation time on the creation of saliency maps," in Proc. IEEE Picture Coding Symp. Conf., Dec. 2010, pp. 282-285.
25. J. Wang, R. Pepion, and P. L. Callet, IRCCyN/IVC eyetracker images LIVE database. (2011) [Online]. Available: http://www.irccyn.ecnantes. fr/spip.php?article839&lang=en
26. H. R. Sheikh, Z. Wang, L. Cormack, and A. C. Bovik, LIVE image quality assessment database release 2. (2005). Available: http://live.ece.utexas.edu/ research/quality
27. "TM3 eye tracker," EyeTech Digital Systems. (2009) [Online]. Available: http://www.eyetechds.com/
28. "RED/RED250/RED500," SensoMotoric Instruments. (2011) [Online]. Available: http://www.smivision.com/en/eye-gaze-trackingsystems/products/red- red250-red-500.html
29. iView X Hi-Speed. (2011) [Online]. Available: http://www.smivision. com/en/eye-gaze-tracking-systems/products/iview-x-hi-speed.html
30. "TM3 eye tracker," EyeTech Digital Systems. (2011) [Online]. Available: http://www.eyetechds.com/research/tm3-qc
31. C. M. Privitera and L. W. Stark, "Algorithms for defining visual regionsof-interest: Comparison with eye fixations," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 9, pp. 970-982, Sep. 2000.
32. G. Kootstra, B. Boer, and L. R. B. Schomaker, "Predicting eye fixations on complex visual stimuli using local symmetry," Cognit. Comput., vol. 3, no. 1, pp. 223-240, 2011.
33. Q. Zhao and C. Koch, "Learning a saliency map using fixated locations in natural scenes," J. Vis., vol. 3, no. 9, pp. 1-15, 2011.
34. R. J. Peters, A. Iyer, L. Itti, and C. Koch, "Components of bottomup gaze allocation in natural images," Vis. Res., vol. 45, no. 18, pp. 2397-2416, Aug. 2005.
35. S. Marat, T. H. Phuoc, L. Granjon, N. Guyader, D. Pellerin, and A. Guérin-Dugué, "Modelling spatio-temporal saliency to predict gaze direction for short videos," Int. J. Comput. Vis., vol. 82, no. 3, pp. 231-243, May 2009.
36. J. Cohen, P. Cohen, S. G. West, and L. S. Aiken. in Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences, 3rd ed. Mahwah, NJ: Lawrence Erlbaum Associates, 2003.
37. D. Green and J. Swets, Signal Detection Theory and Psychophysics. New York: John Wiley, 1966.
38. T. Fawcett, "An introduction to ROC analysis," Pattern Recogn. Lett., vol. 27, no. 8, pp. 861-874, 2006.
39. R. Achanta, S. Hemami, F. Estrada, and S. Süsstrunk, "Frequency-tuned salient region detection," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recogn., Jun. 2009, pp. 1597-1604.
40. X. Hou and L. Zhang, "Saliency detection: A spectral residual approach," in Proc. IEEE Int. Conf. Comput. Vis. Pattern Recogn., Jun. 2007, pp. 1-8.
41. A. Ninassi, O. L.Meur, P. L. Callet, and D. Barba, "Does where you gaze on an image affect your perception of quality applying visual attention to image quality metric," in Proc. IEEE Int. Conf. Image Process., Oct. 2007, pp. 169-172.
42. Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, "Image quality assessment: From error visibility to structural similarity," IEEE Trans. Image Process., vol. 13, no. 4, pp. 600-612, Apr. 2004.
43. H. R. Sheikh and A. C. Bovik, "Image information and visual quality," IEEE Trans. Image Process., vol. 15, no. 2, pp. 430-444, Feb. 2006.
44. H. Liu and I. Heynderickx, "Visual attention in objective image quality assessment: Based on eye-tracking data," IEEE Trans. Circuits Syst. Video Technol., vol. 21, no. 7, pp. 971-982, Jul. 2011.
45. S. Avidan and A. Shamir, "Seam carving for content-aware image resizing," ACM Trans. Graph., vol. 26, no. 3, pp. 1-9, Jul. 2007.
46. J. Stankiewicz, N. J. Anderson, and R. J. Moore, "Using performance efficiency for testing and optimization of visual attention models," in Proc. IST/SPIE Human Vis. Electron. Imag., Jan. 2011, pp. 1-7.
47. U. Engelke, A. Maeder, and H.-J. Zepernick, VAIQ: The visual attention for image quality database. (2009) [Online]. Available: http://www.bth.se/tek/ rcg.nsf/pages/vaiq-db
48. H. Liu and I. Heynderickx, TUD image quality database: Eye-tracking release 1. (2010) [Online]. Available: http://mmi.tudelft.nl/∼ingrid/ eyetracking1.html