Visual attention in objective image quality assessment: Based on eye-tracking data

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 21, Issue 7, 2011, Pages 971-982

  Liu, Hantao ^a   Heynderickx, Ingrid ^a,b  

^a DELFT UNIVERSITY OF TECHNOLOGY   (Netherlands)

^b PHILIPS RESEARCH LABORATORIES   (Netherlands)

Author keywords

Eye tracking; image quality assessment; objective metric; saliency map; visual attention

Indexed keywords

EYE-TRACKING; IMAGE QUALITY ASSESSMENT; OBJECTIVE METRIC; SALIENCY MAP; VISUAL ATTENTION;

DESIGN; EXPERIMENTS; FORECASTING; IMAGE SEGMENTATION; RATING;

IMAGE QUALITY;

EID: 79960199686     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2011.2133770     Document Type: Article

References (43)

1. H. Liu and I. Heynderickx. (2010). TUD Image Quality Database: Eye-Tracking Release 1 [Online]. Available: http://mmi.tudelft.nl/iqlab/eye? tracking?1.html
2. Z. Wang and A. C. Bovik, "Modern image quality assessment," in Proc. Synthesis Lectures Image, Video, Multimedia Process., 2006, p. 156.
3. Z. Wang and A. C. Bovik, "Mean squared error: Love it or leave it? A new look at signal fidelity measures," IEEE Signal Process. Mag., vol. 26, no. 1, pp. 98-117, Jan. 2009.
4. S. Daly, "The visible difference predictor: An algorithm for the assessment of image fidelity," in Digital Images and Human Vision, A. B. Watson, Ed. Cambridge, MA: MIT Press, 1993, pp. 179-206.
5. J. Lubin, "The use of psychophysical data and models in the analysis of display system performance," in Digital Images and Human Vision, A. B. Watson, Ed. Cambridge, MA: MIT Press, 1993, pp. 163-178.
6. R. J. Safranek and J. D. Johnston, "A perceptually tuned sub-band image coder with image dependent quantization and post-quantization data compression," in Proc. IEEE Int. Conf. Acou., Speech Signal Process., May 1989, pp. 1945-1948.
7. A. B. Watson, J. Hu, and J. F. Mcgowan, "DVQ: A digital video quality metric based on human vision," J. Electron. Imag., vol. 10, no. 1, pp. 20-29, 2001. (Pubitemid 32279358)
8. H. R. Wu and M. Yuen, "A generalized block-edge impairment metric for video coding," IEEE Signal Process. Lett., vol. 4, no. 11, pp. 317-320, Nov. 1997. (Pubitemid 127554948)
9. Z. Wang, A. C. Bovik, and B. L. Evans, "Blind measurement of blocking artifacts in images," in Proc. IEEE Int. Conf. Image Process., vol. 3. Sep. 2000, pp. 981-984.
10. H. Liu and I. Heynderickx, "A perceptually relevant no-reference blockiness metric based on local image characteristics," EURASIP J. Adv. Signal Process., vol. 2009, no. 263540, pp. 1-14, 2009.
11. P. Marziliano, F. Dufaux, S. Winkler, and T. Ebrahimi, "A no-reference perceptual blur metric," in Proc. IEEE Int. Conf. Image Process., vol. 3. Sep. 2002, pp. 57-60.
12. R. Ferzli and L. J. Karam, "A no-reference objective image sharpness metric based on the notion of just noticeable blur (JNB)," IEEE Trans. Image Process., vol. 18, no. 4, pp. 717-728, Apr. 2009.
13. H. Liu, N. Klomp, and I. Heynderickx, "A no-reference metric for perceived ringing artifacts in images," IEEE Trans. Circuits Syst. Video Technol., vol. 20, no. 4, pp. 529-539, Apr. 2010.
14. Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, "Image quality assessment: From error visibility to structural similarity," IEEE Trans. Image Process., vol. 13, no. 4, pp. 600-612, Apr. 2004.
15. H. R. Sheikh and A. C. Bovik, "Image information and visual quality," IEEE Trans. Image Process., vol. 15, no. 2, pp. 430-444, Feb. 2006. (Pubitemid 43126168)
16. H. R. Sheikh, A. C. Bovik, and L. K. Cormack, "No-reference quality assessment using natural scene statistics: JPEG2000," IEEE Trans. Image Process., vol. 14, no. 11, pp. 1918-1927, Dec. 2005. (Pubitemid 41646081)
17. R. V. Babu, S. Suresh, and A. Perkis, "No-reference JPEG-image quality assessment using GAP-RBF," Signal Process., vol. 87, no. 6, pp. 1493-1503, 2007.
18. P. Gastaldo and R. Zunino, "Neural networks for the no-reference assessment of perceived quality," J. Electron. Imag., vol. 14, no. 3, pp. 1-11, 2005. (Pubitemid 41684857)
19. R. Barland and A. Saadane, "Blind quality metric using a perceptual importance map for JPEG-2000 compressed images," in Proc. IEEE Int. Conf. ICIP, Oct. 2006, pp. 2941-2944.
20. D. V. Rao, N. Sudhakar, I. R. Babu, and L. P. Reddy, "Image quality assessment complemented with visual region of interest," in Proc. Int. Conf. Comput.: Theory Applicat., 2007, pp. 681-687.
21. Q. Ma and L. Zhang, "Image quality assessment with visual attention," in Proc. ICPR, Dec. 2008, pp. 1-4.
22. N. G. Sadaka, L. J. Karam, R. Ferzli, and G. P. Abousleman, "A noreference perceptual image sharpness metric based on saliency-weighted foveal pooling," in Proc. IEEE Int. Conf. ICIP, Oct. 2008, pp. 369-372.
23. A. K. Moorthy and A. C. Bovik, "Visual importance pooling for image quality assessment," IEEE J. Select. Topics Signal Process. (Special Issue on Visual Media Quality Assessment), vol. 3, no. 2, pp. 193-201, Apr. 2009.
24. L. Itti, C. Koch, and E. Niebur, "A model of saliency-based visual attention for rapid scene analysis," IEEE Trans. Patt. Anal. Mach. Intell., vol. 20, no. 11, pp. 1254-1259, Nov. 1998. (Pubitemid 128742001)
25. U. Rajashekar, A. C. Bovik, and L. K. Cormack, "Gaffe: A gaze-attentive fixation finding engine," IEEE Trans. Image Process., vol. 17, no. 4, pp. 564-573, Apr. 2008. (Pubitemid 351493879)
26. A. L. Yarbus, Eye Movements and Vision. New York: Plenum Press, 1967.
27. A. Ninassi, O. L. Meur, P. L. Callet, and D. Barba, "Does where you gaze on an image affect your perception of quality? Applying visual attention to image quality metric," in Proc. IEEE Int. Conf. ICIP, Oct. 2007, pp. 169-172.
28. Methodology for the Subjective Assessment of the Quality of Television Pictures, document ITU-R Rec. BT.500-11, International Telecommunication Union, Geneva, Switzerland, 2002.
29. C. T. Vu, E. C. Larson, and D. M. Chandler, "Visual fixation patterns when judging image quality: Effects of distortion type, amount, and subject experience," in Proc. IEEE SSIAI, Mar. 2008, pp. 73-76.
30. E. C. Larson, C. T. Vu, and D. M. Chandler, "Can visual fixation patterns improve image fidelity assessment?" in Proc. Int. Conf. Image Process., Oct. 2008, pp. 2572-2575.
31. U. Engelke and H.-J. Zepernick, "Framework for optimal region of interest-based quality assessment in wireless imaging," J. Electron. Imag., vol. 19, no. 1, article 011005, 2010.
32. N. Ouerhani, R. V. Wartburg, H. Hugli, and R. Muri, "Empirical validation of the saliency-based model of visual attention," Electron. Lett. Comput. Vision Image Anal., vol. 3, no. 1, pp. 13-24, 2004.
33. D. D. Salvucci, "A model of eye movements and visual attention," in Proc. 3rd Int. Conf. Cognit. Model., 2000, pp. 252-259.
34. C. Privitera and L. Stark, "Algorithms for defining visual regions-ofinterest: Comparison with eye fixations," Patt. Anal. Mach. Intell., vol. 22, no. 9, pp. 970-981, 2000.
35. H. R. Sheikh, Z. Wang, L. Cormack, and A. C. Bovik. LIVE Image Quality Assessment Database Release 2 [Online]. Available: http://live.ece.utexas.edu/ research/quality
36. New Delft Experience Lab [Online]. Available: http://mmi.tudelft.nl/ experiencelab
37. H. Alers, J. Redi, H. Liu, and I. Heynderickx, "Task effects on saliency: Comparing attention behavior for free-looking and quality-assessment tasks," to be published.
38. Video Quality Experts Group. Final Report from the Video Quality Experts Group on the Validation of Objective Models of Video Quality Assessment Phase II [Online]. Available: http://www.vqeg.org
39. S. Winkler, "Vision models and quality metrics for image processing applications," Ph.D. dissertation, Dept. Elect., ́ Ecole Polytechnique F́ed́erale de Lausanne, Lausanne, Switzerland, 2002.
40. H. R. Sheikh, M. F. Sabir, and A. C. Bovik, "A statistical evaluation of recent full reference image quality assessment algorithms," IEEE Trans. Image Process., vol. 15, no. 11, pp. 3440-3451, Nov. 2006. (Pubitemid 44615139)
41. D. C. Montgomery and G. C. Runger, Applied Statistics and Probability for Engineers. New York: Wiley-Interscience, 1999.
42. J. Redi, H. Liu, P. Gastaldo, R. Zunino, and I. Heynderickx, "How to apply spatial saliency into objective metrics for JPEG compressed images?" in Proc. IEEE Int. Conf. Image Process., Nov. 2009, pp. 961-964.
43. U. Engelke, H. Liu, H.-J. Zepernick, I. Heynderickx, and A. Maeder, "Comparing two eye-tracking databases: The effect of experimental setup and image presentation time on the creation of saliency maps," in Proc. Picture Coding Sym., 2010, pp. 282-285.