Information content weighting for perceptual image quality assessment

IEEE Transactions on Image Processing

Volumn 20, Issue 5, 2011, Pages 1185-1198

  Wang, Zhou ^a   Li, Qiang ^b  

^a UNIVERSITY OF WATERLOO   (Canada)

^b Media Excel Inc   (United States)

Author keywords

Gaussian scale mixture (GSM); image quality assessment (IQA); information content measure; peak signal to noise ratio (PSNR); pooling; statistical image modeling; structural similarity (SSIM)

Indexed keywords

GAUSSIAN SCALE MIXTURES; IMAGE QUALITY ASSESSMENT (IQA); INFORMATION CONTENT MEASURE; PEAK SIGNAL-TO-NOISE-RATIO (PSNR); POOLING; STATISTICAL IMAGE MODELING; STRUCTURAL SIMILARITY;

ALGORITHMS; RATING; SIGNAL TO NOISE RATIO;

IMAGE QUALITY;

ALGORITHM; ARTICLE; BIOMIMETICS; HUMAN; IMAGE ENHANCEMENT; INFORMATION RETRIEVAL; METHODOLOGY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY;

ALGORITHMS; BIOMIMETICS; HUMANS; IMAGE ENHANCEMENT; INFORMATION STORAGE AND RETRIEVAL; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY;

EID: 79955428601     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2010.2092435     Document Type: Article

References (60)

1. T. N. Pappas, R. J. Safranek, and J. Chen, , A. Bovik, Ed., "Perceptual criteria for image quality evaluation," in Handbook of Image and Video Proc., 2nd ed. New York: Academic, 2005.
2. , H. R. Wu and K. R. Rao, Eds., Digital Video Image Quality and Perceptual Coding. Boca Raton, FL: CRC Press, 2005.
3. Z. Wang and A. C. Bovik, Modern Image Quality Assessment. San Rafael, CA: Morgan & Claypool Publishers, Mar. 2006.
4. Z. Wang and A. C. Bovik, "A universal image quality index," IEEE Signal Process. Lett., vol. 9, no. 3, pp. 81-84, Mar. 2002. (Pubitemid 34554870)
5. Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, "Image quality assessment: From error visibility to structural similarity," IEEE Trans. Image Processing, vol. 13, no. 4, pp. 600-612, Apr. 2004.
6. A. B. Watson, "DCTune: A technique for visual optimization of DCT quantization matrices for individual images," in Proc. Soc. Inf. Display Dig. Tech. Papers, 1993, vol. XXIV, pp. 946-949.
7. R. J. Safranek and J. D. Johnston, "A perceptually tuned sub-band image coder with image dependent quantization and post-quantization data compression," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., May 1989, pp. 1945-1948.
8. S. Daly, , A. B. Watson, Ed., "The visible difference predictor: An algorithm for the assessment of image fidelity," in Digital Images and Human Vision. Cambridge, MA: MIT Press, 1993, pp. 179-206.
9. J. Lubin, , A. B. Watson, Ed., "The use of psychophysical data and models in the analysis of display system performance," in Digital Images and Human Vision. Cambridge, MA: MIT Press, 1993, pp. 163-178.
10. P. C. Teo and D. J. Heeger, "Perceptual image distortion," in Proc. IEEE Int. Conf. Image Process., 1994, pp. 982-986.
11. A. B.Watson, G. Y. Yang, J. A. Solomon, and J. Villasenor, "Visibility of wavelet quantization noise," IEEE Trans. Image Process., vol. 6, no. 8, pp. 1164-1175, Aug. 1997. (Pubitemid 127768411)
12. B. A. Wandell, Sinauer Associates, Inc., Foundations of Vision 1995.
13. Z.Wang and X. Shang, "Spatial pooling strategies for perceptual image quality assessment," in Proc. IEEE Int. Conf. Image Process., Atlanta, GA, Oct. 2006, pp. 2945-2948.
14. E. C. Larson and D. M. Chandler, "Unveiling relationships between regions of interest and image fidelity metrics," Proc. SPIE Vis. Commun. Image Process., vol. 6822, pp. 6822A1-16, Jan. 2008.
15. E. C. Larson, C. T. Vu, and D. M. Chandler, "Can visual fixation patterns improve image fidelity assessment?," in Proc. IEEE Int. Conf. Image Process., Oct. 2008, vol. 3, pp. 2572-2575.
16. U. Engelke, V. X. Nguyen, and H.-J. Zepernick, "Regional attention to structural degradations for perceptual image quality metric design," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Mar.-Apr. 2008, pp. 869-872.
17. E. C. Larson and D. M. Chandler, "Most apparent distortion: Full-reference image quality assessment and the role of strategy," J. Electron. Imag., vol. 19, pp. 011006:1-011006:21, Jan.-Mar. 2010.
18. S. Wolf and M. H. Pinson, "Spatio-temporal distortion metrics for in-service quality monitoring of any digital video system," Proc. SPIE, vol. 3845, pp. 266-277, 1999. (Pubitemid 30533860)
19. A. K. Moorthy and A. C. Bovik, "Visual importance pooling for image quality assessment," IEEE J. Sel. Topics Signal Process., vol. 3, no. 2, pp. 193-201, Apr. 2009.
20. E. Peli, "Contrast in complex images," J. Opt. Soc. Amer., vol. 7, pp. 2032-2040, Oct. 1990.
21. L. Itti, C.Koch, and E. Niebur, "A model of saliency-based visual attention for rapid scene analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 11, pp. 1254-1259, Nov. 1998. (Pubitemid 128742001)
22. E. Peli, "Feature detection algorithm based on a visual system model," Proc. IEEE, vol. 90, no. 1, pp. 78-93, Jan. 2001.
23. A. Ninassi, O. L. Meur, P. L. Callet, and D. Barbba, "Does where you gaze on an image affect your preception of quality? applying visual attention to image quality metric," in Proc. IEEE Int. Conf. Image Process., Apr. 2007, vol. 2, pp. 169-172.
24. U. Rajashekar, A. C. Bovik, and L. K. Cormack, "Gaffe: A gaze-attention fixation finding engine," IEEE Trans. Image Process., vol. 17, no. 4, pp. 564-573, Apr. 2008. (Pubitemid 351493879)
25. Z. Wang, L. Lu, and A. C. Bovik, "Video quality assessment based on structural distortion measurement," Signal Process.: Image Commun., vol. 19, Special Issue on ObjectiveVideo Quality Metrics, pp. 121-132, Feb. 2004.
26. Z. K. Lu, W. Lin, X. K. Yang, E. P. Ong, and S. S. Yao, "Modeling visual attention's modulatory afterreffects on visual sensitivity and quality evaluation," IEEE Trans. Image Process., vol. 14, no. 11, pp. 1928-1942, Nov. 2005. (Pubitemid 41655695)
27. Z.Wang and Q. Li, "Video quality assessment using a statistical model of human visual speed perception," J. Opt. Soc. Amer. A, vol. 24, pp. B61-B69, Dec. 2007. (Pubitemid 351325125)
28. W. Osberger, N. Bergmann, and A. Maeder, "An automatic image quality assessment technique incorporating high level perceptual factors," in Proc. IEEE Int. Conf. Image Process., 1998, pp. 414-418.
29. Z. Wang and A. C. Bovik, "Embedded foveation image coding," IEEE Trans. Image Process., vol. 10, no. 10, pp. 1397-1410, Oct. 2001. (Pubitemid 32981815)
30. S. Lee, M. S. Pattichis, and A. C. Bovik, "Foveated video quality assessment," IEEE Trans. Multimedia, vol. 4, no. 3, pp. 129-132, Mar. 2002. (Pubitemid 34291535)
31. Z. Wang, L. Lu, and A. C. Bovik, "Foveation scalable video coding with automatic fixation selection," IEEE Trans. Image Process., vol. 12, no. 2, pp. 243-254, Feb. 2003.
32. E. P. Simoncelli and B. Olshausen, "Natural image statistics and neural representation," Annu. Rev. Neurosci., vol. 24, pp. 1193-1216, May 2001. (Pubitemid 32695258)
33. J. Najemnik and W. S. Geisler, "Optimal eye movement strategies in visual search," Nature, no. 434, pp. 387-391, 2005. (Pubitemid 40469182)
34. H. R. Sheikh and A. C. Bovik, "Image information and visual quality," IEEE Trans. Image Process., vol. 15, no. 2, pp. 430-444, Feb. 2006. (Pubitemid 43126168)
35. A. A. Stocker and E. P. Simoncelli, "Noise characteristics and prior expectations in human visual speed perception," Nature Neurosci., vol. 9, pp. 578-585, 2006.
36. J. Portilla, V. Strela, M. J. Wainwright, and E. P. Simoncelli, "Image denoising using scale mixtures of Gaussians in the wavelet domain," IEEE Trans. Image Process., vol. 12, no. 11, pp. 1338-1351, Nov. 2003.
37. H. R. Sheikh, A. C. Bovik, and G. de Veciana, "An information fidelity criterion for image quality assessment using natural scene statistics," IEEE Trans. Image Process., vol. 14, no. 12, pp. 2117-2128, Dec. 2005. (Pubitemid 41763727)
38. Q. Li and Z. Wang, "Reduced-reference image quality assessment using divisive normalization-based image representation," IEEE J. Sel. Topics Signal Process., vol. 3, no. 2, pp. 202-211, Apr. 2009.
39. M. J. Wainwright and E. P. Simoncelli, "Scale mixtures of Gaussians and the statistics of natural images," Adv. Neural Inf. Process. Syst., vol. 12, pp. 855-861, 2000.
40. P. J. Burt and E. H. Adelson, "The Laplacian pyramid as a compact image code," IEEE Trans. Commun., vol. COMM-31, no. 4, pp. 532-540, Apr. 1983.
41. T. M. Cover and J. A. Thomas, Elements of Information Theory. Hoboken, NJ: Wiley, 1991.
42. Z. Wang, E. P. Simoncelli, and A. C. Bovik, "Multi-scale structural similarity for image quality assessment," in Proc. IEEE Asilomar Conf. Signals, Syst., Comput., Pacific Grove, CA, Nov. 2003, pp. 1398-1402.
43. Z.Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, "The SSIM index for image quality assessment," [Online]. Available: http://www.cns.nyu.edu/~lcv/ssim/
44. D. M. Chandler and S. S. Hemami, "VSNR: A wavelet-based visual signal-to-noise-ratio for natural images," IEEE Trans. Image Process., vol. 16, no. 9, pp. 2284-2298, Sep. 2007. (Pubitemid 47316675)
45. N. Ponomarenko, F. Silvestri, K. Egiazarian, M. Carli, J. Astola, and V. Lukin, "On between-coefficient contrast masking of dct basis functions," in Proc. 3rd Int. Workshop Video Process. Quality Metrics Consum. Electron., Scottsdale, AZ, Jan. 2007.
46. H. R. Sheikh, K. Seshadrinathan, A. K. Moorthy, Z.Wang, A. C. Bovik, and L. K. Cormack, "Image and video quality assessment research at LIVE," [Online].Available: http://live.ece.utexas.edu/research/quality/
47. M. Gaubatz and S. S. Hemami, "MeTriX MuX visual quality assessment package," [Online]. Available: http://foulard.ece.cornell.edu/gaubatz/ metrix-mux/
48. N. Ponomarenko, "PSNR-HVS-M download page," [Online]. Available: http://www.ponomarenko.info/psnrhvsm.htm
49. E. C. Larson and D. M. Chandler, "Full-reference image quality assessment and the role of strategy: The most apparent distortion," [Online]. Available: http://vision.okstate.edu/mad
50. D. Walther and C. Koch, "Saliency toolbox," [Online]. Available: http://www.saliencytoolbox.net/
51. D.Walther and C. Koch, "Modeling attention to salient proto-objects," vol. 19, pp. 1395-1407, 2006.
52. D. M. Chandler and S. S. Hemami, "VSNR: A wavelet-based visual signal-to-noise ratio for natural images," [Online]. Available: http://foulard.ece.cornell.edu/dmc27/vsnr/vsnr.html
53. A. Ninassi, P. Le Callet, and F. Autrusseau, "Pseudo no reference image quality metric using perceptual data hiding," in Proc. SPIE: Human Vis. Electron. Imag., San Jose, CA, Jan. 2006, vol. 6057.
54. A. Ninassi, P. Le Callet, and F. Autrusseau, "Subjective quality assessment-IVC database," [Online]. Available: http://www2.irccyn.ec- nantes.fr/ivcdb
55. Y. Horita, K. Shibata, Y. Kawayoke, and Z. M. P. Sazzad, "MICT image quality evaluation database," [Online]. Available: http://mict.eng.u- toyama.ac.jp/mict/index2.html
56. N. Ponomarenko, F. Battisti, K. Egiazarian, J. Astola, and V. Lukin, "Metrics performance comparison for color image database," in Proc. 4th Int. Workshop Video Process. Quality Metrics Consum. Electron., Scottsdale, AZ, Jan. 2009.
57. N. Ponomarenko and K. Egiazarian, "Tampere image database 2008 TID2008," [Online]. Available: http://www.ponomarenko.info/tid2008.htm
58. E. C. Larson and D. M. Chandler, "Categorical image quality (CSIQ) database," [Online]. Available: http://vision.okstate.edu/csiq
59. VQEG, "Final report from the video quality experts group on the validation of objective models of video quality assessment," Apr. 2000, available at [Online]. Available: http://www.vqeg.org/
60. H. R. Sheikh, M. F. Sabir, and A. C. Bovik, "A statistical evaluation of recent full reference image quality assessment algorithms," IEEE Trans. Image Process., vol. 15, no. 11, pp. 3440-3451, Nov. 2006. (Pubitemid 44615139)