Reduced-reference image quality assessment by structural similarity estimation

IEEE Transactions on Image Processing

Volumn 21, Issue 8, 2012, Pages 3378-3389

  Rehman, Abdul ^a   Wang, Zhou ^a  

^a UNIVERSITY OF WATERLOO   (Canada)

Author keywords

Divisive normalization transform; image deblurring; image repairing; natural image statistics; reduced reference image quality assessment (RR IQA); structural similarity

Indexed keywords

IMAGE DEBLURRING; IMAGE REPAIRING; NATURAL IMAGE STATISTICS; REDUCED-REFERENCE IMAGE QUALITY ASSESSMENTS; STRUCTURAL SIMILARITY;

DISCRETE EVENT SIMULATION; ENCODING (SYMBOLS); ESTIMATION; IMAGE ENHANCEMENT; QUALITY CONTROL;

IMAGE QUALITY;

ALGORITHM; AUTOMATED PATTERN RECOGNITION; COMPUTER ASSISTED DIAGNOSIS; IMAGE ENHANCEMENT; IMAGE SUBTRACTION; PROCEDURES; REFERENCE VALUE; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; STATISTICAL ANALYSIS; ARTICLE; METHODOLOGY;

ALGORITHMS; DATA INTERPRETATION, STATISTICAL; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED; REFERENCE VALUES; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; SUBTRACTION TECHNIQUE;

EID: 84864134076     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2012.2197011     Document Type: Article

References (62)

1. Z. Wang, A. Bovik, H. Sheikh, and E. Simoncelli, "Image quality assessment: From error visibility to structural similarity," IEEE Trans. Image Process., vol. 13, no. 4, pp. 600-612, Apr. 2004.
2. Z. Wang, E. P. Simoncelli, and A. C. Bovik, "Multiscale structural similarity for image quality assessment," in Proc. IEEE 37th Asilomar Conf. Signals, Syst., Comput., Pacific Grove, CA, Nov. 2003, pp. 1398-1402.
3. Z. Wang and Q. Li, "Information content weighting for perceptual image quality assessment," IEEE Trans. Image Process., vol. 20, no. 5, pp. 1185-1198, May 2011.
4. H. Sheikh, A. Bovik, and G. Veciana, "An information fidelity criterion for image quality assessment using natural scene statistics," IEEE Trans. Image Process., vol. 14, no. 12, pp. 2117-2128, Dec. 2005. (Pubitemid 41763727)
5. D. Chandler and S. Hemami, "VSNR: A wavelet-based visual signalto-noise ratio for natural images," IEEE Trans. Image Process., vol. 16, no. 9, pp. 2284-2298, Sep. 2007. (Pubitemid 47316675)
6. E. C. Larson and D. M. Chandler, "Most apparent distortion: Fullreference image quality assessment and the role of strategy," J. Electron. Imag., vol. 19, no. 1, pp. 011006-1-011006-21, Jan.-Mar. 2010.
7. Z. Wang and A. Bovik, "Mean squared error: Love it or leave it? A new look at signal fidelity measures," IEEE Signal Process. Mag., vol. 26, no. 1, pp. 98-117, Jan. 2009.
8. D. Brunet, E. R. Vrscay, and Z. Wang, "On the mathematical properties of the structural similarity index," IEEE Trans. Image Process., vol. 24, no. 4, pp. 1488-1499, Apr. 2012.
9. S. Wang, A. Rehman, Z. Wang, S. Ma, and W. Gao, "SSIM-motivated rate distortion optimization for video coding," IEEE Trans. Circuits Syst. Video Technol., vol. 22, no. 4, pp. 516-529, Apr. 2012.
10. S. Wang, A. Rehman, Z. Wang, S. Ma, and W. Gao, "SSIM-inspired divisive normalization for perceptual video coding," in Proc. 18th IEEE Int. Conf. Image Process., Brussels, Belgium, Sep. 2011, pp. 1657-1660.
11. Y. Gao, A. Rehman, and Z. Wang, "CW-SSIM based image classification," in Proc. 18th IEEE Int. Conf. Image Process., Brussels, Belgium, Sep. 2011, pp. 1249-1252.
12. A. Rehman and Z. Wang, "SSIM-based non-local means image denoising," in Proc. 18th IEEE Int. Conf. Image Process., Brussels, Belgium, Sep. 2011, pp. 217-220.
13. A. Rehman, Z. Wang, D. Brunet, and E. Vrscay, "SSIM-inspired image denoising using sparse representations," in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., May 2011, pp. 1121-1124.
14. Z. Wang and A. C. Bovik, Modern Image Quality Assessment. San Mateo, CA: Morgan Kauffmann, Mar. 2006.
15. H. R. Wu and M. Yuen, "A generalized block-edge impairment metric for video coding," IEEE Signal Process. Lett., vol. 4, no. 11, pp. 317-320, Nov. 1997. (Pubitemid 127554948)
16. Z. Wang, A. C. Bovik, and B. L. Evans, "Blind measurement of blocking artifacts in images," in Proc. IEEE Int. Conf. Image Process., vol. 3. Sep. 2000, pp. 981-984.
17. Z. Yu, H. R. Wu, S. Winkler, and T. Chen, "Vision-model-based impairment metric to evaluate blocking artifact in digital video," Proc. IEEE, vol. 90, no. 1, pp. 154-169, Jan. 2002. (Pubitemid 43779320)
18. Z. Wang, H. R. Sheikh, and A. C. Bovik, "No-reference perceptual quality assessment of JPEG compressed images," in Proc. IEEE Int. Conf. Image Process., Sep. 2002, pp. I-477-I-480.
19. H. R. Sheikh, A. C. Bovik, and L. Cormack, "No-reference quality assessment using natural scene statistics: JPEG2000," IEEE Trans. Image Process., vol. 14, no. 11, pp. 1918-1927, Nov. 2005. (Pubitemid 41646081)
20. P. Marziliano, F. Dufaux, S. Winkler, and T. Ebrahimi, "Perceptual blur and ringing metrics: Application to JPEG2000," Signal Process.: Image Commun., vol. 19, no. 2, pp. 163-172, 2004.
21. X. Li, "Blind image quality assessment," in Proc. IEEE Int. Conf. Image Process., vol. 1. Sep. 2002, pp. 449-452.
22. Z.Wang, H. R. Sheikh, and A. C. Bovik, "Objective video quality assessment," in The Handbook of Video Databases: Design and Applications, B. Furht and O. Marques, Eds. Boca Raton, FL: CRC Press, Sep. 2003, pp. 1041-1078.
23. Z. Wang and E. P. Simoncelli, "Reduced-reference image quality assessment using a wavelet-domain natural image statistic model," Proc. SPIE, vol. 5666, pp. 149-159, Jan. 2005. (Pubitemid 40949010)
24. Z. Wang, G. Wu, H. R. Sheikh, E. P. Simoncelli, E.-H. Yang, and A. C. Bovik, "Quality-aware images," IEEE Trans. Image Process., vol. 15, no. 6, pp. 1680-1689, Jun. 2006. (Pubitemid 43778944)
25. Q. Li and Z. Wang, "Reduced-reference image quality assessment using divisive normalization-based image representation," IEEE J. Sel. Topics Signal Process., vol. 3, no. 2, pp. 202-211, Apr. 2009.
26. S. Wolf and M. H. Pinson, "Spatio-temporal distortion metrics for inservice quality monitoring of any digital video system," Proc. SPIE, vol. 3845, pp. 266-277, 1999. (Pubitemid 30533860)
27. T. Kusuma and H.-J. Zepernick, "A reduced-reference perceptual quality metric for in-service image quality assessment," in Proc. Joint 1st Workshop Mobile Future Symp. Trends Commun., Oct. 2003, pp. 71-74.
28. I. P. Gunawan and M. Ghanbari, "Reduced reference picture quality estimation by using local harmonic amplitude information," in Proc. London Commun. Symp., Sep. 2003, pp. 137-140.
29. K. Chono, Y.-C. Lin, D. Varodayan, Y. Miyamoto, and B. Girod, "Reduced-reference image quality assessment using distributed source coding," in Proc. IEEE Int. Conf. Multimedia Exposit., Apr. 2008, pp. 609-612.
30. M. Carnec, P. Le Callet, and D. Barba, "An image quality assessment method based on perception of structural information," in Proc. IEEE Int. Conf. Image Process., vol. 3. Sep. 2003, pp. III-185-III-188.
31. M. Carnec, P. Le Callet, and D. Barba, "Visual features for image quality assessment with reduced reference," in Proc. IEEE Int. Conf. Image Process., vol. 1. Sep. 2005, pp. I-421-I-424.
32. H. B. Barlow, "Possible principles underlying the transformation of sensory messages," in Sensory Communication, W. A. Rosenblith, Ed. Cambridge, MA: MIT Press, 1961, pp. 217-234.
33. E. P. Simoncelli and B. Olshausen, "Natural image statistics and neural representation," Annu. Rev. Neurosci., vol. 24, pp. 1193-1216, May 2001. (Pubitemid 32695258)
34. M. Tagliasacchi, G. Valenzise, M. Naccari, and S. Tubaro, "A reducedreference structural similarity approximation for videos corrupted by channel errors," Multim. Tools Appl., vol. 48, no. 3, pp. 471-492, 2010.
35. D. J. Heeger, "Normalization of cell responses in cat striate cortex," Visual Neural Sci., vol. 9, no. 2, pp. 181-198, 1992.
36. E. P. Simoncelli and D. J. Heeger, "A model of neuronal responses in visual area MT," Vis. Res., vol. 38, no. 5, pp. 743-761, Mar. 1998. (Pubitemid 28081676)
37. M. J. Wainwright, "Visual adaptation as optimal information transmission," Vis. Res., vol. 39, no. 23, pp. 3960-3974, 1999. (Pubitemid 29378319)
38. J. Foley, "Human luminance pattern mechanisms: Masking experiments require a new model," J. Opt. Soc. Amer., vol. 11, no. 6, pp. 1710-1719, 1994.
39. A. B. Watson and J. A. Solomon, "Model of visual contrast gain control and pattern masking," J. Opt. Soc. Amer., vol. 14, no. 9, pp. 2379-2391, 1997. (Pubitemid 127567280)
40. M. J. Wainwright and E. P. Simoncelli, "Scale mixtures of Gaussians and the statistics of natural images," in Advanced Neural Information Processing Systems. Cambridge, MA: MIT Press, 2000, pp. 855-861.
41. Q. Li and Z. Wang, "Reduced-reference image quality assessment using divisive normalization-based image representation," IEEE J. Sel. Topics Signal Process., vol. 3, no. 2, pp. 202-211, Apr. 2009.
42. T. M. Cover and J. A. Thomas, Elements of Information Theory. New York: Wiley, 1991.
43. Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, "Image quality assessment: From error visibility to structural similarity," IEEE Trans. Image Process., vol. 13, no. 4, pp. 600-612, Apr. 2004.
44. H. R. Sheikh, Z. Wang, A. C. Bovik, and L. K. Cormack. (2006). Image and Video Quality Assessment Research at LIVE [Online]. Available: http://live.ece.utexas.edu/research/quality/
45. S. M. Weiss and N. Indurkhya, "Rule-based machine learning methods for functional prediction," J. Artif. Intell. Res., vol. 3, no. 1, pp. 383-403, 1995.
46. L. Breiman, "Random forests," Mach. Learn., vol. 45, no. 1, pp. 5-32, 2001. (Pubitemid 32933532)
47. E. P. Simoncelli, W. T. Freeman, E. H. Adelson, and D. J. Heeger, "Shiftable multiscale transforms," IEEE Trans. Inf. Theory, vol. 38, no. 2, pp. 587-607, Mar. 1992.
48. D. M. Chandler and S. S. Hemami, "VSNR: A wavelet-based visual signal-to-noise ratio for natural images," IEEE Trans. Image Process., vol. 16, no. 9, pp. 2284-2298, Sep. 2007. (Pubitemid 47316675)
49. P. Le Callet and F. Autrusseau. (2005). Subjective Quality Assessment IRCCYN/IVC Database [Online]. Available: http://www.irccyn.ecnantes. fr/ivcdb/
50. A. Ninassi, P. L. Callet, and F. Autrusseau, "Pseudo no reference image quality metric using perceptual data hiding," Proc. SPIE, vol. 6057, no. 1, pp. 60570G-1-60570G-12, 2006.
51. Y. Horita, K. Shibata, Y. Kawayoke, and Z. M. Parvez. (2010). Mict Image Quality Evaluation Database [Online]. Available: http://mict.eng.u-toyama.ac.jp/ mictdb
52. N. Ponomarenko, V. Lukin, A. Zelensky, K. Egiazarian, M. Carli, and F. Battisti, "TID2008 -A database for evaluation of full -reference visual quality assessment metrics," Adv. Modern Radioelectron., vol. 10, pp. 30-45, 2009.
53. N. Ponomarenko and K. Egiazarian. (2008). Tampere Image Database TID2008 [Online]. Available: http://www.ponomarenko.info/tid2008
54. E. C. Larson and D. M. Chandler. (2010). Categorical Image Quality (CSIQ) Database [Online]. Available: http://vision.okstate.edu/csiq
55. H. Sheikh, M. Sabir, and A. Bovik, "A statistical evaluation of recent full reference image quality assessment algorithms," IEEE Trans. Image Process., vol. 15, no. 11, pp. 3440-3451, Nov. 2006. (Pubitemid 44615139)
56. "Final report from the video quality experts group on the validation of objective models of video quality assessment," Video Quality Experts Group (VQEG), San Jose, CA, Tech. Rep. COM 9-80-E, Apr. 2000.
57. N. Ponomarenko, F. Battisti, K. Egiazarian, J. Astola, and V. Lukin, "Metrics performance comparison for color image database," in Proc. 4th Int. Workshop Video Process. Qual. Metrics Consumer Electron., Scottsdale, AZ, Jan. 2009, pp. 1-6.
58. W. Xue and X. Mou, "Reduced reference image quality assessment based on Weibull statistics," in Proc. 2nd Int. Workshop Quality Multim. Experience, Jun. 2010, pp. 1-6.
59. M. Zhang, W. Xue, and X. Mou, "Reduced reference image quality assessment based on statistics of edge," Proc. SPIE, vol. 7876, no. 1, p. 787611, Jan. 2011.
60. L. Ma, S. Li, F. Zhang, and K. N. Ngan, "Reduced-reference image quality assessment using reorganized DCT-based image representation," IEEE Trans. Multimedia, vol. 13, no. 4, pp. 824-829, Aug. 2011.
61. J. Malo, I. Epifanio, R. Navarro, and E. P. Simoncelli, "Non-linear image representation for efficient perceptual coding," IEEE Trans. Image Process., vol. 15, no. 1, pp. 68-80, Jan. 2006. (Pubitemid 43051456)
62. J. Portilla and E. P. Simoncelli, "A parametric texture model based on joint statistics of complex wavelet coefficients," Int. J. Comput. Vis., vol. 40, no. 1, pp. 49-71, Dec. 2000. (Pubitemid 32083683)