Automatic prediction of perceptual image and video quality

Proceedings of the IEEE

Volumn 101, Issue 9, 2013, Pages 2008-2024

  Bovik, Alan Conrad ^a  

^a The University of Texas at Austin   (United States)

Author keywords

Digital photography; image quality; objective quality; video quality; visual perception; wireless spectrum crunch

Indexed keywords

IMAGE QUALITY; VISUAL COMMUNICATION;

AUTOMATIC PREDICTION; DIGITAL PHOTOGRAPHY; MONITOR AND CONTROL; OBJECTIVE QUALITIES; PERCEPTUAL QUALITY; QUALITY ASSESSMENT; VIDEO QUALITY; VISUAL PERCEPTION;

VISION;

EID: 84883054379     PISSN: 00189219     EISSN: None     Source Type: Journal    
DOI: 10.1109/JPROC.2013.2257632     Document Type: Article

References (170)

1. "Image obsessed," Nat. Geographic, vol. 221, p. 35, Apr. 2012.
2. D. Hardawar, "Netflix now accounts for 25% of North American Internet traffic," VentureBeat, May 17, 2011. [Online]. Available: http://venturebeat.com/2011/05/17/netflix-north-america-traffi/.
3. Cisco Corporation, Cisco Visual Networking Index: Global mobile data traffic forecast update, 2010-2015, 2011. [Online]. Available: http://www.cisco.com/en/US/solutions/collateral/ns341/ns525/ns537/ns705/ns827/ white 520862.html.
4. T. S. Rappaport, J. N. Murdock, and F. Gutierrez, "State of the art in 60-GHz integrated circuits and systems for wireless communications," Proc. IEEE, vol. 99, no. 8, pp. 1390-1436, Aug. 2011.
5. V. Chandrasekhar, J. G. Andrews, and A. Gatherer, "Femtocell networks: A survey," IEEE Commun. Mag., vol. 46, no. 9, pp. 59-67, Sep. 2008.
6. F. Crick and C. Koch, "Towards a neurobiological theory of consciousness," Seminars Neurosci., vol. 2, pp. 263-275, 1990.
7. J. G. Apostolopoulos, P. A. Chou, B. Culbertson, T. Kalker, M. D. Trott, and S. Wee, "The road to immersive communication," Proc. IEEE, vol. 100, no. 4, pp. 974-990, Apr. 2012.
8. X. Cao, A. C. Bovik, and Y. Wang, "Converting 2D video to 3D: An efficient path to a 3D experience," IEEE Multimedia, vol. 18, no. 4, pp. 12-17, Apr. 2011.
9. M. Tanimoto, M. P. Tehrani, T. Fujii, and T. Yendo, "FTV for 3-D spatial communication," Proc. IEEE, vol. 100, no. 4, pp. 905-917, Apr. 2012.
10. E. P. Simoncelli, "Capturing visual image properties with probabilistic models," in The Essential Guide to Image Processing, A. C. Bovik, Ed. New York, NY, USA: Academic, 2009.
11. B. Mandelbrot, The Fractal Geometry of Nature. San Francisco, CA, USA: Freeman, 1982.
12. D. J. Tolhurst, Y. Tadmoor, and T. Chao, "Amplitude spectra of natural images," Opthalmic. Physiol. Opt., vol. 12, pp. 229-232, 1992.
13. A. J. Bell and T. J. Sejnowski, "The 'independent components' of natural images are edge filters," Vis. Res., vol. 37, pp. 3327-3338, Dec. 1997. (Pubitemid 27493806)
14. D. L. Ruderman, "The statistics of natural images," Netw. Comput. Neural Syst., vol. 5, no. 4, pp. 517-548, 1994.
15. D. L. Ruderman and W. Bialek, "Statistics of natural images: Scaling in the woods," Phys. Rev. Lett., vol. 73, pp. 814-817, 1994. (Pubitemid 24976330)
16. J. Portilla, V. Strela, M. J. Wainwright, and E. P. Simoncelli, "Image denoising using a scale mixture of Gaussians in the wavelet domain," IEEE Trans. Image Process., vol. 12, no. 11, pp. 1338-1351, Nov. 2003.
17. H. Sheikh and A. C. Bovik, "Image information and visual quality," IEEE Trans. Image Process., vol. 15, no. 2, pp. 430-444, Feb. 2006. (Pubitemid 43126168)
18. S. G. Mallat, "A theory for multiresolution signal decomposition: The wavelet representation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 11, no. 7, pp. 674-693, Jul. 1989.
19. E. P. Simoncelli, E. H. Adelson, and D. J. Heeger, "Probability distributions of optical flow," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., Maui, HI, USA, Jun. 1991, pp. 310-315.
20. D. Calow, N. Kruger, F. Worgotter, and M. Lappe, "Statistics of optic flow for self-motion through natural scenes," in Dynamic Perception, U. Ilg, H. Bulthoff, and H. Mallot, Eds. St. Augustin, Germany: Infix Verlag, 2004, pp. 133-138.
21. S. Roth and M. Black, "On the spatial statistics of optical flow," Int. J. Comput. Vis., vol. 74, no. 1, pp. 33-50, Jan. 2007. (Pubitemid 46673102)
22. K. Seshadrinathan and A. C. Bovik, "A structural similarity metric for video based on motion models," in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., Honolulu, HI, USA, Apr. 2007, vol. 1, pp. 869-872.
23. D. W. Dong and J. J. Atick, "Statistics of natural time-varying images," Netw., Comput. Neural Syst., vol. 6, pp. 345-358, 1995.
24. R. Soundararajan and A. C. Bovik, "Video quality assessment by reduced reference spatio-temporal entropic differencing," IEEE Trans. Circuits Syst. Video Technol., vol. 23, no. 4, pp. 684-694, Apr. 2012.
25. M. Carandini, J. B. Demb, V. Mante, D. J. Tolhurst, Y. Dan, B. A. Olshausen, J. L. Gallant, and N. C. Rust, "Do we know what the early visual system does?" J. Neurosci., vol. 25, no. 46, pp. 10577-10597, Nov. 2005. (Pubitemid 41681906)
26. A. K. Moorthy and A. C. Bovik, "Visual importance pooling for image quality assessment," IEEE J. Sel. Top. Signal Process., vol. 3, no. 2, pp. 193-201, Apr. 2009.
27. D. J. Field, "Relations between the statistics of natural images and the response properties of cortical cells," J. Opt. Soc. Amer. A, vol. 4, pp. 2379-2394, 1987.
28. B. A. Olshausen and D. J. Field, "Sparse coding with an overcomplete basis set: A strategy employed by V1?" Vis. Res., vol. 37, no. 23, pp. 331-3325, 1997.
29. H. K. Hartline and F. Ratliff, "Inhibitory interactions in the retina of Limulus," in Handbook of Sensory Physiology, vol. 7, M. G. Fuortes, Ed. Berlin, Germany: Springer-Verlag, 1972, pp. 381-447.
30. M. V. Srinivasan, S. B. Laughlin, and A. Dubs, "Predictive coding: A fresh view of inhibition in the retina," Proc. Roy. Soc. Lond. B, vol. 216, no. 1205, pp. 427-459, Nov. 1982. (Pubitemid 13218774)
31. B. A. Olshausen and D. J. Field, "How close are we to understanding V1?" Neural Comput., vol. 17, pp. 1665-1699, 2005. (Pubitemid 40864606)
32. J. G. Daugman, "Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters," J. Opt. Soc. Amer., vol. 2, no. 7, pp. 1160-1169, Jul. 1985.
33. A. C. Bovik, M. Clark, and W. S. Geisler, "Multichannel texture analysis using localized spatial filters," IEEE Trans. Pattern Anal. Mach. Intell., vol. 12, no. 1, pp. 55-73, Jan. 1990. (Pubitemid 20653599)
34. L. Wiskott, J. M. Fellous, N. Kruger, and C. V. Malsburg, "Face recognition by elastic bunch graph matching," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 7, pp. 775-779, Jul. 1997. (Pubitemid 127762270)
35. B. S. Manjunath and W. Y. Ma, "Texture features for browsing and retrieval of image data," IEEE Trans. Pattern Anal. Mach. Intell., vol. 18, no. 8, pp. 837-842, Aug. 1996. (Pubitemid 126772825)
36. S. E. Palmer, Vision Science. Cambridge, MA, USA: MIT Press, 1999.
37. D. Chen and A. C. Bovik, "Visual pattern image coding," IEEE Trans. Commun., vol. 38, no. 12, pp. 2137-2146, Dec. 1990.
38. J. Shen, "On the foundations of vision modeling I. Weber's law and Weberized TV (total variation) restoration," Physica D, Nonlinear Phenomena, vol. 175, no. 3-4, pp. 241-251, 2003.
39. D. A. Pollen and S. F. Ronner, "Phase relationships between adjacent simple cells in the visual cortex," Science, vol. 212, no. 4501, pp. 1409-1411, Jun. 1981. (Pubitemid 11033005)
40. D. J. Heeger, "Normalization of cell responses in cat striate cortex," Vis. Neurosci., vol. 9, no. 2, pp. 181-198, Feb. 1992.
41. Z. Wang and A. C. Bovik, "Reduced and no-reference image quality assessment," IEEE Signal Process. Mag., vol. 28, no. 6, pp. 29-40, Nov. 2011.
42. G. E. Legge and J. M. Foley, "Contrast masking in human vision," J. Opt. Soc. Amer., vol. 70, no. 12, pp. 1458-1470, Dec. 1980.
43. D. J. Sakrison and J. L. Mannos, "The effects of a visual fidelity criterion on the encoding of images," IEEE Trans. Inf. Theory, vol. IT-20, no. 4, pp. 525-536, Jul. 1974.
44. A. N. Netravali and B. Prasada, "Adaptive quantization of picture signals using spatial masking," Proc. IEEE, vol. 65, no. 4, pp. 536-548, Apr. 1977.
45. M. D. Swanson, B. Zhu, and A. H. Tewfik, "Multiresolution scene-based watermarking using perceptual models," J. Sel. Areas Commun., vol. 16, no. 4, pp. 540-550, May 1998. (Pubitemid 128564972)
46. D. W. Dong and J. J. Atick, "Temporal decorrelation: A theory of lagged and nonlagged responses in the lateral geniculate nucleus," Netw., Comput. Neural Syst., vol. 6, no. 2, pp. 159-178, Feb. 1995.
47. R. D. Kell, "Improvements related to electric picture transmission systems," U.S. Patent 341 811, 1931.
48. A. B. Watson and A. J. Ahumada, Jr., "Model of human visual-motion sensing," J. Opt. Soc. Amer. A., vol. 2, no. 2, pp. 322-342, Feb. 1985.
49. E. H. Adelson and J. R. Bergen, "Spatiotemporal energy models for the perception of motion," J. Opt. Soc. Amer. A., vol. 2, no. 2, pp. 284-299, Feb. 1985.
50. D. J. Heeger, E. P. Simoncelli, and J. A. Movshon, "Computational models of cortical visual perception," Proc. Nat. Acad. Sci., vol. 93, pp. 623-627, Jan. 1996. (Pubitemid 26041138)
51. E. P. Simoncell and D. J. Heeger, "A model of neuronal responses in visual area MT," Vis. Res., vol. 38, no. 5, pp. 743-761, 1998. (Pubitemid 28081676)
52. K. Seshadrinathan and A. C. Bovik, "Motion-tuned spatio-temporal quality assessment of natural videos," IEEE Trans. Image Process., vol. 19, no. 2, pp. 335-350, Feb. 2010.
53. B. Girod, "Information theoretical significance of spatial and temporal masking in video signals," Proc. SPIEVInt. Soc. Opt. Eng., vol. 1077, pp. 178-187, 1989.
54. J. W. Suchow and G. A. Alvarez, "Motion silences awareness of visual change," Current Biol., vol. 21, pp. 140-143, Jan. 2011.
55. D. Burr and P. Thompson, "Motion psychophysics: 1985-2010," Vis. Res., vol. 51, pp. 1431-1456, 2011.
56. L. K. Choi, A. C. Bovik, and L. K. Cormack, "A flicker detector model of the motion silencing illusion," presented at the Annu. Meeting Vis. Sci. Soc., Naples, FL, May 2012.
57. Z. Wang, A. C. Bovik, and B. Evans, "Blind measurement of blocking artifacts in images," in Proc. IEEE Int. Conf. Image Process., Vancouver, BC, Canada, Sep. 2000, vol. 3, pp. 981-984.
58. A. C. Bovik and S. Liu, "DCT-domain blind measurement of blocking artifacts in DCT-coded images," in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., Salt Lake City, UT, USA, May 2001, vol. 3, pp. 1725-1728. (Pubitemid 32838936)
59. L. Meesters and J. Martens, "A single-ended blockiness measure for JPEG-coded images," Signal Process., vol. 82, pp. 369-387, 2002. (Pubitemid 34284649)
60. S. Liu and A. C. Bovik, "Efficient DCT-domain blind measurement and reduction of blocking artifacts," IEEE Trans. Circuits Syst. Video Technol., vol. 12, no. 12, pp. 1139-1149, Dec. 2002.
61. F. Pan, X. Lin, S. Rahardja, W. Lin, E. Ong, S. Yao, Z. Lu, and X. Yang, "A locally adaptive algorithm for measuring blocking artifacts in images and videos," Signal Process., Image Commun., vol. 19, no. 6, pp. 499-506, Jun. 2004.
62. X. Feng and J. P. Allebach, "Measurement of ringing artifacts in JPEG images," Proc. SPIEVInt. Soc. Opt. Eng., vol. 6076, Feb. 2006, DOI: 10.1117/12.645089.
63. P. Marziliano, F. Dufaux, S. Winkler, and T. Ebrahimi, "A no-reference perceptual blur metric," in Proc. IEEE Int. Conf. Image Process., Rochester, NY, USA, Sep. 2002, vol. 3, pp. 57-60.
64. E. Ong, W. Lin, Z. Lu, X. Yang, S. Yao, F. Pan, L. Jiang, and F. Moschetti, "A no-reference quality metric for measuring image blur," in Proc. Int. Symp. Signal Process. Appl., Paris, France, Jul. 2003, vol. 1, pp. 469-472.
65. R. Ferzli and L. Karam, "Human visual system based no-reference objective image sharpness metric," in Proc. IEEE Int. Conf. Image Process., Atlanta, GA, USA, Oct. 2006, pp. 2949-2952.
66. R. Ferzli and L. Karam, "A no-reference objective image sharpness metric based on the notion of just noticeable blur (JNB)," IEEE Trans. Image Process., vol. 18, no. 4, p. 717, Apr. 2009.
67. X. Zhu and P. Milanfar, "A no-reference sharpness metric sensitive to blur and noise," in Proc. 1st Int. Workshop Quality Multimedia Experience, San Diego, CA, USA, Jul. 2009, pp. 64-69.
68. M. Farias, M. Moore, J. Foley, and S. Mitra, "Perceptual contributions of blocky, blurry, and fuzzy impairments to overall annoyance," Proc. SPIEVInt. Soc. Opt. Eng., vol. 5292, pp. 109-120, Jun. 2004.
69. M. F. Sabir, R. W. Heath, and A. C. Bovik, "Joint source-channel distortion modeling for MPEG-4 video," IEEE Trans. Image Process., vol. 18, no. 1, pp. 90-105, Jan. 2009.
70. A. K. Moorthy and A. C. Bovik, "Statistics of natural image distortions," in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., Dallas, TX, USA, Mar. 2010, pp. 962-965.
71. Z. Wang and E. P. Simoncelli, "Reduced-reference image quality assessment using a wavelet domain natural image statistic model," Proc. SPIEVInt. Soc. Opt. Eng., vol. 5666, pp. 149-159, Jan. 2005. (Pubitemid 40949010)
72. A. K. Moorthy and A. C. Bovik, "Blind image quality assessment: From natural scene statistics to perceptual quality," IEEE Trans. Image Process., vol. 20, no. 12, pp. 3350-3364, Dec. 2011.
73. A. Mittal, A. K. Moorthy, and A. C. Bovik, "Blind/referenceless spatial image quality evaluator," in Proc. Annu. Asilomar Conf. Signals Syst. Comput., Monterey, CA, USA, Nov. 2011, pp. 723-727.
74. A. H. Nuttall, "Accurate efficient evaluation of cumulative or exceedance probability distributions directly from characteristic functions," NUSC, Tech. Rep. 7023., Oct. 1983.
75. A. Mittal, A. K. Moorthy, and A. C. Bovik, "No-reference image quality assessment in the spatial domain," IEEE Trans. Image Process., vol. 21, no. 12, pp. 4695-4708, Dec. 2012.
76. W. Lin and C.-C. Kuo, "Perceptual visual quality metrics: A survey," J. Vis. Commun. Image Representation., vol. 22, no. 4, pp. 297-312, Apr. 2011.
77. K. Seshadrinathan and A. C. Bovik, "Automatic prediction of perceptual quality of multimedia signalsVA survey," Int. J. Multimedia Tools Appl., vol. 51, no. 1, pp. 163-186, Jan. 2011.
78. K. Seshadrinathan, T. N. Pappas, R. J. Safranek, J. Chen, Z. Wang, H. R. Sheikh, and A. C. Bovik, "Image quality assessment," in The Essential Guide to Image Processing, A. C. Bovik, Ed. New York, NY, USA: Elsevier, 2009.
79. K. Seshadrinathan and A. C. Bovik, "Video quality assessment," in The Essential Guide to Video Processing, A. C. Bovik, Ed. New York, NY, USA: Elsevier, 2009.
80. S. Winkler, Digital Video Quality: Vision Models and Metrics. Hoboken, NJ, USA: Wiley, Mar. 2005.
81. Z. Wang and A. C. Bovik, Modern Image Quality Assessment. New York, NY, USA: Morgan & Claypool, 2006.
82. H. R. Sheikh, M. F. Sabir, and A. C. Bovik, "An evaluation of recent full reference image quality assessment algorithms," IEEE Trans. Image Process., vol. 15, no. 11, pp. 3440-3451, Nov. 2006. (Pubitemid 44615139)
83. N. Ponomarenko, V. Lukin, A. Zelensky, K. Egiazarian, M. Carli, and F. Battisti, "TID2008VA database for evaluation of full-reference visual quality assessment metrics," Adv. Modern Radioelectron., vol. 10, pp. 30-45, 2009.
84. K. Seshadrinathan, R. Soundararajan, A. C. Bovik, and L. K. Cormack, "Study of subjective and objective quality assessment of video," IEEE Trans. Image Process., vol. 19, no. 6, pp. 1427-1441, Jun. 2010.
85. MeTriX MuX Visual Quality Assessment Package. [Online]. Available: http://foulard. ece.cornell.edu/gaubatz/metrix-mux/.
86. H. R. Sheikh, Z. Wang, A. C. Bovik, and L. K. Cormack, "Image and video quality assessment research at LIVE." [Online]. Available: http://live.ece.utexas.edu/research/quality/.
87. Z. Wang and A. C. Bovik, "Mean-squared error: Love it or leave it? A New look at signal fidelity measures," IEEE Signal Process. Mag., vol. 26, no. 1, pp. 98-117, Jan. 2009.
88. Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, "Image quality assessment: From error visibility to structural similarity," IEEE Trans. Image Process., vol. 13, no. 4, pp. 600-612, Apr. 2004.
89. M.-J. Chen and A. C. Bovik, "Fast structural similarity index algorithm," J. Real-Time Image Process., vol. 6, no. 4, pp. 281-287, Dec. 2011.
90. Z. Wang, E. Simoncelli, and A. C. Bovik, "Multi-scale structural similarity for image quality assessment," in Proc. Annu. Asilomar Conf. Signals Syst. Comput., Pacific Grove, CA, USA, Nov. 2003, vol. 2, pp. 1398-1402.
91. K. Seshadrinathan and A. C. Bovik, "Unifying analysis of full reference image quality assessment," in Proc. IEEE Int. Conf. Image Process., San Diego, CA, USA, Oct. 2008, pp. 1200-1203.
92. H. R. Sheikh and A. C. Bovik, "Image information and visual quality," IEEE Trans. Image Process., vol. 15, no. 2, pp. 430-444, Feb. 2006. (Pubitemid 43126168)
93. D. M. Chandler and S. S. Hemami, "VSNR: A wavelet-based visual signal-to-noise ratio for natural images," IEEE Trans. Image Process., vol. 16, no. 9, pp. 2284-2298, Sep. 2007. (Pubitemid 47316675)
94. E. C. Larson and D. M. Chandler, "Most apparent distortion: Full-reference image quality assessment and the role of strategy," J. Electr. Imaging, vol. 19, no. 1, pp. 011006-1-011006-21, Jan.-Mar. 2010.
95. L. Zhang, L. Zhang, X. Mou, and D. Zhang, "FSIM: A feature similarity index for image quality assessment," IEEE Trans. Image Process., vol. 20, no. 8, pp. 2378-2386, Aug. 2011.
96. Z. Wang and E. P. Simoncelli, "Local phase coherence and the perception of blur," in Advances in Neural Information Processing Systems, vol. 16. Cambridge, MA, USA: MIT Press, May 2004, pp. 786-792.
97. C. Li and A. C. Bovik, "Content-partitioned structural similarity index for image quality assessment," Signal Process., Image Commun., vol. 25, no. 7, pp. 517-526, Jul. 2010.
98. Z. Wang and Q. Li, "Information content weighting for perceptual image quality assessment," IEEE Trans. Image Process., vol. 20, no. 5, pp. 1185-1198, May 2011.
99. C. Charrier, K. Knoblauch, L. T. Maloney, A. C. Bovik, and A. K. Moorthy, "Optimizing multi-scale SSIM for compression via MLDS," IEEE Trans. Image Process., vol. 21, no. 12, pp. 4682-4694, Dec. 2012.
100. A.M. Tourapis, A. Leontaris, K. Suhring, and G. Sullivan, "H.264/14496-10 AVC reference software manual," Joint Video Team (JVT) of ISO/IEC MPEG and ITU-T VCEG, Jul. 2009.
101. Z. Wang, "Applications of objective image quality assessment methods," IEEE Signal Process. Mag., vol. 28, no. 6, pp. 137-142, Nov. 2011.
102. S. S. Channappayya, A. C. Bovik, C. Caramanis, and R. W. Heath, "Design of linear equalizers optimized for the structural similarity index," IEEE Trans. Image Process., vol. 17, no. 6, pp. 857-872, Jun. 2008. (Pubitemid 351772605)
103. S. S. Channappayya, A. C. Bovik, and R. W. Heath, "Rate bounds on SSIM index of quantized images," IEEE Trans. Image Process., vol. 17, no. 9, pp. 1624-1639, Sep. 2008.
104. M. Temerinac-Ott and M. Burkhardt, "Multichannel image restoration based on optimization of the structural similarity index," in Proc. Asilomar Conf. Signals Syst. Comput., Pacific Grove, CA, USA, 2009, pp. 812-816.
105. A. N. Avanaki, "Exact global histogram specification optimized for structural similarity," Opt. Rev., vol. 16, no. 6, pp. 613-621, Nov. 2009.
106. S. S. Channappayya, A. C. Bovik, and R. W. Heath, "Perceptual soft thresholding using the structural similarity index," in Proc. IEEE Int. Conf. Image Process., San Diego, CA, USA, Oct. 2008, pp. 569-572.
107. A. Rehman, Z. Wang, D. Brunet, and E. R. Vrscay, "SSIM-inspired image denoising using sparse representations," in Proc. IEEE Int. Conf. Acoust. Speech Signal Process., Prague, Czech Republic, 2011, pp. 1121-1124.
108. Z. Wang, Q. Li, and X. Shang, "Perceptual image coding based on a maximum of minimal structural similarity criterion," in Proc. IEEE Int. Conf. Image Process., San Antonio, TX, USA, 2007, vol. 2, pp. 121-124.
109. T. Richter and K. J. Kim, "A MS-SSIM optimal JPEG 2000 encoder," in Proc. Data Compression Conf., Snowbird, UT, USA, 2009, pp. 401-410.
110. A. C. Brooks, X. Zhao, and T. N. Pappas, "Structural similarity quality metrics in a coding context: Exploring the space of realistic distortions," IEEE Trans. Image Process., vol. 17, no. 8, pp. 1261-1273, Aug. 2008.
111. D. Brunet, E. R. Vrscay, and Z. Wang, "On the mathematical properties of the structural similarity index," IEEE Trans. Image Process., vol. 21, no. 4, pp. 1488-1499, Apr. 2012.
112. Y. H. Huang, T. S. Ou, P. Y. Su, and H. H. Chen, "Perceptual rate-distortion optimization using structural similarity index as quality metric," IEEE Trans. Circuits Syst. Video Technol., vol. 20, no. 11, pp. 1614-1624, Nov. 2010.
113. T.-S. Ou, Y.-H. Huang, and H. H. Chen, "SSIM-based perceptual rate control for video coding," IEEE Trans. Circuits Syst. Video Technol., vol. 21, no. 5, pp. 682-691, May 2011.
114. Z. Wang, L. Lu, and A. C. Bovik, "Video quality assessment based on structural distortion measurement," Signal Process., Image Commun., vol. 19, no. 2, pp. 121-132, Feb. 2004.
115. P. V. Vu, C. T. Vu, and D. M. Chandler, "A spatiotemporal most-apparent-distortion model for video quality assessment," in Proc. IEEE Int. Conf. Image Process., Brussels, Belgium, Sep. 2011, pp. 2505-2508.
116. M. H. Pinson and S. Wolf, "A new standardized method for objectively measuring video quality," IEEE Trans. Broadcast., vol. 50, no. 3, pp. 312-322, Sep. 2004.
117. A. Ninassi, A. Le Meur, P. Le Callet, and D. Barba, "Considering temporal variations of spatial visual distortions in video quality assessment," IEEE J. Sel. Top. Signal Process., vol. 3, no. 2, pp. 253-265, Apr. 2009.
118. M. Barkowsky, J. Bialkowski, B. Eskofier, R. Bitto, and A. Kaup, "Temporal trajectory aware visual quality measure," IEEE J. Sel. Top. Signal Process., vol. 3, no. 2, pp. 253-265, Apr. 2009.
119. Z.Wang, G. Wu, H. R. Sheikh, E. Simoncelli, E. Yang, and A. C. Bovik, "Quality-aware images," IEEE Trans. Image Process., vol. 15, no. 5, pp. 1680-1689, May 2006. (Pubitemid 43778944)
120. Q. Li and Z. Wang, "Reduced-reference image quality assessment using divisive normalization-based image representation," IEEE J. Sel. Top. Signal Process., vol. 3, no. 2, pp. 202-211, Apr. 2009.
121. E. P. Simoncelli, W. T. Freeman, E. H. Adelson, and D. J. Heeger, "Shiftable multi-scale transforms," IEEE Trans. Inf. Theory, vol. 38, no. 2, pp. 587-607, Mar. 1992.
122. R. Soundararajan and A. C. Bovik, "RRED indices: Reduced reference entropic differencing for image quality assessment," IEEE Trans. Image Process., vol. 21, no. 2, pp. 517-526, Feb. 2012.
123. S. S. Hemami and A. R. Reibman, "No-reference image and video quality estimation: Applications and human-motivated design," Signal Process., Image Commun., vol. 25, no. 7, pp. 469-481, Aug. 2010.
124. M. C. Q. Farias and S. K. Mitra, "No-reference video quality metric based on artifact measurements," in Proc. IEEE Int. Conf. Image Process., Genoa, Italy, Nov. 2005, vol. 3, pp. 141-144.
125. M. C. Q. Farias and S. K. Mitra, "A methodology for designing no-reference video quality metrics," in Proc. Int. Workshop Video Process. Quality Metrics Consumer Electron., Scottsdale, AZ, USA, Jan. 2009, pp. 140-145.
126. Z. Wang, H. R. Sheikh, and A. C. Bovik, "No-reference perceptual quality assessment of JPEG compressed images," in Proc. IEEE Int. Conf. Image Process., Rochester, NY, USA, Sep. 2002, vol. 1, pp. 477-480.
127. H. R. Sheikh, A. C. Bovik, and L. Cormack, "No-reference quality assessment using natural scene statistics: JPEG2000," IEEE Trans. Image Process., vol. 14, no. 11, pp. 1918-1927, Nov. 2005. (Pubitemid 41646081)
128. T. Oelbaum, K. Diepold, and C. Keimel, "Rule-based no-reference video quality evolution using additionally coded videos," J. Sel. Topics Signal Process., vol. 3, no. 2, pp. 294-303, 2009.
129. T. Brandao and M. P. Queluz, "No-reference quality assessment of H.264/AVC video," IEEE Trans. Circuits Syst. Video Technol., vol. 20, no. 11, pp. 1437-1447, Nov. 2010.
130. A. K. Moorthy and A. C. Bovik, "A two-step framework for constructing blind image quality indices," IEEE Signal Process. Lett., vol. 17, no. 5, pp. 513-516, May 2010.
131. H. Tong, M. Li, H. Zhang, C. Zhang, J. He, and W. Ma, "Learning no-reference quality metric by examples," in Proc. Int. Multimedia Model. Conf., Jan. 2005, pp. 247-254.
132. M. A. Saad, A. C. Bovik, and C. Charrier, "A DCT statistics based blind image quality index," IEEE Signal Process. Lett., vol. 17, no. 6, pp. 583-586, Jun. 2010.
133. M. A. Saad and A. C. Bovik, "Blind image quality assessment: A natural scene statistics approach in the DCT domain," IEEE Trans. Image Process., vol. 21, no. 8, pp. 3339-3352, Aug. 2012.
134. E. Y. Lam and J. W. Goodman, "A mathematical analysis of the DCT coefficient distributions for images," IEEE Trans. Image Process., vol. 9, no. 10, pp. 1661-1666, Oct. 2000.
135. J. Shen, Q. Li, and G. Erlebacher, "Hybrid no reference natural image quality assessment of noisy, blurry, JPEG 2000 and JPEG images," IEEE Trans. Image Process., vol. 20, no. 8, pp. 2089-2098, Aug. 2011.
136. H. Tang, N. Joshi, and A. Kapoor, "Learning a blind measure of perceptual image quality," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., Toronto, ON, Canada, Jun. 2011, pp. 305-312.
137. P. Ye and D. Doermann, "No reference image quality assessment based on visual codebook," in Proc. IEEE Int. Conf. Image Process., Brussels, Belgium, Nov. 2011, pp. 3089-3092.
138. H. R Sheikh, Z. Wang, L. K. Cormack, and A. C. Bovik, "LIVE Image Quality Assessment Database Release 2, 2005. [Online]. Available: http://live.ece.utexas. edu/research/quality.
139. A. Mittal, G. S. Muralidhar, J. Ghosh, and A. C. Bovik, "Blind image quality assessment without human training using latent quality factors," IEEE Signal Process. Lett., vol. 19, no. 2, pp. 75-78, Feb. 2012.
140. A. Mittal, R. Soundararajan, and A. C. Bovik, "Making a 'completely blind' image quality analyzer," IEEE Signal Process. Lett., vol. 21, no. 3, pp. 209-212, Mar. 2013.
141. M. Saad and A. C. Bovik, "Blind quality assessment of videos using a model of natural scene statistics and motion coherency," in Proc. Annu. Asilomar Conf. Signals Syst. Comput., Monterey, CA, USA, Nov. 2012, pp. 332-336.
142. A. Moorthy, "Natural scene statistic based blind image quality assessment and repair," Ph.D. dissertation, Dept. Elec. Comput. Engr., Univ. Texas at Austin, Austin, TX, USA, 2012.
143. S. Chen, A. Beghdadi, and A. Chetouani, "A new color image quality index," in Proc. Int. Workshop Video Process. Quality Metrics Consumer Electron., Scottsdale, AZ, USA, Jan. 2010, pp. 267-271.
144. M. Hassan and C. Bhagvati, "Structural similarity measure for color images," Int. J. Comput. Appl., vol. 43, no. 14, pp. 7-12, Apr. 2012.
145. A. Kolaman and O. Yadid-Pecht, "Quaternion structural similarity: A new quality index for color images," IEEE Trans. Image Process., vol. 21, no. 4, pp. 1546-1536, Apr. 2012.
146. K. Okarma, "Colour image quality assessment using structural similarity index and singular value decomposition," in Lecture Notes in Computer Science, vol. 5101. Berlin, Germany: Springer-Verlag, 2008, pp. 55-65.
147. X. Zhang and B. Wandell, "Color image fidelity metrics evaluated using image distortion maps," Signal Process., vol. 70, pp. 201-214, 1998. (Pubitemid 128418936)
148. C. Oleari, "Color opponencies in the system of the uniform color scales of the Optical Society of America," J. Opt. Soc. Amer. A, vol. 21, no. 5, pp. 677-682, May 2004.
149. A. Benoit, P. Le Callet, P. Campisi, and R. Cousseau, "Quality assessment of stereoscopic images," EURASIP J. Image Video Process., 2008, DOI: 10.1155/2008/659024.
150. J. Yang, C. Hou, Y. Zhou, Z. Zhang, and J. Guo, "Objective quality assessment method of stereo images," in Proc. IEEE 3DTV Conf., Potsdam, Germany, 2009, DOI: 10.1109/3DTV.2009.5069615.
151. R. Olsson and M. A. Sjostrom, "A depth dependent quality metric for evaluation of coded integral imaging based 3D-images," in Proc. IEEE 3DTV Conf., Kos, Greece, 2007, DOI: 10.1109/3DTV.2007.4379397.
152. P. Gorley and N. Holliman, "Stereoscopic image quality metrics and compression," Proc. SPIEVInt. Soc. Opt. Eng., vol. 6803, 2008, DOI: 10.1117/12.763530. (Pubitemid 351613945)
153. A. K. Moorthy, C.-C. Su, A. Mittal, and A. C. Bovik, "Subjective evaluation of stereoscopic image quality," Signal Process., Image Commun., Sep. 2012. [Online]. Available: http://dx.doi.org/10.1016/j.image. 2012.08.004.
154. R. Bensalma and M. C. Larabi, "A perceptual metric for stereoscopic image quality assessment based on the binocular energy," Multidimensional Syst. Signal Process., vol. 24, no. 2, pp. 281-316, Jun. 2013, DOI: 10.1007/s11045-012-0178-3.
155. C.-C. Su, A. C. Bovik, and L. K. Cormack, "Natural scene statistics of color and range," in Proc. IEEE Int. Conf. Image Process., Brussels, Belgium, Sep. 2011, pp. 257-260.
156. Y. Liu, L. K. Cormack, and A. C. Bovik, "Disparity statistics in natural scenes," J. Vis., vol. 8, no. 11, pp. 1-14, Aug. 2008.
157. Y. Liu, A. C. Bovik, and L. K. Cormack, "Statistical modeling of 3D natural scenes with application to Bayesian stereopsis," IEEE Trans. Image Process., vol. 20, no. 9, pp. 2515-2530, Sep. 2011.
158. G. W Cermak, "Consumer opinions about frequency of artifacts in digital video," IEEE J. Sel. Top. Signal Process., vol. 3, no. 2, pp. 336-343, Apr. 2009.
159. D. Rouse, R. Pepion, S. S. Hemami, and P. Le Callet, "Image utility assessment and a relationship with image quality assessment," Proc. SPIEVInt. Soc. Opt. Eng., vol. 7240, Jan. 2009, doi: 10.1117/12.811664.
160. D. Rouse and S. S. Hemami, "Quantifying the use of structure in cognitive tasks," Proc. SPIEVInt. Soc. Opt. Eng., vol. 6492, Jan. 2007, DOI: 10.1117/12.707539. (Pubitemid 47320095)
161. D. Rouse and S. S. Hemami, "Analyzing the role of visual structure in the recognition of natural image content with multi-scale SSIM," Proc. SPIEVInt. Soc. Opt. Eng., vol. 6806, Jan. 2008, DOI: 10.1117/12. 768060.
162. A. Bedagkar-Gala and S. K. Shah, "Joint modeling of algorithm behavior and image quality for algorithm performance prediction," in Proc. British Mach. Vis. Conf., Aberystwyth, U.K., Sep. 2010, DOI: 10.5244/C.24.31.
163. M. Abdel-Mottaleb and M. H. Mahoor, "Algorithms for assessing the quality of facial images," IEEE Comput. Intell. Mag., vol. 2, no. 2, pp. 10-17, May 2007. (Pubitemid 46733337)
164. R.-L. V. Hsu, J. Shah, and B.Martin, "Quality assessment of facial images," in Proc. IEEE Biometrics Symp., Baltimore, MD, USA, Sep. 2006, DOI: 10.1109/BCC.2006.4341617.
165. Y. Chen, S.-C. Dass, and A. K. Jain, "Localized iris image quality using 2-D wavelets Lecture Notes in Computer Science, vol. 3832. Berlin, Germany: Springer-Verlag, 2005, pp. 373-381.
166. N. D. Kalka, J. Zuo, N. A. Schmid, and B. Cukic, "Image quality assessment for iris biometric," Proc. SPIEVInt. Soc. Opt. Eng., vol. 6202, 2006, DOI: 10.1117/12.666448. (Pubitemid 44271124)
167. K. W. Bowyer, K. Hollingsworth, and P. J. Flynn, "Image understanding for iris biometrics: A survey," Comput. Vis. Image Understand., vol. 110, no. 2, pp. 281-307, Feb. 2008.
168. M. Subasic, S. Loncaric, T. Petkovic, and H. Bogunovic, "Face image validation system," in Proc. Int. Symp. Image Signal Process. Anal., 2008, pp. 30-33. (Pubitemid 44459658)
169. L. Breitenbach and P. Chawdhry, "Image quality assessment and performance evaluation for multimodal biometric recognition using face and iris," in Proc. Int. Symp. Image Signal Process. Anal., 2009, pp. 550-555.
170. Information TechnologyVBiometric Data Interchange FormatsVPart 5: Face Image Data, ISO/IEC 19794-5, Jun. 2005.