Perceptual video quality metrics - a review

Digital Video Image Quality and Perceptual Coding

Volumn , Issue , 2017, Pages 155-179

  Winkler, Stefan ^a  

^a Genista Corporation   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85133577352     PISSN: None     EISSN: None     Source Type: Book    
DOI: None     Document Type: Chapter

References (98)

1. A. J. Ahumada, Jr., B. L. Beard, and R. Eriksson. Spatio-temporal discrimination model predicts temporal masking function. In Proc. SPIE, 3299:120-127, San Jose, CA, Jan. 26-29, 1998.
2. A. J. Ahumada, Jr. Computational image quality metrics: A review. In SID Symposium Digest, 24:305-308, 1993.
3. A. J. Ahumada, Jr. and C. H. Null. Image quality: A multidimensional problem. In A. B. Watson, Ed., Digital Images and Human Vision, 141-148. Cambridge, MA: The MIT Press, 1993.
4. I. Avcibaş, B. Sankur, and K. Sayood. Statistical evaluation of image quality measures. J. Electronic Imaging, 11(2):206-223, April 2002.
5. P. G. J. Barten. Contrast Sensitivity of the Human Eye and Its Effects on Image Quality. Bellingham, WA: SPIE, 1999.
6. V. Baroncini and A. Pierotti. Single-ended objective quality assessment of DTV. In Proc. SPIE, 3845:244-253, Boston, MA, Sep. 19-22, 1999.
7. T. Carney et al. Modelfest: Year one results and plans for future years. In Proc. SPIE, 3959:140-151, San Jose, CA, Jan. 23-28, 2000.
8. T. Carney et al. Extending the Modelfest image/threshold database into the spatio-temporal domain. In Proc. SPIE, 4662:138-148, San Jose, CA, Jan. 20-25, 2002.
9. F. X. Coudoux, M. G. Gazalet, C. Derviaux, and P. Corlay. Picture quality measurement based on block visibility in discrete cosine transform coded video sequences. J. Electronic Imaging, 10(2):498-510, April 2001.
10. J. Caviedes and F. Oberti. No-reference quality metric for degraded and enhanced video. In Proc. SPIE, 5150:621-632, Lugano, Switzerland, July 8-11, 2003.
11. A. Cavallaro and S.Winkler. Segmentation-driven perceptual quality metrics. In Proc. ICIP, 3543-3546, Singapore, Oct. 24-27, 2004.
12. G. W. Cermak, S. Wolf, E. P. Tweedy, M. H. Pinson, and A. A. Webster. Validating objective measures of MPEG video quality. SMPTE J., 107(4):226-235, April 1998.
13. S. Daly. The visible differences predictor: An algorithm for the assessment of image fidelity. In A. B. Watson, Ed., Digital Images and Human Vision, 179-206. Cambridge, MA: The MIT Press, 1993.
14. S. Daly. Engineering observations from spatiovelocity and spatiotemporal visual models. In Proc. SPIE, 3299:180-191, San Jose, CA, Jan. 26-29, 1998.
15. J. G. Daugman. Two-dimensional spectral analysis of cortical receptive field profiles. Vision Res., 20(10):847-856, 1980.
16. H. de Ridder, F. J. J. Blommaert, and E. A. Fedorovskaya. Naturalness and image quality: Chroma and hue variation in color images of natural scenes. In Proc. SPIE, 2411:51-61, San Jose, CA, Feb. 6-8, 1995.
17. I. Daubechies and W. Sweldens. Factoring wavelet transforms into lifting steps. J. Fourier Anal. Appl., 4(3):245-267, 1998.
18. R. Eriksson, B. Andren, and K. Brunnström. Modelling the perception of digital images: A performance study. In Proc. SPIE, 3299:88-97, San Jose, CA, Jan. 26-29, 1998.
19. A. M. Eskicioglu and P. S. Fisher. Image quality measures and their performance. IEEE Trans. Comm., 43(12):2959-2965, Dec. 1995.
20. O. D. Faugeras. Digital color image processing within the framework of a human visual model. IEEE Trans. Acoust. Speech Signal Process., 27(4):380-393, Aug. 1979.
21. D. R. Fuhrmann, J. A. Baro, and J. R. Cox, Jr. Experimental evaluation of psychophysical distortion metrics for JPEG-coded images. J. Electronic Imaging, 4(4):397-406, Oct. 1995.
22. R. E. Fredericksen and R. F. Hess. Estimating multiple temporal mechanisms in human vision. Vision Res., 38(7):1023-1040, 1998.
23. E. M. Granger and J. C. Heurtley. Visual chromaticity-modulation transfer function. J. Opt. Soc. Am., 63(9):1173-1174, Sep. 1973.
24. P. Gastaldo, R. Zunino, and S. Rovetta. Objective assessment of MPEG-2 video quality. J. Electronic Imaging, 11(3):365-374, July 2002.
25. A. P. Hekstra et al. PVQM - a perceptual video quality measure. Signal Processing: Image Communication, 17(10):781-798, Nov. 2002.
26. D. S. Hands. A basic multimedia quality model. IEEE Trans. Multimedia, 6(6):806-816, Dec. 2004.
27. Y. Horita, T. Miyata, I. P. Gunawan, T. Murai, and M. Ghanbari. Evaluation model considering static-temporal quality degradation and human memory for SSCQE video quality. In Proc. SPIE, 5150:1601-1611, Lugano, Switzerland, July 8-11, 2003.
28. T. Hamada, S. Miyaji, and S. Matsumoto. Picture quality assessment system by three-layered bottom-up noise weighting considering human visual perception. SMPTE J., 108(1):20-26, Jan. 1999.
29. R. F. Hess and R. J. Snowden. Temporal properties of human visual filters: Number, shapes and spatial covariation. Vision Res., 32(1):47-59, 1992.
30. ITU-R Recommendation BT.500-11. Methodology for the subjective assessment of the quality of television pictures. International Telecommunication Union, Geneva, Switzerland, 2002.
31. R. E. Jacobson. An evaluation of image quality metrics. J. Photographic Sci., 43(1):7-16, 1995.
32. S. A. Klein, T. Carney, L. Barghout-Stein, and C. W. Tyler. Seven models of masking. In Proc. SPIE, 3016:13-24, San Jose, CA, Feb. 8-14, 1997.
33. D. H. Kelly. Spatiotemporal variation of chromatic and achromatic contrast thresholds. J. Opt. Soc. Am., 73(6):742-750, June 1983.
34. S. A. Klein. Image quality and image compression: A psychophysicist's viewpoint. In A. B. Watson, Ed., Digital Images and Human Vision, 73-88. Cambridge, MA: The MIT Press, 1993.
35. F. X. J. Lukas and Z. L. Budrikis. Picture quality prediction based on a visual model. IEEE Trans. Comm., 30(7):1679-1692, July 1982.
36. J. Lubin and D. Fibush. Sarnoff JND vision model. T1A1.5 Working Group Document #97-612, ANSI T1 Standards Committee, 1997.
37. Z. Lu, W. Lin, E. Ong, X. Yang, and S. Yao. PQSM-based RR and NR video quality metrics. In Proc. SPIE, 5150:633-640, Lugano, Switzerland, July 8-11, 2003.
38. B. Li, G. W. Meyer, and R. V. Klassen. A comparison of two image quality models. In Proc. SPIE, 3299:98-109, San Jose, CA, Jan. 26-29, 1998.
39. S. Lee, M. S. Pattichis, and A. C. Bovik. Foveated video quality assessment. IEEE Trans. Multimedia, 4(1):129-132, March 2002.
40. J. Lubin. A visual discrimination model for imaging system design and evaluation. In E. Peli, Ed., Vision Models for Target Detection and Recognition, 245-283. Singapore: World Scientific Publishing, 1995.
41. A. M. Lund. The influence of video image size and resolution on viewing-distance preferences. SMPTE J., 102(5):407-415, May 1993.
42. P. Lindh and C. J. van den Branden Lambrecht. Efficient spatio-temporal decomposition for perceptual processing of video sequences. In Proc. ICIP, 3:331-334, Lausanne, Switzerland, Sep. 16-19, 1996.
43. H. Marmolin. Subjective MSE measures. IEEE Trans. Systems, Man, and Cybernetics, 16(3):486-489, May 1986.
44. P. Marziliano, F. Dufaux, S. Winkler, and T. Ebrahimi. A no-reference perceptual blur metric. In Proc. ICIP, 3:57-60, Rochester, NY, Sep. 22-25, 2002.
45. P. Marziliano, F. Dufaux, S. Winkler, and T. Ebrahimi. Perceptual blur and ringing metrics: Application to JPEG2000. Signal Processing: Image Communication, 19(1), Jan. 2004.
46. A. Mayache, T. Eude, and H. Cherifi. A comparison of image quality models and metrics based on human visual sensitivity. In Proc. ICIP, 3:409-413, Chicago, IL, Oct. 4-7, 1998.
47. M. A. Masry and S. S. Hemami. A metric for continuous quality evaluation of compressed video with severe distortions. Signal Processing: Image Communication, 19(1):133-146, Feb. 2004.
48. J. L. Mannos and D. J. Sakrison. The effects of a visual fidelity criterion on the encoding of images. IEEE Trans. Inform. Theory, 20(4):525-536, July 1974.
49. K. T. Mullen. The contrast sensitivity of human colour vision to red-green and blue-yellow chromatic gratings. J. Physiol., 359:381-400, 1985.
50. T. S. Meese and C. B. Williams. Probability summation for multiple patches of luminance modulation. Vision Res., 40(16):2101-2113, July 2000.
51. M. J. Nadenau, J. Reichel, and M. Kunt. Performance comparison of masking models based on a new psychovisual test method with natural scenery stimuli. Signal Processing: Image Communication, 17(10):807-823, Nov. 2002.
52. W. Osberger and A. M. Rohaly. Automatic detection of regions of interest in complex video sequences. In Proc. SPIE, 4299:361-372, San Jose, CA, Jan. 21-26, 2001.
53. E. Peli. Contrast in complex images. J. Opt. Soc. Am. A, 7(10):2032-2040, Oct. 1990.
54. E. Peli. In search of a contrast metric: Matching the perceived contrast of Gabor patches atdifferent phases and bandwidths. Vision Res., 37(23):3217-3224, 1997.
55. T. N. Pappas and R. J. Safranek. Perceptual criteria for image quality evaluation. In A. Bovik, Ed., Handbook of Image & Video Processing, 669-684. New York: Academic Press, 2000.
56. R. F. Quick, Jr. A vector-magnitude model of contrast detection. Kybernetik, 16:65-67, 1974.
57. A. M. Rohaly et al. Video Quality Experts Group: Current results and future directions. In Proc. SPIE, 4067:742-753, Perth, Australia, June 21-23, 2000.
58. S. Rihs. The influence of audio on perceived picture quality and subjective audio-video delay tolerance. In MOSAIC Handbook, 183-187, Jan. 1996.
59. J. A. J. Roufs. Brightness contrast and sharpness, interactive factors in perceptual image quality. In Proc. SPIE, 1077:209-216, Los Angeles, CA, Jan. 18-20, 1989.
60. A. J. Seyler and Z. L. Budrikis. Detail perception after scene changes in television image presentations. IEEE Trans. Inform. Theory, 11(1):31-43, 1965.
61. W. Schreiber. Fundamentals of Electronic Imaging Systems. New York: Springer, 1993.
62. A. E. Savakis, S. P. Etz, and A. C. Loui. Evaluation of image appeal in consumer photography. In Proc. SPIE, 3959:111-120, San Jose, CA, Jan. 23-28, 2000.
63. R. Steinmetz. Human perception of jitter and media synchronization. IEEE J. Selected Areas in Comm., 14(1):61-72, Jan. 1996.
64. S. Susstrunk and S. Winkler. Color image quality on the Internet. In Proc. SPIE, 5304:118-131, San Jose, CA, Jan. 19-22, 2004. Invited paper.
65. K. T. Tan, M. Ghanbari, and D. E. Pearson. An objective measurement tool for MPEG video quality. Signal Processing, 70(3):279-294, Nov. 1998.
66. P. C. Teo and D. J. Heeger. Perceptual image distortion. In Proc. SPIE, 2179:127-141, San Jose, CA, Feb. 8-10, 1994.
67. X. Tong, D. Heeger, and C. J. van den Branden Lambrecht. Video quality evaluation using ST-CIELAB. In Proc. SPIE, 3644:185-196, San Jose, CA, Jan. 23-29, 1999.
68. C. J. van den Branden Lambrecht. Perceptual Models and Architectures for Video Coding Applications. Ph.D. thesis, École Polytechnique Fédérale de Lausanne, Switzerland, 1996.
69. C. J. van den Branden Lambrecht and O. Verscheure. Perceptual quality measure using a spatio-temporal model of the human visual system. In Proc. SPIE, 2668:450-461, San Jose, CA, Jan. 28-Feb. 2, 1996.
70. G. van der Horst and M. A. Bouman. Spatiotemporal chromaticity discrimination. Journal of the Optical Society of America, 59:1482-1488, 1969.
71. T. Vlachos. Detection of blocking artifacts in compressed video. Electronics Letters, 36(13):1106-1108, June 2000.
72. VQEG. Final report from the Video Quality Experts Group on the validation of objective models of video quality assessment, April 2000. Available at http://www.vqeg.org/.
73. VQEG. Final report from the Video Quality Experts Group on the validation of objective models of video quality assessment - Phase II, Aug. 2003. Available at http://www.vqeg.org/.
74. A. B. Watson. The cortex transform: Rapid computation of simulated neural images. Computer Vision, Graphics, and Image Processing, 39(3):311-327, 1987.
75. A. B. Watson. Image data compression having minimum perceptual error. U.S. Patent 5,426,512, 1995.
76. A. B. Watson. Image data compression having minimum perceptual error. U.S. Patent 5,629,780, 1997.
77. A. B. Watson. Toward a perceptual video quality metric. In Proc. SPIE, 3299:139-147, San Jose, CA, Jan. 26-29, 1998.
78. Z. Wang, A. C. Bovik, and B. L. Evans. Blind measurement of blocking artifacts in images. In Proc. ICIP, 3:981-984, Vancouver, Canada, Sep. 10-13, 2000.
79. A. B. Watson, R. Borthwick, and M. Taylor. Image quality and entropy masking. In Proc. SPIE, 3016:2-12, San Jose, CA, Feb. 8-14, 1997.
80. S. Winkler and R. Campos. Video quality evaluation for Internet streaming applications. In Proc. SPIE, 5007:104-115, Santa Clara, CA, Jan. 21-24, 2003.
81. S. Winkler and F. Dufaux. Video quality evaluation for mobile applications. In Proc. SPIE, 5150:593-603, Lugano, Switzerland, July 8-11, 2003.
82. S. Winkler and C. Faller. Audiovisual quality evaluation of low-bitrate video. In Proc. SPIE, 5666:139-148, San Jose, CA, Jan. 16-20, 2005.
83. A. B. Watson, J. Hu, and J. F. McGowan III. DVQ: A digital video quality metric based on human vision. J. Electronic Imaging, 10(1):20-29, Jan. 2001.
84. S. Winkler. A perceptual distortion metric for digital color images. In Proc. ICIP, 3:399-403, Chicago, IL, Oct. 4-7, 1998.
85. S. Winkler. Issues in vision modeling for perceptual video quality assessment. Signal Processing, 78(2):231-252, Oct. 1999.
86. S. Winkler. A perceptual distortion metric for digital color video. In Proc. SPIE, 3644:175-184, San Jose, CA, Jan. 23-29, 1999.
87. S. Winkler. Quality metric design: A closer look. In Proc. SPIE, 3959:37-44, San Jose, CA, Jan. 23-28, 2000.
88. S. Winkler. Visual fidelity and perceived quality: Towards comprehensive metrics. In Proc. SPIE, 4299:114-125, San Jose, CA, Jan. 21-26, 2001.
89. Z. Wang, L. Lu, and A. C. Bovik. Video quality assessment based on structural distortion measurement. Signal Processing: Image Communication, 19(2):121-132, Feb. 2004.
90. S. Wolf and M. H. Pinson. Spatial-temporal distortion metrics for in-service quality monitoring of any digital video system. In Proc. SPIE, 3845:266-277, Boston, MA, Sep. 19-22, 1999.
91. J. H. D. M. Westerink and J. A. J. Roufs. Subjective image quality as a function of viewing distance, resolution, and picture size. SMPTE J., 98(2):113-119, Feb. 1989.
92. A. B. Watson and J. A. Solomon. Model of visual contrast gain control and pattern masking. J. Opt. Soc. Am. A, 14(9):2379-2391, Sep. 1997.
93. S. Winkler, A. Sharma, and D. McNally. Perceptual video quality and blockiness metrics for multimedia streaming applications. In Proc. International Symposium on Wireless Personal Multimedia Communications, 547-552, Aalborg, Denmark, Sep. 9-12, 2001. Invited paper.
94. S. Winkler and P. Vandergheynst. Computing isotropic local contrast from oriented pyramid decompositions. In Proc. ICIP, 4:420-424, Kobe, Japan, Oct. 25-28, 1999.
95. H. R. Wu and M. Yuen. A generalized block-edge impairment metric for video coding. IEEE Signal Processing Letters, 4(11):317-320, Nov. 1997.
96. S. N. Yendrikhovskij, F. J. J. Blommaert, and H. de Ridder. Towards perceptually optimal colour reproduction of natural scenes. In L. W. MacDonald and M. R. Luo, Eds., Colour Imaging: Vision and Technology, 363-382. New York: John Wiley & Sons, 1999.
97. J. Yang and W. Makous. Spatiotemporal separability in contrast sensitivity. Vision Res., 34(19):2569-2576, 1994.
98. X. Zhang and B. A. Wandell. A spatial extension of CIELAB to predict the discriminability of colored patterns. In SID Symposium Digest, 27:731-735, 1996.