Blind prediction of natural video quality

IEEE Transactions on Image Processing

Volumn 23, Issue 3, 2014, Pages 1352-1365

  Saad, Michele A ^a   Bovik, Alan C ^a   Charrier, Christophe ^b  

^a The University of Texas at Austin   (United States)

^b UNIVERSITÉ DE CAEN   (France)

Author keywords

Discrete cosine transform; Egomotion; Generalized Gaussian; Video quality assessment

Indexed keywords

ALGORITHM; ARTICLE; ARTIFACT; AUTOMATED PATTERN RECOGNITION; COMPUTER ASSISTED DIAGNOSIS; IMAGE ENHANCEMENT; METHODOLOGY; MOTION; PHOTOGRAPHY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; VIDEORECORDING;

ALGORITHMS; ARTIFACTS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; MOTION; PATTERN RECOGNITION, AUTOMATED; PHOTOGRAPHY; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; VIDEO RECORDING;

EID: 84894453987     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2014.2299154     Document Type: Article

References (53)

1. Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, "Image quality assessment: From error visibility to structural similarity," IEEE Trans. Image Process., vol. 13, no. 4, pp. 600-612, Apr. 2004.
2. Z. Wang, E. P. Simoncelli, and A. C. Bovik, "Multiscale structural similarity image quality assessment," in Proc. 37th Asilomar Conf. Signals, Syst., Comput., vol. 2. Nov. 2003, pp. 1398-1402.
3. D. M. Chandler and S. S. Hemami, "VSNR: A wavelet-based visual signal-to-noise ratio for natural images," IEEE Trans. Image Process., vol. 16, no. 9, pp. 2284-2298, Sep. 2007. (Pubitemid 47316675)
4. E. C. Larson and D. M. Chandler, "Most apparent distortion: Fullreference image quality assessment and the role of strategy," J. Electron. Imaging, vol. 19, no. 1, p. 011006-1-011006-21, Mar. 2010.
5. H. R. Sheikh, A. C. Bovik, and G. de Veciana, "Image information and visual quality," IEEE Trans. Image Process., vol. 15, no. 2, pp. 430-444, Feb. 2006. (Pubitemid 43126168)
6. K. Seshadrinathan and A. C. Bovik, "Motion tuned spatio-temporal quality assessment of natural videos," IEEE Trans. Image Process., vol. 19, no. 2, pp. 335-350, Feb. 2010.
7. Z. Wang, L. Lu, and A. C. Bovik, "Video quality assessment based on structural distortion measurement," Signal Process., Image Commun., vol. 19, no. 2, pp. 121-132, Feb. 2004.
8. M. H. Pinson and S. Wolf, "A new standardized method for objectively measuring video quality," IEEE Trans. Broadcast., vol. 10, no. 3, pp. 312-322, Sep. 2004.
9. A. B. Watson, J. Hu, and J. F. McGowan, "DVQ: A digital video quality metric based on human vision," J. Electron. Imag., vol. 10, no. 1, pp. 20-29, Jan. 2001. (Pubitemid 32279358)
10. M. Barkowsky, J. Bialkowski, B. Eskofier, R. Bito, and A. Kaup, "Temporal trajectory aware video quality measure," IEEE J. Sel. Topics Signal Process., vol. 3, no. 2, pp. 266-279, Apr. 2009.
11. P. V. Vu, C. T. Vu, and D. M. Chandler, "A spatiotemporal most apparent distortion model for video quality assessment," in Proc. IEEE ICIP, Sep. 2011, pp. 2505-2508.
12. A. Ninassi, O. Le Meur, P. Le Callet, and D. Barba, "Considering temporal variations of spatial visual distortions in video quality assessment," IEEE J. Sel. Topics Signal Process., vol. 3, no. 2, pp. 253-265, Apr. 2009.
13. C. Li and A. C. Bovik, "Content-weighted video quality assessment using a three-component image model," J. Electron. Imag., vol. 19, no. 1, pp. 011003-1-011003-9, Jan. 2010.
14. Z. Wang and E. P. Simoncelli, "Reduced-reference image quality assessment using a wavelet-domain natural image statistic model," Proc. SPIE, vol. 5666, pp. 149-159, Jan. 2005. (Pubitemid 40949010)
15. L. Qiang and Z. Wang, "Reduced-reference image quality assessment using divisive-normalization-based image representation," IEEE J. Sel. Topics Signal Process., vol. 3, no. 2, pp. 202-211, Apr. 2009.
16. R. Soundararajan and A. C. Bovik, "RRED indices: Reduced reference entropic differencing for image quality assessment," IEEE Trans. Image Process., vol. 21, no. 2, pp. 517-526, Feb. 2012.
17. M. Masry, S. S. Hemami, and Y. Sermadevi, "A scalable wavelet-based video distortion metric and applications," IEEE Trans. Circ. Syst. Video Technol., vol. 16, no. 2, pp. 260-273, Feb. 2006.
18. Z. Wang, A. C. Bovik, and B. L. Evans, "Blind measurement of blocking artifacts in images," in Proc. IEEE Int. Conf. Image Process., vol. 3. Sep. 2000, pp. 981-984.
19. Z. M. Parvez Sazzad, Y. Kawayoke, and Y. Horita, "No-reference image quality assessment for JPEG2000 based on spatial features," Signal Process., Image Commun., vol. 23, no. 4, pp. 257-268, Apr. 2008.
20. X. Zhu and P. Milanfar, "A no-reference sharpness metric sensitive to blur and noise," in Proc. Int. Workshop Qual. Multimedia Exper., Jul. 2009, pp. 64-69.
21. X. Feng and J. P. Allebach, "Measurement of ringing artifacts in JPEG images," Proc. SPIE, vol. 6076, pp. 74-83, Jan. 2006.
22. A. K. Moorthy and A. C. Bovik, "A two-step framework for constructing blind image quality indices," IEEE Signal Process. Lett., vol. 17, no. 5, pp. 513-516, May 2010.
23. M. A. Saad, A. C. Bovik, and C. Charrier, "A DCT statistics-based blind image quality index," IEEE Signal Process. Lett., vol. 17, no. 6, pp. 583-586, Jun. 2010.
24. A. K. Moorthy and A. C. Bovik, "Blind image quality assessment: From natural scene statistics to perceptual quality," IEEE Trans. Image Process., vol. 20, no. 12, pp. 3350-3364, Dec. 2011.
25. M. A. Saad, A. C. Bovik, and C. Charrier, "Blind image quality assessment: A natural scene statistics approach in the DCT domain," IEEE Trans. Image Process., vol. 21, no. 8, pp. 3339-3352, Aug. 2012.
26. R. Blake and R. Sekuler, Perception, 5th ed. New York, NY, USA: McGraw-Hill, 2006.
27. R. T. Born and D. C. Bradley, "Structure and function of visual area MT," Annu. Rev. Neurosci., vol. 28, pp. 157-189, Mar. 2005. (Pubitemid 41098903)
28. B. A. Wandell, Foundations of Vision. Sunderland, MA, USA: Sinauer Associates Inc., 1995.
29. T. Brandao and M. P. Queluz, "No-reference quality assessment of H.264/AVC encoded video," IEEE Trans. Circuits Syst. Video Technol., vol. 20, no. 11, pp. 1437-1447, Nov. 2010.
30. S. Daly, "Engineering observations from spatiovelocity and spatiotemporal visual models," in Vision Models and Applications to Image and Video Processing. New York, NY, USA: Springer-Verlag, 2001, pp. 179-200.
31. D. H. Kelly, "Motion and vision. II: Stabilized spatio-temporal threshold surface," J. Opt. Soc. Amer., vol. 69, no. 10, pp. 1340-1349, Oct. 1979.
32. H. Boujut, J. Benois-Pineau, T. A. O. Hadar, and P. Bonnet, "No-reference video quality assessment of H.264 video streams based on semantic saliency maps," Proc. SPIE, vol. 8293, pp. 82930T-1-82930T-9, Jan. 2012.
33. S. Roth and M. J. Black, "On the spatial statistics of optical flow," in Proc. IEEE Int. Conf. Comput. Vis., vol. 1. Oct. 2005, pp. 42-49. (Pubitemid 44054939)
34. E. P. Simoncelli, E. H. Adelson, and D. J. Heeger, "Probability distributions of optical flow," in Proc. IEEE Conf. CVPR, Jun. 1991, pp. 310-315.
35. K. Seshadrinathan and A. C. Bovik, "A structural similarity metric for video based on motion models," in Proc. IEEE ICASSP, Apr. 2007, pp. 869-872.
36. D. W. Dong and J. J. Atick, "Statistics of natural time-varying images," Netw., Comput. Neural Syst., vol. 6, no. 3, pp. 345-358, 1995.
37. R. Soundararajan and A. C. Bovik, "Video quality assessment by reduced reference spatio-temporal entropic differencing," IEEE Trans. Circuits Syst. Video Technol., vol. 23, no. 4, pp. 684-694, Apr. 2013.
38. K. Seshadrinathan, R. Soundararajan, A. C. Bovik, and L. K. Cormack, "Study of subjective and objective quality assessment of video," IEEE Trans. Image Process., vol. 19, no. 6, pp. 1427-1441, Jun. 2010.
39. D. J. Heeger, "Normalization of cell responses in cat striate cortex," Vis. Neurosci., vol. 9, no. 9, pp. 181-197, Aug. 1992.
40. Z. Wang and A. C. Bovik, "Reduced and no-reference visual quality assessment: The natural scene statistics model approach," IEEE Signal Process. Mag., vol. 29, no. 6, pp. 29-40, Nov. 2011.
41. J. W. Suchow and G. A. Alvarez, "Motion silences awareness of visual change," Current Biol., vol. 21, pp. 140-143, Jan. 2011.
42. L. K. Choi, A. C. Bovik, and L. K. Cormack, "A flicker detector model of the motion silencing illusion," J. Vis., vol. 12, no. 9, p. 777, May 2012.
43. R. Li, B. Zeng, and M. L. Liou, "A new three-step search algorithm for block motion estimation," IEEE Trans. Circuit Syst. Video Technol., vol. 2, no. 2, pp. 438-442, Aug. 1994.
44. Y. Weiss, E. P. Simoncelli, and E. H. Adelson, "Motion illusions as optimal percepts," Nature Neurosci., vol. 5, no. 6, pp. 598-604, Jun. 2002. (Pubitemid 34569003)
45. A. C. Bovik, T. S. Huang, and D. C. Munson, "A generalization of median filtering using linear combinations of order statistics," IEEE Trans. Acoust., Speech, Signal Process., vol. 31, no. 6, pp. 1342-1350, Dec. 1983.
46. K. Sharifi and A. Leon-Garcia, "Estimation of shape parameter for generalized Gaussian distributions in subband decompositions of video," IEEE Trans. Circuits Syst. Video Technol., vol. 5, no. 1, pp. 52-56, Feb. 1995.
47. A. Mittal, R. Soundararajan, and A. C. Bovik, "Making a 'Completely Blind' image quality analyzer," IEEE Signal Process. Lett., vol. 20, no. 3, pp. 209-212, Mar. 2013.
48. A. Karatzoglou, A. Smola, K. Hornik, and A. Zeileis, "Kernlab-An S4 package for kernel methods in R," J. Statist. Softw., vol. 11, no. 9, pp. 1-20, Oct. 2004.
49. W. H. Chen, C. H. Smith, and S. Fralick, "A fast computational algorithm for discrete cosine transform," IEEE Trans. Commun., vol. 25, no. 9, pp. 1004-1009, Sep. 1977. (Pubitemid 8564969)
50. (2007). H.264/MPEG-4 AVC Reference Software Manual [Online]. Available: http://iphome.hhi.de/suehring/tml/
51. E. P. Simoncelli and D. J. Heeger, "A model of neuronal responses in visual area MT," Vis. Res., vol. 38, no. 5, pp. 743-761, Mar. 1998. (Pubitemid 28081676)
52. J. A. Perrone, "A visual motion sensor based in the properties of V1 and MT neurons," Vis. Res., vol. 44, no. 15, pp. 1733-1755, Jul. 2004. (Pubitemid 38609059)
53. K. Seshadrinathan and A. C. Bovik, "Motion-based perceptual quality assessment of video," Proc. SPIE, vol. 7240, pp. 72400X-1-72400X-12, Feb. 2009.