No-reference video quality assessment based on artifact measurement and statistical analysis

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 25, Issue 4, 2015, Pages 533-546

  Zhu, Kongfeng ^a   Li, Chengqing ^c   Asari, Vijayan ^d   Saupe, Dietmar ^b  

^a UNIVERSITÉ DE NANTES   (France)

^b UNIVERSITY OF KONSTANZ   (Germany)

^c XIANGTAN UNIVERSITY   (China)

^d University of Dayton   (United States)

Author keywords

Blocking artifact; DCT; H.264 AVC; natural scene; noreference measure; video quality assessment

Indexed keywords

FREQUENCY BANDS; MOTION PICTURE EXPERTS GROUP STANDARDS; MULTILAYER NEURAL NETWORKS; VIDEO RECORDING; VIDEO SIGNAL PROCESSING;

BLOCKING ARTIFACTS; DCT; H.264/AVC; NATURAL SCENES; NO REFERENCES; VIDEO QUALITY ASSESSMENT;

DISCRETE COSINE TRANSFORMS;

EID: 84926457035     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2014.2363737     Document Type: Article

References (58)

1. K. Zhu, V. Asari, and D. Saupe, "No-reference quality assessment of H.264/AVC encoded video based on natural scene features, " Proc. SPIE, vol. 8755, no. 4, p. 875505, May 2013.
2. A. C. Bovik, "Automatic prediction of perceptual image and video quality, " Proc. IEEE, vol. 101, no. 9, pp. 2008-2024, Sep. 2013.
3. K. Zhu, S. Li, and D. Saupe, "An objective method of measuring texture preservation for camcorder performance evaluation, " Proc. SPIE, vol. 8293, no. 6, p. 829304, Jan. 2012.
4. K. Zhu and D. Saupe, "Performance evaluation of HD camcorders: Measuring texture distortions using Gabor filters and spatio-velocity CSF, " Proc. SPIE, vol. 8653, no. 9, p. 86530A, Feb. 2013.
5. M. Narwaria, W. Lin, and A. E. Çetin, "Scalable image quality assessment with 2D mel-cepstrum and machine learning approach, " Pattern Recognit., vol. 45, no. 1, pp. 299-313, Jan. 2012.
6. A. K. Moorthy and A. C. Bovik, "A two-step framework for constructing blind image quality indices, " IEEE Signal Process. Lett., vol. 17, no. 5, pp. 513-516, May 2010.
7. P. Marziliano, F. Dufaux, S. Winkler, and T. Ebrahimi, "A no-reference perceptual blur metric, " in Proc. Int. Conf. Image Process., vol. 3. 2002, pp. 57-60.
8. C. Feichtenhofer, H. Fassold, and P. Schallauer, "A perceptual image sharpness metric based on local edge gradient analysis, " IEEE Signal Process. Lett., vol. 20, no. 4, pp. 379-382, Apr. 2013.
9. C. Chen, W. Chen, and J. A. Bloom, "A universal reference-free blurriness measure, " Proc. SPIE, vol. 7867, Jan. 2011, Art. ID 78670B.
10. N. N. Ponomarenko, V. V. Lukin, O. I. Eremeev, K. O. Egiazarian, and J. T. Astola, "Sharpness metric for no-reference image visual quality assessment, " Proc. SPIE, vol. 8295, Jan. 2012, Art. ID 829519.
11. P. V. Vu and D. M. Chandler, "A fast wavelet-based algorithm for global and local image sharpness estimation, " IEEE Signal Process. Lett., vol. 19, no. 7, pp. 423-426, Jul. 2012.
12. B. Fishbain, L. Yaroslavsky, I. Ideses, and F. Roffet-Crete, "No-reference method for image effective bandwidth estimation, " Proc. SPIE, vol. 6808, Jan. 2008, Art. ID 68080X.
13. C. T. Vu, T. D. Phan, and D. M. Chandler, "S3: A spectral and spatial measure of local perceived sharpness in natural images, " IEEE Trans. Image Process., vol. 21, no. 3, pp. 934-945, Mar. 2012.
14. Z. Wang, A. C. Bovik, and B. L. Evan, "Blind measurement of blocking artifacts in images, " in Proc. Int. Conf. Image Process., vol. 3. Vancouver, BC, Canada, 2000, pp. 981-984.
15. H. Liu and I. Heynderickx, "A no-reference perceptual blockiness metric, " in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Las Vegas, NV, USA, Mar./Apr. 2008, pp. 865-868.
16. C. Chen and J. A. Bloom, "A blind reference-free blockiness measure, " in Proc. 11th Pacific Rim Conf. Adv. Multimedia Inf. Process., 2010, pp. 112-123.
17. G. Zhai, W. Zhang, X. Yang, W. Lin, and Y. Xu, "No-reference noticeable blockiness estimation in images, " Signal Process., Image Commun., vol. 23, no. 6, pp. 417-432, Jul. 2008.
18. H. Liu and I. Heynderickx, "A perceptually relevant no-reference blockiness metric based on local image characteristics, " EURASIP J. Adv. Signal Process.l, vol. 2009, Jan. 2009, Art. ID 263540.
19. L. Abate, G. Ramponi, and J. Stessen, "Detection and measurement of the blocking artifact in decoded video frames, " Signal Image Video Process., vol. 7, no. 3, pp. 453-466, May 2013.
20. E. P. Simoncelli and B. A. Olshausen, "Natural image statistics and neural representation, " Annu. Rev. Neurosci., vol. 24, pp. 1193-1216, May 2001.
21. W. S. Geisler, "Visual perception and the statistical properties of natural scenes, " Annu. Rev. Psychol., vol. 59, pp. 167-192, Aug. 2007.
22. R. Soundararajan and A. C. Bovik, "Survey of information theory in visual quality assessment, " Signal, Image Video Process., vol. 3, no. 3, pp. 391-401, May 2013.
23. A. Mittal, R. Soundararajan, and A. C. Bovik, "Making a 'completely blind' image quality analyzer, " IEEE Signal Process. Lett., vol. 20, no. 3, pp. 209-212, Mar. 2013.
24. H. Li and S. Forchhammer, "MPEG2 video parameter and no reference PSNR estimation, " in Proc. Picture Coding Symp., Chicago, IL, USA, May 2009, pp. 1-4.
25. T. Brandaõ and M. P. Queluz, "No-reference quality assessment of H.264/AVC encoded video, " IEEE Trans. Circuits Syst. Video Technol., vol. 20, no. 11, pp. 1437-1447, Nov. 2010.
26. J.-W. Ryu, S.-O. Lee, D.-G. Sim, and J.-K. Han, "No-reference peak signal to noise ratio estimation based on generalized Gaussian modeling of transform coefficient distributions, " Opt. Eng., vol. 51, no. 2, Feb. 2012, Art. ID 027401.
27. Recommendation ITU-T P.1401: Methods, Metrics and Procedures for Statistical Evaluation, Qualification and Comparison of Objective Quality Prediction Models, document International Telecommunication Union, Jul. 2012.
28. Recommendation ITU-T J.341: Objective Perceptual Multimedia Video Quality Measurement of HDTV for Digital Cable Television in the Presence of a Full Reference, document International Telecommunication Union, Jan. 2011.
29. A. M. Rohaly et al., "Video quality experts group: Current results and future directions, " Proc. SPIE, vol. 4067, pp. 742-753, May 2000.
30. H. R. Sheikh and A. C. Bovik, "Image information and visual quality, " IEEE Trans. Image Process., vol. 15, no. 2, pp. 430-444, Feb. 2006.
31. L. Cui and A. R. Allen, "An image quality metric based on corner, edge and symmetry maps, " in Proc. Brit. Mach. Vis. Conf., 2008, pp. 1-10.
32. Z. Wang, L. Lu, and A. C. Bovik, "Video quality assessment based on structural distortion measurement, " Signal Process., Image Commun., vol. 19, no. 2, pp. 121-132, Feb. 2004.
33. Z. Wang, E. P. Simoncelli, and A. C. Bovik, "Multiscale structural similarity for image quality assessment, " in Proc. IEEE Asilomar Conf. Signals, Syst. Comput., Nov. 2003, pp. 1398-1402.
34. H. Tang, N. Joshi, and A. Kapoor, "Learning a blind measure of perceptual image quality, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2011, pp. 305-312.
35. X. Jiang, F. Meng, J. Xu, and W. Zhou, "No-reference perceptual video quality measurement for high definition videos based on an artificial neural network, " in Proc. IEEE Int. Conf. Comput. Elect. Eng., Phuket, Thailand, Dec. 2008, pp. 424-427.
36. D. Culibrk, D. Kukolj, P. Vasiljevíc, M. Pokríc, and V. Zlokolica, "Feature selection for neural-network based no-reference video quality assessment, " in Proc. 19th Int. Conf. Artif. Neural Netw., Limmassol, Cyprus, Sep. 2009, pp. 633-642.
37. J. Choe, J. Lee, and C. Lee, "No-reference video quality measurement using neural networks, " in Proc. 16th Int. Conf. Digital Signal Process., Santorini, Greece, Jul. 2009, pp. 1-4.
38. D. D. Kukolj, M. Pokríc, V. M. Zlokolica, J. Filipovíc, and M. Temerinac, "No-reference video quality assessment design framework based on modular neural networks, " in Proc. Int. Conf. Artif. Neural Netw., vol. 6352. Thessaloniki, Greece, Sep. 2010, pp. 569-574.
39. P. Gastaldo, S. Rovetta, and R. Zunino, "Objective quality assessment of MPEG-2 video streams by using CBP neural networks, " IEEE Trans. Neural Netw., vol. 13, no. 4, pp. 939-947, Jul. 2002.
40. P. Le Callet, C. Viard-Gaudin, and D. Barba, "A convolutional neural network approach for objective video quality assessment, " IEEE Trans. Neural Netw., vol. 17, no. 5, pp. 1316-1327, Sep. 2006.
41. C. Li, A. C. Bovik, and X. Wu, "Blind image quality assessment using a general regression neural network, " IEEE Trans. Neural Netw., vol. 22, no. 5, pp. 793-799, May 2011.
42. M. Narwaria and W. Lin, "Objective image quality assessment based on support vector regression, " IEEE Trans. Neural Netw., vol. 21, no. 3, pp. 515-519, Mar. 2010.
43. M. Narwaria, W. Lin, and A. Liu, "Low-complexity video quality assessment using temporal quality variations, " IEEE Trans. Multimedia, vol. 14, no. 3, pp. 525-535, Jun. 2012.
44. M. Dimitrievski and Z. Ivanovski, "Fusion of local degradation features for no-reference video quality assessment, " in Proc. IEEE Int. Workshop Mach. Learn. Signal Process. (MLSP), Santander, Spain, Sep. 2012, pp. 1-6.
45. Z. Shi, P. Chen, C. Feng, L. Huang, and W. Xu, "Research on quality assessment metric based on H.264/AVC bitstream, " in Proc. Int. Conf. Anti-Counterfeiting, Security Identificat. (ASID), Taipei, Taiwan, Aug. 2012, pp. 1-5.
46. S. Decherchi, P. Gastaldo, R. Zunino, E. Cambria, and J. Redi, "Circular-ELM for the reduced-reference assessment of perceived image quality, " Neurocomputing, vol. 102, pp. 78-89, Feb. 2013.
47. N. Staelens, D. Deschrijver, E. Vladislavleva, B. Vermeulen, T. Dhaene, and P. Demeester, "Constructing a no-reference H.264/AVC bitstreambased video quality metric using genetic programming-based symbolic regression, " IEEE Trans. Circuits Syst. Video Technol., vol. 23, no. 8, pp. 1322-1333, Aug. 2013.
48. Y. Altunbasak and N. Kamaci, "An analysis of the DCT coefficient distribution with the H.264 video coder, " in Proc. IEEE Int. Conf. Acoust., Speech Signal Process., vol. 3. Montreal, QC, Canada, May 2004, pp. 177-180.
49. Draft ITU-T Recommendation and Final Draft International Standard of Joint Video Specification, document ITU-T Rec. H.264 | ISO/IEC 14496-10 AVC, Geneva, Switzerland, May 2003.
50. R. Rojas, Neural Networks-A Systematic Introduction. Berlin, Germany: Springer-Verlag, 1996.
51. T. M. Cover and J. A. Thomas, Elements of Information Theory, 2nd ed. New York, NY, USA: Wiley, 2006.
52. Z. Wang and A. C. Bovik, Modern Image Quality Assessment, 1st ed. San Mateo, CA, USA: Morgan Kaufmann, 2006.
53. B. Schölkopf and A. J. Smola, Learning With Kernels: Support Vector Machines, Regularization, Optimization, and Beyond. Cambridge, MA, USA: MIT Press, 2002.
54. Y. Pitrey, M. Barkowsky, R. Pépion, P. Le Callet, and H. Hlavacs, "Influence of the source content and encoding configuration on the perceived quality for scalable video coding, " Proc. SPIE, vol. 8291, p. 82911K, Feb. 2012. [Online]. Available: http://130.66.64.103/spip.php?article771
55. M. Barkowsky, M. Pinson, R. Pépion, and P. Le Callet, "Influence of the source content and encoding configuration on the perceived quality for scalable video coding, " in Proc. 5th Int. Workshop Video Process. Quality Metrics, pp. 1-6, Jan. 2010. [Online]. Available: http://130.66.64.103/spip.php?article775
56. A. K. Moorthy, L. K. Choi, A. C. Bovik, and G. de Veciana, "Video quality assessment on mobile devices: Subjective, behavioral and objective studies, " IEEE J. Sel. Topics Signal Process., vol. 6, no. 6, pp. 652-671, Oct. 2012.
57. K. Seshadrinathan, R. Soundararajan, A. C. Bovik, and L. K. Cormack, "Study of subjective and objective quality assessment of video, " IEEE Trans. Image Process., vol. 19, no. 6, pp. 1427-1441, Jun. 2010.
58. S. Haykin, Neural Networks: A Comprehensive Foundation, 2nd ed. Englewood Cliffs, NJ, USA: Prentice-Hall, 1999.