Recent advances and challenges of visual signal quality assessment

China Communications

Volumn 10, Issue 5, 2013, Pages 62-78

  Ma, Lin ^a,d   Deng, Chenwei ^b   Ngan, King Ngi ^a   Lin, Weisi ^c  

^a CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

^b BEIJING INSTITUTE OF TECHNOLOGY   (China)

^c NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^d Lenovo Group Ltd   (United States)

Author keywords

2D images and videos; human perception; Human Visual System; newly emerged visual signals; objective quality assessment

Indexed keywords

EID: 84878820027     PISSN: 16735447     EISSN: None     Source Type: Journal    
DOI: 10.1109/CC.2013.6520939     Document Type: Article

References (98)

1. ITU-T-P.800. Methods for Subjective Determination of Transmission Quality [S], 1996.
2. ITU-R BT.500-11. Methodology for the Subjective Assessment of the Quality of Television Pictures [S], 2000.
3. LIN Weisi, KUO J C. Perceptual Visual Quality Metrics: A Survey [J]. Journal of Visual Communication and Image Representation, 2011, 22(4): 297-312.
4. LIU T J, LIN Weisi, KUO J C.-C. Recent Developments and Future Trends in Visual Quality Assessment [C]//Proceedings of Asia-Pacific Signal and Information Processing Association Annual Submit and Conference, 2011 (APSIPA ASC 2011): October 18-21, 2011. Xi'an, China, 2011.
5. ENGELKE U, ZEPERNICK H. Perceptual-Based Quality Metrics for Image and Video Services: A Survey [C]//Proceedings of the 3rd EuroNGI Conference on Next Generation Internet Networks: May 21-23, 2007. Trondheim, Norway, 2007: 190-197. (Pubitemid 47439987)
6. WINKLER S, MOHANDAS P. The Evolution of Video Quality Measurement: from PSNR to Hybrid Metrics [J]. IEEE Transactions on Broadcasting, 2008, 54(3): 660-668.
7. WINKLER S. Analysis of Public Image and Video Databases for Quality Assessment [J]. IEEE Journal of Selected Topics in Signal Processing, 2012, 6(6): 616-625.
8. WANG Zhou, BOVIK A C, SHERKH H R, et al. Image Quality Assessment: from Error Visibility to Structural Similarity [J]. IEEE Transactions on Image Processing, 2004, 13(4): 600-612.
9. MA Lin, LI Songnan, NGAN K N. Visual Horizontal Effect for Image Quality Assessment [J]. IEEE Signal Processing Letters, 2010, 17(7): 627-630.
10. LIU Anming, LIN Weisi, NARWARIA M. Image Quality Assessment Based on Gradient Similarity [ J]. IEEE Transactions on Image Processing, 2012, 21(4): 1500-1512.
11. LI Songnan, ZHANG Fan, MA Lin, et al. Image Quality Assessment by Separately Evaluating Detail Losses and Additive Impairments [J]. IEEE Transactions on Multimedia, 2011, 13(5): 935-949.
12. WU Jinjian, LIN Weisi, SHI Guangming, et al. A Perceptual Quality Metric with Internal Generative Mechanism [J]. IEEE Transactions on Image Processing, 2013, 22(1): 43-54.
13. SHEIKH H R, BOVIK A C. Image Information and Visual Quality [J]. IEEE Transactions on Image Processing, 2006, 15(2): 430-444.
14. DALY S. The Visible Difference Predictor: An Algorithm for the Assessment of Image Fidelity [ M]. Cambridge, CA, USA: Digital Images and Human Vision, MIT Press, 1993.
15. WINKLER S. Digital Video Quality: Vision Models and Metrics, John Wiley and Sons [M]. Portland: Book News Inc., 2005.
16. ITU-T Recommendation J.247. Objective Perceptual Multimedia Video Quality Measurement in the Presence of a Full Reference [S], 2008.
17. YANG X K, LING W S, LU Z K, et al. Just Noticeable Distortion Model and Its Applications in Video Coding [J]. Signal Processing: Image Communication, 2005, 20(7): 662-680. (Pubitemid 41023703)
18. MA Lin, NGAN K N, ZHANG Fan, et al. Adaptive Block-Size Transform Based Just-Noticeable Difference Model for Images/Videos [J]. Signal Processing: Image Communication, 2011, 26(3): 162-174.
19. SESHADRINATHAN K, BOVIK A C. Motion Tuned Spatio-Temporal Quality Assessment of Natural Videos [J]. IEEE Transactions on Image Processing, 2010, 19(2): 335-350.
20. ZHANG Fan, MA Lin, LI Songnan, et al. Practical Image Quality Metric Applied to Image Coding [J]. IEEE Transactions on Multimedia, 2011, 13(4): 615-624.
21. NARWARIA M, LIN Weisi. SVD-Based Quality Metric for Image and Video Using Machine Learning [J]. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, 2012, 42(2): 347-364.
22. LI Songnan, MA Lin, NGAN K N. Full-Reference Video Quality Assessment by Decoupling Detail Losses and Additive Impairments [J]. IEEE Transactions on Circuit System for Video Technology, 2012, 22(7): 1100-1112.
23. LI Songnan, MA Lin, NGAN K N. Video Quality Assessment by Decoupling Additive Impairments and Detail Losses [C]//Proceedings of the 3rd International Workshop on Quality of Multimedia Experience (QoMEX 2011): September 7-9, 2011. Mechelen, Belgium, 2011: 90-95.
24. LI Songnan, NGAN K N. Subtractive Impairment, Additive Impairment, and Image Visual Quality [C]//Proceedings of 2010 IEEE International Symposium on Circuits and Systems (ISCAS 2010): May 30-June 2, 2010. Paris, France, 2010: 3373-3376.
25. DAMERA-VENKATA N, KITE T D, GEISLER W S, et al. Image Quality Assessment Based on a Degradation Model [J]. IEEE Transactions on Image Processing, 2000, 9(4): 636-650. (Pubitemid 30594731)
26. LARSON E C, CHANDLER D M. Most Apparent Distortion: Full-Reference Image Quality Assessment and the Role of Strategy [J]. Electronic Imaging, 2010, 19(1): 1-21.
27. ROUSE D M, PEPION R, HEMAMI S S, et al. Image Utility Assessment and a Relationship with Image Quality Assessment [J]. Human Vision Electronic Imaging, 2009, 7240: 724010-1-724010-14.
28. NARWARIA M, LIN Weisi. SVD-Based Quality Metric for Image and Video Using Machine Learning [J]. IEEE Transactions on Systems, Man, and Cybernetics, Part B, 2012, 42(2): 347-364.
29. NARWARIA M, LIN Weisi, CETIN A E. Scalable Image Quality Assessment with 2D Mel-Cepstrum and Machine Learning Approach [J]. Pattern Recognition, 2011, 45(1): 299-313.
30. NARWARIA M, LIN Weisi. Objective Image Quality Assessment Based on Support Vector Regression [J]. IEEE Transactions on Neural Networks, 2010, 21(3): 515-519.
31. LUO Huitao. A Training-Based No-Reference Image Quality Assessment Algorithm [C]//Proceedings of 2004 International Conference on Image Proceeding (ICIP 2004): October 24-27, 2004. Singapore, 2004: 2973-2976. (Pubitemid 40820698)
32. SURESH S, BABU V, SUNDARARAJAN N. Image Quality Measurement Using Sparse Extreme Learning Machine Classifier [C]//Proceedings of the 9th International Conference on Control, Automation, Robotics and Vision, 2006 (ICARCV 2006): December 5-8, 2006. Singapore, 2006: 1-6.
33. LIU T J, LIN Weisi, KUO C.-C J. A Multi-Metric Fusion Approach to Visual Quality Assessment [ C]//Proceedings of 2011 the 3rd International Workshop on Quality of Multimedia Experience (QoMEX): September 7-9, 2011. Mechelen, Belgium, 2011: 72-77.
34. NARWARIA M, LIN Weisi. Video Quality Assessment Using Temporal Quality Variations and Machine Learning [C]//Proceedings of 2011 IEEE International Conference on Multimedia and Expo (ICME): July 11-15, 2011. Barcelona, Spain, 2011: 1-6.
35. WOLF S, PINSON M. Low Bandwidth Reduced Reference Video Quality Monitoring System [C]//Proceedings of the 1st International Workshop on Video Processing and Quality Metrics for Consumer Electronics: January, 2005.
36. TAGLIASACCHI M, VALENZISE G, NACCARI M, et al. A Reduced-Reference Structural Similarity Approximation for Videos Corrupted by Channel Errors [J]. Multimedia Tools Application, 2010, 48(3): 471-492.
37. LE CALLET P, VIARD-GAUDIN C, BARBA D. A Convolutional Neural Network Approach for Objective Video Quality Assessment [J]. IEEE Transactions on Neural Network, 2006, 17(5): 1316-1327. (Pubitemid 46445187)
38. PINSON M.H, WOLF S. A New Standardized Method for Objectively Measuring Video Quality [J]. IEEE Transactions on Broadcasting, 2004, 50(3): 312-322.
39. REDI J.A, GASTALDO P, HEYNDERICKX I, et al. Color Distribution Information for Reduced-Reference Assessment of Perceived Image Quality [J]. IEEE Transactions on Circuit System Video Technology, 2010, 20(12): 1757-1769.
40. LI Qiang, WANG Zhou. Reduced-Reference Image Quality Assessment Using Divisive Normalization-Based Image Representation [J]. IEEE Journal of Selected Topics in Signal Processing, 2009, 3(2): 201-211.
41. WANG Zhou, WU Guixing, SHERIKH H.R, et al. Quality-Aware Images [J]. IEEE Transactions on Image Processing, 2006, 15(6): 1680-1689.
42. MA Lin, LI Songnan, ZHANG Fan, et al. Reduced-Reference Image Quality Assessment Using Reorganized DCT-Based Image Representation [ J]. IEEE Transactions on Multimedia, 2011, 13(4): 824-829.
43. MA Lin, LI Songnan, NGAN K N. Reduced-Reference Video Quality Assessment of Compressed Video Sequences [J]. IEEE Transactions on Circuit System Video Technology, 2012, 22(10): 1441-1456.
44. MA Lin, LI Songnan, ZHANG Fan, et al. Reduced-Reference Image Quality Assessment in Reorganized DCT Domain [J]. IEEE Transactions on Multimedia, 2011, 13(4): 824-829.
45. WANG Zhou, BOVIK A C. Reduced-and no-Reference Image Quality Assessment: the Natural Scene Statistics Model Approach [J]. IEEE Signal Processing Magazine, 2011, 28(6): 29-40.
46. LIANG Luhong, WANG Shiqi, CHEN Jianhua, et al. No-Reference Perceptual Image Quality Metric Using Gradient Profiles for JPEG 2000 [J]. Signal Processing: Image Communication, 2010, 25(7): 502-516.
47. BRANDAO T, QUELUZ M P. No-Reference Image Quality Assessment Based on DCT Domain Statistics [J]. Signal Processing, 2008, 88(4): 822-833.
48. WANG Zhou, SHEIKH H R, BOVIK A C. No-Reference Perceptual Quality Assessment of JPEG Compressed Images [C]//Proceedings of 2002 International Conference on Image Processing (ICIP 2002): September 22-25, 2002. Rochester, NY, USA, 2002: I-477-I-480.
49. FERZLI R, KARAM L J. A No-Reference Objective Image Sharpness Metric Based on the Notion of Just Noticeable Blur (JNB) [J]. IEEE Transactions on Image Processing, 2009, 18(4): 717-728.
50. SHEIKH H R, BOVIK A C, CORMARK L. No-Reference Quality Assessment Using Nature Scene Statistics: JPEG 2000 [J]. IEEE Transactions on Image Processing, 2005, 14(11): 1918-1927. (Pubitemid 41646081)
51. MITTAL A, MURALIDHAR G S, GHOSH J, et al. Blind Image Quality Assessment without Human Training Using Latent Quality Factors [J]. IEEE Signal Processing Letters, 2012, 19(2): 75-78.
52. SAAD M A, BOVIK A C, CHARRIER C. A Perceptual DCT Statistics Based Blind Image Quality Metric [J]. IEEE Signal Processing Letters, 2010, 17(6): 583-586.
53. MOORTHY A K, BOVIK A C. Blind Image Quality Assessment: from Natural Scene Statistics to Perceptual Quality [J]. IEEE Transactions on Image Processing, 2011, 20(12): 3350-3364.
54. HEMAMI S S, REIBMAN A R. No-Reference Image and Video Quality Estimation: Applications and Human-Motivated Design [J]. Image Communication, 2010, 25(7): 469-481.
55. Video Coding Experts Group (VCEG). Joint call for proposals on scalable video coding extensions of high efficiency video coding (HEVC) [R]. 2012.
56. LEE J S, SIMONE F D, RAMZAN N, et al. Subjective Evaluation of Scalable Video Coding for Content Distribution [C]//Proceedings of the International Conference on Multimedia (MM'10): October 25-29, 2010. Firenze, France, 2010: 65-72.
57. ZHAI Guangtao, CAI Jianfei, LIN Weisi, et al. Cross-Dimensional Perceptual Quality Assessment for Low Bit-Rate Videos [J]. IEEE Transactions on Multimedia, 2008, 10(7): 1316-1324.
58. MOORTHY A K, CHOI L K, BOVIK A C, et al. Video Quality Assessment on Mobile Devices: Subjective, Behavioral and Objective Studies [ J]. IEEE Journal of Selected Topics in Signal Processing, 2012, 6(6): 652-671.
59. YEGANEH H, WANG Zhou. Objective Quality Assessment of Tone Mapped Images [J]. IEEE Transactions on Image Processing, 2013, 22(2): 657-667.
60. YEGANEH H, WANG Zhou. Objective Quality Assessment of Tone Mapping Algorithms [C]//Proceedings of the 17th IEEE International Conference on Image Processing (ICIP 2010): September 26-29, 2010. Hong Kong, China, 2010: 2477-2480.
61. AYDIN T O, MANTIUK R, MYSZKOWSKI K, et al. Dynamic Range Independent Image Quality Assessment [J]. ACM Transactions on Graphics, 2008, 27(3): 69.
62. CADIK M, HAJDOK O, LEJSEK A, et al. Evaluation of Tone Mapping Operators [EB/OL]. http://www.cgg.cvut.cz/members/cadikm/tmo.
63. LIU Jianqing, YANG Y. Multiresolution Color Image Segmentation [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1994, 16(7): 689-700.
64. BORSOTTI M, CAMPADELLI P, SCHETTINI P C. Quantitative Evaluation of Color Image Segmentation Results [J]. Pattern Recognition Letter, 1998, 19(8): 741-747. (Pubitemid 128381339)
65. ZHANG Hui, FRITTS J E, GOLDMAN S A. An Entropy-Based Objective Segmentation Evaluation Method for Image Segmentation [J]. SPIE-Electronic Imaging Storage and Retrieval Methods and Applications for Multimedia, 2004, 5307: 38-49.
66. REN Xiaofeng, MALIK J. Learning a Classification Model for Segmentation [C]//Proceedings of the 9th IEEE International Conference on Computer Vision, 2003 (ICCV): October 13-16, 2003. Nice, France, 2003: 10-17.
67. CHRISTENSEN H I, PHILLIPS P J. Empirical Evaluation Methods in Computer Vision [M]. Singapore: World Scientific Publishing Company, 2002.
68. MARTIN D, FOWLKES C, TAL D, et al. A Database of Human Segmented Natural Images and Its Application to Evaluating Segmentation Algorithms and Measuring Ecological Statistics [C]//Proceedings of the 8th IEEE International Conference on Computer Vision, 2001 (ICCV 2001): July 7-14, 2001. Vancouver, BC, Canada, 2001: 416-423. (Pubitemid 32795086)
69. FREXENET J, MUNOZ X, RABA D, et al. Yet Another Survey on Image Segmentation: Region and Boundary Information Integration [C]//Proceedings of the 7th European Conference on Computer Vision-Part III (ECCV'02): May 28-31, 2002. Copenhagen, Denmark, 2002: 408-422.
70. MARTIN D R. An Empirical Approach to Grouping and Segmentation [D]. San Francisco, USA: University of California, Berkeley, 2002.
71. RAND W M. Objective Criteria for the Evaluation of Clustering Methods [J]. Journal of the American Statistical Association, 1971, 66(336): 846-850.
72. FOWLKES E B, MALLOWS C L. A Method for Comparing Two Hierarchical Clusterings [J]. Journal of the American Statistical Association, 1983, 78(833): 553-569.
73. UNNIKRISHNAN R, HEBERT M. Measures of Similarity [J]. IEEE Workshop on Applications of Computer Vision, 2005, 1: 394-400.
74. PENG Bo, ZHANG Lei. Evaluation of Image Segmentation Quality by Adaptive Ground Truth Composition [J]. Lectures Notes in Computer Science, 2012, 7574: 287-300.
75. MARTIN D R, FOWLKES C C, MALIK J. Learning to Detect Natural Image Boundaries Using Local Brightness, Color and Texture Cues [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2004, 26(5): 530-549.
76. SAMPAT M P, WANG Zhou, GUPTA S, et al. Complex Wavelet Structural Similarity: A New Image Similarity Index [J]. IEEE Transactions on Image Processing, 2009, 18(11): 2385-2401.
77. MOORTHY A K, SU Chechun, MITTAL A, et al. Subjective Evaluation of Stereoscopic Image Quality [J]. Signal Processing: Image Communication, 2012.
78. LEBRETON P, RAAKE A, BARKOWSKY M, et al. Evaluating Depth Perception of 3D Stereoscopic Videos [J]. IEEE Journal of Selected Topics in Signal Processing, 2012, 6(6): 710-720.
79. BOSC E, PEPION R, LE CALLET P, et al. Towards a New Quality Metric for 3-D Synthesized View Assessment [J]. IEEE Journal of Selected Topics in Signal Processing, 2011, 5(7): 1332-1343.
80. HEWAGE C T E R, MARTINI M G. Reduced-Reference Quality Assessment for 3D Video Compression and Transmission [J]. IEEE Transactions on Consumer Electronics, 2011, 57(3): 1185-1193.
81. MOORTHY A K, BOVIK A C. A Two-Step Framework for Constructing blind Image Quality Indices [J]. IEEE Signal Processing Letters, 2011, 17(2): 587-599.
82. BENOIT A, LE CALLET P, CAMPISI P, et al. Quality Assessment of Stereoscopic Images [J]. EURASIP Journal on Image and Video Processing, 2009: 1-13.
83. HEWAGE C T E R, MARTINI M G. Reduced-Reference Quality Metric for 3D Depth Map Transmission [C]//Proceedings of 3DTV-Conference: The True Vision-Capture, Transmission and Display of 3D Video (3DTV-CON), 2010: June 7-9, 2010. Tampere, Finland, 2010: 1-4.
84. YOU Junyong, XING Liyuan, PERKIS A, et al. Perceptual Quality Assessment for Stereoscopic Images Based on 2D Image Quality Metrics and Disparity Analysis [C]//Proceedings of the 5th International Workshop on Video Processing and Quality Metrics (VPQM 2010): January 13-15, 2010. Scottsdale, Arizona, USA, 2010: 281-316.
85. GORLEY P, HOLLIMAN N. Stereoscopic Image Quality Metrics and Compression [J]. Stereoscopic Displays and Applications, 2008, 6803.
86. SHEN Lili, YANG Jiachen, ZHANG Zhouyun. Stereo Picture Quality Estimation Based on a Multiple Channel HVS Model [C]//Proceedings of the 2nd International Congress on Image and Signal Processing, 2009 (CISP'09): October 17-19, 2009. Tianjin, China, 2009: 1-4.
87. YANG Jiachen, HOU Chunping, ZHOU Yuan, et al. Objective Quality Assessment Method of Stereo Images [C]//Proceedings of 3DTV Conference: The True Vision-Capture, Transmission and Display of 3D Video, 2009: May 4-6, 2009. Potsdam, Germany, 2009: 1-4.
88. ZHU Zhongjie, WANG Yuer. Perceptual Distortion Metric for Stereo Video Quality Evaluation [ J]. WSEAS Transactions on Signal Processing, 2009, 5(7): 241-250.
89. AKHTER R, SAZZAD Z M P, HORITA Y, et al. No Reference Stereoscopic Image Quality Assessment [ J]. Stereoscopic Displays and Applications, 2010, 7524: 752407-752407-12.
90. RUBINSTEIN M, GUTIERREZ D, SORKINE O, et al. A Comparative Study of Image Retargeting [ C]//Proceedings of the 3rd ACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia: December 15-18, 2010. Hong Kong, China, 2010: 160.
91. MA Lin, LIN Weisi, DENG Chenwei, et al. Image Retargeting Quality Assessment: A Study of Subjective Scores and Objective Metrics [J]. IEEE Journal of Selected Topics in Signal Processing, 2012, 6(6): 626-639.
92. MA Lin, LIN Weisi, DENG Chenwei, et al. Study of subjective and Objective Quality Assessment of Retargeted Images [C]//Proceedings of 2002 International Conference Symposium on Circuits and Systems (ISCAS 2012): May 20-23, 2012. Seoul, Korea, 2012: 626-639.
93. MANJUNATH B S, OHM J, VASUDEVAN V V, et al. Color and Texture Descriptors [J]. IEEE Transactions on Circuits Systems for Video Technology, 2001, 11(6): 703-715.
94. LIU Ce, YUEN J, TORRALBA A, et al. SIFT Flow: Dense Correspondence across Different Scenes [ C]//Proceedings of the 10th European Conference on Computer Vision: Part III (ECCV'08): October 12-18, 2008. Marseille, France, 2008: 28-42.
95. SIMAKOV D, CASPI Y, SHECHTMAN E, et al. Summarizing Visual Data Using Bidirectional Similarity [C]//Proceedings of IEEE Conference on Computer Vision and Pattern Recognition 2008 (CVPR 2008): June 23-28, 2008. Anchorage, Alsaka, USA, 2008: 1-8.
96. BARNES C, SHECHTMAN E, FINKELSTEIN A, et al. PatchMatch: A Randomized Correspondence Algorithm for Structural Image Editing [ C]//Proceedings of the International Conference and Exhibition on Computer Graphics and Interactive Techniques (SIGGRAPH): August 3-7, 2009. New Orleans, Louisiana, USA, 2009: 24.
97. PELE O, WERMAN M. Fast and Robust Earth Mover's Distances [C]//Proceedings of 2009 IEEE 12th International Conference on Computer Vision: September 29-October 2, 2009. Kyoto, Japan, 2009: 460-467.
98. RUBNER Y, TOMASI C, GUIBAS L J. The Earth Mover's Distance as a Metric for Image Retrieval [ J]. International Journal of Computer Vision, 2000, 40(2): 99-121. (Pubitemid 32136368)