Saliency inspired full-reference quality metrics for packet-loss-impaired video

IEEE Transactions on Broadcasting

Volumn 57, Issue 1, 2011, Pages 81-88

  Feng, Xin ^a   Liu, Tao ^a   Yang, Dan ^b   Wang, Yao ^c  

^a CHONGQING UNIVERSITY   (China)

^b Dialogic Research Inc   (United States)

^c POLYTECHNIC UNIVERSITY   (United States)

Author keywords

Attention change; Packet loss distortion; Saliency; Video quality assessment

Indexed keywords

ATTENTION CHANGE; COMBINED MODEL; ERROR MEASURES; MOTION INFORMATION; PERCEPTUAL QUALITY; PIXEL ERRORS; QUALITY METRICS; SALIENCY; SALIENCY DETECTION; SALIENCY MAP; SPATIAL DEVIATION; SPATIAL TEMPORALS; STEPWISE LINEAR REGRESSION; TEMPORAL VARIATION; VIDEO QUALITY ASSESSMENT; VISUAL ATTENTION; VISUAL SALIENCY; WEIGHTED AVERAGES;

ERRORS; PACKET LOSS; PIXELS; REGRESSION ANALYSIS; VIDEO SIGNAL PROCESSING; VISUALIZATION;

RATING;

EID: 79952003635     PISSN: 00189316     EISSN: None     Source Type: Journal    
DOI: 10.1109/TBC.2010.2092150     Document Type: Article

References (34)

1. S. Winker, "Issues in vision modeling for perceptual video quality assessment," Signal Processing, vol. 78, pp. 231-252, Oct. 1999.
2. W. Osberger, A. J. Maeder, and D. Mclean, "A computational model of the human visual system for image quality assessment," in Proc. Digital Image Computing: Techniques and Applications, Dec. 1997, pp. 337-342.
3. W. Osberger, N. Bergmann, and A. J. Maeder, "An automatic image quality assessment technique incorporating high level perceptual factors," in Proc. IEEE Int. Conf. Image Processing, Oct. 1998, pp. 414-418.
4. R. V. Babu, A. S. Bopardikar, A. Perkis, and O. I. Hillestad, "No-Reference metrics for video streaming applications," in Proc. Int. Workshop on Packet Video, Dec. 2004.
5. H. Rui, C. Li, and S. Qiu, "Evaluation of packet loss impairment on streaming video," J. of Zhejiang University SCIENCE, vol. 7, pp. 131-136, Apr. 2006. (Pubitemid 43851818)
6. O. Nemethova,M. Ries, M. Zavodsky, and M. Rupp, "PSNR-Based estimation of subjective time-variant video quality for mobiles," in Proc. Int. Conf. Measurement of Audio and Video Quality in Networks, Jun. 2006.
7. S. Kanumuri, S. G. Subramanian, P. C. Cosman, and A. R. Reibman, "Predicting H.264 packet loss visibility using a generalized linear model," in Proc. IEEE Int. Conf. Image Processing, Oct. 2006, pp. 2245-2248.
8. S. Kanumuri, P. C. Cosman, A. R. Reibman, and V. A. Vaishampayan, "Modeling packet-loss visibility in MPEG-2 video," IEEE Trans. Multimedia, vol. 8, no. 2, pp. 341-355, Apr. 2006.
9. A. Reibman and D. Poole, "Predicting packet-loss visibility using scene characteristics," in Proc. Int. Workshop on Packet Video, Nov. 2007, pp. 308-317.
10. T. Liu, Y.Wang, J. Boyce, H. Yang, and Z.Wu, "A novel video quality metric for low bitrate video considering both coding and packet loss artifacts," IEEE Journal of Selected Topics in Signal Processing, vol. 3, no. 2, pp. 280-293, Apr. 2009.
11. K. Seshadrinathan, R. Soundararajan, A. C. Bovik, and L. K. Cormack, "A subjective study to evaluate video quality assessment algorithms," in Proc. SPIE-Human Vision and Electronic Imaging, Jan. 2010.
12. A. K. Moorthy and A. C. Bovik, "Wireless video quality assessment: A study of subjective scores and objective algorithms," IEEE Trans. Circuits and Systems for Video Technology, vol. 20, no. 4, pp. 513-516, Apr. 2010.
13. L. Itti and C. Koch, "Computational modeling of visual attention," Nature Reviews Neuroscience, vol. 2, no. 3, pp. 194-203, Mar. 2001.
14. A. Ninassi and O. Le Meur et al., "Does where you gase on an image affect your perception of quality? Applying visual attention to image quality metric," in Proc. IEEE Int. Conf. Image Processing, Oct. 2007, vol. 2, pp. 169-172.
15. A. K. Moorthy and A. C. Bovik, "Visual importance pooling for image quality assessment," IEEE Journal of Selected Topics in Signal Processing, vol. 3, no. 2, pp. 193-201, Apr. 2009.
16. Z.Wang and A. C. Bovik et al., "Image quality assessment: From error visibility to structural similarity," IEEE Trans. Image Processing, vol. 13, no. 4, pp. 1-14, Apr. 2004.
17. U. Rajashekar, I. van der Linde, A. C. Bovik, and L. K. Cormack, "GAFFE: A gaze-attentive fixation finding engine," IEEE Trans. On Image Processing vol. 17, no. 4, pp. 564-573, 2008 [Online]. Available: http://live.ece.utexas.edu/research/gaffe, URL: (Pubitemid 351493879)
18. D. M. Rouse and S. S. Hemami, "Analyzing the role of visual structure in the recognition of natural image content with multi-scale SSIM," in Proc. SPIE-Human Vision and Electronic Imaging, 2008, vol. 6806.
19. Z. Lu et al., "Perceptual-quality significance map and its application on video quality distortion metrics," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing, Apr. 2003, vol. 3, pp. 617-620.
20. C. Oprea, I. Prinog, C. Paleologu, and M. Udrea, "Perceptual video quality assessment based on salient region detection," in Fifth Advanced International Conference on Telecommunications, May 2009, pp. 232-236.
21. L. Itti, C. Koch, and E. Niebur, "A model of saliency-based visual attention for rapid scene analysis," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 20, no. 11, pp. 1254-1259, Nov. 1998, x. (Pubitemid 128742001)
22. X. Feng, T. Liu, D. Yang, and Y. Wang, "Saliency based objective quality assessment of decoded video affected by packet losses," in Proc. IEEE Int. Conf. Image Processing, Oct. 2008, pp. 2560-2563.
23. T. Liu, X. Feng, A. Reibman, and Y. Wang, "Saliency inspired modeling of packet-loss visibility in decoded videos," in Fourth Int. Workshop on Video Processing and Quality Metrics for Consumer Electronics, Jan. 2009.
24. W. Osberger and A. J. Maeder, "Automatic identification of perceptually important regions in an image using a model of the human visual system," in Int. Conf. on Pattern Recognition, Aug. 1998, vol. 1, pp. 701-704.
25. SaliencyToolbox1.0 [Online]. Available: . net/ [online]:
26. D. Walther, "Interactions of visual attention and object recognition: computational modeling, algorithms, and psychophysics," PhD thesis, California Institute of Technology, Pasadena, CA, Feb. 23, 2006.
27. B. Hassenstein and W. Reichardt, "Systemtheoretische Analyse der Zeit-Reihenfolgen, und Vorzeihenauswertung bei der Bewegungsperzeption des Ruesselkaefers," Naturforch, vol. 11b, pp. 513-524, 1956.
28. "JM 10.0," [Online]. Available: index.htm
29. S. Bandyopadhyay et al., "Frame loss error concealment for H.264/ AVC," ISO/IEC MPEG and ITU-T VCEG, JVT-P072, 2005.
30. "Methodology for the subjective assessment of the quality of television pictures," ITU-R Rec.BT500-11, Jun. 2002.
31. "PolyVideoLab," [Online]. Available: . html/index.php?n= HomePage.PerceptualVideoQualityInPresenceOf- PacketLoss
32. L. Itti and P. Baldi, "A principle approach to detecting surprising events in video," in Proc. IEEE Int. Conf. Computer Vision and Pattern Recognition, San Diego, CA, Jun. 2005.
33. "R software," [Online]. Available:
34. M. H. Pinson and S.Wolf, "A new standardized method for objectively measuring video quality," IEEE Trans. Broadcast., no. 3, pp. 312-322, Sep. 2004.