The evolution of video quality measurement: From PSNR to hybrid metrics

IEEE Transactions on Broadcasting

Volumn 54, Issue 3, 2008, Pages 660-668

  Winkler, Stefan ^a   Mohandas, Praveen ^a  

^a Symmetricom   (United States)

Author keywords

Audiovisual quality; Objective metrics; Standards; Subjective assessment; Video quality

Indexed keywords

INDUSTRIAL ENGINEERING; LABELS; STANDARDIZATION;

AUDIOVISUAL QUALITY; BIT STREAMS; CURRENT STATE; EMERGING TRENDS; OBJECTIVE METRICS; QUALITY MEASUREMENTS; STANDARDS; SUBJECTIVE ASSESSMENT; SUBJECTIVE EXPERIMENTS; VIDEO QUALITY; VIDEO QUALITY EXPERTS GROUP; VIDEO QUALITY MEASUREMENT; VISUAL ATTENTION;

LABELING;

IMAGE QUALITY; INDUSTRIAL ENGINEERING; LABELING; LABELS; STANDARDS;

EID: 50549092673     PISSN: 00189316     EISSN: None     Source Type: Journal    
DOI: 10.1109/TBC.2008.2000733     Document Type: Article

References (55)

1. S. Winkler, Digital Video Quality - Vision Models and Metrics. : John Wiley & Sons, 2005.
2. A. J. Ahumada, Jr. and C. H. Null, "Image quality: A multidimensional problem," in Digital Images and Human Vision, A. B. Watson, Ed. Cambridge, MA: MIT Press, 1993, pp. 141-148.
3. S. A. Klein, "Image quality and image compression: A psychophysicist's viewpoint," in Digital Images and Human Vision, A. B. Watson, Ed. Cambridge, MA: MIT Press, 1993, pp. 73-88.
4. S. Jumisko-Pyykkö, J. Häkkinen, and G. Nyman, "Experienced quality factors - Qualitative evaluation approach to audiovisual quality," in Proc. SPIE Multimedia on Mobile Devices, San Jose, CA, January 28-31, 2007, vol. 6507.
5. P. G. Engeldrum, Psychometric Scaling: A Toolkit for Imaging Systems Development. Winchester, MA: Imcotek Press, 2000.
6. ITU-R Recommendation BT.500-11, "Methodology for the subjective assessment of the quality of television pictures," International Telecommunication Union, Geneva, Switzerland, 2002.
7. ITU-T Recommendation P.9.10, "Subjective Video Quality Assessment Methods for Multimedia Applications," International Telecommunication Union, Geneva, Switzerland, 1999.
8. ITU-T Recommendation P.911, Subjective Audiovisual Quality Assessment Methods for Multimedia Applications International Telecommunication Union, Geneva, Switzerland, 1998.
9. P. Corriveau, "Video quality testing," in Digital Video Image Quality and Perceptual Coding, H. R. Wu and K. R. Rao, Eds. Boca Raton, FL: CRC Press, 2006, ch. 4.
10. S. Winkler, "Video quality and beyond," in Proc. European Signal Processing Conference, Poznan, Poland, September 3-7, 2007, invited paper.
11. A. M. Eskicioglu and P. S. Fisher, "Image quality measures and their performance," IEEE Trans. Communications, vol. 43, no. 12, pp. 2959-2965, December 1995.
12. I. Avcrbas, B. Sankur, and K. Sayood, "Statistical evaluation of image quality measures," Journal of Electronic Imaging, vol. 11, no. 2, pp. 206-223, April 2002.
13. S. Winkler, "Perceptual video quality metrics - A review," in Digital Video Image Quality and Perceptual Coding, H. R. Wu and K. R. Rao, Eds. Boca Raton, FL: CRC Press, 2005, ch. 5.
14. S. Winkler, "Issues in vision modeling for perceptual video quality assessment," Signal Processing, vol. 78, pp. 231-252, October 1999.
15. J. L. Mannos and D. J. Sakrison, "The effects of a visual fidelity criterion on the encoding of images," IEEE Trans. Information Theory, vol. 20, no. 4, pp. 525-536, July 1974.
16. F. X. J. Lukas and Z. L. Budrikis, "Picture quality prediction based on a visual model," IEEE Trans. Communications, vol. 30, no. 7, pp. 1679-1692, July 1982.
17. S. Daly, "The visible differences predictor: An algorithm for the assessment of image fidelity," in Digital Images and Human Vision, A. B. Watson, Ed. Cambridge, MA: MIT Press, 1993, pp. 179-206.
18. J. Lubin and D. Fibush, "Sarnoff JND Vision Model," T1A1.5 Working Group Document #97-612, ANSI T1 Standards Committee, 1997.
19. C. J. van den Branden Lambrecht and O. Verscheure, "Perceptual quality measure using a spatio-temporal model of the human visual system," in Proc. SPIE Digital Video Compression: Algorithms and Technologies, San Jose, CA, January 28-February 2 1996, vol. 2668, pp. 450-461.
20. S. Winkler, "A perceptual distortion metric for digital color video," in Proc. SPIE Human Vision and Electronic Imaging, San Jose, CA, January 23-29, 1999, vol. 3644, pp. 175-184.
21. S. Süsstrunk and S. Winkler, "Color image quality on the Internet," in Proc. SPIE Internet Imaging, San Jose, CA, January 19-22, 2004, vol. 5304, pp. 118-131, invited paper.
22. Z. Wang, L. Lu, and A. C. Bovik, "Video quality assessment based on structural distortion measurement," Signal Processing: Image Communication, vol. 19, no. 2, pp. 121-132, February 2004.
23. M. H. Pinson and S. Wolf, "A new standardized method for objectively measuring video quality," IEEE Trans. Broadcasting, vol. 50, no. 3, pp. 312-322, September 2004.
24. O. Verscheure, P. Frossard, and M. Hamdi, "User-oriented QoS analysis in MPEG-2 delivery," Real-Time Imaging, vol. 5, no. 5, pp. 305-314, 1999.
25. S. Kanumuri, P. C. Cosman, A. R. Reibman, and V. A. Vaishampayan, "Modeling packet-loss visibility in MPEG-2 video," IEEE Trans. Multimedia, vol. 8, no. 2, pp. 341-355, 2006.
26. S. Kanumuri, S. G. Subramanian, P. C. Cosman, and A. R. Reibman, "Predicting H.264 packet loss visibility using a generalized linear model," in Proc. International Conference on Image Processing, Atlanta, GA, October 8-11, 2006, pp. 2245-2248.
27. S. Winkler, A. Sharma, and D. McNally, "Perceptual video quality and blockiness metrics for multimedia streaming applications," in Proc. International Symposium on Wireless Personal Multimedia Communications, Aalborg, Denmark, September 9-12, 2001, pp. 547-552, invited paper.
28. VQEG, "Final report from the Video Quality Experts Group on the Validation of Objective Models of Video Quality Assessment," April 2000 [Online]. Available: http://www.vqeg.org/
29. VQEG, "Final Report From the Video Quality Experts Group on the Validation of Objective Models of Video Quality Assessment - Phase II," August 2003 [Online]. Available: http://www.vqeg.org/
30. ITU-T Recommendation J.144, "Objective Perceptual Video Quality Measurement Techniques for Digital Cable Television in the Presence of a Full Reference," International Telecommunication Union, Geneva, Switzerland, 2004.
31. ITU-R Recommendation BT.1683, "Objective Perceptual Video Quality Measurement Techniques for Standard Definition Digital Broadcast Television in the Presence of a Full Reference," International Telecommunication Union, Geneva, Switzerland, 2004.
32. ITU-T Recommendation J.244, "Calibration Methods for Constant Misalignment of Spatial and Temporal Domains With Constant Gain and Offset," International Telecommunication Union, Geneva, Switzerland, 2008.
33. ITU-T Recommendation G.1070, "Opinion model for video-telephony applications," International Telecommunication Union, Geneva, Switzerland, 2007.
34. DSL Forum, Triple-play services quality of experience (QoE) requirements DSL Forum Architecture and Transport Working Group, Tech. Rep. TR-126, 2006.
35. Video Services Forum, VSF Test and Measurements Activity Group 2006, Tech. Rep..
36. A. E. Savakis, S. P. Etz, and A. C. Loui, "Evaluation of image appeal in consumer photography," in Proc. SPIE Human Vision and Electronic Imaging, San Jose, CA, January 23-28, 2000, vol. 3959, pp. 111-120.
37. S. N. Yendrikhovskij, F. J. J. Blommaert, and H. de Ridder, "Perceptually optimal color reproduction," in Proc. SPIE Human Vision and Electronic Imaging, San Jose, CA, January 26-29, 1998, vol. 3299, pp. 274-281.
38. S. Winkler, "Visual fidelity and perceived quality: Towards comprehensive metrics," in Proc. SPIE Human Vision and Electronic Imaging, San Jose, CA, January 21-26, 2001, vol. 4299, pp. 114-125.
39. J. Caviedes and F. Oberti, "No-reference quality metric for degraded and enhanced video," in Digital Video Image Quality and Perceptual Coding, H. R. Wu and K. R. Rao, Eds. : CRC Press, 2005, ch. 10.
40. S. Lee, M. S. Pattichis, and A. C. Bovik, "Foveated video quality assessment," IEEE Trans. Multimedia, vol. 4, no. 1, pp. 129-132, March 2002.
41. A. Cavallaro and S. Winkler, "Segmentation-driven perceptual quality metrics," in Proc. International Conference on Image Processing, Singapore, October 24-27, 2004, pp. 3543-3546.
42. W. Osberger and A. M. Rohaly, "Automatic detection of regions of interest in complex video sequences," in Proc. SPIE Human Vision and Electronic Imaging, San Jose, CA, January 21-26, 2001, vol. 4299, pp. 361-372.
43. L. Itti, "Automatic foveation for video compression using a neurobiological model of visual attention," IEEE Trans. Image Processing, vol. 13, no. 10, pp. 1304-1318, October 2004.
44. M. T. López, M. A. Fernández, A. Fernández- Caballero, J. Mira, and A. E. Delgado, "Dynamic visual attention model in image sequences," Image and Vision Computing, vol. 25, no. 5, pp. 597-613, May 2007.
45. O. Le Meur, P. Le Callet, and D. Barba, "Predicting visual fixations on video based on low-level visual features," Vision Research, vol. 47, no. 19, pp. 2483-2498, September 2007.
46. R. Steinmetz, "Human perception of jitter and media synchronization," IEEE Journal on Selected Areas in Communications, vol. 14, no. 1, pp. 61-72, January 1996.
47. R. Arrighi, D. Alais, and D. Burr, "Perceptual synchrony of audiovisual streams for natural and artificial motion sequences," Journal of Vision, vol. 6, no. 3, pp. 260-268, 2006.
48. M. Ries, R. Puglia, T. Tebaldi, O. Nemethova, and M. Rupp, "Audiovisual quality estimation for mobile streaming services," in Proc. International Symposium on Wireless Communication Systems, Siena, Italy, September 5-7, 2005.
49. S. Jumisko-Pyykkö, "I would like to see the subtitles and the face or at least hear the voice: Effects of picture ratio and audiovideo bitrate ratio on perception of quality in mobile television," Multimedia Tools and Applications, vol. 36, no. 1-2, pp. 167-184, January 2008.
50. S. Winkler and C. Faller, "Perceived audiovisual quality of low-bitrate multimedia content," IEEE Trans. Multimedia, vol. 8, no. 5, pp. 973-980, 2006.
51. M. P. Hollier and R. Voelcker, "Towards a multi-modal perceptual model," BT Technology Journal, vol. 15, no. 4, pp. 162-171, 1997.
52. C. Jones and D. J. Atkinson, "Development of opinion-based audiovisual quality models for desktop video-teleconferencing," in Proc. International Workshop on Quality of Service, Napa, CA, May 18-20, 1998, pp. 196-203.
53. J. G. Beerends and F. E. de Caluwe, "The influence of video quality on perceived audio quality and vice versa," Journal of the Audio Engineering Society, vol. 47, no. 5, pp. 355-362, May 1999.
54. D. S. Hands, "A basic multimedia quality model," IEEE Trans. Multimedia, vol. 6, no. 6, pp. 806-816, December 2004.
55. S. Winkler and C. Faller, "Audiovisual quality evaluation of low-bitrate video," in Proc. SPIE Human Vision and Electronic Imaging, San Jose, CA, January 16-20, 2005, vol. 5666, pp. 139-148.