Evaluation of the effects of transmission impairments on perceived video quality by exploiting ReTRiEVED dataset

Journal of Electronic Imaging

Volumn 26, Issue 2, 2017, Pages

  Paudyal, Pradip ^a   Battisti, Federica ^a   Carli, Marco ^a  

^a ROMA TRE UNIVERSITY   (Italy)

Author keywords

network impairments; quality of experience; ReTRiEVED video dataset; subjective video quality assessment

Indexed keywords

PACKET LOSS; PACKET NETWORKS; QUALITY OF SERVICE; STATISTICAL TESTS; VIDEO RECORDING;

MULTIMEDIA NETWORKS; NETWORK IMPAIRMENTS; PERCEIVED QUALITY; PERCEIVED VIDEO QUALITY; QUALITY OF EXPERIENCE (QOE); SUBJECTIVE VIDEO QUALITY; TRANSMISSION IMPAIRMENT; VIDEO DATASET;

QUALITY CONTROL;

EID: 85015772783     PISSN: 10179909     EISSN: 1560229X     Source Type: Journal    
DOI: 10.1117/1.JEI.26.2.023003     Document Type: Article

References (65)

1. ITU-R, "Future spectrum requirements estimate for terrestrial IMT, " in ITU-R M.2290-0 Report (2013).
2. CISCO, "CISCO visual networking index forecast and methodology, 2013-2018, " in White Paper (2014).
3. K. Wang, et al., "Perceived 3D TV transmission quality assessment: multi-laboratory results using absolute category rating on quality of experience scale, " IEEE Trans. Broadcasting 58, 544-557 (2012).
4. C. Timmerer, T. Ebrahimi, and F. Pereira, "Toward a new assessment of quality, " Networks 7, 1-8 (2015).
5. ITU-T, "Definition of quality of experience (QoE), liaison statement from SG 12 to SG 2, " in SG12 TD 44 Rev1 (2004).
6. "Qualinet white paper on definitions of quality of experience (2012), " in European Network on Quality of Experience in Multimedia Systems and Services (COST Action IC 1003), P. Le Callet, S. Moller, and A. Perkis, Eds. (2013).
7. K. T. Chen, C. Tu, and W. Xiao, "Oneclick: a framework for measuring network quality of experience, " in INFOCOM, pp. 702-710 (2009).
8. R. Shmueli, et al., "Effects of an encoding scheme on perceived video quality transmitted over lossy internet protocol networks, " IEEE Trans. Broadcasting 54(3), 628-640 (2008).
9. Z. Wang, "Objective image quality assessment: facing the real-world challenges, " in IS&T Electronic Imaging-Image Quality and System Performance (Keynote Speech Paper), pp. 1-6, SPIE, San Francisco, California (2016).
10. A. Mittal, M. A. Saad, and A. C. Bovik, "A completely blind video integrity oracle, " IEEE Trans. Image Process. 25(1), 289-300 (2016).
11. P. Paudyal, F. Battisti, and M. Carli, "A study on the effects of quality of service parameters on perceived video quality, " in Fifth European Visual Information Processing (EUVIP) (2014).
12. K. Fliegel, "QUALINET multimedia databases v5.0, " http://dbq-wiki. multimediatech.cz/ (2014).
13. K. Seshadrinathan, et al., "LIVE video quality database, " http://live.ece. utexas.edu/research/quality/ (3 February 2017).
14. A. K. Moorthy, et al., "Video quality assessment on mobile devices: subjective, behavioral and objective studies, " IEEE J. Sel. Top. Signal Process. 6, 652-671 (2012).
15. F. De Simone, et al., "A H.264/AVC video database for the evaluation of quality metrics, " in Int. Conf. on Acoustics Speech and Signal Processing (ICASSP), pp. 2430-2433 (2010).
16. N. Staelens, et al., "High definition H.264/AVC subjective video database for evaluating the influence of slice losses on quality perception, " in Fifth Int. Workshop on Quality of Multimedia Experience (QoMEX), pp. 130-135 (2013).
17. Y. Pitrey, et al., "Influence of the source content and encoding configuration on the preceived quality for scalable video coding, " Proc. SPIE 8291, 82911K (2012).
18. Y. Pitrey, et al., "Aligning subjective tests using a low cost common set, " in Euro ITV QoEMCS (2011).
19. Y. Pitrey, et al., "Subjective quality of SVC-coded videos with different error-patterns concealed using spatial scalability, " in European Workshop on Visual Information Processing (EUVIP) (2011).
20. Video Quality Experts Group and Others, "Final report from the video quality experts group on the validation of objective models of video quality assessment, " http://www.vqeg.org (3 February 2017).
21. T. Liu, et al., "A novel video quality metric for low bit-rate video considering both coding and packet-loss artifacts, " J. Sel. Top. Signal Process. 3, 280-293 (2009).
22. M. P. Queluz, et al., "Quality assessment of H.264/AVC encoded sequences subject to transmission losses, " http://amalia.img.lx.it.pt/(3 February 2017).
23. J. Y. Lin, et al., "MCL-V: a streaming video quality assessment database, " J. Visual Commun. Image Represent. 30, 1-9 (2015).
24. F. Battisti, et al., "A study on the impact of AL-FEC techniques on TV over IP quality of experience, " EURASIP J. Adv. Signal Process. 2011(1), 86 (2011).
25. R. Shmueli, R. Huber, and O. Hadar, "Effects of frame rate, frame size and MPEG2 compression on the perceived compressed video quality transmitted over lossy IP networks, " in 2nd Int. Conf. on Information Technology: Research and Education (ITRE) (2004).
26. N. Chen, X. Jiang, and C. Wang, "Impact of packet loss distribution on the perceived IPTV video quality, " in 5th Int. Congress on Image and Signal Processing (CISP), pp. 38-42 (2012).
27. K. R. Laghari, et al., "Quality-of-experience perception for video streaming services: preliminary subjective and objective results, " in 2012 Asia-Pacific Signal and Information Processing Annual Summit and Conf. (APSIPA ASC), pp. 1-9 (2012).
28. C. Wang, and X. Jiang, "Video quality assessment for IPTV services: a survey, " in Int. Conf. on Computing and Convergence Technology (ICCCT), pp. 182-186 (2012).
29. S. Hussain, et al., "Dominant factors in the network domain that influence the QoE of an IPTV service, " in European Modelling Symp., pp. 629-634 (2013).
30. D. Ghadiyaram, et al., "Study of the effects of stalling events on the quality of experience of mobile streaming videos, " in IEEE Global Conf. on Signal and Information Processing (GlobalSIP), pp. 989-993 (2014).
31. T. N. Minhas, et al., "Mobile video sensitivity to packet loss and packet delay variation in terms of QoE, " in 19th Int. Packet Video Workshop, pp. 83-88 (2012).
32. M. Claypool, and J. Tanner, "The effects of jitter on the perceptual quality of video, " in Seventh ACM Int. Conf. on Multimedia (Part 2), pp. 115-118 (1999).
33. J. Nightingale, et al., "The impact of network impairment on quality of experience (QoE) in H.265/HEVC video streaming, " IEEE Trans. Consum. Electron. 60, 242-250 (2014).
34. P. Paudyal, F. Battisti, and M. Carli, "Impact of video content and transmission impairments on quality of experience, " Multimedia Tools Appl. 75(23), 16461-16485 (2016).
35. N. Dimitrova, et al., "Applications of video-content analysis and retrieval, " IEEE Multimedia 9, 42-55 (2002).
36. S. Winkler, "Analysis of public image and video databases for quality assessment, " IEEE J. Sel. Top. Signal Process. 6(6), 616-625 (2012).
37. O. Hadar, et al., "Effects of compression parameters on the perceived quality of video stream over a lossy internet protocol network, " Opt. Eng. 45(8), 087003 (2006).
38. M. A. Saad, A. C. Bovik, and C. Charrier, "Blind prediction of natural video quality, " IEEE Trans. Image Process. 23(3), 1352-1365 (2014).
39. M. H. Pinson, M. Barkowsky, and P. Le Callet, "Selecting scenes for 2D and 3D subjective video quality tests, " EURASIP J. Image Video Process. 2013(1), 1-12 (2013).
40. B. W. Keelan, and H. Urabe, "ISO 20462: a psychophysical image quality measurement standard, " Proc. SPIE 5294, 181 (2003).
41. ITU-T, "Subjective video quality assessment methods for multimedia applications, " in ITU-T Study Group 9 Recommendation, International Telecommunication Union, Geneva, Switzerland (2008).
42. CDVL, "Consumer Digital Video Library, " http://www.cdvl.org/(2014).
43. "Network emulation with NetEM, " http://www.linuxfoundation.org/collaborate/workgroups/networking/netem (2016).
44. ITU-R, "Methodology for the subjective assessment of the quality of television pictures, " in ITU-R BT.500-13 Recommendation International Telecommunication Union, Geneva, Switzerland (2012).
45. ITU-T, "Framework and methodologies for the determination and application of QoS parameters, " in ITU-T Study Group 2 Recommendation International Telecommunication Union, Geneva, Switzerland (2007).
46. ITU, "Opinion model for video-Telephony applications, " in ITU-T G.1070 Recommendation International Telecommunication Union, Geneva, Switzerland (2012).
47. ETSI, "Speech and multimedia transmission quality (STQ); end-To-end jitter transmission planning requirements for real time service in an NGN context, " in ETSI TR 103 210 V1.1.1 Recommendation International Telecommunication Union, Geneva, Switzerland (2013).
48. K. Seshadrinathan, et al., "Study of subjective and objective quality assessment of video, " IEEE Trans. Image Process. 19(6), 1427-1441 (2010).
49. T. Tominaga, et al., "Performance comparisons of subjective quality assessment methods for mobile video, " in Second Int. Workshop on Quality of Multimedia Experience (QoMEX), pp. 82-87 (2010).
50. K. Seshadrinathan, et al., "Study of subjective and objective quality assessment of video, " IEEE Trans. Image Process. 19, 1427-1441 (2010).
51. T. Kawano, K. Yamagishi, and T. Hayashi, "Performance comparison of subjective assessment methods for 3D video quality, " in Int. Workshop on Quality of Multimedia Experience (QoMEX), pp. 218-233 (2012).
52. J. Korhonen, et al., "How to evaluate objective video quality metrics reliably, " in Fourth Int. Workshop on Quality of Multimedia Experience (QoMEX), pp. 57-62 (2012).
53. R. McGill, J. W. Tukey, and W. A. Larsen, "Variations of box plots, " Am. Statistician 32(1), 12-16 (1978).
54. L. Anegekuh, et al., "Content-based video quality prediction for HEVC encoded videos streamed over packet networks, " IEEE Trans. Multimedia 17(8), 1323-1334 (2015).
55. Y. Chen, K. Wu, and Q. Zhang, "From QoS to QoE: a tutorial on video quality assessment, " Commun. Surv. Tutorials 17(2), 1126-1165 (2015).
56. D. Hasler, and S. E. Suesstrunk, "Measuring colorfulness in natural images, " Proc. SPIE 5007, 87 (2003).
57. Z.Wang, et al., "Image quality assessment: from error visibility to structural similarity, " IEEE Trans. Image Process. 13(4), 600-612 (2004).
58. W. Lin, and C.-C. J. Kuo, "Perceptual visual quality metrics: a survey, " J. Visual Commun. Image Represent. 22(4), 297-312 (2011).
59. R. M. Haralick, K. Shanmugam, and I. H. Dinstein, "Textural features for image classification, " IEEE Trans. Syst. Man Cybern. SMC-3, 610-621 (1973).
60. A. Mittal, R. Soundararajan, and A. C. Bovik, "Making a completely blind image quality analyzer, " IEEE Signal Process. Lett. 20, 209-212 (2013).
61. A. K. Moorthy, and A. C. Bovik, "A two-step framework for constructing blind image quality indices, " IEEE Signal Process. Lett. 17, 513-516 (2010).
62. A. Mittal, A. K. Moorthy, and A. C. Bovik, "No-reference image quality assessment in the spatial domain, " IEEE Trans. Image Process. 21, 4695-4708 (2012).
63. M. A. Saad, and A. C. Bovik, "Blind image quality assessment: a natural scene statistics approach in the DCT domain, " IEEE Trans. Image Process. 21, 3339-3352 (2012).
64. P. Paudyal, et al., "Video quality of experience metric for streaming services, " Electron. Imaging 2016(15), 1-5 (2016).
65. P. Paudyal, F. Battisti, and M. Carli, "ReTRiEVED Video Quality Database, " http://www.comlab.uniroma3.it/retrieved.htm (3 February 2017).