No-reference video quality measurement: Added value of machine learning

Journal of Electronic Imaging

Volumn 24, Issue 6, 2015, Pages

  Mocanu, Decebal Constantin ^a   Pokhrel, Jeevan ^b   Garella, Juan Pablo ^c   Seppänen, Janne ^d   Liotou, Eirini ^e   Narwaria, Manish ^f  

^a EINDHOVEN UNIVERSITY OF TECHNOLOGY   (Netherlands)

^b Montimage   (France)

^c UNIVERSIDAD DE LA REPÚBLICA   (Uruguay)

^d VTT TECHNICAL RESEARCH CENTRE OF FINLAND   (Finland)

^e UNIVERSITY OF ATHENS   (Greece)

^f DHIRUBHAI AMBANI INSTITUTE OF INFORMATION AND COMMUNICATION TECHNOLOGY   (India)

Author keywords

deep learning; no reference video quality assessment; objective studies; quality of experience; subjective studies

Indexed keywords

ARTIFICIAL INTELLIGENCE; DIGITAL TELEVISION; FORECASTING; IMAGE QUALITY; LEARNING SYSTEMS; MOBILE TELECOMMUNICATION SYSTEMS; QUALITY OF SERVICE; TELEVISION BROADCASTING;

DEEP LEARNING; NO-REFERENCE VIDEO QUALITY ASSESSMENTS; OBJECTIVE STUDIES; QUALITY OF EXPERIENCE (QOE); SUBJECTIVE STUDIES;

QUALITY CONTROL;

EID: 84954195661     PISSN: 10179909     EISSN: 1560229X     Source Type: Journal    
DOI: 10.1117/1.JEI.24.6.061208     Document Type: Article

References (46)

1. Qualinet, "Qualinet white paper on definitions of quality of experience," 3 June 2012, http://www.qualinet.eu/images/stories/whitepaper-v1.1-dagstuhl-output-corrected.pdf (12 December 2015).
2. S. Chikkerur et al., "Objective video quality assessment methods: a classification, review, performance comparison," IEEE Trans. Broadcast. 57, 165-182 (2011).
3. ITU-R, "Methodology for the subjective assessment of the quality of television pictures," January 2012, http://www.itu.int/dms-pubrec/itu-r/rec/bt/R-REC-BT.500-13-201201-I!!PDF-E.pdf (12 December 2015).
4. P. Gastaldo, S. Rovetta, R. Zunino, "Objective quality assessment of MPEG-2 video streams by using CBP neural networks," IEEE Trans. Neural Netw. 13, 939-947 (2002).
5. P. Le Callet, C. Viard-Gaudin, D. Barba, "A convolutional neural network approach for objective video quality assessment," IEEE Trans. Neural Netw. 17, 1316-1327 (2006).
6. J. Xu et al., "No-reference video quality assessment via feature learning," in IEEE Int. Conf. on Image Processing, pp. 491-495 (2014).
7. K. Zhu et al., "No-reference video quality assessment based on artifact measurement, statistical analysis," IEEE Trans. Circuits Syst. Video Technol. 25(4), 533-546 (2015).
8. N. Staelens et al., "Constructing a no-reference H.264/AVC bitstreambased video quality metric using genetic programming-based symbolic regression," IEEE Trans. Circuits Syst. Video Technol. 23, 1322-1333 (2013).
9. J. Sogaard, S. Forchhammer, J. Korhonen, "No-reference video quality assessment using codec analysis," IEEE Trans. Circuits Syst. Video Technol. 25(10), 1637-1650 (2015).
10. B. Konuk et al., "A spatiotemporal no-reference video quality assessment model," in 20th IEEE Int. Conf. on Image Processing, pp. 54-58 (2013).
11. M. Shahid et al., "No-reference image, video quality assessment: a classification, review of recent approaches," EURASIP J. Image Video Process. 2014(1), 40 (2014).
12. T. Hastie, R. Tibshirani, J. Friedman, The Elements of Statistical Learning, Springer New York Inc., New York (2001).
13. S. Mohamed, G. Rubino, "A study of real-time packet video quality using random neural networks," IEEE Trans. Circuits Syst. Video Technol. 12, 1071-1083 (2002).
14. Y. Bengio, "Learning deep architectures for AI," Found. Trends Mach. Learn. 2, 1-127 (2009).
15. J. P. Garella et al., "Subjective video quality test: methodology, database, experience," in IEEE Int. Symp. on Broadband Multimedia Systems, Broadcasting, pp 1-6 (2015).
16. E. Karapanos, J.-B. Martens, M. Hassenzahl, "Accounting for diversity in subjective judgments," in Proc. of the SIGCHI Conf. on Human Factors in Computing Systems, pp. 639-648, ACM, New York (2009).
17. T. Hobfeld, R. Schatz, S. Egger, "SOS: the MOS is not enough!," in Third Int. Workshop on Quality of Multimedia Experience, pp. 131-136 (2011).
18. J. Joskowicz et al., "Automation of subjective video quality measurements," in Proc. of the Latin America Networking Conf., pp. 7:1-7:5, ACM (2014).
19. S. Péchard, R. Pépion, P. Le Callet, "Suitable methodology in subjective video quality assessment: a resolution dependent paradigm," in Int. Workshop on Image Media Quality, its Applications, p. 6 (2008).
20. J. Joskowicz, R. Sotelo, "A model for video quality assessment considering packet loss for broadcast digital television coded in H.264," Int. J. Digit. Multimed. Broadcast. 2014(5786), 11 (2014).
21. C. Cramer, E. Gelenbe, P. Gelenbe, "Image, video compression," IEEE Potentials 17, 29-33 (1998).
22. H. Bakrcolu, T. Kocąk, "Survey of random neural network applications," Eur. J. Oper. Res. 126(2), 319-330 (2000).
23. E. Gelenbe, "Stability of the random neural network model," Neural Comput. 2, 239-247 (1990).
24. K. Singh, G. Rubino, "Quality of experience estimation using frame loss pattern, video encoding characteristics in DVB-H networks," in 18th Int. Packet Video Workshop, pp. 150-157 (2010).
25. K. Singh, Y. Hadjadj-Aoul, G. Rubino, "Quality of experience estimation for adaptive HTTP/TCP video streaming using H.264/AVC," in IEEE Consumer Communications, Networking Conf., pp. 127-131 (2012).
26. E. Aguiar et al., "Video quality estimator for wireless mesh networks," in IEEE 20th Int. Workshop on Quality of Service, pp. 1-9 (2012).
27. N. Jones, "Computer science: the learning machines," Nature 505(7482), 146-148 (2014).
28. J. Laserson, "From neural networks to deep learning: zeroing in on the human brain," XRDS 18, 29-34 (2011).
29. H. Larochelle, Y. Bengio, "Classification using discriminative restricted Boltzmann machines," in Proc. of the 25th Int. Conf. on Machine Learning, pp. 536-543, ACM, New York (2008).
30. R. Salakhutdinov, A. Mnih, G. Hinton, "Restricted Boltzmann machines for collaborative filtering," in Proc. of the 24th Int. Conf. on Machine Learning, pp. 791-798, ACM, New York (2007).
31. H. Ammar et al., "Automatically mapped transfer between reinforcement learning tasks via three-way restricted Boltzmann machines," Lec. Notes Comput. Sci. 8189, 449-464 (2013).
32. E. Mocanu et al., "Inexpensive user tracking using Boltzmann machines," in IEEE Int. Conf. on Systems, Man, Cybernetics, pp. 1-6 (2014).
33. P. V. Gehler, A. D. Holub, M. Welling, "The rate adapting Poisson model for information retrieval, object recognition," in Proc. of the 23rd Int. Conf. on Machine Learning, pp. 337-344, ACM, New York (2006).
34. D. C. Mocanu et al., "Factored four way conditional restricted Boltzmann machines for activity recognition," Pattern Recognit. Lett. 66, 100-108 (2015).
35. D. Mocanu, G. Exarchakos, A. Liotta, "Deep learning for objective quality assessment of 3D images," in IEEE Int. Conf. on Image Processing, pp. 758-762 (2014).
36. D. Mocanu et al., "Reduced reference image quality assessment via Boltzmann machines," in IFIP/IEEE Int. Symp. on Integrated Network Management, pp. 1278-1281 (2015).
37. H. Tang, N. Joshi, A. Kapoor, "Blind image quality assessment using semi-supervised rectifier networks," in IEEE Conf. on Computer Vision, Pattern Recognition, pp. 2877-2884 (2014).
38. D. Ghadiyaram, A. Bovik, "Blind image quality assessment on real distorted images using deep belief nets," in IEEE Global Conf. on Signal, Information Processing, pp. 946-950 (2014).
39. P. Smolensky, "Information processing in dynamical systems: foundations of harmony theory, in Parallel Distributed Processing: Explorations in the Microstructure of Cognition," Vol. 1, D. E. Rumelhart, J. L. McClelland, PDP Research Group, pp. 194-281, MIT Press, Cambridge, Massachusetts (1986).
40. G. E. Hinton, S. Osindero, Y.-W. Teh, "A fast learning algorithm for deep belief nets," Neural Comput. 18, 1527-1554 (2006).
41. D. Rumelhart, G. Hintont, R. Williams, "Learning representations by back-propagating errors," Nature 323(6088), 533-536 (1986).
42. G. E. Hinton, "A practical guide to training restricted Boltzmann machines," Lec. Notes Comput. Sci. 7700, 599-619 (2012).
43. Changlin Liu, Luca Muscariello, "Quality of Experience Estimation using Random Neural Networks," July 2011, https://code.google.com/p/qoe-rnn/(7 March 2015).
44. F. Pedregosa et al., "Scikit-learn: Machine learning in Python," J. Mach. Learn. Res. 12, 2825-2830 (2011).
45. VQEG, "Final report from the video quality experts group on the validation of objective models of video quality assessment," ITU-T SG09, ITU (International Telecommunication Union), Geneva, Switzerland (2003).
46. M. Varela et al., "Towards an understanding of visual appeal in website design," in Fifth Int. Workshop on Quality of Multimedia Experience, pp. 70-75 (2013).