Video quality assessment on mobile devices: Subjective, behavioral and objective studies

IEEE Journal on Selected Topics in Signal Processing

Volumn 6, Issue 6, 2012, Pages 652-671

  Moorthy, Anush Krishna ^a   Choi, Lark Kwon ^b   Bovik, Alan Conrad ^b   De Veciana, Gustavo ^b  

^a TEXAS INSTRUMENTS   (United States)

^b The University of Texas at Austin   (United States)

Author keywords

Mobile video quality; objective algorithm evaluations; subjective quality; video quality assessment; video quality database

Indexed keywords

ALGORITHM EVALUATION; MOBILE VIDEO; SUBJECTIVE QUALITY; VIDEO QUALITY; VIDEO QUALITY ASSESSMENT;

ALGORITHMS; CELLULAR TELEPHONES; DATABASE SYSTEMS; MOBILE PHONES; QUALITY CONTROL; STATISTICAL TESTS; VIDEO SIGNAL PROCESSING;

MOBILE DEVICES;

EID: 84866501132     PISSN: 19324553     EISSN: None     Source Type: Journal    
DOI: 10.1109/JSTSP.2012.2212417     Document Type: Article

References (46)

1. Cisco Visual Networking Index: Global Mobile Data Traffic Forecast Update, 2010-2015, CISCO Corp., 2011, [Online]. Available: http://www.cisco.com/ en/US/solutions/collateral/ns341/ns525/ns537/ns705/ns827/white-paper-c11-520862. html
2. Global Internet Phenomena Spotlight, Sandvine, 2011, [Online]. Available: http://www.sandvine.com/downloads/documents/05-17-2011-phenomena/ Sandvine%20Global%20Internet%20Phe-nomena%20Spotlight%20-%20Netflix%20Rising.pdf
3. FCC Warns of Impending Wireless Spectrum Shortage, PCWorld, 2010, [Online]. Available: http://www.pcworld.com/article/186434/fcc-warns-of- impending-wireless-spectrum-shortage.html
4. S. Higginbotham, Spectrum Shortage Will Strike in 2013, 2010, [Online]. Available: http://gigaom.com/2010/02/17/analyst-spec-trum-shortage-will-strike- in-2013
5. K. Seshadrinathan, R. Soundararajan, A. C. Bovik, and L. K. Cormack, "Study of subjective and objective quality assessment of video," IEEE Trans. Image Process., vol. 19, no. 2, pp. 1427-1441, Feb. 2010.
6. A. K. Moorthy, K. Seshadrinathan, R. Soundararajan, and A. C. Bovik, "Wireless video quality assessment: A study of subjective scores and objective algorithms'," IEEE Trans. Circuits Syst. Video Technol., vol. 20, no. 4, pp. 513-516, Apr. 2010.
7. Final Report from the Video Quality Experts Group on the Validation of Objective Quality Metrics for Video Quality Assessment Phase II, Video Quality Experts Group (VQEG), 2003, [Online]. Available: http://www.its.bldrdoc.gov/ vqeg/projects/frtv-phaseII
8. Final Report from the Video Quality Experts Group on the Validation of Objective Quality Metrics for Video Quality Assessment Phase I, Video Quality Experts Group (VQEG), 2000, [Online]. Available: http://www.its.bldrdoc.gov/ vqeg/projects/frtv-phaseI
9. Final Report of Video Quality Experts Group Multimedia Phase I Validation Test, TD 923, ITU Study Group 9, Video Quality Experts Group (VQEG), 2008.
10. F. D. Simone, M. Naccari, M. Tagliasacchi, F. Dufaux, S. Tubaro, and T. Ebrahimi, "Subjective assessment of h.264/avc video sequences transmitted over a noisy channel," in Proc. 1st Int. Workshop Quality of Multimedia Experience (QoMEX), Jul. 2009.
11. M. H. Pinson and S. Wolf, "A new standardized method for objectively measuring video quality," IEEE Trans. Broadcasting, vol. 50, no. 3, pp. 312-322, Sep. 2004.
12. K. Seshadrinathan and A. C. Bovik, "Motion tuned spatio-temporal quality assessment of natural videos," IEEE Trans. Image Process., vol. 19, no. 2, pp. 335-350, Feb. 2010.
13. Z. Wang and Q. Li, "Video quality assessment using a statistical model of human visual speed perception," J. Opt. Soc. Amer., vol. 24, no. 12, pp. B61-B69, Dec. 2007.
14. A. Watson, J. Hu, and J. McGowan, III, "Digital video quality metric based on human vision," J. Electron. Imag., vol. 10, p. 20, 2001.
15. S. R. Gulliver and G. Ghinea, "The perceptual and attentive impact of delay and jitterin multimedia delivery," IEEE Trans. Broadcasting, vol. 53, no. 2, pp. 449-458, Jun. 2007.
16. Q. Huynh-Thu and M. Ghanbari, "Impact of jitter and jerkiness on perceived video quality," in Proc. Workshop Video Process. Quality Metrics, 2006.
17. A.Eichhorn and P. Ni, "Pick your layers wisely-a quality assessment of h. 264 scalable video coding for mobile devices," in Proc. 2009 IEEE Int. Conf. Commun., 2009, pp. 5446-5451.
18. H. Knoche, J. McCarthy, and M. Sasse, "Can small be beautiful?: Assessing image resolution requirements for mobile tv," in Proc. 13th Annu. ACM Int. Conf. Multimedia, 2005, pp. 829-838.
19. S. Jumisko-Pyykko and J. Hakkinen, "Evaluation of subjective video quality of mobile devices," in Proc. 13th Annual ACM Int. Conf. Multimedia, 2005, pp. 535-538.
20. M. Ries, O. Nemethova, and M. Rupp, "Performance evaluation of mobile video quality estimators," in Proc. Eur. Signal Process. Conf., Poznan, Poland, 2007.
21. S. Jumisko-Pyykko and M. Hannuksela, "Does context matter in quality evaluation of mobile television?," in Proc. 10th Int. Conf. Human Comput. Interact. Mobile Devices and Services, 2008, pp. 63-72.
22. S. Winkler and F. Dufaux, "Video quality evaluation for mobile applications," in Proc. SPIE Conf. Vis. Commun. Image Process., Lugano, Switzerland, 2003, vol. 5150, pp. 593-603.
23. Joint Draft ITU-T Rec. H.264 \- ISO/IEC 14496-10/Amd.3 Scalable Video Coding, Joint Video Team (JVT) of ISO/IEC MPEG & ITU-T VCEG, [Online]. Available: http://www.hhi.fraun-hofer.de/fileadmin/hhi/downloads/IP/ip-ic-H.264- MPEG4-AVC-Ver-sion8-FinalDraft.pdf
24. A. K. Moorthy, L. K. Choi, G. deVeciana, and A. C. Bovik, "Subjective analysis of video quality on mobile devices," in Proc. 6th Int. Workshop Video Process. Quality Metrics (VPQM) (Invited Article), Jan. 2012.
25. H. Schwarz, D. Marpe, and T. Wiegand, "Overview of the scalable video coding extension of the h. 264/avc standard," IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 9, pp. 1103-1120, Sep. 2007.
26. SVC Reference Software (JSVM Software), Joint Video Team (JVT), [Online]. Available: http://ip.hhi.de/imagecom-G1/savce/down-loads/SVC-Reference- Software.htm
27. T. Stockhammer, M. Hannuksela, and T. Wiegand, "H.264/avc in wireless environments," IEEE Trans. Circuits Syst. Video Technol., vol. 13, no. 7, pp. 657-673, Jul. 2003.
28. B. Wandell, Foundations of Vision. Sunderland, MA: Sinauer, 1995.
29. BT-500-11: Methodology for the Subjective Assessment of the Quality of Television Pictures, Int. Telecommuncation Union Std..
30. M. H. Pinson and S. Wolf, "Comparing subjective video quality testing methodologies," in Proc. SPIE Vis. Commun. Image Process., 2003, vol. 5150.
31. The XGL Toolbox, 2008 [Online]. Available: http://128.83.207.86/jsp/ software/xgltoolbox-1.0.5.zip
32. K. Seshadrinathan and A. Bovik, "Temporal hysteresis model of time varying subjective video quality," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), 2011, pp. 1153-1156.
33. A. K. Moorthy and A. C. Bovik, "Visual importance pooling for image quality assessment," IEEE J. Sel. Topics Signal Process., Iss. on Visual Media Quality Assess., vol. 3, no. 2, pp. 193-201, Apr. 2009.
34. Z. Wang and X. Shang, "Spatial pooling strategies for perceptual image quality assessment," in Proc. IEEE Int. Conf. Image Process., 2006, pp. 2945-2948.
35. J. Park, K. Seshadrinathan, S. Lee, and A. Bovik, "Spatio-temporal quality pooling accounting for transient severe impairments and egomotion," in Proc. IEEE Int. Conf. Image Process. (ICIP), 2010, pp. 2509-2512.
36. M. Gaubatz, Metrix Mux Visual Quality Assessment Package, [Online]. Available: http://foulard.ece.cornell.edu/gaubatz/metrix-mux
37. Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, "Image quality assessment: From error measurement to structural similarity," IEEE Signal Process. Lett., vol. 13, no. 4, pp. 600-612, Apr. 2004.
38. Z. Wang, L. Lu, and A. Bovik, "Foveation scalable video coding with automatic fixation selection," IEEE Trans. Image Process., vol. 12, no. 2, pp. 243-254, Feb. 2003.
39. D. M. Chandler and S. S. Hemami, "VSNR: A wavelet-based visual signal-to-noise ratio for natural images," IEEE Trans. Image Process., vol. 16, no. 9, pp. 2284-2298, Sep. 2007.
40. H. R. Sheikh and A. C. Bovik, "Image information and visual quality," IEEE Trans. Image Process., vol. 15, no. 2, pp. 430-444, Feb. 2006.
41. Z. Wang and A. C. Bovik, "A universal image quality index," IEEE Signal Process. Lett., vol. 9, no. 3, pp. 81-84, Mar. 2002.
42. N. Damera-Venkata, T. D. Kite, W. S. Geisler, B. L. Evans, and A. C. Bovik, "Image quality assessment based on a degradation model," IEEE Trans. Image Process., vol. 9, no. 4, pp. 636-650, Sep. 2002.
43. J. Mannos and D. Sakrison, "The effects of a visual fidelity criterion on the encoding of images," IEEE Trans. Inf. Theory, vol. IT-20, no. 4, pp. 525-535, Jul. 1974.
44. Video Quality Metric, [Online]. Available: http://www.its.bl-drdoc.gov/ n3/video/VQM software.php
45. K. Seshadrinathan, Movie Software Release, 2010 [Online]. Available: http://live.ece.utexas.edu/research/Quality/movie.html
46. H. R. Sheikh, M. F. Sabir, and A. C. Bovik, "A statistical evaluation of recent full reference image quality assessment algorithms," IEEE Trans. Image Process., vol. 15, no. 11, pp. 3440-3451, Nov. 2006.