Subjective quality evaluation VIA paired comparison: Application to scalable video coding

IEEE Transactions on Multimedia

Volumn 13, Issue 5, 2011, Pages 882-893

  Lee, Jong Seok ^a   De Simone, Francesca ^a   Ebrahimi, Touradj ^a  

^a EPFL   (Switzerland)

Author keywords

Bradley Terry model; content distribution; multimedia quality assessment; paired comparison; scalable video coding; subjective test

Indexed keywords

BRADLEY-TERRY MODELS; CONTENT DISTRIBUTION; MULTIMEDIA QUALITY; PAIRED COMPARISON; SCALABLE VIDEO CODING; SUBJECTIVE TESTS;

IMAGE CODING; INTERACTIVE COMPUTER SYSTEMS; MULTIMEDIA SERVICES; MULTIMEDIA SYSTEMS; OPTIMIZATION; RELIABILITY ANALYSIS; SCALABILITY; USER INTERFACES;

QUALITY CONTROL;

EID: 80052932019     PISSN: 15209210     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMM.2011.2157333     Document Type: Article

References (23)

1. J.-R. Ohm, "Advances in scalable video coding, " Proc. IEEE, vol. 93, no. 1, pp. 42-56, Jan. 2005.
2. Methodology for the Subjective Assessment of the Quality of Television Pictures, Geneva, Switzerland, 2002, Recommendation ITU-R BT.500-11.
3. K.-T. Chen, C.-C. Wu, Y.-C. Chang, and C.-L. Lei, "A crowdsourceable QoE evaluation framework for multimedia content, " in Proc. ACM Multimedia, Oct. 2009, pp. 491-500.
4. S. Voran and A. Catellier, "Gradient ascent paired-comparison subjective quality testing, " in Proc. Int. Workshop Quality of Multimedia Experience, San Diego, CA, 2009, pp. 133-138.
5. R. A. Doherty, A. C. Younkin, and P. J. Corriveau, "Paired comparison analysis for frame rate conversion algorithms, " in Proc. Int. Workshop Video Processing and Quality Metrics for Consumer Electronics, Scottsdale, AZ, Jan. 2009.
6. R. Rajendran, M. van der Schaar, and S.-F. Chang, "FGS+: Optimizing the joint SNR-temporal video quality in MPEG-4 fine grained scalable coding, " in Proc. Int. Symp. Circuits and Systems, 2002, pp. 445-448.
7. Y. Wang, S.-F. Chang, and A. C. Lou, "Subjective preference of spatio-temporal rate in video adaptation using multidimensional scalable coding, " in Proc. Int. Conf. Multimedia and Expo, 2004, pp. 1119-1122.
8. N. Cranley, P. Perry, and L. Murphy, "Optimum adaptation trajectories for streamed multimedia, " Multimedia Syst., vol. 10, no. 5, pp. 392-401, 2005. (Pubitemid 41414388)
9. G. Zhai, J. Cai, W. Lin, X. Yang, W. Zhang, and M. Etoh, "Cross-dimensional perceptual quality assessment for low bit-rate videos, " IEEE Trans. Multimedia, vol. 10, no. 7, pp. 1316-1324, Nov. 2008.
10. D. A. Silverstein and J. E. Farrell, "Quantifying perceptual image quality, " in Proc. ST&T's Image Processing, Image Quality, Image Capture, Systems Conf., 1998, pp. 242-246.
11. R. A. Bradley and M. E. Terry, "Rank analysis of incomplete block designs: I. The method of paired comparisons, " Biometrika, vol. 39, pp. 324-345, 1952.
12. M. E. Glickman, "Parameter estimation in large dynamic paired comparison experiments, " J. Roy. Statist. Soc., Ser. C (Appl. Statist.), vol. 48, no. 3, pp. 377-394, 1999.
13. P. V. Rao and L. L. Kupper, "Ties in paired-comparison experiments: A generalization of the Bradley-Terry model, " J. Amer. Statist. Assoc., vol. 62, no. 317, pp. 194-204, Mar. 1967.
14. R. R. Davidson, "On extending the Bradley-Terry model to accommodate ties in paired comparison experiments, " J. Amer. Statist. Assoc., vol. 65, no. 329, pp. 317-328, Mar. 1970.
15. J.-S. Lee, F. D. Simone, N. Ramzan, Z. Zhao, E. Kurutepe, T. Sikora, J. Ostermann, E. Izquierdo, and T. Ebrahimi, "Subjective evaluation of scalable video coding for content distribution, " in Proc. ACM Multimedia, Firenze, Italy, Oct. 2010, pp. 65-72.
16. H. Schwarz, D. Marpe, and T. Wiegand, "Overview of the scalable video coding extension of the H.264/AVC standard, " IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 9, pp. 1103-1120, Sep. 2007. (Pubitemid 47483052)
17. J. Reichel, H. Schwarz, and M. Wien, Joint Scalable Video Model 11 (JSVM 11), Joint Video Team, 2007, doc. JVT-X202.
18. N. Adami, A. Signoroni, and R. Leonardi, "State-of-the-art and trends in scalable video compression with wavelet-based approaches, " IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 9, pp. 1238-1255, Sep. 2007. (Pubitemid 47483061)
19. N. Ramzan, T. Zgaljic, and E. Izquierdo, "An efficient optimisation scheme for scalable surveillance centric video communications, " Signal Process.: Image Commun., vol. 24, no. 6, pp. 510-523, 2009.
20. The SVT High Definition Multi Format Test Set. [Online]. Available: http://www.its.bldrdoc.gov/vqeg.
21. Subjective Video Quality Assessment Methods for Multimedia Applications, 1999, Recommendation ITU-R P.910.
22. M. G. Kendall and B. B. Smith, "On the method of paired comparisons, " Biometrika, vol. 31, no. 3/4, pp. 324-345, Mar. 1940.
23. W.-H. Peng, J. K. Zao, H.-T. Huang, T.-W.Wang, and L.-S. Huang, "A rate-distortion optimization model for SVC inter-layer encoding and bitstream extraction, " J. Vis. Commun. Image Represent., vol. 19, pp. 543-557, 2008.