Active sampling for subjective image quality assessment

Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Volumn , Issue , 2014, Pages 4249-4256

  Ye, Peng ^a   Doermann, David ^a  

^a UNIVERSITY OF MARYLAND   (United States)

Author keywords

active learning; quality of experience; subjective image quality

Indexed keywords

CROWDSOURCING; PATTERN RECOGNITION; QUALITY OF SERVICE; QUERY PROCESSING;

ACTIVE LEARNING; EXPECTED INFORMATIONS; LABORATORY STUDIES; MEAN OPINION SCORES; OBJECTIVE QUALITY MEASURES; PROBABILISTIC MODELING; QUALITY OF EXPERIENCE (QOE); SUBJECTIVE IMAGE QUALITY;

IMAGE QUALITY;

EID: 84911427749     PISSN: 10636919     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CVPR.2014.541     Document Type: Conference Paper

References (24)

1. Subjective video quality assessment methods for multimedia applications. ITU-T Recommendation P.910, Apr. 2008.
2. A. Azevedo-Filho and R. D. Shachter. Laplace's method approximations for probabilistic inference in belief networks with continuous variables. In Uncertainty in Artificial Intelligence, pages 28-36, 1994.
3. R. A. Bradley and M. E. Terry. Rank analysis of incomplete block designs: I. the method of paired comparisons. Biometrika, 39(3/4):324-345, 1952.
4. B. Carterette, P. N. Bennett, D. M. Chickering, and S. T. Du-mais. Here or there: preference judgments for relevance. In Proceedings of the IR research, 30th European Conference on Advances in information retrieval, pages 16-27, Berlin, Heidelberg, 2008.
5. K.-T. Chen, C.-C. Wu, Y.-C. Chang, and C.-L. Lei. A crowd-sourceable QoE evaluation framework for multimedia content. In Proceedings of the 17th ACM International Conference on Multimedia, pages 491-500, 2009.
6. X. Chen, P. N. Bennett, K. Collins-Thompson, and E. Horvitz. Pairwise ranking aggregation in a crowdsourced setting. In Proceedings of the Sixth ACM International Conference on Web Search and Data Mining, pages 193-202. ACM, 2013.
7. W. Chu and Z. Ghahramani. Gaussian processes for ordinal regression. Journal of Machine Learning Research, 6:1019-1041, Dec. 2005.
8. H. David. The Method of Paired Comparisons. Hodder Arnold, second edition, 1988.
9. J. Ford, L. Ru Solution of a ranking problem from binary comparisons. The American Mathematical Monthly, 64(8):pp. 28-33, 1957.
10. D. F. Gleich and L.-h. Lim. Rank aggregation via nuclear norm minimization. In Proceedings of the 17th ACM SIGKDD International Conference on Knowledge discovery and data mining, pages 60-68, 2011.
11. X. Jiang, L.-H. Lim, Y. Yao, and Y. Ye. Statistical ranking and combinatorial Hodge theory. Mathematical Programming, 127(1):203-244, 2011.
12. D. V. Lindley. On a measure of the information provided by an experiment. The Annals of Mathematical Statistics, 27(4):pp. 986-1005, 1956.
13. F. Mosteller. Remarks on the method of paired comparisons: I. the least squares solution assuming equal standard deviations and equal correlations. Psychometrika, 16:3-9, 1951.
14. T. Pfeiffer, X. A. Gao, A. Mao, Y. Chen, and D. G. Rand. Adaptive polling and information aggregation. In The 26th Conference on Artificial Intelligence (AAAI'12), 2012.
15. W. H. Press, B. P. Flannery, S. A. Teukolsky, and W. T. Vet-terling. Numerical Recipes in C : The Art of Scientific Computing. Cambridge University Press, October 1992.
16. F. Ribeiro, D. Florencio, C. Zhang, and M. Seltzer. Crowd-mos: An approach for crowdsourcing mean opinion score studies. In 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 2416-2419, May 2011.
17. H. R. Sheikh, M. F. Sabir, and A. C. Bovik. A statistical evaluation of recent full reference image quality assessment algorithms. IEEE Transactions on Image Processing, 15(11):3440-3451, 2006.
18. L. Thurstone. A law of comparative judgment. Psychological Review, 1927. 34:273-286.
19. W. Torgerson. Theory and methods of scaling. John Wiley & Sons, New York, 1958.
20. M. N. Volkovs and R. S. Zemel. A flexible generative model for preference aggregation. In Proceedings of the 21st International Conference on World Wide Web, pages 479-488, 2012.
21. R. C. Weng and C.-J. Lin. A bayesian approximation method for online ranking. Journal of Machine Learning Research, 12:267-300, 2011.
22. A. Wchter and L. T. Biegler. On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming. Mathematical Programming, 106:25-57, 2006.
23. Q. Xu, Q. Huang, and Y. Yao. Online crowdsourcing subjective image quality assessment. In Proceedings of the 20th ACM International Conference on Multimedia, pages 359-368. ACM, 2012.
24. Q. Xu, T. Jiang, Y. Yao, Q. Huang, B. Yan, and W. Lin. Random partial paired comparison for subjective video quality assessment via hodgerank. In Proceedings of the 19th ACM International Conference on Multimedia, pages 393-402. ACM, 2011.