Crowdsourcing quality-of-experience assessments

Computer

Volumn 47, Issue 9, 2014, Pages 98-102

  Hossfeld, Tobias ^a   Keimel, Christian ^b   Timmerer, Christian ^c  

^a UNIVERSITY OF WÜRZBURG   (Germany)

^b TECHNICAL UNIVERSITY OF MUNICH   (Germany)

^c UNIVERSITY OF KLAGENFURT   (Austria)

Author keywords

Crowdsourcing; Data analysis; Internet Web technologies; Project management; Quality of experience; Social computing; Testing

Indexed keywords

PROJECT MANAGEMENT; TESTING;

CROWDSOURCING; QUALITY OF EXPERIENCE (QOE); QUALITY OF EXPERIENCES; SOCIAL COMPUTING;

DATA REDUCTION;

EID: 84907462746     PISSN: 00189162     EISSN: None     Source Type: Trade Journal    
DOI: 10.1109/MC.2014.245     Document Type: Article

References (12)

1. P. Le Callet, S. Möller and A. Perkis, eds., Qualinet White Paper on Definitions of Quality of Experience, v1.2, European Network on Quality of Experience in Multimedia Systems and Services, Mar. 2013; www.qualinet.eu/images/stories/QoEwhitepaperv1.2.pdf.
2. M. Masli, "Crowdsourcing Maps," Computer, vol. 44, no. 11, 2011, pp. 90-93.
3. J. Riedl and E. Riedl, "Crowdsourcing Medical Research," Computer, vol. 46, no. 1, 2013, pp. 89-92.
4. T. Hossfeld and C. Keimel, "Crowdsourcing in QoE Evaluation," Quality of Experience: Advanced Concepts, Applications and Methods, S. Möller and A. Raake, eds., Springer, 2014, pp. 315-327.
5. T. Hossfeld et al., "Best Practices for QoE Crowdtesting: QoE Assessment with Crowdsourcing," IEEE Trans. Multimedia, vol. 16, no. 2, 2014, pp. 541-558.
6. K.-T. Chen et al., "A Crowdsourceable QoE Evaluation Framework for Multimedia Content," Proc. 17th ACM Int'l Conf. Multimedia (MM 09), 2009, pp. 491-500.
7. J. Rogstadius et al., "An Assessment of Intrinsic and Extrinsic Motivation on Task Performance in Crowdsourcing Markets," Proc. 5th Int'l Conf. Weblogs and Social Media (ICWSM 11), 2011; www.mediateam.oulu. fi/publications/pdf/1405.pdf.
8. M. Varela et al., "Increasing Payments in Crowdsourcing: Don't Look a Gift Horse in the Mouth!," Proc. 4th Int'l Workshop Perceptual Quality of Systems (PQS 13), 2013; https://pqs.ftw.at/workshop-program/papers/s14 Varela.pdf.
9. T. Hossfeld et al., "Survey of Web-Based Crowdsourcing Frameworks for Subjective Quality Assessment," Proc. 16th Int'l Workshop Multimedia Signal Processing (MMSP 14), 2014; http://infoscience.epfl.ch/record/199537/files/MMSP2014CS.pdf.
10. A.D. Shaw, J.J. Horton, and D.L. Chen, "Designing Incentives for Inexpert Human Raters," Proc. 2011 ACM Conf. Computer Supported Cooperative Work (CSCW 11), 2011, pp. 275-284.
11. C. Timmerer and B. Rainer, "The Social Multimedia Experience," Computer, vol. 47, no. 3, 2014, pp. 67-69.
12. C. Eickhoff et al., "Quality through Flow and Immersion: Gamifying Crowdsourced Relevance Assessments," Proc. 35th Int'l ACM SIGIR Conf. Research and Development in Information Retrieval (SIGIR 12), 2012, pp. 871-880.