SOS: The MOS is not enough!

2011 3rd International Workshop on Quality of Multimedia Experience, QoMEX 2011

Volumn , Issue , 2011, Pages 131-136

  Hoßfeld, Tobias ^a   Schatz, Raimund ^b   Egger, Sebastian ^b  

^a UNIVERSITY OF WÜRZBURG   (Germany)

^b TELECOMMUNICATIONS RESEARCH CENTER VIENNA FTW   (Austria)

Author keywords

diversity of user ratings; MOS; QoE representation; SOS hypothesis; subjective tests

Indexed keywords

MOS; QOE REPRESENTATION; SOS HYPOTHESIS; SUBJECTIVE TESTS; USER RATING;

MULTIMEDIA SYSTEMS; QUALITY OF SERVICE;

SYSTEMS ENGINEERING;

EID: 83455188225     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/QoMEX.2011.6065690     Document Type: Conference Paper

References (24)

1. SebastianMoeller, Assessment and Prediction of Speech Quality in Telecommunications, Springer, 1st edition, August 2000.
2. Evangelos Karapanos and Jean-Bernard Martens, "Characterizing the diversity in users' perceptions," in Proc. of 11th IFIP TC 13 international conference on Human-computer interaction, Berlin, Heidelberg, 2007, INTERACT'07, pp. 515-518, Springer-Verlag.
3. Evangelos Karapanos, Jean-Bernard Martens, and Marc Hassenzahl, "Accounting for diversity in subjective judgments," in Proc of 27th International Conference on Human factors in Computing Systems, New York, NY, USA, 2009, CHI '09, pp. 639-648, ACM.
4. International Telecommunication Union, "Mean Opinion Score (MOS) Terminology," ITU-T Recommendation P.800.1, Mar. 2003.
5. GroupLens Research, "Movielens data sets," www.grouplens.org, 2011.
6. Tobias Hoßfeld, Raimund Schatz, Alexander Platzer, Sebastian Egger, Sebastian Biedermann, and Markus Fiedler, "The Memory Effect and Its Implications on Web QoE Modeling,"in currently under review, 2011.
7. Mark Hall, Eibe Frank, Geoffrey Holmes, Bernhard Pfahringer, Peter Reutemann, and Ian H. Witten, "The WEKA Data Mining Software: An Update," SIGKDD Explorations, vol. 11, no. 1, 2009.
8. International Telecommunication Union, "Subjective video quality assessment methods for multimedia applications," ITU-T Recommendation P.910, April 2008.
9. International Telecommunication Union, "Methodology for the subjective assessment of the quality of television pictures," ITU-R Recommendation BT.500-12, Mar. 2009.
10. Jürgen Bortz and Nicola Döring, Forschungsmethoden und Evaluation für Human- und Sozialwissenschaftler, Springer-Lehrbuch. Springer-Verlag Berlin and Heidelberg GmbH & Co. KG, Heidelberg, 4., überarb. Aufl. edition, 2006.
11. Warren S. Torgerson, Theory and Methods of Scaling, John Wiley & Sons,Inc., 1963.
12. Paul Cairns, "HCI... not as it should be: inferential statistics in HCI research," in Proceedings of the 21st British HCI Group Annual Conference on People and Computers: HCI... but not as we know it-Volume 1, 2007, p. 195201.
13. Stefan Winkler, "On the properties of subjective ratings in video quality experiments," in Proc. of InternationalWorkshop on Quality of Multimedia Experience (QoMEX, 2009.
14. Marcus Barkowsky, Björn Eskofier, Jens Bialkowski, and Andre Kaup, "Influence of the presentation time on subjective votings of coded still images," in Proc. of IEEE International Conference on Image Processing, 2006.
15. Philip Corriveau, Christina Gojmerac, Bronwen Hughes, and Lew Stelmach, "All subjective scales are not created equal: the effects of context on different scales," Signal Process., vol. 77, pp. 1-9, August 1999.
16. Michael Jarschel, Daniel Schlosser, Sven Scheuring, and Tobias Hoßfeld, "An Evaluation of QoE in Cloud Gaming Based on Subjective Tests," in Proc. of 1st International Workshop on Future Internet and Next Generation Networks (FINGNet-2011) in conjunction with IMIS 2011, June 2011.
17. Peter Reichl, Bruno Tuffin, and Raimund Schatz, "Logarithmic laws in service quality perception: Where microeconomics meets psychophysics and quality of experience.," Accepted for: Telecommunication Systems Journal, Springer, 2011, in print.
18. Vasanthi Dwaraka Bhamidipati and Swetha Kilari, "Effect of Delay/ Delay Variable on QoE in Video Streaming," M.S. thesis, School of Computing at Blekinge Institute of Technology, Karlskrona, Sweden, May 2010.
19. Fadi Boulos, Wei Chen, Benoit Parrein, and Patrick Le Callet, "Region-of-Interest Intra Prediction for H.264/AVC Error Resilience," in Proc. of IEEE International Conference on Image Processing, Cairo, Egypt, 2009, Data available at ftp://ftp.ivc.polytech.univ-nantes.fr/IRCCyN-IVC-SD-RoI- Database/.
20. Stephane Pechard, Romuald Pepion, and Patrick Le Callet, "Suitable methodology in subjective video quality assessment: a resolution dependent paradigm," in Proc. of International Workshop on Image Media Quality and its Applications (IMQA2008), Kyoto, Japan, 2008, Data available at ftp://ftp.ivc.polytech.univ-nantes.fr/IRCCyN-IVC-1080i-Database/.
21. Tomas Brandao, Luis Roque, and Maria Paula Queluz, "Quality assessment of H.264/AVC encoded video," in Proc of Confernce on Telecommunications - ConfTele, Sta. Maria da Feira, Portugal, 2009, Data available at http://amalia.img.lx.it.pt/~tgsb/H264-test/.
22. ITU, ITU-T coded-speech database (ITU-T Recommendation P.Sup23), International Telecommunications Union, Feb. 1998.
23. Hamid Rahim Sheikh, Muhammad Farooq Sabir, and Alan C. Bovik, "A statistical evaluation of recent full reference image quality assessment algorithms," IEEE Transactions on Image Processing, vol. 15, no. 11, Nov. 2006, Data available at http://live.ece.utexas.edu/research/quality/subjective. htm.
24. Sylvain Tourancheau, Florent Autrusseau, Parvez Sazzad, and Yuukou Horita, "Impact of the subjective dataset on the performance of image quality metrics," in Proc. of IEEE International Conference on Image Processing (ICIP 2008), San Diego, US, 10 2008, Data available at ftp://ftp.ivc.polytech.univ-nantes.fr/IRCCyN-IVC-Scores-On-Toyama-Images/.