From packets to people: Quality of experience as a new measurement challenge

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 7754, Issue , 2013, Pages 219-263

  Schatz, Raimund ^a   Hoßfeld, Tobias ^b   Janowski, Lucjan ^c   Egger, Sebastian ^a  

^a TELECOMMUNICATIONS RESEARCH CENTER VIENNA FTW   (Austria)

^b UNIVERSITY OF WÜRZBURG   (Germany)

^c AGH UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Poland)

Author keywords

[No Author keywords available]

Indexed keywords

ANOMALY DETECTION; WEB SERVICES;

ACADEMIC RESEARCH; END USERS; NETWORKED COMMUNICATION SYSTEMS; QUALITY OF EXPERIENCE (QOE); STATE OF THE ART; SUBJECTIVE PERCEPTIONS;

QUALITY OF SERVICE;

EID: 84875943937     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-36784-7_10     Document Type: Review

References (136)

1. Al-Akhras, M., Zedan, H., John, R., Al-Momani, I.: Non-intrusive speech quality prediction in voip networks using a neural network approach. Neurocomputing 72(10-12), 2595-2608 (2009), http://www.sciencedirect.com/ science/article/B6V10-4V1TXP7-1/2/ c089682667034eb3874ab651e69e21c1; Lattice Computing and Natural Computing (JCIS 2007) / Neural Networks in Intelligent Systems Designn (ISDA 2007
2. Allan, L.G.: The perception of time. Attention, Perception, & Psychophysics 26(5), 340-354 (1979
3. Anderson, C.: TED Talks: How web video powers global innovation, http://www.ted.com/talks/ chris anderson how web video powers global innovation.html
4. Andrews, M., Cao, J., McGowan, J.: Measuring human satisfaction in data networks. In: Proceedings of INFOCOM 2006. IEEE (2006
5. Antonides, G., Verhoef, P.C., van Aalst, M.: Consumer perception and evaluation of waiting time: A field experiment. Journal of Consumer Psychology 12(3), 193-202 (2002
6. Bech, S., Zacharov, N.: Perceptual Audio Evaluation-Theory, Method and Application. Wiley (July 2006
7. Beerends, J.G., Hekstra, A.P., Hollier, M.P., Rix, A.W.: Perceptual Evaluation of Speech Quality (PESQ)-The New ITU Standard for End-To-End Speech Quality Assessment Part II-Psychoacoustic Model. Journal of the Audio Engineering Society 50(10), 765-778 (2002
8. Belshe, M.: More Bandwidth does not Matter (much). Tech. rep., Google (2010
9. Bhatti, N., Bouch, A., Kuchinsky, A.: Integrating User-Perceived quality into web server design. In: 9th International World Wide Web Conference, pp. 1-16 (2000
10. Bjorksten, M., Pohjola, O.P., Kilkki, K.: Applying user segmentation and estimating user value in techno-economic modeling. In: 6th Conference on Telecommunication Techno-Economics, CTTE 2007, pp. 1-6 (2007
11. Boev, A., Poikela, M., Gotchev, A., Aksay, A.: Modelling of the stereoscopic hvs. Tech. rep., Mobile3DTV Project, http://sp.cs.tut.fi/ mobile3dtv/results/tech/D5.3-Mobile3DTV-v2.0.pdf
12. Bouch, A., Sasse, M.A., DeMeer, H.G.: Of packets and people: A user-centered approach to quality of service. In: Proceedings of IWQoS 2000 (2000
13. Bouch, A., Kuchinsky, A., Bhatti, N.: Quality is in the eye of the beholder: Meeting users' requirements for internet quality of service. In: CHI 2000: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 297-304. ACM, New York (2000
14. Van den Broeck,W., Jacobs, A., Staelens, N.: Integrating the everyday-life context in subjective video quality experiments. In: 2012 Fourth International Workshop on Quality of Multimedia Experience (QoMEX), pp. 19-24 (July 2012
15. Brooks, P., Hestnes, B.: User measures of quality of experience: Why being objective and quantitative is important. IEEE Network 24(2), 8-13 (2010
16. Buchinger, S., Robitza, W., Hummelbrunner, P., Nezveda, M., Sack, M., Hlavacs, H.: Slider or glove? proposing an alternative quality rating methodology. In: VPQM 2010 (2010), http://eprints.cs.univie.ac.at/93/
17. Callet, P.L., Möller, S.: Perkis (eds), A.: Qualinet white paper on definitions of quality of experience (June 2012
18. Chen, K.T., Chang, C.J.,Wu, C.C., Chang, Y.C., Lei, C.L.: Quadrant of euphoria: A crowdsourcing platform for QoE assessment. IEEE Network 24(2), 28-35 (2010
19. Chen, W., Fournier, J., Barkowsky, M., Callet, P.L.: New requirements of subjective video quality assessment methodologies for 3dtv. In: VPQM 2010 (2010
20. Clark, A.: Modeling the effects of burst packet loss and recency on subjective voice quality. In: Internet Telephony Workshop, New York (April 2001), http://www.cs.columbia.edu/~hgs/papers/iptel2001/21.pdf
21. Collange, D., Costeux, J.L.: Passive estimation of quality of experience. Journal of Universal Computer Science 14(5), 625-641 (2008
22. Crawley, E., Nair, R., Rajagopalan, B., Sandick, H.: RFC 2386: A Framework for QoS-based Routing in the Internet. Tech. rep., IETF (August 1998), http://www.ietf.org/rfc/rfc2386.txt
23. Cui, H., Biersack, E.: Trouble shooting interactive web sessions in a home environment, p. 25. ACM Press (2011), http://64.238.147.56/citation.cfm?id= 2018567.2018574&coll=DL& dl=GUIDE&CFID=103748494&CFTOKEN= 26870697
24. Daly, S.: The visible differences predictor: An algorithm for the assessment of image fidelity. In: Digital images and Human Vision, pp. 179-206. MIT Press, Cambridge (1993
25. Dobrian, F., Sekar, V., Awan, A., Stoica, I., Joseph, D., Ganjam, A., Zhan, J., Zhang, H.: Understanding the impact of video quality on user engagement. In: Proceedings of the ACM SIGCOMM 2011 Conference (SIGCOMM 2011), pp. 362-373. ACM, New York (2011), http://doi.acm.org/10.1145/2018436.2018478
26. Egger, S., Reichl, P., Hoßfeld, T., Schatz, R.: 'Time is Bandwidth'? Narrowing the Gap between Subjective Time Perception and Quality of Experience. In: IEEE ICC 2012-Communication QoS, Reliability and Modeling Symposium (ICC 2012 CQRM), Ottawa, Ontario, Canada (June 2012
27. Egger, S., Schatz, R., Scherer, S.: It Takes Two to Tango-Assessing the Impact of Delay on Conversational Interactivity on Perceived Speech Quality. In: INTERSPEECH, pp. 1321-1324 (2010
28. Egger, S., Schatz, R., Schoenenberg, K., Raake, A., Kubin, G.: Same but Different?-Using Speech Signal Features for Comparing Conversational VoIP Quality Studies. In: IEEE ICC 2012-Communication QoS, Reliability and Modeling Symposium (ICC 2012 CQRM), Ottawa, Ontario, Canada (June 2012
29. Eisler, H.: Subjective duration and psychophysics. Psychological Review 82(6), 429-450 (1975
30. Elert, G.: Wavelength of maximum human visual sensitivity, http://hypertextbook.com/facts/2007/SusanZhao.shtml
31. Fiedler, M.: EuroNGI deliverable D.WP.JRA.6.1.1: State of the art with regards to user perceived quality of service and quality feedback. Tech. rep. (May 2004), http://eurongi.enst.fr
32. Fiedler, M., Hoßfeld, T., Tran-Gia, P.: A generic quantitative relationship between quality of experience and quality of service. Netwrk. Mag. of Global Internetwkg 24, 36-41 (2010
33. Garcia, M.N., Raake, A., List, P.: Towards content-related features for parametric video quality prediction of IPTV services, pp. 757-760 (2008
34. Garcia, M.N., Raake, A.: Frame-layer packet-based parametric video quality model for encrypted video in IPTV services. In: QoMEX 2011, pp. 102-106 (2011
35. Gomez, G., Sanchez, R.: End-To-End Quality of Service Over Cellular Networks: Data Services Performance and Optimization in 2g/3g. John Wiley (July 2005
36. Gozdecki, J., Jajszczyk, A., Stankiewicz, R.: Quality of service terminology in IP networks. IEEE Communications Magazine 41(3), 153-159 (2003
37. Grondin, S.: From physical time to the first and second moments of psychological time. Psychological Bulletin 127(1), 22-44 (2001
38. Grondin, S.: Sensory modalities and temporal processing. In: Helfrich, H. (ed.) Time and mind II: Information processing perspectives. Hogrefe & Huber (2003
39. Grondin, S.: Timing and time perception: A review of recent behavioral and neuroscience findings and theoretical directions. Attention Perception Psychophysics 72(3), 561-582 (2010
40. Hands, D., Wilkins, M.: A Study of the Impact of Network Loss and Burst Size on Video Streaming Quality and Acceptability. In: D'iaz, M., S'enac, P. (eds.) IDMS 1999. LNCS, vol. 1718, pp. 45-57. Springer, Heidelberg (1999), http://www.springerlink.com/content/21u2413r58534l52/abstract/
41. Hogarth, R.M.: Judgement and choice: The psychology of decision. J. Wiley (1980
42. Höldtke, K., Raake, A., Möller, S., Egger, S., Schatz, R., Rohrer, N.: How the Need for fast Interaction affects the Impact of Transmission Delay on the overall Quality Judgment. Tech. rep., ITU-T, Geneva, Switzerland (January 2011
43. Hoßfeld, T., Hock, D., Tran-Gia, P., Tutschku, K., Fiedler, M.: Testing the IQX Hypothesis for Exponential Interdependency between QoS and QoE of Voice Codecs iLBC and G.711. Tech. Rep. 442, University of Wuerzburg (March 2008
44. Hoßfeld, T., Schatz, R., Biedermann, S., Platzer, A., Egger, S., Fiedler, M.: The Memory Effect and Its Implications on Web QoE Modeling. In: 23rd International Teletraffic Congress (ITC 2011), San Francisco, USA (September 2011
45. Hoßfeld, T., Schatz, R., Seufert, M., Hirth, M., Zinner, T., Tran-Gia, P.: Quantification of YouTube QoE via Crowdsourcing. In: IEEE International Workshop on Multimedia Quality of Experience-Modeling, Evaluation, and Directions (MQoE 2011), Dana Point, CA, USA (December 2011
46. Hoßfeld, T., Schatz, R., Varela, M., Timmerer, C.: Challenges of QoE Management for Cloud Applications. IEEE Communications Magazine (April 2012
47. Hoßfeld, T., Tran-Gia, P., Fiedler, M.: Quantification of quality of experience for edge-based applications. In: 20th International Teletraffic Congress (ITC 20), Ottawa, Canada (June 2007
48. Hu, J., Wildfeuer, H.: Use of content complexity factors in video over ip quality monitoring. In: 2009 International Workshop on Quality of Multimedia Experience, pp. 216-221 (2009
49. Huynh-Thu, Q., Garcia, M., Speranza, F., Corriveau, P., Raake, A.: Study of rating scales for subjective quality assessment of High-Definition video. IEEE Transactions on Broadcasting 57(1), 1-14 (2011
50. Ibarrola, E., Liberal, F., Taboada, I., Ortega, R.: Web qoe evaluation in multiagent networks: Validation of itu-T g.1030. In: ICAS 2009: Proceedings of the 2009 Fifth International Conference on Autonomic and Autonomous Systems, pp. 289-294. IEEE Computer Society, Washington, DC (2009
51. International Telecommunication Union: Handbook on Telephonometry, ITU-T (July 1992
52. International Telecommunication Union: Terms and definitions related to quality of service and network performance including dependibility. ITU-T Recommendation E.800 (August 1994
53. International Telecommunication Union: End-user multimedia QoS categories. ITU-T Recommendation G.1010 (November 2001
54. International Telecommunication Union: Analysis and interpretation of INMD voice-service measurements. ITU-T Recommendation P.562 (May 2004
55. International Telecommunication Union: Estimating end-To-end performance in ip networks for data applications. ITU-T Recommendation G.1030 (November 2005
56. International Telecommunication Union: Vocabulary and effects of transmission parameters on customer opinion of transmission quality, amendment 2. ITU-T Recommendation P.10/G.100 (2006
57. International Telecommunication Union: H.264: Advanced video coding for generic audiovisual services. Series H: Audiovisual and Multimedia Systems; Infrastructure of audiovisual services-Coding of moving video (November 2007
58. International Telecommunication Union: Subjective Evaluation of Conversational Quality. ITU-T Recommendation P.805 (July 2007
59. Ito, Y., Tasaka, S.: Quantitative assessment of user-level QoS and its mapping. IEEE Transactions on Multimedia 7(3), 572-584 (2005
60. ITU-T Study Group 2: Teletraffic Engineering Handbook. ITU (2005
61. Janowski, L., Papir, Z.: Modeling subjective tests of quality of experience with a generalized linear model. In: QoMEX 2009, First International Workshop on Quality of Multimedia Experience, California, San Diego (July 2009
62. Jekosch, U.: Voice and Speech Quality Perception: Assessment and Evaluation. Signals and Communication Technology. Springer (2005), http://books.google.at/books?id=Ef3lHiSzq1QC
63. Kanumuri, S., Cosman, P., Reibman, A., Vaishampayan, V.: Modeling packetloss visibility in MPEG-2 video. IEEE Transactions on Multimedia 8(2), 341-355 (2006
64. Kawano, T., Yamagishi, K.: Performance evaluation of subjective quality assessment methods for stereoscopic video services, ftp://vqeg.its.bldrdoc.gov/ Documents/VQEG Hillsboro Dec11/ MeetingFiles/VQEG 3DTV 2011 037 Performance%20Evaluation%20of%203D %20Assessment%20Methods(NTT).doc
65. Khirman, S., Henriksen, P.: Relationship between Quality-of-Service and qualityof- experience for public internet service. In: Proceedings of the 3rd Workshop on Passive and Active Measurement, Fort Collins, Colorado, USA (March 2002
66. Killeen, P.R., Weiss, N.A.: Optimal timing and the weber function. Psychological Review 94(4), 455-468 (1987
67. Kim, D.S., Tarraf, A.: Anique+: A new american national standard for nonintrusive estimation of narrowband speech quality: Research articles. Bell Lab. Tech. J. 12(1), 221-236 (2007), http://dx.doi.org/10.1002/bltj.v12:1
68. King, A.: Speed Up Your Site: Web Site Optimization. New Riders, Indianapolis (2003
69. Knoche, H., De Meer, H., Kirsh, D.: Utility curves: Mean opinion scores considered biased. In: 1999 Seventh International Workshop on Quality of Service, IWQoS 1999, pp. 12-14 (1999
70. Knoche, H.O.: Quality of experience in digital mobile multimedia services (July 2011), http://discovery.ucl.ac.uk/1322706/
71. Kumar, V.: Managing Customers for Profit: Strategies to Increase Profits and Build Loyalty. Pearson Prentice Hall (2008
72. Laghari, K., Crespi, N., Connelly, K.: Toward total quality of experience: A QoE model in a communication ecosystem. IEEE Communications Magazine 50(4), 58-65 (2012
73. Malfait, L., Berger, J., Kastner, M.: P.563-The ITU-T Standard for Single-Ended Speech Quality Assessment. IEEE Transactions on Audio, Speech & Language Processing 14(6), 1924-1934 (2006
74. Mandryk, R.L., Inkpen, K.M., Calvert, T.W.: Using psychophysiological techniques to measure user experience with entertainment technologies. Behaviour & IT 25(2), 141-158 (2006
75. Möller, S., Berger, J., Raake, A., Waltermann, M., Weiss, B.: A new dimensionbased framework model for the quality of speech communication services. In: 2011 Third International Workshop on Quality of Multimedia Experience (QoMEX), pp. 107-112 (September 2011
76. Möller, S., Berger, J., Raake, A., Wältermann, M., Weiss, B.: A new dimensionbased framework model for the quality of speech communication services. In: 2011 Third International Workshop on Quality of Multimedia Experience (QoMEX), pp. 107-112 (September 2011
77. Möller, S., Chan, W., Cote, N., Falk, T., Raake, A., Wältermann, M.: Speech quality estimation: Models and trends. IEEE Signal Processing Magazine 28(6), 18-28 (2011
78. Möller, S.: Assessment and Prediction of Speech Quality in Telecommunications, 1st edn. Springer (August 2000
79. Möller, S.: Quality Engineering-Qualität kommunikationstechnischer Systeme. Springer (2010
80. Möller, S., Raake, A.: Telephone speech quality prediction: Towards network planning and monitoring models for modern network scenarios. Speech Communication 47-75 (2002), http://portal.acm.org/citation.cfm?id=638078.638082, ACM ID: 638082
81. Moor, K.D., Ketyko, I., Joseph, W., Deryckere, T., Marez, L.D., Martens, L., Verleye, G.: Proposed framework for evaluating quality of experience in a mobile, testbed-oriented living lab setting. Mobile Networks and Applications 15(3), 378-391 (2010), http://www.springerlink.com/index/10.1007/s11036-010- 0223-0
82. Moorsel, A.V.: Metrics for the internet age: Quality of experience and quality of business. Tech. rep., 5th Performability Workshop (2001), http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.24.3810
83. Nielsen, J.: Usability Engineering. Morgan Kaufmann Publishers, San Francisco (1993
84. Niida, S., Uemura, S., Nakamura, H.: Mobile services. IEEE Vehicular Technology Magazine 5(3), 61-67 (2010
85. Nokia: Quality of experience (QoE) of mobile services-can it be measured and improved? (2004
86. O'Shaughnessy, D.: Speech communications: Human and machine, vol. 37. IEEE Press (2000), http://www.ncbi.nlm.nih.gov/pubmed/11442089
87. Olshefski, D., Nieh, J.: Understanding the management of client perceived response time. In: Proceedings of the Joint International Conference on Measurement and Modeling of Computer Systems, pp. 240-251 (2006
88. Osaka, N., Kakehi, K., Iai, S., Kitawaki, N.: A model for evaluating talker echo and sidetone in a telephone transmission network. IEEE Transactions on Communications 40(11), 1684-1692 (1992
89. Pescap̀e, A., Salgarelli, L., Dimitropoulos, X. (eds.): TMA 2012. LNCS, vol. 7189. Springer, Heidelberg (2012
90. Pine, B.J., Gilmore, J.H.: The Experience Economy: Work is Theatre & Every Business a Stage. Harvard Business Press (April 1999
91. Pinson, M., Wolf, S.: Comparing subjective video quality testing methodologies. In: SPIE Video Communications and Image Processing Conference, pp. 8-11 (2003
92. Pinson, M.H., Janowski, L., Pepion, R., Huynh-Thu, Q., Schmidmer, C., Corriveau, P., Younkin, A., Le Callet, P., Barkowsky, M., Ingram, W.: The influence of subjects and environment on audiovisual subjective tests: An international study. IEEE Journal of Selected Topics in Signal Processing 6(6), 640-651 (2012
93. Pinson, M., Speranza, F.: Report on the validation of video quality models for high definition video content, http://www.its.bldrdoc.gov/media/4212/ vqeg hdtv final report version 2.0.zip
94. Pinson, M., Thorpe, L., Cermak, G.: Test plan for evaluation of video quality models for use with high definition tv content, http://www.its.bldrdoc. gov/media/5871/vqeg-hdtv-testplan-v3-1.doc
95. Raake, A.: Short- And Long-Term Packet Loss Behavior: Towards Speech Quality Prediction for Arbitrary Loss Distributions. IEEE Transactions on Audio, Speech, and Language Processing 14(6), 1957-1968 (2006
96. Raake, A., Garcia, M., Möller, S., Berger, J., Kling, F., List, P., Johann, J., Heidemann, C.: T-V-model: Parameter-based prediction of IPTV quality. In: IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2008, pp. 1149-1152 (2008
97. Raake, A.: Speech Quality of VoIP: Assessment and Prediction. John Wiley & Sons (2006
98. Reichelt, S., Haussler, R., Fütterer, G., Leister, N.: Most 7690(0), 76900B-76900B-12 (2010
99. Reichl, P., Egger, S., Schatz, R., D'Alconzo, A.: The Logarithmic Nature of QoE and the Role of the Weber-Fechner Law in QoE Assessment. In: Proceedings of the 2010 IEEE International Conference on Communications, pp. 1-5 (May 2010
100. Reichl, P.: From charging for quality of service to charging for quality of experience. Annales des T'el'ecommunications 65(3-4), 189-199 (2010
101. Reichl, P., Tuffin, B., Schatz, R.: Logarithmic laws in service quality perception: Where microeconomics meets psychophysics and quality of experience. Telecommunication Systems, 1-14 (2011
102. Richards, D.: Calculation of opinion scores for telephone connections. Proceedings of the Institution of Electrical Engineers 121(5), 313-323 (1974
103. Rix, A.W., Beerends, J.G., Hollier, M.P., Hekstra, A.P.: Perceptual evaluation of speech quality (PESQ): The new ITU standard for end-To-end speech quality assessment-Part I: Time-delay compensation. Journal of the Audio Engineering Society 50(10), 755-764 (2002
104. Rubino, G.: Quantifying the quality of audio and video transmissions over the internet: The PSQA approach. In: Design and Operations of Communication Networks: A Review of Wired and Wireless Modelling and Management Challenges. Imperial College Press (2005
105. Schatz, R., Egger, S.: Vienna Surfing-Assessing Mobile Broadband Quality in the Field. In: Taft, N., Wetherall, D. (eds.) Proceedings of the 1st ACM SIGCOMM Workshop on Measurements Up the STack (W-MUST). ACM (2011
106. Schatz, R., Egger, S., Platzer, A.: Poor, Good Enough or Even Better? Bridging the Gap between Acceptability and QoE of Mobile Broadband Data Services. In: Proceedings of the 2011 IEEE International Conference on Communications, pp. 1-6 (June 2011
107. Schatz, R., Egger, S., Platzer, A.: Poor, Good Enough or Even Better? Bridging the Gap between Acceptability and QoE of Mobile Broadband Data Services. In: International Conference on Communications (2011
108. Seow, S.C.: Designing and Engineering Time: The Psychology of Time Perception in Software. Addison-Wesley Professional (2008
109. Shaikh, J., Fiedler, M., Collange, D.: Quality of experience from user and network perspectives. Annals of Telecommunications 65, 47-57 (2010), http://dx.doi.org/10.1007/s12243-009-0142-x, 10.1007/s12243-009-0142-X
110. Siller, M., Woods, J.C.: QoS arbitration for improving the QoE in multimedia transmission. In: International Conference on Visual Information Engineering, VIE 2003, pp. 238-241 (2003
111. da Silva, A.P.C., Varela, M., de Souza e Silva, E., Leäo, R.M.M., Rubino, G.: Quality assessment of interactive voice applications. Comput. Netw. 52(6), 1179-1192 (2008
112. Skadberg, Y.X., Kimmel, J.R.: Visitors' flow experience while browsing aWeb site: Its measurement, contributing factors and consequences. Computers in Human Behavior 20, 403-422 (2004
113. Soldani, D., Li, M., Cuny, R.: QoS and QoE management in UMTS cellular systems. John Wiley and Sons (August 2006
114. Staelens, N., Sedano, I., Barkowsky, M., Janowski, L., Brunnstrom, K., Callet, P.L.: Standardized toolchain and model development for video quality assessment-The mission of the joint effort group in vqeg. In: 2011 Third International Workshop on Quality of Multimedia Experience Quality of Multimedia Experience (QoMEX), Belgium, pp. 17-22 (September 2011
115. Stankiewicz, R., Jajszczyk, A.: A survey of qoe assurance in converged networks. Computer Networks 55(7), 1459-1473 (2011
116. Stevens, S.S.: On the Psychophysical Law. Psychology Revue 64(3), 153-181 (1957
117. Strohmeier, D., Jumisko-Pyykk, S., Kunze, K.: Open profiling of quality: A mixed method approach to understanding multimodal quality perception. In: Advances in Multimedia 2010, pp. 1-28 (2010), http://www.hindawi.com/journals/ am/2010/658980/abs/
118. Sun, L., Ifeachor, E.: Voice quality prediction models and their application in voip networks. IEEE Transactions on Multimedia 8(4), 809-820 (2006
119. Takahashi, A.: Opinion model for estimating conversational quality of voip. In: Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2004, vol. 3, pp. 1072-1075 (May 2004
120. Takahashi, A., Kurashima, A., Yoshino, H.: Objective assessment methodology for estimating conversational quality in voip. IEEE Transactions on Audio, Speech, and Language Processing 14(6), 1984-1993 (2006
121. Thakolsri, S., Kellerer, W., Steinbach, E.G.: Qoe-based cross-layer optimization of wireless video with unperceivable temporal video quality fluctuation. In: ICC, pp. 1-6. IEEE (2011), http://dblp.uni-Trier.de/db/conf/ icc/icc2011.html#ThakolsriKS11
122. Varela, M.: Pseudo-subjective Quality Assessment of Multimedia Streams and its Applications in Control. PhD thesis, University of Rennes 1, France (2005
123. Wältermann, M., Raake, A., Möller, S.: Quality Dimensions of Narrowband and Wideband Speech Transmission. Acta Acustica united with Acustica 96(6) (2010), http://dx.doi.org/10.3813/AAA.918370
124. Wang, Y.: Survey of objective video quality measurements. Quality, pp. 1-7 (2006
125. Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: From error visibility to structural similarity. IEEE Transactions on Image Processing 13(4), 600-612 (2004
126. Wang, Z., Lu, L., Bovik, A.C.: Video quality assessment based on structural distortion measurement (February 2004
127. Weber, E.H.: De Pulsu, Resorptione, Auditu Et Tactu. Annotationes Anatomicae Et Physiologicae. Koehler, Leipzig (1834
128. Weinreich, H., Obendorf, H., Herder, E., Mayer, M.: Not quite the average: An empirical study of web use. ACM Transactions on the Web (TWEB) 2(1), 1-31 (2008
129. Wilson, G.M., Sasse, M.A.: Do Users Always Know What's Good For Them? Utilising Physiological Responses to Assess Media Quality. In: The Proceedings of HCI 2000: People and Computers XIV-Usability or Else (HCI 2000), pp. 327-339. Springer (2000
130. Winkler, S., Mohandas, P.: The evolution of video quality measurement: From PSNR to hybrid metrics. IEEE Transactions on Broadcasting 54(3), 660-668 (2008), http://ieeexplore.ieee.org/lpdocs/epic03/wrapper.htmärnumber= 4550731
131. Winkler, S.: Issues in vision modeling for perceptual video quality assessment. Signal Processing 78(2), 231-252 (1999), http://www.sciencedirect. com/science/article/pii/S0165168499000626
132. Winkler, S.: Video quality measurement standards: Current status and trends. In: Proceedings of the 7th International Conference on Information, Communications and Signal Processing, ICICS 2009, pp. 848-852. IEEE Press, Piscataway (2009
133. Wolf, S., Pinson, M.: NTIA Report 02-392: Video Quality Measurement Techniques. Tech. rep., Institute for Telecommunication Sciences, http://www.its.bldrdoc.gov/pub/ntia-rpt/02-392/
134. Xue, J., Chen, C.W.: A study on perception of mobile video with surrounding contextual influences. In: 2012 Fourth International Workshop on Quality of Multimedia Experience (QoMEX), pp. 248-253 (July 2012
135. Zepernick, H., Engelke, U.: Quality of experience of multimedia services: Past, Present, and Future. ACM, Lisbon (2011), http://www.bth.se/fou/forskinfo. nsf/all/ bb7dbb41bc492428c12578f7003d6bfb
136. Zhang, J., Ansari, N.: On assuring end-To-end qoe in next generation networks: Challenges and a possible solution. IEEE Communications Magazine 49(7), 185-191 (2011), http://dblp.uni-Trier.de/db/journals/cm/cm49. html#ZhangA11a