PQoS assessment methods for multimedia services

Handbook of Research on Wireless Multimedia: Quality of Service and Solutions

Volumn , Issue , 2008, Pages 316-351

  Koumaras, Harilaos ^a,d   Liberal, Fidel ^b   Sun, Lingfen ^c  

^a National Center of Scientific Research 'Demokritos'   (Greece)

^b UNIVERSITY OF THE BASQUE COUNTRY UPV EHU   (Spain)

^c UNIVERSITY OF PLYMOUTH   (United Kingdom)

^d City University of Seattle   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 77953197647     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.4018/978-1-59904-820-8.ch013     Document Type: Chapter

References (121)

1. Akao, Y. (1990). Quality function deployment: Integrating customer requirements into product design. Productivity Press Inc.
2. Aladwani, A. M., & Palvia, P. C. (2002). Developing and validating an instrument for measuring user-perceived Web quality. Information and Management, 39, 467-476.
3. Alkahtani, A. M. S., Woodward, M. E., Al-Begain, K., & Alghannam, A.(2002). Enhanced best effort QoS routing with multiple prioritised metrics using the analytic hierarchy process (AHP) concept. Paper presented at the ICAI 2002, Canary Islands. Spain.
4. Armitage, G. (2001a). Lag over 150 milliseconds is unacceptable. Retrieved from http://gja.space4me.com/things/quake3-latency-051701.html
5. Armitage, G. (2001b). When does the QuakeIII community play? Retrieved from http://gja.space4me.com/things/quake3-when-051401.html
6. Babulak, E. (2004, Dec). Quality of service provision assessment for campus network. Journal of Electrical Engineering, 55(7-8), 221-224
7. th European Conference on Information Systems, Viena, Austria.
8. th European Conference on Information Systems, Viena.
9. th international World Wide Web Conference on Computer Networks: The International Journal of Computer and Telecommunications Networking (pp. 1-16). North-Holland Publishing Co.
10. th International World Wide Web Conference on Computer Networks: The International Journal of Computer and Telecommunications Networking (pp. 1-16). North-Holland Publishing Co.
11. Bodin, L. D., Gordon, L. A., & Loeb, M. P. (2005). Evaluating information security investments using the analytic hierarchy process. Communications of the ACM, 48(2), 79-83.
12. Bouch, A., Kuchinsky, A., & Bhatti, N. (2000). Quality is in the eye of the beholder: meeting users' requirements for Internet quality of service. Paper presented at the SIGCHI Conference on Human factors in computing systems, The Hague, The Netherlands.
13. th International Distributed Conference (IDC'99) (pp. 78-90).
14. Bouch, A., Sasse, M. A., & DeMeer, H. (2000, 5-7 June 2000). Of packets and people: A usercentered approach to quality of service. Paper presented at the International Workshop on Quality of Service (IWQOS 2000).
15. Buxton, W. (1995). Integrating the periphery and context: A new taxonomy of telematics. Proceedings of Graphics Interface (Vol. 95, pp. 239-246).
16. Cole, R. G., & Rosenbluth, J. H. (2001, May). Voice over IP performance monitoring. ACM SIGCOMM Computer Communication Review, 31(2), 9-24.
17. Cronin, J. J., & Taylor, S. A. (1994). SERVPERF vs. SERVQUAL: Reconciling performance-based and perceptions-minus-expectations measurement of service quality. Journal of Marketing, 58, 125-131.
18. Charzinski, J.(2001a, Dec 2001). Measured HTTP performance and fun factors. Paper presented at the ITC 2001, Salvador, BA, Brasil.
19. Charzinski, J. (2001b). Web performance in practice: Why we are waiting? Paper presented at the AEÜ International Journal of Electronics and Communications.
20. Cherkasova, L., Fu, Y., & Tang, W. (2002). Measuring end-to-end Internet service performance: Response Time, caching efficiency and QoS.
21. Cherkasova, L., Fu, Y., Tang, W., & Vahdat, A. (2003, Dec). Measuring and characterizing endto-end Internet service performance. ACM Trans. Inter. Tech., 3(4), 347-391.
22. Chung, H., & Zhao, X. (2004). Effects of perceived interactivity on Web site preference and memory: Role of personal motivation. Journal of ComputerMediated Communication, 10(1).
23. D'Ambra, J., & Rice, R. E. (2001). Emerging factors in user evaluation of the World Wide Web. Information and Management, 38, 373-384.
24. Davis, F. D. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly, 13(3), 319-340.
25. Davis, F. D., Bagozzi, R. P., & Warshaw, P. R. (1989). User acceptance of computer technology: A comparison of two theoretical models. Management Science, 35(8), 982-1003.
26. th ACM SIGCOMM Workshop on Network and System Support for Games. Hawthorne, NY: ACM Press.
27. ETSI. (1994). Network Aspects (NA); General aspects of Quality of Service (QoS) and Network Performance (NP). ETSI.
28. EURESCOM Project P905-PF (2000, August). AQUAVIT - Assessment of quality for audio-visual signals over Internet and UMTS - Deliverable 2: Methodology for subjective audio-visual quality evaluation in mobile and IP networks.
29. st Workshop on Network and System Support for Games (pp. 53-57). ACM Press.
30. Fogg, B. J., Jonathan, M., Othman, L., Alex, O., Chris, V., Nicholas, F., et al. (2001). What makes Web sites credible? A report on a large quantitative study. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. Seattle, WA: ACM Press.
31. Galletta, D., Henry, R., McCoy, S., & Polak, P. (2004). Web site delays: How tolerant are users? Journal of the Association for Information Systems, 5(1), 1-28.
32. Gardikis, G., Kourtis, A., & Constantinou, P. (2003). Dynamic bandwidth allocation in DVB-T networks providing IP services. IEEE Transactions on Broadcasting, 49(3), 314-318.
33. Gbaguidi, C., Verscheure, O., & Hubaux, J. P.(1997, Julio 1997). A new flexible and modular QoS mapping framework based on psychophysics. Paper presented at the MMNS 97, IFIP/IEEE Conference on Management of Multimedia Networks, Montreal, Canada.
34. Ghinea, G., & Magoulas, G. (2001a). Neural network-based interactive multicriteria decision making in a quality of perception-oriented management scheme. Joint Conference on Neural Networks (pp. 2536-2541).
35. Ghinea, G., & Magoulas, G. D. (2001b). Quality of service for perceptual considerations: An integrated perspective. IEEE International Conference on Multimedia and Expo (pp. 752-755).
36. Gronroos, C. (1983). Strategic management and marketing in the service sector. Boston: Marketing Science Institute.
37. Gunawan, I. P., & Ghanbari, M. (2003). Reduced-reference picture quality estimation by using local harmonic amplitude information. Paper presented at the London Communications Symposium 2003.
38. Habib, A., & Abrams, M. (2000). Analysis of sources of latency in downloading web pages. Paper presented at the WebNet 2000.
39. Hammer, F., Reichl, P., & Ziegler, T. (2004). Where packet traces meet speech samples: An instrumental approach to perceptual QoS evaluation of VoIP. Paper presented at the IWQOS'04.
40. Henderson, T., & Bhatti, S. (2001, October 5, 2001). Modelling user behaviour in networked games. Paper presented at the ACM Multimedia 2001, Ottawa, Canada.
41. International Telecommunication Union. (1996). Methods for subjective determination of transmission quality. ITU Recommendation P.800.
42. International Telecommunication Union. (1998). Objective measuring apparatus, Appendix 1: Test signals. ITU-T Recommendation P.50.
43. International Telecommunication Union. (2001). Perceptual evaluation of speech quality (PESQ), an objective method for end-to-end speech quality assessment of narrow-band telephone networks and speech codec. ITU Recommendation P.862.
44. International Telecommunication Union. (2003a). Mapping function for transforming P.862 raw result scores to MOS-LQO. ITU Recommendation P.862.1.
45. International Telecommunication Union. (2003b). Mean opinion score (MOS) terminology. ITU Recommendation P.800.1.
46. International Telecommunication Union. (2004). Single-ended method for objective speech quality assessment in narrow-band telephony applications. ITU-T Recommendation P.563.
47. International Telecommunication Union. (2005). The E-model, a computational model for use in transmission planning. ITU Recommendation G.107.
48. International Telecommunication Union. (2006). Conformance testing for narrowband voice over IP transmission quality assessment models. ITU-T Recommendation P.564.
49. Irnich, T. (2000). Measuring and modelling WWW traffic characteristics in access networks. Thesis. Aachen University of Technology.
50. ITU-T. P.862.1 (11/2003). Mapping function for transforming P.862 raw result scores to MOSLQO.
51. ITU-T. (1993). General aspects of quality of service and network performance in digital net works, including ISDNs. In Rec. G.1000. Vol. Rec. I.350, (ITU).
52. ITU-T. (1994). E.800: Terms and definitions related to quality of service and network performance including dependability.
53. ITU-T. (1997). Methods for subjective determination of transmisión quality.
54. ITU-T. (1998). Objective measuring apparatus, appendix 1: Test signals. ITU-T P.50 (2/1998)
55. ITU-T. (2001). Perceptual evaluation of speech quality (PESQ), an objective method for end-toend speech quality assessment of narrow-band telephone networks and speech codecs. P.862. (02/2001).
56. ITU-T. (2002). Internet protocol data communication service - IP packet transfer and availability performance parameters: International Telecommunication Union.
57. ITU-T. (2004a). Handbook on quality of service and network performance. ITU Press. ITU-T. (2004b). Handbook on quality of service and network performance. ITU Press.
58. ITU-T. (2005a). Wideband extension to recommendation P.862 for the assessment of wideband telephone networks and speech codecs. P.862.2 (11/2005).
59. ITU-T. (2005b). The E-model, a computational model for use in transmission planning. G.107 (03/2005).
60. ITU-T. (2006). Conformance testing for narrowband voice over IP transmission quality assessment models. P.564 (07/2006).
61. Johnson, C. (1998). Why CHI (computer-human interaction) has failed to improve the Web. Retrieved from www.dcs.gla.ac.uk/~johnson/papers/Web98.html
62. Koumaras, H., Kourtis, A., & Martakos, D. (2005). Evaluation of video quality based on objectively estimated metric. Journal of Communications and Networks, 7(3), 235-242.
63. Koumaras, H., Pallis, E., Xilouris, G., Kourtis, A., Martakos, D., & Lauterjung, J. (2004). Preencoding PQoS assessment method for optimized resource utilization. Paper presented at the HETNETs04, Ilkley, West Yorkshire, U.K.
64. Krishnamurthy, B., & Wills, C. E. (2000, May 2000). Analyzing factors that influence end-toend web performance. Paper presented at the Ninth International World Wide Web Conference, Amsterdam, Netherlands.
65. Lavie, T., & Tractinsky, N. (2004). Assessing dimensions of perceived visual aesthetics of Web sites. International Journal Human-Computer Studies, 60(3), 269-298.
66. Lee, C. (1999). On quality of service management. PhD thesis. Carnegie Mellon University.
67. Lee, C., Lehoczky, J., Siewiorek, D., Rajkumar, R., & Hansen, J. (1999). A scalable solution to the multi-resource QoS problem. Paper presented at the 20th IEEE Real-Time Systems Symposium.
68. Liberal, F., Ferro, A., Jodra, J. L., & Fajardo, J. O. (2005). Application of general perception-based QoS model to find providers' responsibilities. Case study: User perceived Web service performance. Paper presented at the Joint International Conference on Autonomic and Autonomous Systems and International Conference on Networking and Services (ICAS/ICNS 2005), Tahiti.
69. Liu, C., & Arnett, K. P. (2000). Exploring the factors associated with Web site success in the context of electronic commerce. Information and Management, 38, 23-33.
70. Lu, L., Wang, Z., Bovik, A. C., & Kouloheris, J. (2002). Full-reference video quality assessment considering structural distortion and no-reference quality evaluation of MPEG video. Paper presented at the IEEE International Conference on Multimedia.
71. Luna, C. E., Kondi, L. P., & Katsaggelos, A. K. (2003). Maximizing user utility in video streaming applications. IEEE Transactions on Circuits and Systems for Video Technology, 13(2), 141.
72. Mahlke, S. (2002). Factors influencing the experience of Web site usage. CHI '02 Extended Abstracts on Human Factors in Computing Systems (pp. 846-847): ACM Press.
73. Monfort, J. Y. (2006). Voice quality assessment, ITU-T Study Group 12. Retrieved from http://www.etsi.org/plugtests/History/2006STQ_Asia/JYMonfort_SG12_QoSMeasurement.pdf
74. Moon, J. W., & Kim, Y. G. (2001). Extending the TAM for a World-Wide-Web context. Information and Management, 38(4), 217-230.
75. rd International Workshop on Human Computer Interaction, Lille, France.
76. Muntean, C. H., & McManis, J. (2004, June 2024, 2004). A QoS-aware adaptative Web-based system. Paper presented at the IEEE International Conference on Communications.
77. Nah, F. (2004). A study on tolerable waiting time: How long are Web users willing to wait? Behaviour and Information Technology, 23(3), 153-163(111).
78. NS2. (2007). NS2. The network simulator. Retrieved from http://www.isi.edu/nsnam/ns/
79. Okamoto, T., & Hayashi, T. (2002). Analysis of service provider's profit by modeling customer's willingness to pay for IP QoS. Paper presented at the Globecom 2002.
80. Olshefski, D., & Nieh, J. (2006). Understanding the management of client perceived response time. SIGMETRICS Perform. Eval. Rev., 34(1), 240-251.
81. Olson, T. (1994). In a framework about tasktechnology fit, what are the tasks features. Paper presented at the CSCW '94: Workshop on video mediated communication: Testing, Evaluation & Design Implications, North Carolina, US.
82. Oodan, A. P., Ward, K. E., & Mullee, A. W. (1997). Quality of service in telecommunications. The IEE press.
83. OPNET. (2007). OPNET [http://www.opnet.com/].
84. Pantel, L., & Wolf, L. C. (2002). On the impact of delay on real-time multiplayer games. Miami, FL: ACM Press.
85. Parasuraman, A., Berry, L. L., & Zeithaml, V. A. (1988). SERVQUAL: A multiple-item scale for measuring consumer perceptions of service quality. Journal of Retailing, 64(1), 12-40.
86. Parasuraman, A., Zeithaml, V. A., & Berry, L. L. (1985). A conceptual model of service quality and its implications for future research. Journal of Marketing, 49(4).
87. Parasuraman, A., Zeithaml, V. A., & Berry, L. L. (1991). Refinement and reassessment of the SERVQUAL scale. Journal of Retailing, 67(4), 420-450.
88. st International Conference on Quality of Service in Heterogeneous Wired/Wireless Networks (QSHINE 2004), Dallas, US.
89. th International Symposium on Wireless Personal Multimedia Communications, Aalborg, Denmark.
90. Ramsay, J., Barbesi, A., & Preece, J. (1998). A psychological investigation of long retrieval times on the World Wide Web. Interacting with Computers, 10(1), 77-86(10).
91. Ranganathan, C., & Shobha, G. (2002). Key dimensions of business-to-consumer Web sites. Information and Management, 39, 457-465.
92. Richards, A., Rogers, G., Antoniades, M., & Witana, V. (1998, Nov). Mapping user level QoS from a single parameter. Paper presented at the International Conference on Multimedia Networks and Services (MMNS '98).
93. Riva, O., Saarto, J., & Kojo, M. (2004). Performance analysis on HTTP traffic and traffic mixtures with competing TCP and UDP flows. University of Helsinki - Department of Computer Science.
94. Saliba, A. J., Beresford, M. A., Ivanovich, M., & Fitzpatrick, P. (2005). User-perceived quality of service in wireless data networks. Personal Ubiquitous Comput., 9(6), 413-422.
95. Schaefer, C., Enderes, T., Ritter, H., & Zitterbart, M. (2002, April 2002). Subjective quality assessment for multiplayer realtime games. Paper presented at the Workshop on Network and System Support for Games.
96. Schubert, P. (2003). Evaluation of electronic commerce applications from the customer's viewpoint. International Journal of Electronic Commerce, 7.
97. th International Bled Electronic Commerce Conference, Bled, Slovenia.
98. Schubert, P., & Leimstoll, U. (2001). The extended Web assessment method (EWAM) applied: Do Web sites for consumer goods stand the test? Paper presented at the Eighth Research Symposium on Emerging Electronic Markets RSEEM 01, Maastricht, The Netherlands.
99. th Annual Hawaii International Conference on System Sciences (HICSS'02), Big Island, Hawaii.
100. Sears, A., Jacko, J. A., & Borella, M. S. (1997). Internet delay effects: How users perceive quality, organization, and ease of use of information. Atlanta, GA: ACM Press.
101. Seeling, P., Reisslein, M., & Kulapala, B. (2004). Network performance evaluation using frame size and quality traces of single layer and two layer video: A tutorial. IEEE Communications Surveys & Tutorials, 6(3), 58-78.
102. Selz, D., & Schubert, P. (1997). Web assessment: A model for the evaluation and the assessment of successful electronic commerce applications. Electronic Markets, 7(3).
103. Sevcik, P. J. (2002). Understanding how users view application performance. Business Communication Reviews--Net Forecasts, 32(7).
104. nd Workshop on Network and System Support for Games. Redwood City, California.
105. Sun, L., & Ifeachor, E. (2006). Voice quality prediction models and their application in VoIP networks. IEEE Transactions on Multimedia, 8(4), 809-820.
106. th IASTED International Conference, Internet and Multimedia Systems and Applications, Grindelwald, Switcherland.
107. van der Heijden, H. (2003). Factors influencing the usage of Web sites: The case of a generic portal in The Netherlands. Information and Management, 40(6), 541-549.
108. van der Mei, R. D. (2004). Performance analysis of communication networks. Course syllabus, Faculty of Science: Vrije Universiteit.
109. VQEG. (2000). Final report from the video quality experts group on the validation of objective models of video quality assessment. Retrieved from http://www.vqeg.org
110. Wang, H., & Bovik, A. C. (2004). Video quality assessment based on structural distortion measurement. Signal Processing: Image Communication, special issue on Objective video quality metrics, 19(2), 121-132.
111. Wang, H., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004). Image quality assessment: From error visibility to structural similarity. IEEE Transactions on Image Processing, 13(4), 1-14.
112. Wang, Z., Bovik, A. C., & Lu, L. (2002). Why is image quality assessment so difficult? Paper presented at the IEEE International Conference on Acoustics, Speech, and Signal Processing.
113. Wang, Z., Sheikh, H. R., & Bovik, A. C.(2003). Objective video quality assessment. In B. Furht & O. Marqure (Eds.), The handbook of video databases: Design and applications (Vol. 41, pp. 1041-1078). CRC Press.
114. Watson, A., & Sasse, M. A. (1998). Measuring perceived quality of speech and video in multimedia conferencing applications. Paper presented at the ACM Multimedia.
115. Woolley, R. D. (2000). Web performance measurement & capacity planning: Briefing paper. Chief Information Officer's Section. Office of the Governor. State of Utah.
116. Xilouris, G., Kourtis, A., & Stefanou, G. (2005). A mesh topology DVB-S network architecture for node interconnection, featuring QoS capabilities. Computer Networks, 48(1), 45-56.
117. th Asia-Pacific Conference on Communications (APCC 2004), Beijing, China.
118. Zander, S., & Armitage, G. (2004). Empirically measuring the QoS sensitivity of interactive online game players. Paper presented at the Australian Telecommunications Networks & Applications Conference 2004 (ATNAC 2004), Sydney, Australia.
119. th Annual Hawaii International Conference on System Sciences (HICSS-34).
120. Zhang, P., & von Dran, G. (2001b). User expectations and rankings of quality factors in different Web site domains. International Journal of Electronic Commerce, 6(2), 9.
121. Zviran, M., Glezer, C., & Avni, I. (2006). User satisfaction from commercial Web sites: The effect of design and use. Information and Management, 43(2), 157-178.