A simulation-based methodology and tool for automating the modeling and analysis of voice-over-IP perceptual quality

Performance Evaluation

Volumn 54, Issue 2, 2003, Pages 129-147

  Conway, Adrian E ^a   Zhu, Yali ^b  

^a Verizon Laboratories   (United States)

^b Worcester Polytechnic Institute   (United States)

Author keywords

Network models; Objective perceptual quality evaluation; Packet voice quality; PESQ; PSQM; Simulation methodology; VoIP quality

Indexed keywords

ALGORITHMS; COMPUTER SIMULATION; COSTS; MULTIMEDIA SYSTEMS; MULTIPLEXING; QUALITY OF SERVICE; SPEECH; TELECOMMUNICATION NETWORKS;

PACKET VOICE QUALITY;

AUTOMATION;

EID: 0041827407     PISSN: 01665316     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0166-5316(03)00068-3     Document Type: Conference Paper

References (31)

1. Testing VoIP using PSQM, Abacus Application Note 11, Zarak Systems Corporation, September 1999.
2. Cermak G.W. Subjective quality of speech over packet networks as a function of packet loss, delay and delay variation. Int. J. Speech Technol. 5:2002;65-84.
3. Cole R.G., Rosenbluth J.H. Voice over IP performance monitoring. Comput. Commun. Rev. 31(2):2001;9-24.
4. A.E. Conway, S.B. Moon, P. Skelly, Synchronized two-way voice simulation tool for internet phone performance analysis and evaluation, in: Computer Performance Evaluation Modeling Techniques and Tools, Lecture Notes in Computer Science, vol. 1245, Springer, Berlin, 1997, pp. 108-122.
5. A.E. Conway, Y. Zhu, Analyzing voice-over-IP subjective quality as a function of network QoS: a simulation-based methodology and tool, in: Computer Performance Evaluation Modelling Techniques and Tools, Lecture Notes in Computer Science, vol. 2324, Springer, Berlin, 2002, pp. 289-308.
6. A.E. Conway, Y. Zhu, Applying objective perceptual quality assessment methods in network performance modeling, in: Proceedings of the 11th IEEE International Conference on Computer Communications and Networks (ICCCN), Miami, FL, October 2002, pp. 116-123.
7. P. Corriveau, A. Webster, A. Rohaly, J. Libert, Video Quality Experts Group: the quest for valid objective methods, in: B. Rogowitz, T. Pappas (Eds.), Proceedings of the SPIE on Human Vision and Electronic Imaging V, vol. 3959, June 2000, pp. 129-139.
8. Denisowski P. How does it sound? IEEE Spectrum. 38(2):2001;60-64.
9. Hollier M.P., Voelcker R. Towards a multi-modal perceptual model. BT Technol. J. 14(4):1997;162-171.
10. ITU-R Recommendation BS.1387, Method for objective measurements of perceived audio quality (PEAQ), 1998.
11. ITU-T Recommendation P.50, Artificial Voices, 1999.
12. ITU-T Recommendation P.50, Appendix 1, Test signals, 1998.
13. ITU-T Recommendation P.800, Methods for subjective determination of transmission quality, 1996.
14. ITU-T Recommendation P.861, Objective quality measurement of telephone-band (300-3400 Hz) speech codecs, 1998.
15. ITU-T Recommendation P.862, Perceptual evaluation of speech quality (PESQ), an objective method for end-to-end speech quality assessment of narrowband telephone networks and speech codecs, 2001.
16. ITU-T Contribution COM 12-20-E, Improvement of the P.861 perceptual speech quality measure, KPN Research, The Netherlands, December 1997.
17. M.J. Karam, F.A. Tobagi, Analysis of the delay and jitter of voice traffic over the internet, in: Proceedings of the IEEE INFOCOM 2001, vol. 2, 2001, pp. 824-833.
18. M. Keyhl, C. Schmidmer, H. Wachter, A combined measurement tool for the objective, perceptual based evaluation of compressed speech and audio signals, in: Proceedings of the 106th Audio Engineering Society (AES) Convention, 4931 (M3), Munich, Germany, May 1999.
19. T. Kostas, M. Borella, I. Sidhu, G. Schuster, J. Grabiec, J. Mahler, Real-time voice over packet-switched networks, IEEE Network 12 (1) (1998) 18-27.
20. O. Maeshima, Y. Ito, M. Ishikura, T. Asami, A method of service quality estimation with a network measurement tool, in: Proceedings of the IEEE International Performance, Computing and Communications Conference, February 1999, pp. 201-209.
21. NIST Net emulator homepage. http://www.antd.nist.gov/itg/nistnet/index.html.
22. Perkins M., Evans K., Pascal D., Thorpe L. Characterizing the subjective performance of the ITU-T 8 kb/s speech coding algorithm - ITU-T G.729. IEEE Commun. Mag. 359:1997;74-81.
23. Perkins C., Hodson O., Hardman V. A survey of packet-loss recovery techniques for streaming audio. IEEE Network Mag. 12(5):1998;40-48.
24. Rayes A., Sage K. Integrated management architecture for IP-based networks. IEEE Commun. Mag. 38(4):2000;48-53.
25. A.W. Rix, J.G. Beerends, M.P. Hollier, A.P. Hekstra, Perceptual evaluation of speech quality (PESQ) - a new method for speech quality assessment of telephone networks and codecs, in: Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing, vol. 2, 2001, pp. 749-752.
26. A. Rohaly et al., Video Quality Experts Group: current results and future directions, in: K. Ngan, T. Sikora, M. Sun (Eds.), Proceedings of the SPIE on Visual Communications and Image Processing 2000, vol. 4067, May 2000, pp. 742-753.
27. L. Sun, G. Wade, B. Lines, E. Ifeachor, Impact of packet loss location on perceived speech quality, in: Proceedings of the Second IP-Telephony Workshop, Columbia University, New York, April 2001.
28. L. Thorpe, W. Yang, Performance of current perceptual objective speech quality measures, in: Proceedings of the IEEE Workshop on Speech Coding, 1999, pp. 144-146.
29. State of the art voice quality testing, White Paper, Opticom GmbH, Erlangen, Germany, 2000.
30. Video PQoS™ - a software tool to measure the perceptual quality of digital video, Genista Corporation, 2002.
31. Stream PQoS™ - perceptual quality monitoring software for streaming video applications, Genista Corporation, 2002.