Assessing the quality of voice communications over internet backbones

IEEE/ACM Transactions on Networking

Volumn 11, Issue 5, 2003, Pages 747-760

  Markopoulou, Athina P ^a   Tobagi, Fouad A ^a   Karam, Mansour J ^b  

^a Stanford University   (United States)

^b RouteScience Technologies Inc   (United States)

Author keywords

Computer networks; Internet; Measurements; Voice communications; Voice over IP (VoIP); Voice quality assessment

Indexed keywords

ALGORITHMS; COMPUTER SIMULATION; INTERNET TELEPHONY; PACKET NETWORKS; PULSE CODE MODULATION; QUALITY OF SERVICE; SIGNAL RECEIVERS; TELECOMMUNICATION TRAFFIC; VOICE/DATA COMMUNICATION SYSTEMS; WIDE AREA NETWORKS;

PUBLIC SWITCHED TELEPHONE NETWORK; VOICE OVER IP; VOICE QUALITY ASSESSMENT;

INTERNET;

EID: 0242334167     PISSN: 10636692     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNET.2003.818179     Document Type: Article

References (44)

1. A. Markopoulou, F. Tobagi, and M. Karam, "Assessment of VoIP quality over Internet backbones," in Proc. IEEE INFOCOM, New York, NY, June 2002, pp. 150-159.
2. K. Sriram and W. Whitt, "Characterizing superposition arrival processes in packet multiplexers for voice and data," IEEE J. Select. Areas Commun., vol. SAC-4, pp. 833-846, Sept. 1986.
3. P. Brady, "A technique for investigating on/off patterns of speech," Bell Labs Tech. J., vol. 44, no. 1, pp. 1-22, Jan. 1965.
4. W. Jiang and H. Schulzrinne, "Analysis of on-off patterns in VoIP and their effect on voice traffic aggregation," in Proc. IEEE Int. Conf. Computer Communication Networks, Las Vegas, NV, Oct. 2000, pp. 82-87.
5. R. Cox, "Three new speech coders from the ITU cover a range of applications," IEEE Commun. Mag., vol. 35, pp. 40-47, Sept. 1997.
6. R. Ramjee, J. Kurose, D. Towsley, and H. Schulzrinne, "Adaptive playout mechanisms for packetized audio applications in wide-area networks," in Proc. IEEE INFOCOM, Toronto, Canada, June 1994, pp. 680-688.
7. S. Moon, J. Kurose, and D. Towsley, "Packet audio playout delay adjustment: performance bounds and algorithms," ACM/Springer Multimedia Syst., vol. 6, pp. 17-28, Jan. 1998.
8. P. DeLeon and C. Sreenan, "An adaptive predictor for media playout buffering," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing (ICASSP), vol. 6, Mar. 1999, pp. 3097-3100.
9. C. J. Sreenan, J.-C. Chen, P. Agrawal, and B. Naderdran, "Delay reduction techniques for playout buffering," IEEE Trans. Multimedia, vol. 2, pp. 88-100, June 200.
10. Y. Liang, N. Färber, and B. Girod, "Adaptive playout scheduling using time scale modification in packet voice communications," in Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing (ICASSP), vol. 3, Salt Lake City, UT, May 2001, pp. 1445-1448.
11. I. Kouvelas and V. Hardman, "Overcoming workstation scheduling problems in a real-time audio tool," in Proc. USENIX, Anaheim, CA, Jan. 1997, pp. 235-242.
12. C. Perkins, O. Hodson, and V. Hardman, "A survey of packet loss recovery techniques for streaming audio," IEEE Network, vol. 12, pp. 40-48, Sept./Oct. 1998.
13. Dept. Comput. Sci., UCL. Robust Audio Tool (RAT). [Online]. Available: http://ww-mice.cs.ucl.ac.uk/multimedia/software/rat/
14. T. Kostas, M. Borella, I. Sidhu, G. Schuster, and J. Grabiec, "Real-time voice over packet-switched networks," IEEE Network, vol. 12, pp. 18-27, Jan./Feb. 1998.
15. "Methods for subjective determination of transmission quality," ITU-T Recommendation P.800, Aug. 1996.
16. "The Emodel: A computational model for use in transmission planning," ITU-T Recommendation G.107, Dec. 1998.
17. "Definition of categories of speech transmission quality," ITU-T Recommendation G.109, Sept. 1999.
18. A. Watson and M. Sasse, "Measuring perceived quality of speech and video in multimedia conferencing applications," in Proc. ACM Multimedia 1998, Bristol, UK, Sept. 12-16, 1998.
19. J. Gruber and L. Strawczynski, "Subjective effects of variable delay and speech clipping in dynamically managed voice systems," IEEE Trans. Commun., vol. COM-33, pp. 801-808, Aug. 1985.
20. R. Cox and M. Perkins, "Results of a subjective listening test for G.711 with frame erasure concealment," AT & T Contr. to T1A1.7/99-016, May 1999.
21. M. Perkins, K. Evans, D. Pascal, and L. Thorpe, "Characterizing the subjective performance of the ITU-T 8 kb/s speech coding algorithm-ITU-T G.729," IEEE Commun. Mag., vol. 35, pp. 74-81, Sept. 1997.
22. H. Sanneck, L. Le, and A. Wolisz, "Intra-flow loss recovery and control for VoIP," in Proc. ACM Multimedia, 2001, pp. 441-454.
23. S. Voran, "Perception of temporal discontinuity impairments in coded speech-A proposal for objective estimators and some subjective test results," in Proc. 2nd Int. Conf. Measurement of Speech and Audio Quality in Networks (MESAQIN), Prague, Czech Republic, May 2003, pp. 37-46.
24. "Application of the Emodel: A planning guide," ITU-T Recommendation G.108, Sept. 1998.
25. "Transmission impairments due to speech processing," ITU-T Recommendation G.113, Feb. 2001.
26. "Actual measurements of network and terminal characteristics and performance parameters in TIPHON networks and their influence on voice quality," ETSI, TIPHON project, TR 101 329-6, July 2000.
27. "One Way Transmission Time," ITU-T Recommendation G.114, May 2000.
28. N. Kitawaki and K. Itoh, "Pure delay effects on speech quality in telecommunications," IEEE J. Select. Areas Commun., vol. 9, pp. 586-593, May 1991.
29. R. G. Cole and J. Rosenbluth, "Voice over IP performance monitoring," Comput. Commun. Rev., vol. 4, Apr. 2001.
30. V. Vleeschauwer, J. Janssen, G. Petit, and F. Poppe, "Quality bounds for packetized voice transport," Alcatel, Tech. Rep., 1st Quarter 2000.
31. A. Clark, "Modeling the effects of burst packet loss and recency on subjective voice quality," in Proc. IP Telephony Workshop, Mar. 2001.
32. "Continuous assessment of time-varying subjective vocal quality and its relationship with overall subjective quality," France Telecom R&D, ITU ST 12, Contr. COM 12-94 E, July 1999.
33. "Study of the relationship between instantaneous and overall subjective speech quality for time-varying quality speech sequences: Influence of the recency effect," France Telecom R&D, ITU Study Group 12, Contribution D.139, May 2000.
34. A. Clark and R. Liu, "Comparison of TS 101 329-5 Annex E With PAMS and PSOM," TIPHON#23, Temp. Doc. 061, July 2001.
35. ____, "Comparison of TS101 329-5 Annex E With Emodel," TIPHON#23, Temp. Doc. 062, July 2001.
36. A. Markopoulou, "Assessing the quality of multimedia communications over Internet backbones," Ph.D. dissertation, Stanford Univ., Stanford, CA, Oct. 2002.
37. F. Tobagi, A. Markopoulou, and M. Karam, "Is the Internet ready for VoIP?," in Proc. IWDC, Capri, Italy, Sept. 2002, pp. 49-57.
38. J.-C. Bolot, "Characterizing end-to-end packet delay and loss in the Internet," in Proc. ACM SIGCOMM, San Francisco, CA, Sept. 1993, pp. 289-298.
39. J.-C. Bolot, H. Crepin, and A. V. Garcia, "Analysis of audio packet loss in the Internet," in Proc. NOSSDAV, Durham, NH, 1995, pp. 154-165.
40. M. Yajnik, S. Moon, J. Kurose, and D. Towsley, "Measurement and modeling of the temporal dependence in packet loss," in Proc. IEEE INFOCOM, Mar. 1999, pp. 345-352.
41. D. Loguinov and H. Radha, "End-to-end Internet video traffic dynamics: Statistical study and analysis," in Proc. IEEE INFOCOM, New York, NY, June 2002, pp. 723-732.
42. C. Boutremans, G. Iannaccone, and C. Diot, "Impact of link failures on VoIP performance," in Proc. NOSSDAV, Miami, FL, 2002, pp. 63-71.
43. G. Iannaccone, C. Chuah, R. Mortier, S. Bhattacharyya, and C. Diot, "Analysis of link failures in an IP backbone," in Proc. ACM SIGCOMM Internet Measurement Workshop, Marseille, France, Nov. 2002, pp. 237-242.
44. W. Jiang and H. Schulzrinne, "QoS measurement of real time multimedia services in the Internet," Columbia Univ., New York, NY, Rep. CUCS-015-99, 1999.