Methods of improving the accuracy and reproducibility of objective quality assessment of VoIP speech

IEICE Transactions on Communications

Volumn E87-B, Issue 6, 2004, Pages 1660-1669

  Takahashi, Akira ^a   Masuda, Masataka ^a   Kurashima, Atsuko ^a  

^a NTT CORPORATION   (Japan)

Author keywords

Objective quality assessment; QoS; Speech quality; Subjective quality; VoIP

Indexed keywords

BIT ERROR RATE; CODE CONVERTERS; IMAGE CODING; IMAGE QUALITY; PACKET NETWORKS; QUALITY OF SERVICE; SPEECH; TELECOMMUNICATION SERVICES;

OBJECTIVE QUALITY ASSESSMENT; SPEECH QUALITY; SUBJECTIVE QUALITY; VOIP;

VOICE/DATA COMMUNICATION SYSTEMS;

EID: 3042638099     PISSN: 09168516     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (28)

1. ITU-T Recommendation P.79, "Calculation of loudness ratings for telephone sets," Sept. 1999.
2. N. Kitawaki and K. Itoh, "Pure delay effects on speech quality in telecommunications," IEEE J. Sel. Areas Commun., vol.9, pp.586-593, May 1991.
3. H. Nomura, H. Oikawa, and M. Nishino, "Permissive value of loudness rating for single echo (ELR) in digital telephone sets," IEICE Trans. Fundamentals (Japanese Edition), vol.J73-A, no.10, pp.1709-1711, Oct. 1990.
4. CCITT Contribution COM XII-60, "Evaluation of non-linear distortion via the coherence function (BNR)," April 1982.
5. N. Kitawaki, H. Nagabuchi, and K. Itoh, "Objective quality evaluation for low-bit-rate speech coding systems," IEEE J. Sel. Areas Commun., vol.6, no.2, pp.242-248, Feb. 1988.
6. J. Lalue, "The information index: An objective measure of speech transmission performance," Annales des Telecommunications, vol.45, no.1-2, CNET/France, pp.47-65, 1990.
7. T. Watanabe and S. Hayashi, "An objective measure based on an auditory model for assessing low-rate coded speech," IEICE Trans. Inf. & Syst., Vol.E78-D, no.6, pp.751-757, June 1995.
8. J.G. Beerends and J.A. Stemerdink, "A perceptual speech quality measure based on a psychoacoustic sound representation," J. Audio Eng. Soc., vol.42, no.3, pp. 115-123, March 1994.
9. R.F. Kubichek, E.A. Quincy, and K.L. Kiser, "Speech quality assessment using expert pattern recognition techniques," Proc. IEEE Pacific Rim Conf. on Computers, Communication, and Signal Processing, pp.208-211, June 1989.
10. ITU-T Recommendation P.861, "Objective quality measurement of telephone-band (300-3400 Hz) speech codecs," Aug. 1996.
11. ITU-T Recommendation P.862, "Perceptual evaluation of speech quality (PESQ), an objective method for end-to-end speech quality assessment of narrow-band telephone networks and speech codecs," Feb. 2001.
12. ITU-T Contribution COM12-117-E, "Report of question 13/12 rapporteur's meeting (Solothurn, Germany, 6-10 March 2000)," March 2000.
13. ITU-T Recommendation G.729, "Coding of speech at 8 kbit/s using conjugate-structure algebraic-code-excited linear-prediction (CS-ACELP)," March 1996.
14. Supplement 23 to ITU-T P-series Recommendations, "ITU-T coded speech database," Feb. 1998.
15. ITU-T COM12-74-E, "Review of validation tests for objective speech quality measures (NTT, Japan)," March 1996.
16. ITU-T Recommendation G.723.1, "Dual rate speech coder for multimedia communication transmitting at 5.3 & 6.3 kbit/s," March 1996.
17. M. Masuda and K. Ori, "Network performance metrics in estimating the speech quality of VoIP," IEICE 2001 Asia-Pacific Symposium on Information and Telecommunication Technologies (APSITT 2001), pp.333-337, Nov. 2001.
18. ITU-T Recommendation P.810, "Modulated noise reference unit (MNRU)," Feb. 1996.
19. ITU-T Recommendation G.191, "Software tools for speech and audio coding standardization," Nov. 1996.
20. ITU-T Contribution COM 12-D146-E, "Performance evaluation of E-model and proposed modifications (NTT, Japan)," Sept. 2003.
21. A. Takahashi, N. Kitawaki, P. Usai, and D. Atkinson, "Performance evaluation of objective quality measures for coded speech," Eurospeech'97, vol.1, pp.437-440, Sept. 1997.
22. K. Itoh, N. Kitawaki, H. Irii, and H. Nagabuchi, "A new artificial speech signal for objective quality evaluation of speech coding systems," IEEE Trans. Commun., vol.42, no.234, pp.664-672, Feb. 1994.
23. H. Nagabuchi, K. Satoh, and N. Kitawaki, "Artificial conversational speech signal generation method for measuring characteristics of devices operated by speech signals," ASA 126th meeting at Denver, 2pSP8, Oct. 1993.
24. ITU-T Recommendation P.50, "Artificial voice," Sept. 1999.
25. ITU-T Recommendation P.59, "Artificial conversational speech," March 1993.
26. ITU-T Recommendation P.834, "Methodology for the derivation of equipment impairment factors from instrumental models," July 2002.
27. ITU-T Recommendation G.107, "The E-model, a computational model for use in transmission planning," March 2003.
28. J. Davidson and J. Peters, Voice over IP Fundamentals, Cisco Press, March 2000.