Listeners' weighting of acoustic cues to synthetic speech naturalness: A multidimensional scaling analysis

Speech Communication

Volumn 53, Issue 3, 2011, Pages 311-326

  Mayo, Catherine ^a   Clark, Robert A J ^a   King, Simon ^a  

^a UNIVERSITY OF EDINBURGH   (United Kingdom)

Author keywords

Acoustic cue weighting; Evaluation; Multidimensional scaling; Speech perception; Speech synthesis

Indexed keywords

ACOUSTIC CHARACTERISTIC; ACOUSTIC CUES; CUE WEIGHTING; EVALUATION; EVALUATION METHOD; MULTIDIMENSIONAL SCALING; MULTIDIMENSIONAL SCALING ANALYSIS; MULTIDIMENSIONAL SCALING TECHNIQUES; ONE DIMENSION; PAIR-WISE COMPARISON; PERCEPTUAL EVALUATION; SPEECH PERCEPTION; SPEECH SYNTHESIS SYSTEM; SYNTHETIC SPEECH; SYNTHETIC SPEECH NATURALNESS;

SPEECH SYNTHESIS;

EID: 79551495380     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2010.10.003     Document Type: Article

References (60)

1. P. Allen, and C. Bond Multidimensional scaling of complex sounds by school-aged children and adults J. Acoust. Soc. Amer. 102 4 1997 2255 2263
2. P. Allen, and S. Scollie Stimulus set effects in the similarity ratings of unfamiliar complex sounds J. Acoust. Soc. Amer. 112 1 2002 211 218
3. Bailly, G.; Campbell, N.; Mobius, B.; 2003. ISCA special session: Hot topics in speech synthesis. .
4. C.T. Best, B. Morrongiello, and R. Robson Perceptual equivalence of acoustic cues in speech and non-speech perception Percept. Psychophys. 29 3 1981 191 211
5. Black, A.; Taylor, P.A.; Caley, R.; Clark, R.; King, S.; Richmond, K.; 1997-2004. The Festival speech synthesis system. Available from CSTR .
6. A.R. Bradlow, L.C. Nygaard, and D.B. Pisoni Effects of talker, rate, and amplitude variation on recognition memory for spoken words Percept. Psychophys. 61 1999 206 219
7. Cerňak, M.; Rusko, M.; 2005. An evaluation of synthetic speech using the PESQ measure. In: Proc. Forum Acousticum, Budapest, pp. 2725-2728.
8. Cerňak, M.; Rusko, M.; Trnka, M.; 2009. Diagnostic evaluation of synthetic speech using speech recognition. In: Proc. ICSV1, International Congress on Sound and Vibration, Kraków.
9. Chen, J.; Campbell, N.; 1999. Objective distance measures for assessing concatenative speech synthesis. In: Proc. Eurospeech'99, Sixth European Conference on Speech Communication and Technology, Budapest, Hungary, pp. 611-614.
10. L.A. Christensen, and L.E. Humes Identification of multidimensional stimuli containing speech cues and the effects of training J. Acoust. Soc. Amer. 102 4 1997 2297 2310
11. Clark, R.A.J.; 2003. Modelling pitch accents for concept-to-speech synthesis. In: Internat. Congress of Phonetic Sciences, Barcelona, Spain, pp. 1141-1144.
12. Clark, R.A.J.; Dusterhoff, K.E.; 1999. Objective methods for evaluating synthetic intonation. In: Proc. Eurospeech'99, Sixth European Conf. on Speech Communication and Technology, Budapest, Hungary, pp. 1623-1626.
13. R.A.J. Clark, K. Richmond, and S. King Multisyn: Open-domain unit selection for the Festival speech synthesis system Speech Commun. 49 4 2007 317 330
14. A. Cutler, and T. Otake Mora or phoneme? Further evidence for language-specific listening J. Memory Lang. 33 1994 824 844
15. Expert Advisory Group on Language Engineering Standards, 1996. Evaluation of natural language processing systems: Final report. .
16. Falk, T.H.; Moeller, S.; Karaiskos, V.; King, S.; 2008. Improving instrumental quality prediction performance for the Blizzard Challenge. In: Proc. Blizzard Workshop, Brisbane, Australia.
17. C. Fisher, and H. Tokura Prosody in speech to infants: Direct and indirect acoustic cues to syntactic structure J.L. Morgan, K. Demuth, Signal to Syntax: Bootstrapping from Speech to Grammar in Early Acquisition 1996 Lawrence Erlbaum Mahwah, NJ 343 363
18. A.L. Francis, N. Kaganovich, and C. Driscoll-Huber Cue-specific effects of categorization training on the relative weighting of acoustic cues to consonant voicing in English J. Acoust. Soc. Amer. 124 2008 1234 1251
19. J.S. Garofolo Getting Started with the DARPA TIMIT CD-ROM: An Acoustic Phonetic Continuous Speech Database 1988 National Institute of Standards and Technology (NIST) Gaithersburgh, MD
20. P.C. Gordon, J.L. Eberhardt, and J.G. Rueckl Attentional modulation of the phonetic significance of acoustic cues Cogn. Psychol. 25 1993 1 42
21. J.L. Hall Application of multidimensional scaling to subjective evaluation of coded speech J. Acoust. Soc. Amer. 110 2001 2167 2182
22. V. Hazan, and S. Barrett The development of phonemic categorisation in children aged 6-12 J. Phonetics 28 2000 377 396
23. V. Hazan, and A. Simpson The effect of cue-enhancement on the intelligibility of nonsense word and sentence materials presented in noise Speech Commun. 24 1998 211 226
24. Hazan, V.; Simpson, A.; Huckvale, M.; 1998. Enhancement techniques to improve the intelligibility of consonants in noise: Speaker and listener effects. In: ICSLP, Sydney, Australia, pp. 2163-2167.
25. Hirst, D.; Rilliard, A.; Aubergé, V.; 1998. Comparison of subjective evaluation and an objective evaluation metric for prosody in text-to-speech synthesis. In: Proc. ESCA/COCOSDA Workshop on Speech Synthesis'98, Jenolan Caves, Blue Mountians, Australia.
26. ITU-T Recommendation P.85, 1994. A method for subjective performance assessment of the quality of speech output devices. International Telecommunications Union publication.
27. P. Iverson, P.K. Kuhl, R. Akahane-Yamada, D.E.Y. Tohkura, A. Kettermann, and C. Siebert A perceptual interference account of acquisition difficulties for non-native phonemes Cognition 87 2002 B47 B57
28. P. Iverson, V. Hazan, and K. Bannister Phonetic training with acoustic cue manipulations: A comparison of methods for teaching English /r/-/l/ to Japanese adults J. Acoust. Soc. Amer. 118 2005 3267 3278
29. Jilka, M.; 2005. Exploration of different types of intonational deviations in foreign-accented and synthesized speech. In: Proc. Interspeech-2005, Lisbon, Portugal, pp. 2393-2396.
30. Jilka, M.; Syrdal, A.; Conkie, A.; Kapilow, D.; 2003. Effects on TTS quality of methods of realizing natural prosodic variations. In: Proc. ICPhS, International Congress of Phonetic Sciences, Bercelona, Spain, pp. 2549-2552.
31. P.W. Jusczyk The Discovery of Spoken Language 1997 MIT Press Cambridge, Massachusetts
32. Klabbers, E.; Veldhuis, R.; 1998. On the reduction of concatenation artefacts in diphone synthesis. In: Proc. ICSLP'98, 5th Internat. Conf. on Spoken Language Processing, Sydney, Australia, pp. 1983-1986.
33. E. Klabbers, and R. Veldhuis Reducing audible spectral discontinuities IEEE Trans. Speech Audio Process. 9 2001
34. J. Kreiman, and B.R. Gerratt Validity of rating scale measures of voice quality J. Acoust. Soc. Amer. 104 1998 1598 1608
35. J. Kreiman, and B.R. Gerratt Sources of listener disagreement in voice quality assessment J. Acoust. Soc. Amer. 108 2000 1867 1876
36. J. Kreiman, and B.R. Gerratt Perceptual relevance of source spectral slope measures J. Acoust. Soc. Amer. 115 2004 2609
37. J. Kreiman, B.R. Gerratt, and M. Ito When and why listeners disagree in voice quality assessment J. Acoust. Soc. Amer. 122 4 2007 2354 2364
38. J.B. Kruskal, and M. Wish Multidimensional Scaling Sage University Paper series on Quantitative Applications in the Social Sciences 1978 Sage Pubns. Beverly Hills and London
39. Lamel, L.F.; Kassel, R.H.; Seneff, S.; 1989. Speech database development: Design and analysis of the acoustic-phonetic corpus. In: Proc. Speech I/O Assessment and Speech Databases, Noordwijkerhout, The Netherlands, pp. 2161-2170.
40. J. Marozeau, A. de Cheveigné, S. McAdams, and S. Winsberg The dependency of timbre on fundamental frequency J. Acoust. Soc. Amer. 114 2003 2946 2957
41. C. Mayo, and A. Turk Adult-child differences in acoustic cue weighting are influenced by segmental context: Children are not always perceptually biased toward transitions J. Acoust. Soc. Amer. 115 2004 3184 3194
42. C. Mayo, and A. Turk The influence of spectral distinctiveness on acoustic cue weighting in children's and adults' speech perception J. Acoust. Soc. Amer. 118 2005 1730 1741
43. Mayo, C.; Clark, R.A.J.; King, S.; 2005. Multidimensional scaling of listener responses to synthetic speech. In: Proc. Interspeech 2005, Lisbon, Portugal.
44. Möller, S.; Falk, T.H.; 2009. Quality prediction for synthesized speech: Comparison of approaches. In: Proc. NAG/DAGA 2009, Rotterdam, pp. 1168-1171.
45. S. Nittrouer The role of temporal and dynamic signal components in the perception of syllable-final stop voicing J. Acoust. Soc. Amer. 115 2004 1777 1790
46. Plumpe, M.; Meredith, S.; 1998. Which is more important in a concatenative text to speech system - pitch, duration, or spectral discontinuity? In: Proc. ESCA/COCOSDA Workshop on Speech Synthesis'98, Jenolan Caves, Blue Mountians, Australia.
47. C.R. Rabinov, J. Kreiman, B.R. Gerratt, and S. Bielamowicz Comparing reliability of perceptual ratings of roughness and acoustic measures of jitter J. Speech Hear. Res. 38 1995 26 32
48. W. Schnieder, A. Eschman, and A. Zuccolotto E-Prime User's Guide; E-Prime Reference Guide 2002 Psychology Software Tools, Inc. Pittsburgh, PA
49. Stylianou, Y.; Syrdal, A.K.; 2001. Perceptual and objective detection of discontinuities in concatenative speech synthesis. In: Proc. ICASSP, Internat. Conf. on Acoustics, Speech and Signal Processing, Salt Lake City, Utah.
50. Syrdal, A.; 2001. Phonetic effects on listener detection of vowel concatenation. In: Proc. Eurospeech 2001, 7th European Conference on Speech Communication and Technology, Aalborg, Denmark, pp. 979-982.
51. A. Syrdal, and M. Jilka Acceptability of variations in question intonation in natural and synthesised American English J. Acoust. Soc. Amer. 115 5 2004 2543(A)
52. A. Turk, S. Nakai, and M. Sugahara Acoustic segment durations in prosodic research: A practical guide S. Sudhoff, D. Lenertova, R. Meyer, S. Pappert, P. Augurzky, I. Mleinek, N. Richter, J. Schliesser, Methods in Empirical Prosody Research 2006 De Gruyter Berlin 1 28
53. Vainio, M.; Järvikivi, J.; Werner, S.; 2002. Effect of prosodic naturalness on segmental acceptability in synthetic speech. In: Proceedings IEEE 2002 Workshop on Speech Synthesis, Santa Monica, California.
54. J. Vepa, and S. King Join cost for unit selection speech synthesis A. Alwan, S. Narayanan, Text to Speech Synthesis: New Paradigms and Advances 2004 Prentice-Hall Upper Saddle River, NJ
55. C. Wardrip-Fruin On the status of temporal cues to phonetic categories: Preceding vowel duration as a cue to voicing in final stop consonants J. Acoust. Soc. Amer. 71 1982 187 195
56. C. Wardrip-Fruin The effect of signal degradation on the status of cues to voicing in utterance-final stop consonants J. Acoust. Soc. Amer. 77 5 1985 1907 1912
57. Watson, J.; 1997. Sibilant-vowel coarticulation in the perception of speech by children with phonological disorder. Ph.D. Dissertation, Queen Margaret College, Edinburgh.
58. C. Wightman, S. Shattuck-Huffnagel, M. Ostendorf, and P. Price Segmental durations in the vicinity of prosodic phrase boundaries J. Acoust. Soc. Amer. 91 1992 1707 1717
59. Wouters, J.; Macon, M.W.; 1998. A perceptual evaluation of distance measures for concatenative speech synthesis. In: Proc. ICSLP'98, 5th Internat. Conf. on Spoken Language Processing, Sydney, Australia, pp. 2747-2750.
60. H. Zen, K. Tokuda, and T. Kitamura Reformulating the HMM as a trajectory model by imposing explicit relationships between static and dynamic feature vector sequences Comput. Speech Lang. 21 1 2007 153 173