On the development of an automatic voice pleasantness classification and intensity estimation system

Computer Speech and Language

Volumn 27, Issue 1, 2013, Pages 75-88

  Pinto Coelho, Luis ^a,b   Braga, Daniela ^b   Sales Dias, Miguel ^b,c   Garcia Mateo, Carmen ^d  

^a POLYTECHNIC INSTITUTE OF PORTO   (Portugal)

^b MICROSOFT   (United States)

^c INSTITUTO UNIVERSITÁRIO DE LISBOA ISCTE IUL   (Portugal)

^d UNIVERSITY OF VIGO   (Spain)

Author keywords

Perceptual speech analysis; Subtle emotions; Text to Speech synthesis; Voice pleasantness

Indexed keywords

CONTINUED USE; ERROR RATE; FEATURE SUBSET; INTENSITY ESTIMATION; OBJECTIVE DEFINITION; PERFORMANCE EVALUATION; SPEECH-BASED INTERFACES; SUBTLE EMOTIONS; USER EXPERIENCE;

SPEECH SYNTHESIS;

ESTIMATION;

EID: 84867329307     PISSN: 08852308     EISSN: 10958363     Source Type: Journal    
DOI: 10.1016/j.csl.2012.01.006     Document Type: Article

References (67)

1. Alku P.; Backstrom T.; and Vikman E. Normalized amplitude quotient for parametrization of the glottal flow Acoustical Society of America 2 2002 701 710
2. Amano-Kusumoto A.; and Hosom J.-P. The effect of formant trajectories and phoneme durations on vowel intelligibility Proc. IEEE Conf. on Acoustics, Speech, and Signal Processing 2009 4677 4680
3. Audibert N.; Vincent D.; Aubergé V.; and Rosec O. Expressive speech synthesis: evaluation of a voice quality centered coder on the different acoustic dimensions Proc. of 3rd International Conference on Speech Prosody Dresden, Germany 2006
4. Barsky B.A. End conditions and boundary conditions for uniform b-spline curve and surface representations Computers in Industry 3 1982 17 29
5. Beigi H. Fundamentals of Speaker Recognition 2011 Springer
6. Biadsy F.; Rosenberg A.; Carlson R.; Hirschberg J.; and Strangert E. A cross-cultural comparison of American, Palestinian, and Swedish perception of charismatic speech Proc. Speech Prosody Campinas, Brazil 2008
7. Boersma P. Praat: doing phonetics by computer Glot International 9/10 5 2001 341 345 URL http://www.fon.hum.uva.nl/praat/
8. Borg I.; and Groenen P. Modern Multidimensional Scaling: Theory and Applications 2005 Springer-Verlag
9. Braga D.; Coelho L.; Junior F.G.R.; and Dias M.S. Subjective and objective evaluation of Brazilian Portuguese TTS voice font quality Int. Workshop on Advances in Speech Technology Maribor, Slovenia 2007, July 306 311
10. Braga D.; Coelho L.; Junior F.G.V.R.; and Dias M.S. Subjective and objective assessment of TTS voice font quality Proc. of International Conference on Speech and Computers (SPECOM 2007) Moscow 2007, October 306 311
11. Burkhardt F.; Eckert M.; Johannsen W.; and Stegmann J. A database of age and gender annotated telephone speech Proc. Languages Resources Evaluation Conference 2010
12. Burkhardt F.; and Paeschke A. A database of German emotional speech Proc. Interspeech 2005
13. Burkhardt F.; Schuller B.; Weiss B.; and Weninger F. "Would you buy a car from me?" - on the likability of telephone voices Proc. Interspeech Florence 2011, August
14. Campbell J.P. Speaker recognition: a tutorial Proceedings of the IEEE 85 9 1997 1437 1462
15. Campbell N. Expressive/affective speech synthesis Springer Handbook on Speech Processing 2008 Springer http://www.speech-data.jp/fastnet/ApplicantCV- Campbell.pdf, pp. 505-517
16. Casale S.; Russo A.; Scebba G.; and Serrano S. Speech emotion classification using machine learning algorithms Proceedings of the 2008 IEEE International Conference on Semantic Computing 2008 IEEE Computer Society Washington, DC, USA 158 165
17. Chang C.-C.; and Lin C.-J. LIBSVM: a library for support vector machines ACM Transactions on Intelligent Systems and Technology 2 2011 27:1 27:27
18. Chattopadhyay A.; Dahl D.W.; Ritchie R.J.; and Shahin K.N. Hearing voices: the impact of announcer speech characteristics on consumer response to broadcast advertising Journal of Consumer Psychology 13 3 2003 198 204
19. Coelho L.; Braga D.; Dias M.; and Mateo C. An automatic voice pleasantness classification system based on prosodic and acoustic patterns of voice preference Proc. of Interspeech 2011
20. Coelho L.; Braga D.; and Garcia-Mateo C. Kalman tracking linear predictor for vowel intelligibility enhancement on European Portuguese HMM based speech synthesis Proc of ICASSP. No. 1 2010 4734 4737
21. Cover T.; and Thomas J. Elements of Information Theory 1991 John Wiley & Sons New York
22. Dempster A.P.; Laird N.M.; and Rubin D.B. Maximum-likelihood from incomplete data via the EM algorithm Journal of the Royal Statistical Society: Series B 39 1977
23. Eklund R.; and Lindström A. Xenophones: an investigation of phone set expansion in Swedish and implications for speech recognition and speech synthesis Speech Communication 35 2 2001 81 102
24. Ekman P.; Sorenson E.; and Friesen W.V. Pan-cultural elements in facial displays of emotions Science 164 1969 86 88
25. Eyben F.; Wöllmer M.; and Schuller B. OpenEAR - introducing the Munich open-source emotion and affect recognition toolkit Proc. 4th Int. HUMAINE Association Conf. on Affective Computing and Intelligent Interaction 2009
26. Fellbaum C. WordNet: An Electronical Lexical Database 1998 The MIT Press Cambridge, MA
27. Fukunaga K. Introduction to Statistical Pattern Recognition 1990 Academic Press
28. Gobl C.; and Chasasaide A.N. The role of voice quality in communicating emotion, mood and attitude Speech Communication 40 2003 189 212
29. Hassan A.; and Damper R.I. Emotion recognition from speech using extended feature selection and a simple classifier Proc. Interspeech Brighton 2009
30. Kendall M.G.; and Smith B. The problem of m rankings The Annals of Mathematical Statistics 10 3 1939 275 287
31. Kinnunen T.; and Li H. An overview of text-independent speaker recognition: from features to supervectors Speech Communication 52 January 2010 12 40
32. Kohonen T. Self Organizing Maps 2000 Springer
33. Kreiman J.; Gerratt B.; and Precoda K. Listener experience and perception of voice quality Journal of Speech and Hearing Research 33 1990 103 115
34. Lilliefors H.W. On the Kolmogorov-Smirnov test for normality with mean and variance unknown Journal of the American Statistical Association 62 1967 399 402
35. Lopes J.; Freitas S.; Sousa R.; Matos J.; Abreu F.; and Ferreira A. A medida HNR: Sua relevância na análise acústica da voz e sua estimação precisa Proceedings of "I Jornadas sobre Tecnologia e Saúde" Guarda, Portugal 2008
36. Luengo, I.; 2010. Análisis y evaluación de parámetros para identificación automática de emociones en el habla. Ph.D. Thesis, Universidad del País Vasco.
37. Lugger M.; and Yang B. cal motivated multi-stage emotion classification exploiting voice quality features Speech Recognition, Technologies and Applications 2008 pp. 395-410.
38. Mayo C.; Clark R.A.J.; and King S. Listeners' weighting of acoustic cues to synthetic speech naturalness: a multidimensional scaling analysis Speech Communication 53 March 2011 311 326
39. Montero J.M.; Gutiérrez-Arriola J.; Colas J.; Enriquez E.; and Pardo J.M. Analysis and modelling of emotional speech in Spanish ICPhS99 2 1999 957 960
40. Oxford Dictionary, 2009 [Online; accessed 13.03.2011]. URL http://oxforddictionaries.com/.
41. Peng H.; Long F.; and Ding C. Feature selection based on mutual information: criteria of max-dependency, max-relevance and min-redundancy IEEE Transactions on Pattern Analysis and Machine Intelligence 27 2005 1226 1238
42. Pinho S.; and Pontes P. Escala de avaliação perceptiva da fonte glótica: Rasat Vox Brasilis 8 3 2002 8 13
43. Pudil P.; Ferri F.; Novovicova J.; and Kittler J. Floating search method for feature selection with nonmonotonic criterion functions Pattern Recognition 2 1994 279 283
44. Reynolds D.A.; Quatieri T.F.; and Dunn R.B. Speaker verification using adapted Gaussian mixture models Digital Signal Processing 10 2000 19 41
45. Schuller B. On the acoustics of emotion in speech: desperately seeking a standard Journal of the Acoustical Society of America 127 3 2010 1995
46. Schuller B.; Arsic D.; Wallhoff F.; and Rigoll G. Emotion recognition in the noise applying large acoustic feature sets Proc. Speech Prosody Dresden 2006
47. Schuller B.; Batliner A.; Seppi D.; Steidl S.; Vogt T.; Wagner J.; Devillers L.; Vidrascu L.; Amir N.; Kossous L.; and Aharonson V. The relevance of feature type for the automatic classification of emotional user states: low level descriptors and functionals Proceedings of Interspeech Antwerp, Belgium 2007, August
48. Schuller B.; Vlasenko B.; Eyben F.; Wollmer M.; Stuhlsatz A.; Wendemuth A.; and Rigoll G. Cross-corpus acoustic emotion recognition: variances and strategies IEEE Transactions on Affective Computing 1 July 2010 119 131
49. Schröder M. Expressive speech synthesis: past, present, and possible futures Affective Information Processing 2009 Springer London pp. 111-126
50. Shami M.; and Verhelst W. An evaluation of the robustness of existing supervised machine learning approaches to the classification of emotions in speech Speech Communication 49 March 2007 201 212
51. Shaukat A.; and Chen K. Towards automatic emotional state categorization from speech signals INTERSPEECH'08 2008 2771 2774
52. Stuhlsatz A.; Meyer C.; Eyben F.; Zielke T.; Meier H.-G.; and Schuller B. Deep neural networks for acoustic emotion recognition: raising the benchmarks Proc of ICASSP 2011 IEEE 5688 5691
53. Syrdal A.; Conkie A.; and Stylianou Y. Exploration of acoustic correlates in speaker selection for concatenative synthesis Proc. of Int. Conf. Speech and Lang. Processing 98 Lisbon, Portugal 1998
54. Teixeira J.P.; Freitas D.; Braga D.; Barros M.J.; and Latsch V. Phonetic events from the labelling the European Portuguese database for speech synthesis, FEUP/IPB-DB Proc. of Eurospeech 2001
55. Tenenbaum J.B.; de Silva V.; and Langford J.C. A global geometric framework for nonlinear dimensionality reduction Science 290 2000 2319 2323
56. Theodoridis S.; and Koutroumbas K. Pattern Recognition 3rd ed. 2006, February Academic Press
57. Unluturk M.S.; Oguz K.; and Atay C. Emotion recognition using neural networks Proceedings of the 10th WSEAS International Conference on Neural Networks 2009 WSEAS Stevens Point, WI, USA 82 85
58. van Bezooijen R. Approximant /r/ in Dutch: routes and feelings Speech Communication 47 1 2005 15 31
59. L.J.P. van der Maaten, E. P.; van den Herik, H.; 2009. Dimensionality reduction: a comparative review. Tech. rep.; Tilburg University Technical Report.
60. van der Maaten L.; and Hinton G. Visualizing high-dimensional data using t-sne Journal of Machine Learning Research 9 2008 2579 2605
61. Ververidis D.; Kotropoulos C.; and Pitas I. Automatic emotional speech classification Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP'04), vol. 1 2004 593 596
62. Weiss B.; and Burkhardt F. Voice attributes affecting likability perception Proc. of Interspeech Makuhari, Japan 2010, September
63. Witten I.H.; and Frank E. Data Mining: Practical Machine Learning Tools and Techniques 2005 Morgan Kaufmann
64. Wolf J.J. Efficient acoustic parameters for speaker recognition Journal of the American Statistical Association 51 1972 2044 2056
65. Yabuoka H.; Nakayama T.; Kitabayashi Y.; and Asakawa Y. Investigations of independence of distortion scales in objective evaluation of synthesized speech quality Electronics and Communications in Japan (Part III: Fundamental Electronic Science) 83 5 2000 14 22
66. Yanushevskaya I.; Gobl C.; and Chasaide A.N. Voice quality and loudness in affect perception Proc. of Speech Prosody 2008
67. Zhao, Z.; Morstatter, F.; Sharma, S.; Alelyani, S.; Anand, A.; Liu, H.; 2009. Advancing feature selection research - ASU feature selection repository. Tech. rep.