Speech emotion recognition using Fourier parameters

IEEE Transactions on Affective Computing

Volumn 6, Issue 1, 2015, Pages 69-75

  Wang, Kunxia ^a,b   An, Ning ^a   Li, Bing Nan ^a   Zhang, Yanyong ^c   Li, Lian ^a  

^a HEFEI UNIVERSITY OF TECHNOLOGY   (China)

^b ANHUI JIANZHU UNIVERSITY   (China)

^c Piscataway   (United States)

Author keywords

affective computing; Fourier parameter model; speaker independent; speech emotion recognition

Indexed keywords

DATABASE SYSTEMS; FOURIER TRANSFORMS; SPEECH;

AFFECTIVE COMPUTING; CHINESE LANGUAGE; EMOTIONAL STATE; MEL-FREQUENCY CEPSTRAL COEFFICIENTS; PARAMETER MODEL; SPEAKER INDEPENDENTS; SPEECH EMOTION RECOGNITION; SPEECH SIGNALS;

SPEECH RECOGNITION;

EID: 84924081025     PISSN: 19493045     EISSN: None     Source Type: Journal    
DOI: 10.1109/TAFFC.2015.2392101     Document Type: Article

References (58)

1. M. El Ayadi, M. S. Kamel, and F. Karray, "Survey on speech emotion recognition: Features, classification schemes, and databases," Pattern Recog., vol. 44, no. 3, pp. 572-587, 2011.
2. W. Minker, J. Pittermann, A. Pittermann, P. Strauss, and D. Bühler, "Challenges in speech-based human-computer interfaces," Int. J. Speech Technol., vol. 10, no. 2-3, pp. 109-119, 2007.
3. S. Ntalampiras, I. Potamitis, and N. Fakotakis, "An adaptive framework for acoustic monitoring of potential hazards," EURASIP J. Audio, Speech, Music Process., vol. 2009, no. 13, pp. 1-15, 2009.
4. M. Kotti and F. Paternò, "Speaker-independent emotion recognition exploiting a psychologically-inspired binary cascade classification schema," Int. J. Speech Technol., vol. 15, pp. 131-150, 2012.
5. N. Mavridis, M. S. Katsaiti, S. Naef, A. Falasi, A. Nuaimi, H. Araifi, and A. Kitbi, "Opinions and attitudes toward humanoid robots in the middle east," AI Soc., vol. 27, no. 4, pp. 517-534, 2012.
6. R. A. Calvo and S. D'Mello, "Affect detection: An interdisciplinary review of models, methods, and their applications," IEEE Trans. Affective Comput., vol. 1, no. 1, pp. 18-37, Jan.-Jun. 2010.
7. C. Busso, S. Lee, and S. Narayanan, "Analysis of emotionally salient aspects of fundamental frequency for emotion detection," IEEE Trans. Audio, Speech, Language Process., vol. 17, no. 4, pp. 582-596, May 2009.
8. Y. J. Yuan, P. H. Zhao, and Q. Zhou, "Research of speaker recognition based on combination of LPCC and MFCC," in Proc. IEEE Int. Conf. Intell. Comput. Intell. Syst., 2010, vol. 3, pp. 765-767.
9. T. Kinnunen and H. Z. Li, "An overview of text independent speaker recognition: From features to supervectors," Speech Commun., vol. 52, pp. 12-40, 2010.
10. M. Sheikhan, D. Gharavian, and F. Ashoftedl, "Using DTW neural-based MFCC warping to improve emotional speech recognition," Neural Comput. Appl., vol. 21, pp.1765-1773, 2011.
11. R. Cowie, D. Cowie, E. Tsapatsoulis, N. Votsis, G. Kollias, S. W. Fellenz, and J. G. Taylor, "Emotion recognition in human-computer interaction,"IEEE Signal Process. Mag., vol. 18, no. 1, pp. 32-80, Jan. 2001.
12. C. Lee and S. Narayanan, "Toward detecting emotions in spoken dialogs,"IEEE Trans. Speech Audio Process., vol. 13, no. 2, pp. 293-303, Mar. 2005.
13. E. Messina, G. Arosio, and F. Archetti, "Audio-based emotion recognition in judicial domain: A multilayer support vector machines approach,"Mach. Learn. Data Mining Pattern Recog., vol. 5632, pp. 594-602, 2009.
14. C. Gobl and A. Ni Chasaide, "The role of voice quality in communicating emotion, mood and attitude," Speech Commun., vol. 40, pp.189-212, 2003.
15. B. Yang and M. Lugger, "Emotion recognition from speech signals using new harmony features," Signal Process., vol. 90, pp. 1415-1423, 2010.
16. P. Ruvolo, I. Fasel, and J. R. Movellan, "A learning approach to hierarchical feature selection and aggregation for audio classification," Pattern Recog. Lett., vol. 31, pp.1535-1542, 2010.
17. R. J. McAulay and T. F. Quatieri, "Speech analysis/synthesis based on a sinusoidal representation," IEEE Trans. Acoust., Speech Signal Process.,vol. 34, no. 4, pp. 744-754, Aug. 1986.
18. F. Burkhardt, A. Paeschke, M. Rolfes, W. Sendlmeier, and B. Weiss, "A database of german emotional speech," in Proc. INTERSPEECH, 2005, pp. 1517-1520.
19. S. Ramamohan and S. Dandapat, "Sinusoidal model-based analysis and classification of stressed speech," IEEE Trans. Audio, Speech, Language Process., vol. 14, no. 3, pp.737-746, May 2006.
20. B. A. Hanson and T. H. Applebaum, "Robust speaker-independent word recognition using static, dynamic and acceleration features: Experiments with Lombard and noisy speech," in Proc. Int. Conf. Acoust., Speech, Signal Process., 1990, pp. 857-860.
21. M. Y. You, C. Chen, J. J. Bu, J. Liu, and J. H. Tao, "Emotion recognition from noisy speech," in Proc. IEEE Int. Conf. Multimedia Expo, Jul. 2006, pp. 1653-1656.
22. P. H. David, V. Bogdan, B. Ronald, and W. Andreas, "The performance of the speaking rate parameter in emotion recognition from speech," in Proc. IEEE Int. Conf. Multimedia Expo Workshops, 2012, pp. 296-301.
23. nd Int. Conf. Affective Comput. Intell. Interaction, 2007, vol. 4738, pp. 114-125.
24. V. N. Vapnik, Statistical Learning Theory. New York, NY, USA: Wiley, 1998.
25. N. Kamaruddina, A. Wahabb, and C. Quek, "Cultural dependency analysis for understanding speech emotion," Expert Syst. Appl., vol. 39, pp. 5115-5133, 2012.
26. C. J. C. Burges, "A tutorial on support vector machines for pattern recognition,"Knowl. Discovery Data Mining, vol. 2, pp. 121-167, 1998.
27. M. Hayat and M. Bennamoun, "An automatic framework for textured 3D video-based facial expression recognition," IEEE Trans. Affective Comput., vol. 5, no. 3, pp. 301-313, Jul.-Sep. 2014.
28. S. Chandrakala and C. C. Sekhar, "Combination of generative models and SVM based classifier for speech emotion recognition," in Proc. IEEE Int. Joint Conf. Neural Netw., 2009, pp. 1374-1379.
29. B. Schuller, G. Rigoll, and M. Lang, "Speech emotion recognition combining acoustic features and linguistic information in a hybrid support vector machine-belief network architecture," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., 2004, vol. 1, pp. 577-580.
30. O. Küstner, R. Tato, T. Kemp, and B. Meffert, "Towards real life applications in emotion recognition," in Proc. Conf. Affective Dialogue Syst., May 2004, pp. 25-35.
31. E. Vayrynen, J. Kortelainen, and T. Seppanen, "Classifier-based learning of nonlinear feature manifold for visualization of emotional speech prosody,"IEEE Trans. Affective Comput., vol. 4, no. 1, pp. 47-56, Jan.-Mar. 2013
32. st ed. Prentice Hall, Upper Saddle River, New Jersey 07458, USA, 1978.
33. B. S. Atal, "Effectiveness of linear prediction characteristics of the speech wave for automatic speaker identification and verification," J. Acoust. Soc. Am., vol. 55, no. 6, pp.1304-1312, 1974.
34. S. E. Bou-Ghazale and J. Hansen, "A comparative study of traditional and newly proposed features for recognition of speech under stress," IEEE Trans. Speech Audio Process., vol. 8, no. 4, pp. 429-442, Jul. 2000.
35. H. Teager, "Some observations on oral air flow during phonation," IEEE Trans. Acoust. Speech Signal Process., vol. 28, no. 5, pp. 599-601, Oct. 1990.
36. L. Kaiser, "Communication of affects by single vowels," Synthese, vol. 14, no. 4, pp. 300-319, 1962.
37. D. Caims and J. Hansen, "Nonlinear analysis and detection of speech under stressed conditions," J. Acoust. Soc. Am., vol. 96, pp. 3392-3400, 1994.
38. G. Zhou, J. Hansen, and J. Kaiser, "Nonlinear feature based classification of speech under stress," IEEE Trans. Speech Audio Process., vol. 9, no. 3, pp. 201-216, Mar. 2001.
39. X. Li, J. Tao, M. T. Johnson, J. Soltis, A. Savage, K. M. Leong, and J. D. Newman, "Stress and emotion classification using jitter and shimmer features,"in Proc. IEEE Int. Conf. Acoust., Speech Signal Process., 2007, vol. 4, pp. IV- 1081-IV-1084.
40. th Eur. Signal Process. Conf., 2009, pp. 1225-1229.
41. R. Sun, E. Moore, and J. F. Torres, "Investigating glottal parameters for differentiating emotional categories with similar prosodics," in Proc. IEEE Int. Conf. Acoust., Speech Signal Process., 2009, pp. 4509-4512.
42. M. Lugger and B. Yang, "Psychological motivated multi-stage emotion classification exploiting voice quality features," in Speech Recognition, F. Mihelic and J. Zibert Ed. In-Tech, Vienna, Austria, 2008.
43. J. S. Walker, "Fourier series," in Encyclopedia of Physical Science and Technology. New York, NY, USA: Academic, 2001.
44. S. Davis and P. Mermelstein, "Comparison of parametric representations for monosyllabic word recognition in continuously spoken sentences,"IEEE Trans. Acoust., Speech Signal Process., vol. 28, no. 4, pp. 357-366, Aug. 1980.
45. J. H. Tao, F. Z. Liu, M. Zhang, and H. B. Jia, "Design of speech corpus for mandarin text to speech," in Proc. Blizzard Challenge Workshop, 2008, p. 1.
46. M. Grimm, K. Kroschel, E. Mower, and S. Narayanan, "Primitives based evaluation and estimation of emotions in speech," Speech Commun., vol. 49, pp. 787-800, 2007.
47. C. Clavel, I. Vasilescu, L. Devillers, G. Richard, and T. Ehrette, "Feartype emotion recognition for future audio-based surveillance systems," Speech Commun., vol. 50, pp. 487-503, 2008.
48. D. Bitouk, R. Verma, and A. Nenkova, "Class-level spectral features for emotion recognition," Speech Commun., vol. 52, no. 7-8, pp. 613-625, 2010.
49. nd ed. New York, NY, USA: Dover, 1877.
50. H. Boukricha, I. Wachsmuth, M. N. Carminati, and P. Knoeferle, "Stress detection from audio on multiple window analysis size in a public speaking task," in Proc. Humaine Assoc. Conf. Affective Comput. Intell. Interaction, 2013, pp. 529-533.
51. C. Busso, S. Marioor-yad, S. Narayanan and A. Metallinou, "Iterative feature normalization scheme for automatic emotion detection from speech,"IEEE Trans. Affective Comput., vol. 4, no. 4, pp. 386-397, Oct.-Dec. 2013
52. C. W. Hsu and C. J. Lin, "A comparison of methods for multiclass support vector machines," IEEE Trans. Neural Netw., vol. 13, no. 2, pp. 415-425, Mar. 2002.
53. M. Lugger, B. Yang, and W. Wokurek, "Robust estimation of voice quality parameters under realworld disturbances," in Proc. IEEE Int. Conf. Acoust., Speech Signal Process., May 2006, vol. 1, pp. 14-19.
54. K. X. Wang, Q. L. Zhang, and S. Y. Liao, "A database of elderly emotional speech," in Proc. Int. Symp. Signal Process. Biomed. Eng Informat., 2014, pp. 549-553.
55. I. S. Engberg and A. V. Hansen, "Documentation of the Danish Emotional Speech Database (DES)," Dept. Commun. Technol., Inst. Electron. Syst., Aalborg University, Denmark, 1996.
56. K. X. Wang, N. An, and L. Li, "Emotional speech recognition using a novel feature set," J. Comput. Inf. Syst., vol. 9, pp. 1-8, 2013.
57. P. Pudil, F. Ferri, J. Novovicova, and J. Kittler, "Floating search method for feature selection with nonmonotonic criterion functions," Pattern Recog., vol. 2, pp. 279-283, 1994.
58. C. C. Chang and C. J. Lin, "LIBSVM: A library for support vector machines," ACM Trans. Intel. Syst. Technol. (TIST), vol. 2, no. 3, p. 27, 2011.