The feature extraction based on texture image information for emotion sensing in speech

Sensors (Switzerland)

Volumn 14, Issue 9, 2014, Pages 16692-16714

  Wang, Kun Ching ^a  

^a SHIH CHIEN UNIVERSITY   (Taiwan)

Author keywords

Emotion sensing; Emotional feature extraction; Spectrogram; Texture image information

Indexed keywords

DATABASE SYSTEMS; EXTRACTION; FEATURE EXTRACTION; SPECTROGRAPHS; SPEECH RECOGNITION; SUPPORT VECTOR MACHINES; TEXTURES;

EMOTION RECOGNITION; EMOTION SENSING; EMOTIONAL DATABASE; SPECTROGRAMS; TEXTURE IMAGE; TIME-FREQUENCY REPRESENTATIONS; TWO DIMENSIONAL (2 D); VISUAL PERCEPTION;

IMAGE TEXTURE;

EID: 84907221100     PISSN: 14248220     EISSN: None     Source Type: Journal    
DOI: 10.3390/s140916692     Document Type: Article

References (37)

1. Lu, J.; Zhou, X.; Tan, Y. P.; Shang, Y.; Zhou, J. Neighborhood Repulsed Metric Learning for Kinship Verification. IEEE Trans. Pattern Anal. Mach. Intell. 2014, 36, 331-345.
2. Xu, C.; Tao, D.; Xu, C. Large-Margin Multi-View Information Bottleneck. IEEE Trans. Pattern Anal. Mach. Intell. 2014, 36, 1559-1572.
3. Lu, J.; Tan, Y. P.; Wang, G. Discriminative Multimanifold Analysis for Face Recognition from a Single Training Sample per Person. IEEE Trans. Pattern Anal. Mach. Intell. 2013, 35, 39-51.
4. Adams, B.; Breazeal, C.; Brooks, R.; Scassellati, B. Humanoid robots: A new kind of tool. IEEE Intell. Syst. Their Appl. 2000, 15, 25-31.
5. Kim, E.; Hyun, K.; Kim, S.; Kwak, Y. Emotion interactive robot focus on speaker independently emotion recognition. In Proceedings of the 2007 IEEE/ASME International Conference on Advanced Intelligent Mechatronics, Zurich, Switzerland, 4-7 September 2007; pp. 1-6.
6. Cowie, R.; Douglas-Cowie, E.; Tsapatsoulis, N.; Votsis, G.; Kollias, S.; Fellenz, W.; Taylor, J. G. Emotion Recognition in Human-Computer Interaction. IEEE Signal Process. Mag. 2001, 18, 32-80.
7. Petrushin, V. A. Emotion recognition in speech signal: Experimental study, development, and application. In Proceedings of International Conference of Spoken Language Processing 2000, Beijing, China, 16-20 October 2000; pp. 222-225.
8. Xiao, X.; Nickel, R. M. Speech Enhancement with Inventory Style Speech Resynthesis. IEEE Trans. Audio Speech Lang. Process. 2010, 18, 1243-1257.
9. Schuller, B.; Rigoll, G.; Lang, M. Hidden Markov Model-based Speech Emotion Recognition. In Proceedings of International Conference on Acoustics, Speech, and Signal Processing, Hong Kong, China, 6-10 April 2003; pp. 401-405.
10. Park, C. H.; Heo, K. S.; Lee, D. W.; Joo, Y. H.; Sim, K. B. Emotion Recognition based on Frequency Analysis of Speech Signal. Int. J. Fuzzy Log. Intell. Syst. 2002, 2, 122-126.
11. Yacoub, S.; Simske, S.; Lin, X.; Burns, J. Recognition of Emotions in Interactive Voice Response Systems. In Proceedings of Eurospeech, Geneva, Switzerland, 1-4 September 2003; pp. 729-732.
12. Tato, R. S.; Kompe, R.; Pardo, J. M. Emotional Space Improves Emotion Recognition. In Proceedings of International Conference on Spoken Language Processing, Denver, CO, USA, 16-20 September 2002; pp. 2029-2032.
13. Kwon, O. W.; Chan, K.; Hao, J.; Lee, T. W. Emotion Recognition by Speech Signals. In Proceedings of the Eurospeech, Geneva, Switzerland, 1-4 September 2003; pp. 125-128.
14. Le, X. H.; Quenot, G.; Castelli, E. Recognizing Emotions for the Audio-Visual Document Indexing. In Proceedings of the Ninth IEEE International Symposium on Computers and Communications, Alexandria, Egypt, 28 June-1 July 2004; pp. 580-584.
15. New, T. L.; Wei, F. S.; De Silva, L. C. Speech based emotion classification. In Proceedings of IEEE Region 10 International Conference on Electrical and Electronic Technology, Hong Kong, China, 19-22 August 2001; pp. 297-301.
16. Kleinschmidt, M. Methods for capturing spectrotemporal modulations in automatic speech recognition. Acta Acust. 2001, 8, 416-422.
17. Kleinschmidt, M.; Hohmann, V. Sub-band SNR estimation using auditory feature processing. Speech Commun. 2003, 39, 47-63.
18. Chih, T.; Ru, P.; Shamma, S. Multiresolution spectrotemporal analysis of complex sounds. J. Acoust. Soc. Am. 2005, 118, 887-906.
19. Ezzat, T.; Poggio, T. Discriminative Word-Spotting Using Ordered Spectro-Temporal Patch Features. In Proceedings of the Workshop on Statistical and Perceptual Audition, Brisbane, Australia, 21 September 2008; pp. 35-40.
20. Bouvrie, J.; Ezzat, T.; Poggio, T. Localized Spectro-Temporal Cepstral Analysis of Speech. In Proceedings of International Conference on Acoustics, Speech, and Signal Processing, LasVegas, NV, USA, 30 March-4 April 2008; pp. 4733-4736.
21. Ezzat, T.; Bouvrie, J.; Poggio, T. Spectro-Temporal Analysis of Speech Using 2-D Gabor Filters. In Proceedings of Interspeech, Antwerp, Belgium, 27-31 August 2007.
22. Vogt, T.; Andre, E. Comparing feature sets for acted and spontaneous speech in view of automatic emotion recognition. In Proceedings of Multimedia and Expo, Amsterdam, The Netherlands, 6 July 2005; pp. 474-477.
23. Schuller, B.; Wimmer, M.; Mosenlechner, L.; Kern, C.; Arsic, D.; Rigoll, G. Brute-forcing hierarchical functionals for paralinguistics: A waste of feature space. In Proceedings of International Conference on Acoustics, Speech, and Signal Processing, Las Vegas, NV, USA, 30 March-4 April 2008; pp. 4501-4504.
24. Pachet, F.; Roy, P. Analytical features: A knowledge-based approach to audio feature generation. EURASIP J. Audio Speech Music Process. 2009, doi: 10. 1155/2009/153017.
25. Schuller, B.; Reiter, S.; Rigoll, G. Evolutionary feature generation in speech emotion recognition. In Proceedings of International Conference on Multimedia and Expo, Toronto, Canada, 9-12 July 2006.
26. Marc, E. M. Emotion Recognition from Speech Signals: Erasmus Exchange Project Work. Ph. D. Thesis, University of Ljubljana, Ljubljana, Slovenia, 2012.
27. Berlin Database of Emotional Speech. Available online: http://pascal. kgw. tu-berlin. de/emodb/(accessed on 22 June 2009).
28. Martin, O.; Kotsia, I.; Macq, B. The eNTERFACE'05 Audio-visual Emotion Database. In Proceedings of the 22nd International Conference on Data Engineering Workshops, Atlanta, GA, USA, 3-7 April 2006.
29. Quatieri, T. F. Discrete-Time Speech Signal Processing: Principles and Practice; Pearson Prentice Hall: Englewood Cliff, NJ, USA, 2002.
30. He, L.; Lech, M.; Maddage, N.; Allen, N. Emotion Recognition in Speech of Parents of Depressed Adolescents. In Proceedings of 3rd International Conference on Bioinformatics and Biomedical Engineering, Beijing, China, 11-13 June 2009.
31. He, L.; Lech M.; Maddage N.; Memon S.; Allen N. Emotion Recognition in Spontaneous Speech within Work and Family Environments. In Proceedings of 3rd International Conference on Bioinformatics and Biomedical Engineering, Beijing, China, 11-13 June 2009; pp. 1-4.
32. He, L.; Lech, M.; Memon, S.; Allen, N. Recognition of Stress in Speech Using Wavelet Analysis and Teager Energy Operator. In Proceedings of 9th Annual Conference of the International Speech Communication Association, Brisbane, Australia, 22-26 September 2008.
33. Dennis, J.; Tran, H.; Li, H. Spectrogram image feature for sound event classification in mismatched conditions. IEEE Signal Process. Lett. 2011, 18, 130-133.
34. Lin, C. T.; Chin, C. L. Using Fuzzy Inference and Cubic Curve to Detect and Compensate Backlight Image. Int. J. Fuzzy Syst. 2006, 8, 2-13.
35. Laws, K. I. Textured image segmentation. Ph. D. Dissertation, University of Southern California, Los Angles, CA, USA, 1980.
36. Ganapathiraju, A. R.; Hamaker, J. E.; Picone, J. Application of Support Vector Machines to Speech Recognition. IEEE Trans. Signal Process. 2004, 52, 2348-2355.
37. Ingale Ashish, B.; Dr, D.; Chaudhari, S. Speech Emotion Recognition using Hidden Markov Model and Support Vector Machine. Int. J. Adv. Eng. Res. Stud. 2012, 1, 316-318.