Improved emotion recognition with a novel speaker-independent feature

IEEE/ASME Transactions on Mechatronics

Volumn 14, Issue 3, 2009, Pages 317-325

  Kim, Eun Ho ^a   Hyun, Kyung Hyun ^a   Kim, Soo Hyun ^a   Kwak, Yoon Keun ^a  

^a Korea Advanced Institute of Science and Technology (KAIST)   (South Korea)

Author keywords

Emotional interaction; Intelligent robots; Speakerindependent system; Speech emotion recognition

Indexed keywords

ACCURACY RATE; COMMERCIAL APPLICATIONS; CONFIDENCE INTERVAL; EMOTION RECOGNITION; EMOTIONAL INTERACTION; HUMAN ROBOT INTERACTIONS; INDEPENDENT MODE; INDEPENDENT SYSTEMS; MEL-FREQUENCY CEPSTRAL COEFFICIENTS; RECOGNITION RATES; SMALL VARIATIONS; SPEAKERINDEPENDENT SYSTEM; SPECTRAL CENTER; SPECTRAL FLATNESS; SPEECH EMOTION RECOGNITION;

FACE RECOGNITION; INTELLIGENT ROBOTS;

SPEECH RECOGNITION;

EID: 67650159383     PISSN: 10834435     EISSN: None     Source Type: Journal    
DOI: 10.1109/TMECH.2008.2008644     Document Type: Article

References (41)

1. S. Chiaverini, B. Siciliano, and L. Villani, "A survey of robot interaction control schemes with experimental comparison," IEEE/ASME Trans. Mechatronics, vol. 4, no. 3, pp. 273-285, Sep. 1999.
2. R. Gassert, R. Moser, E. Burdet, and H. Bleuler, "MRI/fMRI-compatible robotic system with force feedback for interaction with human motion," EEE/ASME Trans. Mechatronics, vol. 11, no. 2, pp. 216-224, Apr. 2006.
3. M. Pantic and L. Rothkrantz, "Toward an affect-sensitive multimodal human-computer interaction," Proc. IEEE, vol. 91, no. 9, pp. 1370-1390, Sep. 2003.
4. U. Williams and K. N. Stevens, "Emotions and speech: Some acoustical correlates," JASA, vol. 52, no. 4, pp. 1238-1250, 1972.
5. R. Van Bezooijen, The Characteristics and Reconcilability of Vocal Expression of Emotions. Dordrecht, The Netherlands: Foris, 1984.
6. F. J. Tolkmitt and K. R. Scherer, "Effect of experimentally induced stress on vocal parameter," J. Exp. Psychol.: Hum. Percept. Perform. vol. 12, no. 3, pp. 302-313, Aug. 1986.
7. P. Y. Oudeyer, "The production and recognition of emotions in speech: Feature and algorithms," Int.J. Hum.-Comput. Stud. 59, vol. 59, no. 1, pp. 157-183, Jul. 2003.
8. N. Sebe, I. Cohen, and T. S. Huang, "Multimodal emotion recognition," in Handbook of Pattern Recognition and Computer Vision. Singapore: World Scientific, Jan. 2005.
9. B. Schuller, R. J. Villar, G. Riqoll, and M. Lang, "Meta-classification in acoustic and linguistic feature fusion-based affect recognition," in Proc. ICASSP, Mar. 2005, vol. 1, pp. 325-328.
10. S. McGilloway, R. Cowie, E. Douglas-Cowie, S. Gielen, M. Westerdijk, and S. Stroeve, "Approaching automatic recognition of emotion from voice: A rough benchmark," in Proc. ISCA Workshop Speech Emotion, Belfast, U.K., 2000, pp. 207-212.
11. D. Ververidis and C. Kotropolos, "Automatic emotional speech classification," in Proc. IEEE int. Conf. Acoust., Speech Signal Process., May 2004, vol. 1, pp. 593-596.
12. K.Kong and D. Jeon, "Design and control of an exoskeleton for elderly and patients," IEEE/ASME Trans. Mechatronics, vol. 11, no. 4, pp. 428-432, Aug. 2006.
13. Y. Mori, J. Okada, and K. Takayama, "Development of a standing style transfer system "ABLE" for disabled lower limbs," IEEE/ASME Trans. Mechatronics, vol. 11, no. 4, pp. 372-380, Aug. 2006.
14. L. Beccai, S. Roccella, L. Ascari, P. Valdastri, A. Sieber, M. C. Carrozza, and P. Dario, "Development and experimental analysis of a soft compliant tactile microsensor for anthropomorphic artificial hand," IEEE/ASME Trans. Mechatronics, vol. 13, no. 2, pp. 158-168, Apr. 2008.
15. A. D. Greer, P. M. Newhook, and G. R. Sutherland, "Human-machine interface for robotic surgery and stereotaxy," IEEE/ASME Trans. Mechatronics, vol. 13, no. 3, pp. 355-361, Jun. 2008.
16. A. Ozcan and N. Tsekos, "The interconnection of MRI scanner and MR-compatible robotic device: Synergistic graphical user interface to form a mechatronic system," IEEE/ASME Trans. Mechatronics, vol. 13, no. 3, pp. 362-369, Jun. 2008.
17. K. W. Lee, H. R. Kim, W. C. Yoon, Y. S. Yoon, and D. S. Kim, "Designing a human-robot interaction framework for home service robot," in Proc. Robot Hum. Interactive Commun. IEEE 14th Workshop, Aug. 2005, pp. 286-293.
18. B. S. Kang, "Text independent emotion recognition using speech signals," M.S. thesis, Yonsei Univ. Seoul, Korea, 2000.
19. B. Schuller, S. Reiter, R. Muller, M. Al-Hames, M. Lang, and G. Rigoll, "Speaker independent speech emotion recognition by ensemble classification," in Proc. IEEE Int. Conf. Multimedia Expo. 2005, pp. 864-867.
20. C. Breazeal and L. Aryananda, "Recognition of affective communicative intent in robot-directed speech," Auton. Robots, vol. 12, no. 1, pp. 83-104, Jan. 2002.
21. J. D. Johnston, "Transform cording of audio signal using perceptual noise criteria," IEEE J. Sel. Areas Commun., vol. SAC-6, no. 2, pp. 314-323, Feb. 1988.
22. R. J. J. H. van Son and L.C.W. Pols, "An acoustic description of consonant reduction," Speech Commun., vol. 28, no. 2, pp. 125-140, Jun. 1999.
23. M.T. Shami and M. S. Kamel, "Segment-based approach to the recognition of emotion in speech," in Proc. IEEE Int. Conf. Multimedia Expo., 2005, 4 pp.
24. C. Clavel, I. Vasilescu, G. Richard, and L. Devillers, "Voiced and unvoiced content of fear-type emotions in the SAFE corpus," in Proc. Speech Prosody Conf., Dresden, Germany, 2006.
25. E. H. Kim, K. H. Hyun, and Y. K. Kwak, "Improvement of emotion recognition from voice by separating of obstruents," in Proc. IEEE Int. Symp. Robot Hum. Interactive Commun., RO-MAN, Sep. 2006, pp. 564-568.
26. C. E. Osgood, J. G. Suci, and P. H. Tannenbaum, The Measurement of Meaning, Urbana, IL: Univ. Illinois, 1957, pp. 31-75.
27. M. You, C. Chen, J. Bu, J. Liu, and J. Tao, "A hierarchical framework for speech emotion recognition," IEEE Int. Symp. Ind. Electron., vol. 1, pp. 515-519, Jul. 2006.
28. J. Liu, C. Chen, J. Bu, M. You, and J. Tao, "Speech emotion recognition based on a fusion of all-class and pairwise-class feature selection," Lecture Notes Comput. Sci., vol. 4487, pp. 1611-3349, Jul. 2007.
29. J. D. Markel, "The SIFT algorithm for fundamental frequency estimation," IEEE Trans. Audio Electroacoust., vol. AU-20, no. 5, pp. 367-377, Dec. 1972.
30. I.Witten and E. Frank, Data mining. Los Altos, CA: Morgan Kaufflan, 2000.
31. T. Okada and S. Tomita, "Optimal orthogonal system for discriminant analysis," Pattern Recognit., vol. 18, pp. 139-144, 1985.
32. M. Nishida and T. Kawahara, "Speaker model selection based on the Bayesian information criterion applied to unsupervised speaker indexing," IEEE Trans. Speech Audio Process., vol. 13, no. 4, pp. 583-592, Jul. 2004.
33. I. S. Engberg and J. Beskow, "Documentation of the danish emotional speech database (DES)," Center for Personal Communication, Aalborg, Denmark, Internal AAU Rep., 1996.
34. D. Ververidis and C. Kotropoulos, "Emotional speech recognition: Resources, features, and methods," Speech Commun., vol. 48, no. 9, pp. 1162-1181, Sep. 2006.
35. O.W. Kwon, K. Chan, and T.W. Lee, "Statistical speech feature selection for emotion recognition," J. Acoust. Soc. Korea, vol. 24, no. 4E, pp. 144-151, 2005.
36. T. L. Pao,Y. T. Chen, and J. H.Yeh, "Comparison of classification methods for detection emotion from mandarin speech," IEICE Trans. Inf. Syst., vol. E91-D, no. 4, pp. 1074-1081, 2008.
37. R. Nakatsu, N. Tosa, and T. Ochi, "Construction of interactive movie system for multi-person participation," in Proc. IEEE Int. Conf. Multimedia Comput. Syst. (ICMCS), Jul. 1998, pp. 228-232.
38. D. J. France, R. G. Shivavi, S. Silverman, M. Silverman, and M. Wikes, "Acoustical properties of speech as indicators of depression and suicidal risk," IEEE Trans. Biomed. Eng., vol. 4, no. 7, pp. 829-837, Jul. 2000.
39. R. Cowie, E. Douglass-Cowi, N. Tsapatsoulis, G. Votsis, S. Kollias, W. Fellenz, and J. G. Taylor, "Emotion recognition in human-computer interaction," IEEE Signal Process. Mag., vol. 18, no. 1, pp. 32-80, Jan. 2001.
40. V. Kostov and S. Fukuda, "Emotion in user interface, voice interaction system," in Proc. IEEE Int. Conf. Syst., Man, and Cybern. (SMC), 2000, vol. 2, pp. 798-803.
41. J. H. L. Hansen, "Analysis and compensation of speech under stress and noise for environmental robustness in speech recognition," Speech Commun., vol. 20, no. 2, pp. 151-170, Nov. 1996.