A new information fusion method for bimodal robotic emotion recognition

Journal of Computers

Volumn 3, Issue 7, 2008, Pages 39-47

  Han, Meng Ju ^a   Hsu, Jing Huai ^a   Song, Kai Tai ^a   Chang, Fuh Yu ^b  

^a NATIONAL CHIAO TUNG UNIVERSITY   (Taiwan)

^b INDUSTRIAL TECHNOLOGY RESEARCH INSTITUTE   (Taiwan)

Author keywords

DSP based image and audio processing system; Emotion recognation; Human robot interaction; Probabilistic; SVM

Indexed keywords

CLASSIFICATION (OF INFORMATION); FACE RECOGNITION; HUMAN ROBOT INTERACTION; INFORMATION FUSION; MAN MACHINE SYSTEMS; ROBOTS; SUPPORT VECTOR MACHINES;

BIMODAL EMOTION RECOGNITION; DSP-BASED IMAGE AND AUDIO PROCESSING SYSTEM; EMOTION RECOGNATION; EMOTION RECOGNITION; INFORMATION FUSION METHOD; PROBABILISTIC; PROBABILISTIC STRATEGY; SVM CLASSIFICATION;

SPEECH RECOGNITION;

EID: 77953912587     PISSN: 1796203X     EISSN: None     Source Type: Journal    
DOI: 10.4304/jcp.3.7.39-47     Document Type: Article

References (19)

1. M. Fujita, "On Activating Human Communications with Pet-type Robot AIBO," Proc. of the IEEE, vol. 92, no. 11, pp. 1804-1813, 2004.
2. Y. Tian, T. Kanade and J.F. Cohn, "Recognizing Action Units for Facial Expression Analysis," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 23, no. 2, pp. 97-115, 2001.
3. M. Pantic and L.J.M. Rothkrantz, "Automatic Analysis of Facial Expressions: The State of the Art," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 22, no. 12, pp. 1424-1445, 2000.
4. D. Ververidis, C. Kotropoulos and I. Pitas, "Automatic Emotional Speech Classification," Proc. of IEEE International Conf. on Acoustics, Speech, and Signal Processing, Montreal, Quebec, Canada, 2004, pp 593-596.
5. B. Schuller, G. Rigoll and M. Lang, "Speech Emotion Recognition Combining Acoustic Features and Linguistic Information in a Hybrid Support Vector Machine - Belief Network Architecture," Pro. of IEEE International Conf. on Acoustics, Speech, and Signal Processing, Montreal, Quebec, Canada, 2004, vol. 1, pp. 577-580.
6. P. S. Aleksic and A. K. Katsaggelos, "Audio-Visual Biometrics," Proc. of the IEEE, vol. 94, no. 11, pp. 2025-2044, 2006.
7. L. C. De Silva, T. Miyasato and R. Nakatsu, "Facial Emotion Recognition Using Multi-modal Information," Proc. of IEEE International Conf. on Information, Communications and Signal Processing, Singapore, 1997, pp. 397-401.
8. L. C. De Silva, "Audiovisual Emotion Recognition," Proc. of IEEE International Conf. on Systems, Man and Cybernetics, The Hague, The Netherlands, 2004, pp. 649-654.
9. H. J. Go, K. C. Kwak, D. J. Lee and M. G. Chun, "Emotion recognition from the facial image and speech signal," Proc. of SICE Annual Conf., Fukui, Japan, 2003, vol. 3, pp. 2890-2895.
10. Y. Wang and L. Guan, "Recognizing Human Emotion from Audiovisual Information," Proc. of IEEE International Conf. on Acoustics, Speech, and Signal Processing, Philadelphia, PA, USA, 2005, pp. 1125-1128.
11. J. C. Platt, Probabilistic Outputs for Support Vector Machines and Comparisons to Regularized Likelihood Methods, Advances in Large-Margin Classifiers, MIT Press, Cambridge, MA, 2000.
12. Frederick Jelinek, Statistical Methods for Speech Recognition, MIT Press, Cambridge, MA, 1999.
13. N. Christianini and J.S. Taylor, An Introduction to Support Vector Machines, MIT Press, Cambridge, MA, 2000.
14. P. Viola and M. Jones, "Rapid Object Dectetion Using a Boosted Cascade of Simple Features," Proc. of IEEE Conf. on Computer Vision and Pattern Recognition, Kauai Marriott, Hawaii, 2001, pp. 511-518.
15. J. H. Lai, P. C Yuen, W. S. Chen, S. Lao and M. Kawade, "Robust Facial Feature Point Detection Under Nonlinear Illuminations," Proc. of IEEE ICCV Workshop on Recognition, Analysis and Tracking of Faces and Gestures in Real-time Systems, Canada, 2001, pp.168-174.
16. B. Schuller, G. Rigoll and M. Lang, "Speech Emotion Recognition Combining Acoustic Features and Linguistic Information in a Hybrid Support Vector Machine - Belief Network Architecture," Proc. of IEEE International Conf. on Acoustics, Speech, and Signal Processing, Montreal, Quebec, Canada, 2004, vol. 1, pp. 577-580.
17. Meng-Ju Han, Jing-Huai Hsu, Kai-Tai Song and Fuh-Yu Chang, "A New Information Fusion Method for SVM-Based Robotic Audio-Visual Emotion Recognition," Proc. of IEEE International Conference on Systems, Man and Cybernetics, Montreal, Canada, 2007, pp. 2656-2661.
18. M. Pantic, Michel Valstar, R. Rademaker and L. Maat, "Web-based Database for Facial Expression Analysis," Proc. of IEEE International Conf. on Multimedia and Expo., Amsterdam, 2005.
19. O. Martin, I. Kotsia, B. Macq and I. Pitas, "The eNTERFACE'05 Audio-Visual Emotion Database," Proc. of IEEE International Conf. on Data Engineering Workshops, Atlanta, 2006.