Predicting latent narrative mood using audio and physiologic data

31st AAAI Conference on Artificial Intelligence, AAAI 2017

Volumn , Issue , 2017, Pages 948-954

  Al Hanai, Tuka ^a   Ghassemi, Mohammad Mahdi ^a  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; CLASSIFICATION (OF INFORMATION); LINGUISTICS; TOPOLOGY;

CROSS VALIDATION; MODEL PERFORMANCE; NETWORK TOPOLOGY; NEURAL NETWORK (NN); PHYSIOLOGICAL FEATURES; PHYSIOLOGICAL SIGNALS; PHYSIOLOGICAL STATE; SEQUENTIAL FORWARD SELECTION;

PHYSIOLOGY;

EID: 85019603994     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (27)

1. Barrett, L. F.; Lindquist, K. A.; and Gendron, M. 2007. Language as context for the perception of emotion. Trends in cognitive sciences 11(8):327-332.
2. Barrett, L. F.; Mesquita, B.; and Gendron, M. 2011. Context in emotion perception. Current Directions in Psychological Science 20(5):286-290.
3. Calvo, R. A., and D'Mello, S. 2010. Affect detection: An interdisciplinary review of models, methods, and their applications. Affective Computing, IEEE Transactions on 1(1):18-37.
4. Cameron, J. J., and Robinson, K. J. 2010. Dont you know how much i need you? consequences of miscommunication vary by self-esteem. Social Psychological and Personality Science 1(2):136-142.
5. D'Mello, S., and Kory, J. 2012. Consistent but modest: a meta-analysis on unimodal and multimodal affect detection accuracies from 30 studies. In Proceedings of the 14th ACM international conference on Multimodal interaction, 31-38. ACM.
6. Douglas-Cowie, E.; Campbell, N.; Cowie, R.; and Roach, P. 2003. Emotional speech: Towards a new generation of databases. Speech communication 40(1):33-60.
7. El Ayadi, M.; Kamel, M. S.; and Karray, F. 2011. Survey on speech emotion recognition: Features, classification schemes, and databases. Pattern Recognition 44(3):572-587.
8. Esuli, A., and Sebastiani, F. 2006. Sentiwordnet: A publicly available lexical resource for opinion mining. In Proceedings of LREC, Volume 6, 417-422. Citeseer.
9. Eyben, F.; Wöllmer, M.; and Schuller, B. 2010. Opensmile: the munich versatile and fast open-source audio feature extractor. In Proceedings of the 18th ACM international conference on Multimedia, 1459-1462. ACM.
10. Friedman, J.; Hastie, T.; and Tibshirani, R. 2001. The elements of statistical learning, Volume 1. Springer series in statistics Springer, Berlin.
11. Haag, A.; Goronzy, S.; Schaich, P.; and Williams, J. 2004. Emotion recognition using bio-sensors: First steps towards an automatic system. In ADS, 36-48. Springer.
12. Han, K.; Yu, D.; and Tashev, I. 2014. Speech emotion recognition using deep neural network and extreme learning machine. In Interspeech, 223-227.
13. Kahou, S. E.; Pal, C.; Bouthillier, X.; Froumenty, P.; Gülçehre, ç.; Memisevic, R.; Vincent, P.; Courville, A.; Bengio, Y.; Ferrari, R. C.; et al. 2013. Combining modality specific deep neural networks for emotion recognition in video. In Proceedings of the 15th ACM on International conference on multimodal interaction, 543-550. ACM.
14. Katsis, C. D.; Katertsidis, N.; Ganiatsas, G.; and Fotiadis, D. I. 2008. Toward emotion recognition in car-racing drivers: A biosignal processing approach. Systems, Man and Cybernetics, Part A: Systems and Humans, IEEE Transactions on 38(3):502-512.
15. Koolagudi, S. G., and Rao, K. S. 2012. Emotion recognition from speech: a review. International journal of speech technology 15(2):99-117.
16. Li, L.; Zhao, Y.; Jiang, D.; Zhang, Y.; Wang, F.; Gonzalez, I.; Valentin, E.; and Sahli, H. 2013. Hybrid deep neural network-hidden markov model (dnn-hmm) based speech emotion recognition. In Affective Computing and Intelligent Interaction (ACII), 2013 Humaine Association Conference on, 312-317. IEEE.
17. Müller, E.; Schuler, A.; and Yates, G. B. 2008. Social challenges and supports from the perspective of individuals with asperger syndrome and other autism spectrum disabilities. Autism 12(2):173-190.
18. Plutchik, R. 2001. The nature of emotions human emotions have deep evolutionary roots, a fact that may explain their complexity and provide tools for clinical practice. American Scientist 89(4):344-350.
19. Rilliard, A.; Shochi, T.; Martin, J.-C.; Erickson, D.; and Aubergé, V. 2009. Multimodal indices to japanese and french prosodically expressed social affects. Language and speech 52(2-3):223-243.
20. Schuller, B.; Rigoll, G.; et al. 2006. Timing levels in segment-based speech emotion recognition. In INTERSPEECH.
21. Schuller, B.; Steidl, S.; and Batliner, A. 2009. The interspeech 2009 emotion challenge. In INTERSPEECH, volume 2009, 312-315. Citeseer.
22. Stuhlsatz, A.; Meyer, C.; Eyben, F.; ZieIke, T.; Meier, G.; and Schuller, B. 2011. Deep neural networks for acoustic emotion recognition: raising the benchmarks. In Acoustics, Speech and Signal Processing (ICASSP), 2011 IEEE International Conference on, 5688-5691. IEEE.
23. Wagner, J.; Kim, J.; and André, E. 2005. From physiological signals to emotions: Implementing and comparing selected methods for feature extraction and classification. In Multimedia and Expo, 2005. ICME 2005. IEEE International Conference on, 940-943. IEEE.
24. Walter, S.; Scherer, S.; Schels, M.; Glodek, M.; Hrabal, D.; Schmidt, M.; Böck, R.; Limbrecht, K.; Traue, H. C.; and Schwenker, F. 2011. Multimodal emotion classification in naturalistic user behavior. In Human-Computer Interaction. Towards Mobile and Intelligent Interaction Environments. Springer. 603-611.
25. Wöllmer, M.; Metallinou, A.; Eyben, F.; Schuller, B.; and Narayanan, S. S. 2010. Context-sensitive multimodal emotion recognition from speech and facial expression using bidirectional lstm modeling. In INTERSPEECH, 2362-2365.
26. Wöllmer, M.; Kaiser, M.; Eyben, F.; Schuller, B.; and Rigoll, G. 2013. Lstm-modeling of continuous emotions in an audiovisual affect recognition framework. Image and Vision Computing 31(2):153-163.
27. Zeng, Z.; Pantic, M.; Roisman, G. I.; and Huang, T. S. 2009. A survey of affect recognition methods: Audio, visual, and spontaneous expressions. IEEE transactions on pattern analysis and machine intelligence 31(1):39-58.