Inferring depression and affect from application dependent meta knowledge

AVEC 2014 - Proceedings of the 4th International Workshop on Audio/Visual Emotion Challenge, Workshop of MM 2014

Volumn , Issue , 2014, Pages 41-48

  Kächele, Markus ^a   Schels, Martin ^a   Schwenker, Friedhelm ^a  

^a Institute of Neural Information Processing   (Germany)

Author keywords

Affect recognition; Avec 2014; Depression recognition; Meta knowledge

Indexed keywords

AFFECT RECOGNITION; AUDIO-VISUAL DATA; AVEC 2014; CLASSIFICATION RESULTS; DEPRESSION RECOGNITION; META-KNOWLEDGE; PERFORMANCE MEASURE; STATISTICAL FEATURES;

EID: 84919360066     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2661806.2661813     Document Type: Conference Paper

References (61)

1. L. Breiman. Random forests. Mach. Learn., 45(1):5-32, 2001.
2. R. Cowie, E. Douglas-Cowie, N. Tsapatsoulis, G. Votsis, S. Kollias, W. Fellenz, and J. Taylor. Emotion recognition in human-computer interaction. IEEE Sig. Proc. Mag., 18(1):32-80, 2001.
3. T. Drugman and A. Alwan. Joint robust voicing detection and pitch estimation based on residual harmonics. In Interspeech, 2011.
4. J. Esparza, S. Scherer, and F. Schwenker. Studying self-and active-training methods for multi-feature set emotion recognition. In Partially Supervised Learning, pages 19-31. 2012.
5. M. Glodek, G. Layher, F. Schwenker, and G. Palm. Recognizing human activities using a layered Markov architecture. In Proc. of ICANN, volume 7552 of LNCS, pages 677-684. Springer, 2012.
6. M. Glodek, S. Reuter, M. Schels, K. Dietmayer, and F. Schwenker. Kalman filter based classifier fusion for affective state recognition. In Proc. of MCS, volume 7872 of LNCS, pages 85-94. Springer, 2013.
7. M. Glodek, M. Schels, G. Palm, and F. Schwenker. Multi-modal fusion based on classification using rejection option and Markov fusion networks. In Proc. of ICPR, pages 1084-1087. IEEE, 2012.
8. M. Glodek, M. Schels, G. Palm, and F. Schwenker. Multiple classifier combination using reject options and markov fusion networks. In Proc. of ICMI, pages 465-472. ACM, 2012.
9. M. Glodek, M. Schels, F. Schwenker, and G. Palm. Combination of sequential class distributions from multiple channels using markov fusion networks. JMUI, pages 1-16, 2014.
10. M. Glodek, S. Scherer, and F. Schwenker. Conditioned hidden Markov model fusion for multimodal classification. In Interspeech, pages 2269-2272. ISCA, 2011.
11. M. Glodek, S. Tschechne, G. Layher, M. Schels, T. Brosch, S. Scherer, M. Kächele, M. Schmidt, H. Neumann, G. Palm, and F. Schwenker. Multiple classifier systems for the classification of audio-visual emotional states. In Proc. of ACII - Part II, LNCS 6975, pages 359-368. Springer, 2011.
12. M. F. A. Hady, M. Schels, F. Schwenker, and G. Palm. Semi-supervised facial expressions annotation using co-training with fast probabilistic tri-class svms. In K. I. Diamantaras, W. Duch, and L. S. Iliadis, editors, Proc. of ICANN, LNCS 6353, pages 70-75. Springer, 2010.
13. H. Hermansky. Perceptual linear predictive (PLP) analysis of speech. The Journal of the Acoustical Society of America, 87(4):1738-1752, 1990.
14. H. Hermansky, N. Morgan, A. Bayya, and P. Kohn. RASTA-PLP speech analysis technique. In IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), volume 1, pages 121-124. IEEE, 1992.
15. S. Hochreiter. The vanishing gradient problem during learning recurrent neural nets and problem solutions. International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, 06(02):107-116, 1998.
16. S. Hochreiter and J. Schmidhuber. Long short-term memory. Neural Comput., 9(8):1735-1780, Nov. 1997.
17. F. Honold, P. Bercher, F. Richter, F. Nothdurft, T. Geier, R. Barth, T. Härnle, F. Schüssel, S. Reuter, M. Rau, G. Bertrand, B. Seegebarth, P. Kurzok, B. Schattenberg, W. Minker, M. Weber, and S. Biundo. Companion-technology: Towards user- and situation-adaptive functionality of technical systems. In Proc. of IE, pages 378-381. IEEE, 2014.
18. H. Jaeger and H. Haas. Harnessing nonlinearity: Predicting chaotic systems and saving energy in wireless communication. Science, 304(5667):78-80, 2004.
19. M. Kächele, M. Glodek, D. Zharkov, S. Meudt, and F. Schwenker. Fusion of audio-visual features using hierarchical classifier systems for the recognition of afiective states and the state of depression. In Proc. of ICPRAM, pages 671-678, 2014.
20. M. Kächele, M. Schels, S. Meudt, V. Kessler, M. Glodek, P. Thiam, S. Tschechne, G. Palm, and F. Schwenker. On annotation and evaluation of multi-modal corpora in affective human-computer interaction. In Proceedings of Multimodal Analyses enabling Artificial Agents in Human-Machine Interaction. Springer, 2014.
21. M. Kächele and F. Schwenker. Semi-supervised dictionary learning of sparse representations for emotion recognition. In Partially Supervised Learning, LNCS, pages 21-35, 2013.
22. M. Kächele and F. Schwenker. Cascaded fusion of dynamic, spatial, and textural feature sets for person-independent facial emotion recognition. In Proc. of ICPR, page (to appear), 2014.
23. M. Kächele, P. Thiam, G. Palm, and F. Schwenker. Majority-class aware support vector domain oversampling for imbalanced classification problems. In Artificial Neural Networks in Pattern Recognition, volume 8774 of LNCS, pages 83-92. Springer Berlin Heidelberg, 2014.
24. M. Kächele, D. Zharkov, S. Meudt, and F. Schwenker. Prosodic, spectral and voice quality feature selection using a long-term stopping criterion for audio-based emotion recognition. In Proc. of ICPR, page (to appear), 2014.
25. J. Kim and E. André. Emotion recognition based on physiological changes in music listening. Transactions on Pattern Analysis and Machine Intelligence, 30(12):2067-2083, 2008.
26. J. Kittler, M. Hatef, R. P. W. Duin, and J. Matas. On combining classifiers. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20:226-239, 1998.
27. S. Koelstra, C. Muhl, M. Soleymani, J.-S. Lee, A. Yazdani, T. Ebrahimi, T. Pun, A. Nijholt, and I. Patras. Deap: A database for emotion analysis using physiological signals. IEEE Transactions on Affective Computing, 3(1):18-31, 2012.
28. L. Kuncheva. Combining pattern classifiers: Methods and Algorithms. Wiley, 2004.
29. S. Leikas, M. Verkasalo, and J.-E. Lönnqvist. Posing personality: Is it possible to enact the big five traits in photographs? Journal of Research in Personality, 47(1):15 - 21, 2013.
30. S. Meudt, L. Bigalke, and F. Schwenker. ATLAS - an annotation tool for HCI data utilizing machine learning methods. In Proc. of APD'12, pages 5347-5352, 2012.
31. S. Meudt and F. Schwenker. On instance selection in audio based emotion recognition. In Proc. ANNPR'12, pages 186-192, 2012.
32. S. Meudt, D. Zharkov, M. Kächele, and F. Schwenker. Multi classifier systems and forward backward feature selection algorithms to classify emotional coloured speech. In Proc. of ICMI, pages 551-556, 2013.
33. J. Nicholson, K. Takahashi, and R. Nakatsu. Emotion recognition in speech using neural networks. Neural Computing and Applications, 9:290-296, 2000.
34. T. L. Nwe, S. W. Foo, and L. C. De Silva. Speech emotion recognition using hidden markov models. Speech communication, 41(4):603-623, 2003.
35. R. W. Picard. Affective Computing. MIT Press Cambridge, 2000.
36. L. Rabiner and B.-H. Juang. Fundamentals of speech recognition. Prentice Hall, Eaglewood Clifis, NJ, 1993.
37. F. Ringeval, A. Sonderegger, J. Sauer, and D. Lalanne. Introducing the recola multimodal corpus of remote collaborative and affective interactions. In Proc. of IEEE FG, pages 1-8, 2013.
38. D. Rösner, J. Frommer, R. Friesen, M. Haase, J. Lange, and M. Otto. Last minute: A multimodal corpus of speech-based user-companion interactions. In Proc. LREC'12, pages 2559-2566, may 2012.
39. J. A. Russell. A circumplex model of affect. JPSP, 39(6):1161-1178, 1980.
40. M. Schels, M. Glodek, S. Meudt, S. Scherer, M. Schmidt, G. Layher, S. Tschechne, T. Brosch, D. Hrabal, S. Walter, H. Traue, G. Palm, H. Neumann, and F. Schwenker. Multi-Modal Classifier-Fusion for the Recognition of Emotions, pages 73-98. Coverbal Synchrony in Human-Machine Interaction. CRC Press, 2013.
41. M. Schels, M. Glodek, S. Meudt, M. Schmidt, D. Hrabal, R. Bock, S. Walter, and F. Schwenker. Multi-modal classifier-fusion for the classification of emotional states in woz scenarios. In 1st International Conference on Affective and Pleasurable Design, pages 5337-5346, 2012.
42. M. Schels, M. Glodek, G. Palm, and F. Schwenker. Revisiting AVEC 2011 an information fusion architecture. In Computational Intelligence in Emotional or Affective Systems, Smart Innovation, Systems and Technologies, pages 385-393. Springer, 2013.
43. M. Schels, M. Kachele, M. Glodek, D. Hrabal, S. Walter, and F. Schwenker. Using unlabeled data to improve classification of emotional states in human computer interaction. JMUI, 8(1):5-16, 2014.
44. M. Schels, M. Kachele, D. Hrabal, S. Walter, H. C. Traue, and F. Schwenker. Classification of emotional states in a woz scenario exploiting labeled and unlabeled bio-physiological data. In Proc. of Partially Supervised Learning, pages 138-147. Springer, 2012.
45. M. Schels, S. Scherer, M. Glodek, H. Kestler, G. Palm, and F. Schwenker. On the discovery of events in EEG data utilizing information fusion. Computational Statistics, 28(1):5-18, 2013.
46. M. Schels, P. Schillinger, and F. Schwenker. Training of multiple classifier systems utilizing partially labeled sequential data sets. In Proceedings of the European Symposium on Artificial Neural Networks (ESANN), 2011.
47. K. R. Scherer, T. Johnstone, and G. Klasmeyer. Handbook of Affective Sciences - Vocal expression of emotion, chapter 23, pages 433-456. Affective Science. Oxford University Press, 2003.
48. S. Scherer, M. Glodek, G. Layher, M. Schels, M. Schmidt, T. Brosch, S. Tschechne, F. Schwenker, H. Neumann, and G. Palm. A generic framework for the inference of user states in human computer interaction: How patterns of low level communicational cues support complex affective states. JMUI, pages 117-141, 2012.
49. S. Scherer, M. Glodek, F. Schwenker, N. Campbell, and G. Palm. Spotting laughter in natural multiparty conversations: A comparison of automatic online and offine approaches using audiovisual data. ACM Transactions on Interactive Intelligent Systems, 2(1):1-31, 2012.
50. M. Schmidt, M. Schels, and F. Schwenker. A hidden markov model based approach for facial expression recognition in image sequences. In Proc. of ANNPR'10, LNAI 5998, pages 149-160. Springer, 2010.
51. B. Schuller, M. Valstar, F. Eyben, G. McKeown, R. Cowie, and M. Pantic. AVEC 2011 the first international audio visual emotion challenges. In Proc. of ACII (2011), LNCS, pages 415-424, 2011. Part II.
52. F. Schwenker, C. Dietrich, C. Thiel, and G. Palm. Learning decision fusion mappings for pattern recognition. International Journal on Artificial Intelligence and Machine Learning (AIML), 6:17-21, 2006.
53. F. Schwenker, M. Frey, M. Glodek, M. Kachele, S. Meudt, M. Schels, and M. Schmidt. A new multi-class fuzzy support vector machine algorithm. In Artificial Neural Networks in Pattern Recognition, volume 8774 of LNCS, pages 153-164. 2014.
54. F. Schwenker and E. Trentin. Pattern classification and clustering: A review of partially supervised learning approaches. Pattern Recognition Letters, 37:4-14, 2014.
55. M. Soleymani, J. Lichtenauer, T. Pun, and M. Pantic. A multimodal database for affect recognition and implicit tagging. IEEE Transactions on Affective Computing, 3:42-55, April 2012. Issue 1.
56. P.-M. Strau, H. Hömann, W. Minker, H. Neumann, G. Palm, S. Scherer, F. Schwenker, H. Traue, W. Walter, and U. Weidenbacher. Wizard-of-oz data collection for perception and interaction in multi-user environments. In Proceedings of LREC, pages 2014-2017, 2006.
57. S. Tschechne, G. Layher, and H. Neumann. A Biologically Inspired Model for the Detection of External and Internal Head Motions. In Proc. of ICANN, LNCS 8131, pages 232-239, 2013.
58. M. Valstar, B. Schuller, K. Smith, T. Almaev, F. Eyben, J. Krajewski, R. Cowie, and M. Pantic. Avec 2014: 3d dimensional affect and depression recognition challenge. In Proc. of ACM Multimedia. ACM, 2014.
59. S. Walter, J. Kim, D. Hrabal, S. Crawcour, H. Kessler, and H. Traue. Transsituational individual-specific biopsychological classification of emotions. IEEE Transactions on Systems, Man, and Cybernetics, 43(4):988-995, 2013.
60. S. Walter, S. Scherer, M. Schels, M. Glodek, D. Hrabal, M. Schmidt, R. Bock, K. Limbrecht, H. Traue, and F. Schwenker. Multimodal emotion classification in naturalistic user behavior. In Human-Computer Interaction. Towards Mobile and Intelligent Interaction Environments, volume 6763 of LNCS, pages 603-611. 2011.
61. M. Wöllmer, M. Kaiser, F. Eyben, B. Schuller, and G. Rigoll. LSTM-modeling of continuous emotions in an audiovisual affect recognition framework. Image and Vision Computing, 31(2):153 - 163, 2013.