Beyond emotion archetypes: Databases for emotion modelling using neural networks

Neural Networks

Volumn 18, Issue 4, 2005, Pages 371-388

  Cowie, Roddy ^a   Douglas Cowie, Ellen ^a   Cox, Cate ^a  

^a QUEEN'S UNIVERSITY BELFAST   (United Kingdom)

Author keywords

Database; Elicitation; Emotion; Multimodal; Naturalistic

Indexed keywords

EMOTIONAL RESEARCH; NATURALISTIC; PERVASIVE EMOTIONS; TROUBLE SHOOTING;

BEHAVIORAL RESEARCH; DATA REDUCTION; NATURAL LANGUAGE PROCESSING SYSTEMS; NEURAL NETWORKS;

DATABASE SYSTEMS;

AGGRESSION; ARTICLE; DATA BASE; ELECTRONICS; EMOTION; FACIAL EXPRESSION; HUMAN; HUMAN COMPUTER INTERACTION; LANGUAGE ABILITY; MACHINE; NERVE CELL NETWORK; NONVERBAL COMMUNICATION; PRIORITY JOURNAL; RISK; THEORETICAL STUDY;

COMPUTER SIMULATION; DATABASES; EMOTIONS; HUMANS; NEURAL NETWORKS (COMPUTER);

EID: 21544457223     PISSN: 08936080     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neunet.2005.03.002     Document Type: Article

References (88)

1. N. Amir, S. Ron, and N. Laor Analysis of an emotional speech corpus in Hebrew based on objective criteria E. Douglas-Cowie R. Cowie M. Schroeder Proceedings of the ISCA workshop on speech and emotion, belfast 2000 2000 29 33
2. J. Ang, R. Dhillon, A. Krupski, E. Shriberg, and A. Stolcke Prosody-based automatic detection of annoyance and frustration in human-computer dialog Proceedings ICSLP, Denver, Colorado, Sept. 2002 2002
3. V. Auberge, N. Audibert, and A. Rilliard Why and how to control the authentic emotional speech corpora Eurospeech 2003, Geneva, Switzerland 2003 pp. 185-188
4. J.A. Bachorowski Vocal expression and perception of emotion Current Directions in Psychol Science 8 2 1999 53 57
5. Balomenos, T., Cowie, R., Malinescos, G., McMahon, E., Kasderidis, & S. (2003). Data Description, Sampling Methods, Experimental Design. Deliverable ND1.5: Retrieved 19 March, 2005 from http://manolito.image.ece.ntua.gr/oresteia/ .
6. T. Balomenos, A. Raouzaiou, S. Ioannou, A. Drosopoulos, K. Karpouzis, and S. Kollias Emotion analysis in man-machine interaction systems Workshop on multimodal interaction and related machine learning algorithms. (MLMI04) 2004 2004
7. R. Banse, and K.R. Scherer Acoustic profiles in vocal emotion expression Journal of Personality and Social Psychology 70 3 1996 614 636
8. A. Batliner, K. Fischer, R. Huber, J. Spilker, and E. Nöth How to find trouble in communication Speech Communication 40 2003 117 143
9. A. Batliner, C. Hacker, S. Steidl, E. Noth, S. D'Arcy, and M. Russell You stupid tin box - children interacting with the AIBO robot: A cross-linguistic emotional speech corpus Proceedings LREC 2004 2004
10. A. Batliner, C. Hacker, S. Steidl, E. Noth, and J. Haas From emotion to interaction: Lessons learned from real human-machine dialogues Proceedings of Affective Dialogue Systems: Tutorial and Research Workshop, ADS 2004, June 14-16 2004 Springer-Verlag Kloster Irsee, Germany pp. 1-12
11. Batocchi, A., & Pianesi, F. (2004). PianesiDaFEx: Database of kinetic facial expressionsproceedings sli-gscp workshop comunicazione parlata e manifestazione delle emozioni, padova (Italy) 30 Nov.-1, Dec. 2004.
12. C.R. Berger, and J.J. Bradac Language and social knowledge: Uncertainty in interpersonal relationships 1982 Edward Arnold London
13. J.T. Cacioppo, D.J. Klein, G.G. Berntson, and E. Hatfield The psychophysiology of emotion M. Lewis J. Haviland Handbook of emotions 1993 Guilford Press NewYork 119 142
14. N. Campbell What type of inputs will we need for expressive speech synthesis? Proceedings of 2002 IEEE workshop on speech synthesis 2002 pp. 95-98
15. N. Campbell Recording and storing of speech data Proceedings LREC 2002 2002
16. N. Campbell Specifying affect and emotion for expressive speech synthesis A. Gelbukh Computational linguistics and intelligent text processing: Fifth international conference, CICLing 2004 Seoul, Korea, February 15-21 2004 395 406
17. Center for the Study of Emotion and Attention (CSEA-NIMH) Center for the study of emotion and attention (CSEA-NIMH) The International affective picture system: Digitized photographs The center for research in psychophysiology 1999 University of Florida Gainesville, FL
18. Chung, S. -J. (2000). L'expression et la perception de l.émotion extraite de la parole spontanée: évidences du coréen et de l'anglais. Unpublished doctoral dissertation, Université de la Sorbonne Nouvelle, Paris III. Retrieved March 19, 2005, from http://www.geocities.com/ soojinchung/.
19. D.M. Clark On the induction of depressed mood in the laboratory: Evaluation and comparison of the Velten and musical procedures Advances in Behavioral Research and Therapy 5 1983 27 49
20. R. Cornelius The science of emotion: Research and tradition in the psychology of emotion 1966 Prentice-Hall Upper Saddle River, NJ
21. R. Cowie What are people doing when they assign everyday emotion terms? Psychological Inquiry 16 1 2005 11 48
22. R. Cowie, and R. Cornelius Describing the Emotional States that are Expressed in Speech Speech Communication 40 2003 5 32
23. R. Cowie, E. Douglas-Cowie, B. Apolloni, J. Taylor, A. Romano, and W. Fellenz What a neural net needs to know about emotion words N. Mastorakis Computational intelligence and applications 1999 World Scientific Engineering Society 109 114
24. R. Cowie, A. McGuiggan, E. McMahon, and E. Douglas-Cowie Speech in the process of becoming bored Proceedings of 15th international congress of phonetic sciences, Barcelona 2003
25. R. Cowie, and M. Schroeder Piecing together the emotion jigsaw S. Bengio H. Bourlard Machine learning for multimodal interaction: Lecture notes in computer science Vol. 3361 2005 Springer Verlag Heidelberg 305 317
26. Cox, C. (2004). SALAS (Sensitive Artificial Listener induction techniques). Paper presented to HUMAINE Network of Excellence Summer School, 2004. Retrieved 23 March 2005 from http://emotion-research.net/ws/summerschool1/ SALAS.ppt#259.
27. R. Craggs, and M. Wood A 2 dimensional annotation scheme for emotion in dialogue AAAI spring symposium on exploring attitude and affect in text: Theories and applications 2004 AAAI Press Stanford University pp. 44-49
28. R.J. Davidson Neuropsychological perspectives on affective styles and their cognitive consequences T. Dalgleish M. Power Handbook of cognition and emotion 1999 Wiley New York 103 123
29. R. Descartes The passions of the soul (1649) E.L. Haldane G.R. Ross The philosophical works of descartes 1911-1912 Cambridge University Press Cambridge
30. L. Devillers, and I. Vasilescu Reliability of lexical and prosodic cues in two real-life spoken dialog corpora Proceedings LREC 2004 2004
31. E. Douglas-Cowie, N. Campbell, Cowie, and P. Roach Emotional speech: Towards a new generation of databases Speech Communication 40 1-2 2003 33 60
32. P. Ekman Basic emotions T. Dalgleish M.J. Power Handbook of cognition and emotion 1999 Wiley New York 301 320
33. P. Ekman, and W. Friesen The repertoire of non verbal behavior: Categories, origins, usage and coding Semiotica 1 1969 49 98
34. P. Ekman, and W. Friesen Pictures of facial affect 1975 Consulting Psychologists' Press Palo Alto, CA
35. P. Ekman, and W. Friesen Unmasking the face: A guide to recognizing emotions from facial clues 1975 Prentice-Hall, Inc. Englewood Cliffs, NJ
36. P. Ekman, W.V. Friesen, M. O'Sullivan, A. Chan, I. Diacoyanni-Tarlatzis, and K. Heider Universals and cultural differences in the judgments of facial expressions of emotion Journal of Personality and Social Psychology 53 4 1987 712 717
37. R. Fernandez, and R. Picard Modeling drivers' speech under stress Speech Communication 40 2003 145 159
38. D. France, R. Shiavi, S. Silverman, M. Silverman, and D. Wilkes Acoustical properties of speech as indicators of depression and suicidal risk IEEE Transactions on Biomedical Engineering 47 7 2000
39. N.H. Frijda The emotions 1986 Cambridge University Press Cambridge, UK
40. Goldie, P., Doring, S., & WPIO members. (2004). Report on ethical prospects and pitfalls for emotion-oriented systems. Report for EC funded IST Network of Excellence 507422 (HUMAINE). Retrieved 22nd March 2005 from http://emotion-research.net/deliverables/D10a.pdf.
41. P. Greasley, J. Setter, M. Waterman, C. Sherrard, P. Roach, and S. Arnfield Representation of prosodic and emotional features in a spoken language database Proceedings XIIIth international congress of phonetic sciences, Stockholm Vol. 1 1995 pp. 242-245
42. P. Greasley, C. Sherrard, and M. Waterman Emotion in language and speech: Methodological issues in naturalistic approaches Language and Speech 43 2000 355 375
43. J.J. Gross, and R.W. Levenson Emotion elicitation using films Cognition and Emotion 9 1995 87 108
44. P. Hadfield, and P. Marks This is your captain dozing New Scientist 1682267 2000 21
45. I. Iriondo Validation of an acoustical modelling of emotional expression in spanish using speech synthesis techniques Proceedings of the ISCA workshop on speech and emotion, Belfast 2000 2000
46. W. James What is emotion? Mind 9 1884 188 205
47. P. Juslin, and P. Laukka Communication of emotions in vocal expression and music performance Psychological Bulletin 129 5 2002 770 814
48. P. Kenealy Validation of a music mood induction procedure: Some preliminary findings Cognition and Emotion 2 1988 41 48
49. M. Kienast, and W.F. Sendlmeier Acoustical analysis of spectral and temporal changes in emotional speech R. Cowie E. Douglas-Cowie M. Schroeder Speech and emotion: Proceedings of the ISCA workshop. Newcastle, Co. Down, September 2000 2000 92 97
50. Kollias, S., Karpouzis, K., Ioannpou, S., & Raouzaiou, A. (2004). The facial feature extraction subsystem. Report (Deliverable D10) for EC funded fifth framework IST project IST-2000-29319 ERMIS (Emotionally Rich Man-machine Intelligent System). See http://manolito.image.ece.ntua.gr/ermis/.
51. Kollias, S. et al., 2005. Presentation to the final review of the ERMIS project (EC funded Fifth Framework IST project IST-2000-29319), Athens, March 2005.
52. P.J. Lang, M.M. Bradley, and B.N. Cuthbert International affective picture system IAPS: Technical manual and affective ratings The center for research in psychophysiology 1999 University of Florida Gainesville, FL
53. P. Laukka Verbal expressions of emotion: Discrete emotions and dimensional accounts Acta Universitatis Uppsalensis, Comprehensive Summaries of Uppsala Dissertations from the Faculty of Social Sciences 2004 141
54. J.E. LeDoux Emotion V.B. Mountcastle Handbook of physiology, Section I: The nervous system Higher functions of the brain Vol. V 1987 American Physiological Society Bethesda, MD
55. C. Lee, and S. Narayanan Emotion recognition using a data-driven fuzzy inference system Proceedings eurospeech 2003, Geneva 2003
56. C.M. Lee, and S. Narayanan Towards detecting emotions in spoken dialogs IEEE transactions on speech and audio processing 13 2 2005 293 303
57. L. Leinonen, and T. Hiltunen Expression of emotional-motivational connotations with a one-word utterance Journal of the Acoustical Society of America 102 3 1997 1853 1863
58. D.T. Lykken Polygraphic interrogation Nature 387 1984 681 684
59. McGilloway, S. (1997). Negative symptoms and speech parameters in schizophrenia. Unpublished doctoral thesis, Queen's University, Belfast.
60. S. McGilloway, R. Cowie, E. Douglas-Cowie, S. Gielen, M. Westerdijk, and S. Stroeve Automatic recognition of emotion from voice: A rough benchmark R. Cowie E. Douglas-Cowie M. Schroeder Speech and emotion: Proceedings of the ISCA workshop. Newcastle, Co. Down, September 2000 2000 207 212
61. E. McMahon, R. Cowie, S. Kasderidis, J. Taylor, and S. Kollias What chance that a DC could recognise hazardous mental states from sensor outputs? Proc, DC Tales conference, Sanotrini, June 2003 2003
62. C.B. Mervis, J. Catlin, and E. Rosch Relationships among goodness-of-example, category norms, and word frequency Bulletin of the Psychonomic Society 7 1976 268 284
63. Mozziconacci, S. (1998). Speech variability and emotion: Production and perception. Unpublished doctoral thesis. Technical University Eindhoven, Eindhoven.
64. R. Nakatsu, N. Tosa, and J. Nicholson Emotion recognition and its application to computer agents with spontaneous interactive capabilities Proceedings IEEE workshop on multimedia signal processing 1999 pp. 439-444
65. A. Nogueiras, A. Moreno, A. Bonafonte, and J. Mariño Speech emotion recognition using hidden markov models Proceedings Eurospeech 2001, Aalborg, Denmark 2001
66. A. Ortony, and T.J. Turner Whats basic about basic emotions Psychological Review 97 3 1990 315 331
67. R.W. Picard, E. Vyzas, and J. Healey Toward machine emotional intelligence: Analysis of affective physiological state IEEE Transactions On Pattern Analysis and Machine Intelligence 23 2001 1175 1191
68. U.T. Place Folk psychology from the standpoint of conceptual analysis W. O'Donohue R.F. Kitchener The philosophy of psychology 1996 Sage London 264 270
69. F.E. Pollick, H. Hill, A. Calder, and H. Paterson Recognising facial expression from spatially and temporally modified movements Perception 32 2003 813 826
70. T.S. Polzin, and A. Waibel Emotion-sensitive human-computer interfaces E. Douglas-Cowie R. Cowie M. Schroeder Proceedings of the ISCA workshop on speech and emotion, Belfast 2000 2000 201 206 pp. 201-206
71. P. Roach Techniques for the phonetic description of emotional speech E. Douglas-Cowie R. Cowie M. Schroeder Proceedings of the ISCA workshop on speech and emotion, Belfast 2000 2000
72. P. Roach, R. Stibbard, J. Osborne, S. Arnfield, and J. Setter Transcription of prosodic and paralinguistic features of emotional speech Journal of the International Phonetic Association 28 1998 83 94
73. J. Russell, and L. Barrett-Feldman Core affect, prototypical emotional episodes, and other things called emotion: Dissecting the elephant Journal of Personality and Social Psychology 5 1999 37 63
74. Sabini, and Silver Why emotion names and experiences don't neatly pair Psychological Inquiry 16 1 2005 1 10
75. K.R. Scherer Appraisal theory T. Dalgleish M.J. Power Handbook of cognition and emotion 1999 Wiley New York 637 663
76. K.R. Scherer, and G. Ceschi Lost luggage emotion: A field study of emotion - antecedent appraisal Motivation and Emotion 21 1997 211 235
77. K.R. Scherer, and G. Ceschi Studying affective communication in the airport: The case of lost baggage claims Personality and Social Psychology Bulletin 26 3 2000 327 339
78. K.R. Scherer, T. Johnstone, and T. Bänziger Automatic verification of emotionally stressed speakers: The problem of individual differences Proceedings of the international workshop on speech and computer, St Petersburg 1998
79. Scherer, K. et al. (2004). Preliminary plans for exemplars: Theory. Report for EC funded IST Network of Excellence 507422 (HUMAINE). Retrieved 22nd March 2005 from http://emotion-research.net/deliverables/D3c.pdf.
80. W.X. Schneider VAM: A neuro-cognitive model for visual control of segmentation, object recognition, and space-based motor action Visual Cognition 2 1995 331 376
81. M. Schroeder Experimental study of affect bursts Speech Communication 40 1-2 2003 99 116
82. Stibbard, R. (2001). Vocal expression of emotions in non-laboratory speech. Unpublished doctoral dissertation, University of Reading, UK.
83. Sweeney, F. (2005). The words people use to describe their emotional lives BSc thesis: School of Psychology, Queen's University Belfast.
84. F. Tolkmitt, and K.R. Scherer Effect of experimentally induced stress on vocal parameters Exp Psychol Hum Percept Perform 12 3 1986 302 313
85. Tsukahara, W., & Ward, N. (2001). Responding to subtle, fleeting changes in the user's internal state. CHI'01, ACM, 2001, pp. 77-84.
86. E. Velten A laboratory task for induction of mood states Behavior Research and Therapy 6 1968 473 482
87. N. Ward On the expressive competencies needed for responsive systems CHI 2003 workshop on subtle expressivity for characters and robots, April 7 2003, Fort Lauderdale, FL 2003
88. S. Yacoub, S. Simske, X. Lin, and J. Burns Recognition of emotions in interactive voice response systems Proceedings of the Eurospeech 2003, Geneva 2003