A methodology for reader's emotional state extraction to augment expressions in speech synthesis

Proceedings - International Conference on Tools with Artificial Intelligence, ICTAI

Volumn 2, Issue , 2007, Pages 218-225

  Tsonos, Dimitrios ^a   Xydas, Gerasimos ^a   Kouroupetroglou, Georgios ^a  

^a UNIVERSITY OF ATHENS   (Greece)

Author keywords

Document to audio; Emotional state extraction annotation of documents; Expressive speech synthesis; Speech representation of text formatting

Indexed keywords

ARTIFICIAL INTELLIGENCE; CYBERNETICS; EXTRACTIVE METALLURGY; SPEECH COMMUNICATION; SPEECH SYNTHESIS;

DOCUMENT-TO-AUDIO; EMOTIONAL STATE EXTRACTION-ANNOTATION OF DOCUMENTS; EMOTIONAL STATES; EXPRESSIVE SPEECH SYNTHESIS; INTERNATIONAL CONFERENCES; MANIKIN TEST; REAL-TIME EXTRACTION; SELF-ASSESSMENT; SPEECH REPRESENTATION OF TEXT FORMATTING; SYSTEM ARCHITECTURES; TEXT-TO-SPEECH SYNTHESIS;

SPEECH;

EID: 47949109651     PISSN: 10823409     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICTAI.2007.127     Document Type: Conference Paper

References (36)

1. K. Holmqvist, J. Holsanova, M. Barthelson and D. Lundqvist, "Reading or scanning? A study of newspaper and net paper reading", In Hyönä, J. R., and Deubel, H. (Eds.), The mind's eye: cognitive and applied aspects of eye movement research, Elsevier Science Ltd, 2003, pp. 657-670.
2. K. Holmqvist and C. Wartenberg, "The role of local design factors for newspaper reading behaviour - an eye-tracking perspective. Daily newspaper layout-designer's prediction of reader's visual behaviour - a case study", Lund University Cognitive Studies, 127, Lund, LUCS 2005.
3. N. Küpper, "Recording of Visual Reading Activity: Research into Newspaper Reading Behaviour." (Available as pdf from http://calendardesign.de/leseforschungeyetrackstudy.pdf), 1989.
4. Holmberg N., Eye movement patterns and newspaper design factors. An experimental approach, Master Thesis, Lund University Cognitive Science, Sweden, 2004.
5. K. Larson, "The Technology of Text", IEEE Spectrum, May 2007. pp 20-25.
6. Barrien F., Color and Human response, Van Norstrand Reinhold, New York , 1978.
7. J.A. Sánchez, N. P. Hernández, J. C. Penagos and Y. Ostróvskaya, "Conveying mood and emotion in instant messaging by using a two-dimensional model for affective states". Proceedings of the Symposium on Human Factors in Computer Systems IHC 2006, Natal,Brazil. 2006.
8. J.A. Sanchez, I. Kirschning, J.C. Palacio, Y. Ostróvskaya, "Towards mood-oriented interfaces for synchronous interaction", Congreso Latinoamericano de Interacción Humano-Computadora (CLIHC'05), Cuernavaca, México, 2005, pp.1-7.
9. J. Laarni, "Effects of color, font type and font style on user preferences", In C. Stephanidis (Ed.) Adjunct Proceedings of HCI International 2003, Heraklion, Crete, Lawrence Erlbaum Associates Inc, 2003, pp. 31-32.
10. T. Saari, M. Turpeinen, J. Laarni, N. Ravaja and K. Kallinen, "Emotionally Loaded Mobile Multimedia Messaging", Entertainment Computing - ICEC 2004, Third International Conference, Eindhoven, The Netherlands, September 1-3, 2004, pp. 476-486.
11. The Humaine Portal, http://emotion-research.net/
12. C. Dormann, "Affective experiences in the home: measuring emotions", HOIT2003, California, U.S.A., April 6-8, 2003.
13. L. Kärkkäinen, and J. Laarni, "Designing for small display screens", NordiCHI 2002, Aarhus, Denmark, October 19-23, 2002, pp. 227-230
14. Lang P.J., M. Bradley and B. Culthbert, International Affective Picture System (IAPS): Instruction Manual and Affective Ratings, Technical Report A-6, The Center for Research in Psychophysiology, University of Florida, U.S.A., 2005.
15. R. P. Bagozzi, M. Gopinath and P. U. Nyer, "The Role of Emotions in Marketing", Journal of the Academy of Marketing Science, Vol. 27, 1999, pp. 184-206.
16. J. D. Morris, "Observations SAM: The self-assessment manikin- An efficient cross-cultural measurement of emotional response", Journal of Advertising Research, November-December, 1995, pp. 63-68.
17. L. Kärkkäinen and J. Laarni, "A New Test for Web Page Evaluation", Proceedings of the IADIS International Conference WWW/Internet 2003, ICWI2003, Algarve, Portugal, November 5-8, 2003, pp. 1255-1256.
18. "Special Section on Expressive Speech Synthesis", as presented in the Editorial of IEEE Transactions on Audio, Speech and Language Processing, vol. 14, no 4, July 2006, pp. 1097-1098.
19. E. Eide, A. Aaron, R. Bakis, W. Hamza, M. Picheny and J. Pitrelli, "A Corpus-Based Approach to 〈ahem/〉 Expressive Speech Synthesis", 5th ISCA Speech Synthesis Workshop 14th-16th June 2004, Carnegie Mellon University Pittsburgh, pp. 79-84
20. C. Drioli, G. Tisato, P. Cosi and F. Tesser, "Emotions and voice quality: experiments with sinusoidal modelling", In VOQUAL'03, Geneve, Switzerland, August 27-29, 2003, pp. 127-132.
21. C.-H. Wu, C.-C. Hsia, T.-H. Liu and J.-F. Wang, "Voice conversion using duration-embedded bi-HMMs for expressive speech synthesis", IEEE Transactions on Audio, Speech and Language Processing, vol. 14, No 4, 2006, pp. 1109-1116.
22. Pitrelli J.F., Bakis R., Eide E. M., Fernandez R., Hamza W.; Picheny M.A., "The IBM expressive Text-to-Speech synthesis system for American English", IEEE Transactions on Audio, Speech and Language Processing, Vol. 14, Iss.. 4, July 2006, pp. 1099- 1108.
23. Theune M.; Meijs K.; Heylen D. ;Ordelman R, "Generating expressive speech for storytelling applications", IEEE Transactions on Audio, Speech and Language Processing, Vol. 14, Iss. 4, July 2006, pp. 1137-1144.
24. W.L. Johnson, S. Narayanan, R. Whitney, R. Das, M. Bulut and C. LaBore, "Limited domain synthesis of expressive military speech for animated characters", Speech Synthesis, 2002. Proceedings of 2002 IEEE Workshop on, Santa Monica, USA, September 11-13, 2002, pp.163-166
25. F. Burkhardt, N. Audibert, L. Malatesta, O. Türk, L. Arslan and V. Auberge, "Emotional Prosody - Does Culture Make A Difference?", Speech Prosody 2006, Dresden, Germany, May 2-5, 2006.
26. A. Iida, N. Campbell, F. Higuchi, F. and M. Yasumura, "A corpus-based speech synthesis system with emotion", Speech Communication, Elsevier, vol. 40, no 1, April 2003, pp. 161-187.
27. Schroeder M., "Expressing degree of activation in synthetic speech" IEEE Transactions on Audio, Speech and Language Processing, Vol. 14, Iss. 4, July 2006, pp. 1128-1136
28. Emotional Text Analyzer, http://emotion.informatik.uniaugsburg.de/
29. D. Tsonos, G. Xydas, and G. Kouroupetroglou, "Auditory Accessibility of Metadata in Books: A Design for All Approach", Lecture Notes in Computer Science (LNCS), Springer, Vol. 4556, pp. 436-445, 2007.
30. G. Xydas, V. Argyropoulos, T. Karakosta and G. Kouroupetroglou, "An Open Platform for Conducting Psycho-Acoustic Experiments in the Auditory Representation of Web Documents" , in Proceedings of the ACOUSTICS 2004 Conference, Thessaloniki, Greece, September 27-28, 2004, pp. 157-164.
31. D. Spiliotopoulos, G. Xydas, G. Kouroupetroglou and V. Argyropoulos, "Experimentation on Spoken Format of Tables in Auditory User Interfaces", Universal Access in HCI, Vol. 8, Proceedings of the 11th International Conference on Human-Computer Interaction (HCII-2005), Las Vegas, USA, July 2005, pp. 22-27.
32. K. R. Schrerer, R. Banse, and H.G. Wallbott, "Emotion Inferences from vocal expression correlate across languages and cultures", J. Cross-Cultural Psychol., vol.32, no. 1, 2001, pp.76-92.
33. K. R. Scherer, "What are emotions? And how can they be measured?" Social Science Information, 44(4), 2005, pp. 693-727.
34. D. Ververidis and C. Kotropoulos, "Emotional speech recognition: Resources, features, and methods", Speech Communication, Vol. 48, no 9, January 2006, pp. 1162-1181.
35. C. Ma, H. Prendinger and M. Ishizuka, "A Chat System Based on Emotion Estimation from Text and Embodied Conversational Messengers", Proceedings of 4th International Conference Entertainment Computing - ICEC 2005, Sanda, Japan, September 19-21, 2005, p.p. 535-538.
36. P. J. Lang, "The cognitive psychophysiology of emotion: Fear and anxiety" in A. Tuma & J. Maser (Eds.), Anxiety and the anxiety disorder, Lawrence Erlbaum, 1985, pp. 131-170.