3D audiovisual rendering and real-time interactive control of expressivity in a talking head

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 4722 LNCS, Issue , 2007, Pages 29-36

  Martin, Jean Claude ^a   D'Alessandro, Christophe ^a   Jacquemin, Christian ^a   Katz, Brian ^a   Max, Aurélien ^a   Pointai, Laurent ^a   Rilliard, Albert ^a  

^a CNRS   (France)

Author keywords

3D animation; Experimental studies; Expressiveness; Real time and interactivity; Voice directivity

Indexed keywords

INTELLIGENT VIRTUAL AGENTS; SPEECH SYNTHESIS;

3D ANIMATION; EXPERIMENTAL PLATFORM; EXPERIMENTAL STUDIES; EXPRESSIVENESS; INTERACTIVITY; MULTIMODAL PERCEPTION; QUESTION AND ANSWER SYSTEM; SPEECH SYNTHESIS SYSTEM;

THREE DIMENSIONAL COMPUTER GRAPHICS;

EID: 37249078022     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-540-74997-4_3     Document Type: Conference Paper

References (31)

1. Bailly, G., Bérar, M., Elisei, F., Odisi, M.: Audiovisual Speech Synthesis. International Journal of Speech Technology. Special Issue on Speech Synthesis: Part II. 6(4) (2003)
2. Cohen, M.M., Massaro, D.W.: Modeling coarticulation in synthetic visual speech. Models and Techniques in Computer Animation. AAAI/MIT Press, Cambridge (1993)
3. Ma, J., Cole, R., Pellom, B., Ward, W., Wise, B.: Accurate automatic visible speech synthesis of arbitrary 3D models based on concatenation of diviseme motion capture data. Computer Animation and Virtual Worlds, 15(5) (2004)
4. Beskow, J.: Talking Heads - Models and Applications for Multimodal Speech Synthesis. PhD Thesis. Stockholm (2003), http://www.speech.kth.se/~beskow/ thesis/index.html
5. Reveret, L., Essa, I.: Visual Coding and Tracking of Speech Related Facial Motion, Hawai, USA
6. Bevacqua, E., Pelachaud, C.: Expressive audio-visual speech. Comp. Anim. Virtual Worlds, 15 (2004)
7. DeCarlo, D., Stone, M., Revilla, C., Venditti, J.: Specifying and Animating Facial Signals for Discourse in Embodied Conversational Agents. Computer Animation and Virtual Worlds 15(1) (2004)
8. Cohen, M., Beskow, J., Massaro, D.: Recent developments in facial animation: an inside view. In: AVSP'98 (1998)
9. Ostermann, J.: Animation of synthetic faces in MPEG-4. In: Computer Animation'98, Philadelphia, USA, pp. 49-51 (1998)
10. Schröder, M.: Speech and Emotion Research: An overview of research frameworks and a dimensional approach to emotional speech synthesis. PhD Thesis (2004)
11. Kob, M., Jers, H.: Directivity measurement of a singer. Journal of the Acoustical Society of America 105(2) (1999)
12. Prudon, R., d'Alessandro, C.: selection/concatenation text-to-speech synthesis system: databases development, system design, comparative evaluation. In: 4th ISCA/IEEE International Workshop on Speech Synthesis, IEEE Computer Society Press, Los Alamitos (2001)
13. Katz, B., Prezat, F., d'Alessandro, C.: Human voice phoneme directivity pattern measurements. In: 4th Joint Meeting of the Acoustical Society of America and the Acoustical Society of Japan, Honolulu, Hawaï 3359 (2006)
14. D'Alessandro, C., D'Alessandro, N., Le Beux, S., Simko, J., Cetin, F., Pirker, H.: The speech conductor: gestural control of speech synthesis. In: eNTERFACE 2005. The SIMILAR NoE Summer Workshop on Multimodal Interfaces, Mons, Belgium, pp. 52-61 (2005)
15. Campbell, N.: Speech & Expression; the value of a longitudinal corpus. In: LREC 2004, pp. 183-186 (2004)
16. Martin, J.-C., Abrilian, S., Devillers, L.: Annotating Multimodal Behaviors Occurring during Non Basic Emotions. In: Tao, J., Tan, T., Picard, R.W. (eds.) ACII 2005. LNCS, vol. 3784, pp. 550-557. Springer, Heidelberg (2005)
17. d'Alessandro, C., Rilliard, A., Le Beux, S.: Computerized chironomy: evaluation of hand-controlled Intonation reiteration. In: Interspeech 2007, Antwerp, Belgium (2007)
18. Le Beux, S., Rilliard, A.: A real-time intonation controller for expressive speech synthesis. In: 6th ISCA Workshop on Speech Synthesis (SSW-6), Bonn, Germany (2007)
19. d'Alessandro, N., Doval, B., d'Alessandro, C., Beux, L., Woodruff, P., Fabre, Y., Dutoit, T.: RAMCESS: Realtime and Accurate Musical Control of Expression in Singing Synthesis. Journal on Multimodal User Interfaces 1(1) (2007)
20. Pandzic, I.S., Forchheimer, R.: MPEG-4 Facial Animation. The Standard, Implementation and Applications. John Wiley & Sons, LTD, Chichester (2002)
21. Tsapatsoulis, N., Raouzaiou, A., Kollias, S., Cowie, R., Douglas-Cowie, E.: Emotion Recognition and Synthesis based on MPEG-4 FAPs. MPEG-4 Facial Animation. John Wiley & Sons, Chichester (2002)
22. Balci, K.: MPEG-4 based open source toolkit for 3D Facial Animation. In: Working conference on Advanced visual interfaces, New York, NY, USA, pp. 399-402 (2004)
23. Kshirsagar, S., Garchery, S., Magnenat-Thalmann, N.: Feature Point Based Mesh Deformation Applied to MPEG-4 Facial Animation. In: IFIP Tc5/Wg5.10 Deform'2000 Workshop and Avatars'2000 Workshop on Deformable Avatars, pp. 24-34 (2000)
24. Beeson, C.: Animation in the "Dawn" demo. GPU Gems, Programming Techniques, Tips, and Tricks for Real-Time Graphics. Wiley, Chichester, UK (2004)
25. Fagel, S.: Video-realistic Synthetic Speech with a Parametric Visual Speech Synthesizer. In: International Conference on Spoken Language Processing (INTERSPEECH/ICSLP 2004) (2004)
26. Jacquemin, C.: A tangible cephalomorphic interface for expressive facial animation. In: Paiva, A., Prada, R., Picard, R.W. (eds.) ACII 2007. LNCS, vol. 4738, pp. 558-569. Springer, Heidelberg (2007)
27. Benamara, F.: WebCoop: un système de Questions-Réponses coopératif sur le Web. PhD Thesis (2004)
28. Bosma, W.: Extending answers using discourse structure. In: Proceedings of RANLP workshop on Crossing Barriers in Text Summarization Research, Borovets, Bulgaria (2005)
29. Boves, L., den Os, E.: Interactivity and multimodality in the IMIX demonstrator. In: IEEE conference on Multimedia and Expo (ICME 2005) (2005)
30. Rosset, S., Galibert, O., Illouz, G., Max, A.: Integrating spoken dialog and question answering: the Ritel project. In: Interspeech'06, Pittsburgh, USA (2006)
31. Marsi, E., van Rooden, F.: Expressing uncertainty with a Talking Head in a Multimodal Question-Answering System, Aberdeen, UK