Fantasy, curiosity and challenge as adaptation indicators in multimodal dialogue systems for preschoolers

Proceedings of the 2nd Workshop on Child, Computer and Interaction, WOCCI '09

Volumn , Issue , 2009, Pages

  Kannetis, Theofanis ^a   Potamianos, Alexandros ^a   Yannakakis, Georgios N ^b  

^a TECHNICAL UNIVERSITY OF CRETE   (Greece)

^b IT UNIVERSITY OF COPENHAGEN   (Denmark)

Author keywords

Children computer interaction; Evaluation; Graphical user interfaces; Multimodal interfaces; Speech interfaces

Indexed keywords

AUDIO FEATURES; CHILDREN COMPUTER INTERACTION; COMPUTER GAME; COMPUTER INTERACTION; EMOTIONAL STATE; INDIVIDUAL PREFERENCE; INTERACTION TIME; MULTI-MODAL; MULTI-MODAL INTERFACES; MULTIMODAL DIALOGUE; MULTIMODAL DIALOGUE SYSTEMS; OBJECTIVE METRICS; OPTIMAL LEVEL; POTENTIAL FEATURES; SPEECH INTERFACE; USER EXPERIENCE;

COMPUTER CRIME; INTERACTIVE COMPUTER SYSTEMS; INTERFACES (COMPUTER); SPEECH PROCESSING;

GRAPHICAL USER INTERFACES;

EID: 74049155426     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1640377.1640378     Document Type: Conference Paper

References (21)

1. Boersma, P. and Weenink, D., "Praat: doing phonetics by computer (Version 4.6)". Available at: http://www.praat.org/.
2. Busso, C. et al, "Analysis of emotion recognition using facial expressions, speech and multimodal information," in Proc. of ICMI, Oct. 2004.
3. Cassell, J. and Ryokai, K., "Making Space for Voice: Technologies to Support Children's Fantasy and Storytelling," Personal Technologies, vol. 5, 2001.
4. Chanel, G., Rebetez, C., Betrancourt, M., and Pun, T., "Boredom, Engagement and Anxiety as Indicators for Adaptation to Difficulty in Games," in Proc. of the 12th Intl. Conf. on Entertainment and Media in the Ubiquitous Era, Tampere, Finland, Oct. 2008.
5. Csikszentmihalyi, M., "Flow: The Psychology of Optimal Experience," New York: Harper & Row, 1990.
6. Gustafson, J., Bell, L., Boye, J., Lindstrom, A., and Wiren, M., "The NICE Fairy-tale Game System," in Proc. of SIGdial 04, Boston, MA, Apr. 2004.
7. Hagen, A., Pellom, B., and Cole, R., "Children's speech recognition with application to interactive book and tutors," in Proc. ASRU Workshop, 2003.
8. Kannetis, T. and Potamianos, A., "Towards adapting fantasy, curiosity and challenge in multimodal dialogue systems for preschoolers," in Proc. ICMI, Boston, MA, Nov. 2009.
9. Lazzaro, N., "Why We Play Games: Four Keys to More Emotion Without Story," Technical Report, XEO Design Inc., 2004, available at: http://www.xeodesign.com.
10. Narayanan, S. and Potamianos, A., "Creating conversational interfaces for children," IEEE Trans. on Speech and Audio Processing, vol. 10, pp. 65-78, Feb. 2002
11. Malone, T. W, "What make things fun to learn? A study of intrinsically motivating computer games," In Proc. of the 3rd ACM SIGSMALL Symposium and the First SIGPC Symposium on Small Systems, Palo Alto, California, Sept. 1980.
12. Mostow, J., Hauptmann, A. G., and Roth, S. F., "Demonstration of a reading coach that listens," in Proc. of the ACM Symposium on User Interface Software and Technology, pp. 77-78, 1995.
13. Potamianos, A. and Narayanan, S., "Robust recognition of children's speech," IEEE Trans. on Speech and Audio Processing, vol. 11, pp. 603-616, Nov. 2003.
14. Russell, M., Brown, B., Skilling, A., Series, R., Wallace, J., Bonham, B., and Barker, P., "Applications of automatic speech recognition to speech and language development in young children," in Proc. ICSLP, Philadelphia, PA, Oct. 1996.
15. Steidl, S. , Automatic Classification of Emotion-Related User States in Spontaneous Children's Speech. PhD thesis, Friedrich-Alexander University, Erlangen, Germany, 2009.
16. Strommen, E. F. and Frome, F. S., "Talking back to big bird: Preschool users and a simple speech recognition system," Educational Technology Research and Development, vol. 41, pp. 5-16, 1993.
17. Yannakakis, G. N., Hallam, J., and Lund, H. H., "Comparative Fun Analysis in the Innovative Playware Game Platform," in Proc. of the 1st World Conference for Fun n' Games, pp. 33-37, 2006.
18. Yannakakis, G. N., Hallam, J., and Lund, H. H., "Capturing Entertainment through Heart-rate Dynamics in the Playware Playground," in Proc. of the 5th International Conference on Entertainment Computing, Lecture Notes in Computer Science, vol. 4161, pp. 314-317, Cambridge, UK, Sept. 2006.
19. Yannakakis, G. N. and Hallam, J., "Entertainment Modeling in Physical Play through Physiology beyond Heart-Rate," in Proc. of the Int. Conf. on Affective Computing and Intelligent Interaction, Lecture Notes in Computer Science, vol. 4738, pp. 256-267, Lisbon, Portugal, Sept. 2007.
20. Yannakakis, G. N. and Hallam, J., "Feature Selection for Capturing the Experience of Fun," in Proc. of the AIIDE'07 Workshop on Optimizing Player Satisfaction, AAAI Press Technical Report WS-01-01, pp. 37-42, Stanford, June 2007.
21. Yildirim, S., Min, C.L., Sungbok, L., Potamianos, A., and Narayanan, S., "Detecting Politeness and frustration state of a child in a conversational computer game," in Proc. EUROSPEECH, Lisbon, Portugal, 2005.