Utilizing multimodal cues to automatically evaluate public speaking performance

2015 International Conference on Affective Computing and Intelligent Interaction, ACII 2015

Volumn , Issue , 2015, Pages 394-400

  Chen, Lei ^a   Leong, Chee Wee ^a   Feng, Gary ^a   Lee, Chong Min ^a   Somasundaran, Swapna ^a  

^a EDUCATIONAL TESTING SERVICE   (United States)

Author keywords

automated assessment; body language; facial expressions; motion tracking; public speaking

Indexed keywords

AUTOMATION; EMPLOYMENT; FACE RECOGNITION;

AUTOMATED ASSESSMENT; BODY LANGUAGE; FACIAL EXPRESSIONS; MOTION TRACKING; PUBLIC SPEAKING;

INTELLIGENT COMPUTING;

EID: 84964043677     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ACII.2015.7344601     Document Type: Conference Paper

References (34)

1. P. C. Kyllonen, "Measurement of 21st century skills within the common core state standards," in Invitational Research Symposium on Technology Enhanced Assessments. May, 2012, pp. 7-8.
2. A. Porter, J. McMaken, J. Hwang, and R. Yang, "Common core standards the new us intended curriculum," Educational Researcher, vol. 40, no. 3, pp. 103-116, 2011.
3. R. L. Quianthy, Communication is life: Essential college sophomore speaking and listening competencies. Speech Communication Association, 1990.
4. S. P. Morreale, M. R. Moore, D. Surges-Tatum, and L. Webster, "The competent speaker" speech evaluation form (2nd ed.). National Communication Association, 2007.
5. L. M. Schreiber, G. D. Paul, and L. R. Shibley, "The development and test of the public speaking competence rubric," Communication Education, vol. 61, no. 3, pp. 205-233, 2012.
6. R. Bennett, "Moving the field forward: Some thoughts on validity and automated scoring," Automated scoring of complex tasks in computerbased testing, pp. 403-412, 2006.
7. T. Pfister and P. Robinson, "Real-time recognition of affective states from nonverbal features of speech and its application for public speaking skill analysis," Affective Computing, IEEE Transactions on, vol. 2, no. 2, pp. 66-78, 2011.
8. T. Giraud, M. Soury, J. Hua, A. Delaborde, M. Tahon, G. Antonio, V. Eyharabide, E. Filaire, C. L. Scanff, L. Devillers, and others, "Multimodal expressions of stress during a public speaking task: Collection, annotation and global analyses," in Affective Computing and Intelligent Interaction (ACII), 2013 Humaine Association Conference on. IEEE, 2013, pp. 417-422.
9. K. Kurihara, M. Goto, J. Ogata, Y. Matsusaka, and T. Igarashi, "Presentation sensei: a presentation training system using speech and image processing," in Proceedings of the 9th international conference on Multimodal interfaces. ACM, 2007, pp. 358-365.
10. Z. Zhang, "Microsoft kinect sensor and its effect," Multimedia, IEEE, vol. 19, no. 2, pp. 4-10, 2012.
11. A.-T. Nguyen, W. Chen, and M. Rauterberg, "Online feedback system for public speakers," in IEEE Symp. e-Learning, e-Management and e-Services. Citeseer, 2012.
12. L. Batrinca, G. Stratou, A. Shapiro, L.-P. Morency, and S. Scherer, "Cicero-towards a multimodal virtual audience platform for public speaking training," in Intelligent Virtual Agents, 2013, pp. 116-128.
13. L. Chen, G. Feng, J. Joe, C. W. Leong, C. Kitchen, and C. M. Lee, "Towards automated assessment of public speaking skills using multimodal cues," in Proceedings of the 16th International Conference on Multimodal Interaction. ACM, 2014, pp. 200-203.
14. X. Ochoa, M. Worsley, K. Chiluiza, and S. Luz, "MLA'14: Third multimodal learning analytics workshop and grand challenges," in Proceedings of the 16th International Conference on Multimodal Interaction. ACM, 2014, pp. 531-532.
15. S. Scherer, G. Stratou, and L.-P. Morency, "Audiovisual behavior descriptors for depression assessment," in Proceedings of the 15th ACM on International conference on multimodal interaction. ACM, 2013, pp. 135-140.
16. ESPOL, "Description of the oral presentation quality corpus," http:// www.sigmla.org/datasets/, 2014.
17. R. J. Mislevy and G. D. Haertel, "Implications of evidence-centered design for educational testing," Educational Measurement: Issues and Practice, vol. 25, no. 4, pp. 6-20, 2006.
18. J. Joe, C. Kitchen, L. Chen, and G. Feng, "A prototype public speaking skills assessment: An evaluation of human scoring quality," ETS Research Report, in press.
19. R. Niewiadomski, M. Mancini, and S. Piana, "Human and virtual agent expressive gesture quality analysis and synthesis," Coverbal Synchrony in Human-Machine Interaction, pp. 269-292.
20. D. Glowinski, N. Dael, A. Camurri, G. Volpe, M. Mortillaro, and K. Scherer, "Toward a minimal representation of affective gestures," Affective Computing, IEEE Transactions on, vol. 2, no. 2, pp. 106-118, 2011.
21. S. Plagenhoef, F. G. Evans, and T. Abdelnour, "Anatomical data for analyzing human motion," Sport, vol. 54, pp. 169-178, 1983.
22. T. Wilson, J. Wiebe, and P. Hoffmann, "Recognizing contextual polarity in phrase-level sentiment analysis," in Proceedings of the conference on human language technology and empirical methods in natural language processing. Association for Computational Linguistics, 2005, pp. 347-354.
23. B. Beigman Klebanov, J. Burstein, and N. Madnani, "Sentiment profiles of multi-word expressions in test-taker essays: The case of noun-noun compounds," in ACM Transactions on Speech and Language Processing, vol. 10(3), no. 3, 2013.
24. T. Brants and A. Franz, "Web 1T 5-gram Version 1," in Linguistic Data Consortium, Philadelphia, 2006.
25. S. Somasundaran, C. M. Lee, M. Chodorow, and X. Wang, "Automated scoring of picture-based story narration," in Proceedings of the 10th Workshop on Innovative Use of NLP for Building Educational Applications, 2015, pp. 42-48.
26. S. M. Witt, "Use of speech recognition in computer-assisted language learning," Ph.D. dissertation, University of Cambridge, 1999.
27. H. Franco, H. Bratt, R. Rossier, V. R. Gadde, E. Shriberg, V. Abrash, and K. Precoda, "EduSpeak: a speech recognition and pronunciation scoring toolkit for computer-aided language learning applications," Language Testing, vol. 27, no. 3, p. 401, 2010.
28. K. Zechner, D. Higgins, X. Xi, and D. M. Williamson, "Automatic scoring of non-native spontaneous speech in tests of spoken english," Speech Communication, vol. 51, no. 10, pp. 883-895, 2009.
29. J. Bernstein, A. V. Moere, and J. Cheng, "Validating automated speaking tests," Language Testing, vol. 27, no. 3, p. 355, 2010.
30. R. Downey, D. Rubin, J. Cheng, and J. Bernstein, "Performance of automated scoring for children's oral reading," in Proceedings of the 6th Workshop on Innovative Use of NLP for Building Educational Applications. Association for Computational Linguistics, 2011, pp. 46-55.
31. L. Chen, K. Zechner, and X. Xi, "Improved pronunciation features for construct-driven assessment of non-native spontaneous speech," in NAACL-HLT, 2009.
32. M. Kuhn, "Building predictive models in R using the caret package," Journal of Statistical Software, vol. 28, no. 5, pp. 1-26, 2008.
33. E. Dimitriadou, K. Hornik, F. Leisch, D. Meyer, and A. Weingessel, "Misc functions of the Department of Statistics (e1071), TU Wien," R package, pp. 1-5, 2008.
34. J. Friedman, T. Hastie, and R. Tibshirani, "glmnet: Lasso and elastic-net regularized generalized linear models," R package version, vol. 1, 2009.