Multimodal public speaking performance assessment

ICMI 2015 - Proceedings of the 2015 ACM International Conference on Multimodal Interaction

Volumn , Issue , 2015, Pages 43-50

  Wörtwein, Torsten ^a   Morency, Louis Philippe ^b   Chollet, Mathieu ^c   Stiefelhagen, Rainer ^a   Schauerte, Boris ^a   Scherer, Stefan ^c  

^a KARLSRUHE INSTITUTE OF TECHNOLOGY   (Germany)

^b CARNEGIE MELLON UNIVERSITY   (United States)

^c UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

Machine learning; Nonverbal behavior; Public speaking; Virtual human interaction

Indexed keywords

ACTINIDES; ARTIFICIAL INTELLIGENCE; INTERACTIVE COMPUTER SYSTEMS; LEARNING SYSTEMS; VIRTUAL REALITY;

AUTOMATIC ASSESSMENT; INTERACTIVE ENVIRONMENTS; MULTI-MODAL APPROACH; NONVERBAL BEHAVIOR; OVERALL PERFORMANCE ASSESSMENTS; PERFORMANCE ASSESSMENT; PUBLIC SPEAKING; VIRTUAL HUMANS;

PERSONNEL TRAINING;

EID: 84959304372     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2818346.2820762     Document Type: Conference Paper

References (31)

1. P. Alku, T. Bäckström, and E. Vilkman. Normalized amplitude quotient for parameterization of the glottal flow. Journal of the Acoustical Society of America, 112(2):701-710, 2002.
2. K. Anderson and et al. The TARDIS framework: Intelligent virtual agents for social coaching in job interviews. In Proceedings of International Conference on Advances in Computer Entertainment, pages 476-491, 2013.
3. T. Baltrusaitis, P. Robinson, and L.-P. Morency. Constrained local neural fields for robust facial landmark detection in the wild. In International Conference on Computer Vision Workshops, pages 354-361, 2013.
4. L. Batrinca, G. Stratou, A. Shapiro, L.-P. Morency, and S. Scherer. Cicero - towards a multimodal virtual audience platform for public speaking training. In Proceedings of Intelligent Virtual Agents 2013, pages 116-128. Springer, 2013.
5. M. Chollet, G. Stratou, A. Shapiro, L.-P. Morency, and S. Scherer. An interactive virtual audience platform for public speaking training. In Proceedings of International Conference on Autonomous Agents and Multiagent Systems, pages 1657-1658, 2014.
6. G. Degottex, J. Kane, T. Drugman, T. Raitio, and S. Scherer. Covarep - a collaborative voice analysis repository for speech technologies. In Proceedings of International Conference on Acoustics, Speech and Signal Processing, pages 960-964, 2014.
7. D. DeVault and et al. Simsensei kiosk: A virtual human interviewer for healthcare decision support. In Proceedings of Autonomous Agents and Multiagent Systems, pages 1061-1068, 2014.
8. M. R. DiMatteo, R. D. Hays, and L. M. Prince. Relationship of physicians' nonverbal communication skill to patient satisfaction, appointment noncompliance, and physician workload. Health Psychology, 5(6):581, 1986.
9. T. Drugman and A. Abeer. Joint robust voicing detection and pitch estimation based on residual harmonics. In Proceedings of Interspeech 2011, pages 1973-1976, 2011.
10. Emotient. FACET SDK, 2014. http://www.emotient.com/products.
11. G. Fant, J. Liljencrants, and Q. Lin. The LF-model revisited. transformations and frequency domain analysis. Speech Transmission Laboratory, Quarterly Report, Royal Institute of Technology, 2(1):119-156, 1995.
12. J. Hart, J. Gratch, and S. Marsella. How Virtual Reality Training Can Win Friends and Influence People, chapter 21, pages 235-249. Human Factors in Defence. Ashgate, 2013.
13. L. V. Hedges. Distribution theory for glass's estimator of effect size and related estimators. Journal of Educational Statistics, 6(2):107-128, 1981.
14. M. Hoque, M. Courgeon, J.-C. Martin, M. Bilge, and R. Picard. Mach: My automated conversation coach. In Proceedings of International Joint Conference on Pervasive and Ubiquitous Computing, 2013.
15. W. L. Johnson, J. W. Rickel, and J. C. Lester. Animated pedagogical agents: Face-to-face interaction in interactive learning environments. International Journal of Artificial Intelligence in Education, 11(1):47-78, 2000.
16. J. Kane and C. Gobl. Identifying regions of non-modal phonation using features of the wavelet transform. In Proceedings of Interspeech 2011, pages 177-180, 2011.
17. J. Kane and C. Gobl. Wavelet maxima dispersion for breathy to tense voice discrimination. Audio, Speech, and Language Processing, IEEE Transactions on, 21(6):1170-1179, 2013.
18. H. C. Lane, M. J. Hays, M. G. Core, and D. Auerbach. Learning intercultural communication skills with virtual humans: Feedback and fidelity. Journal of Educational Psychology Special Issue on Advanced Learning Technologies, 105(4):1026-1035, 2013.
19. S. Lao and M. Kawade. Vision-based face understanding technologies and their applications. In Proceedings of the Conference on Advances in Biometric Person Authentication, pages 339-348, 2004.
20. D. D. Mehta, D. Rudoy, and P. J. Wolfe. KARMA: Kalman-based autoregressive moving average modeling and inference for formant and antiformant tracking. Journal of the Acoustical Society of America, 132(3):1732-1746, 2011.
21. L. S. Nguyen, A. Marcos-Ramiro, M. Marrón Romera, and D. Gatica-Perez. Multimodal analysis of body communication cues in employment interviews. In Proceedings of the International Conference on Multimodal Interaction, pages 437-444, 2013.
22. S. Park, P. Shoemark, and L.-P. Morency. Toward crowdsourcing micro-level behavior annotations: the challenges of interface, training, and generalization. In Proceedings of the 18th International Conference on Intelligent User Interfaces, pages 37-46. ACM, 2014.
23. D.-P. Pertaub, M. Slater, and C. Barker. An experiment on public speaking anxiety in response to three different types of virtual audience. Presence: Teleoperators and Virtual Environments, 11(1):68-78, 2002.
24. A. Rosenberg and J. Hirschberg. Acoustic/prosodic and lexical correlates of charismatic speech. In Proceedings of Interspeech 2005, pages 513-516, 2005.
25. J. Rowe, L. Shores, B. Mott, and J. C. Lester. Integrating learning and engagement in narrative-centered learning environments. In Proceedings of the Tenth International Conference on Intelligent Tutoring Systems, 2010.
26. S. Scherer, G. Layher, J. Kane, H. Neumann, and N. Campbell. An audiovisual political speech analysis incorporating eye-tracking and perception data. In Proceedings of the Eight International Conference on Language Resources and Evaluation, pages 1114-1120. ELRA, 2012.
27. L. M. Schreiber, D. P. Gregory, and L. R. Shibley. The development and test of the public speaking competence rubric. Communication Education, 61(3):205-233, 2012.
28. H. Sloetjes and P. Wittenburg. Annotation by category: ELAN and ISO DCR. In Proceedings of the International Conference on Language Resources and Evaluation, 2008.
29. E. Strangert and J. Gustafson. What makes a good speaker? subject ratings, acoustic measurements and perceptual evaluations. In Proceedings of Interspeech 2008, pages 1688-1691, 2008.
30. W. Swartout, R. Artstein, E. Forbell, S. Foutz, H. C. Lane, B. Lange, J. Morie, A. Rizzo, and D. Traum. Virtual humans for learning. AI Magazine, 34(4):13-30, 2013.
31. I. Titze and J. Sundberg. Vocal intensity in speakers and singers. Journal of the Acoustical Society of America, 91(5):2936-2946, 1992.