The INTERSPEECH 2014 computational paralinguistics challenge: Cognitive & physical load

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH

Volumn , Issue , 2014, Pages 427-431

  Schuller, Björn ^a,b   Steidl, Stefan ^c   Batliner, Anton ^b,c   Epps, Julien ^d,e   Eyben, Florian ^b   Ringeval, Fabien ^b   Marchi, Erik ^b   Zhang, Yue ^b  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

^b TECHNICAL UNIVERSITY OF MUNICH   (Germany)

^c UNIVERSITY OF ERLANGEN NUREMBERG   (Germany)

^d UNIVERSITY OF NEW SOUTH WALES   (Australia)

^e CSIRO   (Australia)

Author keywords

Challenge; Cognitive load; Computational paralinguistics; Physical load

Indexed keywords

LINGUISTICS; SPEECH RECOGNITION;

AUTOMATIC RECOGNITION; BASELINE RESULTS; CHALLENGE; COGNITIVE LOADS; EXPERIMENTAL PROCEDURE; PARALINGUISTICS; PHYSICAL LOADS;

SPEECH COMMUNICATION;

EID: 84910048232     PISSN: 2308457X     EISSN: 19909772     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (28)

1. B. Schuller and A. Batliner, Computational Paralinguistics - Emotion, Affect, and Personality in Speech and Language Processing. Chichester, UK: Wiley, 2014.
2. B. Schuller, S. Steidl, A. Batliner, A. Vinciarelli, K. Scherer, F. Ringeval, M. Chetouani, F. Weninger, F. Eyben, E. Marchi, M. Mortillaro, H. Salamin, A. Polychroniou, F. Valente, and S. Kim, "The INTERSPEECH 2013 computational paralinguistics challenge: Social signals, conflict, emotion, autism, " in Proc. of Interspeech, Lyon, France, 2013, pp. 148-152.
3. T. F. Yap, "Speech production under cognitive load: Effects and classification, " Ph.D. dissertation, The University of New South Wales, Sydney, Australia, 2012.
4. A. Baddeley, "Working memory, " Science, vol. 255, no. 5044, pp. 556-559, 1992.
5. A. R. Conway, M. J. Kane, M. F. Bunting, D. Z. Hambrick, O. Wilhelm, and R. W. Engle, "Working memory span tasks: A methodological review and users guide, " Psychonomic Bulletin & Review, vol. 12, no. 5, pp. 769-786, 2005.
6. M. Daneman and P. A. Carpenter, "Individual differences in working memory and reading, " Journal of Verbal Learning and Verbal Behavior, vol. 19, no. 4, pp. 450-466, 1980.
7. N. Unsworth, R. P. Heitz, J. C. Schrock, and R. W. Engle, "An automated version of the operation span task, " Behavior Research Methods, vol. 37, no. 3, pp. 498-505, 2005.
8. F. G. Paas and J. J. Van Merrïenboer, "Instructional control of cognitive load in the training of complex cognitive tasks, " Educational Psychology Review, vol. 6, no. 4, pp. 351-371, 1994.
9. J. R. Stroop, "Studies of interference in serial verbal reactions." Journal of Experimental Psychology, vol. 18, no. 6, p. 643, 1935.
10. B. Yin, F. Chen, N. Ruiz, and E. Ambikairajah, "Speechbased cognitive load monitoring system, " in Proc. of ICASSP, 2008, pp. 2041-2044.
11. P. N. Le, E. Ambikairajah, J. Epps, V. Sethu, and E. H. Choi, "Investigation of spectral centroid features for cognitive load classification, " Speech Communication, vol. 53, no. 4, pp. 540-551, 2011.
12. F. Chen, N. Ruiz, E. Choi, J. Epps, M. A. Khawaja, R. Taib, B. Yin, and Y.Wang, "Multimodal behavior and interaction as indicators of cognitive load, " ACM Transactions on Interactive Intelligent Systems (TiiS), vol. 2, no. 4, p. 22, 2012.
13. S. Harada, J. Lester, K. Patel, T. Saponas, J. Fogarty, J. Landay, and J. Wobbrock, "Voicelabel: Using speech to label mobile sensor data, " in Proc. of the ACM International Conference on Multimodal Interfaces, ICMI, Chania, Greece, 2008.
14. J. H. L. Hansen and S. E. Bou-Ghazale, "Getting Started With SUSAS: A Speech Under Simulated And Actual Stress Database, " in Proc. of Eurospeech, Rhodes, Greece, 1997, pp. 1743-1746.
15. A. Stupakov, E. Hanusa, J. Bilmes, and D. Fox, "COSINE - A corpus of multi-party COnversational Speech In Noisy Environments, " in Proc. of ICASSP, Taipei, 2009, pp. 4153-4156.
16. B. Schuller, F. Friedmann, and F. Eyben, "The Munich biovoice corpus: Effects of physical exercising, heart rate, and skin conductance on human speech production, " in Proc. of LREC, Reykjavik, Iceland, 2014, to appear.
17. B. Schuller, F. Friedmann, and F. Eyben, "Automatic recognition of physiological parameters in the human voice: Heart rate and skin conductance, " in Proc. of ICASSP, Vancouver, Canada, 2013, pp. 7219- 7223.
18. R. Orlikoff and R. Baken, "The effect of the heartbeat on vocal fundamental frequency perturbation, " Journal of Speech, Language, and Hearing Research (JSLHR), vol. 32, pp. 576-582, 1989.
19. D. Skopin and S. Baglikov, "Heartbeat feature extraction from vowel speech signal using 2D spectrum representation, " in Proc. of the 4th International Conference on Information Technology (ICIT), Amman, Jordan, 2009, p. 6 pages.
20. A. Mesleh, D. Skopin, S. Baglikov, and A. Quteishat, "Heart rate extraction from vowel speech signals, " Journal of Computer Science and Technology, vol. 27, no. 6, pp. 1243-1251, 2012.
21. R. Croft, C. Gonsalvez, J. Gander, L. Lechem, and R. Barry, "Differential relations between heart rate and skin conductance, and public speaking anxiety, " Journal of Behavior Therapy and Experimental Psychiatry, vol. 35, no. 3, pp. 259-271, September 2004.
22. J. Zhang, J. Kalinowski, T. Saltuklaroglu, and D. Hudock, "Stuttered and fluent speakers' heart rate and skin conductance in response to fluent and stuttered speech, " International Journal of Language & Communication Disorders, vol. 45, no. 6, pp. 670-680, 2010.
23. H. Kurniawan, A. Maslov, and M. Pechenizkiy, "Stress detection from speech and galvanic skin response signals, " in Proc. of the 26th IEEE International Symposium on Computer-Based Medical Systems (CBMS), Porto, Portugal, 2013, pp. 209-214.
24. F. Eyben, M. Wöllmer, and B. Schuller, "openSMILE - The Munich versatile and fast open-source audio feature extractor, " in Proc. of the 18th ACM International Conference on Multimedia, MM 2010, Florence, Italy, 2010, pp. 1459-1462.
25. F. Eyben, F. Weninger, F. Groß, and B. Schuller, "Recent developments in opensmile, the Munich open-source multimedia feature extractor, " in Proc. of the 21st ACM International Conference on Multimedia, MM 2013, Barcelona, Spain, 2013, pp. 835-838.
26. F. Weninger, F. Eyben, B. W. Schuller, M. Mortillaro, and K. R. Scherer, "On the acoustics of emotion in audio: What speech, music and sound have in common, " Frontiers in Psychology, Emotion Science, Special Issue on Expression of emotion in music and vocal communication, vol. 4, no. Article ID 292, pp. 1-12, 2013.
27. B. Schuller, A. Batliner, S. Steidl, and D. Seppi, "Recognising realistic emotions and affect in speech: State of the art and lessons learnt from the first challenge, " Speech Communication, vol. 53, no. 9/10, pp. 1062-1087, 2011.
28. M. Hall, E. Frank, G. Holmes, B. Pfahringer, P. Reutemann, and I. Witten, "The WEKA data mining software: An update, " SIGKDD Explorations, vol. 11, 2009.