Augmenting social interactions: Realtime behavioural feedback using social signal processing techniques

Conference on Human Factors in Computing Systems - Proceedings

Volumn 2015-April, Issue , 2015, Pages 565-574

  Damian, Ionut ^a   Tan, Chiew Seng Sean ^b   Baur, Tobias ^a   Schöning, Johannes ^b   Luyten, Kris ^b   André, Elisabeth ^a  

^a UNIVERSITY OF AUGSBURG   (Germany)

^b HASSELT UNIVERSITY   (Belgium)

Author keywords

Behaviour analysis; Computer enhanced interaction; Peripheral feedback; Social signal processing

Indexed keywords

BEHAVIORAL RESEARCH; COMPUTER PERIPHERAL EQUIPMENT; HELMET MOUNTED DISPLAYS; HUMAN COMPUTER INTERACTION; HUMAN ENGINEERING; SOCIAL SCIENCES; VISUAL COMMUNICATION; WEARABLE TECHNOLOGY;

BEHAVIOUR ANALYSIS; HEAD MOUNTED DISPLAYS; HUMAN-HUMAN INTERACTIONS; NON-VERBAL BEHAVIOURS; REAL-TIME FEEDBACK; SOCIAL INTERACTIONS; SOCIAL SIGNAL PROCESSING; VISUAL FEEDBACK;

SIGNAL PROCESSING;

EID: 84951118917     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2702123.2702314     Document Type: Conference Paper

References (38)

1. Batrinca, L., Stratou, G., Shapiro, A., Morency, L.-P., and Scherer, S. Cicero - Towards a multimodal virtual audience platform for public speaking training. In Proc. IVA, vol. 8108. Springer, 2013, 116-128.
2. Baur, T., Damian, I., Gebhard, P., Porayska-Pomsta, K., and Andŕe, E. A job interview simulation: Social cue-based interaction with a virtual character. In Proc. SocialCom. IEEE, 2013, 220-227.
3. Baur, T., Damian, I., Lingenfelser, F., Wagner, J., and Andŕe, E. Nova: Automated analysis of nonverbal signals in social interactions. In Human Behavior Understanding, vol. 8212 of LNCS. Springer, 2013.
4. Bertin, J. Semiology of graphics: Diagrams, networks, maps. University of Wisconsin press, 1983.
5. Birdwhistell, R. L. Kinesics and context: Essays on body motion communication. University of Pennsylvania press, 2011.
6. Blanch, D. C., Hall, J. A., Roter, D. L., and Frankel, R. M. Is it good to express uncertainty to a patient? correlates and consequences for medical students in a standardized patient visit. In Proc. EACH, vol. 76 (2009), 300 - 306.
7. Caridakis, G., Raouzaiou, A., Karpouzis, K., and Kollias, S. Synthesizing gesture expressivity based on real sequences. Multimodal Corpora (2006).
8. Carl, H. Nonverbal communication during the employment interview. ABCA Bulletin 44, 4 (1980).
9. Cohen, B. M., and Etheredge, J. M. Recruiting's main ingredient. Journal of College Placement (1975).
10. de Jong, N. H., and Wempe, T. Praat script to detect syllable nuclei and measure speech rate automatically. Behavior Research Methods 41, 2 (2009), 385-390.
11. DeVaul, R. W., Pentland, A. S., and Corey, V. R. The memory glasses: Subliminal vs. overt memory support with imperfect information. In Proc. ISWC (2003).
12. Drake, L. R., et al. How do employers value the interview?. Journal of College Placement 32, 3 (1972).
13. Engelbart, D. C. Augmenting human intellect: A conceptual framework. Air Force Office of Scientific Research, AFOSR-3233, 1962.
14. Fukumoto, K., Terada, T., and Tsukamoto, M. A smile/laughter recognition mechanism for smile-based life logging. In Proc. AH, ACM (2013), 213-220.
15. Gabbard, J. L., Swan, J. E., Zedlitz, J., and Winchester, W. W. More than meets the eye: An engineering study to empirically examine the blending of real and virtual color spaces. In Proc. VR, IEEE (2010), 79-86.
16. Hill J, R. W., Gratch, J., Marsella, S., Rickel, J., Swartout, W. R., and Traum, D. R. Virtual humans in the mission rehearsal exercise system. KI 17, 4 (2003), 5.
17. Hogan, K. Can't Get Through: Eight Barriers to Communication. Pelican Publishing, 2003.
18. Hollandsworth, J. G., Kazelskis, R., Stevens, J., and Dressel, M. E. Relative contributions of verbal, articulative, and nonverbal communication to employment decisions in the job interview setting. Personnel Psychology 32, 2 (1979), 359-367.
19. Hoque, M. E., Courgeon, M., Martin, J., Mutlu, B., and Picard, R. W. Mach: My automated conversation coach. In Proc. UbiComp (2013).
20. Hwang, I., Yoo, C., Hwang, C., Yim, D., Lee, Y., Min, C., Kim, J., and Song, J. Talkbetter: Family-driven mobile intervention care for children with language delay. In Proc. CSCW, ACM (2014), 1283-1296.
21. Kim, T., Chang, A., Holland, L., and Pentland, A. S. Meeting mediator: Enhancing group collaborationusing sociometric feedback. In Proc. CSCW, ACM (2008).
22. Lee, Y., Min, C., Hwang, C., Lee, J., Hwang, I., Ju, Y., Yoo, C., Moon, M., Lee, U., and Song, J. Sociophone: Everyday face-to-face interaction monitoring platform using multi-phone sensor fusion. In Proc. MobiSys, ACM (2013), 375-388.
23. Li, X., and Rekimoto, J. Smartvoice: A presentation support system for overcoming the language barrier. In Proc. CHI, ACM (2014), 1563-1570.
24. Lu, H., Frauendorfer, D., Rabbi, M., Mast, M. S., Chittaranjan, G. T., Campbell, A. T., Gatica-Perez, D., and Choudhury, T. Stresssense: Detecting stress in unconstrained acoustic environments using smartphones. In Proc. UbiComp, ACM (2012), 351-360.
25. McAtamney, G., and Parker, C. An examination of the effects of a wearable display on informal face-to-face communication. In Proc. CHI, ACM (2006), 45-54.
26. Mehrabian, A. Silent messages: Implicit Communication of Emotions and Attitudes. Wadsworth Publishing Co Inc, Belmont, 1981.
27. Ofek, E., Iqbal, S. T., and Strauss, K. Reducing disruption from subtle information delivery during a conversation: Mode and bandwidth investigation. In Proc. CHI, ACM (2013), 3111-3120.
28. Pan, X., Gillies, M., Barker, Clark, D. M. C. M., and Slater, M. Socially anxious and confident men interact with a forward virtual woman: An experiment study. PLoS ONE 7, 4 (2012), e32931.
29. Pease, A. Body Language. Sheldon Press, London, 1988.
30. Posthuma, R. A., Morgeson, F. P., and Campion, M. A. Beyond employment interview validity: A comprehensive narrative review of recent research and trends over time. Personnel Psychology 55, 1 (2002).
31. Saket, B., Yang, S., Tan, H., Yatani, K., and Edge, D. Talkzones: Section-based time support for presentations. In Proc. MobileHCI, ACM (2014), 263-272.
32. Scherl, C. R., and Haley, J. Computer monitor supervision: A clinical note. The American Journal of Family Therapy 28, 3 (2000), 275-282.
33. Sieverding, M. be cool!: Emotional costs of hiding feelings in a job interview. International Journal of Selection and Assessment 17, 4 (2009), 391-401.
34. Szczerba, J., Hersberger, R., and Riegelman, A. Design and evaluation of a differential speedometer. In Proc. HFES Meeting, vol. 56 (2012), 1629-1633.
35. Tan, C. S. S., Schöning, J., Luyten, K., and Coninx, K. Investigating the effects of using biofeedback as visual stress indicator during video-mediated collaboration. In Proc. CHI, ACM (2014), 71-80.
36. van der Linden, J., Johnson, R., Bird, J., Rogers, Y., and Schoonderwaldt, E. Buzzing to play: Lessons learned from an in the wild study of real-time vibrotactile feedback. In Proc. CHI, ACM (2011), 533-542.
37. Wagner, J., Lingenfelser, F., Baur, T., Damian, I., Kistler, F., and Andŕe, E. The social signal interpretation (ssi) framework - Multimodal signal processing and recognition in real-time. In Proc. ACM MM (2013).
38. Xia, C., and Maes, P. The design of artifacts for augmenting intellect. In Proc. AH, ACM (2013).