A job interview simulation: Social cue-based interaction with a virtual character

Proceedings - SocialCom/PASSAT/BigData/EconCom/BioMedCom 2013

Volumn , Issue , 2013, Pages 220-227

  Baur, Tobias ^a   Damian, Ionut ^a   Gebhard, Patrick ^b   Porayska Pomsta, Kaéka ^c   André, Elisabeth ^a  

^a UNIVERSITY OF AUGSBURG   (Germany)

^b GERMAN RESEARCH CENTER FOR ARTIFICIAL INTELLIGENCE DFKI   (Germany)

^c UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

AUTOMATIC RECOGNITION; BEHAVIORAL PATTERNS; JOB INTERVIEWS; JOB SEEKERS; SIMULATION ENVIRONMENT; SOCIAL CUES; SOCIAL SIGNAL PROCESSING; VIRTUAL CHARACTER;

SIGNAL PROCESSING;

BEHAVIORAL RESEARCH;

EID: 84893607045     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SocialCom.2013.39     Document Type: Conference Paper

References (34)

1. R. MacDonald, "Disconnected youth? social exclusion, the underclass and economic marginality," Social Work and Society, vol. 6, no. 2, pp. 236-247, 2008.
2. T. Hammer, "Mental health and social exclusion among unemployed youth in scandinavia. a comparative study," Intl. Journal of Social Welfare, vol. 9, no. 1, pp. 53-63, 2000. [Online]. Available: http://dx.doi.org/10.1111/1468-2397.00108
3. R. D. Arvey and J. E. Campion, "The employment interview: A summary and review of recent research," Personnel Psychology, vol. 35, no. 2, pp. 281-322, 1982. [Online]. Available: http: //dx.doi.org/10.1111/j.1744-6570.1982. tb02197.x
4. J. Curhan and A. Pentland, "Thin slices of negotiation: predicting outcomes from conversational dynamics within the first 5 minutes," pp. 802-811, 2007.
5. N. Bianchi-Berthouze, "Understanding the role of body movement in player engagement," HumanComputer Interaction, vol. 28, no. 1, pp. 40-75, 2013. [Online]. Available: http://www.tandfonline.com/doi/abs/10.1080/07370024. 2012.688468
6. J. Greene and B. Burleson, Handbook of Communication and Social Interaction Skills, ser. LEA?s Communication Series. L. Erlbaum Associates, 2003. [Online]. Available: http://books.google.de/books?id=h3i-refbDKwC
7. H. Prendinger and M. Ishizuka, "The empathic companion: A character-based interface that addresses users? affective states," Applied Artificial Intelligence, vol. 19, no. 3-4, pp. 267-285, 2005. [Online]. Available: http://www.ingentaconnect.com/content/tandf/uaai/2005/00000019/ F0020003/art00004
8. B. Endrass, E. André, M. Rehm, and Y. Nakano, "Investigating culturerelated aspects of behavior for virtual characters," Autonomous Agents and Multi-Agent Systems, 2013.
9. D. R. Traum, D. DeVault, J. Lee, Z. Wang, and S. Marsella, "Incremental dialogue understanding and feedback for multiparty, multimodal conversation," in Intelligent Virtual Agents-12th International Conference, IVA 2012, Santa Cruz, CA, USA, September, 12-14, 2012. Proceedings, ser. Lecture Notes in Computer Science, Y. Nakano, M. Neff, A. Paiva, and M. A. Walker, Eds., vol. 7502. Springer, 2012, pp. 275-288.
10. S.-H. Kang, J. Gratch, C. L. Sidner, R. Artstein, L. Huang, and L.-P. Morency, "Towards building a virtual counselor: modeling nonverbal behavior during intimate self-disclosure," in International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2012, Valencia, Spain, June 4-8, 2012 (3 Volumes), W. van der Hoek, L. Padgham, V. Conitzer, and M. Winikoff, Eds. IFAAMAS, 2012, pp. 63-70.
11. A. Vinciarelli, M. Pantic, D. Heylen, C. Pelachaud, I. Poggi, F. D'Errico, and M. Schroeder, "Bridging the gap between social animal and unsocial machine: A survey of social signal processing," Affective Computing, IEEE Transactions on, vol. 3, no. 1, pp. 69-87, jan.-march 2012.
12. T. Vogt and E. Andre, "Comparing feature sets for acted and spontaneous speech in view of automatic emotion recognition," in Multimedia and Expo, 2005. ICME 2005. IEEE International Conference on, july 2005, pp. 474-477.
13. Z. Zeng, M. Pantic, G. Roisman, and T. Huang, "A survey of affect recognition methods: Audio, visual, and spontaneous expressions," Pattern Analysis and Machine Intelligence, IEEE Transactions on, vol. 31, no. 1, pp. 39-58, jan. 2009.
14. A. Kleinsmith and N. Bianchi-Berthouze, "Form as a cue in the automatic recognition of non-acted affective body expressions," in Proceedings of the 4th international conference on Affective computing and intelligent interaction-Volume Part I, ser. ACII'11. Berlin, Heidelberg: Springer-Verlag, 2011, pp. 155-164. [Online]. Available: http://dl.acm.org/ citation.cfm?id=2062780.2062801
15. A. Kapoor and R. W. Picard, "Multimodal affect recognition in learning environments," in Proceedings of the 13th annual ACM international conference on Multimedia, ser. MULTIMEDIA '05. New York, NY, USA: ACM, 2005, pp. 677-682. [Online]. Available: http://doi.acm.org/10.1145/1101149.1101300
16. A. Kleinsmith and N. Bianchi-Berthouze, "Affective body expression perception and recognition: A survey," IEEE Transactions on Affective Computing, vol. 4, no. 1, pp. 15-33, 2013.
17. S. D?Mello and J. Kory, "Consistent but modest: a meta-analysis on unimodal and multimodal affect detection accuracies from 30 studies," in Proceedings of the 14th ACM international conference on Multimodal interaction, ser. ICMI '12. New York, NY, USA: ACM, 2012, pp. 31-38. [Online]. Available: http://doi.acm.org/10.1145/2388676.2388686
18. S. Scherer, S. Marsella, G. Stratou, Y. Xu, F. Morbini, A. Egan, A. Rizzo, and L.-P. Morency, "Perception markup language: Towards a standardized representation of perceived nonverbal behaviors," in Intelligent Virtual Agents, ser. Lecture Notes in Computer Science, Y. Nakano, M. Neff, A. Paiva, and M. Walker, Eds. Springer Berlin Heidelberg, 2012, vol. 7502, pp. 455-463. [Online]. Available: http://dx.doi.org/10.1007/978-3-642- 33197-8 47
19. M. Schroder, E. Bevacqua, R. Cowie, F. Eyben, H. Gunes, D. Heylen, M. Termaat, G. McKeown, S. Pammi, M. Pantic, C. Pelachaud, B. Schuller, E. de Sevin, M. Valstar, and M. Wollmer, "Building autonomous sensitive artificial listeners," Affective Computing, IEEE Transactions on, vol. 3, no. 2, pp. 165-183, april-june 2012.
20. M. Cavazza, D. Pizzi, F. Charles, T. Vogt, and E. André, "Emotional input for character-based interactive storytelling," in Proc. 8th Intl. Conf. on Autonomous Agents and Multiagent Systems Vol1, ser. AAMAS '09. Richland, SC: International Foundation for Autonomous Agents and Multiagent Systems, 2009, pp. 313-320. [Online]. Available: http://dl.acm.org/ citation.cfm?id=1558013.1558056
21. R. Niewiadomski, J. Hofmann, J. Urbain, T. Platt, J. Wagner, B. Piot, H. Cakmak, S. Pammi, T. Baur, S. Dupont, M. Geist, F. Lingenfelser, G. McKeown, O. Pietquin, and W. Ruch, "Laugh-aware virtual agent and its impact on user amusement ," in Proceedings of the Twelfth International Conference on Autonomous Agents and Multiagent Systems (AAMAS2013), Saint Paul, USA, May 2013.
22. H. Sloetjes and P. Wittenburg, "Annotation by category: Elan and iso dcr." in LREC. European Language Resources Association, 2008. [Online]. Available: http://dblp.uni-trier.de/db/conf/lrec/lrec2008.html#SloetjesW08
23. A. Heloir and M. Kipp, "Real-time animation of interactive agents: Specification and realization," Applied Artificial Intelligence, vol. 24, no. 6, pp. 510-529, 2010.
24. M. Kipp, A. Heloir, M. Schröder, and P. Gebhard, "Realizing multimodal behavior: closing the gap between behavior planning and embodied agent presentation," in Proceedings of the 10th international conference on Intelligent virtual agents, ser. IVA'10. Berlin, Heidelberg: Springer-Verlag, 2010, pp. 57-63. [Online]. Available: http://dl.acm.org/citation.cfm?id=1889075. 1889083
25. P. Gebhard, G. Mehlmann, and M. Kipp, "Visual scenemaker-a tool for authoring interactive virtual characters," Journal on Multimodal User Interfaces, vol. 6, no. 1-2, pp. 3-11, 2012. [Online]. Available: http://dx.doi.org/10.1007/s12193-011-0077-1
26. J. Wagner, F. Lingenfelser, T. Baur, I. Damian, F. Kistler, and E. André, "The social signal interpretation (ssi) framework-multimodal signal processing and recognition in real-time," in Proceedings of ACM MULTIMEDIA 2013, Barcelona, 2013.
27. A. Pease and J. Kent, Body Language: How to Read Others? Thoughts by Their Gestures. Camel Pub., 1981. [Online]. Available: http://books.google.de/ books?id=\ EeFQgAACAAJ
28. F. Kistler, B. Endrass, I. Damian, C. T. Dang, and E. André, "Natural interaction with culturally adaptive virtual characters," Journal on Multimodal User Interfaces, vol. 6, pp. 39-47, 2012. [Online]. Available: http://dx.doi.org/10.1007/s12193-011-0087-z
29. C. Küblbeck and A. Ernst, "Face detection and tracking in video sequences using the modifiedcensus transformation," Image Vision Comput., vol. 24, no. 6, pp. 564-572, Jun. 2006. [Online]. Available: http://dx.doi.org/10.1016/j.imavis.2005.08.005
30. R. E. Kraut and R. E. Johnston, "Social and Emotional Messages of Smiling: An Ethological Approach," Journal of Personality and Social Psychology, vol. 37, no. 9, pp. 1539-1553, 1979.
31. J. Harrigan and K. Taing, "Fooled by a smile: Detecting anxiety in others," Journal of Nonverbal Behavior, vol. 21, no. 3, pp. 203-221, 1997. [Online]. Available: http://dx.doi.org/10.1023/A%3A1024921631009
32. G. Caridakis, A. Raouzaiou, K. Karapouzis, and S. Kollias, "Synthesizing gesture expressivity based on real sequences," Workshop on multimodal corpora: from multimodal behaviour theories to usable models, LREC Conference Genoa, Italy, Mai 2006.
33. H. Wallbott, "Bodily expression of emotion," European Journal of Social Psychology, no. 28, pp. 879-896, 1998.
34. B. Hartman, M. Mancini, and C. Pelachaud, "Implementing expressive gesture synthesis for embodied conversational agents," Gesture Workshop Vannes, 2005.