SimSensei kiosk: A virtual human interviewer for healthcare decision support

13th International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2014

Volumn 2, Issue , 2014, Pages 1061-1068

  DeVault, David ^a   Artstein, Ron ^a   Benn, Grace ^a   Dey, Teresa ^a   Fast, Ed ^a   Gainer, Alesia ^a   Georgila, Kallirroi ^a   Gratch, Jon ^a   Hartholt, Arno ^a   Lhommet, Margaux ^a   Lucas, Gale ^a   Marsella, Stacy ^a   Morbini, Fabrizio ^a   Nazarian, Angela ^a   Scherer, Stefan ^a   Stratou, Giota ^a   Suri, Apar ^a   Traum, David ^a   Wood, Rachel ^a   Xu, Yuyu ^a   Rizzo, Albert ^a,b   Morency, Louis Philippe ^a,b   more..

^a USC Institute for Creative Technologies ^*  (United States)

^b SimSensei Project   (United States)

Author keywords

Dialogue systems; Nonverbal behavior; Virtual humans

Indexed keywords

EID: 84906490421     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (37)

1. SUS: a "quick and dirty" usability scale. In P. W. Jordan, B. Thomas, B. A. Weerdmeester, and A. L. McClelland, editors, Usability Evaluation in Industry. Taylor and Francis.
2. S. Baccianella, A. Esuli, and F. Sebastiani. SentiWordNet 3.0: An enhanced lexical resource for sentiment analysis and opinion mining. In LREC, 2010.
3. T. Baltrusaitis, P. Robinson, and L. Morency. 3d constrained local model for rigid and non-rigid facial tracking. In CVPR, 2012 IEEE Conference, 2012.
4. T. Bickmore, A. Gruber, and R. Picard. Establishing the computer-patient working alliance in automated health behavior change interventions. Patient Education and Counseling, 59(1):21-30, Oct. 2005.
5. J. K. Burgoon, L. K. Guerrero, and K. Floyd. Nonverbal Communication. Allyn & Bacon, 2009.
6. J. F. Cohn, T. S. Kruez, I. Matthews, Y. Yang, M. H. Nguyen, M. T. Padilla, F. Zhou, and F. De la Torre. Detecting depression from facial actions and vocal prosody. In Affective Computing and Intelligent Interaction (ACII), September 2009.
7. D. DeVault, K. Georgila, R. Artstein, F. Morbini, D. Traum, S. Scherer, A. S. Rizzo, and L.-P. Morency. Verbal indicators of psychological distress in interactive dialogue with a virtual human. In Proceedings of SIGdial, 2013.
8. L. A. Fairbanks, M. T. McGuire, and C. J. Harris. Nonverbal interaction of patients and therapists during psychiatric interviews. Journal of Abnormal Psychology, 91(2):109-119, 1982.
9. J. Gratch, R. Artstein, G. Lucas, G. Stratou, S. Scherer, A. Nazarian, R. Wood, J. Boberg, D. DeVault, S. Marsella, D. Traum, S. Rizzo, and L.-P. Morency. The Distress Analysis Interview Corpus of human and computer interviews. In LREC 2014, to appear.
10. J. Gratch, L.-P. Morency, S. Scherer, G. Stratou, J. Boberg, S. Koenig, T. Adamson, A. Rizzo, et al. User-state sensing for virtual health agents and telehealth applications. Studies in health technology and informatics, 184:151-157, 2012.
11. J. Gratch, N. Wang, J. Gerten, E. Fast, and R. Duffy. Creating rapport with virtual agents. In Intelligent Virtual Agents, 2007.
12. J. A. Hall, J. A. Harrigan, and R. Rosenthal. Nonverbal behavior in clinician-patient interaction. Applied and Preventive Psychology, 4(1):21-37, 1995.
13. J. Hart, J. Gratch, and S. Marsella. How Virtual Reality Training Can Win Friends and Influence People, chapter 21, pages 235-249. Human Factors in Defence. Ashgate, 2013.
14. A. Hartholt, D. Traum, S. Marsella, A. Shapiro, G. Stratou, A. Leuski, L.-P. Morency, and J. Gratch. All together now, introducing the virtual human toolkit. In Intelligent Virtual Agents, 2013.
15. D. Huggins-Daines, M. Kumar, A. Chan, A. W. Black, M. Ravishankar, and A. I. Rudnicky. Pocketsphinx: A free, real-time continuous speech recognition system for hand-held devices. In Proceedings of ICASSP, 2006.
16. A. N. Joinson. Self-disclosure in computer-mediated communication: The role of self-awareness and visual anonymity. European Journal of Social Psychology, 31(2):177-192, 2001.
17. D. Jurafsky, E. Shriberg, and D. Biasca. Switchboard SWBD-DAMSL Shallow-Discourse-Function Annotation Coders Manual, Draft 13. 1997.
18. S.-H. Kang and J. Gratch. Socially anxious people reveal more personal information with virtual counselors that talk about themselves using intimate human back stories. In B. Wiederhold and G. Riva, editors, Annual Review of Cybertherapy and Telemedicine, pages 202-207. IOS Press, 2012.
19. A. Kirsch and S. Brunnhuber. Facial expression and experience of emotions in psychodynamic interviews with patients with PTSD in comparison to healthy subjects. Psychopathology, 40(5):296-302, 2007.
20. S. Kopp, B. Krenn, S. Marsella, A. Marshall, C. Pelachaud, H. Pirker, K. Thorisson, and H. Vilhjalmsson. Towards a common framework for multimodal generation: The behavior markup language. In Intelligent Virtual Agents, 2006.
21. C. Kublbeck and A. Ernst. Face detection and tracking in video sequences using the modifiedcensus transformation. Image and Vision Computing, 24(6):564-572, 2006.
22. M. Lhommet and S. C. Marsella. Gesture with meaning. In Intelligent Virtual Agents, 2013.
23. S. Marsella, Y. Xu, M. Lhommet, A. Feng, S. Scherer, and A. Shapiro. Virtual character performance from speech. In Proceedings of the Symposium on Computer Animation, Anaheim, 2013.
24. F. Morbini, D. DeVault, K. Sagae, J. Gerten, A. Nazarian, and D. Traum. FLoReS: A forward looking reward seeking dialogue manager. In Proceedings of IWSDS, 2012.
25. L.-P. Morency, J. Whitehill, and J. Movellan. Generalized adaptive view-based appearance model: Integrated framework for monocular head pose estimation. In The IEEE Conference on Automatic Face and Gesture Recognition, 2008.
26. J. E. Perez and R. E. Riggio. Nonverbal social skills and psychopathology, pages 17-44. Nonverbal behavior in clinical settings. Oxford University Press, 2003.
27. L. I. Reed, M. A. Sayette, and J. F. Cohn. Impact of Depression on Response to Comedy: A Dynamic Facial Coding Analysis. Journal of Abnormal Psychology, 116:804-809, 2007.
28. S. Rude, E.-M. Gortner, and J. Pennebaker. Language use of depressed and depression-vulnerable college students. Cognition & Emotion, 18(8), 2004.
29. S. Scherer, S. Marsella, G. Stratou, Y. Xu, F. Morbini, A. Egan, A. Rizzo, and L. P. Morency. Perception markup language: Towards a standardized representation of perceived nonverbal behaviors. In Intelligent Virtual Agents, 2012.
30. S. Scherer, G. Stratou, J. Gratch, and L.-P. Morency. Investigating voice quality as a speaker-independent indicator of depression and PTSD. In Proceedings of Interspeech 2013, pages 847-851. ISCA, 2013.
31. S. Scherer, G. Stratou, M. Mahmoud, J. Boberg, J. Gratch, A. Rizzo, and L.-P. Morency. Automatic behavior descriptors for psychological disorder analysis. In IEEE Conference on Automatic Face and Gesture Recognition, 2013.
32. S. Scherer, G. Stratou, and L.-P. Morency. Audiovisual behavior descriptors for depression assessment. In ICMI, 2013.
33. G. Stratou, S. Scherer, J. Gratch, and L.-P. Morency. Automatic nonverbal behavior indicators of depression and PTSD: Exploring gender differences. In Affective Computing and Intelligent Interaction (ACII), 2013.
34. M. Taboada, J. Brooke, M. Tofiloski, K. Voll, and M. Stede. Lexicon-based methods for sentiment analysis. Computational Linguistics, 37(2), June 2011.
35. M. Thiebaux, S. Marsella, A. N. Marshall, and M. Kallmann. SmartBody: behavior realization for embodied conversational agents. In AAMAS, 2008.
36. Z. Wang, J. Lee, and S. Marsella. Multi-party, multi-role comprehensive listening behavior. Autonomous Agents and Multi-Agent Systems, 27(2):218-234, Sept. 2013.
37. S. Weisband and S. Kiesler. Self-disclosure on computer forms: Meta analysis and implications. In CHI, Volume 96, pages 3-10, 1996.