Embodied conversational agent-based kiosk for automated interviewing

Journal of Management Information Systems

Volumn 28, Issue 1, 2011, Pages 17-48

  Nunamaker Jr , Jay ^a   Derrick, Douglas ^b   Elkins, Aaron ^a   Burgoon, Judee ^a   Patton, Mark ^a  

^a UNIVERSITY OF ARIZONA   (United States)

^b UNIVERSITY OF NEBRASKA AT OMAHA   (United States)

Author keywords

Avatars; deception detection; embodied conversational agents; NeuroIS

Indexed keywords

AGENT BASED; AVATARS; DECEPTION DETECTION; EMBODIED AGENT; EMBODIED CONVERSATIONAL AGENT; ENVIRONMENTAL AWARENESS; ENVIRONMENTAL SENSOR; HETEROGENEOUS SENSORS; HUMAN BEHAVIORS; HUMAN PHYSIOLOGY; HUMAN STRESS; HUMAN-COMPUTER; NEUROIS; SINGLE SENSOR; VOCAL PITCHES;

ARTIFICIAL INTELLIGENCE; AUTOMATION; BEHAVIORAL RESEARCH; COGNITIVE SYSTEMS; GESTURE RECOGNITION; HUMAN COMPUTER INTERACTION; INFORMATION SYSTEMS; KNOWLEDGE MANAGEMENT; PHYSIOLOGY; SENSORS;

INTELLIGENT AGENTS;

EID: 80051709642     PISSN: 07421222     EISSN: None     Source Type: Journal    
DOI: 10.2753/MIS0742-1222280102     Document Type: Article

References (40)

1. Bachorowski, J.A., and Owren, M.J. Vocal expression of emotion: Acoustic properties of speech are associated with emotional intensity and context. Psychological Science, 6, 4 (1995), 219-224.
2. Beale, R., and Creed, C. Affective interaction: How emotional agents affect users. International Journal of Human-Computer Studies, 67, 9 (2009), 755-776.
3. Boersma, P. Accurate short-term analysis of the fundamental frequency and the harmonicsto-noise ratio of a sampled sound. In Proceedings of the Institute of Phonetic Sciences, University of Amsterdam, 1993, pp. 97-110.
4. Boersma, P.P.G. Praat, a system for doing phonetics by computer. Glot International, 5, 9-10 (2002), 341-345.
5. Clayes, E.L., and Anderson, A.H. Real faces and robot faces: The effects of representation on computer-mediated communication. International Journal of Human-Computer Studies, 65, 6 (2007), 480-496. (Pubitemid 46560412)
6. Cowell, A.J., and Stanney, K.M. Manipulation of non-verbal interaction style and demographic embodiment to increase anthropomorphic computer character credibility. International Journal of Human-Computer Studies, 62, 2 (2005), 281-306. (Pubitemid 40206248)
7. Cutrow, R.J. The objective use of multiple physiological indices in the detection of deception. Psychophysiology, 9, 6 (1972), 578-588.
8. Deng, Z.; Bailenson, J.; Lewis, J.P.; and Neumann, U. Perceiving visual emotions with speech. Paper presented at the Sixth International Conference on Intelligent Virtual Agents, Marina Del Rey, CA, August 21-23, 2006.
9. Derrick, D.C.; Elkins, A.C.; Burgoon, J.K.; Nunamaker, J.F.; and Zeng, D. Credibility assessment via heterogeneous sensors for border security. IEEE Intelligent Systems, 25 (May-June 2010), 41-49.
10. Dimoka, A.; Banker, R.D.; Benbasat, I.; Davis, F.D.; Dennis, A.R.; Gefen, D.; Gupta, A .; Ischebeck, A.; Kenning, P.; Mïller-Putz, G.; Pavlou, P.A.; Riedl, R.; Vom Brocke, J.; and Weber, B. On the use of neurophysiological tools in IS research: Developing a research agenda for NeuroIS. Working paper, Marketing Department, Fox School of Business, Temple University, Philadelphia, 2010.
11. Dionisio, D.P.; Granholm, E.; Hillix, W.A.; and Perrine, W.F. Differentiation of deception using pupillary responses as an index of cognitive processing. Psychophysiology, 38, 2 (2001), 205-211. (Pubitemid 32267763)
12. Elkins, A.C. Evaluating the credibility assessment capability of vocal analysis software. In R.H. Sprague (ed.), Proceedings of the 43rd Annual Hawaii International Conference on System Sciences. Los Alamitos, CA: IEEE Computer Society, 2010.
13. Elkins, A.C., and Burgoon, J.K. Validating vocal analysis software to assess credibility in interpersonal interaction: A multilevel factor analytic approach. Paper presented at the National Communication Association 96th Annual Convention, San Francisco, November 14-17, 2010.
14. Fukuda, K. Eye blinks: New indices for the detection of deception. International Journal of Psychophysiology, 40, 3 (2001), 239-245. (Pubitemid 32157074)
15. Gratch, J.; Rickel, J.; Andre, E.; Cassell, J.; Petajan, E.; and Badler, N. Creating interactive virtual humans: Some assembly required. IEEE Intelligent Systems, 17, 4 (2002), 54-63.
16. Gratch, J.; Okhmatovskaia, A.; Lamothe, F.; Marsella, S.; Morales, M.; van der Werf, R .; and Morency, L.-P. Virtual rapport. Paper presented at the Sixth International Conference on Intelligent Virtual Agents, Marina Del Rey, CA, August 21-23, 2006.
17. Juslin, P.N., and Laukka, P. Communication of emotions in vocal expression and music performance: Different channels, same code-Psychological Bulletin, 129, 5 (2003), 770-814. (Pubitemid 37394950)
18. Juslin, P.N., and Scherer, K.R. Vocal expression of affect. In J. Harrigan, R. R osenthal, and K. Scherer (eds.), The New Handbook of Methods in Nonverbal Behavior Research. New York: Oxford University Press, 2005, pp. 65-135.
19. Katsyri, J., and Sams, M. The effect of dynamics on identifying basic emotions from synthetic and natural faces. International Journal of Human-Computer Studies, 66, 4 (2008), 233-242. (Pubitemid 351726244)
20. Kenny, P.; Parsons, T.; Gratch, J.; and Rizzo, A. Evaluation of Justina: A virtual patient with PTSD. In H. Prendinger, J. Lester, and M. Ishizuka (eds.), Intelligent Virtual Agents. Berlin: Springer, 2008, pp. 394-408.
21. Kurohara, A.; Terai, K.; Takeuchi, H.; and Umezawa, A. Respiratory changes during detection of deception: Mechanisms underlying inhibitory breathing in response to critical questions. Japanese Journal of Physiological Psychology and Psychophysiology, 19, 2 (2001), 75-86.
22. Ladefoged, P. A Course in Phonetics. Boston: Wadsworth, 2001.
23. McBreen, H.M., and Jack, M.A. Evaluating humanoid synthetic agents in e-retail applications. IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans, 31, 5 (2001), 394-405. (Pubitemid 32992534)
24. Ohanian, R. Construction and validation of a scale to measure celebrity endorsers' perceived expertise, trustworthiness, and attractiveness. Journal of Advertising, 19, 3 (1990), 39-52.
25. Pandzic, I.S.; Ostermann, J.; and Millen, D. User evaluation: Synthetic talking faces for interactive services. Visual Computer, 15, 7 (1999), 330-340. (Pubitemid 30504265)
26. Patton, M.W. Decision support for rapid assessment of truth and deception using automated assessment technologies and kiosk based embodied conversational agents. Ph.D. dissertation, University of Arizona, Tucson, 2009.
27. Pavlidis, I.; Eberhardt, N.L.; and Levine, J.A. Human behaviour: Seeing through the face of deception. Nature, 415, 6867 (January 3, 2002), 35. (Pubitemid 34062437)
28. Prentice, D.A., and Carranza, E. What women and men should be, shouldn't be, are allowed to be, and don't have to be: The contents of prescriptive gender stereotypes. Psychology of Women Quarterly, 26, 4 (2002), 269-281.
29. Reysen, S. Construction of new scale: The Reysen likability scale. Social Behavior & Personality: An International Journal, 33, 2 (2005), 201-208.
30. Ridgeway, C.L. Cultural beliefs and the gendering of social relations. In C.L. Ridgeway (ed.), Framed by Gender: How Gender Inequality Persists in the Modern World. Oxford: Oxford University Press, 2009, pp. 56-92.
31. Ridgeway, C.L. Framed by Gender: How Gender Inequality Persists in the Modern World. Oxford: Oxford University Press, 2009.
32. Rosenberg-Kima, R.B.; Baylor, A.L.; Plant, E.A.; and Doerr, C.E. Interface agents as social models for female students: The effects of agent visual presence and appearance on female students' attitudes and beliefs. Computers in Human Behavior, 24, 6 (2008), 2741-2756.
33. Rummel, R.J. Applied Factor Analysis. Evanston, IL: Northwestern University Press, 1970.
34. Ryan, A.H., Jr.; Pavlidis, I.; Rohrbaugh, J.W.; Marchak, F.; and Kozel, F.A. Credibility Assessments: Operational Issues and Technology Impact for Law Enforcement Applications. Orlando, FL: SPIE, 2003, pp. 168-182.
35. Streeter, L.A.; Krauss, R.M.; Geller, V.; Olson, C.; and Apple, W. Pitch changes during attempted deception. Journal of Personality and Social Psychology, 35, 5 (1977), 345-350.
36. Titze, I.R., and Martin, D.W. Principles of voice production. Acoustical Society of America Journal, 104, 3 (1998), 1148.
37. Wooldridge, M. Intelligent Agents. Cambridge: MIT Press, 1999.
38. Wooldridge, M. An Introduction to Multiagent Systems. Torquay, UK: John Wiley & Sons, 2009.
39. Wooldridge, M., and Jennings, N.R. Intelligent agents: Theory and practice. Knowledge Engineering Review, 10, 2 (1995), 115-152.
40. Yumoto, E.; Gould, W.J.; and Baer, T. Harmonics-to-noise ratio as an index of the degree of hoarseness. Journal of the Acoustical Society of America, 71, 6 (1982), 1544-1550. (Pubitemid 12019689)