A crowdsourcing method to develop virtual human conversational agents

International Journal of Human Computer Studies

Volumn 70, Issue 4, 2012, Pages 301-319

  Rossen, Brent ^a   Lok, Benjamin ^a  

^a J Crayton Pruitt Family Department of Biomedical Engineering   (United States)

Author keywords

Agents and intelligent systems; Distributed knowledge acquisition; End user programming; Human centered computing; Virtual humans

Indexed keywords

AUTHORING TOOL; COLLABORATIVE DEVELOPMENT; COMPUTER SCIENTISTS; CONVERSATIONAL AGENTS; CROWDSOURCING; DISTRIBUTED KNOWLEDGE ACQUISITION; DOMAIN EXPERTS; DOMAIN KNOWLEDGE; END-USER PROGRAMMING; END-USERS; HUMAN-CENTERED COMPUTING; INTERPERSONAL SKILLS; KNOWLEDGE ENGINEERS; NATURAL LANGUAGES; STRUCTURED LEARNING; VIRTUAL HUMANS; VIRTUAL PATIENTS;

COMPUTER PROGRAMMING; COST ENGINEERING; INTELLIGENT SYSTEMS; MEDICINE; STUDENTS;

VIRTUAL REALITY;

EID: 84856765158     PISSN: 10715819     EISSN: 10959300     Source Type: Journal    
DOI: 10.1016/j.ijhcs.2011.11.004     Document Type: Article

References (44)

1. A. Aamodt, and E. Plaza Case-Based Reasoning: Foundational Issues, Methodological Variations, and System Approaches AI Communications 7 1994 39 59
2. M. Bearman, B. Cesnik, and M. Liddell Random comparison of 'virtual patient models in the context of teaching clinical communication skills Medical Education 35 2001 824 832 (Pubitemid 34212143)
3. N. Benedict Virtual Patients and Problem-Based Learning in Advanced Therapeutics American Journal of Pharmaceutical Education 74 2010 8
4. R.A. Bergin, and U.G.H. Fors Interactive simulated patient - an advanced tool for student-activated learning in medicine and healthcare Computers & Education 40 4 2003 361 376
5. J. Cassell Embodied conversational agents: representation and intelligence in user interfaces AI magazine 22 4 2001 67
6. F.D. Davis Perceived usefulness, perceived ease of use, and user acceptance of information technology MIS Quarterly 13 3 1989 319 340
7. Deladisma, A., Mack D., Bernard T., Oxendine C., Szlam S., Wagner P., Kruse E.J., Lok B. and Lind D.S. 2007. Virtual patients reduce anxiety and enhance learning when teaching medical student sexual-history taking skills. Association for Surgical Education 2007 Surgical Education Week.
8. Dickerson, R., Johnsen K., Raij A., Lok B., Hernandez J., Stevens A. and Lind D.S. (2005). Evaluating a script-based approach for simulating patientdoctor interaction SCS 2005 International Conference on Human-Computer Interface Advances for Modeling and Simulation: 7984.
9. Ellaway, R., and McGee, J.B., 2008. Virtual Patient Working Group from 〈http://www.medbiq.org/working-groups/virtual-patient/index.html〉.
10. L.H. Fall, N.B. Berman, S. Smith, C.B. White, J.C. Woodhead, and A.L. Olson Multi-institutional development and utilization of a computer-assisted learning program for the pediatrics clerkship: the CLIPP project Academic Medicine 80 9 2005 847
11. Noseworthy Foster, Lind Shah, Chuah Lok, and Rossen Evaluation of Medical Student Interaction with a Bipolar Virtual Patient Scenario Written by a Peer Support Specialist A Pilot Study 2010 ADMSEP. Jackson Hole WY
12. Freedman, J., Levin A., Westbrook C., Edwards-Daughtery P., Hurliman J., Taney, F., and Neal, J., 2010. Open Metaverse Foundation libopenmetaverse from 〈http://www.openmetaverse.org/〉.
13. J. Glass, E. Weinstein, S. Cyphers, J. Polifroni, G. Chung, and M. Nakano A framework for developing conversational user interfaces Computer-Aided Design of User Interfaces IV 2005 349 360
14. R. Hill, J. Gratch, S. Marsella, J. Rickel, W. Swartout, and D. Traum Virtual humans in the mission rehearsal exercise system Künstliche Intelligenz 4 03 2003 5 10
15. G. Huang, R. Reynolds, and C. Candler Virtual patient simulation at US and Canadian medical schools Academic Medicine 82 5 2007 446
16. R.C. Hubal, P.N. Kizakevich, C.I. Guinn, K.D. Merino, and S.L. West The virtual standardized patient. Simulated patient-practitioner dialog for patient interview training Studies in Health Technology and Informatics 70 2000 133 138
17. F. Iacobelli, and J. Cassell Ethnic identity and engagement in embodied conversational agents Intelligent Virtual Agents (IVA) 2007 Springer Paris, France
18. Jackson, J., 2010. USF Health Virtual Standardized Patient Simulation (Video) from 〈http://vimeo.com/16291272〉.
19. K. Johnsen Design and validation of a virtual human system for interpersonal skills education Computer Information Science and Engineering 2008 University of Florida. Doctor of Philosophy Gainesville, FL 146
20. K. Johnsen, A. Raij, A. Stevens, D.S. Lind, and B. Lok The Validity of a Virtual Human System for Interpersonal Skills Education 2007 ACM SIGCHI
21. P. Kenny, A. Hartholt, J. Gratch, W. Swartout, D. Traum, S. Marsella, and D. Piepol Building Interactive Virtual Humans for Training Environments 2007 ITSEC, NTSA
22. Kenny, P., Parsons T.D., Gratch J. and Rizzo A.A. 2008. Evaluation of Justina: A Virtual Patient with PTSD Intelligent Virtual Agents: 8th International Conference, IVA 2008, Tokyo, Japan, September 1-3, 2008, Proceedings.
23. Leuski, A., Patel R., Traum, D., and Kennedy, B., 2006. Building effective question answering characters Proceedings of the 7th SIGdial Workshop on Discourse and Dialogue.
24. Lidwell, W., Holden, K., and Butler, J., 2003. Universal Principles of Design, Rockport.
25. Nantha Surkunalingam, J.W., Christopher Taranto, Samantha McCaskill, Christopher Blanchard, D., Scott Lind, Benjamin Lok, Brent Rossen (2009). A study to investigate the efficacy of a novel interactive web-based Virtual clinical scenario system (Virtual People Factory) in medical education. American Osteopathic Association National Conference.
26. T.D. Parsons, P. Kenny, C.A. Ntuen, C.S. Pataki, M.T. Pato, A.A. Rizzo, C. St-George, and J. Sugar Objective structured clinicl interview training using a virtual human patient Studies in Health Technology and Informatics 132 2008 357
27. A. Raij, K. Johnsen, R. Dickerson, B. Lok, M. Cohen, A. Stevens, T. Bernard, C. Oxendine, P. Wagner, and D.S. Lind Comparing interpersonal interactions with a virtual human to those with a real human IEEE Transactions on Visualization and Computer Graphics 13 3 2007 443 457 (Pubitemid 46479763)
28. E. Reiter, S. Sripada, and R. Robertson Acquiring correct knowledge for natural language generation Journal of Artificial Intelligence Research 18 2003 491 516 (Pubitemid 41525943)
29. Rossen, B., 2010. MySQL Ajax Database Access Layer (MADAL) from 〈http://code.google.com/p/madal/〉.
30. Ruttkay, Z., Andre, E., Johnson, W.L., and Pelachaud, C., 2004. Evaluating Embodied Conversational Agents Evaluating Embodied Conversational Agents Volume, DOI
31. N. Saleh The value of virtual patients in medical education Annals of Behavioral Science and Medical Education 16 2 2010 29 31
32. H. Shah, B. Rossen, and A. Foster Interactive virtual patient scenarios: an evolving tool in psychiatric education Academic Psychiatry 2012 Accepted, Awaiting Publication
33. Shah, H., Rossen B., Lind, D., and Lok, B., 2009. Pilot study to evaluate the use of an online virtual patient system to teach interviewing skills to first-year medical students. National Conference of Family Medicine Residents and Medical Students. Kansas City.
34. E.H. Shortliffe Computer-Based Medical Consultations 1976 MYCIN New York
35. P. Singh, T. Lin, E.T. Mueller, G. Lim, T. Perkins, and W. Li Zhu Open mind common sense: knowledge acquisition from the general public On the Move to Meaningful Internet Systems 2002 2002 CoopIS, DOA, and ODBASE 1223-1237
36. M. Slater, D. Pertaub, and A. Steed Public speaking in virtual reality: facing an audience of avatars IEEE Computer Graphics and Applications 19 2 1999 6 9
37. D. Traum Talking to virtual humans: dialogue models and methodologies for embodied conversational agents Lecture Notes in Computer Science 4930 2008 296
38. Triola, M.M., Campion N., McGee J.B., Albright S., Greene P., Smothers V. and Ellaway R. 2007. An XML standard for virtual patients: exchanging case-based simulations in medical education. AMIA Annual Symposium, American Medical Informatics Association.
39. S. Ullrich, K. Bruegmann, H. Prendinger, and M. Ishizuka Extending MPML3D to Second Life Intelligent Virtual Agents. Tokyo, Japan 5208 2008 281 288
40. W.A. Villaume, B.A. Berger, and B.N. Barker Learning motivational interviewing: scripting a virtual patient American Journal of Pharmaceutical Education 70 2006 2
41. von Ahn, L. and Dabbish L. 2004. Labeling images with a computer game Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: 319326.
42. J. Westberg, and H. Jason Fostering Reflection and Providing Feedback 2001 Springer
43. M.J. Yedidia, and M. Lipkin Effect of communications training on medical student performance JAMA 290 2003 1157 1165 (Pubitemid 37430420)
44. Zanbaka, C.A., Ulinski, A.C., Goolkasian, P., and Hodges, L.F., 2007. Social responses to virtual humans: Implications for Future Interface Design Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: 15611570.