Interaction analysis of the ALICE chatterbot: A two-study investigation of dialog and domain questioning

IEEE Transactions on Systems, Man, and Cybernetics Part A:Systems and Humans

Volumn 40, Issue 1, 2010, Pages 40-51

  Schumaker, Robert P ^a,b   Chen, Hsinchun ^a  

^a UNIVERSITY OF ARIZONA   (United States)

^b IONA COLLEGE   (United States)

Author keywords

Artificial linguistic internet chat entity (ALICE); Chatterbot; Dialog platform; Domain specific knowledge; Evaluation; Knowledge delivery

Indexed keywords

CHATTERBOTS; DOMAIN-SPECIFIC KNOWLEDGE; EVALUATION; INTERNET CHAT; KNOWLEDGE DELIVERY;

LINGUISTICS;

INTERNET;

EID: 72949088640     PISSN: 10834427     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCA.2009.2029603     Document Type: Article

References (33)

1. R. S. Wallace, The Anatomy of A.L.I.C.E.. San Francisco, CA: A.L.I.C.E. Artif. Intell. Found., Inc., 2004.
2. R. S. Russell, Language Use, Personality and True Conversational Interfaces. Edinburgh, U.K.: Univ. Edinburgh, 2002.
3. R. S. Wallace, The Elements of AIML Style. San Francisco, CA: A.L.I.C.E. Artif. Intell. Found., Inc., 2003.
4. R. P. Schumaker, M. Ginsburg, H. Chen, and Y. Liu, "An evaluation of the chat and knowledge delivery components of a low-level dialog system: The AZ-ALICE experiment," Decis. Support Syst., vol.42, no.4, pp. 2236-2246, Jan. 2007.
5. M. Awad and L. Khan, "Web navigation prediction using multiple evidence combination and domain knowledge," IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol.37, no.6, pp. 1054-1062, Nov. 2007.
6. V. Shen and T. Juang, "Verification of knowledge-based systems using predicate/transition nets," IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol.38, no.1, pp. 78-87, Jan. 2008.
7. O. Ferret, B. Grau, M. Hurault-Plantet, G. Illouz, and C. Jacquemin, "Terminological variants for document selection and question/answer matching," in Proc. Assoc. Comput. Linguistics, Toulouse, France, 2001, pp. 1-8.
8. E. M. Voorhees and D. M. Tice, "Building a question answering test collection," in Proc. Annu. ACM Conf. Res. Develop. Inf. Retrieval, 2000, pp. 200-207.
9. M. A. Pasca and S. M. Harabagiu, "High performance question/ answering," in Proc. Annu. ACM Conf. Res. Develop. Inf. Retrieval, New Orleans, LA, 2001, pp. 366-374.
10. D. Vrajitoru, "Evolutionary sentence building for chatterbots," in Proc. GECCO, Chicago, IL, 2003, pp. 315-321.
11. D. Lenat, G. Miller, and T. Yokoi, "CYC, WordNet, and EDR: Critiques and responses," Commun. ACM, vol.38, no.11, pp. 45-48, Nov. 1995.
12. J. Kupiec, "MURAX: A robust linguistic approach for question answering using an on-line encyclopedia," in Proc. ACM-SIGIR, Pittsburgh, PA, 1993, pp. 181-190.
13. T. Winograd, "Five lectures on artificial intelligence," in Fundamental Studies in Computer Science, vol.5, A. Zampolli, Ed. Amsterdam, The Netherlands: North Holland, 1977, pp. 399-520.
14. W. A.Woods, "Lunar rocks in natural english: Explorations in natural language question answering," in Fundamental Studies in Computer Science, vol.5, A. Zampolli, Ed. Amsterdam, The Netherlands: North Holland, 1977, pp. 521-569.
15. S. Potter, "A survey of knowledge acquisition from natural language," TMA of Knowledge Acquisition from Natural Language, vol.2003, Edinburgh, U.K., 2001. [Online]. Available: http://www.aiai.ed.ac.uk/project/ akt/work/stephenp/TMA%20of%20KAfromNL.pdf
16. D. Moldovan, M. Pasca, S. Harabagiu, and M. Surdeanu, "Performance issues and error analysis in an open-domain question answering system," ACM Trans. Inf. Syst., vol.21, no.2, pp. 133-154, Apr. 2003.
17. J. L. Hutchens and M. D. Alder, "Introducing MegaHAL," in Proc. Human-Comput. Commun. Workshop, 1998, pp. 271-274.
18. J. S. Breese and D. Heckerman, "Decision-theoretic case-based reasoning," IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol.26, no.6, pp. 838-842, Nov. 1996.
19. R. Moore and G. Gibbs, Emile: Using a Chatbot Conversation to Enhance the Learning of Social Theory. Huddersfield, U.K.: Univ. Huddersfield, 2002.
20. J. Hammerton, M. Osbourne, S. Armstrong, and W. Daelemans, "Introduction to special issue on machine learning approaches to shallow parsing," J. Mach. Learn. Res., vol.2, pp. 551-558, 2002.
21. J. Jia, The Study of the Application of a Keywords-Based Chatbot System on the Teaching of Foreign Languages. Augsburg, Germany: Univ. Augsburg, 2002.
22. B. Reeves and C. Nass, The Media Equation: How People Treat Computers, Televisions and New Media Like Real People and Places. Cambridge, U.K.: Cambridge Univ. Press, 1996.
23. A. M. Pejtersen, "Semantic information retrieval," Commun. ACM, vol.41, no.4, pp. 90-92, Apr. 1998.
24. A. De Angeli, G. I. Johnson, and L. Coventry, "The unfriendly user: Exploring social reactions to chatterbots," in Proc. Int. Conf. Affective Human Factors Des., London, U.K., 2001, pp. 467-474.
25. S. Han and Y. Kim, "Intelligent dialogue system for plane Euclidean geometry learning," presented at the Int. Conf. Computers Education, Seoul, Korea, 2001.
26. R. P. Schumaker and H. Chen, "Leveraging question answer technology to address terrorism inquiry," Decis. Support Syst., vol.43, no.4, pp. 1419-1430, Aug. 2007.
27. M. Louwerse, A. Graesser, and A. Olney, "Etiquette for Human-Computer Work. Papers From the 2002 Fall Symposium," AAAI Press, Menlo Park, CA, pp. 71-76, 2002.
28. A. C. Graesser, N. K. Person, and D. Harter, "Teaching tactics and dialog in AutoTutor," Int. J. Artif. Intell. Educ., vol.12, pp. 257-279, 2001.
29. E. M. Voorhees, "Overview of the TREC 2001 question answering track," in Proc. Text REtrieval Conf., 2001, pp. 42-51.
30. E. M. Voorhees, "Overview of the TREC 2003 question answering track," in Proc. Text REtrieval Conf., 2003, pp. 54-68.
31. I. Zuckerman and E. Horvitz, "Using machine learning techniques to interpret WH-questions," in Proc. Assoc. Comput. Linguistics, Toulouse, France, 2001, pp. 547-554.
32. O. Uzuner, R. Davis, and B. Katz, "Using empirical methods for evaluating expression and content similarity," in Proc. 37th Annu. Hawaii Int. Conf. Syst. Sci., 2004, pp. 1-8.
33. A. F. Bissell, "Weighted cumulative sums for test analysis using word counts," J. R. Stat. Soc., A, vol.158, no.3, pp. 525-545, 1995.