Combining verbal and nonverbal features to overcome the'information gap' in task-oriented dialogue

SIGDIAL 2012 - 13th Annual Meeting of the Special Interest Group on Discourse and Dialogue, Proceedings of the Conference

Volumn , Issue , 2012, Pages 247-256

  Ha, Eun Young ^a   Grafsgaard, Joseph F ^a   Mitchell, Christopher M ^a   Boyer, Kristy Elizabeth ^a   Lester, James C ^a  

^a North Carolina State University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE;

DIALOGUE ACTS; INFORMATION GAP; MISSING INFORMATION; NON-VERBAL FEATURES; TASK-ORIENTED;

LEARNING SYSTEMS;

EID: 84988005800     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (27)

1. Bangalore, S., Di Fabbrizio, G., & Stent, A. (2008).Learning the structure of task-driven human-humandialogs. IEEE Transactions on Audio, Speech, andLanguage Processing, 16(7), 1249-1259.
2. Boyer, K. E., Grafsgaard, J. F., Ha, E. Y., Phillips, R., &Lester, J. C. (2011). An affect-enriched dialogue actclassification model for task-oriented dialogue. Proceedings of the 49th Annual Meeting of theAssociation for Computational Linguistics: HumanLanguage Technologies (pp. 1190-1199). Portland,OR.
3. Boyer, K. E., Ha, E. Y., Phillips, R., Wallis, M. D.,Vouk, M. A., & Lester, J. C. (2010a). Dialogue ActModeling in a Complex Task-Oriented Domain. Proceedings of the 11th Annual SIGDIAL Meeting onDiscourse and Dialogue (pp. 297-305). Tokyo,Japan.
4. Boyer, K. E., Phillips, R., Ingram, A., Ha, E. Y., Wallis,M., Vouk, M., & Lester, J. (2010b). Characterizingthe effectiveness of tutorial dialogue with hiddenmarkov models. Proceedings of the 10thinternational conference on Intelligent TutoringSystems (pp. 55-64). Pittsburgh, PA.
5. Carletta, J., Isard, A., Isard, S., Kowtko, J., Doherty-Sneddon, G., & Anderson, A. (1997). The reliabilityof a dialogue structure coding scheme. Computational Linguistics, 23, 13-31
6. Cavicchio, F. (2009). The modulation of cooperationand emotion in dialogue: The REC corpus.Proceedings of the ACL-IJCNLP 2009 StudentResearch Workshop (pp. 81-87). Suntec, Singapore.
7. Cohen, J. (1960). A coefficient of agreement fornominal scales. Educational and PsychologicalMeasurement, 20(1), 37-46.
8. Di Eugenio, B., Xie, Z., & Serafin, R. (2010). Dialogueact classification, instance-based learning, and higherorder dialogue structure. Dialogue and Discourse,1(2), 81-104.
9. D'Mello, S., & Graesser, A. (2010). Mining BodilyPatterns of Affective Experience during Learning. Proceedings of the 3rd International Conference onEducational Data Mining (pp. 31-40). Pittsburgh,PA.
10. Forsyth, E. N. (2007). Improving Automated Lexicaland Discourse Analysis of Online Chat Dialog. Master's thesis. Naval Postgraduate School.
11. Grafsgaard, J. F., Boyer, K. E., Wiebe, E. N., & Lester,J. C. (2012). Analyzing Posture and Affect in Task-Oriented Tutoring. Proceedings of the 25th FloridaArtificial Intelligence Research Society Conference(pp. 438-443). Marco Island, FL.
12. Ivanovic, E. (2008). Automatic instant messagingdialogue using statistical models and dialogue acts. Master's thesis. The University of Melbourne.
13. Joty, S. R., Carenini, G., & Lin, C.-Y. (2011). Unsupervised Modeling of Dialog Acts inAsynchronous Conversations. Proceedings of the22nd International Joint Conference on ArtificialIntelligence (pp. 1807-1813). Barcelona, Catalonia,Spain.
14. Jurafsky, D., Bates, R., Coccaro, N., Martin, R., Meteer,M., Ries, K., Shriberg, E., et al. (1998). Switchboarddiscourse language modeling project report. Baltimore, MD.
15. Kapoor, A., Burleson, W., & Picard, R. W. (2007). Automatic prediction of frustration. InternationalJournal of Human-Computer Studies, 65(8), 724-736.
16. Kim, S. N., Cavedon, L., & Baldwin, T. (2010). Classifying dialogue acts in one-on-one live chats. Proceedings of the 2010 Conference on EmpiricalMethods in Natural Language Processing (pp. 862-871). Cambridge, MA.
17. Knapp, M. L., & Hall, J. A. (2006). NonverbalCommunication in Human Interaction (6th ed.). Belmont, CA: Wadsworth/Thomson Learning.
18. McCallum, A. K. (2002). MALLET: A MachineLearning for Language Toolkit. Available fromhttp://mallet.cs.umass.edu
19. Mehrabian, A. (2007). Nonverbal Communication. NewBrunswick, NJ: Aldine Transaction.
20. Ritter, A., Cherry, C., & Dolan, B. (2010). Unsupervised modeling of twitter conversations. Proceedings of Human Language Technologies: The2010 Annual Conference of the North AmericanChapter (pp. 172-180). Los Angeles, CA.
21. Russell, J. A., Bachorowski, J. A., & Fernandez-dols, J. M. (2003). Facial and vocal expressions of emotion. Annual Review of Psychology, 54, 329-349.
22. Sanghvi, J., Castellano, G., Leite, I., Pereira, A.,McOwan, P. W., & Paiva, A. (2011). Automaticanalysis of affective postures and body motion todetect engagement with a game companion. Proceedings of the 6th international conference onHuman-robot interaction (pp. 305-312). Lausanne,Switzerland.
23. Sridhar, R., Bangalore, S., & Narayanan, S. (2009). Combining lexical, syntactic and prosodic cues forimproved online dialog act tagging. ComputerSpeech and Language, 23(4), 407-422.
24. Stolcke, A., Ries, K., Coccaro, N., Shriberg, E., Bates,R., Jurafsky, D., Taylor, P., et al. (2000). Dialogueact modeling for automatic tagging and recognitionof conversational speech. Computational Linguistics,26(3), 339-373.
25. Surendran, D., & Levow, G.-A. (2006). Dialog acttagging with support vector machines and hiddenMarkov models. Proceedings of Interspeech (pp. 1950-1953). Pittsburgh, PA.
26. Woolf, B., Burleson, W., Arroyo, I., Dragon, T.,Cooper, D., & Picard, R. W. (2009). Affect-awaretutors recognising and responding to student affect. International Journal of Learning Technology,4(3/4), 129-164.
27. Wu, T., Khan, F. M., Fisher, T. A., Shuler, L. A., & Pottenger, W. M. (2005). Posting Act Tagging UsingTransformation-Based Learning. In T. Y. Lin, S. Ohsuga, C.-J. Liau, X. Hu, & S. Tsumoto (Eds.),Foundations of Data Mining and knowledgeDiscovery (pp. 319-331). Springer.