How to classify tutorial dialogue? Comparing feature vectors vs. Sequences

EDM 2011 - Proceedings of the 4th International Conference on Educational Data Mining

Volumn , Issue , 2011, Pages 169-178

  González Brenes, Josép ^a   Duan, Weisi ^a   Mostow, Jack ^a  

^a Carnegie Mellon University   (United States)

Author keywords

Feature Vectors; Project LISTEN; Reading Task Completio; Sequence Classification

Indexed keywords

CLASSIFICATION ACCURACY; CROSS VALIDATION; DATA SETS; EDUCATIONAL DATA MINING; FEATURE SETS; FEATURE VECTORS; FIXED NUMBERS; HIDDEN CONDITIONAL RANDOM FIELDS; PROJECT LISTEN; READING TASK COMPLETIO; SEQUENCE CLASSIFICATION; TIME-VARYING DATA;

DATA MINING;

EID: 84857466692     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (35)

1. AI, H., TETREAULT, J.R. and LITMAN, D.J. 2007. Comparing user simulation models for dialog strategy learning, Human Language Technologies: The Annual Conference of the North American Chapter of the Association for Computational Linguistics; Companion Volume, Short Papers. Association for Computational Linguistics, Rochester, New York, 1-4.
2. BECK, J. 2004. Using response times to model student disengagement, Proceedings of the ITS2004 Workshop on Social and Emotional Intelligence in Learning Environments, 13-20.
3. BECK, J. and WOOLF, B.P. 2000. High-Level Student Modeling with Machine Learning, Proceedings of the 5th International Conference on Intelligent Tutoring Systems. Springer-Verlag, London, UK, 584-593.
4. BERGER, A.L., PIETRA, V.J.D. and PIETRA, S.A.D. 1996. A maximum entropy approach to natural language processing. Comput. Linguist. 22, 39-71.
5. BLAND, J.M. and KERRY, S.M. 1998. Weighted comparison of means. British Medical Journal 316(7125), 129.
6. BOYER, K., PHILLIPS, R., INGRAM, A., HA, E., WALLIS, M., VOUK, M. and LESTER, J. 2010. Characterizing the Effectiveness of Tutorial Dialogue with Hidden Markov Models, Intelligent Tutoring Systems. Springer Berlin/Heidelberg, 55-64.
7. BREIMAN, L. 2004. Consistency for a simple model of random forests. 670, University of California, Berkeley, Berkeley.
8. CHI, M., JORDAN, P., VANLEHN, K. and HALL, M. 2008. Reinforcement Learning-based Feature Selection For Developing Pedagogically Effective Tutorial Dialogue Tactics, Proceedings of the 1st International Conference on Educational Data Mining, Montreal, 30-36.
9. CHI, M., VANLEHN, K. and LITMAN, D. 2010. Do Micro-Level Tutorial Decisions Matter: Applying Reinforcement Learning to Induce Pedagogical Tutorial Tactics, Intelligent Tutoring Systems. Springer Berlin/Heidelberg, Berlin, 224-234.
10. DUONG, M. and MOSTOW, J. 2010. Adapting a Prosodic Synthesis Model to Score Children's Oral Reading. In Interspeech 2010, Makuhari, Japan, Sept. 26-30, 2010.
11. EISENSTEIN, J., BARZILAY, R. and DAVIS, R. 2008. Gestural cohesion for topic segmentation. ACL: HLT, 852-860.
12. GONZÁLEZ-BRENES, J.P., BLACK, A.W. and ESKENAZI, M. 2009. Describing Spoken Dialogue Systems Differences. In International Workshop on Spoken Dialogue Systems, Irsee, Germany, 2009, Best Paper nominee.
13. GONZÁLEZ-BRENES, J.P. and MOSTOW, J. 2010. Predicting Task Completion from Rich but Scarce Data. In Proceedings of the 3rd International Conference on Educational Data Mining, Pittsburgh, PA, June 11- 13, 2010, R.S.J.D. BAKER, A. MERCERON and P.I.J. PAVLIK, Eds., 291-292.
14. GONZáLEZ-BRENES, J.P. and MOSTOW, J. 2011. Classifying Dialogue in High-Dimensional Space. ACM Transactions on Speech and Language Processing 7(3).
15. GUNAWARDANA, A., MAHAJAN, M., ACERO, A. and PLATT, J.C. 2005. Hidden conditional random fields for phone classification. In 9th European Conference on Speech Communication and Technology - Interspeech Lisboa, Portugal, 2005.
16. HAJDINJAK, M. and MIHELIC, F. 2006. The PARADISE evaluation framework: Issues and findings. Computational Linguistics 32(2), 263-272.
17. HUANG, X., ALLEVA, F., HON, H.W., HWANG, M.Y., LEE, K.F. and ROSENFELD, R. 1993. The SPHINX-II speech recognition system: an overview. Computer Speech & Language 7(2), 137-148.
18. LODHI, H., SAUNDERS, C., SHAWE-TAYLOR, J., CRISTIANINI, N. and WATKINS, C. 2002. Text classification using string kernels. J. Mach. Learn. Res. 2, 419-444.
19. LOURADOUR, J., DAOUDI, K. and BACH, F. 2006. SVM Speaker Verification using an Incomplete Cholesky Decomposition Sequence Kernel. In Speaker and Language Recognition Workshop, 2006. IEEE Odyssey 2006: The, 28-30 June 2006, 2006, 1-5.
20. MÖLLER, S., ENGELBRECHT, K.P. and SCHLEICHER, R. 2008. Predicting the quality and usability of spoken dialogue services. Speech Communication 50(8-9), 730-744.
21. MÖLLER, S., SMEELE, P., BOLAND, H. and KREBBER, J. 2007. Evaluating spoken dialogue systems according to de-facto standards: A case study. Computer Speech and Language 21(1), 26 - 53.
22. MOSTOW, J. and AIST, G. 2001. Evaluating tutors that listen: An overview of Project LISTEN. In Smart Machines in Education, K. FORBUS and P. FELTOVICH, Eds. MIT/AAAI Press, Menlo Park, CA, 169- 234.
23. MURPHY, K. 2012, in preparation. Machine Learning: a Probabilistic Perspective. MIT Press.
24. NG, A.Y. 2004. Feature selection, $\ell-1$ vs. $\ell-2$ regularization, and rotational invariance, ICML '04: Proceedings of the Twenty-first International Conference on Machine learning. ACM, Banff, Alberta, Canada, 78-86.
25. OBOZINSKI, G., TASKAR, B. and JORDAN, M.I. 2007. Multi-task feature selection, The Workshop of Structural Knowledge Transfer for Machine Learning in the 23rd International Conference on Machine Learning (ICML), Pittsburgh, PA.
26. QUATTONI, A., WANG, S., MORENCY, L.P., COLLINS, M. and DARRELL, T. 2007. Hidden conditional random fields. Pattern Analysis and Machine Intelligence, IEEE Transactions on 29(10), 1848-1852.
27. RABINER, L.R. 1989. A tutorial on hidden Markov models and selected applications in speech recognition. Proceedings of the IEEE 77(2), 257-286.
28. REIGELUTH, C.M.A.S., Fu S. (Editor), 1983. The Elaboration Theory of Instruction. Instructional Design Theories and Models: An Overview of their Current States. Lawrence Erlbaum, Hillsdale, NJ.
29. SINGH, S.P., KEARNS, M.J., LITMAN, D.J. and WALKER, M.A. 1999. Reinforcement Learning for Spoken Dialogue Systems, Advances in Neural Information Processing Systems. MIT Press, Cambridge, MA, 956- 962.
30. STOLCKE, A., RIES, K., COCCARO, N., SHRIBERG, E., BATES, R., JURAFSKY, D., TAYLOR, P., MARTIN, R., ESS-DYKEMA, C.V. and METEER, M. 2000. Dialogue act modeling for automatic tagging and recognition of conversational speech. Computational linguistics 26(3), 339-373.
31. SY BOR, W. 2006. Hidden Conditional Random Fields for Gesture Recognition, 2006, Q. ARIADNA, M. LOUIS-PHILIPPE, D. DAVID and D. TREVOR, Eds., 1521-1527.
32. WALKER, M., KAMM, C. and LITMAN, D. 2001. Towards developing general models of usability with PARADISE. Natural Language Engineering 6(3), 363-377.
33. WALLACH, H.M. 2006. Topic modeling: beyond bag-of-words, Proceedings of the 23rd international conference on Machine learning. ACM, Pittsburgh, Pennsylvania, 977-984.
34. XING, Z., PEI, J. and KEOGH, E. 2010. A brief survey on sequence classification. SIGKDD Explor. Newsl. 12(1), 40-48.
35. ZOU, H. and HASTIE, T. 2005. Regularization and variable selection via the elastic net. Journal of the Royal Statistical Society: Series B (Statistical Methodology) 67(2), 301-320.