Experimental Evaluation of Automatic Hint Generation for a Logic Tutor

International Journal of Artificial Intelligence in Education

Volumn 22, Issue 1-2, 2013, Pages 3-17

  Stamper, John ^a   Eagle, Michael ^b   Barnes, Tiffany ^c   Croy, Marvin ^d  

^a Carnegie Mellon University ^*  (United States)

^b University of North Carolina at Charlotte   (United States)

^c North Carolina State University   (United States)

^d UNIVERSITY OF NORTH CAROLINA AT CHARLOTTE   (United States)

Author keywords

Data mining; logic tutor; machine learning

Indexed keywords

AUTOMATIC TEST PATTERN GENERATION; DATA MINING; LEARNING SYSTEMS;

AUTOMATICALLY GENERATED; COMPUTER-AIDED INSTRUCTIONAL TOOLS; DEDUCTIVE LOGIC; EXPERIMENTAL EVALUATION; LOGIC PROOFS; LOGIC TUTOR;

TEACHING;

EID: 84882290267     PISSN: 15604292     EISSN: None     Source Type: Journal    
DOI: 10.3233/JAI-130029     Document Type: Conference Paper

References (27)

1. Aleven, V., McLaren, B., Roll, I., & Koedinger, K. (2004). Toward tutoring help seeking: Applying cognitive modelling to meta-cognitive skills. Proceedings of the Seventh International Conference on Intelligent Tutoring Systems.
2. Barnes, T., & Stamper, J. (2008). Toward Automatic Hint Generation for Logic Proof Tutoring Using Historical Student Data. In E. Aimeur & B. Woolf (Eds.) Intelligent Tutoring Systems (ITS 2008) (pp. 373-382). Berlin, Germany: Springer Verlag.
3. Barnes, T., Stamper, J., Lehmann, L., & Croy, M. (2008). A Pilot Study on Logic Proof Tutoring Using Hints Generated from Historical Student Data. In R. Baker, T. Barnes & J. Beck (Eds.) Educational Data Mining (EDM 2008) (pp. 197-201). Montreal, Canada.
4. Beck, J., Chang, K., Mostow, J., & Corbett, A. (2008). Does Help Help? Introducing the Bayesian Evaluation and Assessment Methodology. Intelligent Tutoring Systems, 383-394.
5. Billingsley,W., & Robinson, P. (2007). Student proof exercises using Maths Tiles and Isabelle/HOL in an intelligent book. Journal of Automated Reasoning, 39(2), 181-218. Springer.
6. Springer. Croy, M., Barnes, T.,&Stamper, J. (2007). Towards an Intelligent Tutoring System for propositional proof construction. In P. Brey, A. Briggle & K. Waelbers (eds.), In Proc European Computing and Philosophy Conference (pp. 145-155), Amsterdam, Netherlands: IOS Publishers.
7. Eagle, M., Johnson, M., & Barnes, T. (2012). Interaction Networks: Generating High Level Hints Based on Network Community Clusterings. In Proceedings of the 5th International Conference on Educational Data Mining (EDM 2012) (pp. 164-167). Chania, Greece.
8. Fossati, D., Di Eugenio, B., Ohlsson, S., Brown, C., Chen, L., & Cosejo, D. (2009). I learn from you, you learn from me: How to make iList learn from students. In V. Dimitrova, R. Mizoguchi, B. Du Boulay & A. Graesser (Eds.), Proc 14th Intl Conf on Artificial Intelligence in Education, AIED 2009 (pp. 186-195). Brighton, UK: IOS Press.
9. Jin, W., Barnes, T., Stamper, J., Eagle, M., Johnson, M., & Lehmann, L. (2012) Program Representation for Automatic Hint Generation for a Data-Driven Novice Programming Tutor. In Proc of the 11th Intl Conference on Intelligent Tutoring Systems (ITS2012) (pp. 304-309). Springer.
10. Li, N., Matsuda, N., Cohen, W. W., & Koedinger, K. R. (2011). A Machine Learning Approach for Automatic Student Model Discovery. In M. Pechenizkiy, T. Calders, C. Conati, S. Ventura, C. Romero & J. Stamper (Eds.), Proceedings of the 4th International Conference on Educational Data Mining (EDM2011) (pp. 31-40).
11. Lukins, S., Levicki, A., & Burg, J. (2002). A tutorial program for propositional logic with human/computer interactive learning. ACM SIGCSE Bulletin, 34(1), 381-385. ACM.
12. Koedinger, K., McLaughlin, E., & Stamper, J. (2012). Automated Student Model Improvement. In Proceedings of the 5th International Conference on Educational Data Mining (EDM 2012) (pp. 17-24). Chania, Greece.
13. Koedinger, K. R., Baker, R. S. J. d., Cunningham, K., Skogsholm, A., Leber, B., & Stamper, J. (2010) A Data Repository for the EDM commuity: The PSLC DataShop. In C. Romero, S. Ventura, M. Pechenizkiy & R. S. J. d. Baker (Eds.) Handbook of Educational Data Mining. Boca Raton, FL: CRC Press.
14. Mitrovic, A., Koedinger, K. & Martin, B. (2003). A comparative analysis of cognitive tutoring and constraint-based modelling. User Modelling, 313-322.
15. McLaren, B., Koedinger, K., Schneider, M., Harrer, A., & Bollen, L. (2004). Bootstrapping Novice Data: Semiautomated tutor authoring using student log files, In Proc Workshop on Analyzing Student-Tutor Interaction Logs to Improve Educational Outcomes, 7th Intl Conf Intelligent Tutoring Systems (ITS-2004), Maceió, Brazil.
16. Nkambou, R., Mephu Nguifo, E., & Fournier-Viger, P. (2008). Using Knowledge Discovery Techniques to Support Tutoring in an Ill-Defined Domain. In E. Aimeur & B. Woolf (Eds.) Intelligent Tutoring Systems (ITS 2008) (pp. 395-405). Berlin: Springer Verlag.
17. Paquette, L., Lebeau, J.F., Mbungira, J., & Mayers, A. (2011). Generating task-specific next-step hints using domainindependent structures. In Proceedings of the International Conference on Artificial Intelligence in Education (AIED 2011) (pp. 525-527). Springer.
18. Razzaq, L. & Heffernan, N. (2010). Hints: Is It Better to Give or Wait to be Asked? In V. Aleven, J. Kay & Mostow, J (Eds). Proc 10th Intelligent Tutoring Systems (ITS2010) Part 1 (pp. 349-358). Springer.
19. Razzaq, L., & Heffernan, N.T. (2006). Scaffolding vs. hints in the Assistment system. In Ikeda, Ashley & Chan (Eds.). Proceedings of the Eight International Conference on Intelligent Tutoring Systems (pp. 635-644) Springer-Verlag: Berlin.
20. Scheines, R., & Sieg, W. (1994). Computer environments for proof construction. Interactive Learning Environments, 4(2), 159-169.
21. Shih, B., Kenneth R. Koedinger & Richard Scheines. (2008). "A Response Time Model For Bottom-Out Hints as Worked Examples." In Proceedings of the 1st International Conference on Educational Data Mining, EDM2008, pp. 117-126.
22. Shute, V. J. (2008). Focus on formative feedback. Review of Educational Research, 78(1), 153-189.
23. Stamper, J., M. Eagle, T. Barnes, & M. Croy. (2011). Experimental Evaluation of Automatic Hint Generation for a Logic Tutor. 15th Intl Conf on AI in Education (AIED) 2011 (pp. 345-35). Auckland, New Zealand.
24. Stamper, J., Barnes, T., & Croy, M. (2011). Enhancing the Automatic Generation of Hints with Expert Seeding. International Journal of Artificial Intelligence in Education, Special Issue "Best of ITS", IOS Press.
25. Sutton, R. & Barto, A. (1998). Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press.
26. Van Lehn, K. (2006). The behavior of tutoring systems, International Journal of Artificial Intelligence in Education, 16, 227-265. IOS Press.
27. Yacef, K. (2005). The Logic-ITA in the classroom: A medium scale experiment. International Journal of Artificial Intelligence in Education, 15(1), 41-60. IOS Press.