Teaching the teacher: Tutoring simstudent leads to more effective cognitive tutor authoring

International Journal of Artificial Intelligence in Education

Volumn 25, Issue 1, 2015, Pages 1-34

  Matsuda, Noboru ^a   Cohen, William W ^a   Koedinger, Kenneth R ^a  

^a Human Computer Interaction Institute Carnegie Mellon University ^*  (United States)

Author keywords

Cognitive tutor authoring tools; Inductive logic programming; Intelligent authoring system; Machine learning; Programming by demonstration; SimStudent

Indexed keywords

ARTIFICIAL INTELLIGENCE; DEMONSTRATIONS; FEEDBACK; INDUCTIVE LOGIC PROGRAMMING (ILP); LEARNING SYSTEMS;

AUTHORING SYSTEMS; AUTHORING TOOL; FORMATIVE ASSESSMENT; LEARNING PROGRESS; MACHINE LEARNING AGENTS; PROGRAMMING BY DEMON-STRATION; SIMSTUDENT; WORKED-OUT EXAMPLES;

TEACHING;

EID: 84920862842     PISSN: 15604292     EISSN: 15604306     Source Type: Journal    
DOI: 10.1007/s40593-014-0020-1     Document Type: Review

References (61)

1. Ainsworth, S., & Grimshaw, S. (2004). Evaluating the REDEEM authoring tool: can teachers create effective learning environments? International Journal of Artificial Intelligence in Education, 14, 279-312.
2. Aleven, V., McLaren, B. M., Sewall, J., & Koedinger, K. R. (2006). The cognitive tutor authoring tools (CTAT): Preliminary evaluation of efficiency gains. In M. Ikeda, K. D. Ashley, & T. W. Chan (Eds.), Proceedings of the 8th international conference on intelligent tutoring systems (pp. 61-70). Berlin: Springer Verlag.
3. Aleven, V., McLaren, B. M., Sewall, J., & Koedinger, K. R. (2009). A New paradigm for intelligent tutoring systems: example-tracing tutors. International Journal of Artificial Intelligence in Education, 19, 105-154.
4. Anderson, J. R., & Pelletier, R. (1991). A development system for model-tracing tutors. Proc. of the International Conference on the Learning Sciences, 1-8.
5. Anderson, J. R., Corbett, A. T., Koedinger, K. R., & Pelletier, R. (1995). Cognitive tutors: lessons learned. Journal of the Learning Sciences, 4(2), 167-207.
6. Angros, R., Jr., Johnson, W. L., Rickel, J., & Scholer, A. (2002). Learning domain knowledge for teaching procedural skills proceedings of the first international joint conference on autonomous agents and multiagent systems: Part 3 (pp. 1372-1378). New York: ACM Press.
7. Arruarte, A., Fernández-Castro, I., Ferrero, B., & Greer, J. (1997). The IRIS shell: how to build ITSs from pedagogical and design requisites. International Journal of Artificial Intelligence in Education, 8, 341-381.
8. Atkinson, R. K., Renkl, A., & Margaret Merrill, M. (2003). Transitioning from studying examples to solving problems: effects of self-explanation prompts and fading worked-out steps. Journal of Educational Psychology, 95(4), 774-783.
9. Blessing, S. B. (1997). A programming by demonstration authoring tool for model-tracing tutors. International Journal of Artificial Intelligence in Education, 8, 233-261.
10. Booth, J. L., & Koedinger, K. R. (2008). Key misconceptions in algebraic problem solving. In B. C. Love, K. McRae, & V. M. Sloutsky (Eds.), Proceedings of the 30th annual conference of the cognitive science society (pp. 571-576). Austin: Cognitive Science Society.
11. Burton, R. R., & Brown, J. S. (1982). An investigation of computer coaching for informal learning activities. In D. Sleeman & J. S. Brown (Eds.), Intelligent tutoring systems (pp. 79-98). Orlando: Academic.
12. Chi, M. T. H. (1997). Quantifying qualitative analyses of verbal data: a practical guide. Journal of the Learning Sciences, 6(3), 271-315.
13. Clark, R. E., & Estes, F. (1996). Cognitive task analysis for training. International Journal of Educational Research, 25(5), 403-417.
14. Corbett, A. T., Anderson, J. R., & O' Brien, A. T. (1995). Student modeling in the ACT programming tutor. In P. D. Nichols & S. F. Chipman (Eds.), Cognitively diagnostic assessment (pp. 19-41). Hillsdale: Lawrence Erlbaum Associates, Inc.
15. Corbett, A. T., McLaughlin, M., & Scarpinatto, K. C. (2000). Modeling student knowledge: cognitive tutors in high school and college. User Modeling and User Adapted Interaction, 10(2-3), 81-108.
16. Cypher, A. (Ed.). (1993). Watch what I do: Programming by demonstration. Cambridge: MIT Press.
17. Fails, J. A., & Olsen, D. R., Jr. (2003). Interactive machine learning Proceedings of IUI2003 (pp. 39-45). Miami Beach: ACM.
18. Gott, S. P., & Lesgold, A. M. (2000). Competence in the workplace: How cognitive performance models and situated instruction Can accelerate skill acquisition. In R. Glaser (Ed.), Advances in instructional psychology: Educational design and cognitive science (Vol. 5, pp. 239-327). Mahwah: Erlbaum.
19. Heffernan, N. T., Turner, T. E., Lourenco, A. L. N., Macasek, M. A., Nuzzo-Jones, G., & Koedinger, K. R. (2006). The ASSISTment Builder: Towards an Analysis of Cost Effectiveness of ITS creation Proc of FLAIRS2006.
20. Jarvis, M. P., Nuzzo-Jones, G., & Heffernan, N. T. (2004). Applying machine learning techniques to rule generation in intelligent tutoring systems. In J. C. Lester (Ed.), Proceedings of the international conference on intelligent tutoring systems (pp. 541-553). Heidelberg: Springer.
21. Jonassen, D. H., Tessmer, M., & Hannum, W. H. (1999). Task analysis methods for instructional design. Mahwah: Lawrence Erlbaum Associates, Inc., Publishers.
22. Kalyuga, S., Chandler, P., Tuovinen, J., & Sweller, J. (2001). When problem solving is superior to studying worked examples. Journal of Educational Psychology, 93(3), 579-588.
23. Kieras, D. E. (1988). Towards a practical GOMS model methodology for user interface design. In M. Helander (Ed.), Handbook of human-computer interaction (pp. 135-157). New York: Elsevier.
24. Kiyama, M., Ishiuchi, S., Ikeda, K., Tsujimoto, M., & Fukuhara, Y. (1997). Authoring methods for the Web-based intelligent CAI system CALAT and its application to telecommunications service. AAAI Technical Report FS, 97(01), 44-52.
25. Koedinger, K. R., & Aleven, V. (2007). Exploring the assistance dilemma in experiments with cognitive tutors. Educational Psychology Review, 19(3), 239-264.
26. Koedinger, K. R., & Corbett, A. T. (2006). Cognitive tutors: Technology bringing learning sciences to the classroom. In R. K. Sawyer (Ed.), The Cambridge handbook of the learning sciences (pp. 61-78). New York: Cambridge University Press.
27. Koedinger, K. R., & Nathan, M. J. (2004). The real story behind story problems: effects of representations on quantitative reasoning. Journal of the Learning Sciences, 13, 129-164.
28. Koedinger, K. R., Aleven, V., & Heffernan, N. (2003). Toward a rapid development environment for cognitive tutors. In U. Hoppe, F. Verdejo, & J. Kay (Eds.), Proceedings of the international conference on artificial intelligence in education (pp. 455-457). Amsterdam: IOS Press.
29. Koedinger, K. R., Aleven, V., Heffernan, N., McLaren, B., & Hockenberry, M. (2004). Opening the Door to Non-Programmers: Authoring Intelligent Tutor Behavior by Demonstration. In J. C. Lester, R. M. Vicari & F. Paraguac¸u (Eds.), Proceedings of the Seventh International Conference on Intelligent Tutoring Systems.
30. Koedinger, K. R., Cunningham, K., Skogsholm, A., & Leber, B. (2008). An open repository and analysis tools for fine-grained, longitudinal learner data Proceedings of the international Conference on Educational Data Mining.
31. Koedinger, K. R., Baker, R. S. J. D., Cunningham, K., Skogsholm, A., Leber, B., & Stamper, J. (2010). A data repository for the EDM community: The PSLC Datashop. In C. Romero, S. Ventura, M. Pechenizkiy, & R. S. J. D. Baker (Eds.), Handbook of educational data mining. Boca Raton: CRC Press.
32. Kosbie, D. S., & Myers, B. A. (1993). PBD invocation techniques: A review and proposal. In A. Cypher (Ed.), Watch what I do: Programming by demonstration (pp. 423-431). Cambridge: MIT Press.
33. Langley, P., Bradshaw, G. L., & Simon, H. A. (1987). Heuristics for empirical discovery. In L. Bolc (Ed.), Computational models of learning. Berlin: Springer.
34. Lau, T. A., & Weld, D. S. (1998). Programming by demonstration: An inductive learning formulation proceedings of the 4th international conference on intelligent user interfaces (pp. 145-152). New York: ACM Press.
35. Li, N., Matsuda, N., Cohen, W. W., & Koedinger, K. R. (2011). A machine learning approach for automatic student model discovery. In M. Pechenizkiy, T. Calders, C. Conati, S. Ventura, C. Romero, & J. Stamper (Eds.), Proceedings of the international conference on educational data mining (pp. 31-40). Eindhoven: International Educational Data Mining Society.
36. London, B., & Clancey, W. J. (1982). Plan recognition strategies in student modeling: Prediction and description: Department of Computer Science, Stanford University.
37. Matsuda, N., Cohen, W. W., & Koedinger, K. R. (2005a). Applying programming by demonstration in an intelligent authoring tool for cognitive tutors aaai workshop on human comprehensible machine learning (Technical report WS-05-04) (pp. 1-8). Menlo Park: AAAI association.
38. Matsuda, N., Cohen, W. W., & Koedinger, K. R. (2005b). Building cognitive tutors with programming by demonstration. In S. Kramer & B. Pfahringer (Eds.), Technical report: TUM-I0510 (Proceedings of the International Conference on Inductive Logic Programming) (pp. 41-46). Institut fur Informatik, Technische Universitat Munchen.
39. Matsuda, N., Cohen, W. W., Sewall, J., & Koedinger, K. R. (2006). Applying machine learning to cognitive modeling for cognitive tutors machine learning department technical report (CMU-ML-06-105). Pittsburgh: School of Computer Science, Carnegie Mellon University.
40. Matsuda, N., Cohen, W. W., Sewall, J., Lacerda, G., & Koedinger, K. R. (2008). Why tutored problem solving may be better than example study: Theoretical implications from a simulated-student study. In B. P. Woolf, E. Aimeur, R. Nkambou, & S. Lajoie (Eds.), Proceedings of the international conference on intelligent tutoring systems (pp. 111-121). Heidelberg: Springer.
41. McCalla, G., & Champaign, J. (Eds.). (2013). Proceedings of the AIED workshop on simulated learners. Memphis: International AIED Society.
42. McDaniel, R., & Myers, B. A. (1998). Building applications using only demonstration proceedings of the 3rd international conference on intelligent user interfaces (pp. 109-116). New York: ACM Press.
43. Mitchell, T. M. (1997). Machine learning. Boston: McGraw-Hill.
44. Mitrovic, A., & Ohlsson, S. (1999). Evaluation of a constraint-based tutor for a database language. International Journal of Artificial Intelligence in Education, 10, 238-256.
45. Mitrovic, A., Martin, B., & Suraweera, P. (2007). Intelligent tutors for all: the constraint-based approach. IEEE Intelligent Systems, 22(4), 38-45.
46. Muggleton, S. (1999). Inductive logic programming: issues, results and the challenge of learning language in logic. Artificial Intelligence, 114(1-2), 283-296.
47. Muggleton, S., & de Raedt, L. (1994). Inductive logic programming: theory and methods. Journal of Logic Programming, 19-20(Supplement 1), 629-679.
48. Munro, A., Johnson, M. C., Pizzini, Q. A., Surmon, D. S., Towne, D. M., & Wogulis, J. L. (1997). Authoring simulation-centered tutors with RIDES. International Journal of Artificial Intelligence in Education, 8, 284-316.
49. Murray, T. (1998). Authoring knowledge-based tutors: tools for content, instructional strategy, student model and interface design. Journal of the Learning Sciences, 7(1), 5-64.
50. Murray, T. (1999). Authoring intelligent tutoring systems: an analysis of the state of the art. International Journal of Artificial Intelligence in Education, 10, 98-129.
51. Murray, T. (2003). An overview of intelligent tutoring system authoring tools. In T. Murray, S. Ainsworth, & S. B. Blessing (Eds.), Authoring tools for advanced technology learning environment (pp. 491-544). Netherlands: Kluwer.
52. Olsen, D. R., Jr., & Pace, A. (2005). Human-guided Machine Learning. Proceedings of UIST, 1-9.
53. Quinlan, J. R. (1990). Learning logical definitions from relations. Machine Learning, 5(3), 239-266.
54. Ritter, S., & Koedinger, K. R. (1996). An architecture for plug-in Tutor Agents.
55. Ritter, S., Anderson, J. R., Koedinger, K. R., & Corbett, A. (2007). Cognitive tutor: applied research in mathematics education. Psychonomic Bulletin & Review, 14(2), 249-255.
56. Sammut, C., & Banerji, R. B. (1986). Learning concepts by asking questions. In R. S. Michalski, J. G. Carbonell, & T. M. Mitchell (Eds.), Machine learning: An artificial intelligence approach (Vol. 2). Los Altos: Kaufmann.
57. Shapiro, E. Y. (1982). Algorithmic program debugging. Cambridge: MIT Press.
58. Shute, V. J., & Psotka, J. (1994). Intelligent tutoring systems: past, present, and future. (AL/HR-TP-1994-0005). Brooks Air Force Base: Armstrong Laboratory.
59. Sparks, R., Dooley, S., Meiskey, L., & Blumenthal, R. (1999). The LEAP authoring tool: supporting complex courseware authoring through reuse, rapid prototyping, and interactive visualizations. International Journal of Artificial Intelligence in Education, 10, 75-97.
60. Suraweera, P., Mitrovic, A., & Martin, B. (2005). A Knowledge Acquisition System for Constraint-based Intelligent Tutoring Systems. In C.-K. Looi (Ed.), Artificial Intelligence in Education (pp. 638-645): IOS Press.
61. Wenger, E. (1987). Artificial intelligence and tutoring systems: Computational and cognitive approaches to the communication of knowledge. Los Altos: Morgan Kaufmann.