Student modeling in an intelligent tutoring system

Intelligent Tutoring Systems in E-Learning Environments: Design, Implementation and Evaluation

Volumn , Issue , 2010, Pages 208-236

  Feng, Mingyu ^a   Heffernan, Neil ^b   Koedinger, Kenneth ^c  

^a SRI INTERNATIONAL   (United States)

^b WORCESTER POLYTECHNIC INSTITUTE   (United States)

^c CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84900613706     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.4018/978-1-61692-008-1.ch011     Document Type: Chapter

References (93)

1. Ahn, J., Brusilovsky, P., Grady, J., He, D., & Syn, S. Y. (2007). Open user profiles for adaptive news systems: help or harm? In Proceedings of the 16th international conference on World Wide Web (WWW '07) (pp 11-20), New York: ACM Press.
2. Aleven, V. A. W. M. M., & Koedinger, K. R. (2002). An effective metacognitive strategy: Learning by doing and explaining with a computer-based Cognitive Tutor. Cognitive Science, 26(2), PAGE NUMBERS.
3. Almond, R. G., DiBello, L. V., Moulder, B., & Zapata-Rivera, D. (2007). Modeling diagnostic assessment with Bayesian networks. Journal of Educational Measurement, 44(4), 341-359. doi:10.1111/j.1745-3984.2007.00043.x
4. Almond, R. G., Shute, V., Underwood, J., & Zapata-Rivera, D. (2009). Bayesian networks: A teacher's view. International Journal of Approximate Reasoning, 50, 450-460. doi:10.1016/j.ijar.2008.04.011
5. Anderson, J. R. (1993). Rules of mind. Hillsdale, NJ: Lawrence Erlbaum Associates.
6. Anderson, J. R., Corbett, A. T., Koedinger, K. R., & Pelletier, R. (1995). Cognitive tutors: Lessons learned. Journal of the Learning Sciences, 4(2), 167-207. doi:10.1207/s15327809jls0402_2
7. Anderson, J. R., & Lebiere, C. (1998). The Atomic Components of Thought. Hillsdale, NJ: Lawrence Erlbaum Associates.
8. Anderson, J. R., & Lebiere, C. (1998). The Atomic Components of Thought. Mahwah, NJ: Erlbaum: LEA.
9. Anozie, N. O., & Junker, B. W. (2006, July). Predicting end-of-year accountability assessment scores from monthly student records in an online tutoring system. Poster presented at the American Association for Artificial Intelligence Workshop on Educational Data Mining (AAAI-06), Boston.
10. Ayers, E., & Junker, B. W. (2006, July). Do skills combine additively to predict task difficulty in eighth-grade mathematics? Poster presented at the American Association for Artificial Intelligence Workshop on Educational Data Mining (AAAI-06), Boston, MA.
11. Barnes, T. (2005). Q-matrix Method: Mining Student Response Data for Knowledge. In Beck. J. (Ed), Educational Data Mining: Papers from the 2005 AAAI Workshop. Menlo Park, CA: AAAI Pressrx.
12. Beck, J. E.(2006). Using learning decomposition to analyze student fluency development. In Proceedings of the Workshop on Educational Data Mining at the 8th International Conference on Intelligent Tutoring Systems (pp 21-28).
13. Jhongli, Taiwan eck, J. E., Chang, K., Mostow, J., & Corbett, A. (2008). Does help help? Introducing the Bayesian Evaluation and Assessment methodology. In Proceedings of the 9th International Conference on Intelligent Tutoring Systems, (pp 383-394).
14. Brown, A. L., Bryant, N. R., & Campione, J. C. (1983). Preschool children's learning and transfer of matrices problems: Potential for improvement. Paper presented at the Society for Research in Child Development meeting, Detroit, MI.
15. Brusilovsky, P., & Millán, E. (2007). User models for adaptive hypermedia and adaptive educational systems. In: P. Brusilovsky, A. Kobsa and W. Neidl (Eds.). The Adaptive Web: Methods and Strategies of Web Personalization: Lecture Notes in Computer Science, 4321, 3-53. Berlin Heidelberg New York: Springer-Verlag.
16. Brusilovsky, P., & Peylo, C. (2003). Adaptive and intelligent web-based educational systems. Journal of Artificial Intelligence in Education, 13(2-4), 159-172.
17. Brusilovsky, P., Sosnovsky, S., & Shcherbinina, O. (2005). User Modeling in a Distributed E-Learning Architecture. In: L. Ardissono, P. Brna and A. Mitrovic (Eds.) Proceedings of 10th International User Modeling Conference: Lecture Notes in Artificial Intelligence, vol. 3538. Berlin: Springer Verlag
18. Bull, S. (2004). Supporting Learning with Open Learner Models. In Proceedings of 4th Hellenic Conference with International Participation: Information and Communication Technologies in Education, Athens, Greece.
19. Bull, S., Gardner, P., Ahmad, N., Ting, J. & Clarke, B. (in press). Use and Trust of Simple Independent Open Learner Models to Support Learning Within and Across Courses. User Modeling, Adaptation and Personalization, Springer-Verlag, Berlin Heidelberg.
20. Bull, S., & Kay, J. (2007). Student Models that Invite the Learner In: The SMILI Open Learner Modelling Framework. International Journal of Artificial Intelligence in Education, 17(2), 89-120.
21. Bull, S., & McEvoy, A. T. (2003). An Intelligent Learning Environment with an Open Learner Model for the Desktop PC and Pocket PC. In Hoppe, U., Verdejo, F., & Kay, J. (Eds.), Artificial Intelligence in Education (pp. 389-391). Amsterdam: IOS Press.
22. Bull, S., & Nghiem, T. (2002). Helping Learners to Understand Themselves with a Learner Model Open to Students, Peers and Instructors. In P. Brna & V. Dimitrova (Eds.), Proceedings of Workshop on Individual and Group Modeling Methods that Help Learners Understand Themselves, International Conference on Intelligent Tutoring Systems, (pp. 5-13).
23. Campione, J. C., Brown, A. L., & Bryant, N. R. (1985). Individual differences in learning and memory. In Sternberg, R. J. (Ed.), Human abilities: An information-processing approach (pp. 103-126). New York: W.H. Freeman.
24. Carmonal, C., Millán, E., Pérez-de-la-Cruz, J. L., Trellal, M., & Conejo, R. (2005). Introducing Prerequisite Relations in a Multi-layered Bayesian Student Model. In Ardissono, Brna & Mitroivc (Eds.). 10th International Conference on User Modeling 2005, (pp. 347-356), Berlin, Germany: Springer-Verlag
25. Cen, H., Koedinger, K., & Junker, B. (2005). Automating Cognitive Model Improvement by A*Search and Logistic Regression. In Beck. J (Eds). Educational Data Mining: Papers from the 2005 AAAI Workshop. Menlo Park, CA: AAAI Press.
26. Cen, H., Koedinger, K., & Junker, B. (2006, June). Learning factors analysis: a general method for cognitive model evaluation and improvement. Presented at the Eighth International Conference on Intelligent Tutoring Systems (ITS 2006), Jhongli, Taiwan.
27. Chang, K., Beck, J., Mostow, J., & Corbett, A. (2006, June). A Bayes Net Toolkit for Student Modeling in Intelligent Tutoring Systems. Presented at Eigth International Conference on Intelligent Tutoring Systems, Jhongli, Taiwan
28. Collins, J., Greer, J., & Huang, S. (1996). Adaptive assessment of using granularity hierarchies and Bayesien nets. In Lecture Notes in Computer Science: Proceedings of the third Intelligent Tutoring Systems, (pp. 569-577), London: Springer-Verlag.
29. Computing Research Association. (2005). Cyber infrastructure for Education and Learning for the Future: a Vision and Research Agenda. Final report of Cyber learning Workshop Series workshops held Fall 2004 - Spring 2005 by the Computing Research Association (CRA) and the International Society of the Learning Sciences (ISLS). Retrieved from http://www.cra.org/re-ports/cyberinfrastructure.pdfrx
30. Conati, C., Gertner, A., VanLehn, K., & Druzdzel, M. (1997). On-Line Student Modeling for Coached Problem Solving Using Bayesian Networks. In Jameson A., Paris C., Tasso C., (Eds.), Proceedings of the sixth International Conference on User Modeling (UM'97). New York: Springer-Wien.
31. Corbett, A. T., & Anderson, J. R. (1995). Knowledge tracing: Modeling the acquisition of procedural knowledge. User Modeling and UserAdapted Interaction, 4, 253-278. doi:10.1007/BF01099821
32. Corbett, A. T., Anderson, J. R., & O'Brien, A. T. (1995). Student modeling in the ACT programming tutor. In Nichols, P., Chipman, S., & Brennan, R. (Eds.), Cognitively Diagnostic Assessment. Hillsdale, NJ: Erlbaumrx.
33. Corbett, A. T., Koedinger, K. R., & Hadley, W. H. (2001). Cognitive Tutors: From the research classroom to all classrooms. In Goodman, P. S. (Ed.), Technology Enhanced Learning: Opportunities for Change. Mahwah, NJ: Lawrence Erlbaum Associates.
34. Dimitrova, V., Self, J., & Brna, P. (2001). Applying Interactive Open Learner Models to Learning Technical Terminology. In M. Bauer, P. J. Gmytrasiewicz & J. Vassileva (Eds.), User Modeling 2001: 8th International Conference, (pp. 148-157). Springer-Verlag, Berlin Heidelberg.
35. Draney, K. L., Pirolli, P., & Wilson, M. (1995). A measurement model for a complex cognitive skill. In Nichols, P., Chipman, S., & Brennan, R. (Eds.), Cognitively Diagnostic Assessment. Hillsdale, NJ: Erlbaumrx.
36. Feng, M., & Beck, J. (2009). Back to the future: a non-automated method of constructing transfer models. In Barnes & Desmarais (Eds.), Proceedings of the 2nd International Conference on Educational Data Mining. Cordoba, Spain, 2009.
37. Feng, M., Beck, J., & Heffernan, N. (2009a) Using learning decomposition to analyze instructional effectiveness in the ASSISTment system. In Proceedings of the 14th International Conference on Artificial Intelligence in Education (AIED-2009). Brighton, UK: IOS Press.
38. Feng, M., Beck, J., Heffernan, N., & Koedinger, K. (2008). Can an Intelligent Tutoring System Predict Math Proficiency as Well as a Standardized Test? In Beck & Baker (Eds.). In Proceedings of the 1st International Conference on Education Data Mining. Montreal, Quebec.
39. Feng, M., Beck, J., & Heffernan, N. T. (2009b). Using Learning Decomposition and Bootstrapping with Randomization to Compare the Impact of Different Educational Interventions on Learning. In Barnes, Desmarais, Romero, & Ventura (Eds.), Proceedings of the 2nd International Conference on Educational Data Mining (pp. 51-60). Cordoba, Spain: Copisterias Don Folio, S.Lrx.
40. Feng, M., & Heffernan, N. (2007b). Towards Live Informing and Automatic Analyzing of Student Learning: Reporting in ASSISTment System. Journal of Interactive Learning Research, 18(2), 207-230.
41. Feng, M., Heffernan, N., Beck, J., & Koedinger, K. (2008). Can we predict which groups of questions students will learn from? In Beck & Baker (Eds.), Proceedings of the 1st International Conference on Education Data Mining. Montreal, Quebec.
42. Feng, M, Heffernan, N., Heffernan, C. & Mani, M. (2009). Using mixed-effects modeling to analyze different grain-sized skill models. IEEE Transactions on Learning Technologies, retrieved from/doi.ieeecomputersociety.org/10.1109/TLT.2009.17.
43. Feng, M., & Heffernan, N. T. (2007a). Assessing Students' Performance: Item Difficulty Parameter vs. Skill Learning Tracking. Paper presented at the National Council on Educational Measurement, Chicago.
44. Feng, M., Heffernan, N. T., & Koedinger, K. R. (2006a). Addressing the testing challenge with a web based E-assessment system that tutors as it assesses. In Proceedings of the 15th Annual World Wide Web Conference. New York: ACM Press.
45. Feng, M., Heffernan, N. T., & Koedinger, K. R. (2006b). Predicting state test scores better with intelligent tutoring systems: developing metrics to measure assistance required. In Ikeda, Ashley & Chan (Eds.), Proceedings of the Eighth International Conference on Intelligent Tutoring Systems, (pp 31-40). Springer-Verlag: Berlin.
46. Feng, M., Heffernan, N. T., & Koedinger, K. R. (2009). Addressing the assessment challenge in an online system that tutors as it assesses. User Modeling and User-Adapted Interaction: The Journal of Personalization Research (UMUAI journal), 19.
47. Ferguson, K., Arroyo, I., Mahadevan, S., Woolf, B., & Barto, A. (2006). Improving Intelligent Tutoring Systems: Using Expectation Maximization to Learn Student Skill Levels. In Ikeda, Ashley & Chan (Eds.), Proceedings of the Eight International Conference on Intelligent Tutoring Systems, (pp.453-462). Berlin: Springer-Verlag.
48. Fitzmaurice, G., Laird, N., & Ware, J. (2004). Applied Longitudinal Analysis. Hoboken, New Jersey: Wiley & Sons.
49. Gierl, M. J., Wang, C., & Zhou, J. (2008). Using the attribute hierarchy method to make diagnostic inferences about examinees' cognitive skills in Algebra on the SAT. Journal of Technology, Learning, and Assessment, 6(6). Retrieved May 2008, from www.jtla.org.
50. Grigorenko, E. L., & Sternberg, R. J. (1998). Dynamic testing. Psychological Bulletin, 124, 75-111. doi:10.1037/0033-2909.124.1.75
51. Heffernan, N. T., Turner, T. E., Lourenco, A. L. N., Macasek, M. A., Nuzzo-Jones, G., & Koedinger, K. R. (2006). The ASSISTment Builder: Towards an Analysis of Cost Effectiveness of ITS creation. Presented at FLAIRS2006, Florida.
52. Junker, B. W., & Sijtsma, K. (2001). Cognitive assessment models with few assumptions, and connections with nonparametric item response theory. Applied Psychological Measurement, 25, 258-272. doi:10.1177/01466210122032064
53. Kay, J. (1997). Learner Know Thyself: Student Models to Give Learner Control and Responsibility. In Z. Halim, T. Ottomann & Z. Razak (Eds.), Proceedings of International Conference on Computers in Education (pp. 17-24), Association for the Advancement of Computing in Education (AACE).
54. Koedinger, K. R., Aleven, V., Heffernan, N. T., McLaren, B., & Hockenberry, M. (2004). Opening the Door to Non-Programmers: Authoring Intelligent Tutor Behavior by Demonstration. In Proceedings of the 7th International Conference on Intelligent Tutoring Systems, Maceio, Brazil.
55. Koedinger, K. R., Anderson, J. R., Hadley, W. H., & Mark, M. A. (1997). Intelligent tutoring goes to school in the big city. International Journal of Artificial Intelligence in Education, 8, 30-43.
56. Koedinger, K. R., & Mathan, S. (2004). Distinguishing qualitatively different kinds of learning using log files and learning curves. In the Working Notes of the ITS2004 Workshop on Analyzing Student-Tutor Interaction Logs to Improve Educational Outcomes. Maceiò, Alagoas, Brazil.
57. McCalla, G. I., & Greer, J. E. (1994). Granularitybased reasoning and belief revision in student models. In Greer, J. E., & McCalla, G. I. (Eds.), Student Modeling: The Key to Individualized Knowledge-Based Instruction (pp. 39-62). Berlin: Springer-Verlag.
58. Means, B., Padilla, C., DeBarger, A., & Bakia, M. (2009). Implementing Data-Informed Decision Making in Schools--Teacher Access, Supports and Use. Report prepared for U. Menlo Park, CA: S. Department of Education, Office of Planning, Evaluation and Policy Development. Prepared by SRI International.
59. Mislevy, R. J. (1995). Probability-based reasoning in cognitive diagnosis. In Nichols, P., Chipman, S., & Brennan, R. (Eds.), Cognitively Diagnostic Assessment. Hillsdale, NJ: Erlbaum.
60. Mislevy, R. J., & Gitomer, D. H. (1996). The role of probability-based inference in an intelligent tutoring system. User Modeling and User-Adapted Interaction, 5, 253-282. doi:10.1007/BF01126112
61. Mislevy, R. J., Steinberg, L. S., & Almond, R. G. (2003). On the structure of educational assessments. Measurement: Interdisciplinary Research and Perspectives, 1, 3-67. doi:10.1207/S15366359MEA0101_02
62. Mitrovic, A., & Martin, B. (2002). Evaluating the Effects of Open Student Models on Learning. In P. De Bra, P. Brusilovsky & R. Conejo (Eds.), Adaptive Hypermedia and Adaptive WebBased Systems, Proceedings of Second International Conference. Berlin Heidelberg, Germany: Springer-Verlag.
63. No Child Left Behind Act of 2001, Pub. L. No. 107-110, 115 Stat. 1425. (2002). No Child Left Behind Act of 2001. Retrieved September 6, 2005, from www.ed.gov/legislation/ESEA02/
64. Nuzzo-Jones, G., Walonoski, J. A., Heffernan, N. T., & Livak, T. (2005). The eXtensible tutor architecture: A new foundation for ITS. Presented at theWorkshop on Adaptive Systems for Web-Based Education: Tools and Reusability held at the 12th Annual Conference on Artificial Intelligence in Education. Amsterdam, Netherlands.
65. Olson, L. (2005). Special report: testing takes off. Education Week, November 30, 10-14.
66. Pardos, Z., & Heffernan, N. (2009a). Detecting the Learning Value of Items in a Randomized Problem Set. In Proceedings of the 14th International Conference on Artificial Intelligence in Education (AIED-2009). IOS Press. Brighton, UKrx.
67. Pardos, Z., & Heffernan, N. T. (2009b). Determining the Significance of Item Order In Randomized Problem Sets. In Proceedings of the Second International Conference on Educational Data Mining. Cordoba, Spain.
68. Pardos, Z. A., Feng, M., Heffernan, N. T., & Heffernan, C. L. (2007). Analyzing Fine-Grained Skill Models Using Bayesian and Mixed Effect Methods. In Luckin & Koedinger (Eds.). In Proceedings of the 13th Conference on Artificial Intelligence in Education. pp. 626-628. Amsterdam, Netherlands: IOS Press
69. Pardos, Z. A., Heffernan, N. T., Anderson, B., & Heffernan, C. L. (2006). Using Fine Grained Skill Models to Fit Student Performance with Bayesian Networks. Workshop in Educational Data Mining held at the Eighth International Conference on Intelligent Tutoring Systems. Taiwan.
70. Patvarczki, J., Almeida, S., Beck, J., & Heffernan, N. T. (2008). Lessons Learned from Scaling Up a Web-Based Intelligent Tutoring System. In Woolf & Aimeur (Eds.), Proceeding of the 9th International Conference on Intelligent Tutoring Systems. Berlin, Germany: Springer-Verlagrx.
71. th International Conference on Artificial Intelligence in Education. Brighton, UK.
72. Ramírez, E., & Clark, K. (2009, Feb/). What Arne Duncan Thinks of No Child Left Behind: The new education secretary talks about the controversial law and financial aid forms. Retrieved on March 8, 2009, from http://www.usnews.com/articles/education/2009/02/05/what-arne-duncan-thinks-of-no-child-left-behind.html
73. Rasch, G. (1960/1980). Probabilistic models for some intelligence and attainment tests. (Copenhagen, Danish Institute for Educational Research), expanded edition (1980) with foreword and afterword by B. D. Wright. Chicago: The University of Chicago Press.
74. Razzaq, L., Feng, M., Nuzzo-Jones, G., Heffernan, N. T., Koedinger, K. R., Junker, B., Upalekar, R., Walonoski, J. A., Macasek, M. A., & Rasmussen, K. P. (2005). The Assistment Project: Blending Assessment and Assisting. In C.K. Looi, G.McCalla, B. Bredeweg, & J. Breuker (Eds.) Proceedings of the 12th Artificial Intelligence In Education,(pp 555-562). Amsterdam: ISO Press.
75. Razzaq, L., & Heffernan, N. T. (2006). Scaffolding vs. hints in the Assistment System. In Ikeda, Ashley & Chan (Eds.), Proceedings of the 8th International Conference on Intelligent Tutoring Systems, (pp. 635-644). Springer-Verlag: Berlin.
76. Razzaq, L., Heffernan, N. T., & Lindeman, R. W. (2007). What level of tutor interaction is best? In Luckin & Koedinger (Eds.), Proceedings of the 13th Conference on Artificial Intelligence in Education. Amsterdam: IOS Press.
77. Razzaq, L., Parvarczki, J., Almeida, S. F., Vartak, M., Feng, M., Heffernan, N. T., & Koedinger, K. (2009). The ASSISTment builder: Supporting the Life-cycle of ITS Content Creation. IEEE Transactions on Learning Technologies.
78. Renkl, A. (1997). Learning from worked-out examples: A study on individual differences. Cognitive Science, 21, 1-29. doi:10.1207/s15516709cog2101_1
79. Ritter, S., & Koedinger, K. (1996). An architecture for plug-in tutor agents. Journal of Artificial Intelligence in Education, 7(3-4), 315-347.
80. Rothman, S. (2001). 2001 MCAS Reporting Workshop: The second generation of MCAS results. Massachusetts Department of Education. Retrieved November 2006, from www.doe.mass.edu/mcas/2001/news/reportingwkshp.pps
81. Russell, M., & Masters, J. (2009). Formative Assessment Tools for Algebra and Geometry. Presentation at Technology Supports for Formative Assessment Symposium of 2009 American Educational Research Association (AERA) Annual Meeting. San Diego, CA.
82. Sao Pedro, M., Gobert, J., Heffernan, N., & Beck, J. (2009). Comparing Pedagogical Approaches for Teaching the Control of Variables Strategy. In Proceedings of the Cognitive Science Society Annual 2009 Conference. Amsterdam.
83. Singer, J. D., & Willett, J. B. (2003). Applied longitudinal data analysis: Modeling change and occurrence. New York: Oxford University Press. doi:10.1093/acprof:oso/9780195152968.001.0001
84. Stiggins, R. (2005). From formative assessment to assessment FOR learning: A path to success in standards-based schools. Phi Delta Kappan, 87(4), 324-328.
85. Tatsuoka, K. K. (1990). Toward an Integration of Item Response Theory and Cognitive Error Diagnosis. In Frederiksen, N., Glaser, R., Lesgold, A., & Shafto, M. G. (Eds.), Diagnostic monitoring of skill and knowledge acquisition (pp. 453-488). Hillsdale, NJ: Lawrence Erlbaum Associates.
86. Turner, T. E., Macasek, M. A., Nuzzo-Jones, G., & Heffernan, N. T. (2005). The ASSISTment Builder: A Rapid Development Tool for ITS. In Proceedings of the 12th Annual Conference on Artificial Intelligence in Education. (pp. 929-231). Amsterdam: IOS Press.
87. United States Department of Education. (2003). Using data to influence classroom decisions. Washington, DC. Retrieved November 2008, from http://www.ed.gov/teachers/nclbguide/datadriven.pdf
88. Van der Linden, W. J., & Hambleton, R. K. (Eds.) (1997). Handbook of Modern Item Response Theory. New York: Springer-Verlag.
89. VanLehn, K., Lynch, C., Schulze, K., Shapiro, J. A., Shelby, R., & Taylor, L. (2005). The Andes Physics Tutoring System: Lessons Learned. International Journal of Artificial Intelligence in Education, 15(3), 1-47.
90. Walonoski, J., & Heffernan, N. T. (2006). Detection and Analysis of Off-Task Gaming Behavior in Intelligent Tutoring Systems. In Ikeda, Ashley & Chan (Eds.), Proceedings of the 8th International Conference on Intelligent Tutoring Systems (pp. 382-391). Springer-Verlag: Berlin.
91. Wiliam, D. (2006). Formative Assessment: Getting the focus right. Educational Assessment, 11(3&4), 283-289. doi:10.1207/s15326977ea1103&4_7
92. Wongchokprasitti, C., & Brusilovsky, P. (2007). NewsMe: A Case Study for Adaptive News Systems with Open User Model. In Proceedings of The Third International Conference on Autonomic and Autonomous Systems, ICAS, IEEE Press.
93. Yun, J. T., Willet, J., & Murnane, R. (2004) Accountability-Based Reforms and Instruction: Testing Curricular Alignment for Instruction Using the Massachusetts Comprehensive Assessment System. Paper presented at the Annual American Educational Research Association Meeting. San Diego, California.