Automated, unobtrusive, action-by-action assessment of self-regulation during learning with an intelligent tutoring system

Educational Psychologist

Volumn 45, Issue 4, 2010, Pages 224-233

  Aleven, Vincent ^a   Roll, Ido ^b   McLaren, Bruce M ^a   Koedinger, Kenneth R ^a  

^a Carnegie Mellon University   (United States)

^b UNIVERSITY OF BRITISH COLUMBIA   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 77958116930     PISSN: 00461520     EISSN: None     Source Type: Journal    
DOI: 10.1080/00461520.2010.517740     Document Type: Review

References (65)

1. Aleven, V., & Koedinger, K. R. (2000). Limitations of student control: Do student know when they need help? In G. Gauthier, C. Frasson, & K. VanLehn (Eds.), Proceedings of the 5th International Conference on Intelligent Tutoring Systems, ITS 2000 (pp. 292-303). Berlin, Germany: Springer Verlag.
2. Aleven, V., McLaren, B. M., Roll, I., & Koedinger, K. R. (2006). Toward meta-cognitive tutoring: A model of help seeking with a cognitive tutor. International Journal of Artificial Intelligence in Education, 16,101-128.
3. Aleven, V., Stahl, E., Schworm, S., Fischer, F., & Wallace, R.M. (2003). Help seeking and help design in interactive learning environments. Review of Educational Research, 73, 277-320.
4. Anderson, J. R. (1993). Rules of the mind. Mahwah, NJ: Erlbaum.
5. Anderson, J. R., Corbett, A. T., Koedinger, K. R., & Pelletier, R. (1995). Cognitive Tutors: Lessons learned. The Journal of the Learning Sciences, 4,167-207.
6. Anderson, J. R., & Lebière, C. (1998). The atomic components of thought. Mahwah, NJ: Erlbaum.
7. Azevedo, R. (2007). Understanding the complex nature of self-regulatory processes in learning with computer-based learning environments: An introduction. Metacognition and Learning, 2, 57-65.
8. Azevedo, R., Cromley, J. G., & Seibert, D. (2004). Does adaptive scaffolding facilitate students' ability to regulate their learning with hypermedia? Contemporary Educational Psychology, 29, 344-370.
9. Baker, R. S. J. d. (2007). Modeling and understanding students' off-task behavior in intelligent tutoring systems. In M. B. Rosson & D. J. Gilmore (Eds.), Proceedings of ACM CHI 2007: Computer-Human Interactio (pp. 1059-1068). New York, NY: ACM.
10. Baker, R., Walonoski, J., Heffernan, N., Roll, I., Corbett, A., & Koedinger, K. (2008). Why students engage in "gaming the system" behavior in interactive learning environments. Journal of Interactive Learning Research, 19,185-224.
11. Bembenutty, H. (2009). Feeling-of-knowing judgment and self-regulation of learning. Education, 129, 589-598.
12. Biswas, G., Leelawong, K., Schwartz, D., Vye, N., & the Teachable Agents Group at Vanderbilt (2005). Learning by teaching: A new agent paradigm for educational software. Applied Artificial Intelligence, 19, 363-392.
13. Brusilovsky, P. (2001). Adaptive hypermedia. User Modeling & UserAdapted Interaction, 11, 87-110.
14. Corbett, A. T., & Anderson, J. R. (1995). Knowledge tracing: Modeling the acquisition of procedural knowledge. User Modeling and User-Adapted Interaction, 4, 253-278.
15. Corbett, A., McLaughlin, M., & Scarpinatto, K. C. (2000). Modeling student knowledge: Cognitive Tutors in high school and college. User Modeling and User-Adapted Interaction, 10, 81-108.
16. de Jong, T., & van Joolingen, W. R. (1998). Scientific discovery learning with computer simulations of conceptual domains. Review of Educational Research, 68, 179-201.
17. Dillon, A., & Gabbard, R.(1998).Hypermedia asan educational technology: A review of the quantitative research literature on learner comprehension, control, and style. Review of Educational Research, 68, 322-349.
18. Edelson, D.C., Gordin, D.N., & Pea, R.D. (1999). Addressing the challenges of inquiry-based learning through technology and curriculum design. The Journal of the Learning Sciences, 8, 391-450.
19. Gross, A. E., & McMullen, P. A. (1983). Models of the help-seeking process. In J. D. Fisher, N. Nadler, & B. M. DePaulo (Eds.), New directions in helping (Vol. 2, pp. 45-61). New York, NY: Academic Press.
20. Hadwin, A. F., Nesbit, J. C., Jamieson-Noel, D., Code, J., & Winne, P. H. (2007). Examining trace data to explore self-regulated learning. Metacognition and Learning, 2, 107-124.
21. Karabenick, S. A. (Ed.). (1998). Strategic help seeking: Implications for learning and teaching. Mahwah, NJ: Erlbaum.
22. Karabenick, S. A., & Newman, R. (Eds.) (2006). Help seeking in academic settings: Goals, groups, and contexts. Mahwah, NJ: Erlbaum.
23. Koedinger, K. R., & Aleven V. (2007). Exploring the assistance dilemma in experiments with Cognitive Tutors. Educational Psychology Review, 19, 239-264.
24. Koedinger, K. R., Aleven, V., Roll, I., & Baker, R. (2009). In vivo experiments on whether supporting metacognition in intelligent tutoring systems yields robust learning. In D. J. Hacker, J. Dunlosky, & A. C. Graesser (Eds.), Handbook of metacognition in education (pp. 897-964). New York, NY: Routledge.
25. Koedinger, K. R., Anderson, J. R., Hadley, W. H., & Mark, M. A. (1997). Intelligent tutoring goes to school in the big city. International Journal of Artificial Intelligence in Education, 8(1), 30-43.
26. Koedinger, K. R., & Corbett, A. T. (2006). Cognitive Tutors: Technology bringing learning science to the classroom. In K. Sawyer (Ed.), The Cambridge handbook of the learning sciences (pp. 61-78). New York, NY: Cambridge University Press.
27. Koedinger, K. R., Corbett, A. C., & Perfetti, C. (2010). The Knowledge-Learning-Instruction (KLI) framework: Toward bridging the science-practice chasm to enhance robust student learning (CMU-HCII Tech Rep. No. 10-102). Available from http://reports-archive.adm.cs.cmu.edu/hcii.html
28. Koedinger, K., Cunningham, K., Skogsholm A., & Leber, B. (2008, June). An open repository and analysis tools for fine-grained, longitudinal learner data. In R. S. J. d. Baker, T. Barnes, & J. E. Beck (Eds.), Educational Data Mining 2008: 1st International Conference on Educational Data Mining, Proceedings (pp. 157-166). Montreal, Quebec, Canada.
29. Koedinger, K. R., Suthers, D. D., & Forbus, K. D. (1999). Component-based construction of a science learning space. International Journal of Artificial Intelligence in Education, 10, 166-175.
30. Kuhn, D., Black, J., Keselman, A., & Kaplan, D. (2000). The development of cognitive skills to support inquiry learning. Cognition and Instruction, 18,495-523.
31. Lovett, M. C.(1998).Cognitive task analysis in service of intelligent tutoring system design: a case study in statistics. In Goettl, B. P., Halff, H. M., Redfield, C. L., & Shute, V. J. (Eds.), Proceedings of the 4th International Conference on Intelligent Tutoring Systems, ITS 2008 (pp. 234-243). Berlin, Germany: Springer-Verlag.
32. Mathan, S. A., & Koedinger, K. R. (2005). Fostering the intelligent novice: Learning from errors with metacognitive tutoring. Educational Psychologist, 40, 257-265.
33. Mevarech, Z. R., & Kramarski, B. (2003). The effects of metacognitive training versus worked-out examples on students' mathematical reasoning. British Journal of Educational Psychology, 73, 449-471.
34. Mitrovic, A., & Ohlsson, S. (1999). Evaluation of a constraint-based tutor for a database language. International Journal of Artificial Intelligence in Education, 10, 238-256.
35. Nelson-Le Gall, S. (1981). Help-seeking: An understudied problem-solving skill in children. Developmental Review, 1, 224-246.
36. Nelson-Le Gall, S. (1985). Help-seeking behavior in learning. Review of Research in Education, 12(1), 55-90.
37. Newell, A. & Simon, H. A. (1972). Human problem solving. Englewood Cliffs, NJ: Prentice-Hall.
38. Newman, R. S. (1998). Adaptive help seeking: A role of social interaction in self-regulated learning. In S. A. Karabenick (Ed.), Strategic help seeking. Implications for learning and teaching (pp. 13-37). Mahwah, NJ: Erlbaum.
39. Newman, R.S. (2008). The motivational role of adaptive help seeking inself-regulated learning. In D.H. Schunk & B.J. Zimmerman (Eds.), Motivation and self-regulated learning: Theory, research, and applications (pp. 315-337). New York, NY: Erlbaum.
40. Pintrich, P. R. (2000). The role of goal orientation in self-regulated learning. In M. Boekaerts, P. R. Pintrich, & M. Zeidner (Eds.), Handbook of selfregulation (pp. 451-502). San Diego, CA: Academic Press.
41. Pintrich, P. R. (2004). A conceptual framework for assessing motivation and self-regulated learning in college students. Educational Psychology Review, 16, 385-407.
42. Roll, I., Aleven, V., & Koedinger, K. R. (2010). The Invention Lab: Using a hybrid of model tracing and constraint-based modeling to offer intelligent support in inquiry environments. In V. Aleven, J. Kay, & J. Mostow (Eds.), Proceedings of the 10th International Conference on Intelligent Tutoring Systems, ITS 2010 (Vol. 1, pp. 115-124). Berlin: Springer.
43. Roll, I., Aleven, V., McLaren, B., & Koedinger, K. (2007a). Can help seeking be tutored? Searching for the secret sauce of metacognitive tutoring. In R. Luckin, K. Koedinger, & J. Greer (Eds.), Proceedings of the 13th International Conference on Artificial Intelligence in Education, AIED 2007 (pp. 203-210). Amsterdam, The Netherlands: IOS Press.
44. Roll, I., Aleven, V., McLaren, B., & Koedinger, K. (2007b). Designing for metacognition -applying Cognitive Tutor principles to metacognitive tutoring. Metacognition and Learning, 2, 125-140.
45. Roll, I., Aleven, V., McLaren, B. M., & Koedinger, K. R. (in press). Online assessment and tutoring of help seeking: Toward domain learning through metacognitive improvement. Learning and Instruction. doi:10.1016/j.learninstruc.2010.07.004
46. Roll, I., Aleven, V., McLaren, B. M., Ryu, E., Baker, R. S., & Koedinger, K. R. (2006). The Help Tutor: does metacognitive feedback improve students' help-seeking actions, skills and learning? In M. Ikeda, K.D. Ashley, & T. W. Chan (Eds.), Proceedings of 8th International Conference on Intelligent Tutoring Systems, ITS 2006 (pp. 360-369). Berlin, Germany: Springer Verlag.
47. Schofield, J. W. (1995). Computers and classroom culture. New York, NY: Cambridge University Press.
48. Shih, B., Koedinger, K. R., & Scheines, R. (2008). A response time model for bottom-out hints as worked examples. In R. S. J. d. Baker, T. Barnes, & J. Beck (Eds.), Educational Data Mining 2008: 1st International Conference on Educational Data Mining, Proceedings (pp. 117-126). Montreal, Quebec, Canada.
49. Tobias, S., & Everson, H. T. (2002). Knowing what you know and what you don't: Further research on metacognitive knowledge monitoring (College Board Research Report No. 2002-3). New York, NY: College Board Publications.
50. VanLehn, K. (2006). The behavior of tutoring systems. International Journal of Artificial Intelligence in Education, 16, 227-265.
51. VanLehn, K., Koedinger, K.R., Skogsholm, A., Nwaigwe, A., Hausmann, R. G. M., Weinstein, A. & Billings, B. (2007). What's in a step? Toward general, abstract representations of tutoring system log data. In C. Conati, K. McCoy, & G. Paliouras (Eds.), Proceedings of the 11th International Conference on User Modeling, UM 2007 (pp.455-459).Berlin,Germany: Springer.
52. VanLehn, K., Lynch, C., Schultz, K., Shapiro, J.A., Shelby, R.H., Taylor, L.,...Wintersgill, M. (2005). The Andes physics tutoring system: Lessons learned. International Journal of Artificial Intelligence in Education, 15, 147-204.
53. Walker, E., Walker, S., Rummel, N., & Koedinger, K. R. (2010). Using problem-solving context to assess help quality in computer-mediated peer tutoring. In V. Aleven, J. Kay, & J. Mostow (Eds.), Proceedings of the 10th International Conference on Intelligent Tutoring Systems, ITS 2010 (Vol. I, pp. 145-155). Berlin, Germany: Springer.
54. Walonoski, J., & Heffernan, N. T. (2006). Detection and analysis of off-task gaming behavior in intelligent tutoring systems. In M. Ikeda, K. D. Ashley & T.-W. Chan (Eds.), Proceedings of the 8th International Conference on Intelligent Tutoring Systems, ITS 2006 (pp. 382-391). Berlin, Germany: Springer-Verlag.
55. Wagster, J., Tan, J., Wu, Y., Biswas, G., & Schwartz, D. (2007). Do learning by teaching environments with metacognitive support help students develop better learning behaviors? In D. S. McNamara & G. Trafton (Eds.), Proceedings of the 29th Meeting of the Cognitive Science Society (pp. 695-700). Austin, TX: Cognitive Science Society.
56. White, B. Y., & Frederiksen, J. R. (1998). Inquiry, modeling, and metacognition: Making science accessible to all students. Cognition and Instruction, 16(1),3-118.
57. Winne, P. H., & Hadwin, A. F. (1998). Studying as self-regulated learning. In D. J. Hacker, J. Dunlosky, & A. C. Graesser (Eds.), Metacognition in educational theory and practice (pp. 279-306). Hillsdale, NJ: Erlbaum.
58. Winne, P. H., & Jamieson-Noel, D. (2002).Exploringstudents' calibration of self report sand study tactics and achievement. Contemporary Educational Psychology, 27, 551-572.
59. Winne, P. H., & Perry, N. E. (2000). Measuring self-regulated learning. In M. Boekaerts, P. R. Pintrich, & M. Zeidner (Eds.), Handbook of selfregulation (pp. 531-566). San Diego, CA: Academic Press.
60. Wood, H., & Wood, D. (1999). Help seeking, learning and contingent tutoring. Computers and Education, 33, 153-169.
61. Woolf, B. P. (2009). Building intelligent interactive tutors: Student-centered strategies for revolutionizing e-learning. Burlington, MA: Morgan Kaufmann.
62. Zimmerman, B. J. (2000). Attaining self-regulation: A social cognitive perspective. In M. Boekaerts, P. R. Pintrich, & M. Zeidner (Eds.), Handbook of self-regulation (pp. 13-39). San Diego, CA: Academic Press.
63. Zimmerman, B. J. (2008). Investigating self-regulation and motivation: Historical background, methodological developments, and future prospects. American Educational Research Journal, 45(1), 166-183.
64. Zimmerman, B.J., & Moylan, A.R. (2009). Self-regulation: Where meta cognition and motivation intersect. In D. J. Hacker, J. Dunlosky, & A. C. Graesser (Eds.), Handbook of metacognition in education (pp. 299-315). New York, NY: Routledge.
65. Zusho, A., Karabenick, S. A., Bonney, C. R., & Sims, B. C. (2007). Contextual determinants of motivation and help seeking in the college classroom. In R. P. Perry, & J. C. Smart (Eds.), The scholarship of teaching and learning in higher education: An evidence-based perspective (pp. 611-659). Dordrecht, The Netherlands: Springer.