Adaptive training environment without prior knowledge: Modeling feedback selection as a multi-armed bandit problem

UMAP 2016 - Proceedings of the 2016 Conference on User Modeling Adaptation and Personalization

Volumn , Issue , 2016, Pages 131-139

  Frenoy, Rémy ^a   Soullard, Yann ^a   Thouvenin, Indira ^a   Gapenne, Olivier ^a  

^a SORBONNE UNIVERSITÉ   (France)

Author keywords

Adaptive feedback selection; Adaptive Pedagogical Action Selection; Intelligent tutoring system; Multi armed bandit

Indexed keywords

COMPUTER AIDED INSTRUCTION; EDUCATION; EDUCATION COMPUTING; PERSONNEL TRAINING; PROBABILITY; STATISTICS; TEACHING;

ACTION SELECTION; ADAPTIVE FEEDBACK; INTELLIGENT TUTORING; INTELLIGENT TUTORING SYSTEM; LEARNING ENVIRONMENTS; MULTI ARMED BANDIT; MULTI-ARMED BANDIT PROBLEM; SIMULATED ENVIRONMENT;

STUDENTS;

EID: 84984866206     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2930238.2930256     Document Type: Conference Paper

References (31)

1. S. C. Abdullah and R. E. Cooley. Using simulated students to evaluate an adaptive testing system. In Computers in Education, 2002. Proceedings. International Conference on, pages 614-618. IEEE, 2002.
2. D. Boud and E. Molloy. Feedback in higher and professional education: understanding it and doing it well. Routledge, 2013.
3. J. Bravo and A. Ortigosa. Validating the evaluation of adaptive systems by user profile simulation. In Proceedings of workshop held at the fourth international conference on adaptive hypermedia and adaptive web-based systems (AH2006), pages 479-483, 2006.
4. P. Brusilovsky and E. Millfian. User models for adaptive hypermedia and adaptive educational systems. In The adaptive web, pages 3-53. Springer-Verlag, 2007.
5. S. Bubeck and N. Cesa-Bianchi. Regret analysis of stochastic and nonstochastic multi-armed bandit problems. arXiv preprint arXiv:1204.5721, 2012.
6. R. A. Calvo and R. A. Ellis. Students' conceptions of tutor and automated feedback in professional writing. Journal of Engineering Education, 99(4):427-438, 2010.
7. K. Chrysafiadi and M. Virvou. Student modeling approaches: A literature review for the last decade. Expert Systems with Applications, 40(11):4715-4729, Sept. 2013.
8. A. T. Corbett and J. R. Anderson. Knowledge tracing: Modeling the acquisition of procedural knowledge. User modeling and user-adapted interaction, 4(4):253-278, 1994.
9. M. C. Desmarais and R. S. d Baker. A review of recent advances in learner and skill modeling in intelligent learning environments. User Modeling and User-Adapted Interaction, 22(1-2):9-38, 2012.
10. F. A. Dorfica, L. V. Lima, M. A. Fernandes, and C. R. Lopes. Comparing strategies for modeling students learning styles through reinforcement learning in adaptive and intelligent educational systems: An experimental analysis. Expert Systems with Applications, 40(6):2092-2101, May 2013.
11. R. Frenoy, I. Thouvenin, Y. Soullard, and O. Gapenne. CalliSmart: an Adaptive Informed Environment for Intelligent Calligraphy Training. In The Ninth International Conference on Advances in Computer-Human Interactions (ACHI 16), Venice, 2016.
12. R. Glaser, A. Lesgold, and S. Lajoie. Toward a cognitive theory for the measurement of achievement. In The influence of cognitive psychology on testing, pages 41-85. Hillsdale: Erlbaum, 1987.
13. J. Hattie. Visible learning for teachers: Maximizing impact on learning. Routledge, 2012.
14. T. Käser, S. Klingler, A. G. Schwing, and M. Gross. Beyond knowledge tracing: Modeling skill topologies with bayesian networks. In Intelligent Tutoring Systems, pages 188-198. Springer, 2014.
15. V. Kuleshov and D. Precup. Algorithms for multi-armed bandit problems. Journal of Machine Learning, 2010.
16. T. Lu, D. Pfial, and M. Pfial. Contextual multi-armed bandits. In International Conference on Artificial Intelligence and Statistics, pages 485-492, 2010.
17. M. Mayo and A. Mitrovic. Optimising ITS behaviour with Bayesian networks and decision theory. International Journal of Artificial Intelligence in Education, 12(2):124-153, 2001.
18. L. N. Michaud and K. F. McCoy. Empirical derivation of a sequence of user stereotypes for language learning. User Modeling and User-Adapted Interaction, 14(4):317-350, 2004.
19. S. Mitra and T. Acharya. Gesture Recognition: A Survey. IEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews), 37(3):311-324, May 2007.
20. A. Mitrovic and S. Ohlsson. Constraint-based knowledge representation for individualized instruction. Computer Science and Information Systems, 3(1):1-22, 2006.
21. S. Ohlsson. Constraint-based student modeling. In Student modelling: the key to individualized knowledge-based instruction, pages 167-189. Springer, 1994.
22. P.M. Fitts and M.I. Posner. Human performance. Belmont, CA: Brooks/Cole, 1967.
23. E. Rich. User modeling via stereotypes. Cognitive science, 3(4):329-354, 1979.
24. S. L. Scott. A modern Bayesian look at the multi-armed bandit. Applied Stochastic Models in Business and Industry, 26(6):639-658, Nov. 2010.
25. E. Sklar, A. D. Blair, and J. B. Pollack. Co-evolutionary learning: Machines and humans schooling together. In Workshop on Current Trends and Applications of Artificial Intelligence in Education: 4th World Congress on Expert Systems. Citeseer, 1998.
26. A. Slivkins. Contextual bandits with similarity information. The Journal of Machine Learning Research, 15(1):2533-2568, 2014.
27. N. Spada and P. M. Lightbown. Instruction and the development of questions in l2 classrooms. Studies in Second Language Acquisition, 15(02):205-224, 1993.
28. P. Suraweera and A. Mitrovic. An intelligent tutoring system for entity relationship modelling. International Journal of Artificial Intelligence in Education, 14(3, 4):375-417, 2004.
29. J. Vermorel and M. Mohri. Multi-armed bandit algorithms and empirical evaluation. In Machine learning: ECML 2005, pages 437-448. Springer, 2005.
30. M. Virvou, K. Manos, and G. Katsionis. An evaluation agent that simulates students' behaviour in intelligent tutoring systems. In Systems, Man and Cybernetics, 2003. IEEE International Conference on, volume 5, pages 4872-4877. IEEE, 2003.
31. G. Westerfield, A. Mitrovic, and M. Billinghurst. Intelligent augmented reality training for assembly tasks. In Artificial Intelligence in Education, pages 542-551. Springer, 2013.