Modeling a student's behavior in a tutorial-like system using learning automata

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 40, Issue 2, 2010, Pages 481-492

  Oommen, B John ^a,b   Hashem, M Khaled ^c  

^a CARLETON UNIVERSITY   (Canada)

^b UNIVERSITY OF AGDER   (Norway)

^c MKH Consulting Inc   (Canada)

Author keywords

Learning automata (LAs); Modeling of adaptive systems; Student modeling; Tutorial like systems

Indexed keywords

BLACK BOXES; LEARNING AUTOMATA; LEARNING AUTOMATA (LAS); LEARNING MECHANISM; LEARNING MODELS; LONG-TERM GOALS; OPTIMAL TEACHING; STUDENT MODELING;

ADAPTIVE SYSTEMS; AUTOMATA THEORY; PHILOSOPHICAL ASPECTS; ROBOTS; STUDENTS; TRANSLATION (LANGUAGES);

MATHEMATICAL MODELS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; BIOLOGICAL MODEL; HUMAN; LEARNING; STATISTICS; STUDENT; TEACHING;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; HUMANS; LEARNING; MODELS, BIOLOGICAL; STOCHASTIC PROCESSES; STUDENTS; TEACHING;

EID: 77949775861     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2009.2027220     Document Type: Article

References (60)

1. N. Abe and M. Warmuth, "On the computational complexity of approximating distributions by probabilistic automata," Mach. Learn., vol.9, pp. 205-260, 1998.
2. M. Agache, "Families of estimator-based stochastic learning algorithms," M.S. thesis, School Comput. Sci., Carleton Univ., Ottawa, ON, Canada, 2000.
3. M. Agache and B. J. Oommen, "Generalized pursuit learning schemes: New families of continuous and discretized learning automata," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol.32, no.6, pp. 738-749, Dec. 2002.
4. N. Baba, T. Soeda, and Y.Mogami, "An application of stochastic automata to the investment game," Int. J. Syst. Sci., vol.11, no.12, pp. 1447-1457, Dec. 1980.
5. P. Baffes and R. Mooney, "Refinement-based student modeling and automated bug library construction," J. Artif. Intell. Educ., vol.7, no.1, pp. 75-116, 1996.
6. J. Beck, "Learning to teach with a reinforcement learning agent," in Proc. 15th Nat. Conf. AI/IAAI, Madison, WI, 1998, p. 1185.
7. H. Beigy and M. R. Meybodi, "Adaptation of parameters of BP algorithm using learning automata," in Proc. VI Brazilian Symp. Neural Netw. (SBRN), 2000, pp. 24-31.
8. T. Dean, D. Angluin, K. Basye, S. Engelson, L. Kaelbling, E. Kokkevis, and O. Maron, "Inferring finite automata with stochastic output functions and an application to map learning," Mach. Learn., vol.18, no.1, pp. 81- 108, Jan. 1995.
9. E. Fischetti and A. Gisolfi, "From computer-aided instruction to intelligent tutoring systems," Educ. Technol., vol.30, no.8, pp. 7-17, Aug. 1990.
10. T. Gordon, C. Marsh, and Q. H.Wu, "Stochastic optimal control of vehicle suspension systems using learning automata," Proc. Inst. Mech. Eng., Pt. I. J. Syst. Control Eng., vol.207, no.13, pp. 143-152, 1993.
11. M. K. Hashem, "Learning automata based intelligent tutorial-like systems," Ph.D. dissertation, School Comput. Sci., Carleton Univ., Ottawa, ON, Canada, 2007.
12. M. K. Hashem and B. J. Oommen, "Using learning automata to model a student-classroom interaction in a tutorial-like system," in Proc. IEEE Int. Conf. SMC, Montreal, QC, Canada, Oct. 2007, pp. 1177-1182.
13. M. N. Howell and M. C. Best, "On-line PID tuning for engine idlespeed control using continuous action reinforcement learning automata," Control Eng. Pract., vol.8, no.2, pp. 147-154, Feb. 2000.
14. M. N. Howell and T. J. Gordon, "Continuous learning automata and adaptive digital filter design," in Proc. UKACC Int. Conf. CONTROL, IEEE Conf. Publication No.455, 1998, vol.1, pp. 100-105.
15. S. Lakshmivarahan, Learning Algorithms Theory and Applications. New York: Springer-Verlag, 1981.
16. S. Lakshmivarahan, "Two person decentralized team with incomplete information," Appl. Math. Comput., vol.8, pp. 51-78, 1981.
17. J. K. Lanctôt, "Discrete estimator algorithms: A mathematical model of computer learning," M.S. thesis, Dept. Math. Statist., Carleton Univ., Ottawa, ON, Canada, 1989.
18. J. K. Lanctôt and B. J. Oommen, "Discretized estimator learning automata," IEEE Trans. Syst., Man, Cybern., vol.22, no.6, pp. 1473-1483, Nov./Dec. 1992.
19. R. S. Legaspi and R. C. Sison, "Modeling the tutor using reinforcement learning," in Proc. PCSC, 2000, pp. 194-196.
20. M. R. Meybodi, "Learning automata and its application to priority assignment in a queueing system with unknown characteristics," Ph.D. dissertation, School Elect. Eng. Comput. Sci., Univ. Oklahoma, Norman, OK, 1983.
21. K. Najim and A. S. Poznyak, Learning Automata: Theory and Applications. Oxford, U.K.: Pergamon, 1994.
22. K. S. Narendra and K. Parthasarathy, "Learning automata approach to hierarchical multiobjective analysis," IEEE Trans. Syst., Man, Cybern., vol.21, no.1, pp. 263-273, Jan./Feb. 1991.
23. K. S. Narendra and M. A. L. Thathachar, "Learning automata: A survey," IEEE Trans. Syst., Man, Cybern., vol.SMC-4, no.4, pp. 323-334, Jul. 1974.
24. K. S. Narendra and M. A. L. Thathachar, "On the behavior of a learning automata in a changing environment with routing applications," IEEE Trans. Syst., Man, Cybern., vol.SMC-10, no.5, pp. 262-269, May 1980.
25. K. S. Narendra and M. A. L. Thathachar, Learning Automata: An Introduction. Englewood Cliffs, NJ: Prentice-Hall, 1989.
26. K. S. Narendra, E. Wright, and L. G. Mason, "Applications of learning automata to telephone traffic routing," IEEE Trans. Syst., Man, Cybern., vol.SMC-7, no.11, pp. 785-792, Nov. 1977.
27. M. S. Obaidat, G. I. Papadimitrious, and A. S. Pomportsis, "Learning automata: Theory, paradigms, and applications," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol.32, no.6, pp. 706-709, Dec. 2002.
28. N. Omar and A. S. Leite, "The learning process mediated by intelligent tutoring systems and conceptual learning," in Proc. Int. Conf. Eng. Educ., Rio de Janeiro, Brazil, 1998, p. 20.
29. B. J. Oommen, "Absorbing and ergodic discretized two-action learning automata," IEEE Trans. Syst.,Man, Cybern., vol.SMC-16, no.2, pp. 282- 293, Mar./Apr. 1986.
30. B. J. Oommen and M. Agache, "Continuous and discretized pursuit learning schemes: Various algorithms and their comparison," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol.31, no.3, pp. 277-287, Jun. 2001.
31. B. J. Oommen and J. P. R. Christensen, " optimal discretized rewardpenalty learning automata," IEEE Trans. Syst., Man, Cybern., vol.18, no.3, pp. 451-457, May/Jun. 1988.
32. B. J. Oommen and E. V. de St. Croix, "String taxonomy using learning automata," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol.27, no.2, pp. 354-365, Apr. 1997.
33. B. J. Oommen and E. V. de St. Croix, "Graph partitioning using learning automata," IEEE Trans. Comput., vol.45, no.2, pp. 195-208, Feb. 1996.
34. B. J. Oommen and E. R. Hansen, "The asymptotic optimality of discretized linear reward-inaction learning automata," IEEE Trans. Syst., Man, Cybern., vol.SMC-14, no.3, pp. 542-545, May/Jun. 1984.
35. B. J. Oommen and J. K. Lanctôt, "Discretized pursuit learning automata," IEEE Trans. Syst., Man, Cybern., vol.20, no.4, pp. 931-938, Jul./Aug. 1990.
36. B. J. Oommen and D. C. Y. Ma, "Deterministic learning automata solutions to the equi-partitioning problem," IEEE Trans. Comput., vol.37, no.1, pp. 2-13, Jan. 1988.
37. B. J. Oommen and D. C. Y. Ma, "Stochastic automata solutions to the object partitioning problem," Comput. J., vol.35, pp. A105-A120, 1992.
38. B. J. Oommen and T. D. Roberts, "Continuous learning automata solutions to the capacity assignment problem," IEEE Trans. Comput., vol.49, no.6, pp. 608-620, Jun. 2000.
39. G. I. Papadimitriou and D. G. Maritsas, "Learning automata-based receiver conflict avoidance algorithms for WDM broadcast-and-select star networks," IEEE/ACM Trans. Netw., vol.4, no.3, pp. 407-412, Jun. 1996.
40. G. I. Papadimitriou, P. Nicopolitidis, and A. S. Pomportsis, "Self-adaptive polling protocols for wireless LANs: A learning-automata- based approach," in Proc. IEEE ICECS, St. Julian's, Malta, Sep. 2001, pp. 1309- 1312.
41. G. I. Papadimitriou and A. S. Pomportsis, "Self-adaptive TDMA protocols for WDM star networks: A learning-automata approach," IEEE Photon. Technol. Lett., vol.11, no.10, pp. 1322-1324, Oct. 1999.
42. G. I. Papadimitriou and A. S. Pomportsis, "Learning-automata-based MAC protocols for photonic LANs," in Proc. IEEE ICON, Singapore, Sep. 5-8, 2000, p. 481.
43. G. I. Papadimitriou and A. S. Pomportsis, "On the use of stochastic estimator learning automata for dynamic channel allocation in broadcast networks," in Proc. IEEE/CEC, San Diego, CA, Jul. 2000, pp. 112-116.
44. G. I. Papadimitriou, A. L. Vakali, and A. S. Pomportsis, "Designing a learning-automata-based controller for client/server systems: A methodology," in Proc. 12th IEEE ICTAI, Vancouver, BC, Canada, Nov. 2000, pp. 422-425.
45. A. S. Poznyak and K. Najim, Learning Automata and Stochastic Optimization. Berlin, Germany: Springer-Verlag, 1997.
46. A. S. Poznyak, K. Najim, and M. Chtourou, "Learning automata with continuous inputs and their application for multimodal functions optimization," Int. J. Syst. Sci., vol.27, no.1, pp. 87-95, Jan. 1996.
47. R. Ramesh, "Learning automata in pattern classification," M.E. thesis, Indian Inst. Sci., Bangalore, India, 1983.
48. J. R. Sanders, presented at the 24th Annu. Meeting Joint Committee Stand. Educ. Eval., Oct. 1998. [Online]. Available: http://www.wmich. edu/evalctr/jc/Minutes/JCMinutes98.htm
49. P. S. Sastry, "Systems of learning automata: Estimator algorithms applications," Ph.D. dissertation, Dept. Elect. Eng., Indian Inst. Sci., Bangalore, India, Jun. 1985.
50. J. Self, "The defining characteristics of intelligent tutoring systems research: ITSs care, precisely," Int. J. Artif. Intell. Educ., vol.10, pp. 350- 364, 1999.
51. F. Seredynski, "Distributed scheduling using simple learning machines," Eur. J. Oper. Res., vol.107, no.2, pp. 401-413, Jun. 1998.
52. C. K. K. Tang and P. Mars, "Games of stochastic learning automata and adaptive signal processing," IEEE Trans. Syst., Man, Cybern., vol.23, no.3, pp. 851-856, May/Jun. 1993.
53. M. A. L. Thathachar and B. J. Oommen, "Discretized reward-inaction learning automata," J. Cybern. Inf. Sci., vol.2, no.1, pp. 24-29, Spring 1979.
54. M. A. L. Thathachar and P. S. Sastry, "A new approach to designing reinforcement schemes for learning automata," IEEE Trans. Syst., Man, Cybern., vol.SMC-15, no.1, pp. 168-175, Jan./Feb. 1985.
55. M. A. L. Thathachar and P. S. Sastry, "Varieties of learning automata: An overview," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol.32, no.6, pp. 711-722, Dec. 2002.
56. M. A. L. Thathachar and P. S. Sastry, Networks of Learning Automata: Techniques for Online Stochastic Optimization. Boston, MA: Kluwer, 2003.
57. M. L. Tsetlin, Automaton Theory and the Modeling of Biological Systems. New York: Academic, 1973.
58. C. Ünsal, P. Kachroo, and J. S. Bay, "Multiple stochastic learning automata for vehicle path control in an automated highway system," IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol.29, no.1, pp. 120-128, Jan. 1999.
59. R. Winkels and J. Breuker, "What's in an ITS? a functional decomposition," in New Directions for Intelligent Tutoring Systems, E. Costa, Ed. Berlin, Germany: Springer-Verlag, 1990.
60. Q. H. Wu, "Learning coordinated control of power systems using interconnected learning automata," Int. J. Elect. Power Energy Syst., vol.17, no.2, pp. 91-99, Apr. 1995.