Generalized pursuit learning schemes: New families of continuous and discretized learning automata

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 32, Issue 6, 2002, Pages 738-749

  Agache, Mariana ^a   Oommen, B John ^a  

^a CARLETON UNIVERSITY   (Canada)

Author keywords

Estimator algorithms; Learning automata (LA); Pursuit algorithms

Indexed keywords

CONVERGENCE OF NUMERICAL METHODS; LEARNING ALGORITHMS; LEARNING SYSTEMS; OPTIMAL SYSTEMS; PROBABILITY;

ESTIMATOR ALGORITHMS; PURSUIT ALGORITHMS;

AUTOMATA THEORY;

EID: 0036896733     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2002.1049608     Document Type: Article

References (58)

1. N. Baba, T. Soeda, and Y. Sawaragi, "An application of stochastic automata to the investment game," Int. J. Syst. Sci., vol. 11, pp. 1447-1457, Dec. 1980.
2. S. Lakshmivarahan, Learning Algorithms Theory and Applications. New York: Springer-Verlag, 1981.
3. _, "Two person decentralized team with incomplete information," Appl. Math. Comput., vol. 8, pp. 51-78, 1981.
4. S. Lakshmivarahan and M.A.L. Thathachar, "Absolutely expedient algorithms for stochastic automata," IEEE Trans. Syst., Man, Cybern., vol. SMC-3, pp. 281-286, 1973.
5. J.K. Lanctôt, "Discrete estimator algorithms: A mathematical model of computer learning," M.Sc. thesis, Dept. Math. Statist, Carleton Univ., Ottawa, ON, Canada, 1989.
6. J.K. Lanctôt and B.J. Oommen, "Discretized estimator learning automata," IEEE Trans. Syst., Man, Cybern., vol. 22, pp. 1473-1483, Nov. 1992.
7. M.R. Meybodi, "Learning automata and its application to priority assignment in a queuing system with unknown characteristic," Ph.D. dissertation, School Elect. Eng. Comput. Sci., Univ. Oklahoma, Norman.
8. K.S. Narendra and S. Lakshmivarahan, "Learning Automata: A critique," J. Cybern. Inform. Sci., vol. 1, pp. 53-66, 1987.
9. K.S. Narendra and M.A.L. Thathachar, Learning Automata. Englewood Cliffs, NJ: Prentice-Hall, 1989.
10. _, "Leaming automata-A survey," IEEE Trans, Syst., Man, Cybern., vol. SMC-4, pp. 323-334, 1974.
11. _, "On the behavior of a learning automata in a changing environment with routing applications," IEEE Trans. Syst., Man, Cybern., vol. SMC-10, pp. 262-269, 1980.
12. K.S. Narendra, E. Wright, and L.G. Mason, "Applications of learning automata to telephone traffic routing," IEEE Trans. Syst, Man, Cybern., vol. SMC-7, pp. 785-792, 1977.
13. B.J. Oommen, "Absorbing and ergodic discretized two-action learning automata," IEEE Trans. Syst., Man, Cybern., vol. SMC-16, pp. 282-296, 1986.
14. B.J. Oommen and J.R.P. Christensen, "Epsilon-optimal discretized reward-penalty learning automata," IEEE. Trans. Syst., Man, Cybern., vol. 18, pp. 451-458, May 1988.
15. B.J. Oommen anal E.R. Hansen, "The asymptotic optimality of discretized linear reward-inaction leaming automata," IEEE. Trans. Syst., Man, Cybern., vol. SMC-14, pp. 542-545, May 1984.
16. B.J. Oommen and J.K. Lanctôt, "Discretized pursuit learning automata," IEEE Trans. Syst., Man, Cybern., vol. 20, pp. 931-938, July 1990.
17. B.J. Oommen and D.C.Y. Ma, "Deterministic learning automata solutions to the equipartitioning problem," IEEE Trans. Comput., vol. 37, pp. 2-14, Jan. 1988.
18. _, "Stochastic automata solutions to the object partitioning problem," Comput. J., vol. 35, pp. A105-A120, 1992.
19. B.J. Oommen and M.A.L. Thathachar, "Multiaction learning automata possessing ergodicity of the mean," Inf. Sci., vol. 35, pp. 183-198, June 1985.
20. B.J. Oommen and M. Agache, "Continuous and discretized pursuit learning schemes: Various algorithms and their comparison," IEEE Trans. Syst., Man, Cybern. B, vol. 31, pp. 277-287, June 2001.
21. R. Ramesh, "Learning automata in pattern classification," M.E. thesis, Indian Inst. Sci., Bangalore, India, 1983.
22. M.A.L. Thathachar and B.J. Oommen, "Discretized reward-inaction learning automata," J. Cybern. Inf. Sci., pp. 24-29, Spring 1979.
23. M.A.L. Thathachar and P.S. Sastry, "A class of rapidly converging algorithms for learning automata," IEEE Trans. Syst., Man, Cybern., vol. SMC-15, pp. 168-175, 1985.
24. _, "Estimator Algorithms for Learning Automata," in Proc. Platinum Jubilee Conf on Syst. Signal Processing. Bangalore, India: Dept. Elect. Eng., Indian Inst. Sci., Dec. 1986.
25. M.L. Tsetlin, "On the behavior of finite automata in random media," in Proc. Automat. Telemek., vol. 22, USSR, Oct. 1961, pp. 1345-1354.
26. _, Automaton Theory and the Modeling of Biological Systems. New York: Academic, 1973.
27. V.I. Varshavskii and I.P. Vorontsova, "On the behavior of stochastic automata with variable structure," in Proc. Automat. Telemek., vol. 24, USSR, 1963, pp. 327-333.
28. H. Beigy and M.R. Meybodi, "Adaptation of parameters of BP algorithm using learning automata," in Proc. VI SBRN'00.
29. A.A. Economides, "Multiple response learning automata," IEEE Trans. Syst., Man, Cybern. A, vol. 26, pp. 153-156, Jan. 1996.
30. M.N. Howell and M.C. Best, "On-line PID tuning for engine idle-speed control using continuous action reinforcement learning automata," J. Control Eng. Prac., vol. 8, pp. 147-154, 1999.
31. K. Najim and A.S. Poznyak, Learning Automata: Theory and Applications. New York: Pergamon, 1994.
32. B.J. Oommen and T.D. Roberts, "Continuous learning automata solutions to the capacity assignment problem," IEEE Trans. Comput., vol. 49, pp. 608-620, June 2000.
33. G.I. Papadimitriou, "A new approach to the design of reinforcement schemes for learning automata: Stochastic estimator learning algorithms," IEEE Trans. Knowl. Data Eng., vol. 6, pp. 649-654, 1994.
34. _, "Hierarchical discretized pursuit nonlinear learning automata with rapid convergence and high accuracy," IEEE Trans. Knowl. Data Eng., vol. 6, pp. 654-659, 1994.
35. A.S. Poznyak and K. Najim, Learning Automata and Stochastic Optimization. New York: Springer-Verlag, 1997.
36. G.I. Papadimitriou, P. Nicopolitidis, and A.S. Pomportsis, "Self-adaptive polling protocols for wireless LANs: A learning-automata-based approach," in Proc. ICECS, Malta, Sept. 2001.
37. G.I. Papadimitriou and A.S. Pomportsis, "Self-adaptive TDMA protocols for WDM star networks: A learning-automata approach," IEEE Photon. Technol. Lett., vol. 11, no. Oct., pp. 1322-1324, 1999.
38. _, "On the use of stochastic estimator learning automata for dynamic channel allocation in broadcast networks," in Proc. IEEE/CEC 2000, San Diego, CA, July 2000.
39. F. Seredynski, "Distributed scheduling using simple learning machines," in European Journal of Operational Research 107. Amsterdam, The Netherlands: Elsevier, 1998, pp. 401-413.
40. N. Abe and M. Warmuth, "On the computational complexity of approximating distributions by probabilistic automata," Mach. Learn., vol. 9, pp. 205-260, 1998.
41. T. Dean, D. Angluin, K. Basye, S. Engelson, L. Kaelbling, E. Kokkevis, and O. Maron, "Inferring finite automata with stochastic output functions and an application to map learning," Mach. Learn., vol. 18, pp. 81-108, 1995.
42. M.N. Howell and T.J. Gordon, "Countinous learning automata and adaptive digital filter design," in Proc. UKACC Int. Conf Control, 1998, IEE Conf. Publ. 455.
43. K.S. Narendra and K. Parthasarathy, "Learning automata approach to hierarchical multiobjective analysis," IEEE Trans. Syst., Man, Cybern., vol. 21, pp. 263-273, Jan. 1991.
44. G.I. Papadimitriou and D.G. Maritsas, "Learning automata-based receiver conflict avoidance algorithms for WDM broadcast-and-select star networks," IEEE/ACM Trans. Networking, vol. 4, no. 3, pp. 407-412, 1996.
45. G.I. Papadimitriou and A.S. Pomportsis, "Learning-automata-based MAC protocols for photonic LANs," IEEE Photon. Technol. Lett., vol. 14, p. 481, 2000.
46. G.I. Papadimitriou, A.L. Vakali, and A.S. Pomportsis, "Designing a learning-automata-based controller for client/server systems: A methotodology," in Proc. 12th IEEE ICTAL Vancouver, BC, Canada, Nov. 13-15, 2000.
47. K. Rajaraman and R.S. Sastry, "Finite time analysis of the pursuit algorithm for learning automata," IEEE Trans. Syst., Man, Cybern. A, vol. 26, pp. 590-598, July 1996.
48. M.A.L. Thathachar and M.T. Arvind, "Parallel algorithms for modules of learning automata," IEEE Trans. Syst., Man, Cybern. A, vol. 28, pp. 24-33, Jan. 1998.
49. C.K.K. Tang and P. Mars, "Games of stochastic learning automata and adaptive signal processing," IEEE Trans. Syst., Man, Cybern., vol. 23, pp. 851-856, Aug. 1993.
50. C. Unsal, P. Kachroo, and J.S. Bay, "Multiple stochastic learning automata for vehicle path control in an automated highway system," IEEE Trans. Syst., Man, Cybern. A, vol. 29, pp. 120-128, Jan. 1999.
51. Q.H. Wu, "Learning coordinated control of power systems using interconnected learning automata," Int. J. Electr. Power Energy Syst., vol. 17, no. 2, pp. 91-99, 1995.
52. T. Gordon, C. Marsh, anal Q.H. Wu, "Stochastic optimal control of vehicle suspension systems using learning automata," J. Syst. Conte Eng., pt. I, vol. 207, no. 13, pp. 143-152, 1993.
53. F. Seredynski, J.P. Kitajima, and B. Plateau, "Simulation of learning automata networks on distributed computers," in Proc. Eur. Simulation Symp.: Simulation and AI in Computer-Aided Techniques, Dresden, Germany, Nov. 1992.
54. A.S. Poznyak, K. Najim, and M. Chtourou, "Learning automata with continuous inputs and their application for multimodal functions optimization," Int. J. Syst. Sci., vol. 27, no. 1, pp. 87-96, 1996.
55. G.I. Papadimitriou and A.S. Pomportsis, "Learning-automata-based TDMA protocols for broadcast communication systems with bursty traffic," IEEE Commun. Lett., vol. 4, pp. 107-109, 2000.
56. B.J. Oommen and T. De St. Croix, "String taxonomy using learning automata," IEEE Trans. Syst., Man, Cybern., vol. 27, pp. 354-365, Apr. 1997.
57. _, "Graph partitioning using learning automata," IEEE Trans. Comput., vol. 45, pp. 195-208, 1995.
58. R. Simha and J.F. Kurose, "Relative reward strength algorithms for learning automata," IEEE Trans. Syst., Man, Cybern., vol. 19, pp. 388-398, 1989.