Fast and Epsilon-Optimal Discretized Pursuit Learning Automata

IEEE Transactions on Cybernetics

Volumn 45, Issue 10, 2015, Pages 2089-2099

  Zhang, Junqi ^a   Wang, Cheng ^a   Zhou, Mengchu ^a,b  

^a Ministry of Education   (China)

^b NEW JERSEY INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Discretized pursuit learning automata (LA); low computational complexity; Stationary environments

Indexed keywords

AUTOMATA THEORY; COMPUTATIONAL COMPLEXITY;

ACTION-ORIENTED; FAST CONVERGENCE SPEED; FASTER CONVERGENCE; LEARNING AUTOMATA; LEARNING AUTOMATON; LOW COMPUTATIONAL COMPLEXITY; STATE PROBABILITY; STATIONARY ENVIRONMENTS;

REINFORCEMENT LEARNING;

EID: 84911071747     PISSN: 21682267     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCYB.2014.2365463     Document Type: Article

References (64)

1. B. J. Oommen and M. Agache, "Continuous and discretized pursuit learning schemes: Various algorithms and their comparison," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 31, no. 3, pp. 277-287, Jun. 2001.
2. S. Mukhopadhyay and M. A. L. Thathachar, "Associative learning of Boolean functions," IEEE Trans. Syst., Man, Cybern., vol. 19, no. 5, pp. 1008-1015, Sep./Oct. 1989.
3. S. Lakshmivarahan, "Two person decentralized team with incomplete information," Appl. Math. Comput., vol. 8, no. 1, pp. 51-78, 1981.
4. O. Tilak, R. Martin, S. Mukhopadhyay, "Decentralized indirect methods for learning automata games," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 41, no. 5, pp. 1213-1223, Oct. 2011.
5. R. Ramesh, "Learning automata in pattern classification," M.E. thesis, Dept. Elect. Eng., Indian Inst. Sci., Bangalore, India, 1983.
6. P. S. Sastry, G. D. Nagendra, N. Manwani, "A team of continuousaction learning automata for noise-tolerant learning of half-space," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 40, no. 1, pp. 19-28, Feb. 2010.
7. O.-C. Granmo, B. J. Oommen, S. A. Myrer, M. G. Olsen, "Learning automata-based solutions to the nonlinear fractional knapsack problem with applications to optimal resource allocation," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 37, no. 1, pp. 166-175, Feb. 2007.
8. B. J. Oommen and M. K. Hashem, "Modeling a student's behavior in a tutorial-like system using learning automata," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 40, no. 2, pp. 481-492, Apr. 2010.
9. B. J. Oommen and M. K. Hashem, "Modeling a student-classroom interaction in tutorial-like system using learning automata," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 40, no. 1, pp. 29-42, Feb. 2010.
10. B. J. Oommen and D. C. Y. Ma, "Deterministic learning automata solutions to the equipartitioning problem," IEEE Trans. Comput., vol. 37, no. 1, pp. 2-13, Jan. 1988.
11. B. J. Oommen and D. C. Y. Ma, "Fast object partitioning using stochastic learning automata," in Proc. Annu. Int. Conf. Res. Develop. Inf. Retrieval, New Orleans, LA, USA, Jun. 1987, pp. 111-122.
12. B. J. Oommen, R. S. Valiveti, J. R. Zgierski, "An adaptive learning solution to the keyboard optimization problem," IEEE Trans. Syst., Man, Cybern., vol. 21, no. 6, pp. 1608-1618, Nov./Dec. 1991.
13. B. J. Oommen and E. V. De St Croix, "String taxonomy using learning automata," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 27, no. 2, pp. 354-365, Apr. 1997.
14. H. Beigy and M. R. Meybodi, "Cellular learning automata with multiple learning automata in each cell and its applications," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 40, no. 1, pp. 54-65, Feb. 2010.
15. K. S. Narendra, W. E. Allen, L. G. Mason, "Applications of learning automata to telephone traffic routing," IEEE Trans. Syst., Man, Cybern., vol. 7, no. 11, pp. 785-792, Nov. 1977.
16. K. S. Narendra and M. A. L. Thathachar, "On the behavior of a learning automata in a changing environment with routing applications," IEEE Trans. Syst., Man, Cybern., vol. 10, no. 5, pp. 262-269, May 1980.
17. R. Mirchandaney and J. A. Stankovic, "Using stochastic learning automata for job scheduling in distributed processing systems," J. Parallel Distrib. Comput., vol. 3, no. 4, pp. 527-552, 1986.
18. B. J. Oommen, "A learning automaton solution to the stochastic minimum-spanning circle problem," IEEE Trans. Syst., Man, Cybern., vol. 16, no. 4, pp. 598-603, Jul. 1986.
19. S. Misra, B. J. Oommen, S. Yanamandra, M. S. Obaidat, "Random early detection for congestion avoidance in wired networks: A discretized pursuit learning-automata-like solution," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 40, no. 1, pp. 66-76, Feb. 2010.
20. M. N. Howell, T. J. Gordon, F. V. Brandao, "Genetic learning automata for function optimization," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 32, no. 6, pp. 804-815, Dec. 2002.
21. H. Beigy and M. R. Meybodi, "A new continuous action-set learning automaton for function optimization," J. Franklin Inst., vol. 343, no. 1, pp. 27-47, 2006.
22. B. J. Oommen and T. D. Roberts, "Discretized learning automata solutions to the capacity assignment problem for prioritized networks," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 32, no. 6, pp. 821-831, Dec. 2002.
23. M. R. Meybodi, "Learning automata and its application to priority assignment in a queuing system with unknown characteristic," Ph.D. dissertation, Dept. Electr. Eng. Comput. Sci., Univ. Oklahoma, Norman, OK, USA, 1983.
24. G. Horn and B. J. Oommen, "Solving multiconstraint assignment problems using learning automata," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 40, no. 1, pp. 6-18, Feb. 2010.
25. J. S. Riordon, "An adaptive automaton controller for discrete-time Markov processes," Automatica, vol. 5, no. 6, pp. 721-730, 1969.
26. K. S. Narendra and M. A. L. Thathachar, "Learning automata: A survey," IEEE Trans. Syst., Man, Cybern., vol. 4, no. 4, pp. 323-334, Jul. 1974.
27. M. A. L. Thathachar and P. S. Sastry, "Varieties of learning automata: An overview," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 32, no. 6, pp. 711-722, Dec. 2002.
28. S. Lakshmivarahan, Learning Algorithms Theory and Applications. New York, NY, USA: Springer, 1981.
29. K. S. Narendra and M. A. L. Thathachar, Learning Automata: An Introduction. Englewood Cliffs, NJ, USA: Prentice-Hall, 1989.
30. K. Najim and A. S. Poznyak, Learning Automata: Theory and Applications. New York, NY, USA: Pergamon, 1994.
31. A. S. Poznyak and K. Najim, Learning Automata and Stochastic Optimization. New York, NY, USA: Springer, 1997.
32. Y. M. El-Fattah and C. Foulard, Learning Systems: Decision, Simulation and Control. Berlin, Germany: Springer, 1978.
33. M. A. L. Thathachar and B. J. Oommen, "Discretized reward-inaction learning automata," J. Cybern. Inf. Sci., vol. 2, no. 1, pp. 24-29, 1979.
34. M. A. L. Thathachar and P. S. Sastry, "Estimator algorithms for learning automata," in Proc. Platinum Jubilee Conf. Syst. Signal Process., Bangalore, India, Dec. 1986, pp. 29-32.
35. M. A. L. Thathachar and P. S. Sastry, "A class of rapidly converging algorithms for learning automata," in Proc. IEEE Int. Conf. Cybern. Soc., Bombay, India, 1984, pp. 602-606.
36. B. J. Oommen and J. K. Lanctot, "Discretized pursuit learning automata," IEEE Trans. Syst., Man, Cybern., vol. 20, no. 4, pp. 931-938, Jul./Aug. 1990.
37. M. A. L. Thathachar and K. R. Ramakrishnan, "A hierarchical system of learning automata," IEEE Trans. Syst., Man, Cybern., vol. 11, no. 3, pp. 236-241, Mar. 1981.
38. G. I. Papadimitriou, "Hierarchical discretized pursuit nonlinear learning automata with rapid convergence and high accuracy," IEEE Trans. Knowl. Data Eng., vol. 6, no. 4, pp. 654-659, Aug. 1994.
39. M. S. Obaidat, G. I. Papadimitriou, A. S. Pomportsis, "Efficient fast learning automata," Inf. Sci., vol. 157, pp. 121-133, Dec. 2003.
40. M. Agache and B. J. Oommen, "Generalized pursuit learning schemes: New families of continuous and discretized learning automata," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 32, no. 6, pp. 738-749, Dec. 2002.
41. M. S. Georgios, I. Papadimitriou, A. S. Pomportsis, "A new class of-optimal learning automata," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 34, no. 1, pp. 246-254, Feb. 2004.
42. M. Ryan and T. Omkar, "On-optimality of the pursuit learning algorithm," J. Appl. Probab., vol. 49, no. 3, pp. 795-805, 2012.
43. X. Zhang, O.-C. Granmo, B. J. Oommen, L. Jiao, "On using the theory of regular functions to prove the-optimality of the continuous pursuit learning automaton," in Proc. Int. Conf. Ind. Eng. Appl. Artif. Intell. Expert Syst., Amsterdam, The Netherlands, Jun. 2013, pp. 262-271.
44. X. Zhang, O.-C. Granmo, B. J. Oommen, L. Jiao, "A formal proof of the ?-optimality of absorbing continuous pursuit algorithms using the theory of regular functions," Appl. Intell., vol. 41, pp. 1-12, Oct. 2014.
45. X. Zhang, B. J. Oommen, O.-C. Granmo, L. Jiao, "Using the theory of regular functions to formally prove the ?-optimality of discretized pursuit learning algorithms," in Modern Advances in Applied Intelligence. Cham, Switzerland: Springer, 2014, pp. 379-388.
46. M. A. L. Thathachar and P. S. Sastry, "A new approach to the design of reinforcement schemes for learning automata," IEEE Trans. Syst., Man, Cybern., vol. 15, no. 1, pp. 168-175, Jan./Feb. 1985.
47. W. Dong and M. C. Zhou, "Gaussian classifier-based evolutionary strategy for multimodal optimization," IEEE Trans. Neural Netw. Learn. Syst., vol. 25, no. 6, pp. 1200-1216, Jun. 2014.
48. C. Chu, F. Chu, M. Zhou, H. Chen, Q. Shen, "A polynomial dynamic programming algorithm for crude oil transportation planning," IEEE Trans. Autom. Sci. Eng., vol. 9, no. 1, pp. 42-55, Jan. 2012.
49. L. Li, Z. Sun, M. C. Zhou, F. Qiao, "Adaptive dispatching rule for semiconductor wafer fabrication facility," IEEE Trans. Autom. Sci. Eng., vol. 10, no. 2, pp. 354-364, Apr. 2013.
50. Y. Qiao, N. Wu, M. C. Zhou, "Scheduling of dual-arm cluster tools with wafer revisiting and residency time constraints" IEEE Trans. Ind. Informat., vol. 10, no. 1, pp. 286-300, Feb. 2014.
51. Y. Qiao, N. Wu, M. C. Zhou, "A Petri net-based novel scheduling approach and its cycle time analysis for dual-arm cluster tools with wafer revisiting," IEEE Trans. Semicond. Manuf., vol. 26, no. 1, pp. 100-110, Feb. 2013.
52. N. Wu, L. Bai, M. C. Zhou, F. Chu, S. Mammar, "A novel approach to the optimization of refining schedules for crude oil operations in refinery," IEEE Trans. Syst., Man, Cybern. C, Appl. Rev., vol. 42, no. 6, pp. 1042-1053, Dec. 2012.
53. K. Xing, L. Han, M. C. Zhou, "Deadlock-free genetic scheduling algorithm for automated manufacturing systems based on deadlock control policy," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 42, no. 3, pp. 603-615, Jun. 2012.
54. Z. Zhou, F. Chu, A. Che, M. C. Zhou, "?-constraint and fuzzy logic-based optimization of hazardous material transportation via lane reservation," IEEE Intell. Transp. Syst. Mag., vol. 14, no. 2, pp. 847-857, Jun. 2013.
55. H. Zhu, M. Hou, C. Wang, M. C. Zhou, "An efficient outpatient scheduling approach," IEEE Trans. Autom. Sci. Eng., vol. 9, no. 4, pp. 701-709, Oct. 2012.
56. H. Zhu and M. C. Zhou, "Efficient role transfer based on Kuhn-Munkres algorithm," IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 42, no. 2, pp. 491-496, Mar. 2012.
57. H. Zhu, M. C. Zhou, R. Alkins, "Group role assignment via a Kuhn-Munkres algorithm-based solution," IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 42, no. 3, pp. 739-750, May 2012.
58. B. Liu, K. Huang, J. Li, M. C. Zhou, "An incremental and distributed inference method for large-scale ontologies based on MapReduce paradigm," to be published.
59. M. Dotoli, M. P. Fanti, C. Meloni, M. C. Zhou, "Design and optimization of integrated e-supply chain for agile and environmentally conscious manufacturing," IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 36, no. 1, pp. 62-75, Jan. 2006.
60. B. Huang, C. Li, F. Tao, "A chaos control optimal algorithm for QoSbased service composition selection in cloud manufacturing system," Enterp. Inf. Syst., vol. 8, no. 4, pp. 445-463, 2014.
61. Q. Kang, M. C. Zhou, J. An, Q.Wu, "Swarm intelligence approaches to optimal power flow problem with distributed generator failures in power networks," IEEE Trans. Autom. Sci. Eng., vol. 10, no. 2, pp. 343-353, Apr. 2013.
62. N. Li, W. Yi, Z. Bi, H. Kong, G. Gong, "An optimisation method for complex product design," Enterp. Inf. Syst., vol. 7, no. 4, pp. 470-489, 2013.
63. M. Hou, H. Zhu, M. C. Zhou, G. R. Arrabito, "Optimizing Operator-Agent Interaction in Intelligent Adaptive Interface Design: A Conceptual Framework," IEEE Trans. Syst., Man, Cybernetics: Part C, vol. 41, no. 2, pp. 161-178, Mar. 2011.
64. P. Wang, Z. Ding, C. Jiang, M. C. Zhou, "Constraint-Aware Approach to Web Service Composition," IEEE Trans. Syst., Man, Cybernetics: Systems, vol 44, no. 6, pp. 770-784, Jun. 2014.