Systems control with generalized probabilistic fuzzy-reinforcement learning

IEEE Transactions on Fuzzy Systems

Volumn 19, Issue 1, 2011, Pages 51-64

  Hinojosa, William M ^a   Nefti, Samia ^a   Kaymak, Uzay ^b  

^a UNIVERSITY OF SALFORD   (United Kingdom)

^b ERASMUS UNIVERSITY ROTTERDAM   (Netherlands)

Author keywords

Actorcritic (AC); learning agent; probabilistic fuzzy systems; reinforcement learning (RL); systems control

Indexed keywords

ACTOR CRITIC; APPROXIMATION CAPABILITIES; CONTROL ACTIONS; ENHANCED LEARNING; GRADIENT-DESCENT; INPUT-OUTPUT DATA; LEARNING AGENT; LEARNING ARCHITECTURES; LEARNING METHODS; LEARNING STRUCTURE; PROBABILISTIC FUZZY SYSTEMS; PROBABILISTIC UNCERTAINTY; PROBABILITY MEASURES; SYSTEMS CONTROL;

CONVERGENCE OF NUMERICAL METHODS; FUZZY SETS; REINFORCEMENT LEARNING;

PROBABILITY DISTRIBUTIONS;

EID: 79551653988     PISSN: 10636706     EISSN: None     Source Type: Journal    
DOI: 10.1109/TFUZZ.2010.2081994     Document Type: Article

References (36)

1. J. van den Berg et al., " Financial markets analysis by using a probabilistic fuzzy modelling approach," Int. J. Approx. Reason., vol. 35, no. 3, pp. 291-305, 2004.
2. R. E. Bellman, Dynamic Programming. Princeton, NJ: Princeton Univ. Press, 1957.
3. A. G. Barto et al., " Neuron-like adaptive elements that can solve difficult learning control problems," IEEE Trans. Syst., Man, Cybern., vol. SMC- 13, no. 5, pp. 835-846, 1983.
4. C. W. Anderson, "Learning to control an inverted pendulum using neural networks," IEEE Control Syst. Mag., vol. 9, no. 3, pp. 31-37, Apr. 1989.
5. H. R. Berenji and P. Khedkar, " Learning and tuning fuzzy logic controllers through reinforcements," IEEE Trans.NeuralNetw., vol. 3, no. 5, pp. 724- 740, Sep. 1992.
6. C.-C. Lee, "A self-learning rule-based controller employing approximate reasoning and neural net concept" Int. J. Intell. Syst., vol. 6, no. 1, pp. 71-93, 1991.
7. C.-T. Lin and C. S. G. Lee, " Reinforcement structure/parameter learning for neural-network-based fuzzy logic control systems," presented at the IEEE Int. Conf. Fuzzy Syst., San Francisco, CA, 1993.
8. C.-T. Lin, "A neural fuzzy control system with structure and parameter learning," Fuzzy Sets Syst., vol. 70, no. 2/3, pp. 183-212, Mar. 1995.
9. M. H. F. Zarandi et al., " Reinforcement learning for fuzzy control with linguistic states," J. Uncertain Syst., vol. 2, pp. 54-66, Oct. 2008.
10. L. Jouffe, "Fuzzy inference system learning by reinforcement methods," IEEE Trans. Syst., Man, Cybern., vol. 28, no. 3, pp. 238-255, Aug. 1998.
11. C.-K. Lin, "Areinforcement learning adaptive fuzzy controller for robots," Fuzzy Sets Syst., vol. 137, no. 1, pp. 339-352, Aug. 2003.
12. C.-J. Lin and C.-T. Lin, " Reinforcement learning for an ART-based fuzzy adaptive learning control network," IEEE Trans. Neural Netw., vol. 7, no. 3, pp. 709-731, May 1996.
13. R. J. Almeida and U. Kaymak, " Probabilistic fuzzy systems in value-atrisk estimation," Int. J. Intell. Syst. Account., Finance Manag., vol. 16, no. 1/2, pp. 49-70, 2009.
14. X.-S.Wang et al., " A fuzzy actor-critic reinforcement learning network," Inf. Sci., vol. 177, no. 18, pp. 3764-3781, Sep. 2007.
15. K. P. Valavanis and G. N. Saridis, " Probabilistic modelling of intelligent robotic systems," IEEE Trans. Robot. Autom., vol. 7, no. 1, pp. 164-171, Feb. 1991.
16. J. C. Pidre et al., " Probabilistic model for mechanical power fluctuations in asynchronous wind parks," IEEE Trans. Power Syst., vol. 18, no. 2, pp. 761-768, May 2003.
17. H. Deshuang and M. Songde, " A new radial basis probabilistic neural network model," presented at the Int. Conf. Signal Processing, Beijing, China, 1996.
18. L. A. Zadeh, "Probability theory and fuzzy logic are complementary rather than competitive" Technometrics, vol. 37, no. 3, pp. 271-276, Aug. 1995.
19. M. Laviolette and J.W. Seaman, " Unity and diversity of fuzziness-from a probability viewpoint," IEEE Trans. Fuzzy Syst., vol. 2, no. 1, pp. 38-42, Feb. 1994.
20. P. Liang and F. Song, " What does a probabilistic interpretation of fuzzy sets mean?," IEEE Trans. Fuzzy Syst., vol. 4, no. 2, pp. 200-205, May 1996.
21. Z. Liu and H.-X. Li, " A probabilistic fuzzy logic system for modelling and control," IEEE Trans. Fuzzy Syst., vol. 13, no. 6, pp. 848-859, Dec. 2005. (Pubitemid 43065967)
22. J. v. d. Berg et al., "Fuzzy cla ssification using probability-based rule weighting," in Proc. IEEE Int. Conf. Fuzzy Syst., Honolulu, HI, 2002, pp. 991-996.
23. F. Laviolette and S. Zhioua, " Testing stochastic processes through reinforcement learning," presented at the Workshop Testing Deployable Learn. Decision Syst., Vancouver, BC, Canada, 2006.
24. C. Baird, "Reinforcement learning through gradient descent," Ph.D. dissertation, School of Comput. Sci., Carnegie Mellon Univ., Pittsburgh, PA, 1999.
25. R. S. Sutton et al., " Fast gradient-descentmethods for temporal-difference learning with linear function approximation," in Proc. 26th Int. Conf. Mach. Learn., Montreal, QC, Canada, 2009, pp. 993-1000.
26. L. Baird and A. Moore, " Gradient descent for general reinforcement learning," in Proc. Adv. Neural Inf. Process. Syst. II, 1999, pp. 968-974.
27. H. Yu et al., " Tracking control of a peddulum-driven cart-pole underactuated system," presented at the IEEE Int. Conf. Syst., Man, Cybern., Montreal, QC, Canada, 2007.
28. H. R. Berenji, "Refinement of approximate reasoning-based controllers by reinforcement learning" presented at the 8th Int.Workshop Mach. Learn., San Francisco, CA, 1991.
29. H. R. Berenji, "Fuzzy Q-learning for generalization of reinforcement learning" presented at the 5th IEEE Int. Conf. Fuzzy Syst., New Orleans, LA, 1996.
30. C.-T. Lin and C. S. G. Lee, " Reinforcement structure/parameter learning for neural-network-based fuzzy logic control systems," IEEE Trans. Fuzzy Syst., vol. 2, no. 1, pp. 46-63, Feb. 1994.
31. C.-T. Lin and C. S. G. Lee, " Neural-network-based fuzzy logic control and decision system," IEEE Trans. Comput., vol. 40, no. 12, pp. 1320-1336, Dec. 1991.
32. C.-T. Lin et al., " Fuzzy adaptive learning control network with on-line neural learning," Fuzzy Sets Syst., vol. 71, no. 1, pp. 25-45, Apr. 1995.
33. S. Thrun. (2000) Probabilistic algorithms in robotics. AI Mag.
34. J. Pineau, "Point-based value iteration: An any time algorithm for POMDPs," presented at the Int. Joint Conf. Artif. Intell., Acapulco, Mexico, 2003.
35. P. Poupart and C. Boutilier, " VDCBPI: An approximate scalable algorithm for large POMDPs," presented at the Advances Neural Inform. Process. Syst., Vancouver, BC, Canada, 2004.
36. N. Roy et al., " Finding approximate POMDP solutions through belief compression," J. Artif. Intell. Res., vol. 23, no. 1, pp. 1-40, Jan. 2005.