Control of multivariable systems based on emotional temporal difference learning controller

International Journal of Engineering, Transactions A: Basics

Volumn 17, Issue 4, 2004, Pages 363-376

  Abdi, Javad ^a   Khalili, GholamHassan Famil ^b   Fatourechi, Mehrdad ^c   Lucas, Caro ^d   Sedigh, Ali Khaki ^e  

^a UNIVERSITY OF TEHRAN   (Iran)

^b ISLAMIC AZAD UNIVERSITY   (Iran)

^c UNIVERSITY OF BRITISH COLUMBIA   (Canada)

^d INSTITUTE FOR STUDIES IN THEORETICAL PHYSICS AND MATHEMATICS IPM   (Iran)

^e K N TOOSI UNIVERSITY OF TECHNOLOGY   (Iran)

Author keywords

Agent; Emotional Learning; Intelligent Control; Multivariable Systems; Neuro Fuzzy Control; Temporal Difference Learning

Indexed keywords

CONTROL EQUIPMENT; FUZZY SETS; INTELLIGENT CONTROL;

EMOTIONAL LEARNING; NEURO-FUZZY CONTROL; TEMPORAL DIFFERENCE LEARNING;

MULTIVARIABLE SYSTEMS;

EID: 25144475121     PISSN: 17281431     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (37)

1. Simon, H. A. and Associates, "Decision Making and Problem Solving", Interfaces, Vol. 17, (1987).
2. Balkenius, C. and Moren, J., "A Computational Model of Context Processing", In: Proceedings of the 6th International Conference on Simulation of Adaptive Behavior, Cambridge, (2000).
3. El-Nasr, M., Loerger, T. and Yen, J., "Peteei: A Pet with Evolving Emotional Intelligence", Autonomous Agents99, (1999), 9-15.
4. Velasquez, J., "A Computational Framework for Emotion-Based Control", In: Proceedings of the Grounding Emotions in Adaptive Systems Workshop SAB'98, Zurich, Switzerland, (1998).
5. Fatourechi, M., Lucas, C. and Sedigh, A. K., "An Agent-Based Approach to Multivariable Control", In the Proceedings of LASTED International Conference on Artificial Intelligence and Applications, Marbella. Spain. (September 4-7, 2001), 376-381.
6. Fatourechi, M., Lucas, C. and Khaki Sedigh, A., "Reducing Control Effort by Means of Emotional Learning", In: The Proceedings of 9 th Iranian Conference on Electrical Engineering (ICEE2001), Tehran, Iran, (2001), 41-1 to 41-8.
7. Fatourechi, M., Lucas, C. and Khaki Sedigh, A., "Reduction of Maximum Overshoot by Means of Emotional Learning", In: The Proceedings of 6th Annual CSI Computer Conference, 2001, Isfahan, Iran, 460-467
8. Lucas, C. and Jazbi, S. A., "Intelligent Motion Control of Electric Motors with Evaluative Feedback", Cigre98, Cigre, France, (1998),1-6. (11-104)
9. Lucas, C., Jazbi, S. A., Fatourechi, M. and Farshad, M., "Cognitive Action Selection with Neurocontrollers", Third Iran-Armenia Workshop on Neural Networks, Yerevan, Armenia, (2000).
10. Von Altrock, C. and Gebhardt, J., "Recent Successful Fuzzy Logic Applications in Industrial Automation", In: Proceedings of the Fifth IEEE International Conference, Vol. 3, (1996), 1845-1851.
11. Lin, C. T. and Lee, C. S. G., "Neural-Network Based Fuzzy Logic Control and Decision System", IEEE Transactions on Computers, Vol. 40, No. 12, (1991), 1320-1327.
12. Maes, P. (ed.), "Designing Autonomous Agents: Theory and Practice from Biology to Engineering and Back", The MIT press, London, (1991).
13. Rolls, E. D., "The Brain and Emotion", Oxford University Press, (1998).
14. Barto, A. G., Sutton, R. S. and Anderson, C. W., "Neurolike Adaptive Elements that can solve Difficult Learning Control Problems", IEEE Transactions on Systems, Man and Cybernetics, SMC-13, (1983), 834-846.
15. Galloti, K. M., "Cognitive Psychology in and out of Laboratory", (2nd ed.), Brooks/Cole, Pacific Grove, CA. (1999).
16. Kentridge, R.W. and Aggleton, J. P., "Emotion: Sensory Representations, Reinforcement and the Temporal Lobe", Cognition and Emotion, Vol. 4, (1990), 191-208.
17. Berenji, H. R. and Khedkar, P., "Learning and Tuning Fuzzy Logic Controller Through Reinforcements", IEEE Transactions on Neural Networks, Vol. 3, (1992), 724-740
18. Wooldridge, M. and Jennings, N., "Intelligent Agents: Theory and Practice", The Knowledge Engineering Review, Vol. 10, No. 2, (1995), 115-152.
19. Wooldridge, M., "Intelligent Agents", in G. Weiss (Ed.), Multiagent Systems: A modern approach to Distributed Artificial Intelligence, (London: MIT Press, 1999), 27-77
20. Russel, S. and Norwig, P., "A Modern Approach to Artificial Intelligence", Prentice-Hall, Englewood Cliffs, (1995).
21. Takagi, T. and Sugeno, M., "Derivation of Fuzzy Control Rules from human operator's control actions", Proc. IFAC Symp.on Fuzzy Information, Knowledge Representation and Decision Analysis, (1983), 55-60.
22. Cheng, C. C. Liao, Y. K. and. Wanq, T. S, "Quantitative Design of Uncertain Multivariable Control System with an Inner-Feedback Loop", In: IEE Proceedings on Control Theory Applications, Vol. 144, (1997), 195-201.
23. Fatourechi, M., "Generalization of Emotional Learning (to Multivariable and Multi-objective Systems)", M.S Thesis, University of Tehran, (June 2001)
24. Zhao, R. and Govind, R., "Membership Function-Based Fuzzy Model and its Application to Multivariable Nonlinear Model-Predictive Control", In: Proceedings of the Third IEEE Conference on Computational Intelligence, Vol. 3, (1994), 1586-1591.
25. Cannon, R. H., "Dynamics of Physical Systems", McGraw-Hill, New York, (1967).
26. Jang, J. S., "Self-Learning Fuzzy Controllers Based on Temporal Back Propagation", IEEE Transactions on Neural Networks, Vol. 3, No. 5, (1992), 714-723.
27. Lee, P. G., Lee, K. K. and Jeon, G. J., "An Index of Applicability for the Decomposition Method of Multivariable Fuzzy Systems", IEEE Transactions on Fuzzy Systems, Vol. 3, (1995), 364-369
28. Sutton, R. S., Barto, A. G., "A Temporal - Difference Model of Classical Conditioning", In: Proceedings of 9th Annual Conference on Cognitive Science, New Jersey, (1987), 355-378.
29. Sutton, R. S., "Learning to Predict by the Method of Temporal Differences", Machine Learning, Vol. 3, (1988), 9-44.
30. Patel, R. V. and Munro, M., "Multivariable System Theory and Design", Pergamon press, (1984).
31. Abdi, J., Lucas, C., Sedigh, A. K. and Khalili, A. F., "Truncating Temporal Differences in Control", 11th International Conference on Electrical Engineering, ICEE'03, Shiraz, Iran, (2003).
32. Abdi, J., Lucas, C. and Sedigh, A. K., "Application of Temporal Difference Learning in Control", M.S Thesis, Uni. of Tehran, (February 2003).
33. Gordon, G. J., "Stable Function Approximation in Dynamic Programming", In Proceedings of the 12th International Conference on Machine Learning (ML-95), Morgan Kaufmann, (1995).
34. Sutton, R. S., "Temporal Credit Assignment in Reinforcement Learning", PhD Thesis, Department of Computer and Information Science, University of Massachusetts, (1984)
35. Sutton, R. S., "Learning to Predict by the Methods of Temporal Differences", Machine Learning, Vol. 3, (1988), 9-44.
36. Abdi, J., Lucas, C., Sedigh, A. K. and Fatourechi, M., "Multivariable Systems Temporal Difference Emotional Control", Journal of Faculty of Engineering, Vol.38, No. 1, (May 2004), 51-62.
37. Abdi, J., Khalili, A. F., Lucas, C. and Sedigh, A. K., "The Role of Truncated Temporal Difference with Function Approximation in Decreasing the Required Time and Costs of Reinforcement Learning Computations", IAEEE (Journal of Iranian and Association of Electrical and Electronics Engineers), Vol. 1, No. 1, (Spring 2004), 4-18.