A mixture density network approach to modelling and exploiting uncertainty in nonlinear control problems

Engineering Applications of Artificial Intelligence

Volumn 17, Issue 2, 2004, Pages 145-158

  Herzallah, Randa ^a   Lowe, David ^b  

^a AL BALQA APPLIED UNIVERSITY   (Jordan)

^b ASTON UNIVERSITY   (United Kingdom)

Author keywords

Mixture density networks; Nonlinear control; Uncertainty

Indexed keywords

CONTROL EQUIPMENT; DYNAMIC PROGRAMMING; NONLINEAR CONTROL SYSTEMS; PARAMETER ESTIMATION; PROBABILITY DISTRIBUTIONS; PROBLEM SOLVING; ROBUSTNESS (CONTROL SYSTEMS); STATISTICAL METHODS;

FEED-FORWARD CONTROLLERS; MIXTURE DENSITY NETWORKS; NONLINEAR CONTROL; UNCERTAINTY;

FEEDFORWARD NEURAL NETWORKS;

EID: 2042548650     PISSN: 09521976     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.engappai.2004.02.001     Document Type: Article

References (48)

1. Albus J.S. A new approach to manipulator control. the cerebellar model articulation controller (CMAC) Transactions of the ASME Journal of Dynamic Systems, Measurements, and Control. 97:1975;220-227.
2. Barto A.G. Connectionist learning for control. Sutton R.S., Miller W.T., Werbos P.J. Neural Networks for Control. 1990;5-58 MIT Press, Cambridge, MA, London, England. (Chapter 1).
3. Bellman R.E. Adaptive Control Processes. 1961;Princeton University Press, Princeton, NJ.
4. Bellman R.E. Applied Dynamic Programming. 1962;Princeton University Press, Princeton, NJ.
5. Bishop C.M. Neural Networks for Pattern Recognition. 1995;Oxford University Press, New York, NY.
6. Botto M.A., Wams B., van den Boom, Sà da Costa J.M.G. Robust stability of feedback linearised systems modelled with neural networks. dealing with uncertainty Engineering Applications of Artificial Intelligence. 13(6):2000;659-670.
7. Botto, M.A., Wams, B., van den Boom, Sà da Costa, J.M.G., 2000b. Stability analysis of nonlinear plants under approximate feedback linearization. In: Maciejowski, J. (Ed.), CONTROL 2000 Proceedings. UKACC International Conference on Control, Cambridge, UK, September 2000, project Code: ET00-06, pp. 1-6.
8. Chen F.C., Khalil H.K. Adaptive control of a class of nonlinear discrete-time systems using neural networks. IEEE Transactions on Automatic Control. 40(5):1995;791-801.
9. de Vries, T.J.A., Idema, L.J., Velthuis, W.J.R., 1998. Parsimonious learning feed-forward control. In: ESANN'1998 Proceedings - European Syposium on Artificial Neural Networks, Bruges, Belgium, April 1998, pp. 85-90.
10. de Vries, T.J.A., Velthuis, W.J.R., van Amerongen, J. 2000. Learning feed-forward control: a survey and historical note. In: Proceedings First IFAC Conference on Mechatronic Systems, Germany, September 2000, pp. 949-954.
11. Gersho A., Gray R.M. Vector quantization and signal compression. 1992;Kluwer Academic Publishers, Dordrecht.
12. Gomi H., Kawato M. Recognition of manipulated objects by motor learning with modular architecture networks. Neural Networks. 6:1993;485-497.
13. Graybiel A.M., Aosaki T., Flaherty A.W., Kimura M. The basal ganglia and adaptive motor control. Science. 265:1994;1826-1831.
14. Herzallah, R., Lowe, D., 2002a. Improved robust control of nonlinear stochastic systems using uncertain models. In: Control 2002, Aveiro, Portugal, September 2002, pp. 507-512.
15. Herzallah, R., Lowe, D., 2002b. A novel approach to modelling and exploiting uncertainty in stochastic control systems. In: International Conference on Artificial Neural Networks, ICANN, Madrid, Spain, August 2002, pp. 801-806.
16. Herzallah, R., Lowe, D., 2003a. Multi-valued control problems and mixture density network. In: IFAC International Conference on Intelligent Control Systems and Signal Processing, ICONS, Faro, Portugal, Vol. 2. April 2003, pp. 387-392.
17. Herzallah, R., Lowe, D., 2003b. Probability distribution modelling to improve stability in nonlinear MIMO control. In: IEEE Conference on Control Applications, CCA, Istanbul, Turkey, Vol. 2. June 2003, pp. 954-959.
18. Herzallah R., Lowe D. Robust control of nonlinear stochastic systems by modelling conditional distributions of control signals. Neural Computing and Applications. 12:2003;98-108.
19. Hovakimyan, N., Calise, A.J., 2002. Adaptive output feedback control of uncertain multi-input multi-output systems using single hidden layer neural networks. In: Proceedings of the American Control Conference, Anchorage, AK, USA Vol. 2. May 2002, pp. 1555-1560.
20. Hovakimyan, N., Nardi, F., Calise, A.J., 2001. A novel observer based adaptive output feedback approach for control of uncertain systems. In: Proceedings of the American Control Conference, Arlington, VA, USA, Vol. 3. June 2001, pp. 2444-2449.
21. Huang, Z., Balakrishnan, S.N., 2000. Robust adaptive critic based neurocontrollers for systems with input uncertainties. In: IEEE International Joint Conference on Neural Networks - IJCNN'00, Como, Italy, Vol. 3. 24-27 July 2000, pp. 3067-3072.
22. Hunt K.J., Sbarbaro D., Zbikowski R., Gawthrop P.J. Neural networks for control systems - a survey. Automatica. 28(6):1992;1083-1112.
23. Jacobs R.A., Nowlan S.J. Adaptive mixtures of local experts. Neural Computation. 3:1991;79-87.
24. Jordan, M.I., 1988. Supervised Learning and Systems with Excess Degrees of Freedom. Coins Technical Report 88-27, 1-41, Amherst, University of Massachusetts, Department of Computer Science and Information.
25. Jordan M.I., Jacobs R.A. Hierarchical mixtures of experts and the EM algorithm. Neural Computation. 6:1994;181-214.
26. Jordan, M.I., Xu, L., 1993. Convergence results for the EM approach to mixtures of experts architectures. Technical report, A.I. Memo No. 1458, C.B.C.L. Memo No. 87, Massachusetts Institute of Technology, Artificial Intelligence Laboratory and Center of Biological and Computational Learning, Department of Brain and Cognitive Sciences, 18 November 1993.
27. Kalanovic V.D., Popovic D., Skaug N.T. Feedback error learning neural network for trans-femoral prosthesis. IEEE Transactions on Rehabilitation Engineering. 8(1):2000;71-80.
28. Kawato M. Computational schemes and neural network models for formation and control of multijoint arm trajectory. Sutton R.S., Miller W.T., Werbos P.J. Neural Networks for Control. 1990;197-228 MIT Press, Cambridge, MA, London, England. (Chapter 9).
29. Kawato M., Furukawa K., Suzuki R. A hierarchical neural network model for control and learning of voluntary movement. Biological Cybernetics. 57:1987;169-185.
30. Kuperstein M. Neural model of adaptive hand-eye coordination for single postures. Science. 239:1988;1308-1311.
31. McFarland, M.B., Calise, A.J., 1997. Robust adaptive control of uncertain nonlinear systems using neural networks. In: Proceedings of the American Control Conference, Vol. 3. June 1997, pp. 1996-2000.
32. Miller W.T. Sensor-based control of robotic manipulators using a general learning algorithm. IEEE Journal of Robotics and Automation. RA-3(2):1987;157-165.
33. Miller, W.T., Sutton, R.S., Werbos, P.J. (Eds.), 1990. Neural Networks for Control MIT Press, Cambridge, MA, London, England.
34. Narendra K.S. Adaptive control using neural networks. Miller W.T., Sutton R.S., Werbos P.J. Neural Networks for Control. 1990;115-142 MIT Press, Cambridge, MA, London, England. (Chapter 5).
35. Narendra K.S. Adaptive control using neural networks. White D.A., Sofge D. Handbook of Intelligent Control. 1992;141-183 Multiscience Press, Inc. New York. (Chapter 5).
36. Narendra K.S., Mukhopadhyay S. Adaptive control of nonlinear multivariable systems using neural networks. Neural Networks. 7(5):1994;737-752.
37. Plett, G.L., 1998. Adaptive Inverse Control of Plants with Disturbances. Ph.D. Thesis, Stanford University, May 1998.
38. Psaltis D., Sideris A., Yamamura A.A. A multilayered neural network controller. IEEE Control Systems Magazine. 88(2):1988;17-21.
39. Sundararajan N., Li Y., Saratchandran P. Neuro-flight controllers for aircraft using minimal resource allocating networks (MRAN). Neural Computation and Application. 8:2001;172-183.
40. te Braake H.A.B., Botto M.A., van Can H.J.L., Sá da Costa J., Verbruggen H.B. Linear predictive control based on approximate input-output feedback linearisation. IEE Proceedings - Control Theory and Applications. 146(4):1999;295-300.
41. Todorović, B., Stankovi'c, M., Moraga, C., 2002. Extended Kalman filter trained recurrent radial basis function network in nonlinear system identification. In: International Conference on Artificial Neural Networks, ICANN, Madrid, Spain, August 2002, pp. 819-824.
42. van den Boom, T.J.J., 1997. Robust nonlinear predictive control using feedback linearization and linear matrix inequalities. In: Proceedings of the American Control Conference, Albuquerque NM, Vol. 5. June 1997, pp. 3068-3072.
43. Wellestead P.E., Zarrop M.B. Self-Tuning Systems Control and Signal Processing. 1987;Wiley, Great Britain.
44. Werbos P.J. Approximate dynamic programming for real-time control and neural modeling. White D.A., Sofge D.A. Handbook of Intelligent Control. 1992;493-526 Multiscience Press, Inc. New York, NY. (Chapter 13).
45. White, D.A., Sofge, D. (Eds.), 1992. Handbook of Intelligent Control. Multiscience Press, Inc, New York, NY.
46. Widrow, B., Plet, G.L., 1997. Nonlinear adaptive inverse control. In: Proceedings of the 36th Conference on Decision and Control, San Diego, CA, USA, December 1997, pp. 1032-1037.
47. Wolpert D.M., Kawato M. Multiple paired forward and inverse models for motor control. Neural Networks. 11:1998;1317-1329.
48. Yen, G.G., Ho, L.-W., 2000. Fault tolerant control: an intelligent sliding mode control strategy. In: Proceedings of the American Control Conference, Chicago, IL, Vol. 6. June 2000, pp. 4204-4208.