Perceptron training algorithms designed using discrete-time control Liapunov functions

Neurocomputing

Volumn 72, Issue 13-15, 2009, Pages 3131-3137

  Diene, Oumar ^a   Bhaya, Amit ^b  

^a UNIVERSIDADE FEDERAL DO ABC   (Brazil)

^b FEDERAL UNIVERSITY OF RIO DE JANEIRO   (Brazil)

Author keywords

Conjugate gradient method; Control; Liapunov function; Perceptron training algorithms; Steepest descent method

Indexed keywords

CONTROL; GRADIENT METHODS; ITERATIVE METHODS; LYAPUNOV FUNCTIONS; STEEPEST DESCENT METHOD;

CONJUGATE GRADIENT ALGORITHMS; DISCRETE-TIME CONTROL; LIAPUNOV FUNCTION; LINEAR INEQUALITIES; LINEARLY SEPARABLE; NETWORK COMMUNITIES; SIMPLE MODIFICATIONS; TRAINING ALGORITHMS;

CONJUGATE GRADIENT METHOD;

ARTICLE; ARTIFICIAL NEURAL NETWORK; CLASSIFICATION; COMPUTER SIMULATION; INFORMATION PROCESSING; LEARNING ALGORITHM; LINEAR SYSTEM; PERCEPTRON; PRIORITY JOURNAL; PROCESS MODEL; STATISTICAL PARAMETERS; TIME SERIES ANALYSIS;

EID: 70450192368     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2009.03.007     Document Type: Article

References (19)

1. D. Anguita, S. Ridella, S. Rovetta, Circuital implementation of support vector machines, Electronic Letters 34 (1998) 1596-1597.
2. A. Bhaya, E. Kaszkurewicz, Iterative methods as dynamical systems with feedback control, in: Proceedings 42nd IEEE Conference on Decision and Control, Maui, Hawaii, USA, 2003.
3. A. Bhaya, E. Kaszkurewicz, Control Perspectives on Numerical Algorithms and Matrix Problems, SIAM, Philadelphia, PA, 2006.
4. C. Cortes, V. Vapnik, Support-vector networks, Machine Learning 20 (3) (1995) 273-297.
5. O. Diene, Linear iterative methods: design and analysis using control theory tools, Master's Thesis, COPPE/UFRJ, April 2004 (in Portuguese).
6. O. Diene, A. Bhaya, Adaptive filtering algorithms designed using control Liapunov functions, IEEE Signal Processing Letters 13 (4) (2006) 224-227 correction in vol. 14 (12) (2007) 1047.
7. R.O. Duda, P.E. Hart, Pattern Classification and Scene Analysis, Wiley, New York, 1973.
8. L.V. Ferreira, E. Kaszkurewicz, A. Bhaya, Support vector classifiers via gradient systems with discontinuous righthand sides, Neural Networks 19 (10) (2006) 1612-1623.
9. R. Fletcher, CM. Reeves, Function minimization by conjugate gradients, Computer Journal 7 (1964) 149-154.
10. M.H. Hassoun, J. Song, Adaptive Ho-Kashyap rules for perceptron training, IEEE Transactions on Neural Networks 3 (1) (1992) 51-61.
11. M.R. Hestenes, E. Stiefel, Methods of conjugate gradients for solving linear systems, Journal of Research of the National Bureau of Standards 49 (1952) 409-436.
12. Y.C. Ho, R.L. Kashyap, An algorithm for linear inequalities and its applications, IEEE Transactions on Electronic Computers EC-14 (1965) 683-688.
13. G. Nagaraja, R.P.J.C. Bose, Adaptive conjugate gradient algorithm for perceptron training, Neurocomputing 69 (2006) 368-386.
14. G. Nagaraja, G. Krishna, Solution of linear inequalities: a conjugate gradient algorithm for linear constraints, in: Proceeding of Joint Automatic Control Conference, vol. 19-21, 1974. URL http://www.cse.iitb.ac.in/~gn/CGA_Constraints.pdf
15. D.J. Newman, S. Hettich, C.L. Blake, C. Merz, UCI repository of machine learning databases, 1998. URL http://www.ics.uci.edu/~mlearn/MLRepository.html
16. N.J. Nilsson, The Mathematical Foundations of Learning Machines, Morgan Kaufmann, San Mateo, CA, 1965.
17. Y. Saad, Iterative Methods for Sparse Linear Systems, PWS Publishing Company, Boston, 1996.
18. B. Schö lkopf, A.J. Smola, R.C. Williamson, P.L. Bartlett, New support vector algorithms, Neural Computation 12 (2000) 1207-1245.
19. J.A. Suykens, T.V. Gestel, J.D. Brabanter, B. De Moor, J. Vandewalle, Least Squares Support Vector Machines, World Scientific Publishing Co., Singapore.