Support vector classifiers via gradient systems with discontinuous righthand sides

Neural Networks

Volumn 19, Issue 10, 2006, Pages 1612-1623

  Ferreira, Leonardo V ^a   Kaszkurewicz, Eugenius ^a   Bhaya, Amit ^a  

^a FEDERAL UNIVERSITY OF RIO DE JANEIRO   (Brazil)

Author keywords

Gradient systems; Neural networks; Nonsmooth optimization; Persidskii systems; Support vector machines

Indexed keywords

INTEGRATION; NEURAL NETWORKS; PARALLEL PROCESSING SYSTEMS; PARAMETER ESTIMATION; QUADRATIC PROGRAMMING; TRAJECTORIES;

GRADIENT SYSTEMS; NONSMOOTH OPTIMIZATION; PERSIDSKII SYSTEMS; SUPPORT VECTOR MACHINES;

GRADIENT METHODS;

ARTICLE; COMPUTER; COMPUTER PROGRAM; DATA BASE; METHODOLOGY; NERVE CELL NETWORK; PARAMETER; PRIORITY JOURNAL;

ALGORITHMS; ANIMALS; ARTIFICIAL INTELLIGENCE; CLUSTER ANALYSIS; COMPUTATIONAL BIOLOGY; HUMANS; INFORMATION STORAGE AND RETRIEVAL; MODELS, STATISTICAL; NONLINEAR DYNAMICS; PATTERN RECOGNITION, AUTOMATED; PLANTS;

EID: 33751211222     PISSN: 08936080     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neunet.2006.07.004     Document Type: Article

References (46)

1. Anguita D., and Boni A. Improved neural network for SVM learning. IEEE Transactions on Neural Networks 13 5 (2002) 1243-1244
2. Anguita D., Boni A., and Ridella S. A digital architecture for support vector machines: Theory, algorithm and FPGA implementation. IEEE Transactions on Neural Networks 14 5 (2003) 993-1009
3. Anguita D., Ridella S., and Rovetta S. Circuital implementation of support vector machines. Electronic Letters 34 16 (1998) 1596-1597
4. Bishop C.M. Neural networks for pattern recognition (1995), Oxford University Press, Oxford, UK
5. Blake, C. L., & Merz, C. J. (1998) UCI repository of machine learning databases. University of California, Dept. of Information and Computer Sciences. Irvine. http://www.ics.uci.edu/~mlearn/MLRepository.html
6. Cash J.R., and Karp A.H. A variable order Runge-Kutta method for initial value problems with rapidly varying right-hand sides. ACM Transactions on Mathematical Software 16 3 (1990) 201-222
7. Chang C.-C., and Lin C.-J. Training ν-support vector classifiers: Theory and algorithms. Neural Computation 13 9 (2001) 2119-2147
8. Chong E.K.P., Hui S., and Żak S.H. An analysis of a class of neural networks for solving linear programming problems. IEEE Transactions on Automatic Control 44 11 (1999) 1995-2006
9. Cichocki A., and Unbehauen R. Neural networks for optimization and signal processing (1993), John Wiley and Sons
10. Cormen T.H., Leiserson C.E., and Rivest R.L. Introduction to algorithms (1990), The MIT Press
11. Cortes C., and Vapnik V. Support-vector networks. Machine Learning 20 3 (1995) 273-297
12. Cristianini N., and Shawe-Taylor J. An introduction to support vector machines and other kernel-based learning methods (2000), Cambridge University Press, Cambridge, UK
13. de Leone R. Parallel algorithm for support vector machines training and quadratic optimization problems. Optimization Methods and Software 20 2-3 (2005) 379-388
14. Edwards C., and Spurgeon S.K. Sliding mode control: Theory and applications (1998), Taylor & Francis
15. Ferreira, L. V., Kaszkurewicz, E., & Bhaya, A. (2002). Convergence analysis of neural networks that solve linear programming problems. In Proceedings of the international joint conference on neural networks 2002, Vol. 3(pp. 2476-2481)
16. Ferreira, L. V., Kaszkurewicz, E., & Bhaya, A. (2003). Synthesis of a k-winners-take-all neural network using linear programming with bounded variables. In Proceedings of the international joint conference on neural networks 2003, Vol. 3 (pp. 2360-2365)
17. Ferreira, L. V., Kaszkurewicz, E., & Bhaya, A. (2004). Support vector classifiers via gradient systems with discontinuous righthand sides. In Proceedings of the international joint conference on neural networks 2004, Vol. 4 (pp. 2997-3002)
18. Ferreira L.V., Kaszkurewicz E., and Bhaya A. Solving systems of linear equations using gradient systems with discontinuous righthand sides: Application to LS-SVM. IEEE Transactions on Neural Networks 16 2 (2005) 501-505
19. Filippov A.F. Differential equations with discontinuous righthand sides (1988), Kluwer, Dordrecht
20. Glazos M.P., Hui S., and Zak S.H. Sliding modes in solving convex programming problems. SIAM Journal of Control and Optimization 36 2 (1998) 680-697
21. Hsu L., Kaszkurewicz E., and Bhaya A. Matrix-theoretic conditions for the realizability of sliding manifolds. Systems & Control Letters 40 (2000) 145-152
22. Joachims T. Making large-scale SVM learning practical. In: Schölkopf B., Burges C., and Smola A. (Eds). Advances in Kernel methods - support vector learning (1999), MIT Press, Cambridge, MA
23. Karpinskaya N.N. Method of "penalty" functions and the foundations of Pyne's method. Automation and Remote Control 28 1 (1967) 124-129
24. Kaszkurewicz E., and Bhaya A. Matrix diagonal stability in systems and computation (2000), Birkhäuser, Boston
25. Kennedy M.P., and Chua L.O. Neural networks for nonlinear programming. IEEE Transactions on Circuits and Systems 35 5 (1988) 554-562
26. Leung Y., Chen K.-Z., Jiao Y.-C., Gao X.-B., and Leung K.S. A new gradient-based neural network for solving linear and quadratic programming problems. IEEE Transactions on Neural Networks 12 5 (2001) 1074-1083
27. Luenberger D.G. Linear and nonlinear programming. 2nd ed. (1984), Addison-Wesley, Reading, MA
28. Maa C.-Y., and Shanblatt M.A. Linear and quadratic programming neural network analysis. IEEE Transactions on Neural Networks 3 4 (1992) 580-594
29. Persidskii S.K. Problem of absolute stability. Automation and Remote Control 12 (1969) 1889-1895
30. Pyne I.B. Linear programming on an electronic analogue computer. Transactions of the American Institute of Electrical Engineers 75 (1956) 139-143
31. Rodríguez-Vázquez A., Domínguez-Castro R., Rueda A., Huertas J., and Sanchez-Sinencio E. Nonlinear switched-capacitor neural networks for optimization problems. IEEE Transactions on Circuits and Systems 37 3 (1990) 384-398
32. Rybashov M.V. Gradient methods of solving linear and quadratic programming problems on electronic analog computers. Automation and Remote Control 26 12 (1965) 2151-2162
33. Schölkopf B., Smola A.J., Williamson R.C., and Bartlett P.L. New support vector algorithms. Neural Computation 12 (2000) 1207-1245
34. Schölkopf B., and Smola A. Learning with kernels (2002), The MIT Press, Cambridge, MA
35. Shevitz D., and Paden B. Lyapunov stability of nonsmooth systems. IEEE Transactions on Automatic Control 39 9 (1994) 1910-1914
36. Steinwart I. On the optimal parameter choice for ν-support vector machines. IEEE Transactions on Pattern Analysis and Machine Intelligence 25 10 (2003) 1274-1284
37. Suykens J.A., Gestel T.V., Brabanter J.D., Moor B.D., and Vandewalle J. Least squares support vector machines (2002), World Scientific, Singapore
38. Tan, Y., Xia, Y., & Wang, J. (2000). Neural network realization of support vector methods for pattern classification. In Proceedings of the international joint conference on neural networks Vol. 6 (pp. 411-415)
39. Utkin V. Sliding modes in control and optimization (1992), Springer-Verlag, Berlin
40. Utkin V., Guldner J., and Shi J. Sliding mode control in electromechanical systems (1999), CRC Press, Boca Raton, FL
41. Valli A.M.P., Carey G.F., and Coutinho A.L.G.A. Control strategies for timestep selection in finite element simulation of incompressible flows of coupled reaction-convection-diffusion processes. International Journal for Numerical Methods in Fluids 47 (2004) 201-231
42. Xia Y., and Wang J. A one-layer recurrent neural network for support vector machine learning. IEEE Transactions on Systems, Man and Cybernetics-Part B 34 2 (2004) 1261-1269
43. Dong J.-X., Krzyżak A., and Suen C.Y. Fast SVM training algorithm with decomposition on very large data sets. IEEE Transactions on Pattern Analysis and Machine Intelligence 27 4 (2005) 603-618
44. Young K.D., Utkin V.I., and Özgüner U. A control engineer's guide to sliding mode control. IEEE Transactions on Control Systems Technology 7 3 (1999) 328-342
45. Żak S.H., Upatising V., and Hui S. Solving linear programming problems with neural networks: A comparative study. IEEE Transactions on Neural Networks 6 1 (1995) 94-104
46. Zanghirati G., and Zanni L. A parallel solver for large quadratic programs in training support vector machines. Parallel Computing 29 (2003) 535-551