Stochastic optimization algorithms for support vector machines classification

Informatica

Volumn 20, Issue 2, 2009, Pages 173-186

  Bartkut Norknien, Vaida ^a  

^a VILNIUS UNIVERSITY   (Lithuania)

Author keywords

Semi supervised classification; Simulated annealing; Stochastic approximation; Support vector machine

Indexed keywords

EID: 67651212147     PISSN: 08684952     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (31)

1. Astorino, A., and A. Fuduli (2007). Nonsmooth optimization techniques for semisupervised classification. IEEE Trans. Pattern Anal. Mach. Intell, 29(12), 2135-2142.
2. Asuncion, A., and D.J. Newman (2007). UCI Machine Learning Repository. School of Information and Computer Science, University of California, Irvine, CA. http://www.ics.uci.edu/∼mlearn/MLRepository.html
3. Bagirov, A.M., A.M. Rubinov and J. Yearwood (2002). Global optimization approach to classification. Optimization and Engineering, 3, 129-155.
4. Bagirov, A.M., A.M. Rubinov, N.V. Soukhoroukova and J. Yearwood (2003). Unsupervised and supervised data classification via nonsmooth and global optimization. TOP: Spanish Operations Research Journal, 11(1), 1-93.
5. Bartkute, V., and L. Sakalauskas (2006). Application of stochastic approximation in technical design. In Computer Aided Methods in Optimal Design and Operations, Series on Computers and Operations Research, Vol. 7. pp. 29-38.
6. Bartkute, V., and L. Sakalauskas (2007). Simultaneous perturbation stochastic approximation for nonsmooth functions. European Journal on Operational Research, 181(3), 1174-1188.
7. Bernataviciene, J., G. Dzemyda, O. Kurasova, V. Marcinkevicius (2006). Optimal decisions in combining the SOM with nonlinear projection methods. European Journal of Operation Research, 173, 729-745.
8. Bernataviciene, J., G. Dzemyda, V. Marcinkevicius (2007). Conditions for optimal efficiency of relative MDS. Informatica, 18(2), 187-202.
9. Blum, J. (1954). Multidimensional stochastic approximation procedures. Annals of Mathematical Statistics, 25(4).
10. Chen, H.-F. (2002). Stochastic Approximation and its Application. Series: Nonconvex Optimization and Its Applications, Vol. 64.
11. Cortes, C., and V. Vapnik (1995). Support-vector networks. Machine Learning, 20(3), 273-297.
12. Cristianini, N., and J. Shawe-Taylor (2003). Support vector and kernel methods. In M. Berthold and D.J. Hand (Eds.), Intelligent Data Analysis: An Introduction. Springer-Verlag. pp. 169-197.
13. Dvoretzky, A. (1956). On stochastic approximation. In J. Neumann (Ed.), Proc. 3rd Berkeley Symposium of Mathematical Statistics and Probability, Vol. 1. University of California Press, Berkeley. pp. 39-55.
14. Ermoliev, Yu. M. (1976). Methods of Stochastic Programming. Nauka, Moscow (in Russian).
15. Ermoliev, Yu.M., V.I. Norkin and R.J.-B. Wets (1995). The minimization of semicontinuous functions: mollifier subgradients. Control and Optimization, 33(1), 149-167.
16. Felinskas, G., and L. Sakalauskas (2003). Pareto type models in simulated annealing algorithms. Lith. Math. J., 43 (spec. issue), 573-578 (in Lithuanian).
17. Grigaitis, D., V. Bartkutė, L. Sakalauskas (2007). An optimization of system for automatic recognition of is-chemic stroke areas in computed tomography images. Informatica, 18(4), 603-614.
18. Granville, V., M. Krivanek and J.P. Rasson (1994). Simulated annealing: a proof of convergence. IEEE Transactions on Pattern Analysis and Machine Intelligence, 16(6), 652-656.
19. Kiefer, J., and J. Wolfowitz (1952). A stochastic estimation of the maximum of a regression function. Annals of Mathematical Statistics, 23(3), 462-466.
20. Kushner, H.J., and G.G. Yin (2003). Stochastic Approximation and Recursive Algorithms and Applications. Springer, New York/Heidelberg/Berlin.
21. Maryak, J.L., and D.C. Chin (2001). Global random optimization by simultaneous perturbation stochastic approximation. In Proceedings of the 33nd Conference on Winter Simulation, Arlington, Virginia. pp. 307-312.
22. Metropolis, N., A. Rosenbluth, M. Rosenbluth, A. Teller and E. Teller (1953). Equation of state calculations by fast computing machines, J. Chem. Phys., 21(6), 1087-1092.
23. Mikhalevitch, V.S., A.M. Gupal and V.I. Norkin (1987). Methods of Nonconvex Optimization. Nauka, Moscow (in Russian).
24. Robins, H., and S. Monro (1951). A stochastic approximation method. Annals of Mathematical Statistics, 22(3), 400-407.
25. Sakalauskas, L. (2000). Nonlinear stochastic optimization by Monte-Carlo method. Informatica, 11(4), 455-468.
26. Yao, C.-C., and P.-T. Yu (2007). Oblique support vector machines. Informatica, 18(1), 137-157.
27. Yang, R.L. (2000). Convergence of the simulated annealing algorithm for continuous global optimization. JOTA, 104(3), 691-716.
28. Yudin, D.B. (1965). Qualitative methods for analysis of complex systems. Izv. AN SSSR.
29. Zhang, H.H., J. Ahn, X. Lin and C. Park (2004). Variable selection for SVM via shrinkage methods. In Discussion Session, SAMSI: Data Mining and Machine Learning Workshop, January 2004. Research Triangle Park, NC.
30. Ziv, B.-J., and A.W. Motore (2004). Machine learning. In School of Computer Science, Carnegie Mellon University. pp. 10-781.
31. Wasan, M.T. (1969). Stochastic approximation. In Transactions in Mathematics and Mathematical Physics. Cambridge University Press, Cambridge.