Working set selection using second order information for training support vector machines

Journal of Machine Learning Research

Volumn 6, Issue , 2005, Pages 1889-1918

  Fan, Rong En ^a   Chen, Pai Hsuen ^a   Lin, Chih Jen ^a  

^a NATIONAL TAIWAN UNIVERSITY   (Taiwan)

Author keywords

Decomposition methods; Sequential minimal optimization; Support vector machines; Working set selection

Indexed keywords

LEARNING SYSTEMS; OPTIMIZATION; SET THEORY;

DECOMPOSITION METHODS; SEQUENTIAL MINIMAL OPTIMIZATION; SUPPORT VECTOR MACHINES; WORKING SET SELECTION;

INFORMATION ANALYSIS;

EID: 29144499905     PISSN: 15337928     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Article

References (22)

1. R. R. Bailey, E. J. Pettit, R. T. Borochoff, M. T. Manry, and X. Jiang. Automatic recognition of usgs land use/cover categories using statistical and neural networks classifiers. In SPIE OE/Aerospace and Remote Sensing, Bellingham, WA, 1993. SPIE.
2. C. L. Blake and C. J. Merz. UCI repository of machine learning databases. Technical report, University of California, Department of Information and Computer Science, Irvine, CA, 1998. Available at http://www.ics.uci.edu/~mlearn/MLRepository.html.
3. B. Boser, I. Guyon, and V. Vapnik. A training algorithm for optimal margin classifiers. In Proceedings of the Fifth Annual Workshop on Computational Learning Theory, pages 144-152. ACM Press, 1992.
4. Chih-Chung Chang and Chih-Jen Lin. LIBSVM: a library for support vector machines, 2001. Software available at http://www.csie.ntu.edu.tw/~cjlin/libsvm
5. Pai-Hsuen Chen, Rong-En Fan, and Chih-Jen Lin. A study on SMO-type decomposition methods for support vector machines. IEEE Transactions on Neural Networks, 2006. URL http://www.csie.ntu.edu.tw/~cjlin/papers/generalSM0.pdf. To appear.
6. C. Cortes and V. Vapnik. Support-vector network. Machine Learning, 20:273-297, 1995.
7. Tin Kam Ho and Eugene M. Kleinberg. Building projectable classifiers of arbitrary complexity. In Proceedings of the 13th International Conference on Pattern Recognition, pages 880-885, Vienna, Austria, August 1996.
8. Don Hush and Clint Scovel. Polynomial-time decomposition algorithms for support vector machines. Machine Learning, 51:51-71, 2003. URL http://www.c3.lanl.gov/~dhush/machine_learning/svm_decomp.ps.
9. Thorsten Joachims. Making large-scale SVM learning practical. In Bernhard Schölkopf, Christopher J. C. Burges, and Alexander J. Smola, editors, Advances in Kernel Methods - Support Vector Learning, Cambridge, MA, 1998. MIT Press.
10. S. S. Keerthi, S. K. Shevade, C. Bhattacharyya, and K. R. K. Murthy. Improvements to Platt's SMO algorithm for SVM classifier design. Neural Computation, 13:637-649, 2001.
11. D. Lai, N. Mani, and M. Palaniswami. Increasing the step of the Newtonian decomposition method for support vector machines. Technical Report MECSE-29-2003, Dept. Electrical and Computer Systems Engineering Monash University, Australia, 2003a.
12. D. Lai, N. Mani, and M. Palaniswami. A new method to select working sets for faster training for support vector machines. Technical Report MESCE-30-2003, Dept. Electrical and Computer Systems Engineering Monash University, Australia, 2003b.
13. Chih-Jen Lin. Linear convergence of a decomposition method for support vector machines. Technical report, Department of Computer Science, National Taiwan University, 2001a. URL http://www.csie.ntu.edu.tw/~cjlin/papers/linearconv.pdf.
14. Chih-Jen Lin. On the convergence of the decomposition method for support vector machines. IEEE Transactions on Neural Networks, 12(6):1288-1298, 2001b. URL http://www.csie.ntu.edu.tw/~cjlin/papers/conv.ps.gz.
15. Chih-Jen Lin. Asymptotic convergence of an SMO algorithm without any assumptions. IEEE Transactions on Neural Networks, 13(1):248-250, 2002. URL http://www.csie.ntu.edu.tw/~cjlin/papers/q2conv.pdf.
16. D. Michie, D. J. Spiegelhalter, and C. C. Taylor. Machine Learning, Neural and Statistical Classification. Prentice Hall, Englewood Cliffs, N.J., 1994. Data available at http://www.ncc.up.pt/liacc/ML/statlog/datasets.html.
17. E. Osuna, R. Freund, and F. Girosi. Training support vector machines: An application to face detection. In Proceedings of CVPR'97, pages 130-136, New York, NY, 1997. IEEE.
18. light algorithm. Optimization Methods and Software, 20(2-3) :315-332, 2005.
19. J. C. Platt. Fast training of support vector machines using sequential minimal optimization. In Bernhard Schölkopf, Christopher J. C. Burges, and Alexander J. Smola, editors, Advances in Kernel Methods - Support Vector Learning, Cambridge, MA, 1998. MIT Press.
20. Danil Prokhorov. IJCNN 2001 neural network competition. Slide presentation in IJCNN'01, Ford Research Laboratory, 2001. http://www.geocities.com/ijcnn/nnc_ijcnn01.pdf
21. B. Schölkopf, A. Smola, R. C. Williamson, and P. L. Bartlett. New support vector algorithms. Neural Computation, 12:1207-1245, 2000.
22. Hans Ulrich Simon. On the complexity of working set selection. In Proceedings of the 15th International Conference on Algorithmic Learning Theory (ALT 2004), 2004.