Scaling up support vector machines using nearest neighbor condensation

IEEE Transactions on Neural Networks

Volumn 21, Issue 2, 2010, Pages 351-357

  Angiulli, Fabrizio ^a   Astorino, Annabella ^b  

^a UNIVERSITY OF CALABRIA   (Italy)

^b CNR   (Italy)

Author keywords

Classification; Large data sets; Nearest neighbor rule; Support vector machines (SVMs); Training set condensation

Indexed keywords

CLASSIFICATION RULES; FAST RESPONSE TIME; LARGE DATA SETS; LOSS OF ACCURACY; MULTI-DIMENSIONAL DATASETS; NEAREST NEIGHBOR RULE; NEAREST NEIGHBORS; ORDERS OF MAGNITUDE; SCALING-UP; SUPPORT VECTOR; SVM CLASSIFIERS; TRAINING AND TESTING; TRAINING SETS;

CLASSIFICATION (OF INFORMATION); CONDENSATION; GEARS; MULTILAYER NEURAL NETWORKS; VECTORS;

SUPPORT VECTOR MACHINES;

EID: 76749097649     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2009.2039227     Document Type: Article

References (20)

1. F. Angiulli, "Fast nearest neighbor condensation for large data sets classification," IEEE Trans. Knowl. Data Eng., vol.19, no.11, pp. 1450-1464, Nov. 2007. (Pubitemid 47573790)
2. G. H. Bakur, L. Bottou, and J. Weston, "Breaking SVM complexity with cross-training," in Advances in Neural Information Processing Systems (NIPS). Cambridge, MA: MIT Press, 2004.
3. B. Boser, I. Guyon, and V. Vapnik, "A training algorithm for optimal margin classifiers," in Proc. 5th Annu. Workshop Comput. Learn. Theory, 1992, pp. 144-152.
4. C.-C. Chang and C.-J. Lin, LIBSVM: A Library for Support Vector Machines, 2001 [Online]. Available: http://www.csie.ntu.edu.tw/cjlin/ libsvm
5. N. Cristianini and J. Shawe-Taylor, An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods. Cambridge, U.K.: Cambridge Univ. Press, 2000.
6. W. Gates, "The reduced nearest neighbor rule," IEEE Trans. Inf. Theory, vol.IT-18, no.3, pp. 431-433, May 1972.
7. P. E. Hart, "The condensed nearest neighbor rule," IEEE Trans. Inf. Theory, vol.IT-14, no.3, pp. 515-516, May 1968.
8. L.-R. Jen and Y.-J. Lee, "Clustering model selection for reduced support vector machines," in Proc. Int. Conf. Intell. Data Eng. Autom. Learn., 2004, pp. 714-719.
9. B. Karaçali and H. Krim, "Fast minimization of structural risk by nearest neighbor rule," IEEE Trans. Neural Netw., vol.14, no.1, pp. 127-134, Jan. 2002.
10. Y.-J. Lee, H.-Y. Lo, and S.-Y. Huang, "Incremental reduced support vector machine," in Proc. Int. Conf. Inf. Cybern. Syst., 2003.
11. Y.-J. Lee and O. L. Mangasarian, "RSVM: Reduced support vector machines," in Proc. 1st SIAM Int. Conf. Data Mining, 2001.
12. P. M. Murphy and D. W. Aha, UCI Repository of Machine Learning Databases, Univ. California Irvine, Irvine, CA, 1992 [Online]. Available: www.ics.uci.edu/∼mlearn/MLRepository.html
13. E. Osuna, R. Freund, and F. Girosi, "An improved training algorithm for support vector machines," in Proc. IEEE Workshop Neural Netw. Signal Process., 1997, pp. 276-285.
14. J. Platt, "Sequential minimal optimization:A fast algorithm for training support vector machines," in Advances in Kernel Methods-Support Vector Learning, B. Schölkopf, C. Burges, and A. Smola, Eds. Cambridge, MA: MIT Press, 1999.
15. B. Schölkopf, "Advances in kernel methods: Support vector learning," in Advances in Neural Information Processing System, C. J. C. Burges and A. J. Smola, Eds. Cambridge, MA: MIT Press, 1999.
16. J. Shawe-Taylor and N. Cristianini, Kernel Methods for Pattern Analysis. Cambridge, U.K.: Cambridge Univ. Press, 2004.
17. G. Toussaint, "Proximity graphs for nearest neighbor decision rules: Recent progress," in Proc. Symp. Comput. Statist., Montreal, QC, Canada, 2002, pp. 17-20.
18. V. Vapnik, The Nature of the Statistical Learning Theory. New York: Springer-Verlag, 1995.
19. D. R. Wilson and T. R. Martinez, "Reduction techniques for instancebased learning algorithms," Mach. Learn., vol.38, no.3, pp. 257-286, 2000.
20. H. Yu, J. Yang, and J. Han, "Classifying large data sets using SVMs with hierarchical clusters," in Proc. Int. Conf. Knowl. Disc. Data Mining, 2003, pp. 306-315.