Reducing SVM Classification Time Using Multiple Mirror Classifiers

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Volumn 34, Issue 2, 2004, Pages 1173-1183

  Chen, Jiun Hung ^a   Chen, Chu Song ^b  

^a University of Washington   (United States)

^b INSTITUTE OF INFORMATION SCIENCE   (Taiwan)

Author keywords

Classification; Kernel based method; Multiple classifier system; Supervised learning; Support vector machine

Indexed keywords

ALGORITHMS; APPROXIMATION THEORY; COMPUTATION THEORY; ERROR ANALYSIS; HEURISTIC METHODS; LAGRANGE MULTIPLIERS; PROBLEM SOLVING; REGRESSION ANALYSIS; STATISTICAL METHODS; VECTORS;

CLASSIFICATION SYSTEMS; KERNEL BASED METHODS; MULTIPLE CLASSIFIER SYSTEMS; SUPERVISED LEARNING; SUPPORT VECTOR MACHINES (SVM);

DECISION THEORY;

EID: 1842535238     PISSN: 10834419     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCB.2003.821867     Document Type: Article

References (36)

1. R. Bellman, Dynamic Programming. Princeton, NJ: Princeton Univ. Press, 1957.
2. D. D. Broomhead and D. Lowe, "Multivariable functional interpolation and adaptive networks," Complex Syst., vol. 2, pp. 321-335, 1988.
3. C. Burges, "Simplified support vector decision rules," in Proc. 13th Int. Conf. Machine Learning, Bari, Italy, 1996, pp. 71-77.
4. J.-H. Chen and C.-S. Chen, "Speeding up SVM decision based on mirror points," in Proc. 16th Int. Conf. Pattern Recognition, ICPR 2002, Quebec City, QB, Canada.
5. _, "Fuzzy kernel perception," IEEE Trans. Neural Networks, vol. 13, pp. 1364-1373, 2002.
6. R. Collobert, S. Bengio, and Y. Bengio, "A parallel mixture of SVM's for very large scale problems," Neural Comput., vol. 14, pp. 1105-1114. 2002.
7. Y. Freund, "An adaptive verision of the boost by majority algorithm," Mach. Learn., vol. 43, pp. 293-318, 2001.
8. Y. Freund and R. E. Schapire, "A decision-theoretic generalization of on-line learning and an pplication to boosting," J. Comput. Syst. Sci., vol. 55, pp. 119-139, 1997.
9. G. Giacinto, F. Roli, and G. Fumera, "Design of effective multiple classifier systems by clustering of classifiers," in Proc. 15th Int. Conf. Pattern Recognition, vol. 2, Barcelona, Spain, 2000, pp. 160-163.
10. L. K. Hansen and P. Salamon, "Neural network ensembles," IEEE Trans. Pattern Anal. Machine Intell., vol. 12, pp. 993-1001, Oct. 1990.
11. S. Hashem, "Optimal linear combinations of neural networks," Neural Networks, vol. 10, pp. 599-614, 1997.
12. S. Haykin, Neural Networks a Comprehensive Foundation, 2nd ed. Upper Saddle River, NJ: Prentice-Hall, 1999.
13. T. K. Ho, J. J. Hull, and S. N. Srihari, "Decision combination in multiple classifier systems," IEEE Trans. Pattern Anal. Machine Intell., vol. 16, pp. 66-75, Jan. 1994.
14. M. Kearns and L. Valiant, "Cryptographic limitations on learning Boolean formuale and finite automata," J. ACM, vol. 41, pp. 67-95, 1994.
15. A. Krogh and J. Vedelsby, "Neural network ensembles, cross validation and active learning," in Advances in Neural Information Processing Systems, D. S. Touretzky, G. Tesauro, and T. K. Leen, Eds. Cambridge, MA: MIT Press, 1995, pp. 231-238.
16. L. I. Kuncheva, "A theoretical study on six classifier fusion strategies," IEEE Trans. Pattern Anal. Machine Intell., vol. 24, pp. 281-286, Feb. 2002.
17. R. Meir and G. Rätsch, "An introduction to boosting and leveraging," in Advanced Lectures on Machine Learning, S. Mendelson and A. Smola, Eds. New York: Springer, 2003. pp. 119-184.
18. K.-R. Müller, S. Mika, G. Rätsch, K. Tsuda, and B. Schölkopf, "An introduction to kernel-based learning algorithms," IEEE Trans. Neural Network, vol. 12, pp. 181-201, Mar. 2001.
19. H. Murase and S. K. Nayar, "Visual learning and recognition of 3-d objects from appearance," Int. J. Comput. Vis., vol. 14, pp. 5-24, 1995.
20. D. Optiz and J. Shavlik, "A genetic algorithm approach for creating neural network ensembles," in Combining Artificial Neural Nets: Ensemble and Modular Multi-Net Systems, A. J. C. Sharkey, Ed. NY: Springer-Verlag, 1999, pp. 79-99.
21. E. Osuna, R. Freund, and F. Girosi, "Training support vector machines: an application to face detection," in Proc. Computer Vision and Pattern Recognition, San Juan, PR, 1997, pp. 130-136.
22. E. Osuna and F. Girosi, "Reducing the run-time complexity of support vector machines," in Advances in Kernel Methods: Support Vector Learning, B. Schölkopf, C. Burges, and A. Smola, Eds. Cambridge, MA: MIT Press, 1999, pp. 271-284.
23. D. Partridge and W. B. Yates, "Engineering multiversion neural-net system," Neural Comput., vol. 8, pp. 869-893, 1996.
24. T. Poggio and F. Girosi, "Networks for approximation and learning," Proc. IEEE, vol. 78, pp. 1481-1497, 1990.
25. M. Pontil and A. Verri, "Support vector machines for 3-D object recognition," IEEE Trans. Pattern Anal. Machine Intell., vol. 20, pp. 637-646, June 1998.
26. G. Rätsch, T. Onoda, and K.-R. Müller, "Soft margins for AdaBoost," Mach. Learn., vol. 43, pp. 287-320, 2001.
27. S. Romdhani, P. Torr, B. Scho̧lkopf, and A. Blake, "Computationally efficient face detection," in Proc. 8th IEEE Int. Conf. Computer Vision, Vancouver, BC, Canada, 2001, pp. 695-700.
28. B. E. Rosen, "Ensemble learning using decorrelated neural network," Connect. Sci., vol. 8, pp. 373-383, 1996.
29. B. Schölkopf, S. Mika, C. J. C. Burges, P. Knirsch, K.-R. Müller, G. Rätsch, and A. J. Smola, "Input space versus feature space in kernel-based methods," IEEE Trans. Neural Networks, vol. 10, pp. 1000-1017, Sept. 1999.
30. R. A. Servedio, "Smooth boosting and learning wtih malicious noise," in Proc. 14th Annu. Conf. Computational Learning Theory, 1999, pp. 278-285.
31. A. J. C. Sharkey, Combining Artificial Neural Nets: Ensemble and Modular Multi-Net Systems. New York: Springer-Verlag, 1999.
32. A. J. C. Sharkey and N. E. Sharkey, "Combining diverse neural nets," Knowl. Eng. Rev., vol. 12, pp. 231-247, 1997.
33. M. E. Tipping, "Sparse bayesian learning and the relevance vector machine," J. Mach. Learn. Res., vol. 1, pp. 211-244, 2001.
34. N. Ueda, "Optimal linear combination of neural networks for improving classification performance," IEEE Trans. Pattern Anal. Machine Inell., vol. 22, pp. 207-213, Feb. 2000.
35. V. Vapnik, The Nature of Statistical Learning Theory. New York: Springer-Verlag, 1995.
36. L. Xu, A. Krzyzák, and C. Y. Suen, "Methods of combining multiple classifiers and their applications to handwriting recognition," IEEE Trans. Syst., Man, Cybern., vol. 22, pp. 418-435, 1992.