Maxi-min margin machine: Learning large margin classifiers locally and globally

IEEE Transactions on Neural Networks

Volumn 19, Issue 2, 2008, Pages 260-272

  Huang, Kaizhu ^a   Yang, Haiqin ^b   King, Irwin ^c   Lyu, Michael R ^c  

^a Fujitsu Research and Development Center Co Ltd   (China)

^b Titanium Technology Limited   (China)

^c CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Classification; Kernel methods; Large margin; Learning locally and globally; Second order cone programming

Indexed keywords

CLASSIFICATION (OF INFORMATION); DISCRIMINANT ANALYSIS; OPTIMIZATION;

KERNEL METHODS; MAXI-MIN MARGIN MACHINE; MINIMAX PROBABILITY MACHINE; SECOND-ORDER CONE PROGRAMMING;

SUPPORT VECTOR MACHINES;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; AUTOMATED PATTERN RECOGNITION; CLUSTER ANALYSIS;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; CLUSTER ANALYSIS; NEURAL NETWORKS (COMPUTER); PATTERN RECOGNITION, AUTOMATED;

EID: 40549124666     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2007.905855     Document Type: Article

References (27)

1. C. L. Blake and C. J. Merz, "UCI Repository of Machine Learning Databases," Univ. California, Irvine, Dept. Inf. Comput. Sci., Irvine, CA, 1998 Online. Available: http://www.ics.uci.edu/~mlearn/ ML-Repository.html
2. L. Breiman, "Arcing classifiers," Statistics Dept., Univ. California, Berkeley, CA, Tech. Rep. 460, 1997.
3. K. Fukunaga, Introduction to Statistical Pattern Recognition, 2nd ed. San Diego, CA: Academic, 1990.
4. K. Huang, H. Yang, I. King, and M. R. Lyu, R. Greiner and D. Schuurmans, Eds., "Learning large margin classifiers locally and globally," in Proc. 21st Int. Conf. Mach. Learn. (ICML), 2004, pp. 401-408.
5. K. Huang, H. Yang, I. King, M. R. Lyu, and L. Chan, "The minimum error minimax probability machine," J. Mach. Learn. Res., vol. 5, pp. 1253-1286, 2004.
6. V. V. Ivannov, "On linear problems which are not well-posed," Soviet Math. Docl., vol. 3, no. 4, pp. 981-983, 1962.
7. R. Kohavi, "A study of cross validation and bootstrap for accuracy estimation and model selection," in Proc. 14th Int. Joint Conf. Artif. Intell. (IJCAI), San Francisco, CA, 1995, pp. 338-345.
8. G. R. G. Lanckriet, L. E. Ghaoui, C. Bhattacharyya, and M. I. Jordan, "A robust minimax approach to classification," J. Mach. Learn. Res. vol. 3, pp. 555-582, 2002.
9. Y. J. Lee and S. Y. Huang, "Reduced support vector machines: A statistical theory," IEEE Trans. Neural Netw., vol. 18, no. 1, pp. 1-13, Jan. 2007.
10. C.-F. Lin and S.-D. Wang, "Fuzzy support vector machines," IEEE Trans. Neural Netw., vol. 13, no. 2, pp. 464-471, Mar. 2002.
11. M. Lobo, L. Vandenberghe, S. Boyd, and H. Lebret, "Applications of second order cone programming," Linear Algebra Appl., vol. 284, pp. 193-228, 1998.
12. R. Lotlikar and R. Kothari, "Fractional-step dimensionality reduction," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 6, pp. 623-627, Jun. 2000.
13. J. Lu, K. N. Plataniotis, and A. N. Venetsanopoulos, "Face recognition using LDA-based algorithms," IEEE Trans. Neural Netw., vol. 14, no. 1, pp. 195-200, Jan. 2003.
14. Y. Nesterov and A. Nemirovsky, Interior Point Polynomial Methods in Convex Programming: Theory and Applications, ser. Studies in Applied Mathematics. Philadelphia, PA: SIAM, 1994.
15. J. Peng, D. R. Heisterkamp, and H. K. Dai, "LDASVM driven nearest neighbor classification," in Proc. 2001 IEEE Computer Soc. Conf. Comput. Vis. Pattern Recognit., 2001, vol. 1, pp. 58-63.
16. J. Platt, "Sequential minimal optimization: A fast algorithm for training support vector machines," Tech. Rep. MSR-TR-98-14, 1998.
17. A. Pruessner, "Conic programming in GAMS," in Proc. Optim. Software - The State of the Art, Atlanta, GA, 2003 Online. Available: http://www.gamsworld.org/cone/links.htm
18. B. Scholkopf and A. Smola, Learning With Kernels. Cambridge, MA: MIT Press, 2002.
19. J. F. Sturm, "Using Sedumi 1.02, a Matlab toolbox for optimization over symmetric cones," Optim. Methods Software, vol. 11, no. 625-653, 1999.
20. J. F. Sturm, "Central region method," in High Performance Optimization, J. B. G. Frenk, C. Roos, T. Terlaky, and S. Zhang, Eds. Norwell, MA: Kluwer, 2000, pp. 157-194.
21. J. A. K. Suykens, T. V. Gestel, J. Vandewalle, and B. D. Moor, "A support vector machine formulation to PCA analysis and its kernel version," IEEE Trans. Neural Netw., vol. 14, no. 2, pp. 447-450, Mar. 2003.
22. A. N. Tikhonov, "On solving ill-posed problem and method of regularization," Dokl. Akad. Nauk USSR, vol. 153, pp. 501-504, 1963.
23. S. Tong and D. Koller, "Restricted Bayes optimal classifiers," in Proc. 17th Nat. Conf. Artif. Intell. (AAAI), 2000, pp. 658-664.
24. V. N. Vapnik, Statistical Learning Theory. New York: Wiley, 1998.
25. V. N. Vapnik, The Nature of Statistical Learning Theory, 2nd ed. New York: Springer-Verlag, 1999.
26. V. V. Vasin, "Relationship of several variational methods for approximate solutions of ill-posed problems," Math. Notes, vol. 7, pp. 161-166, 1970.
27. J. Zhu, S. Rosset, T. Hastie, and R. Tibshirani, "1-norm support vector machines," in Advances in Neural Information Processing Systems 16 Cambridge, MA: MIT Press, 2003.