κ-NS: A classifier by the distance to the nearest subspace

IEEE Transactions on Neural Networks

Volumn 22, Issue 8, 2011, Pages 1256-1268

  Liu, Yiguang ^a   Ge, Shuzhi Sam ^b   Li, Chunguang ^c   You, Zhisheng ^a  

^a SICHUAN UNIVERSITY   (China)

^b University of Electronic Science and Technique of China   (China)

^c ZHEJIANG UNIVERSITY   (China)

Author keywords

Grammian geometric meaning; kernel function nearest subspace; Tikhonov regularization

Indexed keywords

BENCHMARK DATASETS; CLASSIFICATION PERFORMANCE; EUCLIDIAN DISTANCE; GRAMMIAN GEOMETRIC MEANING; HIGH-DIMENSIONAL FEATURE SPACE; INNER PRODUCT; KERNEL FUNCTION; KERNEL FUNCTION NEAREST SUBSPACE; NEAREST NEIGHBORS; TEST ACCURACY; TIKHONOV REGULARIZATION;

PROBLEM SOLVING;

ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; COMPARATIVE STUDY; METHODOLOGY; STATISTICAL MODEL;

ARTIFICIAL INTELLIGENCE; MODELS, STATISTICAL; PATTERN RECOGNITION, AUTOMATED;

EID: 80051552901     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2011.2153210     Document Type: Article

References (42)

1. H. Chen and B. Bhanu, "Efficient recognition of highly similar 3-D objects in range images," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 1, pp. 172-179, Jan. 2009.
2. S. S. Ge, Y. Yang, and T. H. Lee, "Hand gesture recognition and tracking based on distributed locally linear embedding," Image Vis. Comput., vol. 26, no. 12, pp. 1607-1620, Dec. 2008.
3. Y. Yang, S. S. Ge, T. H. Lee, and C. Wang, "Facial expression recognition and tracking for intelligent human-robot interaction," Intell. Serv. Robot., vol. 1, no. 2, pp. 143-157, Apr. 2008.
4. H. Cevikalp, D. Larlus, M. Douze, and F. Jurie, "Local subspace classifiers: Linear and nonlinear approaches," in Proc. IEEE Workshop Mach. Learn. Signal Process., Thessaloniki, Greece, Aug. 2007, pp. 57-62.
5. B. V. Dasarathy, Nearest Neighbor (NN) Norms: NN Pattern Classification Technologies. Los Alamitos, CA: IEEE Press, 1990.
6. T. Hastie and R. Tibshirani, "Discriminant adaptive nearest neighbor classification," IEEE Trans. Pattern Anal. Mach. Intell., vol. 18, no. 6, pp. 607-616, Jun. 1996. (Pubitemid 126773896)
7. J. Peng, D. R. Heisterkamp, and H. K. Dai, "LDA/SVM driven nearest neighbor classification," IEEE Trans. Neural Netw., vol. 14, no. 4, pp. 940-942, Jul. 2003.
8. H. Cevikalp, B. Triggs, and R. Polikar, "Nearest hyperdisk methods for high-dimensional classification," in Proc. 25th Int. Conf. Mach. Learn., vol. 307. 2008, pp. 120-127.
9. P. Vincent and Y. Bengio, "K-local hyperplane and convex distance nearest neighbor algorithms," in Proc. Neural Inf. Process. Syst., 2001, pp. 1-9.
10. A. Jain and B. Chandrasekaran, "Dimensionality and samples size considerations in pattern recognition practiace," in Handbook Statistics, vol. 2. Amsterdam, The Netherlands: North Holland, 1982, pp. 835-855.
11. H. A. Fayed and A. F. Atiya, "A novel template reduction approach for the K-nearest neighbor method," IEEE Trans. Neural Netw., vol. 20, no. 5, pp. 890-896, May 2009.
12. J. Laaksonen, "Subspace classifiers in recognition of handwritten digits," Ph.D. thesis, Dept. Comput. Sci. Eng., Helsinki Univ. Technol., Helsinki, Finland, 1997.
13. G. I. Nalbantov, P. J. F. Groenen, and J. C. Bioch, "Nearest convex hull classification," Econometric Inst., Erasmus Univ. Rotterdam, Rotterdam, The Netherlands, Tech. Rep. EI 2006-50, 2007.
14. S. Watanabe, P. F. Lambert, C. A. Kulikowski, J. L. Buxton, and R. Walker, "Evaluation and selection of variables in pattern recognition," in Computer and Information Sciences II. New York: Academic, 1967.
15. T. Balachander and R. Kothari, "Kernel based subspace pattern classification," in Proc. Int. Joint Conf. Neural Netw., vol. 5. Washington D.C., Jul. 1999, pp. 3119-3122. (Pubitemid 30593542)
16. C. Domeniconi, D. Gunopulos, and J. Peng, "Large margin nearest neighbor classifiers," IEEE Trans. Neural Netw., vol. 16, no. 4, pp. 899-909, Jul. 2005. (Pubitemid 41064321)
17. J. Peng, D. R. Heisterkamp, and H. Dai, "Adaptive quasiconformal kernel nearest neighbor classification," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 5, pp. 656-661, May 2004.
18. J. Wang, P. Neskovic, and L. N. Cooper, "Neighborhood size selection in the k-nearest-neighbor rule using statistical confidence," Pattern Recognit., vol. 39, no. 3, pp. 417-423, Mar. 2006. (Pubitemid 41808622)
19. C. J. Veenman and M. J. T. Reinders, "The nearest subclass classifier: A compromise between the nearest mean and nearest neighbor classifier," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 9, pp. 1417-1429, Sep. 2005. (Pubitemid 41387773)
20. B. Li, Y. W. Chen, and Y. Q. Chen, "The nearest neighbor algorithm of local probability centers," IEEE Trans. Syst., Man, Cybern., Part B: Cybern., vol. 38, no. 1, pp. 141-154, Feb. 2008. (Pubitemid 351285021)
21. A. Cervantes, I. M. Galván, and P. Isasi, "AMPSO: A new particle swarm method for nearest neighborhood classification," IEEE Trans. Syst., Man, Cybern., Part B: Cybern., vol. 39, no. 5, pp. 1082-1091, Oct. 2009.
22. R. Rifkin and A. Klautan, "In defense of one-versus-all classification," J. Mach. Learn. Res., vol. 5, pp. 101-141, Jan. 2004.
23. L. Breiman, "Random forests," Mach. Learn., vol. 45, no. 1, pp. 5-32, Oct. 2001. (Pubitemid 32933532)
24. N. Barth, "The gramian and k-volume in n-space: Some classical results in linear algebra," J. Young Investigat., vol. 2, no. 1, pp. 1-4, Jun. 1999.
25. C. D. Meyer, Matrix Analysis and Applied Linear Algebra. Philadelphia, PA: SIAM, Feb. 2001.
26. R. A. Horn and C. R. Johnson, Matrix Analysis. Cambridge, U.K.: Cambridge Univ. Press, 1986.
27. E. Deza and M. M. Deza, Dictionary of Distances. Amsterdam, The Netherlands: Elsevier, 2006.
28. R. Aster, B. Borchers, and C. Thurber, "Tikhonov regularization," Parameter Estimat. Inver. Probl. (Int. Geophys.), vol. 90, pp. 89-118, Jan. 2005.
29. M. Bertero, "Regularization methods for linear inverse problems," in Lecture Notes in Mathematics. Berlin, Germany: Springer-Verlag, 1986, pp. 52-112.
30. V. N. Vapnik, Statistical Learning Theory. New York: Wiley, 1998.
31. B. Schölkopf and A. J. Smola, Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond. Cambridge, MA: MIT Press, Dec. 2001.
32. X. Jiang, "Asymmetric principal component and discriminant analyses for pattern classification," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 5, pp. 931-937, May 2009.
33. D. Tao, X. Li, X. Wu, and S. J. Maybank, "Geometric mean for subspace selection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 2, pp. 260-274, Feb. 2009.
34. P. Zhang, J. Peng, and C. Domeniconi, "Kernel pooled local subspaces for classification," IEEE Trans. Syst., Man, Cybern., Part B: Cybern., vol. 35, no. 3, pp. 489-502, Jun. 2005. (Pubitemid 40794860)
35. J. C. Platt, "Fast training of support vector machines using sequential minimal optimization," in Advanced in Kernel Methods-Support Vector Learning, B. Schölkopf, C. J. C. Burges, and A. J. Smola, Eds. Cambridge, MA: MIT Press, 1999, pp. 185-208.
36. A.Wieland. Twin Spiral Dataset [Online]. Available: http://www.cs.cmu. edu/afs/cs/project/ai-repository/ai/areas/neural/bench/cmu%/bench.tgz
37. A. Asuncion and D. Newman. (2007). UCI Machine Learning Repository [Online]. Available: http://archive.ics.uci.edu/ml/
38. A. B. A. Graf, A. J. Smola, and S. Borer, "Classification in a normalized feature space using support vector machines," IEEE Trans. Neural Netw., vol. 14, no. 3, pp. 597-605, May 2003.
39. V. Franc and V. Hlavac. (2008, Feb.). Statistical Pattern Recognition Toolbox for MATLAB [Online]. Available: http://cmp.felk.cvut.cz/cmp/software/ stprtool/index.html
40. S. S. Keerthi and C.-J. Lin, "Asymptotic behaviors of support vector machines with Gaussian kernel," Neural Comput., vol. 15, no. 7, pp. 1667-1689, Jul. 2003. (Pubitemid 37035565)
41. G. Villard, "Computation of the inverse and determinant of a matrix," in Algorithms Seminar, F. Chyzak, Ed. Rocquencourt, France: INRIA, 2003, pp. 29-32.
42. V. Y. Pan and Z. Q. Chen, "The complexity of the matrix eigenproblem," in Proc. Annu. 31st ACM Symp. Theory Comput., Atlanta, GA, 1999, pp. 507-516.