An affinity-based new local distance function and similarity measure for kNN algorithm

Pattern Recognition Letters

Volumn 33, Issue 3, 2012, Pages 356-363

  Bhattacharya, Gautam ^a   Ghosh, Koushik ^a   Chowdhury, Ananda S ^b  

^a UNIVERSITY OF BURDWAN   (India)

^b JADAVPUR UNIVERSITY   (India)

Author keywords

Affinity function; kNN; Similarity measure

Indexed keywords

AFFINITY FUNCTIONS; CLASSIFICATION ACCURACY; CROSS-VALIDATIONS; DISTANCE MEASURE; K NEAREST NEIGHBOR ALGORITHM; K-NN ALGORITHM; KNN; LOCAL DISTANCE FUNCTION; LOCAL LEARNING; MACHINE-LEARNING; NUMBER OF DATUM; NUMERICAL DATASETS; SIMILARITY FUNCTIONS; SIMILARITY MEASURE; TEST PATTERN; TEST POINTS; TRAINING PURPOSE;

LEARNING ALGORITHMS;

CLUSTERING ALGORITHMS;

EID: 84255175580     PISSN: 01678655     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patrec.2011.10.021     Document Type: Article

References (44)

1. C.G. Atkeson, A.W. Moore, and S. Schaal Locally weighted learning Artif. Intell. Rev. 11 1997 11 73 (Pubitemid 127508233)
2. T. Bailey, and A. Jain A note on distance weighted k-nearest neighbour rules IEEE Trans. Systems Man Cybernet. 8 1978 311 313 (Pubitemid 8602891)
3. L. Baoli, C. Yuzhong, and Y. Shiwen A comparative study on automatic categorization methods for Chinese search engine Proc. 8th Joint Internat. Computer Conf. 2002 Zhejiang University Press Hangzhou 117 120
4. S. Bermejo, and J. Cabestany Adaptive soft k-nearest-neighbour classifiers Pattern Recognition 33 2000 1999 2005
5. A. Billot, I. Gilboa, and D. Schmeidler Axiomatization of an exponential similarity function Math. Soc. Sci. 55 2008 107 115
6. Boriah, S.; Chandola, V.; Kumar, V.; 2008. Similarity measures for categorical data: A comparative evaluation. In: Proc. SIAM Data Mining Conf.; Atlanta, GA, pp. 243-254.
7. S.H. Cha Comprehensive survey on distance/similarity measures between probability density functions Internat. J. Math. Models and Methods Appl. Sci. 1 4 2007 300 307
8. T.H. Cormen, C.E. Leiserson, R.L. Rivest, and C. Stein Introduction to Algorithms 2001 MIT Press USA
9. T.M. Cover, and P. Hart Nearest neighbour pattern classification IEEE Trans. Inform. Theory 13 1 1967 21 27
10. Davis, J.; Kulis, B.; Jain, P.; Sra, S.; Dhillon, I.; 2007. Information-theoretic metric learning. In: Proc. ICML. Corvalis, Oregon, pp. 209-216.
11. E. Deza, and M.M. Deza Dictionary of Distances 2006 Elsevier
12. Dietterich, T.G.; Wettschereck, D.; Atkeson, C.G.; Moore, A.W.; 1993. Memory based methods for regression and classification. In: Proc. NIPS 1993, pp. 1165-1166.
13. C. Domeniconi, J. Peng, and D. Gunopulos Locally adaptive metric nearest neighbour classification IEEE Trans. Pattern Anal. Machine Intell. 24 9 2002 1281 1285 (Pubitemid 35242588)
14. R.O. Duda, P.E. Hart, and D.G. Stork Pattern Classification 2nd ed. 2001 John Wiley & Sons New York
15. S.A. Dudani The distance-weighted k-nearest-neighbour rules IEEE Trans. Systems Man Cybernet. 6 1976 325 332
16. Fix, E.; Hodges, J.L.; 1951. Discriminatory analysis, nonparametric discriminators: Consistency properties. Technical Report 4, USAF School of Aviation Medicine, Randolph Field, Texas.
17. Frome, A.; Singer, Y.; Sha, F.; Malik, J.; 2007. Learning globally-consistent local distance functions for shape-based image retrieval and classification. In: Proc. Computer Vision, ICCV.
18. K. Fukunaga, and L. Hostetler k-Nearest-neighbour Bayes-risk estimation IEEE Trans. Inform. Theory 21 3 1975 285 293
19. D.G. Gavin, W.W. Oswald, E.R. Wahe, and J.W. Williams A statistical approach to evaluating distance metrics and analog assignments for pollen records Quater. Res. 60 2003 356 367 (Pubitemid 38012839)
20. T. Hastie, and R. Tibshirani Discriminant adaptive nearest neighbour classification IEEE Trans. Pattern Anal. Machine Intell. 18 6 1996 607 616 (Pubitemid 126773896)
21. T. Hastie The Elements of Statistical Learning 2nd ed. 2009 Springer p. 172
22. M.E. Helman The nearest neighbour classification rule with a reject option IEEE Trans. System Man Cybernet. 3 1970 179 185
23. A. Jozwik A learning scheme for a fuzzy k-NN rule Pattern Recognition Lett. 1 1983 287 289
24. J.M. Keller, M.R. Gray, and J.A. Givens A fuzzy k-NN neighbour algorithm IEEE Trans. Systems Man Cybernet. 15 4 1985 580 585
25. Kulis, B.; 2010. Metric learning, ICML 2010 Tutorial.
26. Mahalanobis, P.C.; 1936. On the generalised distance in statistics. In: Proc. National Institute of Sciences of India 2(1), pp. 49-55.
27. McFee, B.; Lanckriet, G.; 2010. Metric learning to rank. In Proc. ICML. Haifa, Israel, pp. 775-782.
28. Michie, D.; Spiegelhalter, D.J.; Taylor, C.C.; 1994. Machine Learning, Neural and Statistical Classification. Ellis Horwood, Upper Saddle River, NJ, USA.
29. P. Mitra, C.A. Murthy, and S.K. Pal Unsupervised feature selection using feature similarity IEEE Trans. Pattern Anal. Machine Intell. 24 3 2002 301 312 (Pubitemid 35289348)
30. P. Mitra, C.A. Murthy, and S.K. Pal Density-based multiscale data condensation IEEE Trans. Pattern Anal. Machine Intell. 24 6 2002 734 747 (Pubitemid 34669588)
31. Monev, V.; 2004. Introduction to similarity searching in chemistry. MATCH - Communications. In: Proc. Mathematical and Computational Chemistry, vol. 51, pp. 7-38.
32. Parvin, H.; Alizadeh, H.; Minaes-Bidgoli, B.; 2008. MKNN: Modified k-nearest neighbor. In: Proc. World Congress on Engineering and Computer Science (WCECS) San Francisco, USA.
33. E. Parzen On estimation of a probability density function and mode Ann. Math. Statist. 33 1962 1065 1076
34. Ricci, F.; Avesani, P.; 1996. Nearest neighbour classification with a local asymmetrically weighted metric. IRST. Protocol No.; 9601-12.
35. M.A. Tahir, and J. Smith Creating diverse nearest neighbor ensembles using simultaneous metaheuristic feature selection Pattern Recognition Lett. 31 2010 1470 1480
36. Tsang, I.; Cheung, P.; Kwok, J.; 2005. Kernel relevant component analysis for distance metric learning. In: Proc. IJCNN.
37. J. Wang, P. Neskovic, and L. Cooper Improving neighbour rule with a simple adaptive distance measure Pattern Recognition Lett. 28 2007 207 213 (Pubitemid 44716403)
38. Wang, S.; Jin, R. 2009. Information geometry approach for distance metric learning. In: Proc. 12th Internat. Conf. on Artificial Intelligence and Statistics (AISTATS). JMLR: W&CP, vol. 5. Clearwater Beach, Florida, USA.
39. Weinberger, K.; Blitzer, J.; Saul, L.; 2005. Distance metric learning for large margin nearest neighbor classification. In: Proc. NIPS.
40. Wu, G.; Chang, E.Y.; Panda, N.; 2005. Formulating distance functions via kernel trick. In: Proc. Conf. on Knowledge Discovery and Data Mining (KDD), pp. 703-709.
41. Xing, E.; Ng, A.; Jordan, M.; Russell, S.; 2002.Distance metric learning, with application to clustering with side-information. In: Proc. NIPS.
42. Yang, Y.; Liu, X.; 1999. A re-examination of text categorization methods. In: Proc. 22nd Annual Internat. ACM SIGIR Conf. on Research and Development in Information Retrieval, pp. 42-49.
43. Yin, X.; Han, J.; 2003. CPAR: Classification based on predictive association rules. In: Proc. SIAM Internat. Conf. on Data Mining (SDM), San Francisco, CA, USA.
44. P. Zezula, G. Amato, V. Dohnal, and M. Batko Similarity Search the Metric Space Approach 2006 Springer