K Nearest Neighbor Equality: Giving equal chance to all existing classes

Information Sciences

Volumn 181, Issue 23, 2011, Pages 5158-5168

  Sierra, B ^a   Lazkano, E ^a   Irigoien, I ^a   Jauregi, E ^a   Mendialdua, I ^a  

^a UNIVERSITY OF THE BASQUE COUNTRY UPV EHU   (Spain)

Author keywords

Machine Learning; Nearest neighbor; Non parametric pattern recognition; Supervised classification

Indexed keywords

DISTANCE-BASED; JOINT DISTRIBUTIONS; K-NEAREST NEIGHBORS; MEAN DISTANCES; NEAREST NEIGHBOR CLASSIFICATION; NEAREST NEIGHBORS; NEAREST POINT; SAMPLE POINT; SELECTION PROCESS; SUPERVISED CLASSIFICATION;

LEARNING SYSTEMS; PATTERN RECOGNITION;

MOTION COMPENSATION;

EID: 80052949352     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2011.07.024     Document Type: Article

References (36)

1. D. Aha, D. Kibler, and M.K. Albert Instance-based learning algorithms Machine Learning 6 1991 37 66 (Pubitemid 21727227)
2. D. Aha Tolerating, irrelevant and novel attributes in instance-based learning algorithms International Journal of Man-Machine Studies 36 1 1992 267 287
3. B.L. Blake, C.J. Merz, UCI Repository of Machine Learning databases, Irvine, CA: University of California, Department of Information and Computer Science, 1998 (.
4. P. Clark, and T. Nibblet The CN2 induction algorithm Machine Learning 3 4 1989 261 283
5. B. Cestnik, Estimating probabilities: a crucial task in machine learning, in: Proceedings of the European Conference on Artificial Intelligence, 1990 pp. 147-149.
6. S. Cost, and S. Salzberg A weighted nearest neighbor algorithm for learning with symbolic features Machine Learning 10 1 1993 57 78
7. T.M. Cover, and P.E. Hart Nearest neighbor pattern classification IEEE Transactions IT-13 1 1967 21 27
8. B.V. Dasarathy Nearest Neighbor (NN) Norms: NN Pattern Recognition Classification Techniques 1991 IEE Computer Society Press
9. J. Demsar Statistical comparisons of classifiers over multiple data sets Journal of Machine Learning Research 7 2006 1 30 (Pubitemid 43022939)
10. T.G. Dietterich Machine learning research: four current directions AI Magazine 18 4 1997 97 136 (Pubitemid 127684659)
11. C. Domeniconi, D. Gunopulos, An Efficient approach for approximating multi-dimensional range queries and neares neighbor classification in large datasets, in: Proceedings of the Eighteenth International Conference on Machine Learning ICML01, 2001, pp. 98-105.
12. H.A. Fayed, and A.F. Atiya A novel template reduction approach for the K-nearest neighbor method IEEE Transactions on Neural Networks 20 5 2009 890 896
13. E. Fix, J.L. Hodges Jr., Discriminatory Analysis, Nonparametric Discrimination, USAF school of Aviation Medicine, Randolf field, Project 21-49-004, Rept 4, 1951.
14. Y. Gao, B. Zheng, G. Chen, Q. Li, C. Chen, and G. Chen Efficient mutual nearest neighbor query processing for moving object trajectories Information Sciences 180 11 2010 2176 2195
15. D. Guan, W. Yuan, Y.K. Lee, and S. Lee Nearest neighbor editing aided by unlabeled data Information Sciences 179 13 2009 2273 2282
16. R.C. Holte Very simple classification rules perform well on most commonly used databases Machine Learning 11 1993 63 90
17. I. Inza, P. Larrañaga, R. Etxeberria, and B. Sierra Feature subset selection by bayesian network-based optimization Artificial Intelligence 123 2000 157 184
18. M.Z. Jahromi, E. Parvinnia, and Robert John A method of learning weighted similarity function to improve the performance of nearest neighbor Information Sciences 179 17 2009 2964 2973
19. R. Kohavi, Scaling up the accuracy of naive-bayes classifiers: a decision-tree hybrid, in: Proceedings of the Second International Conference on Knowledge Discovery and Data Mining, 1996.
20. R. Kohavi, D. Sommerfield, and J. Dougherty Data mining using MLC++, a machine learning library in C++ International Journal of Artificial Intelligence Tools 6 4 1997 537 566 http://www.sgi.com/Technology/mlc/ (Pubitemid 128022865)
21. Y.C. Liaw, M.L. Leou, and C.M. Wu Fast exact K nearest neighbors search using an orthogonal search tree Pattern Recognition 43 2010 2351 2358
22. D. Michie, D.J. Spiegelhalter, C.C. Taylor (Eds.), Machine Learning, Neural and Statistical Classification ().
23. T. Mitchell Machine Learning 1997 McGraw-Hill
24. J.M. Martínez-Otzeta, B. Sierra, Analysis of the iterated probabilistic weighted k-nearest neighbor method, a new distance-based algorithm, in: 6th International Conference on Enterprise Information Systems (ICEIS) 2, 2004, pp. 233-240.
25. J.R. Quinlan Induction of decision trees Machine Learning 1 1986 81 106
26. J.R. Quinlan C4.5: Programs for Machine Learning 1993 Morgan Kaufman Publishers, Inc. Los Altos, California
27. A. Rozsypal, M. Kubat, Using the Genetic algorithm to reduce the size of a nearest-neighbor classifier and to select relevant attributes, in: Proceedings of the Eighteenth International Conference on Machine Learning ICML01, 2001, pp. 449-456.
28. J. Schumacher, and R. Bergmann An effective approach for similarity-based retrieval on top of relational databases 5th European Workshop on Case-Based Reasoning 2000 Springer 273 284
29. B. Sierra, and E. Lazkano Probabilistic-weighted K nearest neighbor algorithm: a new approach for gene expression based classification KES02 Proceedings 2002 IOS press 932 939
30. C. Stanfill, and D. Waltz Toward memory-based reasoning Communications of the ACM 29 12 1986 1213 1228
31. M.A. Tahir, A. Bouridane, and F. Kurugollu Simultaneous feature selection and feature weighting using hybrid tabu search/K-nearest neighbor classifier Pattern Recognition Letters archive 28 2007 438 446 (Pubitemid 44918133)
32. S. Tan Neighbor-weighted K-nearest neighbor for unbalanced text corpus Expert Systems with Applications 28 2005 667 671 (Pubitemid 40583844)
33. Q. Wang, S.R. Kulkarni, and S. Verdu Divergence estimation for multidimensional densities via K-nearest-neighbor distances IEEE Transactions on Information Theory 55 2009 2392 2405
34. K.Q. Weinberger, and L.K. Saul Distance metric learning for large margin nearest neighbor classification The Journal of Machine Learning Research 10 2009 207 244
35. D. Wettschereck, A Study of Distance-Based Machine Learning Algorithms, Ph.D. Thesis, Oregon State University, 1994.
36. Z. Younes, F. Abdallah, T. Denux, Multi-label classification algorithm derived from K-nearest neighbor rule with label dependencies, in: 16th European Signal Processing Conference, 2008 ().