A method of learning weighted similarity function to improve the performance of nearest neighbor

Information Sciences

Volumn 179, Issue 17, 2009, Pages 2964-2973

  Jahromi, Mansoor Zolghadri ^a   Parvinnia, Elham ^b   John, Robert ^a  

^a DE MONTFORT UNIVERSITY   (United Kingdom)

^b SHIRAZ UNIVERSITY   (Iran)

Author keywords

Adaptive distance measure; Nearest neighbor; Prototype reduction; Weighted metrics

Indexed keywords

ADAPTIVE DISTANCE MEASURE; CLASSIFICATION RATES; DISTANCE FUNCTIONS; EXECUTION SPEED; LARGE DATASETS; LEAVE-ONE-OUT; METHOD OF LEARNING; NEAREST NEIGHBOR; NEAREST NEIGHBOR CLASSIFIER; NEAREST NEIGHBORS; PROTOTYPE REDUCTION; QUERY PATTERNS; REDUCTION TECHNIQUES; SIMILARITY FUNCTIONS; SIMILARITY MEASURE; STORAGE REQUIREMENTS; TEST INSTANCES; TRAINING SETS; WEIGHTED METRICS;

CLASSIFIERS; EDUCATION; LEARNING ALGORITHMS; LEARNING SYSTEMS;

SET THEORY;

EID: 67549091208     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2009.04.012     Document Type: Article

References (21)

1. Chen G., Wang C.Z., and Hu Q.H. A new approach to attribute reduction of consistent and inconsistent covering decision systems with covering rough sets. Information Sciences 177 (2007) 3500-3518
2. Conover W.J. Practical Nonparametric Statistics (1971), John Wiley pp. 206-209, 383
3. DeGroot M.H. Probabolity and Statistics. second ed. (1986), Addision Wesley
4. Domeniconi C., Peng J., and Gunopulos D. Locally adaptive metric nearest neighbor classification. IEEE Transaction on Pattern Analysis and Machine Intelligence 24 (2002) 1281-1285
5. Eick C.F., Rouhana A., Bagherjeiran A., and Vilalta R. Using clustering to learn distance functions for supervised similarity assessment. Engineering Applications of Artificial Intelligence 19 4 (2006) 395-401
6. J. Friedman, Flexible Metric Nearest-neighbor Classification, Technical Report 113, Department of Statistices, Stanford University, 1994.
7. Hastie T., and Tibshirani R. Discriminant adaptive nearest neighbor classification. IEEE Transaction on Pattern Analysis and Machine Intelligence 18 6 (1996) 607-615
8. Hu Q., Yu D., Liu J., and Wu C. Neighborhood rough set based heterogeneous feature subset selection. Information Sciences 178 (2008) 3577-3594
9. N. Jankowski, M. Grochowski, Comparison of instances selection algorithm I: algorithms survey, in: L. Rutkowski et al. (Eds.), ICAISC, Springer-Verlag, LNAI 3070, 2004, pp. 598-603.
10. Morring B.D., and Martinez T.R. Weighted instance typicality search (WITS): a nearest neighbor data reduction algorithm. Intelligent Data Analysis 7 6 (2003)
11. Paredes R., and Vidal E. Learning prototypes and distances: a prototype reduction technique based on nearest neighbor error minimization. Pattern Recognition 39 (2006) 180-188
12. Paredes R., and Vidal E. Learning weighted metrics to minimize nearest-neighbor classification error. IEEE Transaction on Pattern Analysis and Machine Intelligence 28 7 (2006) 1100-1110
13. Rozsypal A., and Kubat M. Selecting representative examples and attributes by a genetic algorithm. Intelligent Data Analysis 7 4 (2003)
14. Uncu O., and Türkşen I.B. A novel feature selection approach: combining feature wrappers and filters. Information Sciences 177 (2007) 449-466
15. Wang J., Neskovic P., and Cooper L.N. Improving nearest neighbor rule with a simple adaptive distance measure. Pattern Recognition Letters 28 (2007) 207-213
16. Wang J., Neskovic P., and Cooper L.N. Neighborhood selection in the k-nearest neighbor rule using statistical confidence. Pattern Recognition 39 (2006) 417-423
17. Wilson D.R., and Martinez T.R. An integrated instance-based learning algorithm. Computer Intelligence 16 1 (2000) 1-28
18. Wilson D.R., and Martinez T.R. Reduction techniques for exemplar-based learning algorithms. Machine Learning 38 3 (2000) 257-286
19. N. Zeidat, C.F. Eick, Z. Zhao, Supervised Clustering: Algorithms and Applications, Technical Report UH-CS-06-10, Department of Computer Science, University of Houston, USA, 2006.
20. Zolghadri M.J., and Mansoori E.G. Weighting fuzzy classification rules using receiver operating characteristics (ROC) analysis. Information Sciences 177 11 (2007) 2296-2307
21. Jahromi M.Z., and Taheri M. A proposed method for learning rule weights in fuzzy rule based classification systems. Fuzzy Sets and Systems 159 4 (2008) 449-459