Hubness-based fuzzy measures for high-dimensional k-nearest neighbor classification

International Journal of Machine Learning and Cybernetics

Volumn 5, Issue 3, 2014, Pages 445-458

  Tomašev, Nenad ^a   Radovanović, Miloš ^b   Mladenić, Dunja ^a   Ivanović, Mirjana ^b  

^a JO EF STEFAN INSTITUTE   (Slovenia)

^b UNIVERSITY OF NOVI SAD   (Serbia)

Author keywords

Classification; Curse of dimensionality; Fuzzy; Hubs; k nearest neighbor

Indexed keywords

CLASSIFICATION (OF INFORMATION); LEARNING ALGORITHMS; LEARNING SYSTEMS;

CURSE OF DIMENSIONALITY; EXPERIMENTAL EVALUATION; FUZZY; HUBS; K-NEAREST NEIGHBOR CLASSIFICATION; K-NEAREST NEIGHBOR CLASSIFIER; K-NEAREST NEIGHBOR GRAPHS; K-NEAREST NEIGHBORS;

FUZZY SYSTEMS;

EID: 84901303482     PISSN: 18688071     EISSN: 1868808X     Source Type: Journal    
DOI: 10.1007/s13042-012-0137-1     Document Type: Article

References (34)

1. Aggarwal CC, Hinneburg A, Keim DA (2001) On the surprising behavior of distance metrics in high dimensional spaces. In: Proceedings of the 8th international conference on database theory (ICDT), Lecture notes in computer science, vol 1973. Springer, pp 420-434.
2. Aucouturier JJ (2006) Ten experiments on the modelling of polyphonic timbre. Ph. D. thesis, University of Paris 6.
3. Aucouturier JJ, Pachet F (2004) Improving timbre similarity: how high is the sky? J Negat Results Speech Audio Sci 1. http://jjtok. io/papers/JNRSAS-2004. pdf.
4. Babu VS, Viswanath P (2009) Rough-fuzzy weighted k-nearest leader classifier for large data sets. Pattern Recogn Lett 42(9): 1719-1731.
5. Buza K, Nanopoulos A, Schmidt-Thieme L (2011) INSIGHT: Efficient and effective instance selection for time-series classification. In: Proceedings of the 15th pacific-asia conference on knowledge discovery and data mining (PAKDD), Part II, Lecture Notes in Artificial Intelligence, vol 6635. Springer, pp 149-160.
6. Cabello D, Barro S, Salceda JM, Ruiz R, Mira J (1991) Fuzzy k-nearest neighbor classifiers for ventricular arrhythmia detection. Int J Biomed Comput 27(2): 77-93.
7. Chen J, Fang H, Saad Y (2009) Fast approximate k NN graph construction for high dimensional data via recursive Lanczos bisection. J Mach Learn Res 10: 1989-2012.
8. Cintra ME, Camargo HA, Monard MC (2008) A study on techniques for the automatic generation of membership functions for pattern recognition. In: Congresso da Academia Trinacional de Ciências (C3N), vol 1, pp 1-10.
9. Durrant RJ, Kabán A (2009) When is 'nearest neighbour' meaningful: a converse theorem and implications. J Complex 25(4): 385-397.
10. François D, Wertz V, Verleysen M (2007) The concentration of fractional distances. IEEE Trans Knowl Data Eng 19(7): 873-886.
11. Houle ME, Kriegel HP, Kröger P, Schubert E, Zimek A (2010) Can shared-neighbor distances defeat the curse of dimensionality? In: Proceedings of the 22nd international conference on scientific and statistical database management (SSDBM), Lecture Notes in Computer Science, vol 6187. Springer, pp 482-500.
12. Huang WL, Chen HM, Hwang SF, Ho SY (2007) Accurate prediction of enzyme subfamily class using an adaptive fuzzy k-nearest neighbor method. Biosyst Eng 90(2): 405-413.
13. Keller JE, Gray MR, Givens JA (1985) A fuzzy k-nearest neighbor algorithm. IEEE Trans Syst Man Cybern 15(4): 580-585.
14. Nadeau C, Bengio Y (2003) Inference for the generalization error. Mach Learn 52(3): 239-281.
15. Pham T. D. (2005) An optimally weighted fuzzy k-NN algorithm. In: Proceedings of the 3rd international conference on advances in pattern recognition (ICAPR), Part I, Lecture Notes in Computer Science, vol 3686. Springer, pp 239-247.
16. Radovanović M, Nanopoulos A, Ivanović M (2009) Nearest neighbors in high-dimensional data: the emergence and influence of hubs. In: Proceedings of the 26th international conference on machine learning (ICML), pp 865-872.
17. Radovanović M, Nanopoulos A, Ivanović M (2010) Hubs in space: Popular nearest neighbors in high-dimensional data. J Mach Learn Res 11: 2487-2531.
18. Radovanović M., Nanopoulos A., Ivanović M. (2010) On the existence of obstinate results in vector space models. In: Proceedings of the 33rd annual international ACM SIGIR conference on research and development in information retrieval, pp 186-193.
19. Radovanović M, Nanopoulos A, Ivanović M (2010) Time-series classification in many intrinsic dimensions. In: Proceedings of the 10th SIAM international conference on data mining (SDM), pp 677-688.
20. Shen HB, Yang J, Chou KC (2006) Fuzzy KNN for predicting membrane protein types from pseudo-amino acid composition. J Theor Biol 240(1): 9-13.
21. Sim J, Kim SY, Lee J (2005) Prediction of protein solvent accessibility using fuzzy k-nearest neighbor method. Bioinform Biol Insights 21(12): 2844-2849.
22. Singpurwalla N, Booker JM (2004) Membership functions and probability measures of fuzzy sets. J Am Stat Assoc 99: 867-877.
23. Tomašev N, Brehar R, Mladenić D, Nedevschi S (2011) The influence of hubness on nearest-neighbor methods in object recognition. In: Proceedings of the 7th IEEE international conference on intelligent computer communication and processing (ICCP), pp 367-374.
24. Tomašev N, Mladenić D (2011) Exploring the hubness-related properties of oceanographic sensor data. In: Proceedings of the 14th international multiconference on information society (IS), A: 149-152.
25. Tomašev N, Mladenić D (2011) The influence of weighting the k-occurrences on hubness-aware classification methods. In: Proceedings of 14th international multiconference on information society.
26. Tomašev N, Mladenić D (2012) Nearest neighbor voting in high dimensional data: learning from past occurrences. Comput Sci Inf Syst 9(2): 691-712.
27. Tomašev N, Radovanović M, Mladenić D, Ivanović M (2011) Hubness-based fuzzy measures for high-dimensional k-nearest neighbor classification. In: Proceedings of the 7th international conference on machine learning and data mining (MLDM), Lecture Notes in Artificial Intelligence, vol 6871. Springer, pp 16-30.
28. Tomašev N, Radovanović M, Mladenić D, Ivanović M (2011) The role of hubness in clustering high-dimensional data. In: Proceedings of the 15th pacific-asia conference on knowledge discovery and data mining (PAKDD), Part I, Lecture Notes in Artificial Intelligence, vol 6634. Springer, pp 183-195.
29. Wang XZ, He YL, Dong LC, Zhao HY (2011) Particle swarm optimization for determining fuzzy measures from data. Inf Sci 181(19): 4230-4252.
30. Yu S, Backer SD, Scheunders P (2002) Genetic feature selection combined with composite fuzzy nearest neighbor classifiers for hyperspectral satellite imagery. Pattern Recogn Lett 23(1-3): 183-190.
31. Zadeh LA (1965) Fuzzy sets. Inf Control 8(3): 338-353.
32. Zhang Z, Zhang R (2009) Multimedia data mining. Chapman and Hall, London.
33. Zheng K, Fung PC, Zhou X (2010) K-nearest neighbor search for fuzzy objects. In: Proceedings of the 36th ACM SIGMOD international conference on management of data, pp 699-710.
34. Zuo W, Zhang D, Wang K (2008) On kernel difference-weighted k-nearest neighbor classification. Pattern Anal Appl 11: 247-257.