Nearest neighbor voting in high dimensional data: Learning from past occurrences

Computer Science and Information Systems

Volumn 9, Issue 2, 2012, Pages 691-712

  Tomašev, Nenad ^a   Mladenić, Dunja ^a  

^a JO EF STEFAN INSTITUTE   (Slovenia)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84865237950     PISSN: 18200214     EISSN: None     Source Type: Journal    
DOI: 10.2298/CSIS111211014T     Document Type: Article

References (32)

1. I. H. Witten and E. Frank, Data Mining: Practical Machine Learning Tools and Techniques, 2nd ed. Morgan Kaufmann Publishers, 2005.
2. E. Fix and J. Hodges. "Discriminatory analysis, nonparametric discrimination: consistency properties," USAF School of Aviation Medicine, Randolph Field, Texas, Tech. Rep., 1951.
3. T. M. Cover and P. E. Hart. "Nearest neighbor pattern classification," IEEE Transactions on Information Theory, vol. IT-13, no. 1, pp. 21-27, 1967.
4. L. Devroye. "On the inequality of cover and hart," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 3, pp. 75-78, 1981.
5. C. J. Stone. "Consistent nonparametric regression," Annals of Statistics, vol. 5, pp. 595-645, 1977.
6. A. K. L. Devroye, L. Gyorfi and G. Lugosi. "On the strong universal consistency of nearest neighbor regression function estimates," Annals of Statistics, vol. 22, pp. 1371-1385, 1994.
7. D. François, V. Wertz, and M. Verleysen. "The concentration of fractional distances," IEEE Transactions on Knowledge and Data Engineering, vol. 19, no. 7, pp. 873-886, 2007.
8. C. C. Aggarwal, A. Hinneburg, and D. A. Keim. "On the surprising behavior of distance metrics in high dimensional spaces," in Proc. 8th Int. Conf. on Database Theory (ICDT), 2001, pp. 420-434.
9. M. Radovanović, A. Nanopoulos, and M. Ivanović. "Nearest neighbors in highdimensional data: The emergence and influence of hubs," in Proc. 26th Int. Conf. on Machine Learning (ICML), 2009, pp. 865-872.
10. N. Tomašev, M. Radovanović, D. Mladenić, and M. Ivanović. "The role of hubness in clustering high-dimensional data." in PAKDD (1)'11, 2011, pp. 183-195.
11. E. -H. Han, G. Karypis, and V. Kumar. "Text categorization using weight adjusted k-nearest neighbor classification," in Advances in Knowledge Discovery and Data Mining, ser. Lecture Notes in Computer Science, D. Cheung, G. Williams, and Q. Li, Eds. Springer Berlin / Heidelberg, 2001, vol. 2035, pp. 53-65.
12. J. Wang, P. Neskovic, and L. N. Cooper. "Improving nearest neighbor rule with a simple adaptive distance measure," Pattern Recogn. Lett., vol. 28, pp. 207-213, January 2007.
13. Y. Song, J. Huang, D. Zhou, H. Zha, and C. L. Giles. "Iknn: Informative k-nearest neighbor pattern classification," in Proceedings of the 11th European conference on Principles and Practice of Knowledge Discovery in Databases, ser. PKDD 2007. Berlin, Heidelberg: Springer-Verlag, 2007, pp. 248-264.
14. J. E. Keller, M. R. Gray, and J. A. Givens. "A fuzzy k-nearest-neighbor algorithm," in IEEE Transactions on Systems, Man and Cybernetics, 1985, pp. 580-585.
15. R. Jensen and C. Cornelis. "A new approach to fuzzy-rough nearest neighbour classification," in Rough Sets and Current Trends in Computing, ser. Lecture Notes in Computer Science, C. -C. Chan, J. Grzymala-Busse, and W. Ziarko, Eds. Springer Berlin / Heidelberg, 2008, vol. 5306, pp. 310-319.
16. W. Shang, H. Huang, H. Zhu, Y. Lin, Y. Qu, and H. Dong. "An adaptive fuzzy knn text classifier," in Computational Science - ICCS 2006, ser. Lecture Notes in Computer Science, V. Alexandrov, G. van Albada, P. Sloot, and J. Dongarra, Eds. Springer Berlin / Heidelberg, 2006, vol. 3993, pp. 216-223.
17. L. Wang, L. Khan, and B. Thuraisingham. "An effective evidence theory based k-nearest neighbor (knn) classification," in Proceedings of the 2008 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology - Volume 01. Washington, DC, USA: IEEE Computer Society, 2008, pp. 797-801. [Online]. Available: http://portal. acm. org/citation. cfm?id=1486927.1487026
18. K. Q. Weinberger, J. Blitzer, and L. K. Saul. "Distance metric learning for large margin nearest neighbor classification," in In NIPS. MIT Press, 2006.
19. M. R. Min, D. A. Stanley, Z. Yuan, A. J. Bonner, and Z. Zhang. "A deep non-linear feature mapping for large-margin knn classification," in ICDM, 2009, pp. 357-366.
20. J. Aucouturier and F. Pachet. "Improving timbre similarity: How high is the sky?" Journal of Negative Results in Speech and Audio Sciences, vol. 1, 2004.
21. J. Aucouturier. "Ten experiments on the modelling of polyphonic timbre," Docteral dissertation, University of Paris 6, Tech. Rep., 2006.
22. M. Radovanović, A. Nanopoulos, and M. Ivanović. "Hubs in space: Popular nearest neighbors in high-dimensional data," Journal of Machine Learning Research, vol. 11, pp. 2487-2531, 2011.
23. M. Radovanović, A. Nanopoulos, and M. Ivanović. "On the existence of obstinate results in vector space models," in Proc. 33rd Annual Int. ACM SIGIR Conf. on Research and Development in Information Retrieval, 2010, pp. 186-193.
24. K. Buza, A. Nanopoulos, and L. Schmidt-Thieme. "Insight: efficient and effective instance selection for time-series classification," in Proceedings of the 15th Pacific- Asia conference on Advances in knowledge discovery and data mining - Volume Part II, ser. PAKDD'11. Springer-Verlag, 2011, pp. 149-160.
25. N. Tomašev and D. Mladenić. "Exploring the hubness-related properties of oceanographic sensor data," in Proceedings of the SiKDD conference, 2011.
26. N. Tomašev, M. Radovanović, D. Mladenić, and M. Ivanović. "Hubness-based fuzzy measures for high dimensional k-nearest neighbor classification," in Machine Learning and Data Mining in Pattern Recognition, MLDM conference, 2011.
27. N. Tomašev, M. Radovanović, D. Mladenić, and M. Ivanović. "A probabilistic approach to nearest neighbor classification: Naive hubness bayesian k-nearest neighbor," in Proceeding of the CIKM conference, 2011.
28. N. Tomašev, R. Brehar, D. Mladenić, and S. Nedevschi. "The influence of hubness on nearest-neighbor methods in object recognition," in IEEE Conference on Intelligent Computer Communication and Processing, 2011.
29. D. J. C. MacKay, Information Theory, Inference and Learning Algorithms. New York, NY, USA: Cambridge University Press, 2002.
30. J. Chen, H. ren Fang, and Y. Saad. "Fast approximate kNN graph construction for high dimensional data via recursive Lanczos bisection," Journal of Machine Learning Research, vol. 10, pp. 1989-2012, 2009.
31. D. R. Hardoon, S. Szedmaák, and J. Shawe-Taylor. "Canonical correlation analysis: An overview with application to learning methods," Neural Computation, vol. 16, no. 12, pp. 2639-2664, 2004.
32. H. Hotelling. "The most predictable criterion," Journal of Educational Psychology, vol. 26, pp. 139-142, 1935.