GPU-SME-kNN: Scalable and memory efficient kNN and lazy learning using GPUs

Information Sciences

Volumn 373, Issue , 2016, Pages 165-182

  Gutiérrez, Pablo D ^a   Lastra, Miguel ^a   Bacardit, Jaume ^b   Benítez, José M ^a   Herrera, Francisco ^a  

^a UNIVERSITY OF GRANADA   (Spain)

^b NEWCASTLE UNIVERSITY   (United Kingdom)

Author keywords

CUDA; GPU; kNN

Indexed keywords

COMPUTER GRAPHICS; DATA MINING; NEAREST NEIGHBOR SEARCH; PATTERN RECOGNITION; PROGRAM PROCESSORS;

COMPUTATIONAL EFFORT; COMPUTATIONAL REQUIREMENTS; CUDA; GRAPHICS PROCESSING UNIT; IDENTIFICATION ERRORS; K NEAREST NEIGHBOR (KNN); POOR PERFORMANCE; RUN-TIME PERFORMANCE;

LEARNING ALGORITHMS;

EID: 84986001335     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2016.08.089     Document Type: Article

References (35)

1. [1] CUDA, http://www.nvidia.com/object/cuda_home_new.html.
2. [2] NVIDIA, http://www.nvidia.com/.
3. [3] Aha, D.W., Lazy Learning. 1997, Springer.
4. [4] Alcalá-Fdez, J., Sánchez, L., García, S., del Jesus, M., Ventura, S., Garrell, J., Otero, J., Romero, C., Bacardit, J., Rivas, V., Fernández, J., Herrera, F., KEEL: a software tool to assess evolutionary algorithms for data mining problems. Soft Comput. 13:3 (2009), 307–318.
5. [5] Arefin, A.S., Riveros, C., Berretta, R., Moscato, P., GPU-FS-k NN: a software tool for fast and scalable kNN computation using GPUs. PLoS ONE, 7(8), 2012, e44000, 10.1371/2Fjournal.pone.0044000.
6. [6] K. Bache, M. Lichman, UCI machine learning repository, 2013, URL http://archive.ics.uci.edu/ml.
7. [7] Beliakov, G., Li, G., Improving the speed and stability of the k-nearest neighbors method. Pattern Recognit. Lett. 33:10 (2012), 1296–1301.
8. [8] Cano, A., Luna, J., Ventura, S., High performance evaluation of evolutionary-mined association rules on gpus. J. Supercomput. 66:3 (2013), 1438–1461.
9. [9] Cano, A., Zafra, A., Ventura, S., Speeding up the evaluation phase of gp classification algorithms on gpus. Soft Comput. 16:2 (2012), 187–202.
10. [10] Catanzaro, B., Sundaram, N., Keutzer, K., Fast support vector machine training and classification on graphics processors. Proceedings of the 25th International Conference on Machine Learning, ICLM ’08, 2008, 104–111.
11. [11] Cover, T., Hart, P., Nearest neighbor pattern classification. Inf. Theory IEEE Trans. 13:1 (1967), 21–27.
12. [12] Dhurandhar, A., Dobra, A., Probabilistic characterization of nearest neighbor classifier. Int. J. Mach. Learn. Cybern. 4:4 (2013), 259–272.
13. [13] Duda, R.O., Hart, P.E., Stork, D.G., Pattern Classification. second ed., 2000, Wiley-Interscience.
14. [14] Gao, Q.-B., Wang, Z.-Z., Center-based nearest neighbor classifier. Pattern Recognit. 40:1 (2007), 346–349.
15. [15] Garcia, E., Feldman, S., Gupta, M., Srivastava, S., Completely lazy learning. Knowl. Data Eng. IEEE Transa. 22:9 (2010), 1274–1285.
16. [16] Garcia, V., Debreuve, E., Nielsen, F., Barlaud, M., K-nearest neighbor search: Fast GPU-based implementations and application to high-dimensional feature matching. Proceedings - International Conference on Image Processing, ICIP, 2010, 3757–3760.
17. [17] Hoare, C.A.R., Algorithm 64: Quicksort. Commun. ACM, 4(7), 1961, 321.
18. [18] Huang, L., Li, Z., A novel method of parallel gpu implementation of knn used in text classification. Networking and Distributed Computing (ICNDC), 2013 Fourth International Conference on, 2013, 6–8.
19. [19] Jian, L., Wang, C., Liu, Y., Liang, S., Yi, W., Shi, Y., Parallel data mining techniques on graphics processing unit with compute unified device architecture (CUDA). J. Supercomput. 64:3 (2013), 942–967.
20. [20] Kato, K., Hosino, T., Multi-GPU algorithm for k-nearest neighbor problem. Concurrency Comput. 24:1 (2012), 45–53.
21. [21] Komarov, I., Dashti, A., D'Souza, R.M., Fast k-NNG construction with GPU-based quick multi-select. PLoS ONE, 9(5), 2014, e92409, 10.1371/2Fjournal.pone.0092409.
22. [22] Kuang, Q., Zhao, L., A practical GPU based KNN algorithm. In Proceedings of the Second Symposium on International Computer Science and Computational Technology (ISCSCT 09), 2009.
23. [23] Lastra, M., Carabaño, J., Gutiérrez, P.D., Benítez, J.M., Herrera, F., Fast fingerprint identification using GPUs. Inf. Sci. 301:0 (2015), 195–214.
24. TM architecture. Inf. Sci. 181:20 (2011), 4642–4657 Special Issue on Interpretable Fuzzy Systems.
25. [25] Nock, R., Sebban, M., Bernard, D., A simple locally adaptive nearest neighbor rule with application to pollution forecasting. Int. J. Pattern Recognit. Artif. Intell. 17:8 (2003), 1369–1382.
26. [26] Prasad, J.R., Kulkarni, U., Gujrati character recognition using weighted k-nn and mean χ 2 distance measure. Int. J. Mach. Learn. Cybern. 6:1 (2015), 69–82.
27. [27] Pu, Y., Peng, J., Huang, L., Chen, J., An efficient knn algorithm implemented on fpga based heterogeneous computing system using opencl. Field-Programmable Custom Computing Machines (FCCM), 2015 IEEE 23rd Annual International Symposium on, 2015, 167–170.
28. [28] Rajaraman, A., Ullman, J., Mining of Massive Datasets. 2011, Cambridge University Press.
29. [29] Schatz, M., Trapnell, C., Delcher, A., Varshney, A., High-throughput sequence alignment using graphics processing units. BMC Bioinformatics 8:1 (2007), 1–10.
30. [30] Shakhnarovich, G., Darrell, T., Indyk, P., Nearest-Neighbor Methods in Learning and Vision: Theory and Practice (Neural Information Processing). 2006, MIT Press.
31. [31] Stamoulias, I., Manolakos, E., Parallel architectures for the k NN classifier - design of soft IP cores and FPGA implementations. Trans. Embedded Comput. Syst., 13(2), 2013, Article number: 22.
32. [32] Tomašev, N., Radovanović, M., Mladenić, D., Ivanović, M., Hubness-based fuzzy measures for high-dimensional k-nearest neighbor classification. Int. J. Mach. Learn. Cybern. 5:3 (2014), 445–458.
33. [33] Wang, J., Neskovic, P., Cooper, L., Improving nearest neighbor rule with a simple adaptive distance measure. Pattern Recognit. Lett. 28:2 (2007), 207–213.
34. [34] Wilson, D., Martinez, T., Improved heterogeneous distance functions. J. Artif. Intell. Res. 6 (1997), 1–34.
35. [35] Wu, X., Kumar, V., The Top Ten Algorithms in Data Mining. 2010, CRC Press.