GPU-FS-kNN: A Software Tool for Fast and Scalable kNN Computation Using GPUs

PLoS ONE

Volumn 7, Issue 8, 2012, Pages

  Arefin, Ahmed Shamsul ^a   Riveros, Carlos ^a,b   Berretta, Regina ^a,b   Moscato, Pablo ^a,b,c  

^a UNIVERSITY OF NEWCASTLE   (Australia)

^b JOHN HUNTER HOSPITAL   (Australia)

^c Australian Government Australian Research Council   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; ARTICLE; BIOINFORMATICS; BREAST; COMPUTER PROGRAM; DATA PROCESSING; ELECTRICAL EQUIPMENT; GENE EXPRESSION; GRAPHICS PROCESSING UNIT BASED FAST AND SCALABLE K NEAREST NEIGHBOR; K NEAREST NEIGHBOR; KERNEL METHOD; MACHINE LEARNING; MATHEMATICAL COMPUTING; MICROARRAY ANALYSIS; PATTERN RECOGNITION; SYSTEMS BIOLOGY;

ALGORITHMS; CLUSTER ANALYSIS; COMPUTATIONAL BIOLOGY; PROGRAMMING LANGUAGES; SOFTWARE;

EID: 84865485151     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0044000     Document Type: Article

References (50)

1. Samet H (2005) Foundations of Multidimensional and Metric Data Structures (The Morgan Kaufmann Series in Computer Graphics and Geometric Modeling). San Francisco, CA, USA: Morgan Kaufmann Publishers Inc.
2. Knuth DE (1973) The Art of Computer Programming, Volume III: Sorting and Searching. Addison-Wesley.
3. Bentley JL, (1975) Multidimensional binary search trees used for associative searching. Commun ACM 18: 509-517.
4. Arya S, Mount DM, Netanyahu NS, Silverman R, Wu AY, (1998) An optimal algorithm for approximate nearest neighbor searching fixed dimensions. J ACM 45: 891-923.
5. Brito M, Chvez E, Quiroz A, Yukich J, (1997) Connectivity of the mutual k-nearest-neighbor graph in clustering and outlier detection. Statistics & Probability Letters 35: 33-42.
6. Dasarathy BV (2002) Handbook of data mining and knowledge discovery. New York, NY, USA: Oxford University Press, Inc., chapter Data mining tasks and methods: Classification: nearest-neighbor approaches. 288-298.
7. Belkin M, Niyogi P, (2003) Laplacian Eigenmaps for dimensionality reduction and data representation. Neural Computation 15: 1373-1396.
8. Roweis ST, Saul LK, (2000) Nonlinear dimensionality reduction by locally linear embedding. SCIENCE 290: 2323-2326.
9. Choset H, Lynch K, Hutchinson S, Kantor G, Burgard W, et al. (2005) Principles of Robot Motion: Theory, Algorithms and Implementation. MIT Press.
10. Sankaranarayanan J, Samet H, Varshney A, (2007) A fast all nearest neighbor algorithm for applications involving large point-clouds. Comput Graph 31: 157-174.
11. Jung HY, Cho HG (2002) An automatic block and spot indexing with k-nearest neighbors graph for microarray image analysis. In: Proc. of the European Conference on Computational Biology (ECCB), Supplement of Bioinformatics. 141-151.
12. Bayá AE, Granitto PM (2010) Penalized k-nearest-neighbor-graph based metrics for clustering. CoRR abs/1006.2734.
13. Maier M, Hein M, Luxburg UV (2007) Cluster identification in nearest-neighbor graphs. Technical report, Max Planck Institute for Biological Cybernetics, Tubingen, Germany.
14. Huttenhower C, Flamholz AI, Landis JN, Sahi S, Myers CL, et al. (2007) Nearest neighbor networks: clustering expression data based on gene neighborhoods. BMC Bioinformatics 8: 250.
15. Arefin AS, Inostroza-Ponta M, Mathieson L, Berretta R, Moscato P (2011) Clustering nodes in large-scale biological networks using external memory algorithms. In: Xiang Y, Cuzzocrea A, Hobbs M, Zhou W, editors, ICA3PP (2). Springer, volume 7017 of Lecture Notes in Computer Science, 375-386.
16. Inostroza-Ponta M (2008) An Integrated and Scalable Approach Based on Combinatorial Optimization Techniques for the Analysis of Microarray Data. Ph.D. thesis, School of Electrical Engineering and Computer Science, The University of Newcastle, Australia.
17. Garcia V, Debreuve E, Barlaud M, (2008) Fast k nearest neighbor search using GPU. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW' 08): 1-6.
18. Liang S, Wang C, Liu Y, Jian L, (2009) CUKNN: A parallel implementation of k-nearest neighbor on cuda-enabled gpu. In: IEEE Youth Conference on Information, Computing and Telecommunication (YC-ICT' 09): 415-418.
19. NVIDIA Corporation (2007) NVIDIA CUDA Compute Unified Device Architecture Programming Guide. NVIDIA Corporation.
20. Graham N (2009) Improving the k-nearest neighbour algorithm with CUDA. Technical report, School of CSSE, The University of Western Australia.
21. Quansheng K, Lei Z (2009) A practical GPU based kNN algorithm. In: Proc. of the Second Symposium International Computer Science and Computational Technology(ISCSCT'09). Academy Publisher, 151-155.
22. Satish N, Harris M, (2009) GarlandM (2009) Designing e_cient sorting algorithms for manycore GPUs. In: Proc. of the 2009 IEEE International Symposium on Parallel&Distributed Processing. Washington, DC, USA: IEEE Computer Society, IPDPS ' 09: 1-10.
23. Chang D, Jones NA, Li D, Ouyang M, Ragade RK (2008) Compute pairwise Euclidean distances of data points with GPUs. In: Proc. of the IASTED International Symposium on Computational Biology and Bioinformatics. IASTED, 278-283.
24. Chang D, Desoky AH, Ouyang M, Rouchka EC (2009) Compute pairwise Euclidean distances of data points with GPUs. In: Proc. of the 10th ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing. ACIS, 501-506.
25. Sun L, Stoller C, Newhall T (2010). Hybrid MPI and GPU approach to e_ciently solving large kNN problems. Tera Grid Poster. URL http://www.isgtw.org/pdfs/kNNposter.pdf. Accessed 2012 Aug 4.
26. Connor M, Kumar P, (2010) Fast construction of k-nearest neighbor graphs for point clouds. IEEE Trans Vis Comput Graph 16: 599-608.
27. Plaku E, Kavraki LE, (2007) Distributed computation of the kNN graph for large high-dimensional point sets. J Parallel Distrib Comput 67: 346-359.
28. van de Vijver MJ, He YD, van't Veer LJ, Dai H, Hart AA, et al. (2002) A gene-expression signature as a predictor of survival in breast cancer. The New England Journal of Medicine 347: 1999-2009.
29. Van T Veer LJ, Dai H, Van De Vijver MJ, He YD, Hart AAM, et al. (2002) Gene expression profiling predicts clinical outcome of breast cancer. Nature 415: 530-6.
30. Fayyad UM, Irani KB, (1993) Multi-Interval Discretization of Continuous-Valued Attributes for Classification Learning, Morgan Kaufmann, volume. 2: 1022-1027.
31. Cotta C, Sloper C, Moscato P (2004) Evolutionary search of thresholds for robust feature set selection: Application to the analysis of microarray data. In: Raidl GR, Cagnoni S, Branke J, Corne D, Drechsler R, et al., editors, EvoWorkshops. Springer, volume 3005 of Lecture Notes in Computer Science, 21-30.
32. Cotta C, Langston M, Moscato P (2007) Combinatorial and algorithmic issues for microarray analysis. In: González T, editor, Handbook of Approximation Algorithms and Metaheuristics. Chapman & Hall/CRC Press.
33. Berretta R, Mendes A, Moscato P, (2007) Selection of discriminative genes in microarray experiments using mathematical programming. Journal of Research and Practice in Information Technology 39: 4.
34. Berretta R, Costa W, Moscato P, (2008) Combinatorial optimization models for finding genetic signatures from gene expression datasets. Methods Mol Biol 453: 363-77.
35. Ravetti MG, Berretta R, Moscato P (2009) Novel biomarkers for prostate cancer revealed by (α,β)-k-feature sets. In: Abraham A, Hassanien AE, Snásel V, editors, Foundations of Computational Intelligence (5), Springer, volume 205 of Studies in Computational Intelligence. 149-175.
36. Rocha de Paula M, Ravetti MG, Berretta R, Moscato P, (2011) Differences in abundances of cell-signalling proteins in blood reveal novel biomarkers for early detection of clinical alzheimers disease. PLoS ONE 6: e17481.
37. Boulay PL, Schlienger S, Lewis-Saravalli S, Vitale N, Ferbeyre G, et al. (2011) ARF1 controls proliferation of breast cancer cells by regulating the retinoblastoma protein. Oncogene 30: 1038-61.
38. Clarke R, Liu MC, Bouker KB, Gu Z, Lee RY, et al. (2003) Antiestrogen resistance in breast cancer and the role of estrogen receptor signaling. Oncogene 22: 7316-7339.
39. Pinnix Z, Miller L, Wang W, D'Agostino Jr R, Kute T, et al. (2010) Ferroportin and iron regulation in breast cancer progression and prognosis. Sci Transl Med 2: 43ra56.
40. Pogribny IP (2010) Ferroportin and hepcidin: a new hope in diagnosis, prognosis, and therapy for breast cancer. Breast Cancer Research 12: [Epub ahead of print].
41. Miller L, Coffman L, Chou J, Black M, Bergh J, et al. (2011) An iron regulatory gene signature predicts outcome in breast cancer. Cancer Res 6728-6737: 625-639.
42. Kell DB, (2010) Towards a unifying, systems biology understanding of large-scale cellular death and destruction caused by poorly liganded iron: Parkinsons, huntingtons, alzheimers, prions, bactericides, chemical toxicology and others as examples. Archives of Toxicology 84: 825-889.
43. Chandra R, Dagum L, Kohr D, Maydan D, McDonald J, et al. (2001) Parallel programming in OpenMP. San Francisco, CA, USA: Morgan Kaufmann Publishers Inc.
44. Bell N, Garland M, (2009) Implementing sparse matrix-vector multiplication on throughput-oriented processors. In: Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis. New York, NY, USA: ACM, SC '09, 18 1-18: 11.
45. Siek J, Lee LQ, Lumsdaine A (2000). Boost random number library. Software library. URL http://www.boost.org/users/download/. Accessed 2012 Aug 4.
46. Arefin AS, Riveros C, Berretta R, Moscato P (2012) knn-borvka-gpu: A fast and scalable mst construction from knn graphs on gpu. In: Murgante B, Gervasi O, Misra S, Nedjah N, Rocha AMAC, et al., editors, ICCSA (1). Springer, volume 7333 of Lecture Notes in Computer Science, 71-86.
47. Li Q, Kecman V, Salman R, (2010) A chunking method for euclidean distance matrix calculation on large dataset using multi-gpu. In: Proceedings of the 2010 Ninth International Conference on Machine Learning and Applications. Washington, DC, USA: IEEE Computer Society, ICMLA' 10: 208-213.
48. Pike R, Dorward S, Griesemer R, Quinlan S, (2005) Interpreting the data: Parallel analysis with Sawzall. Sci Program 13: 277-298.
49. Dementiev R, Kettner L, Sanders P, (2008) STXXL: standard template library for XXL data sets. Softw Pract Exper 38: 589-637.
50. Pavlopoulos GA, Wegener AL, Schneider R, (2008) A survey of visualization tools for biological network analysis. BioData Mining 1: 12.