Nearest neighbor classification for high-speed big data streams using spark

IEEE Transactions on Systems, Man, and Cybernetics: Systems

Volumn 47, Issue 10, 2017, Pages 2727-2739

  Ramírez Gallego, Sergio ^a   Krawczyk, Bartosz ^b   García, Salvador ^a   Wózniak, Michal ^c   Benítez, José Manuel ^a   Herrera, Francisco ^a  

^a UNIVERSITY OF GRANADA   (Spain)

^b Virginia Commonwealth University   (United States)

^c WROCLAW UNIVERSITY OF TECHNOLOGY   (Poland)

Author keywords

Apache Spark; Big data; Data streams; Distributed computing; Instance reduction; Machine learning; Nearest neighbor

Indexed keywords

ARTIFICIAL INTELLIGENCE; COMPUTER HARDWARE DESCRIPTION LANGUAGES; COMPUTER SCIENCE; DATA COMMUNICATION SYSTEMS; DATA MINING; DISTRIBUTED COMPUTER SYSTEMS; ELECTRIC SPARKS; LEARNING ALGORITHMS; LEARNING SYSTEMS; METADATA; NEAREST NEIGHBOR SEARCH; PERSONNEL TRAINING;

COMPUTATIONAL REQUIREMENTS; DATA STREAM; INSTANCE SELECTION; MASSIVE DATA STREAMS; MEMORY MANAGEMENT; NEAREST NEIGHBOR ALGORITHM; NEAREST NEIGHBOR CLASSIFICATION; NEAREST NEIGHBORS;

BIG DATA;

EID: 85028953120     PISSN: 21682216     EISSN: 21682232     Source Type: Journal    
DOI: 10.1109/TSMC.2017.2700889     Document Type: Article

References (52)

1. V. Mayer-Schönberger and K. Cukier, Big Data: A Revolution That Will Transform How We Live, Work and Think. London, U.K.: John Murray, 2013.
2. J. Gama, Knowledge Discovery From Data Streams. Boca Raton, FL, USA: Chapman & Hall, 2010.
3. D. Han, C. G. Giraud-Carrier, and S. Li, "Efficient mining of high-speed uncertain data streams," Appl. Intell., vol. 43, no. 4, pp. 773-785, 2015.
4. X. Wu, X. Zhu, G.-Q. Wu, and W. Ding, "Data mining with big data," IEEE Trans. Knowl. Data Eng., vol. 26, no. 1, pp. 97-107, Jan. 2014.
5. U. Fayyad and R. Uthurusamy, "Evolving data into mining solutions for insights," Commun. ACM, vol. 45, no. 8, pp. 28-31, Aug. 2002.
6. [Online]. Available: Http://doi.acm.org/10.1145/545151.545174
7. A. Fernández et al., "Big data with cloud computing: An insight on the computing environment, mapreduce, and programming frameworks," Wiley Interdiscipl. Rev. Data Min. Knowl. Disc., vol. 4, no. 5, pp. 380-409, 2014.
8. J. Dean and S. Ghemawat, "Mapreduce: Simplified data processing on large clusters," in Proc. OSDI, San Francisco, CA, USA, 2004, pp. 137-150.
9. H. Karau, A. Konwinski, P. Wendell, and M. Zaharia, Learning Spark: Lightning-Fast Big Data Analytics. Sebastopol, CA, USA: O'Reilly Media, 2015.
10. Apache Spark: Lightning-Fast Cluster Computing. (2017). Apache Spark. [Online]. Accessed on Jan. 2017. [Online]. Available: Https://spark.apache.org/
11. D. Aha, Lazy Learning. Dordrecht, The Netherlands, Kluwer, 1997.
12. C. C. Aggarwal, Data Mining: The Textbook. Cham, Switzerland: Springer, 2015.
13. S. García, J. Luengo, and F. Herrera, Data Preprocessing in Data Mining. Cham, Switzerland: Springer, 2014.
14. H. Samet, Foundations of Multidimensional and Metric Data Structures (The Morgan Kaufmann Series in Computer Graphics and Geometric Modeling). San Francisco, CA, USA: Morgan Kaufmann, 2005.
15. A. Gionis, P. Indyk, and R. Motwani, "Similarity search in high dimensions via hashing," in Proc. 25th Int. Conf. Very Large Data Bases (VLDB), Edinburgh, U.K., 1999, pp. 518-529.
16. T. White, Hadoop, the Definitive Guide. Sebastopol, CA, USA: O'Reilly Media, 2012.
17. Apache Hadoop Project. (2017). Apache Hadoop. [Online]. Accessed on Jan. 2017. [Online]. Available: Http://hadoop.apache.org/
18. W.-P. Ding, C.-T. Lin, M. Prasad, S.-B. Chen, and Z.-J. Guan, "Attribute equilibrium dominance reduction accelerator (DCCAEDR) based on distributed coevolutionary cloud and its application in medical records," IEEE Trans. Syst., Man, Cybern., Syst., vol. 46, no. 3, pp. 384-400, Mar. 2016.
19. Y. Xun, J. Zhang, and X. Qin, "FiDoop: Parallel mining of frequent itemsets using MapReduce," IEEE Trans. Syst., Man, Cybern., Syst., vol. 46, no. 3, pp. 313-325, Mar. 2016.
20. J. Lin, "Mapreduce is good enough? If all you have is a hammer, throw away everything that's not a nail!" Big Data, vol. 1, no. 1, pp. 28-37, 2012.
21. X. Meng et al., "Mllib: Machine learning in apache spark," J. Mach. Learn. Res., vol. 17, no. 1, pp. 1235-1241, 2016.
22. A. Spark. Machine Learning Library (MLlib) for Spark. Accessed on Jan. 2017. [Online]. Available: Http://spark.apache.org/docs/latest/mllib-guide.html
23. M. M. Gaber, "Advances in data stream mining," Wiley Interdiscipl. Rev. Data Min. Knowl. Disc., vol. 2, no. 1, pp. 79-85, 2012.
24. B. Krawczyk, L. L. Minku, J. Gama, J. Stefanowski, and M. Wózniak, "Ensemble learning for data stream analysis: A survey," Inf. Fusion, vol. 37, pp. 132-156, Sep. 2017.
25. A. Bifet, G. D. F. Morales, J. Read, G. Holmes, and B. Pfahringer, "Efficient online evaluation of big data stream classifiers," in Proc. 21th ACM SIGKDD Int. Conf. Knowl. Disc. Data Min., Sydney, NSW, Australia, 2015, pp. 59-68.
26. S. Ramírez-Gallego, B. Krawczyk, S. García, M. Wózniak, and F. Herrera, "A survey on data preprocessing for data stream mining: Current status and future directions," Neurocomputing, vol. 239, pp. 39-57, May 2017.
27. J. Gama, I. Žliobaite, A. Bifet, M. Pechenizkiy, and A. Bouchachia, "A survey on concept drift adaptation," ACM Comput. Surveys, vol. 46, no. 4, pp. 1-37, 2014.
28. C. Alippi, D. Liu, D. Zhao, and L. Bu, "Detecting and reacting to changes in sensing units: The active classifier case," IEEE Trans. Syst., Man, Cybern., Syst., vol. 44, no. 3, pp. 353-362, Mar. 2014.
29. Z. Pervaiz, A. Ghafoor, and W. G. Aref, "Precision-bounded access control using sliding-window query views for privacy-preserving data streams," IEEE Trans. Knowl. Data Eng., vol. 27, no. 7, pp. 1992-2004, Jul. 2015.
30. L. Du, Q. Song, and X. Jia, "Detecting concept drift: An information entropy based method using an adaptive sliding window," Intell. Data Anal., vol. 18, no. 3, pp. 337-364, 2014.
31. O. Mimran and A. Even, "Data stream mining with multiple sliding windows for continuous prediction," in Proc. 22nd Eur. Conf. Inf. Syst. (ECIS), Tel Aviv, Israel, 2014, pp. 1-15.
32. J. Read, A. Bifet, B. Pfahringer, and G. Holmes, "Batch-incremental versus instance-incremental learning in dynamic and evolving data," in Proc. 11th Int. Symp. Adv. Intell. Data Anal. (IDA), Helsinki, Finland, 2012, pp. 313-323.
33. P. M. Domingos and G. Hulten, "A general framework for mining massive data streams," J. Comput. Graph. Stat., vol. 12, no. 4, pp. 945-949, 2003.
34. M. Wózniak, "A hybrid decision tree training method using data streams," Knowl. Inf. Syst., vol. 29, no. 2, pp. 335-347, 2011.
35. H. He, S. Chen, K. Li, and X. Xu, "Incremental learning from stream data," IEEE Trans. Neural Netw., vol. 22, no. 12, pp. 1901-1914, Dec. 2011.
36. G. Hulten, L. Spencer, and P. M. Domingos, "Mining time-changing data streams," in Proc. 7th ACM SIGKDD Int. Conf. Knowl. Disc. Data Min., San Francisco, CA, USA, 2001, pp. 97-106.
37. P. Kosina and J. Gama, "Very fast decision rules for classification in data streams," Data Min. Knowl. Disc., vol. 29, no. 1, pp. 168-202, 2015.
38. L. I. Kuncheva and J. S. Sánchez, "Nearest neighbour classifiers for streaming data with delayed labelling," in Proc. 8th IEEE Int. Conf. Data Min. (ICDM), Pisa, Italy, 2008, pp. 869-874.
39. D. Yang, E. A. Rundensteiner, and M. O. Ward, "Mining neighbor-based patterns in data streams," Inf. Syst., vol. 38, no. 3, pp. 331-350, 2013.
40. T. M. Cover and P. E. Hart, "Nearest neighbor pattern classification," IEEE Trans. Inf. Theory, vol. 13, no. 1, pp. 21-27, Jan. 1967.
41. X. Wu and V. Kumar, Eds., The Top Ten Algorithms in Data Mining (Data Mining and Knowledge Discovery). Boca Raton, FL, USA: Chapman & Hall, 2009.
42. T. Liu, A. W. Moore, A. G. Gray, and K. Yang, "An investigation of practical approximate nearest neighbor algorithms," in Proc. Adv. Neural Inf. Process. Syst. (NIPS), Vancouver, BC, Canada, 2004, pp. 825-832.
43. T. Liu, C. Rosenberg, and H. A. Rowley, "Clustering billions of images with large scale nearest neighbor search," in Proc. IEEE Workshop Appl. Comput. Vis. (WACV), Austin, TX, USA, 2007, p. 28.
44. A. R. Mahmood et al., "Tornado: A distributed spatio-textual stream processing system," in Proc. 41st Int. Conf. Very Large Data Bases, vol. 8. pp. 2020-2023, 2015.
45. J. Maillo, S. Ramírez, I. Triguero, and F. Herrera, "kNN-IS: An iterative spark-based design of the k-nearest neighbors classifier for big data," Knowl. Based Syst., vol. 117, pp. 3-15, Feb. 2017.
46. J. S. Sánchez, F. Pla, and F. J. Ferri, "Prototype selection for the nearest neighbour rule through proximity graphs," Pattern Recognit. Lett., vol. 18, no. 6, pp. 507-513, 1997.
47. K. J. Supowit, "The relative neighborhood graph, with an application to minimum spanning trees," J. ACM, vol. 30, no. 3, pp. 428-448, 1983.
48. M. Du, S. Ding, and H. Jia, "Study on density peaks clustering based on k-nearest neighbors and principal component analysis," Knowl. Based Syst., vol. 99, pp. 135-145, May 2016.
49. H. Jia, S. Ding, and M. Du, "Self-tuning p-spectral clustering based on shared nearest neighbors," Cogn. Comput., vol. 7, no. 5, pp. 622-632, 2015.
50. K. Bache and M. Lichman. (2013). UCI Machine Learning Repository. [Online]. Available: Http://archive.ics.uci.edu/ml
51. A. Bifet, G. Holmes, R. Kirby, and B. Pfahringer. (2011). Data Stream Mining: A Practical Approach. [Online]. Available: Http://moa.cms.waikato.ac.nz/publications/
52. B. Krawczyk, "Learning from imbalanced data: Open challenges and future directions," Progr. Artif. Intell., vol. 5, no. 4, pp. 221-232, 2016.