On the use of MapReduce for imbalanced big data using Random Forest

Information Sciences

Volumn 285, Issue 1, 2014, Pages 112-137

  Del Río, Sara ^a   López, Victoria ^a   Benítez, José Manuel ^a   Herrera, Francisco ^a  

^a UNIVERSITY OF GRANADA   (Spain)

Author keywords

Big data; Cost sensitive learning; Imbalanced dataset; MapReduce; Random Forest; Sampling

Indexed keywords

CLASSIFICATION (OF INFORMATION); DATA MINING; DECISION TREES; DIGITAL STORAGE; LEARNING SYSTEMS; SAMPLING;

BIG DATA APPLICATIONS; CLASS IMBALANCE PROBLEMS; COST-SENSITIVE LEARNING; IMBALANCED DATASET; MAP-REDUCE; PERFORMANCE OF CLASSIFIER; RANDOM FOREST CLASSIFIER; RANDOM FORESTS;

BIG DATA;

EID: 84906873734     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2014.03.043     Document Type: Article

References (61)

1. Apache Drill, 2013 (accessed December 2013).
2. Apache Hadoop Project, Apache Hadoop, 2013 (accessed December 2013).
3. Apache Mahout Project, Apache Mahout, 2013 (accessed December 2013).
4. K. Bache, M. Lichman, UCI Machine Learning Repository, 2013 .
5. R. Barandela, J.S. Sánchez, V. García, E. Rangel, Strategies for learning in class imbalance problems, Pattern Recognit. 36 (3) (2003) 849-851.
6. G.E.A.P.A. Batista, R.C. Prati, M.C. Monard, A study of the behaviour of several methods for balancing machine learning training data, SIGKDD Explor. 6 (1) (2004) 20-29.
7. R. Batuwita, V. Palade, Adjusted geometric-mean: a novel performance measure for imbalanced bioinformatics datasets learning, J. Bioinform. Comput. Biol. 10 (4) (2012).
8. M. Beyer, D. Laney, 3D Data Management: Controlling Data Volume, Velocity and Variety, 2001 (accessed August 2013).
9. L. Breiman, Random forests, Mach. Learn. 45 (1) (2001) 5-32.
10. L. Breiman, J. Friedman, R. Olshen, C. Stone, Classification and Regression Trees, Wadsworth and Brooks, 1984.
11. C. Bunkhumpornpat, K. Sinapiromsaran, C. Lursinsap, Safe-level-SMOTE: safe-level-synthetic minority over-sampling TEchnique for handling the class imbalanced problem. in: Proceedings of the 13th Pacific-Asia Conference on Advances in Knowledge Discovery and Data Mining PAKDD'09, 2009, pp. 475-482.
12. N.V. Chawla, K.W. Bowyer, L.O. Hall, W.P. Kegelmeyer, SMOTE: synthetic minority over-sampling technique, J. Artif. Intell. Res. 16 (2002) 321-357.
13. N.V. Chawla, D.A. Cieslak, L.O. Hall, A. Joshi, Automatically countering imbalance and its empirical relationship to cost, Data Min. Knowl. Discov. 17 (2) (2008) 225-252.
14. C. Chen, A. Liaw, L. Breiman, Using Random Forest to Learn Imbalanced Data. Tech. Rep. 666, Statistics Department, University of California Berkeley, 2004.
15. J. Dean, S. Ghemawat, Mapreduce: simplified data processing on large clusters, Commun. ACM 51 (1) (2008) 107-113.
16. M. Denil, T. Trappenberg, Overlap versus imbalance, in: Proceedings of the 23rd Canadian conference on Advances in Artificial Intelligence (CCAI'10), vol. 6085 of Lecture Notes on Artificial Intelligence, 2010, pp. 220-231.
17. P. Domingos, Metacost: a general method for making classifiers cost-sensitive, in: Proceedings of the 5th International Conference on Knowledge Discovery and Data Mining (KDD'99), 1999, pp. 155-164.
18. C. Elkan, The foundations of cost-sensitive learning, in: Proceedings of the 17th IEEE International Joint Conference on Artificial Intelligence (IJCAI'01), 2001, pp. 973-978.
19. A. Fernández, V. López, M. Galar, M.J. del Jesus, F. Herrera, Analysing the classification of imbalanced data-sets with multiple classes: binarization techniques and ad-hoc approaches, Knowl.-Based Syst. 42 (2013) 97-110.
20. M. Galar, A. Fernández, E. Barrenechea, H. Bustince, F. Herrera, A review on ensembles for class imbalance problem: bagging, boosting and hybrid based approaches, IEEE Trans. Syst., Man, Cyber. - Part C: Appl. Rev. 42 (4) (2012) 463-484.
21. S. García, J. Derrac, I. Triguero, C.J. Carmona, F. Herrera, Evolutionary-based selection of generalized instances for imbalanced classification, Knowl. Based Syst. 25 (1) (2012) 3-12.
22. S. García, F. Herrera, Evolutionary under-sampling for classification with imbalanced data sets: proposals and taxonomy, Evol. Comput. 17 (3) (2009) 275-306.
23. V. García, R.A. Mollineda, J.S. Sánchez, On the k-NN performance in a challenging scenario of imbalance and overlapping, Pattern Anal. Appl. 11 (3-4) (2008) 269-280.
24. R. Gupta, H. Gupta, M. Mohania, Cloud computing and big data analytics: what is new from databases perspective? in: Proceedings of the 1st International Conference on Big Data Analytics (BDA 2012), vol. 7678 of Lecture Notes on Computer Science, 2012, pp. 42-61.
25. D.A. Hakim, PartialData MapReduce Random Forests, 2013 (accessed December 2013).
26. H. Han, W.Y. Wang, B.H. Mao, Borderline-SMOTE: a new over-sampling method in imbalanced data sets learning, in: Proceedings of the 2005 International Conference on Intelligent Computing (ICIC'05), vol. 3644 of Lecture Notes in Computer Science, 2005, pp. 878-887.
27. H. He, E.A. Garcia, Learning from imbalanced data, IEEE Trans. Knowl. Data Eng. 21 (9) (2009) 1263-1284.
28. N. Japkowicz, S. Stephen, The class imbalance problem: a systematic study, Intell. Data Anal. J. 6 (5) (2002) 429-450.
29. M. Kubat, S. Matwin, Addressing the curse of imbalanced training sets: one-sided selection, in: Proceedings of the 14th International Conference on Machine Learning (ICML'97), 1997, pp. 179-186.
30. J. Laurikkala, Improving identification of difficult small classes by balancing class distribution, in: Proceedings of the 8th Conference on AI in Medicine in Europe: Artificial Intelligence Medicine (AIME'01), 2001, pp. 63-66.
31. V. López, S. del Río, J. Benítez, F. Herrera, Cost-sensitive linguistic fuzzy rule based classification systems under the MapReduce framework for imbalanced big data, Fuzzy Sets Syst. (2014), http://dx.doi.org/10.1016/j.fss.2014.01.01 (in press).
32. V. López, A. Fernández, M.J. del Jesus, F. Herrera, A hierarchical genetic fuzzy system based on genetic programming for addressing classification with highly imbalanced and borderline data-sets, Knowl.-Based Syst. 38 (2013) 85-104.
33. V. López, A. Fernández, S. García, V. Palade, F. Herrera, An insight into classification with imbalanced data: empirical results and current trends on using data intrinsic characteristics, Inform. Sci. 250 (2013) 113-141.
34. V. López, A. Fernández, J.G. Moreno-Torres, F. Herrera, Analysis of preprocessing vs. cost-sensitive learning for imbalanced classification. Open problems on intrinsic data characteristics, Exp. Syst. Appl. 39 (7) (2012) 6585-6608.
35. S. Melnik, A. Gubarev, J. Long, G. Romer, S. Shivakumar, M. Tolton, T. Vassilakis, Dremel: interactive analysis of web-scale datasets, in: Proceedings of the 36th International Conference on Very Large Data Bases, 2010, pp. 330-339.
36. M. Minelli, M. Chambers, A. Dhiraj, Big Data, Big Analytics: Emerging Business Intelligence and Analytic Trends for Today's Businesses, John Wiley & Sons, 2013.
37. D. Miner, A. Shook, MapReduce Design Patterns: Building Effective Algorithms and Analytics for Hadoop and Other Systems, O'Reilly Media, 2012.
38. J.G. Moreno-Torres, T. Raeder, R. Aláiz-Rodríguez, N.V. Chawla, F. Herrera, A unifying view on dataset shift in classification, Pattern Recognit. 45 (1) (2012) 521-530.
39. J. Nahar, T. Imam, K.S. Tickle, Y.-P.P. Chen, Computational intelligence for heart disease diagnosis: a medical knowledge driven approach, Exp. Syst. Appl. 40 (1) (2013) 96-104.
40. K. Napierala, J. Stefanowski, S. Wilk, Learning from imbalanced data in presence of noisy and borderline examples, in: Proceedings of the 7th International Conference on Rough Sets and Current Trends in Computing (RSCTC'10), vol. 6086 of Lecture Notes on Artificial Intelligence, 2010, pp. 158-167.
41. D. Newby, A.A. Freitas, T. Ghafourian, Coping with unbalanced class data sets in oral absorption models, J. Chem. Inform. Model. 53 (2) (2013) 461-474.
42. A. Orriols-Puig, E. Bernadó-Mansilla, Evolutionary rule-based systems for imbalanced datasets, Soft Comput. 13 (3) (2009) 213-225.
43. S. Owen, R. Anil, T. Dunning, E. Friedman, Mahout in Action, Manning Publications Co., 2012.
44. B.-J. Park, S.-K. Oh, W. Pedrycz, The design of polynomial function-based neural network predictors for detection of software defects, Inform. Sci. 229 (2013) 40-57.
45. S.J. Raudys, A.K. Jain, Small sample size effects in statistical pattern recognition: recommendations for practitioners, IEEE Trans. Pattern Anal. Mach. Intell. 13 (3) (1991) 252-264.
46. C. Seiffert, T.M. Khoshgoftaar, J. Van Hulse, A. Folleco, An empirical study of the classification performance of learners on imbalanced and noisy software quality data, Inform. Sci. 259 (2014) 571-595.
47. Spark, 2013 (accessed December 2013).
48. Storm, 2013 (accessed December 2013).
49. Y. Sun, M.S. Kamel, A.K.C. Wong, Y. Wang, Cost-sensitive boosting for classification of imbalanced data, Pattern Recognit. 40 (12) (2007) 3358-3378.
50. Y. Sun, A.K.C. Wong, M.S. Kamel, Classification of imbalanced data: a review, Int. J. Pattern Recognit. Artif. Intell. 23 (4) (2009) 687-719.
51. A. Thusoo, Z. Shao, S. Anthony, D. Borthakur, N. Jain, J. Sen Sarma, R. Murthy, H. Liu, Data warehousing and analytics infrastructure at facebook, in: Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD 2010), 2010, pp. 1013-1020.
52. I. Tomek, Two modifications of CNN, IEEE Trans. Syst. Man Commun. 6 (1976) 769-772.
53. A. Verikas, A. Gelzinis, M. Bacauskiene, Mining data with random forests: a survey and results of new tests, Pattern Recognit. 44 (2) (2011) 330-349.
54. M. Wasikowski, X.-W. Chen, Combating the small sample class imbalance problem using feature selection, IEEE Trans. Knowl. Data Eng. 22 (10) (2010) 1388-1400.
55. G.M. Weiss, Mining with rare cases, in: O. Maimon, L. Rokach (Eds.), The Data Mining and Knowledge Discovery Handbook, Springer, 2005, pp. 765-776.
56. G.M. Weiss, The impact of small disjuncts on classifier learning, in: R. Stahlbock, S.F. Crone, S. Lessmann (Eds.), Data Mining, Annals of Information Systems, vol. 8, Springer, 2010, pp. 193-226.
57. T. White, Hadoop, The Definitive Guide, O'Reilly Media, Inc., 2012.
58. H. Yu, J. Ni, J. Zhao, ACOSampling: an ant colony optimization-based undersampling method for classifying imbalanced dna microarray data, Neurocomputing 101 (2013) 309-318.
59. B. Zadrozny, C. Elkan, Learning and making decisions when costs and probabilities are both unknown, in: Proceedings of the 7th International Conference on Knowledge Discovery and Data Mining (KDD'01), 2001, pp. 204-213.
60. B. Zadrozny, J. Langford, N. Abe, Cost-sensitive learning by cost-proportionate example weighting, in: Proceedings of the 3rd IEEE International Conference on Data Mining (ICDM'03), 2003, pp. 435-442.
61. L. Zhou, Performance of corporate bankruptcy prediction models on imbalanced dataset: the effect of sampling methods, Knowl.-Based Syst. 41 (2013) 16-25.