SMOTE for high-dimensional class-imbalanced data

BMC Bioinformatics

Volumn 14, Issue , 2013, Pages

  Blagus, Rok ^a   Lusa, Lara ^a  

^a UNIVERSITY OF LJUBLJANA   (Slovenia)

Author keywords

[No Author keywords available]

Indexed keywords

DATA VARIABILITY; EUCLIDEAN DISTANCE; HIGH DIMENSIONAL DATA; K-NN CLASSIFICATIONS; NUMBER OF SAMPLES; RANDOM UNDER SAMPLINGS; SYNTHETIC MINORITY OVER-SAMPLING TECHNIQUES; VARIABLE SELECTION;

ALGORITHM; ARTICLE; CLASSIFICATION; COMPUTER SIMULATION; GENE EXPRESSION PROFILING; METHODOLOGY; SUPPORT VECTOR MACHINE;

ALGORITHMS; CLASSIFICATION; COMPUTER SIMULATION; GENE EXPRESSION PROFILING; SUPPORT VECTOR MACHINES;

MLCS; MLOWN;

EID: 84875125127     PISSN: None     EISSN: 14712105     Source Type: Journal    
DOI: 10.1186/1471-2105-14-106     Document Type: Article

References (42)

1. Bishop CM. Pattern Recognition and Machine Learning (Information Science and Statistics) 2007, New York: Springer.
2. He H, Garcia EA. Learning from imbalanced data. IEEE Trans Knowledge Data Eng 2009, 21(9):1263-1284.
3. Daskalaki S, Kopanas I, Avouris N. Evaluation of classifiers for an uneven class distribution problem. Appl Artif Intell 2006, 20(5):381-417.
4. Ramaswamy S, Ross KN, Lander ES, Golub TR. A molecular signature of metastasis in primary solid tumors. Nat Genet 2003, 33:49-54. 10.1038/ng1060, 12469122.
5. Shipp MA, Ross KN, Tamayo P, Weng AP, Kutok JL, Aguiar RC, Gaasenbeek M, Angelo M, Reich M, Pinkus GS, Ray TS, Koval MA, Last KW, Norton A, Lister TA, Mesirov J, Neuberg DS, Lander ES, Aster JC. Diffuse large B-cell lymphoma outcome prediction by gene-expression profiling and supervised machine learning. Nat Med 2002, 8:68. 10.1038/nm0102-68, 11786909.
6. Iizuka N, Oka M, Yamada-Okabe H, Nishida M, Maeda Y, Mori N, Takao T, Tamesa T, Tangoku A, Tabuchi H, Hamada K, Nakayama H, Ishitsuka H, Miyamoto T, Hirabayashi A, Uchimura S, Hamamoto Y. Oligonucleotide microarray for prediction of early intrahepatic recurrence of hepatocellular carcinoma after curative resection. Lancet 2003, 361(9361):923-929. 10.1016/S0140-6736(03)12775-4, 12648972.
7. Blagus R, Lusa L. Class prediction for high-dimensional class-imbalanced data. BMC Bioinformatics 2010, 11:523+. 10.1186/1471-2105-11-523, 3098087, 20961420.
8. Hulse JV, Khoshgoftaar TM, Napolitano A. Experimental perspectives on learning from imbalanced data. Proceedings of the 24th international conference on Machine learning 2007, 935-942. Corvallis, Oregon: Oregon State University.
9. Chawla NV, Bowyer KW, Hall LO, Kegelmeyer WP. SMOTE: synthetic minority over-sampling technique. J Artif Intell Res 2002, 16:341-378.
10. Cieslak DA, Chawla NW, Striegel A. Combating imbalance in network intrusion datasets. Proc IEEE Int Conf Granular Comput 2006, 732-737. Atlanta, Georgia, USA.
11. Liu Y, Chawla NV, Harper MP, Shriberg E, Stolcke A. A study in machine learning from imbalanced data for sentence boundary detection in speech. Comput Speech Lang 2006, 20(4):468-494.
12. Johnson R, Chawla N, Hellmann J. Species distribution modelling and prediction: A class imbalance problem. Conference on Intelligent Data Understanding (CIDU) 2012, 9-16.
13. Fallahi A, Jafari S. An Expert System for Detection of Breast Cancer Using Data Preprocessing and Bayesian Network. Int J Adv Sci Technol 2011, 34:65-70.
14. Batuwita R, Palade V. microPred: effective classification of pre-miRNAs for human miRNA gene prediction. Bioinformatics 2009, 25(8):989-995. 10.1093/bioinformatics/btp107, 19233894.
15. Xiao J, Tang X, Li Y, Fang Z, Ma D, He Y, Li M. Identification of microRNA precursors based on random forest with network-level representation method of stem-loop structure. BMC Bioinformatics 2011, 12:165+. 10.1186/1471-2105-12-165, 3118167, 21575268.
16. MacIsaac KD, Gordon DB, Nekludova L, Odom DT, Schreiber J, Gifford DK, Young RA, Fraenkel E. A hypothesis-based approach for identifying the binding specificity of regulatory proteins from chromatin immunoprecipitation data. Bioinformatics 2006, 22(4):423-429. 10.1093/bioinformatics/bti815, 16332710.
17. Wang J, Xu M, Wang H, Zhang J. Classification of imbalanced data by using the SMOTE algorithm and locally linear embedding. International Conference on Signal Processing 2006, Guilin, China.
18. Doyle S, Monaco J, Feldman M, Tomaszewski J, Madabhushi A. An active learning based classification strategy for the minority class problem application to histopathology annotation. BMC Bioinformatics 2011, 12:424+. 10.1186/1471-2105-12-424, 3284114, 22034914.
19. Wallace B, Small K, Brodley C, Trikalinos T. Class imbalance, Redux. Data Mining (ICDM), 2011 IEEE 11th International Conference on 2011, 754-763. Vancouver, Canada.
20. Ertekin SE, Huang J, Bottou L, Giles CL. Learning on the border: Active learning in imbalanced data classification. Proceedings of ACM Conference on Information and Knowledge Management 2007, 127-136. Lisbon, Portugal.
21. Radivojac P, Chawla NV, Dunker AK, Obradovic Z. Classification and knowledge discovery in protein databases. J Biomed Inform 2004, 37(4):224-239. 10.1016/j.jbi.2004.07.008, 15465476.
22. Han H, Wang WY, Mao BH. Borderline-SMOTE: A New Over-Sampling Method in Imbalanced Data Sets Learning. Advances in Intelligent Computing Volume 3644 of Lecture Notes in Computer Science 2005, 878-887. Berlin/Heidelberg: Springer.
23. Bunkhumpornpat C, Sinapiromsaran K, Lursinsap C. Safe-Level-SMOTE:Safe-Level-Synthetic Minority Over-Sampling TEchnique for Handling the Class Imbalanced Problem. Advances in Knowledge Discovery and Data Mining, Volume 5476 2009, 475-482. Berlin / Heidelberg: Springer.
24. Gu Q, Cai Z, Zhu L. Classification of Imbalanced Data Sets by Using the Hybrid Re-sampling Algorithm Based on Isomap. Advances in Computation and Intelligence Volume 5821 of Lecture Notes in Computer Science 2009, 287-296. Berlin / Heidelberg: Springer.
25. Breiman L, Friedman JH, Olshen RA, Stone CJ. Classification and Regression Trees 1984, Boca Raton: Chapman & Hall/CRC.
26. Fix E, Hodges JJL. Discriminatory analysis. Nonparametric discrimination: consistency properties. Int Stat Rev 1989, 57(3):238-247.
27. Speed TP. Statistical Analysis of Gene Expression Microarray Data 2003, Boca Raton: Chapman & Hall/CRC.
28. Simon RM, Korn EL, McShane LM, Radmacher MD, Wright GW, Zhao Y. Design and Analysis of DNA Microarray Investigations 2004, New York: Springer.
29. Breiman L. Random forests. Mach Learn 2001, 45:5-32.
30. Cortes C, Vapnik V. Support-vector networks. Mach Learn 1995, 20(3):273-297.
31. Tibshirani R, Hastie T, Narasimhan B, Chu G. Diagnosis of multiple cancer types by shrunken centroids of gene expression. Proc Natl Acad Sci USA 2002, 99(10):6567-6572. 10.1073/pnas.082099299, 124443, 12011421.
32. Zhu J, Hastie T. Classification of gene microarrays by penalized logistic regression. Biostatistics 2004, 5(3):427-443. 10.1093/biostatistics/kxg046, 15208204.
33. Beyer K, Goldstein J, Ramakrishnan R, Shaft U. When is " nearest neighbor" meaningful?. Int. Conf. on Database Theory 1999, 217-235. Jerusalem, Israel.
34. Hinneburg A, Aggarwal CC, Keim DA. What is the nearest neighbor in high dimensional spaces?. Proc 26th Int Conf Very Large Data Bases, VLDB '00 2000, 506-515. San Francisco.
35. Drummond C, Holte RC. C4.5, Class Imbalance, and Cost Sensitivity: Why Under-Sampling beats Over-Sampling. Workshop on Learning from Imbalanced Datasets II, ICML 2003, Ottawa, Canada.
36. Sotiriou C, Neo SY, McShane LM, Korn EL, Long PM, Jazaeri A, Martiat P, Fox SB, Harris AL, Liu ET. Breast cancer classification and prognosis based on gene expression profiles from a population-based study. Proc Natl Acad Sci USA 2003, 100(18):10393-10398. 10.1073/pnas.1732912100, 193572, 12917485.
37. Dudoit S, Fridlyand J, Speed TP. Comparison of discrimination methods for the classification of tumors using gene expression data. J Am Stat Assoc 2002, 97(457):77-87.
38. Guo Y, Hastie T, Tibshirani R. Regularized linear discriminant analysis and its application in microarrays. Biostatistics 2007, 8:86-100. 10.1093/biostatistics/kxj035, 16603682.
39. Fawcett T. An introduction to ROC analysis. Pattern Recognit Lett 2006, 27(8):861-874.
40. Pittman J, Huang E, Dressman H, Horng C, Cheng S, Tsou M, Chen C, Bild A, Iversen E, Huang A, Nevins J, West M. Integrated modeling of clinical and gene expression information for personalized prediction of disease outcomes. Proc Natl Acad Sci USA 2004, 101(22):8431-8436. 10.1073/pnas.0401736101, 420411, 15152076.
41. Miller LD, Smeds J, George J, Vega VB, Vergara L, Ploner A, Pawitan Y, Hall P, Klaar S. An expression signature for p53 status in human breast cancer predicts mutation status, transcriptional effects, and patient survival. Proc Natl Acad Sci USA 2005, 102(38):13550-13555. 10.1073/pnas.0506230102, 1197273, 16141321.
42. R Development Core Team R: A Language and Environment for Statistical Computing 2008, Vienna: R Foundation for Statistical Computing, R Development Core Team.