Class-imbalanced classifiers for high-dimensional data

Briefings in Bioinformatics

Volumn 14, Issue 1, 2013, Pages 13-26

  Lin, Wei Jiun ^a   Chen, James J ^b,c  

^a FENG CHIA UNIVERSITY   (Taiwan)

^b NATIONAL CENTER FOR TOXICOLOGICAL RESEARCH   (United States)

^c CHINA MEDICAL UNIVERSITY   (Taiwan)

Author keywords

Class imbalanced prediction; Feature selection; Lack of data; Performance metrics; Threshold adjustment; Under sampling ensemble

Indexed keywords

EID: 84872812260     PISSN: 14675463     EISSN: 14774054     Source Type: Journal    
DOI: 10.1093/bib/bbs006     Document Type: Review

References (49)

1. Helma C, Kramer S. A survey of the Predictive Toxicology Challenge 2000-2001. Bioinformatics 2003;19:1179-82.
2. Young J, Tong W, Fang H, et al. Building an organ-specific carcinogenic database for SAR analyses. J Toxicol Environ Health A 2004;67:1363-89.
3. Tong W, Xie Q, Hong H, et al. Assessment of prediction confidence and domain extrapolation of two structure- activity relationship models for predicting estrogen receptor binding activity. Environ Health Perspect 2004;112: 1249-54.
4. Rosenkranz HS. SAR modeling of genotoxic phenomena: the consequence on predictive performance of deviation from a unity ratio of genotoxicants/non-genotoxicants. Mutat Res 2004;559:67-71.
5. Zou W, Lin WJ, Foley SL, et al. Evaluation of pulsed-field gel electrophoresis profiles for identification of Salmonella serotypes. JClinMicrobiol 2010;48:3122-6.
6. Ramaswamy S, Ross KN, Lander ES, et al. A molecular signature of metastasis in primary solid tumors. Nat Genet 2003;33:49-54.
7. Iizuka N, Oka M, Yamada-Okabe H, etal. Oligonucleotide microarray for prediction of early intrahepatic recurrence of hepatocellular carcinoma after curative resection. Lancet 2003;361:923-9.
8. Shipp MA, Ross KN, Tamayo P, et al. Diffuse large B-cell lymphoma outcome prediction by gene-expression profiling and supervised machine learning. Nat Med 2002;8: 68-74.
9. Fawcett T, Provost F. Adaptive fraud detection. Data Min KnowlDiscov 1997;1:291-316.
10. Bradley AP. The use of the area under the ROC curve in the evaluation of machine learning algorithms. Pattern Recogn 1997;30:1145-59.
11. Provost F, Fawcett T, Kohavi R. The case against accuracy estimation for comparing induction algorithms. Proceedings of the Fifteenth International Conference on Machine Learning (ICML98), 1998. Morgan Kaufmann;445-53.
12. Ling CX, Li C. Data mining for direct marketing: problems and solutions. Proceedings of the Fourth International Conference on Knowledge Discovery and Data Mining (KDD-98), 1998. AAAI Press;73-79.
13. Provost F, Fawcett T. Robust classification for imprecise environments. Mach Learn 2001;42:203-31.
14. Japkowicz N, Stephen S. The class imbalance problem: a systematic study. IntellData Anal 2002;6:203-31.
15. Weiss GM, Provost F. Learning when training data are costly: the effect of class distribution on tree induction. JArtif Intell Res 2003;19:315-54.
16. Weiss GM. Mining with rarity: a unifying framework. SIGKDDExplorations 2004;6:7-19.
17. Chawla NV, Japkowicz N, Kotcz A. Editorial: special issue on learning from imbalanced data sets. SIGKDD Explorations 2004;6:1-6.
18. Baek S, Tsai CA, Chen JJ. Development of biomarker classifiers from high-dimensional data. Brief Bioinform 2009;10: 537-46.
19. Blagus R, Lusa L. Class prediction for highdimensional class-imbalanced data. BMC Bioinformatics 2010;11:523.
20. Dudoit S, Fridlyand J, Speed TP. Comparison of discrimination methods for the classification of tumors using gene expression data. J Am Stat Assoc 2002; 97:77-87.
21. Breiman L. Random forest. Mach Learn 2001;45:5-32.
22. Vapnik V. The Nature of Statistical Learning Theory. New York: Springer, 1995.
23. Guyon I, Weston J, Barnhill S, et al. Gene selection for cancer classification using support vector machines. Mach Learn 2002;46:389-422.
24. Zhou ZH, Liu XY. Training cost-sensitive neural networks with methods addressing the class imbalance problem. IEEE Trans KnowlData Eng 2006;18:63-77.
25. Barandela R, Sánchez JS, García V, etal. Strategies for learning in class imbalance problems. Pattern Recogn 2003;36: 849-51.
26. Zhang J, Mani I. kNN approach to unbalanced data distributions: a case study involving information extraction. Proceedings of theWorkshop on Learning from Imbalanced Datasets II 2003.
27. Raskutti B, Kowalczyk A. Extreme re-balancing for SVMs: a case study. SIGKDDExplorations 2004;6:60-9.
28. Akbani R, Kwek S, Japkowicz N. Applying support vector machines to imbalanced datasets. Proceedings of the Fifteenth European Conference on Machine Learning (ECML), 2004; 39-50.
29. Wu G, Chang EY. KBA: kernel boundary alignment considering imbalanced data distribution. IEEETransKnowlData Eng 2005;17:786-95.
30. Tang Y, Zhang YQ. Granular SVM with repetitive undersampling for highly imbalanced protein homology prediction. Proceedings of IEEE International Conference on Granular Computing, 2006;457-60.
31. Lessmann S. Solving imbalanced classification problems with support vector machines. Proceedings of the International Conference on Artificial Intelligence (IC-AI), 2004; 214-20.
32. Tang Y, Zhang YQ, Chawla NV, et al. SVMs modeling for highly imbalanced classification. IEEETrans SystMan Cybern BCybern 2009;39:281-8.
33. Byon E, Shrivastava AK, Ding Y. A classification procedure for highly imbalanced class sizes. IEEE Trans 2010;42: 288-303.
34. Chawla NV, Bowyer KW, Hall LO, et al. SMOTE: Synthetic minority over-sampling technique. J Artif Intell Res 2002;16:321-57.
35. Chawla NV, Lazarevic A, Hall LO, et al. SMOTEBoost: Improving prediction of the minority class in boosting. Proceedings of the Seventh European Conference on Principles and Practice of Knowledge Discovery inDatabases, 2003;107-19.
36. Chen JJ, Tsai CA, Young JF, et al. Classification ensembles for unbalanced class sizes in predictive toxicology. SAR QSAR EnvironRes 2005;16:517-29.
37. Chen JJ, Tsai CA, Moon H, et al. Decision threshold adjustment in class prediction. SARQSAR Environ Res 2006; 17:337-52.
38. Juszczak P, Duin RPW. Uncertainty sampling methods for one-class classifiers. Proceedings of the ICML'03 Workshop on Learning from ImbalancedData Sets, 2003.
39. Schölkopf B, Smola AJ, Williamson RC, et al. New support vector algorithms. Neural Comput 2000;12:1207-45.
40. Lin SC, Chang YCI, Yang WN. Meta-learning for imbalanced data and classification ensemble in binary classification. Neurocomputing 2009;73:484-94.
41. Alon U, Barkai N, Notterman DA, et al. Broad patterns of gene expression revealed by clustering analysis of tumor and normal colon tissues probed by oligonucleotide arrays. Proc Natl Acad SciUSA 1999;96:6745-50.
42. Reik W, Walter J. Genomic imprinting: parental influence on the genome. Nat RevGenet 2001;2:21-32.
43. Greally JM. Short interspersed transposable elements (SINEs) are excluded from imprinted regions in the human genome. ProcNatl Acad SciUSA 2002;99:327-32.
44. Sotiriou C, Neo SY, McShane LM, et al. Breast cancer classification and prognosis based on gene expression profiles from a population-based study. ProcNatlAcadSciUSA 2003; 100:10393-8.
45. Jemal A, Siegel R, Xu J, et al. Cancer statistics, 2010. Ca CancerJClin 2010;60:277-300.
46. Bishop HM, Blamey RW, Elston CW, etal. Relationship of oestrogen-receptor status to survival in breast cancer. Lancet 1979;2:283-4.
47. Bhattacharjee A, Richards WG, Staunton J, et al. Classification of human lung carcinomas by mRNA expression profiling reveals distinct adenocarcinoma subclasses. ProcNatl Acad SciUSA 2001;98:13790-5.
48. The Non-Hodgkin's Lymphoma Classification Project A clinical evaluation of the international lymphoma study group classification of non-Hodgkin's lymphoma. Blood 1997;89:3909-18.
49. Hackstadt AJ, Hess AM. Filtering for increased power for microarray data analysis. BMC Bioinformatics 2009;10:11.