Do unbalanced data have a negative effect on LDA?

Pattern Recognition

Volumn 41, Issue 5, 2008, Pages 1558-1571

  Xue, Jing Hao ^a   Titterington, D Michael ^a  

^a UNIVERSITY OF GLASGOW   (United Kingdom)

Author keywords

Area under an ROC curve (AUC); Linear discriminant analysis (LDA); Misclassification error rate (ER); Unbalanced data

Indexed keywords

COMPUTER SIMULATION; DATA STRUCTURES; DISCRIMINANT ANALYSIS; PATTERN RECOGNITION; REAL TIME SYSTEMS;

LINEAR DISCRIMINANT ANALYSIS; MISCLASSIFICATION ERROR RATE (ER); UNBALANCED DATA SETS;

DATA PROCESSING;

EID: 38349184207     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2007.11.008     Document Type: Article

References (14)

1. Xie J.G., and Qiu Z.D. The effect of imbalanced data sets on LDA: a theoretical and empirical analysis. Pattern Recognition 40 2 (2007) 557-562
2. Gilbert E.S. The effect of unequal variance-covariance matrices on Fisher's linear discriminant function. Biometrics 25 3 (1969) 505-515
3. Anderson T.W., and Bahadur R.R. Classification into two multivariate normal distributions with different covariance matrices. Ann. Math. Stat. 33 2 (1962) 420-431
4. Marks S., and Dunn O.J. Discriminant function when covariance matrices are unequal. J. Am. Stat. Assoc. 69 345 (1974) 555-559
5. McLachlan G.J. Discriminant Analysis and Statistical Pattern Recognition (1992), Wiley, New York
6. Titterington D.M., Murray G.D., Murray L.S., Spiegelhalter D.J., Skene A.M., Habbema J.D.F., and Gelpke G.J. Comparison of discrimination techniques applied to a complex data set of head injured patients (with discussion). J. R. Stat. Soc. Ser. A (General) 144 2 (1981) 145-175
7. Weiss G.M. Mining with rarity: a unifying framework. SIGKDD Explor. 6 1 (2004) 7-19
8. Bradley A.P. The use of the area under the ROC curve in the evaluation of machine learning algorithms. Pattern Recognition 30 7 (1997) 1145-1159
9. Chawla N.V., Japkowicz N., and Kotcz A. Editorial: special issue on learning from imbalanced data sets. SIGKDD Explor. 6 1 (2004) 1-6
10. Hanley J.A., and McNeil B.J. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 143 1 (1982) 29-36
11. C. Cortes, M. Mohri, AUC optimization vs. error rate minimization, in: NIPS, 2003.
12. Weiss G.M., and Provost F. Learning when training data are costly: the effect of class distribution on tree induction. J. Artif. Intell. Res. 19 (2003) 315-354
13. D.J. Newman, S. Hettich, C.L. Blake, C.J. Merz, UCI Repository of machine learning databases, University of California, Irvine, Department of Information and Computer Sciences 〈http://www.ics.uci.edu/∼mlearn/MLRepository.html〉, 1998.
14. A.Y. Ng, M.I. Jordan, On discriminative vs. generative classifiers: a comparison of logistic regression and nai{dotless}̈ve Bayes, in: NIPS, 2001, pp. 841-848.