The efficiency of logistic regression compared to normal discriminant analysis under class-conditional classification noise

Journal of Multivariate Analysis

Volumn 101, Issue 7, 2010, Pages 1622-1637

  Bi, Yingtao ^a   Jeske, Daniel R ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Asymptotic distribution; Class noise; Misclassification rate; Misspecified model

Indexed keywords

EID: 77952009465     PISSN: 0047259X     EISSN: 10957243     Source Type: Journal    
DOI: 10.1016/j.jmva.2010.03.001     Document Type: Article

References (21)

1. Krishnan T., Nandy S.C. Efficiency of discriminant analysis when initial samples are classified stochastically. Pattern Recognition 1990, 23:529-537.
2. Katre U.A., Krishnan T. Pattern recognition with imperfect supervision. Pattern Recognition 1989, 22:423-431.
3. Michalek J.E., Tripathi R.C. The effect of errors in diagnosis and measurement on the estimation of the probability of an event. Journal of the American Statistical Association 1980, 75:713-721.
4. Li Y., Lodeswyk W., De Ridder D., Reinders M. Classification in the presence of class noise using a probabilistic kernel fisher method. Pattern Recognition 2007, 40:3349-3357.
5. N.D. Lawrence, B. Scholkopf, Estimating a kernel fisher discriminant in the presence of label noise, in: Proc. of 18th ICML, 2001, pp. 306-313.
6. Yasui Y., Pepe M., Hsu L., Adam B.L., Feng Z. Partially supervised learning using an EM-boosting algorithm. Biometrics 2004, 60:199-206.
7. Zhang W., Rekaya R., Bertrand K. A method for predicting disease subtypes in presence of misclassification among training samples using gene expression: application to human breast cancer. Bioinformatics 2006, 22:317-325.
8. Robbins K., Joseph S., Zhang W., Rekaya R., Bertrand J.K. Classification of incipient Alzheimer patients using gene expression data: dealing with potential misdiagnosis. Online Journal of Bioinformatics 2006, 7:22-31.
9. J. Maletic, A. Marcus, Data cleansing: beyond integrity analysis, in: Proceedings of the Conference on Information Quality, 2000.
10. Weisberg S. Applied Linear Regression 1980, John Wiley and Sons, Inc.
11. Norton S.W., Hirsh H. Classifier learning from noisy data as probabilistic evidence combination. Proceedings of the Tenth National Conference on Artificial Intelligence 1992, 141-146. AAAI Press, Menlo Park, CA.
12. Magder L.S., Hughes J.P. Logistic regression when the outcome is measured with uncertainty. American Journal of Epidemiology 1997, 146:195-203.
13. Hofler M. The effect of misclassification on the estimation of association: a review. International Journal of Methods in Psychiatric Research 2005, 14:92-101.
14. Neuhaus J.M. Bias and efficiency loss due to misclassified responses in binary regression. Biometrika 1999, 86:843-855.
15. Krishnan T. Efficiency of learning with imperfect supervision. Pattern Recognition 1988, 21:183-188.
16. Efron B. The efficiency of logistic regression compared to normal discriminant analysis. Journal of the American Statistical Association 1975, 70:892-898.
17. Zhu X., Wu X. Class noise vs. attribute noise: a quantitative study of their impacts. Artificial Intelligence Review 2004, 22:177-210.
18. A.Y. Ng, M.I. Jordan, On discriminative vs. generative classifiers: a comparison of logistic regression and naïve Bayes, in: NIPS, 2001, pp. 841-848.
19. Y. Bi, Theoretical analysis of classification under CCC-Noise and its application to semi-supervised text classification, Ph.D. Thesis, University of California, Riverside, 2008.
20. White H. Maximum likelihood estimation of misspecified model. Econometrica 1982, 50:1-25.
21. Li K.C., Duan N. Regression analysis under link violation. Annals of Statistics 1989, 17:1009-1052.