Learning kernel logistic regression in the presence of class label noise

Pattern Recognition

Volumn 47, Issue 11, 2014, Pages 3641-3655

  Bootkrajang, Jakramate ^a,b   Kabán, Ata ^a  

^a UNIVERSITY OF BIRMINGHAM   (United Kingdom)

^b CHIANG MAI UNIVERSITY   (Thailand)

Author keywords

Classification; Label noise; Model selection; Multiple Kernel Learning

Indexed keywords

CLASSIFICATION (OF INFORMATION); MACHINERY;

CLASSIFICATION TASKS; DISCRIMINATIVE CLASSIFIERS; DISCRIMINATIVE MODELS; KERNEL FISHER DISCRIMINANT; KERNEL LOGISTIC REGRESSION; MODEL COMPLEXITY; MODEL SELECTION; MULTIPLE KERNEL LEARNING;

BENCHMARKING;

EID: 84904348097     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2014.05.007     Document Type: Article

References (47)

1. R. Barandela, E. Gasca, Decontamination of training samples for supervised pattern recognition methods, in: Advances in Pattern Recognition, Lecture Notes in Computer Science, vol. 1876, Springer, Berlin, Heidelberg, 2000, pp. 621-630.
2. B. Biggio, B. Nelson, and P. Laskov Support vector machines under adversarial label noise J. Mach. Learn. Res.: Proc. Track 20 2011 97 112
3. J. Bootkrajang, A. Kabán, Multi-class classification in the presence of labelling errors, in: Proceedings of the European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning, ESANN 2011, 2011, pp. 345-350.
4. J. Bootkrajang, A. Kabán, Label-noise robust logistic regression and its applications, in: ECML/PKDD (1), 2012, pp. 143-158.
5. J. Bootkrajang, and A. Kabán Classification of mislabelled microarrays using robust sparse logistic regression Bioinformatics 29 7 2013 870 877
6. C. Bouveyron, and S. Girard Robust supervised classification with mixture models learning from data with uncertain labels Pattern Recognit. 42 11 2009 2649 2658
7. C.E. Brodley, and M.A. Friedl Identifying mislabeled training data J. Artif. Intell. Res. 11 1999 131 167 (Pubitemid 129628762)
8. G.C. Cawley, and N.L. Talbot On over-fitting in model selection and subsequent selection bias in performance evaluation J. Mach. Learn. Res. 99 2010 2079 2107
9. G.C. Cawley, and N.L.C. Talbot Preventing over-fitting during model selection via Bayesian regularisation of the hyper-parameters J. Mach. Learn. Res. 8 2007 841 861 (Pubitemid 46677044)
10. G. Celeux, S. Chrétien, F. Forbes, and A. Mkhadri A component-wise em algorithm for mixtures J. Comput. Graph. Stat. 10 4 2001 697 712 (Pubitemid 33721250)
11. C.-C. Chang, and C.-J. Lin LIBSVM a library for support vector machines ACM Trans. Intell. Syst. Technol. 2 2011 27:1 27:27
12. R.S. Chhikara, and J. McKeon Linear discriminant analysis with misallocation in training samples J. Am. Stat. Assoc. 79 388 1984 899 906
13. N. Dalal, B. Triggs, Histograms of oriented gradients for human detection, in: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2005 (CVPR 2005), vol. 1, 2005, pp. 886-893. (Pubitemid 43897286)
14. T. Damoulas, and M.A. Girolami Pattern recognition with a Bayesian kernel combination machine Pattern Recognit. Lett. 30 1 2009 46 54
15. B. Frénay, G. de Lannoy, M. Verleysen, Label noise-tolerant hidden Markov models for segmentation: application to ECGs, in: ECML/PKDD (1), 2011, pp. 455-470.
16. M. Gönen, and E. Alpaydin Multiple kernel learning algorithms J. Mach. Learn. Res. 12 2011 2211 2268
17. J.A. Hausman, J. Abrevaya, and F.M. Scott-Morton Misclassification of the dependent variable in a discrete-response setting J. Econom. 87 2 1998 239 269 (Pubitemid 128430148)
18. Y. Jiang, Z.-H. Zhou, Editing training data for knn classifiers with neural network ensemble, in: Advances in Neural Networks, Lecture Notes in Computer Science, vol. 3173, Springer, Berlin, Heidelberg, 2004, pp. 356-361.
19. G.S. Kimeldorf, and G. Wahba Some results on Tchebycheffian spline functions J. Math. Anal. Appl. 33 1 1971 82 95
20. T. Krishnan, and S.C. Nandy Efficiency of discriminant analysis when initial samples are classified stochastically Pattern Recognit. 23 5 1990 529 537
21. P.A. Lachenbruch Discriminant analysis when the initial samples are misclassified Technometrics 8 4 1966 657 662
22. P.A. Lachenbruch Discriminant analysis when the initial samples are misclassified ii non-random misclassification models Technometrics 16 3 1974 419 424
23. G.R.G. Lanckriet, T. De Bie, N. Cristianini, M.I. Jordan, and W.S. Noble A statistical framework for genomic data fusion Bioinformatics 20 16 2004 2626 2635 (Pubitemid 39530149)
24. N.D. Lawrence, B. Schölkopf, Estimating a kernel fisher discriminant in the presence of label noise, in: Proceedings of the 18th International Conference on Machine Learning, Morgan Kaufmann, 2001, pp. 306-313.
25. Y. Li, L.F. Wessels, D. de Ridder, and M.J. Reinders Classification in the presence of class noise using a probabilistic kernel fisher method Pattern Recognit. 40 12 2007 3349 3357 (Pubitemid 47223298)
26. D.G. Lowe, Object recognition from local scale-invariant features, in: Proceedings of the International Conference on Computer Vision (ICCV '99), vol. 2, IEEE Computer Society, Washington, DC, USA, 1999, pp. 1150-1157.
27. G. Lugosi Learning with an unreliable teacher Pattern Recognit. 25 1992 79 87
28. L.S. Magder, and J.P. Hughes Logistic regression when the outcome is measured with uncertainty Am. J. Epidemiol. 146 2 1997 195 203
29. J.I. Maletic, A. Marcus, Data cleansing: beyond integrity analysis, in: Proceedings of the Conference on Information Quality, 2000, pp. 200-209.
30. A. Malossini, E. Blanzieri, and R.T. Ng Detecting potential labeling errors in microarrays by data perturbation Bioinformatics 22 17 2006 2114 2121 (Pubitemid 44390902)
31. F. Muhlenbach, S. Lallich, and D.A. Zighed Identifying and handling mislabelled instances J. Intell. Inf. Syst. 22 1 2004 89 109
32. S.W. Norton, H. Hirsh, Classifier learning from noisy data as probabilistic evidence combination, in: Proceedings of the 10th National Conference on Artificial Intelligence, AAAI Press, Palo Alto, California, USA, 1992, pp. 141-146. (Pubitemid 23633597)
33. T. Ojala, M. Pietikainen, and T. Maenpaa Multiresolution gray-scale and rotation invariant texture classification with local binary patterns IEEE Trans. Pattern Anal. Mach. Intell. 24 7 2002 971 987 (Pubitemid 34835471)
34. P. Pavlidis, J. Weston, J. Cai, W.N. Grundy, Gene functional classification from heterogeneous data, in: Proceedings of the Fifth Annual International Conference on Computational biology (RECOMB '01), ACM, New York, NY, USA, 2001, pp. 249-255. (Pubitemid 32866167)
35. G. Rätsch, T. Onoda, K.-R. Müller, Soft margins for adaboost, Mach. Learn. (2001) 287-320. (Pubitemid 32188795)
36. V.C. Raykar, S. Yu, L.H. Zhao, G.H. Valadez, C. Florin, L. Bogoni, and L. Moy Learning from crowds J. Mach. Learn. Res. 11 2010 1297 1322
37. J.S. Sánchez, R. Barandela, A.I. Marqués, R. Alejo, and J. Badenas Analysis of new techniques to obtain quality training sets Pattern Recognit. Lett. 24 7 2003 1015 1022 (Pubitemid 36049311)
38. R. Snow, B. O'Connor, D. Jurafsky, A. Y. Ng, Cheap and fast - but is it good? Evaluating non-expert annotations for natural language tasks, in: EMNLP, 2008, pp. 254-263.
39. G. Stempfel, L. Ralaivola, Learning kernel perceptrons on noisy data and random projections, in: Algorithmic Learning Theory (ALT), Lecture Notes in Computer Science, vol. 4754.
40. G. Stempfel, L. Ralaivola, Learning Kernel Perceptrons on Noisy Data and Random Projections, 2007. URL http://hal.archives-ouvertes.fr/hal-00137941.
41. G. Stempfel, L. Ralaivola, Learning svms from sloppily labeled data, in: ICANN (1), Lecture Notes in Computer Science, vol. 5768, Springer, Berlin, Heidelberg, 2009, pp. 884-893.
42. T. Takenouchi, S. Eguchi, N. Murata, and T. Kanamori Robust boosting algorithm against mislabeling in multiclass problems Neural Comput. 20 6 2008 1596 1630
43. H. Xu, C. Caramanis, and S. Mannor Robustness and regularization of support vector machines J. Mach. Learn. Res. 10 2009 1485 1510
44. L. Xu, K. Crammer, D. Schuurmans, Robust support vector machine training via convex outlier ablation, in: Proceedings of the 21st National Conference on Artificial intelligence (AAAI'06), vol. 1, 2006, pp. 536-542. (Pubitemid 44705339)
45. Z. Xu, R. Jin, H. Yang, I. King, M.R. Lyu, Simple and efficient multiple kernel learning by group lasso, in: ICML, 2010, pp. 1175-1182.
46. T. Yang, M. Mahdavi, R. Jin, L. Zhang, Y. Zhou, Multiple kernel learning from noisy labels by stochastic programming, in: ICML, 2012, pp. 233-240.
47. Y. Yasui, M. Pepe, L. Hsu, B.-L. Adam, and Z. Feng Partially supervised learning using an EM-boosting algorithm Biometrics 60 1 2004 199 206 (Pubitemid 38392632)