Effect of label noise in the complexity of classification problems

Neurocomputing

Volumn 160, Issue , 2015, Pages 108-119

  Garcia, Luís P F ^a   de Carvalho, André C P L F ^a   Lorena, Ana C ^b  

^a UNIVERSITY OF SÃO PAULO   (Brazil)

^b FEDERAL UNIVERSITY OF SÃO PAULO   (Brazil)

Author keywords

Classification; Complexity measures; Label noise; Noise Filter

Indexed keywords

DIGITAL STORAGE;

COMPLEX DECISION; COMPLEXITY MEASURES; DATA COMPLEXITY; NOISE FILTERS; NOISE IDENTIFICATION; PREPROCESSING TECHNIQUES; REAL-WORLD PROBLEM; STRUCTURAL MEASURES;

CLASSIFICATION (OF INFORMATION);

ARTICLE; CLASSIFICATION; CORRELATION ANALYSIS; CORRELATION COEFFICIENT; FILTER; GEOMETRY; INFORMATION PROCESSING; LABEL NOISE; LEARNING ALGORITHM; METHODOLOGY; NOISE; PRIORITY JOURNAL; STATISTICAL ANALYSIS; STRUCTURE ANALYSIS; UNIFORM RANDOM ADDITION;

EID: 84927970970     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2014.10.085     Document Type: Article

References (37)

1. Quinlan J.R. The effect of noise on concept learning. Machine Learning 1986, 149-166. Morgan Kaufmann Publishers Inc. R.S.I. Michalski, J.G. Carboneel, Mitchell (Eds.).
2. Fayyad U.M., Piatetsky-Shapiro G., Smyth P. Knowledge discovery and data mining. towards a unifying framework. KDD 1996, 82-88. AAAI Press. E. Simoudis, J. Han, U.M. Fayyad (Eds.).
3. Sluban B., Gamberger D., Lavrac N. Ensemble-based noise detection. noise ranking and visual performance evaluation. Data Mining Knowl. Discov. 2014, 28(2):265-303. 10.1007/s10618-012-0299-1.
4. Tomek I. An experiment with the edited nearest-neighbor rule. IEEE Trans. Syst. Man Cybern. 1976, 6(6):448-452. 10.1109/TSMC.1976.4309523.
5. Brodley C.E., Friedl M.A. Identifying and eliminating mislabeled training instances. AAAI/IAAI 1996, vol. 1:799-805. AAAI Press/The MIT Press.
6. Verbaeten S., Assche A.V. Ensemble methods for noise elimination in classification problems. Multiple Classifier Systems, Lecture Notes in Computer Science 2003, vol. 2709:317-325. Springer, Berlin, Heidelberg. 10.1007/3-540-44938-8_32.
7. Sluban B., Gamberger D., Lavrac N. Advances in class noise detection. ECAI, Frontiers in Artificial Intelligence and Applications 2010, vol. 215:1105-1106. IOS Press.
8. Garcia L.P.F., Lorena A.C., Carvalho A.C.P.L.F. A study on class noise detection and elimination. 2012 Brazilian Symposium on Neural Networks (SBRN) 2012, 13-18. IEEE. 10.1109/SBRN.2012.49. A.C. Lorena, C.E. Thomaz, A.T.R. Pozo (Eds.).
9. Smith M., Martinez T., Giraud-Carrier C. An instance level analysis of data complexity. Mach. Learn. 2014, 95(2):225-256. 10.1007/s10994-013-5422-z.
10. B. Frenay, M. Verleysen, Classification in the presence of label noise: a survey, IEEE Trans. Neural Netw. Learning Syst. 99 (2015) 1-25. doi:10.1109/TNNLS.2013.2292894.
11. Ho T.K., Basu M. Complexity measures of supervised classification problems. IEEE Trans. Pattern Anal. Mach. Intell. 2002, 24(3):289-300. 10.1109/34.990132.
12. G. Morais, R.C. Prati, Complex network measures for data set characterization, in: 2013 Brazilian Conference on Intelligent Systems (BRACIS), 2013, pp. 12-18. doi:10.1109/BRACIS.2013.11.
13. L.F. Costa, F.A. Rodrigues, G. Travieso, P.R.V. Boas, Characterization of complex networks: a survey of measurements, Adv. Phys. 56 (2008) 167-242.
14. E. Kolaczyk, Statistical Analysis of Network Data: Methods and Models, in: Springer Series in Statistics, Springer, 2009.
15. Zhu X., Wu X. Class noise vs. attribute noise. a quantitative study. Artif. Intell. Rev. 2004, 22(3):177-210. 10.1007/s10462-004-0751-8.
16. Quinlan J.R. Induction of decision trees. Mach. Learn. 1986, 1(1):81-106. 10.1007/BF00116251.
17. Vapnik V.N. The Nature of Statistical Learning Theory 1995, Springer-Verlag, New York, Inc.
18. E. Eskin, Detecting errors within a corpus using anomaly detection, in: Proceedings of the 1st North American Chapter of the Association for Computational Linguistics Conference, NAACL 2000, Association for Computational Linguistics, 2000, pp. 148-153.
19. A. Ganapathiraju, J. Picone, Support vector machines for automatic data cleanup, in: INTERSPEECH, ISCA, 2000, pp. 210-213.
20. L. Li, Y.S. Abu-Mostafa, Data Complexity in Machine Learning, Technical Report. CaltechCSTR:2006.004, Caltech Computer Science, 2006.
21. T.K. Ho, Data complexity analysis: linkage between context and solution in classification, in: Structural, Syntactic, and Statistical Pattern Recognition, vol. 5342 of Lecture Notes in Computer Science, 2008, pp. 986-995. doi:10.1007/978-3-540-89689-0_102.
22. Singh S. Prism. a novel framework for pattern recognition. Pattern Anal. Appl. 2003, 6(2):134-149. 10.1007/s10044-002-0186-2.
23. Sáez J.A., Luengo J., Herrera F. Predicting noise filtering efficacy with data complexity measures for nearest neighbor classification. Pattern Recognit. 2013, 46(1):355-364. http://dx.doi.org/http://dx.doi.org/10.1016/j.patcog.2012.07.009.
24. Garcia L.P.F., Carvalho A.C., Lorena A.C. Noisy data set identification. Hybrid Artificial Intelligent Systems, Lecture Notes in Computer Science 2013, vol. 8073:629-638. Springer, Berlin, Heidelberg. 10.1007/978-3-642-40846-5_63.
25. Mollineda R.A., Sánchez J.S., Sotoca J.M. Data characterization for effective prototype selection. Pattern Recognition and Image Analysis, Lecture Notes in Computer Science 2005, vol. 3523:27-34. Springer, Berlin, Heidelberg. 10.1007/11492542_4.
26. A. Orriols-Puig, N. Maciá, T.K. Ho, Documentation for the Data Complexity Library in C++, Technical Report, La Salle - Universitat Ramon Llull, 2010.
27. N. Ganguly, A. Deutsch, A. Mukherjee, Dynamics on and of Complex Networks: Applications to Biology, Computer Science, and the Social Sciences, Modeling and Simulation in Science, Engineering and Technology, Birkhäuser, Boston, 2009.
28. X. Zhu, J. Lafferty, R. Rosenfeld, Semi-Supervised Learning with Graphs (Ph.D. Thesis), Carnegie Mellon University, Language Technologies Institute, School of Computer Science, 2005.
29. D.R. Amancio, C.H. Comin, D. Casanova, G. Travieso, O.M. Bruno, F.A. Rodrigues, L. da F. Costa, A systematic comparison of supervised classifiers, PLoS ONE 9(4), 2014, e94137. http://dx.doi.org/10.1371/journal.pone.0094137.
30. K. Bache, M. Lichman, UCI Machine Learning Repository, 2013. http://archive.ics.uci.edu/ml.
31. Alcalá-Fdez J., Fernández A., Luengo J., Derrac J., García S. Keel data-mining software tool. data set repository, integration of algorithms and experimental analysis framework. Mult.-Valued Logic Soft Comput. 2011, 17(2-3):255-287.
32. Maciá N., Bernadó-Mansilla E. Towards UCI+. a mindful repository design. Inf. Sci. 2014, 261:237-262. 10.1016/j.ins.2013.08.059.
33. Teng C.-M. Correcting noisy data. ICML 1999, 239-248. Morgan Kaufmann. I. Bratko, S. Dzeroski (Eds.).
34. C. Giraud-Carrier, T. Martinez, An Efficient Metric for Heterogeneous Inductive Learning Applications in the Attribute-Value Language, Technical Report, University of Bristol, Bristol, UK, 1995.
35. Csardi G., Nepusz T. The Igraph software package for complex network research. InterJ. Complex Syst. 2006, 34:695. URL http://igraph.sf.net.
36. Wilson D.R., Martinez T.R. Reduction techniques for instance-based learning algorithms. Mach. Learn. 2000, 38(3):257-286.
37. Wilson D.L. Asymtoptic properties of nearest neighbor rules using edited data. IEEE Trans. Syst. Man Cybern. 1972, 2(3):408-421.