Noisy data set identification

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 8073 LNAI, Issue , 2013, Pages 629-638

  García, Luís Paulo F ^a   De Carvalho, André C P L F ^a   Lorena, Ana C ^b  

^a UNIVERSITY OF SÃO PAULO   (Brazil)

^b FEDERAL UNIVERSITY OF SÃO PAULO   (Brazil)

Author keywords

Data Complexity Measures; Noise identification; Noisy data

Indexed keywords

DATA COLLECTION; DATA COMPLEXITY; DATA SET; LEARNING PROCESS; MACHINE LEARNING MODELS; NOISE IDENTIFICATION; NOISY DATA; TRAINING TIME;

DIGITAL STORAGE; ERRORS; LEARNING SYSTEMS;

INTELLIGENT SYSTEMS;

EID: 84884954199     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-40846-5_63     Document Type: Conference Paper

References (26)

1. Wang, R.Y., Storey, V.C., Firth, C.P.: A framework for analysis of data quality research. IEEE Trans. Knowl. Data Eng. 7(4), 623-640 (1995)
2. Wu, X.: Knowledge Acquisition from Databases. Ablex Pulishing Corp. (1995)
3. Maletic, J.I., Marcus, A.: Data cleansing: Beyond integrity analysis. In: Proc. Conf. Information Quality, pp. 200-209 (2000)
4. Quinlan, J.R.: Induction of decision trees. Machine Learning 1(1), 81-106 (1986)
5. Quinlan, J.R.: The effect of noise on concept learning. In: Michalski, R.S.I., Carboneel, J.G., Mitchell (eds.) Machine Learning. Morgan Kaufmann Publishers Inc. (1986)
6. Lorena, A.C., Carvalho, A.C.P.L.F.: Evaluation of noise reduction techniques in the splice junction recognition problem. Genetics and Molecular Biology 27(4), 665-672 (2004)
7. Strong, D.M., Lee, Y.W., Wang, R.Y.: Data quality in context. Commun. ACM 40(5), 103-110 (1997)
8. Gamberger, D., Lavrac, N., Dzeroski, S.: Noise detection and elimination in data proprocessing: Experiments in medical domains. Applied Artificial Intelligence 14(2), 205-223 (2000)
9. John, G.H.: Robust decision trees: Removing outliers from databases. In: KDD, pp. 174-179 (1995)
10. Zhao, Q., Nishida, T.: Using qualitative hypotheses to identify inaccurate data. J. Artif. Intell. Res. (JAIR) 3, 119-145 (1995)
11. Brodley, C.E., Friedl, M.A.: Identifying and eliminating mislabeled training instances. In: AAAI/IAAI, vol. 1, pp. 799-805 (1996)
12. Teng, C.M.: Correcting noisy data. In: ICML, pp. 239-248 (1999)
13. Zhu, X., Wu, X., Chen, Q.: Eliminating class noise in large datasets. In: ICML, pp. 920-927 (2003)
14. Zhu, X., Wu, X., Yang, Y.: Error detection and impact-sensitive instance ranking in noisy datasets. In: AAAI, pp. 378-384 (2004)
15. Ho, T.K., Basu, M.: Complexity measures of supervised classification problems. IEEE Trans. Pattern Anal. Mach. Intell. 24(3), 289-300 (2002)
16. Sáez, J.A., Luengo, J., Herrera, F.: Predicting noise filtering efficacy with data complexity measures for nearest neighbor classification. Pattern Recognition 46(1), 355-364 (2013)
17. Sluban, B., Gamberger, D., Lavrac, N.: Ensemble-based noise detection: noise ranking and visual performance evaluation. Data Mining and Knowledge Discovery (2013)
18. Zhu, X., Wu, X.: Class noise vs. attribute noise: A quantitative study. Artif. Intell. Rev. 22(3), 177-210 (2004)
19. Orriols-Puig, A., Maciá, N., Ho, T.K.: Documentation for the data complexity library in C++. Technical report, La Salle - Universitat Ramon Llull (2010)
20. Heckerman, D.: A tutorial on learning with bayesian networks. Technical Report MSR-TR-95-06, Microsoft Research (1995)
21. Breiman, L.: Random forests. Machine Learning 45(1), 5-32 (2001)
22. Breiman, L., Freidman, J.H., Olshen, R.A., Stone, C.J.: Classification and Regression Trees. Wadsworth (1984)
23. Mitchell, T.M.: Machine Learning, 1st edn. McGraw Hill series in computer science. McGraw-Hill (1997)
24. Vapnik, V.N.: The nature of Statistical learning theory. Springer (1995)
25. Bache, K., Lichman, M.: UCI machine learning repository (2013)
26. Demśar, J.: Statistical comparisons of classifiers over multiple data sets. J. Mach. Learn. Res. 7, 1-30 (2006)