Determining noisy instances relative to attributes of interest

Intelligent Data Analysis

Volumn 10, Issue 3, 2006, Pages 251-268

  Khoshgoftaar, Taghi M ^a   Van Hulse, Jason ^b  

^a Florida Atlantic Univ   (United States)

^b FLORIDA ATLANTIC UNIVERSITY   (United States)

Author keywords

attribute of interest; data cleaning; Noise detection

Indexed keywords

ANALYSIS OF DATA; ATTRIBUTE OF INTEREST; DATA CLEANING; DEPENDENT VARIABLES; EMPIRICAL CASE STUDIES; NOISE DETECTION; NOVEL TECHNIQUES; REAL-WORLD DATASETS;

CLASSIFICATION (OF INFORMATION);

EID: 38949166052     PISSN: 1088467X     EISSN: 15714128     Source Type: Journal    
DOI: 10.3233/ida-2006-10305     Document Type: Article

References (23)

1. C.E. Brodley and M.A. Friedl, Identifying mislabeled training data, Journal of Artificial Intelligence Research 11 (1999), 131-167.
2. P. Clark and T. Niblett, Rule induction with CN2: Some recent improvements, In Proceedings of the 5th EuropeanWorking Session on Learning, 1991, 151-163.
3. W.J. Conover, Practical Nonparametric Statistics, (2nd edition), Wiley, 1971.
4. J.D. Dunagan, A geometic theory of outliers and perturbation, Ph. D. Dissertation, 2002. Available at http://research.microsoft.com/̃jdunagan/ thesis.pdf.
5. N.E. Fenton and S.L. Pfleeger, Software Metrics: A Rigorous and Practical Approach, PWS Publishing Company: ITP, Boston, MA, 2nd edition, 1997.
6. D. Gamberger, N. Lavrac and S. Dzeroski, Noise elimination in inductive concept learning: A case study in medical diagnosis, In Proceedings of the 7th International Workshop on Algorithmic Learning Theory, Springer, 1999, 199-212.
7. D. Gamberger, N. Lavrac and C. Groselj, Experiments with noise filtering in a medical domain, In Proceedings of the 16th International Conference on Machine Learning, Morgan Kaufmann, 1999, 143-153.
8. M.A. Hernandez and S.J. Stolfo, Real-world data is dirty: Data cleansing and the merge/purge problem, Data Mining and Knowledge Discovery 2(1) (1998), 9-37.
9. T.M. Khoshgoftaar, L.A. Bullard and K. Gao, Detecting outliers using rule-based modeling for improving CBR-based software quality classification models, in: Proceedings of the 16th International Conference on Case-Based Reasoning, (Vol. 1689), K.D. Ashley and D.G. Bridge, eds, Springer-Verlag LNAI, 2003, pp. 216-230.
10. T.M. Khoshgoftaar and N. Seliya, Comparative assessment of software quality classification techniques: An empirical case study, Empirical Software Engineering Journal 9(3) (2004), 229-257.
11. T.M. Khoshgoftaar and N. Seliya, The necessity of assuring quality in software measurement data, In Proceedings of 10th International Software Metrics Symposium, Chicago, IL, September 2004. IEEE Computer Society, 119-130.
12. T.M. Khoshgoftaar, S. Zhong and V. Joshi, Noise elimination with ensemble-classifier filtering for software quality estimation, Intelligent Data Analysis: An International Journal 9(1) (2005), 3-27.
13. P.M. Murphy and D.W. Aha, UCI repository of machine learning databases, http://www.ics.uci.edu/̃mlearn/MLRepository.html, 1998. University of California, Irvine, Department of Information and Computer Science.
14. J.R. Quinlan, C4.5: Programs For Machine Learning, Morgan Kaufmann, San Mateo, California, 1993.
15. E. Rahm and H. Do, Data cleaning: Problems and current approaches. Bulletin of the Technical Committee on Data Engineering 23(4) (2000), 3-13.
16. SAS Institute, SAS/STAT User's Guide. SAS Institute Inc., 1992.
17. C.M. Teng, A comparison of noise handling techniques, In Proceedings of 14th International Florida Artificial Intelligence Research Symposium, Key West, FL, May 2001, 269-273.
18. J. Van Hulse, T.M. Khoshgoftaar and H. Huang, The pairwise attribute noise detection algorithm. Knowledge and Information Systems Journal, Special Issue on Mining Low Quality Data (2006), in press.
19. I. H. Witten and E. Frank, Data Mining: Practical Machine Learning Tools and Techniques with JAVA Implementations, Morgan Kaufmann, San Francisco, CA, 2000.
20. Y. Yang, X. Wu and X. Zhu, Dealing with predictive-but-unpredictable attributes in noisy data sources, In Proceedings of 8th European Conference on Principles and Practice of Knowledge Discovery in Databases, Pisa, Italy, 2004.
21. S. Zhong, T.M. Khoshgoftaar and N. Seliya, Analyzing software measurement data with clustering techniques, IEEE Intelligent Systems (March 2004), 22-29.
22. X. Zhu and X. Wu, Class noise vs attribute noise: A quantitative study of their impacts, Artificial Intelligence Review 22(3-4) (November 2004), 177-210.
23. X. Zhu and X. Wu, Cost-guided class noise handling for effective cost-sensitive learning, In 4th IEEE International Conference on Data Mining (ICDM 2004), November 2004, 297-304.