Empirical case studies in attribute noise detection

IEEE Transactions on Systems, Man and Cybernetics Part C: Applications and Reviews

Volumn 39, Issue 4, 2009, Pages 379-388

  Khoshgoftaar, Taghi M ^a   Van Hulse, Jason ^a  

^a Florida Atlantic Univ   (United States)

Author keywords

Attribute noise; Data cleaning; Data quality; Noise detection; Pairwise attribute noise detection algorithm (PANDA)

Indexed keywords

ATTRIBUTE NOISE; DATA CLEANING; DATA QUALITY; NOISE DETECTION; PAIRWISE ATTRIBUTE NOISE DETECTION ALGORITHM (PANDA);

INFORMATION MANAGEMENT; MINING; SIGNAL DETECTION;

DATA REDUCTION;

EID: 67649250004     PISSN: 10946977     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSMCC.2009.2013815     Document Type: Article

References (20)

1. C. E. Brodley and M. A. Friedl, "Identifying and eliminating mislabeled training instances," in Proc. 13th Nat. Conf. Artif. Intell., Portland, OR: AAAI Press, 1996, pp. 799-805.
2. C. E. Brodley and M. A. Friedl, "Identifying mislabeled training data," J. Artif. Intell. Res., vol. 11, pp. 131-167, 1999.
3. W. J. Conover, Practical Nonparametric Statistics, 2nd ed. New York: Wiley, 1971.
4. M. Dash and H. Liu, "Feature selection for classification," Intell. Data Anal., vol. 1, no. 3, pp. 131-156, 1997. [Online]. Available: citeseer.ist.psu.edu/dash97feature.html
5. N. E. Fenton and S. L. Pfleeger, Software Metrics: A Rigorous and Practical Approach, 2nd ed. Boston, MA: PWS-Kent ITP, 1997.
6. D. Gamberger, N. Lavrač, and S. Džeroski, "Noise elimination in inductive concept learning: A case study in medical diagnosis," in Proc. 7th Int. Workshop Algorithmic Learning Theory. Berlin, Germany: Springer-Verlag, 1999, pp. 199-212.
7. M.A.Hernandez and S. J. Stolfo, "Real-world data is dirty: Data cleansing and the merge/purge problem," Data Mining Knowl. Discov. vol. 2, no. 1, pp. 9-37, 1998.
8. E. S. Keeping, Introduction to Statistical Inference. New York: Dover, 1995.
9. T.M. Khoshgoftaar and E.B. Allen, "Classification of fault-prone software modules: Prior probabilities, costs and model evaluation," Empirical Softw. Eng., vol. 3, pp. 275-298, 1998.
10. T. M. Khoshgoftaar and N. Seliya, "The necessity of assuring quality in software measurement data," in Proc. 10th Int. Softw. Metrics Symp. Chicago, IL: IEEE Computer Society, Sep. 2004, pp. 119-130.
11. T. M. Khoshgoftaar and J. Van Hulse, "Empirical case studies in attribute noise detection," in Proc. IEEE Int. Conf. Inf. Reuse Integr., Las Vegas, NV, Aug. 2005, pp. 211-216.
12. T. M. Khoshgoftaar, S. Zhong, and V. Joshi, "Enhancing software quality estimation using ensemble-classifier based noise filtering," Intell. Data Anal.: Int. J., vol. 9, no. 1, pp. 3-27, 2005.
13. M. Lee, H. Lu, T. Ling, and Y. Ko, "Cleansing data for mining and warehousing," in Proc. 10th Int. Conf. Database Exp. Syst. Appl. (DEXA), Aug. 1999, pp. 751-760.
14. P. M. Murphy and D. W. Aha. (1998). "UCI repository of machine learning databases," Univ. California, Dept. Inf. Comput. Sci. [Online]. Available: http://www.ics.uci.edu/~mlearn/MLRepository.html
15. E. Rahm and H. Do, "Data cleaning: Problems and current approaches," Bull. Tech. Committee Data Eng., vol. 23, no. 4, pp. 3-13, 2000.
16. SAS Institute, SAS/STAT User's Guide. Cary, NC: SAS Institute Inc., 2004.
17. C. M. Teng, "Correcting noisy data," in Proc. 6th Int. Conf. Mach. Learning (ICML 1999), pp. 239-248.
18. J. Van Hulse, T. M. Khoshgoftaar, and H. Huang, "The pairwise attribute noise detection algorithm," Knowl. Inf. Syst. J., Spec. Issue Mining Low Qual. Data, vol. 11, no. 2, pp. 171-190, 2007.
19. X. Zhu and X. Wu, "Class noise vs attribute noise: A quantitative study of their impacts," Artif. Intell. Rev., vol. 22, no. 3-4, pp. 177-210, Nov. 2004.
20. X. Zhu and X. Wu, "Cost-guided class noise handling for effective cost-sensitive learning," in Proc. 4th IEEE Int. Conf. Data Mining (ICDM 2004), Nov., pp. 297-304.