An efficient data cleaning algorithm based on attributes selection

Proceedings - 6th International Conference on Computer Sciences and Convergence Information Technology, ICCIT 2011

Volumn , Issue , 2011, Pages 375-379

  He, Ling ^a   Zhang, Zhongnan ^a   Tan, Yize ^a   Liao, Minghong ^a  

^a XIAMEN UNIVERSITY   (China)

Author keywords

Approximately duplicate records; data cleaning; SNM

Indexed keywords

APPROXIMATELY DUPLICATE RECORD; DATA CLEANING; DATA INCONSISTENCIES; DATA VOLUME; MULTI-PASS; NEIGHBORHOOD METHODS; SNM;

ALGORITHMS; COMPUTER SCIENCE; DATA WAREHOUSES; INFORMATION TECHNOLOGY;

CLEANING;

EID: 84864109938     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (13)

1. Z. Guo and A. Zhou, "Research on Data Quality and Data Cleaning: a Survey," Journal of Software, vol. 13, 2002, pp. 2076-2082.
2. E. Rahm and H.H. Do, "Data cleaning: Problems and current approaches," IEEE Data Engineering Bulletin, vol. 23, 2000, pp. 3-13.
3. A.E. Monge, "Matching algorithm within a duplicate detection system," IEEE Data Engineering Bulletin, vol. 23, 2000, pp. 14-20.
4. M.A. Hernandez and S.J. Stolfo, "Real-world Data is Dirty: Data Cleansing and The Merge/Purge Problem," Journal of Data Mining and Knowledge Discovery, vol. 2, 1998, pp. 9-37.
5. J. Li and N. Zheng, "Improvement on the algorithm of data cleaning based on MPN," Computer Applications and Software, vol. 25, 2008, pp. 245-246.
6. Y. Qiu, Z. Tian, W. Ji, and A. Zhou, "An efficient approach for detecting approximately duplicate database records," Chinese Journal of Computers, vol. 24, 2001, pp. 69-77.
7. A.E. Monge and C.P. Elkan, "An efficient domain-independent algorithm for detecting approximately duplicate database records," In Proceeding of the ACM-SIGMOD Workshop on Data Mining and Knowledge Discovery. Tucson: ACM, 1997, pp. 23-29.
8. A.E. Monge and C.P. Elkan, "An efficient domain-independent algorithm for detecting approximately duplicate database records," University of California, 1997.
9. A.E. Monge and C.P. Elkan, "The field matching problem: algorithms and applications," Proceedings of the 2nd International Conference on Knowledge Discovery and Data Mining. Oregon: AAAI Press, 1996, pp. 267-270.
10. K. Karadimitriou and J.M. Tyler, "The centroid method for compressing sets of similar images," Pattern Recognition Letters 19, 1998, pp. 585-593.
11. M.A. Hernandez and S.J. Stolfo, "The Merge/Purge Problem for Large Databases," In Proceedings of the ACM-SIGMOD International Conference on Management of Data, San Jose, California, 1995, pp. 127-138.
12. T.F. Smith and M.S. Waterman, "Identification of Common Molecular Subsequences," Journal of Molecular Biology, vol. 147, 1981, pp. 195-197.
13. A. Pudjijono, "Probabilistic Data Generation," Master Thesis, Australian National University, 2008.