Research on data quality and data cleaning: A survey

Ruan Jian Xue Bao/Journal of Software

Volumn 13, Issue 11, 2002, Pages 2076-2082

  Guo, Zhi Mao ^a   Zhou, Ao Ying ^a  

^a FUDAN UNIVERSITY   (China)

Author keywords

Data cleaning; Data cleaning framework; Data integration; Data quality; Duplicate record

Indexed keywords

CLASSIFICATION (OF INFORMATION); DATA MINING; MANAGEMENT INFORMATION SYSTEMS;

DATA CLEARING; DATA INTEGRATION; DATA QUALITY; DUPLICATE RECORDS; MEASUREMENT METRICS;

DATA PROCESSING;

EID: 0036879367     PISSN: 10009825     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (24)

1. Aebi, D., Perrochon, L. Towards improving data quality. In; Sarda, N.L., ed. Proceedings of the International Conference on Information Systems and Management of Data. Delhi, 1993. 273-281.
2. Wang, R.Y., Kon, H.B., Madnick, S.E. Data quality requirements analysis and modeling. In: Proceedings of the 9th International Conference on Data Engineering. Vienna: IEEE Computer Society, 1993. 670-677.
3. Rahm, E., Do, H.H. Data cleaning: problems and current approaches. IEEE Data Engineering Bulletin, 2000, 23(4): 3-13.
4. Galhardas, H., Florescu, D., Shasha, D., et al. AJAX: an extensible data cleaning tool. In: Chen, W.D., Naughton, J.F., Bernstein, P.A., eds. Proceedings of the 2000 ACM SIGMOD International Conference on Management of Data. Texas: ACM, 2000. 590.
5. Hernandez, M.A., Stolfo, S.J. Real-World data is dirty: data cleansing and the merge/purge problem. Data Mining and Knowledge Discovery, 1998, 2(1): 9-37.
6. Lee, M.L., Ling, T.W., Lu H.J., et al. Cleansing data for mining and warehousing. In: Bench-Capon, T., Soda, G., Tjoa, A.M., eds. Database and Expert Systems Applications. Florence: Springer, 1999. 751-760.
7. Monge A.E. Matching algorithm within a duplicate detection system. IEEE Data Engineering Bulletin, 2000, 23(4): 14-20.
8. Monge, A.E., Elkan, C. The field matching problem: algorithms and applications. In: Simoudis, E., Han, J.W., Fayyad, U., eds. Proceedings of the 2nd International Conference on Knowledge Discovery and Data Mining. Oregon; AAAI Press, 1996. 267-270.
9. Savasere, A., Omiecinski, E., Navathe, S.B. An efficient algorithm for mining association rules in large databases. In: Dayal, U., Gray, P., Nishio, S., eds. Proceedings of the 21st International Conference on Very Large Data Bases. Zurich: Morgan Kaufmann, 1995. 432-444.
10. Srikant, R., Agrawal, R. Mining Generalized Association Rules. In: Dayal, U., Gray, P., Nishio, S., eds. Proceedings of the 21st International Conference on Very Large Data Bases. Zurich: Morgan Kaufmann, 1995. 407-419.
11. Abiteboul, S., Cluet, S., Milo, T., et al. Tools for data translation and integration. IEEE Data Engineering Bulletin, 1999, 22(1): 3-8.
12. Milo, T., Zohar, S. Using schema matching to simplify heterogeneous data translation. In: Gupta, A., Shmueli, O., Widom, J., eds. Proceedings of the 24th International Conference on Very Large Data Bases. New York; Morgan Kaufmann, 1998. 122-133.
13. Lee, M.L., Ling, T.W., Low, W.L. IntelliClean: a knowledge-based intelligent data cleaner. In: Proceedings of the 6th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. Boston: ACM Press, 2000. 290-294.
14. Caruso, F., Cochinwala, M., Ganapathy, U., et al. Telcordia's database reconciliation and data quality analysis tool. In; Abbadi, A.E., Brodie, M.L., Chakravarthy, S., et al., eds. Proceedings of the 26th International Conference on Very Large Data Bases. Cairo: Morgan Kaufmann, 2000. 615-618.
15. Galhardas, H. Data cleaning and integration. 2001. http://aravel.inria.fr/-galharda/cleaning.html.
16. Galhardas, H., Floescu, D., Shasha, D., et al. Declarative data cleaning: language, model and algorithms. In: Apers, P., Atzeni, P., Ceri, S., et al. eds. Proceedings of the 27th International Conference on Very Large Data Bases. Roma: Morgan Kaufmann, 2001. 371-380.
17. Raman, V., Hellersterin, J. Potter's wheel: an interactive data cleaning system. In: Apers, P., Atzeni, P., Ceri, S., et al. eds. Proceedings of the 27th International Conference on Very Large Data Bases. Roma: Morgan Kaufmann, 2001. 381-390.
18. Hipp, J., Guntzer, U., Grimmer, U. Data quality mining: making a virtue of necessity. In: Workshop on Research Issues in Data Mining and Knowledge Discovery. Santa Barbara, 2001.
19. Borkar, V., Deshmukh, K., Sarawagi, S. Automatically extracting structure from free text addresses. IEEE Data Engineering Bulletin, 2000, 23(4): 27-32.
20. Hellerstein, J., Stonebraker, M., Caccia, R. Independent, open enterprise data integration. IEEE Data Engineering Bulletin, 1999, 22(1): 43-49.
21. Cohen, W. Integration of heterogeneous databases without common domains using queries based on textual similarity. In: Haas, L., Tiwary, A., eds. Proceedings of International Conference on Management of Data. Seattle: ACM Press, 1998. 201-212.
22. Qiu, Yue-feng, Tian, Zeng-ping, Ji, Wen-yun, et al. An efficient approach for detecting approximately duplicate database records, Chinese Journal of Computers, 2001, 24(1): 69-77 (in Chinese).
23. Yu, Rong-hua, Tian, Zeng-ping, Zhou, Ao-ying. A synthetical approach for detecting approximately duplicate database records of multi-language data. Computer Science, 2002, 29(1): 118-121 (in Chinese).
24. Buneman, P., Davidson, S., Fan, W., et al. Keys for XML. In: Proceedings of the 10th International World wide Web Conference. Hong Kong: ACM Press, 2001. 201-210.