Interaction between record matching and data repairing

Proceedings of the ACM SIGMOD International Conference on Management of Data

Volumn , Issue , 2011, Pages 469-480

  Fan, Wenfei ^a,b   Li, Jianzhong ^b   Ma, Shuai ^c   Tang, Nan ^a   Yu, Wenyuan ^a  

^a UNIVERSITY OF EDINBURGH   (United Kingdom)

^b HARBIN INSTITUTE OF TECHNOLOGY   (China)

^c BEIHANG UNIVERSITY   (China)

Author keywords

conditional functional dependency; data cleaning; matching dependency

Indexed keywords

CLEANING; DATABASE SYSTEMS;

CLEANING SYSTEM; CONDITIONAL FUNCTIONAL DEPENDENCY; CURRENT DATA; DATA CLEANING; FUNCTIONAL DEPENDENCY; HEURISTIC SOLUTIONS; MATCHING DEPENDENCIES; MATCHINGS; REAL-WORLD OBJECTS; RECORD MATCHING;

REPAIR;

EID: 79959944062     PISSN: 07308078     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1989323.1989373     Document Type: Conference Paper

References (39)

1. S. Abiteboul, R. Hull, and V. Vianu. Foundations of Databases. Addison-Wesley, 1995.
2. A. Aiken, D. Kozen, M. Y. Vardi, and E. L.Wimmers. The complexity of set constraints. In CSL, 1993.
3. A. Arasu, C. Re, and D. Suciu. Large-scale deduplication with constraints using Dedupalog. In ICDE, 2009.
4. M. Arenas, L. E. Bertossi, and J. Chomicki. Consistent query answers in inconsistent databases. TPLP, 3(4-5), 2003.
5. G. Beskales, M. A. Soliman, I. F. Ilyas, and S. Ben-David. Modeling and querying possible repairs in duplicate detection. In VLDB, 2009.
6. P. Bohannon, W. Fan, M. Flaster, and R. Rastogi. A cost-based model and effective heuristic for repairing constraints by value modification. In SIGMOD, 2005.
7. S. Chaudhuri, K. Ganjam, V. Ganti, and R. Motwani. Robust and efficient fuzzy match for online data cleaning. In SIGMOD, 2003.
8. F. Chiang and R. Miller. Discovering data quality rules. In VLDB, 2008.
9. G. Cong, W. Fan, F. Geerts, X. Jia, and S. Ma. Improving data quality: Consistency and accuracy. In VLDB, 2007.
10. T. H. Cormen, C. E. Leiserson, R. L. Rivest, and C. Stein. Introduction to Algorithms. The MIT Press, 2001.
11. T. M. Cover and J. A. Thomas. Elements of Information Theory. Wiley-Interscience, 1991.
12. T. de Vries, H. Ke, S. Chawla, and P. Christen. Robust record linkage blocking using suffix arrays. In CIKM, 2009.
13. X. Dong, A. Y. Halevy, and J. Madhavan. Reference reconciliation in complex information spaces. In SIGMOD Conference, 2005.
14. X. L. Dong, L. Berti-Equille, Y. Hu, and D. Srivastava. Global detection of complex copying relationships between sources. In VLDB, 2010.
15. W. W. Eckerson. Data Quality and the Bottom Line: Achieving Business Success through a Commitment to High Quality Data. In The Data Warehousing Institute, 2002.
16. A. K. Elmagarmid, P. G. Ipeirotis, and V. S. Verykios. Duplicate record detection: A survey. TKDE, 19(1):1-16, 2007. (Pubitemid 44955773)
17. W. Fan, F. Geerts, X. Jia, and A. Kementsietsidis. Conditional functional dependencies for capturing data inconsistencies. TODS, 33(1), 2008.
18. W. Fan, X. Jia, J. Li, and S. Ma. Reasoning about record matching rules. In VLDB, 2009.
19. W. Fan, J. Li, S. Ma, N. Tang, and W. Yu. Towards certain fixes with editing rules and master data. In VLDB, 2010.
20. I. Fellegi and D. Holt. A systematic approach to automatic edit and imputation. J. American Statistical Association, 71(353):17-35, 1976.
21. Gartner. Forecast: Data quality tools, worldwide, 2006-2011. Technical report, Gartner, 2007.
22. S. Guo, X. Dong, D. Srivastava, and R. Zajac. Record linkage with uniqueness constraints and erroneous values. PVLDB, 3(1), 2010.
23. R. W. Hamming. Error detecting and error correcting codes. Bell System Technical Journal, 29(2):147-160, 1950.
24. M. A. Hernandez and S. Stolfo. Real-World Data is Dirty: Data Cleansing and the Merge/Purge Problem. Data Mining and Knowledge Discovery, 2(1):9-37, 1998. (Pubitemid 128696797)
25. T. N. Herzog, F. J. Scheuren, and W. E. Winkler. Data Quality and Record Linkage Techniques. Springer, 2009.
26. G. J. Klir and T. A. Folger. Fuzzy sets, uncertainty, and information. Englewood Cliffs, N.J: Prentice Hall, 1988.
27. D. Loshin. Master Data Management. Knowledge Integrity, Inc., 2009.
28. C. Mayfield, J. Neville, and S. Prabhakar. ERACER: a database approach for statistical inference and data cleaning. In SIGMOD, 2010.
29. F. Naumann, A. Bilke, J. Bleiholder, and M. Weis. Data fusion in three steps: Resolving schema, tuple, and value inconsistencies. IEEE Data Eng. Bull., 29(2), 2006.
30. B. Otto and K. Weber. From health checks to the seven sisters: The data quality journey at BT, Sept. 2009. BT TR-BE HSG/CC CDQ/8.
31. T. Redman. The impact of poor data quality on the typical enterprise. Commun. ACM, 2:79-82, 1998.
32. S. Song and L. Chen. Discovering matching dependencies. In CIKM, 2009.
33. D. Srivastava and S. Venkatasubramanian. Information theory for data management. In SIGMOD, 2010.
34. I. Wegener and R. Pruim. Complexity Theory: Exploring the Limits of Efficient Algorithms. Springer, 2005.
35. M. Weis and F. Naumann. Dogmatix tracks down duplicates in XML. In SIGMOD, 2005.
36. S. E. Whang, O. Benjelloun, and H. Garcia-Molina. Generic entity resolution with negative rules. VLDB J., 18(6), 2009.
37. J. Wijsen. Database repairing using updates. TODS, 30(3):722-768, 2005. (Pubitemid 43906382)
38. M. Yakout, A. K. Elmagarmid, J. Neville, and M. Ouzzani. GDR: a system for guided data repair. In SIGMOD, 2010.
39. J. Ziv and A. Lempel. Compression of individual sequences via variable-rate coding. IEEE TIT, 24(5), 1978.