NADEEF: A commodity data cleaning system

Proceedings of the ACM SIGMOD International Conference on Management of Data

Volumn , Issue , 2013, Pages 541-552

  Dallachiesat, Michele ^b   Ebaid, Amr ^c   Eldawy, Ahmed ^d   Elmagarmid, Ahmed ^a   Ilyas, Ihab F ^a   Ouzzani, Mourad ^a   Tang, Nan ^a  

^a QATAR COMPUTING RESEARCH INSTITUTE   (Qatar)

^b UNIVERSITY OF TRENTO   (Italy)

^c PURDUE UNIVERSITY   (United States)

^d UNIVERSITY OF MINNESOTA   (United States)

Author keywords

Conditional functional dependency; Data cleaning; ETL; Matching dependency

Indexed keywords

CONDITIONAL FUNCTIONAL DEPENDENCIES; DATA CLEANING; ETL; MATCHING DEPENDENCIES; PRE-DEFINED CLASS; PROGRAMMING INTERFACE; QUALITY CONSTRAINTS; REAL LIFE DATA;

ALGORITHMS; DATA REDUCTION;

REPAIR;

EID: 84880546390     PISSN: 07308078     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2463676.2465327     Document Type: Conference Paper

References (29)

1. M. Arenas, L. E. Bertossi, and J. Chomicki. Consistent query answers in inconsistent databases. TPLP, 3(4-5), 2003.
2. C. Batini and M. Scannapieco. Data Quality: Concepts, Methodologies and Techniques. Springer, 2006.
3. O. Benjelloun, H. Garcia-Molina, D. Menestrina, Q. Su, S. E. Whang, and J. Widom. Swoosh: a generic approach to entity resolution. VLDB J., 18(1), 2009.
4. A. Biere, M. Heule, H. van Maaren, and T. Walsh, editors. Handbook of Satisfiability, Volume 185 of Frontiers in Artificial Intelligence and Applications. IOS Press, 2009.
5. P. Bohannon, W. Fan, M. Flaster, and R. Rastogi. A cost-based model and effective heuristic for repairing constraints by value modification. In SIGMOD, 2005.
6. L. Bravo, W. Fan, F. Geerts, and S. Ma. Increasing the expressivity of conditional functional dependencies without extra complexity. In ICDE, 2008.
7. P. Christen. A survey of indexing techniques for scalable record linkage and deduplication. TKDE, 19(1), 2011.
8. G. Cong, W. Fan, F. Geerts, X. Jia, and S. Ma. Improving data quality: Consistency and accuracy. In VLDB, 2007.
9. M. G. Elfeky, A. K. Elmagarmid, and V. S. Verykios. Tailor: A record linkage tool box. In ICDE, 2002.
10. A. K. Elmagarmid, P. G. Ipeirotis, and V. S. Verykios. Duplicate record detection: A survey. TKDE, 19(1), 2007.
11. W. Fan. Dependencies revisited for improving data quality. In PODS, 2008.
12. W. Fan, F. Geerts, X. Jia, and A. Kementsietsidis. Conditional functional dependencies for capturing data inconsistencies. TODS, 33(2), 2008.
13. W. Fan, X. Jia, J. Li, and S. Ma. Reasoning about record matching rules. PVLDB, 2(1), 2009.
14. W. Fan, J. Li, S. Ma, N. Tang, and W. Yu. Interaction between record matching and data repairing. In SIGMOD Conference, 2011.
15. W. Fan, J. Li, S. Ma, N. Tang, and W. Yu. Towards certain fixes with editing rules and master data. VLDB J., 21(2), 2012.
16. I. Fellegi and D. Holt. A systematic approach to automatic edit and imputation. J. American Statistical Association, 71(353), 1976.
17. H. Galhardas, D. Florescu, D. Shasha, E. Simon, and C.-A. Saita. Declarative data cleaning: Language, model, and algorithms. In VLDB, 2001.
18. E. Giunchiglia and A. Tacchella, editors. Theory and Applications of Satisfiability Testing, SAT, 2004.
19. M. A. Hernandez and S. Stolfo. Real-World Data is Dirty: Data Cleansing and the Merge/Purge Problem. Data Mining and Knowledge Discovery, 2(1), 1998.
20. S. Kolahi and L. V. S. Lakshmanan. On approximating optimum repairs for functional dependency violations. In ICDT, 2009.
21. G. M. Kuper. Aggregation in constraint databases. In PPCP, 1993.
22. Y. S. Mahajan, Z. Fu, and S. Malik. Zchaff2004: An efficient sat solver. In SAT (Selected Papers), 2004.
23. C. Mayfield, J. Neville, and S. Prabhakar. ERACER: a database approach for statistical inference and data cleaning. In SIGMOD, 2010.
24. F. Naumann, A. Bilke, J. Bleiholder, and M. Weis. Data fusion in three steps: Resolving schema, tuple, and value inconsistencies. IEEE Data Eng. Bull., 29(2), 2006.
25. G. Papadakis, E. Ioannou, C. Niederée, T. Palpanas, and W. Nejdl. Beyond 100 million entities: large-scale blocking-based resolution for heterogeneous data. In WSDM, 2012.
26. V. Raman and J. M. Hellerstein. Potter's wheel: An interactive data cleaning system. In VLDB, 2001.
27. S. E. Whang, O. Benjelloun, and H. Garcia-Molina. Generic entity resolution with negative rules. VLDB J., 18(6), 2009.
28. J. Wijsen. Database repairing using updates. TODS, 30(3), 2005.
29. M. Yakout, A. K. Elmagarmid, J. Neville, M. Ouzzani, and I. F. Ilyas. Guided data repair. PVLDB, 4(5), 2011.