Proof positive and negative in data cleaning

Proceedings - International Conference on Data Engineering

Volumn 2015-May, Issue , 2015, Pages 18-29

  Interlandi, Matteo ^a   Tang, Nan ^a  

^a QATAR COMPUTING RESEARCH INSTITUTE   (Qatar)

Author keywords

[No Author keywords available]

Indexed keywords

DATA PROCESSING;

AUTOMATED METHODS; DATA CLEANING; DATA ERRORS; DATA VALUES; HARD DATA; INTEGRITY CONSTRAINTS; PROOF POSITIVES;

CLEANING;

EID: 84940824296     PISSN: 10844627     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDE.2015.7113269     Document Type: Conference Paper

References (35)

1. Dirty data costs the U. S. economy 3 trillion+ per year. http://www. ringlead. com/dirty-data-costs-economy-3-trillion/.
2. Firms full of dirty data. http://www. itpro. co. uk/ 609057/firms-full-ofdirty-data.
3. A. Arasu, S. Chaudhuri, and R. Kaushik. Learning string transformations from examples. PVLDB, 2009.
4. M. Arenas, L. E. Bertossi, and J. Chomicki. Consistent query answers in inconsistent databases. TPLP, 2003.
5. G. Beskales, I. F. Ilyas, and L. Golab. Sampling the repairs of functional dependency violations under hard constraints. PVLDB, 2010.
6. G. Beskales, M. A. Soliman, I. F. Ilyas, and S. Ben-David. Modeling and querying possible repairs in duplicate detection. In VLDB, 2009.
7. P. Bohannon, W. Fan, M. Flaster, and R. Rastogi. A cost-based model and effective heuristic for repairing constraints by value modification. In SIGMOD, 2005.
8. L. Bravo, W. Fan, and S. Ma. Extending dependencies with conditions. In VLDB, 2007.
9. W. A. Burkhard and R. M. Keller. Some approaches to best-match file searching. Commun. ACM, 16(4):230-236, 1973.
10. F. Chiang and R. J. Miller. Discovering data quality rules. PVLDB, 1(1), 2008.
11. J. Chomicki and J. Marcinkowski. Minimal-change integrity maintenance using tuple deletions. Inf. Comput., 2005.
12. X. Chu, I. Ilyas, and P. Papotti. Holistic data cleaning: Putting violations into context. In ICDE, 2013.
13. X. Chu, I. F. Ilyas, and P. Papotti. Discovering denial constraints. PVLDB, 6(13), 2013.
14. G. Cong, W. Fan, F. Geerts, X. Jia, and S. Ma. Improving data quality: Consistency and accuracy. In VLDB, 2007.
15. M. Dallachiesa, A. Ebaid, A. Eldawy, A. K. Elmagarmid, I. F. Ilyas, M. Ouzzani, and N. Tang. Nadeef: a commodity data cleaning system. In SIGMOD, 2013.
16. A. Ebaid, A. K. Elmagarmid, I. F. Ilyas, M. Ouzzani, J.-A. Quiané-Ruiz, N. Tang, and S. Yin. Nadeef: A generalized data cleaning system. PVLDB, 2013.
17. W. Fan. Dependencies revisited for improving data quality. In PODS, 2008.
18. W. Fan, F. Geerts, X. Jia, and A. Kementsietsidis. Conditional functional dependencies for capturing data inconsistencies. TODS, 2008.
19. W. Fan, F. Geerts, J. Li, and M. Xiong. Discovering conditional functional dependencies. IEEE Trans. Knowl. Data Eng., 23(5), 2011.
20. W. Fan, F. Geerts, S. Ma, N. Tang, and W. Yu. Data quality problems beyond consistency and deduplication. In In Search of Elegance in the Theory and Practice of Computation-Essays Dedicated to Peter Buneman, 2013.
21. W. Fan, F. Geerts, N. Tang, and W. Yu. Inferring data currency and consistency for conflict resolution. In ICDE, 2013.
22. W. Fan, J. Li, S. Ma, N. Tang, and W. Yu. Interaction between record matching and data repairing. In SIGMOD, 2011.
23. W. Fan, J. Li, S. Ma, N. Tang, and W. Yu. Towards certain fixes with editing rules and master data. VLDB J., 2012.
24. I. Fellegi and D. Holt. A systematic approach to automatic edit and imputation. J. American Statistical Association, 1976.
25. F. Geerts, G. Mecca, P. Papotti, and D. Santoro. The LLUNATIC datacleaning framework. PVLDB, 6(9), 2013.
26. T. N. Herzog, F. J. Scheuren, and W. E. Winkler. Data Quality and Record Linkage Techniques. Springer, 2009.
27. S. Kolahi and L. Lakshmanan. On approximating optimum repairs for functional dependency violations. In ICDT, 2009.
28. C. Mayfield, J. Neville, and S. Prabhakar. ERACER: a database approach for statistical inference and data cleaning. In SIGMOD, 2010.
29. F. Naumann, A. Bilke, J. Bleiholder, and M. Weis. Data fusion in three steps: Resolving schema, tuple, and value inconsistencies. IEEE Data Eng. Bull., 2006.
30. B. S. T. Bocek, E. Hunt. Fast Similarity Search in Large Dictionaries. Technical Report ifi-2007. 02, Department of Informatics, University of Zurich, April 2007. http://fastss. csg. uzh. ch/.
31. N. Tang. Big data cleaning. In APWeb, 2014.
32. M. Volkovs, F. Chiang, J. Szlichta, and R. J. Miller. Continuous data cleaning. In ICDE, 2014.
33. J. Wang and N. Tang. Towards dependable data with fixing rules. In SIGMOD, 2014.
34. M. Yakout, L. Berti-Equille, and A. K. Elmagarmid. Don't be SCAREd: use SCalable Automatic REpairing with maximal likelihood and bounded changes. In SIGMOD, 2013.
35. M. Yakout, A. K. Elmagarmid, J. Neville, M. Ouzzani, and I. F. Ilyas. Guided data repair. PVLDB, 2011.