Combining quantitative and logical data cleaning

Proceedings of the VLDB Endowment

Volumn 9, Issue 4, 2016, Pages 300-311

  Prokoshyna, Nataliya ^a   Szlichta, Jaroslaw ^b   Chiang, Fei ^c   Miller, Reńee J ^a   Srivastava, Divesh ^d  

^a UNIVERSITY OF TORONTO   (Canada)

^b UNIVERSITY OF ONTARIO INSTITUTE OF TECHNOLOGY   (Canada)

^c MCMASTER UNIVERSITY   (Canada)

^d AT AND T LABS RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; CLEANING; QUALITY CONTROL; REPAIR; STATISTICS;

EARTH MOVER'S DISTANCE; EXPERIMENTAL EVALUATION; FUNCTIONAL DEPENDENCY; QUANTITATIVE APPROACH; QUANTITATIVE DATA; REPAIR TECHNIQUES; SOUND AND COMPLETE; STATISTICAL PROPERTIES;

COMPUTATIONAL EFFICIENCY;

EID: 84976473806     PISSN: None     EISSN: 21508097     Source Type: Conference Proceeding    
DOI: None     Document Type: Chapter

References (26)

1. M. Arenas, L. E. Bertossi, and J. Chomicki. Consistent query answers in inconsistent databases. In PODS, pages 68-79, 1999.
2. W. W. Armstrong. Dependency structures of data base relationships. In IFIP Congress, pages 580-583, 1974.
3. L. Berti-Equille, T. Dasu, and D. Srivastava. Discovery of complex glitch patterns: A novel approach to quantitative data cleaning. In ICDE, pages 733-744, 2011.
4. L. Bertossi, L. Bravo, E. Franconi, and A. Lopatenko. The complexity and approximation oxing numerical attributes in databases under integrity constraints. Information Systems, 33(4-5):407-434, 2008.
5. G. Beskales, I. F. Ilyas, and L. Golab. Sampling the repairs of functional dependency violations under hard constraints. PVLDB, 3(1):197-207, 2010.
6. P. Bohannon, W. Fan, F. Geerts, X. Jia, and A. Kementsietsidis. Conditional functional dependencies for data cleaning. In ICDE, pages 746-755, 2007.
7. P. Bohannon, M. Flaster, W. Fan, and R. Rastogi. A cost-based model and effiective heuristic for repairing constraints by value modication. In SIGMOD, pages 143-154, 2005.
8. F. Chiang and R. J. Miller. A unied model for data and constraint repair. In ICDE, pages 446-457, 2011.
9. T. Dasu and J. M. Loh. Statistical distortion: Consequences of data cleaning. PVLDB, 5(11):1674-1683, 2012.
10. W. Fan, X. Jia, J. Li, and S. Ma. Reasoning about record matching rules. PVLDB, 2(1):407-418, 2009.
11. Flights data. http://www.lunadong.com/fusionDataSets.htm.
12. H. Galhardas, D. Florescu, D. Shasha, E. Simon, and C. Saita. Declarative data cleaning: Language, model, and algorithms. In VLDB, pages 371-380, 2001.
13. L. Golab, H. Karlo, F.Korn, A. Saha, and D. Srivastava. Sequential dependencies. PVLDB, 2(1):574-585, 2009.
14. J. Hellerstein. Quantitative data cleaning for large databases. In Technical report, UC Berkeley, Feb 2008.
15. S. Kolahi and L. Lakshmanan. On approximating optimum repairs for functional dependency violations. In ICDT, pages 53-62, 2009.
16. N. Koudas, A. Saha, D. Srivastava, and S. Venkatasubramanian. Metric Functional Dependencies. In ICDE, pages 1291-1294, 2009.
17. O. Pele and M. Werman. A linear time histogram metric for improved SIFT matching. In Eur. Conf. on Computer Vision, pages 495-508, 2008.
18. O. Pele and M. Werman. Fast and robust earth mover's distances. In IEEE Int. Conf. on Computer Vision, pages 460-467, 2009.
19. N. Prokoshyna, J. Szlichta, F. Chiang, R. J. Miller, and D. Srivastava. Combining quantitative and logical data cleaning. April 2015. http://dblab.cs.toronto.edu/project/DataQuality.
20. S. Song and L. Chen. Differential dependencies: Reasoning and discovery. TODS, 36(3):16, 2011.
21. Y. Tang, L. H. U, Y. Cai, N. Mamoulis, and R. Cheng. Earth mover's distance based similarity search at scale. PVLDB, 7(4):313-324, 2013.
22. UIS Data Generator. http://www.cs.utexas.edu/users/ml/riddle/data.html.
23. M. Volkovs, F. Chiang, J. Szlichta, and R. J. Miller. Continuous data cleaning. In ICDE, pages 244-255, 2014.
24. X. Wang, X. L. Dong, and A. Meliou. Data x-ray: A diagnostic tool for data errors. In SIGMOD, pages 1231-1245, 2015.
25. M. Yakout, L. Berti-Equille, and A. K. Elmagarmid. Don't be SCAREd: use SCalable Automatic REpairing with maximal likelihood and bounded changes. In SIGMOD, pages 553-564, 2013.
26. M. Zhang, M. Hadjieleftheriou, B. C. Ooi, C. M. Procopiuc, and D. Srivastava. On multi-column foreign key discovery. PVLDB, 3(1):805-814, 2010.