Continuous data cleaning

Proceedings - International Conference on Data Engineering

Volumn , Issue , 2014, Pages 244-255

  Volkovs, Maksims ^a   Chiang, Fei ^b   Szlichta, Jaroslaw ^a   Miller, Renée J ^a  

^a UNIVERSITY OF TORONTO   (Canada)

^b MCMASTER UNIVERSITY   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

ERRORS; SEMANTICS;

CONTINUOUS DATA; DATA CLEANING; DATA SEMANTICS; DATA STATISTICS; LOGICAL INFERENCE; PREDICTION ACCURACY; SINGLE SNAPSHOTS; UNIFIED APPROACH;

REPAIR;

EID: 84901814945     PISSN: 10844627     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDE.2014.6816655     Document Type: Conference Paper

References (29)

1. H. Galhardas, D. Florescu, D. Shasha, E. Simon, and C.-A. Saita, "Declarative data cleaning: Language, model, and algorithms," in VLDB, 2001, pp. 371-380.
2. L. Bertossi and L. Bravo, "Generic and declarative approaches to data quality management," Handbook of Data Quality-Research and Practice, pp. 181-211, 2013.
3. P. Bohannon, M. Flaster, W. Fan, and R. Rastogi, "A cost-based model and effective heuristic for repairing constraints by value modification," in SIGMOD, 2005, pp. 143-154.
4. M. Dallachiesa, A. Ebaid, A. Eldawy, A. Elmagarmid, I. F. Ilyas, M. Ouzzani, and N. Tang, "NADEEF: A commodity data cleaning system," in SIGMOD, 2013, pp. 541-552.
5. G. Cong, W. Fan, F. Geerts, X. Jia, and S. Ma, "Improving data quality: Consistency and accuracy," in VLDB, 2007, pp. 315-326.
6. W. Fan, "Constraint-driven database repair," in Encyclopedia of Database Systems, L. Liu and M. T. Ö zsu, Eds. Springer US, 2009, pp. 458-463.
7. F. Geerts, G. Mecca, P. Papotti, and D. Santoro, "The LLUNATIC data-cleaning framework," PVLDB, vol. 6, no. 9, pp. 625-636, 2013.
8. S. Kolahi and L. V. S. Lakshmanan, "On approximating optimum repairs for functional dependency violations," in ICDT, 2009, pp. 53-62.
9. M. Yakout, A. K. Elmagarmid, J. Neville, M. Ouzzani, and I. F. Ilyas, "Guided data repair," PVLDB, vol. 4, no. 5, pp. 279-289, 2011.
10. A. Arasu, C. Ré, and D. Suciu, "Large-scale deduplication with constraints using dedupalog," in ICDE, 2009, pp. 952-963.
11. F. Chiang and R. J. Miller, "A unified model for data and constraint repair," in ICDE, 2011, pp. 446-457.
12. G. Beskales, I. F. Ilyas, L. Golab, and A. Galiullin, "On the relative trust between inconsistent data and inaccurate constraints," in ICDE, 2013, pp. 541-552.
13. G. Beskales, I. F. Ilyas, and L. Golab, "Sampling the repairs of functional dependency violations under hard constraints," in PVLDB, 2010, pp. 197-207.
14. W. Fan, J. Li, S. Ma, N. Tang, and W. Yu, "Interaction between record matching and data repairing." in SIGMOD, 2011, pp. 469-480.
15. C. Mayfield, J. Neville, and S. Prabhakar, "ERACER: a database approach for statistical inference and data cleaning," in SIGMOD, 2010, pp. 75-86. ́
16. M. Yakout, L. Berti-Equille, and A. K. Elmagarmid, "Don't be SCAREd: use SCalable Automatic REpairing with maximal likelihood and bounded changes," in ICDE, 2013, pp. 553-564.
17. F. Chiang and R. J. Miller, "Active repair of data quality rules," in IJIQ, 2011, pp. 174-188.
18. J. Rissanen, "Modeling by shortest data description," Automatica, vol. 14, no. 5, pp. 465-471, 1978.
19. X. Chu, I. F. Ilyas, and P. Papotti, "Holistic data cleaning: Putting violations into context," in ICDE, 2013, pp. 458-469.
20. L. Berti-Equille, T. Dasu, and D. Srivastava, "Discovery of complex glitch patterns: A novel approach to quantitative data cleaning," in ICDE, 2011, pp. 733-744.
21. "FDIC institution directory." [Online]. Available: https://explore.data.gov/Banking-Finance-and-Insurance/FDIC-Institution- Directory-ID-Insured-Insitution-D/sv8z-wqyy
22. "Green vehicle guide." [Online]. Available: https://explore.data.gov/Transportation/Green-Vehicle-Guide-Data-Downloads/ 9un4-5bz7
23. "Veterans of america dataset." [Online]. Available: http://mlr.cs.umass.edu/ml/databases/kddcup98/
24. O. Hassanzadeh, A. Kementsietsidis, L. Lim, R. J. Miller, and M. Wang, "Linkedct: A linked data space for clinical trials," CoRR, vol. abs/0908.0567, 2009.
25. S. Yeganeh, O. Hassanzadeh, and R. J. Miller, "Linking semistructred data on the web," in WebDB, 2011.
26. J. Szlichta, P. Godfrey, and J. Gryz, "Fundamentals of Order Dependencies," PVLDB, vol. 5, no. 11, pp. 1220-1231, 2012.
27. J. Szlichta, P. Godfrey, J. Gryz, and C. Zuzarte., "Expressiveness and Complexity of Order Dependencies," PVLDB, vol. 6, no. 14, pp. 1858-1869, 2013.
28. L. Golab, H. J. Karloff, F. Korn, and D. Srivastava, "Sequential Dependencies," PVLDB, vol. 2, no. 1, pp. 574-585, 2009.
29. C. Christodoulakis, C. Faloutsos, and R. J. Miller, "Voidwiz: Resolving incompleteness using network effects," in ICDE, 2014, 4 pages (System Demonstration).