Temporal rules discovery for web data cleaning

Proceedings of the VLDB Endowment

Volumn 9, Issue 4, 2016, Pages 336-347

  Abedjan, Ziawasch ^b   Akcora, Cuneyt G ^a   Ouzzani, Mourad ^a   Papotti, Paolo ^a   Stonebraker, Michael ^b  

^a QATAR COMPUTING RESEARCH INSTITUTE   (Qatar)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

LEARNING SYSTEMS;

ASSOCIATION MEASURES; CLEANING PROCESS; EXPERIMENTAL EVALUATION; FUNCTIONAL DEPENDENCY; MACHINE LEARNING METHODS; RECURRENT EVENTS; TEMPORAL RULES; TIME DIMENSION;

CLEANING;

EID: 84976512265     PISSN: None     EISSN: 21508097     Source Type: Journal    
DOI: 10.14778/2856318.2856328     Document Type: Article

References (33)

1. Z. Abedjan, P. Schulze, and F. Naumann., DFD: efficient functional dependency discovery. In CIKM, pages 949-958, 2014.
2. B. Alexe, M. Roth, and W.-C. Tan., Preference-aware integration of temporal data. PVLDB, 8(4):365-376, 2014.
3. G. Beskales, I. F. Ilyas, and L. Golab., Sampling the repairs of functional dependency violations under hard constraints. PVLDB, 3(1):197-207, 2010.
4. P. Bohannon, W. Fan, M. Flaster, and R. Rastogi., A cost-based model and effective heuristic for repairing constraints by value modification. In SIGMOD, pages 143-154, 2005.
5. P. Bohannon, W. Fan, F. Geerts, X. Jia, and A. Kementsietsidis., Conditional functional dependencies for data cleaning. In ICDE, pages 746-755, 2007.
6. G. Bouma., Normalized (pointwise) mutual information in collocation extraction. In GSCL, pages 31-40, 2009.
7. M. Bronzi, V. Crescenzi, P. Merialdo, and P. Papotti., Extraction and integration of partially overlapping web sources. PVLDB, 6(10):805-816, 2013.
8. F. Chiang and R. J. Miller., Discovering data quality rules. PVLDB, 1(1):1166-1177, 2008.
9. Y.-H. Chiang, A. Doan, and J. F. Naughton., Modeling entity evolution for temporal record matching. In SIGMOD, pages 1175-1186, 2014.
10. X. Chu, I. F. Ilyas, and P. Papotti., Holistic data cleaning: Putting violations into context. In ICDE, pages 458-469, 2013.
11. C. Combi, P. Parise, P. Sala, and G. Pozzi., Mining approximate temporal functional dependencies based on pure temporal grouping. In ICDMW, pages 258-265, 2013.
12. M. Dallachiesa, A. Ebaid, A. Eldawy, A. Elmagarmid, I. F. Ilyas, M. Ouzzani, and N. Tang., NADEEF: A Commodity Data Cleaning System. In SIGMOD, pages 541-552, 2013.
13. X. L. Dong, E. Gabrilovich, G. Heitz, W. Horn, K. Murphy, S. Sun, and W. Zhang., From data fusion to knowledge fusion. PVLDB, 7(10):881-892, 2014.
14. W. Fan, F. Geerts, J. Li, and M. Xiong., Discovering conditional functional dependencies. IEEE TKDE, 23(5):683-698, 2011.
15. A. Galland, S. Abiteboul, A. Marian, and P. Senellart., Corroborating information from disagreeing views. In WSDM, pages 131-140, 2010.
16. F. Geerts, G. Mecca, P. Papotti, and D. Santoro., The LLUNATIC data-cleaning framework. PVLDB, 6(9):625-636, 2013.
17. A. Gelman and J. Hill. Data analysis using regression and multilevel/hierarchical models. Cambridge U. Press, 2006.
18. M. Gupta, J. Gao, C. C. Aggarwal, and J. Han., Outlier Detection for Temporal Data. Synthesis Lectures on Data Mining and Knowledge Discovery. Morgan & Claypool Publishers, 2014.
19. Y. Huhtala, J. Kärkkäinen, P. Porkka, and H. Toivonen., TANE: An effcient algorithm for discovering functional and approximate dependencies. Comput. J., 42(2):100-111, 1999.
20. I. F. Ilyas, V. Markl, P. J. Haas, P. Brown, and A. Aboulnaga., CORDS: Automatic discovery of correlations and soft functional dependencies. In SIGMOD, pages 647-658, 2004.
21. C. S. Jensen, R. T. Snodgrass, and M. D. Soo., Extending existing dependency theory to temporal databases. IEEE Trans. Knowl. Data Eng., 8(4):563-582, 1996.
22. Z. Khayyat, I. F. Ilyas, A. Jindal, S. Madden, M. Ouzzani, P. Papotti, J.-A. Quiané-Ruiz, N. Tang, and S. Yin., Bigdansing: A system for big data cleansing. In SIGMOD, pages 1215-1230, 2015.
23. J. Kivinen and H. Mannila., Approximate inference of functional dependencies from relations. In ICDT, pages 129-149, 1995.
24. S. Kolahi and L. V. S. Lakshmanan., On approximating optimum repairs for functional dependency violations. In ICDT, pages 53-62, 2009.
25. F. Li, M. Lee, W. Hsu, and W. Tan., Linking temporal records for profiling entities. In SIGMOD, pages 593-605, 2015.
26. H. Li and N. Homer., A survey of sequence alignment algorithms for next-generation sequencing. Briefings in bioinformatics, 11(5):473-483, 2010.
27. P. Li, X. L. Dong, A. Maurino, and D. Srivastava., Linking temporal records. PVLDB, 4(11):956-967, 2011.
28. X. Li, X. L. Dong, K. Lyons, W. Meng, and D. Srivastava., Truth finding on the deep web: Is the problem solved? PVLDB, 6(2):97-108, 2012.
29. J. Pasternack and D. Roth., Making better informed trust decisions with generalized fact-finding. In IJCAI, pages 2324-2329, 2011.
30. S. Truvé., A white paper on temporal analytics. www.recordedfuture.com/assets/RF-White-Paper.pdf.
31. S. Song, L. Chen, and H. Cheng., Efficient determination of distance thresholds for differential dependencies. IEEE Trans. Knowl. Data Eng., 26(9):2179-2192, 2014.
32. C. M. Wyss, C. Giannella, and E. L. Robertson., FastFDs: A heuristic-driven, depth-first algorithm for mining functional dependencies from relation instances. In DaWaK, pages 101-110, 2001.
33. B. Zhao, B. I. Rubinstein, J. Gemmell, and J. Han., A bayesian approach to discovering truth from conicting sources for data integration. PVLDB, 5(6):550-561, 2012.