Conditional functional dependencies for capturing data inconsistencies

ACM Transactions on Database Systems

Volumn 33, Issue 2, 2008, Pages

  Fan, Wenfei ^a,d   Geerts, Floris ^b,d   Jia, Xibei ^b,d   Kementsietsidis, Anastasios ^c  

^a LUCENT TECHNOLOGIES   (United States)

^b UNIVERSITY OF EDINBURGH   (United Kingdom)

^c IBM T J WATSON RESEARCH CENTER   (United States)

^d School of Informatics   (United Kingdom)

Author keywords

Data cleaning; Functional dependency; SQL

Indexed keywords

(E ,2E) THEORY; CAPTURING DATA; CONSISTENCY PROBLEMS; CONSTRAINT VIOLATIONS; CONSTRAINT-BASED; DATA CLEANING; DATA QUALITY (DQ); DATABASE SCHEMA; FINITE DOMAINS; FUNCTIONAL DEPENDENCIES (FD); IMPLICATION PROBLEM; INCONSISTENCY DETECTION; INFERENCE SYSTEMS; INTEGRITY CONSTRAINTS (IC); MULTIPLE CONSTRAINTS; NOVEL TECHNIQUES; NP COMPLETE; RELATIONAL DATABASES; SCHEMA DESIGN; SINGLE QUERY; TIME COMPLEXITIES;

CONSTRAINT THEORY; NUCLEAR PROPULSION; QUALITY ASSURANCE; RELIABILITY; STATIC ANALYSIS;

DATABASE SYSTEMS;

EID: 46649106686     PISSN: 03625915     EISSN: 15574644     Source Type: Journal    
DOI: 10.1145/1366102.1366103     Document Type: Article

References (51)

1. ABITEBOUL, S., HULL, R., AND VIANU, V. 1995. Foundations of Databases. Addison-Wesley.
2. ARENAS, M., BERTOSSI, L. E., AND CHOMICKI, J. 2003. Consistent query answers in inconsistent databases. Theory Pract. Logic Program. 3, 4-5, 393-424.
3. ARMSTRONG, W. W. 1974. Dependency structures of data base relationships. In Proceedings of the IFIP World Computer Congress. 580-583.
4. BAUDINET, M., CHOMICKI, J., AND WOLPER, P. 1999. Constraint-generating dependencies. J. Comput. Syst. Sci. 59, 1, 94-115.
5. BEERI, C. AND BERNSTEIN, P. A. 1979. Computational problems related to the design of normal form relational schemas. ACM Trans. Data. Syst. 4, 1, 30-59.
6. BEERI, C. AND VARDI, M. 1984. A proof procedure for data dependencies. J. ACM 31, 4, 718-741.
7. BERTOSSI, L. AND CHOMICKI, J. 2003. Query answering in inconsistent databases. In Logics for Emerging Applications of Databases. 43-83.
8. BOHANNON, P., FAN, W., FLASTER, M., AND RASTOGI, R. 2005. A cost-based model and effective heuristic for repairing constraints by value modification. In Proceedings of the International Conference on Management of Data (SIGMOD). 143-154.
9. BOHANNON, P., FAN, W., GEERTS, F., JIA, X., AND KEMENTSIETSIDIS, A. 2007. Conditional functional dependencies for data cleaning. In Proceedings of the International Conference on Data Engineering (ICDE). 746-755.
10. BRA, P. D. AND PAREDAENS, J. 1983. Conditional dependencies for horizontal decompositions. In Colloquium on Automata, Languages and Programming. 67-82.
11. BRAVO, L. AND BERTOSSI, L. 2003. Logic programs for consistently querying data integration systems. In Proceedings of the International Joint Conference on Artificial Intelligence. 10-15.
12. BRAVO, L., FAN, W., GEERTS, F., AND MA, S. 2008. Increasing the expressivity of conditional functional dependencies without extra complexity. In Proceedings of the International Conference on Data Engineering (ICDE).
13. BRAVO, L., FAN, W., AND MA, S. 2007. Extending dependencies with conditions. In Proceedings of the International Conference on Very Large Databases (VLDB). 243-254.
14. BRUNI, R. AND SASSANO, A. 2001. Errors detection and correction in large scale data collecting. In Proceedings of the International Conference on Advances in Intelligent Data Analysis (IDA). 84-94.
15. CALI, A., LEMBO, D., AND ROSATI, R. 2003a. On the decidability and complexity of query answering over inconsistent and incomplete databases. In Proceedings of the Symposium on Principles of Database Systems (PODS). 260-271.
16. CALI, A., LEMBO, D., AND ROSATI, R. 2003b. Query rewriting and answering under constraints in data integration systems. In Proceedings of the International Joint Conference on Artificial Intelligence. 16-21.
17. CHOMICKI, J. AND MARCINKOWSKI, J. 2005a. Minimal-change integrity maintenance using tuple deletions. Inform. Comput. 197, 1-2, 90-121.
18. CHOMICKI, J. AND MARCINKOWSKI, J. 2005b. On the computational complexity of minimal-change integrity maintenance in relational databases. In Inconsistency Tolerance. 119-150.
19. CODD, E. F. 1972. Relational completeness of data base sublanguages. In Database Systems: Courant Computer Science Symposia Series 6. Prentice-Hall, 65-98.
20. CONG, G., FAN, W., GEERTS, F., JIA, X., AND Ma, S. 2007. Improving data quality: Consistency and accuracy. In Proceedings of the International Conference on Very Large Databases (VLDB). 315-326.
21. ECKERSON, W. W. 2002. Data quality and the bottom line: Achieving business success through a commitment to high quality data. Tech. rep., The Data Warehousing Institute. http://www.tdwi.org/research/display.aspx? ID=6064.
22. FELLEGI, I. AND HOLT, D. 1976. A systematic approach to automatic edit and imputation. J. Amer. Statist. Assn. 71, 353, 17-35.
23. FELLEGI, I. P. AND SUNTER, A. B. 1969. A theory for record linkage. J. Amer. Statist. Assn. 64, 328, 1183-1210.
24. FRANCONI, E., PALMA, A. L., LEONE, N., PERRI, S., AND SCARCELLO, F. 2001. Census data repair: a challenging application of disjunctive logic programming. In Proceedings of the Artificial Intelligence on Logic for Programming (LPAR). 561-578.
25. GALHARDAS, H., FLORESCU, D., SHASHA, D., AND SIMON, E. 2000. AJAX: An extensible data cleaning tool. In Proceedings of the International Conference on Management of Data (SIGMOD). 590.
26. GALHARDAS, H., FLORESCU, D., SHASHA, D., SIMON, E., AND SAITA, C.-A. 2001. Declarative data cleaning: Language, model and algorithms. In Proceedings of the International Conference on Very Large Databases (VLDB). 371-380.
27. GAREY, M. AND JOHNSON, D. 1979. Computers and Intractability: A Guide to the Theory of NP-Completeness. W. H. Freeman and Company.
28. GARFINKEL, R. S., KUNNATHUR, A. S., AND LIEPINS, G. E. 1986. Optimal imputation of erroneous data: Categorical data, general edits. Operat. Resear. 34, 5, 744-751.
29. GERTZ, M. AND LIPECK, U. 1995. A diagnostic approach to repairing constraint violations in databases. In Proceedings of the International Workshop on Principles of Diagnosis (DX). 65-72.
30. GRAHNE, G. 1991. The Problem of Incomplete Information in Relational Databases. Springer.
31. GRECO, G., GRECO, S., AND ZUMPANO, E. 2003. A logical framework for querying and repairing inconsistent databases. IEEE Trans. Knowl. Data Engin. 15, 6, 1389-1408.
32. HERNANDEZ, M. A. AND STOLFO, S. 1998. Real-world data is dirty: Data cleansing and the merge/purge problem. Data Min. Knowl. Discov. 2, 1, 9-37.
33. IMIELIŃSKI, T. AND LIPSKI JR, W. 1984. Incomplete information in relational databases. J. ACM 31, 4, 761-791.
34. LIM, E.-P., SRIVASTAVA, J., PRABHAKAR, S., AND RICHARDSON, J. 1996. Entity identification in database integration. Inform. Sci. 89, 1-2, 1-38.
35. MAHER, M. J. 1997. Constrained dependencies. Theor. Comput. Sci. 173, 1, 113-149.
36. MAHER, M. J. AND SRIVASTAVA, D. 1996. Chasing constrained tuple-generating dependencies. In Proceedings of the Symposium on Principles of Database Systems (PODS). 128-138.
37. MAIER, D. 1980. Minimum covers in relational database model. J. ACM 27, 4, 664-674.
38. MAIER, D. 1983. The Theory of Relational Databases. Computer Science Press.
39. MALETIC, J. I. AND MARCUS, A. 2000. Data cleansing: Beyond integrity analysis. In Proceedings of the Conference on Information Quality (IQ). 200-209.
40. MONGE, A. E. 2000. Matching algorithms within a duplicate detection system. IEEE Data Eng. Bull. 23, 4, 14-20.
41. PAPADIMITRIOU, C. H. 1994. Computational Complexity. Addison Wesley.
42. RAHM, E. AND Do, H. H. 2000. Data cleaning: Problems and current approaches. IEEE Data Eng. Bull. 23, 4, 3-13.
43. RAMAN, V. AND HELLERSTEIN, J. M. 2001. Potter's wheel: An interactive data cleaning system. In Proceedings of the International Conference on Very Large Databases (VLDB). 381-390.
44. SADRI, F. 1980. Data dependencies in the relational model of data: A generalization. PhD thesis, Princeton University.
45. SADRI, F. AND ULLMAN, J. 1982. Template dependencies: A large class of dependencies in relational databases and its complete axiomatization. J. ACM 29, 2, 363-372.
46. SHILAKES, C. C. AND TYLMAN, J. 1998. Enterprise information portals. Tech. rep., Merrill Lynch, Inc., New York, NY.
47. VAZIRANI, V. V. 2003. Approximation Algorithms. Springer.
48. WIJSEN, J. 2005. Database repairing using updates. ACM Trans. Datab. Syst. 30, 3, 722-768.
49. WINKLER, W. E. 1994. Advanced methods for record linkage. Tech. rep., Statistical Research Division, U.S. Bureau of the Census.
50. WINKLER, W. E. 1997. Set-covering and editing discrete data. In Proceedings of the American Statistical Association. Section on Survey Research Methods. 564-569.
51. WINKLER, W. E. 2004. Methods for evaluating and creating data quality. Infor. Syst. 29, 7, 531-550.