Differential dependencies: Reasoning and discovery

ACM Transactions on Database Systems

Volumn 36, Issue 3, 2011, Pages

  Song, Shaoxu ^a   Chen, Lei ^a  

^a HONG KONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Hong Kong)

Author keywords

Data dependencies; Differential dependencies

Indexed keywords

DATA DEPENDENCIES; DATA PARTITION; DATA SETS; DIFFERENTIAL DEPENDENCIES; DIFFERENTIAL FUNCTIONS; EXPERIMENTAL EVALUATION; FORMAL DEFINITION; FUNCTIONAL DEPENDENCY; INFERENCE SYSTEMS; INTRINSIC HARDNESS; NUMERICAL VALUES; ORDER RELATION; PRACTICAL PROBLEMS; PRICE DIFFERENCE; PRUNING METHODS; QUERY OPTIMIZATION; REAL APPLICATIONS; REAL DATA SETS; RECORD LINKAGE;

CHARACTER RECOGNITION; DATA HANDLING; SEARCH ENGINES; SEMANTICS;

DIFFERENTIATION (CALCULUS);

EID: 80052365341     PISSN: 03625915     EISSN: 15574644     Source Type: Journal    
DOI: 10.1145/2000824.2000826     Document Type: Article

References (56)

1. ABITEBOUL, S., HULL, R., AND VIANU, V. 1995. Foundations of Databases. Addison-Wesley.
2. ARENAS, M., BERTOSSI, L. E., AND CHOMICKI, J. 1999. Consistent query answers in inconsistent databases. In Proceedings of the ACM SIGACT-SIGMOD-SIGART Symposium on Principles of Database Systems (PODS'99). 68-79.
3. ARMSTRONG, W. W. 1974. Dependency structures of data base relationships. In Proceedings of the IFIP Congress. 580-583.
4. ASPVALL, B., PLASS, M. F., AND TARJAN, R. E. 1979. A linear-time algorithm for testing the truth of certain quantified boolean formulas. Inf. Process. Lett. 8, 3, 121-123.
5. BITTON, D., MILLMAN, J., AND TORGERSEN, S. 1989. A feasibility and performance study of dependency inference. In Proceedings of the International Conference on Data Engineering (ICDE'89). 635-641.
6. BOHANNON, P., FAN, W., GEERT S. F., JIA, X., AND KEMENTSIETSIDIS, A. 2007. Conditional functional dependencies for data cleaning. In Proceedings of the International Conference on Data Engineering (ICDE'07). 746-755. (Pubitemid 47422078)
7. BRAVO, L., FAN, W., GEERTS, F., AND MA, S. 2008. Increasing the expressivity of conditional functional dependencies without extra complexity. In Proceedings of the International Conference on Data Engineering (ICDE'08). 516-525.
8. BRAVO, L., FAN, W., AND MA, S. 2007. Extending dependencies with conditions. In Proceedings of the International Conference on Very Large Databases (VLDB'07). 243-254.
9. CHAKRAVARTHY, U. S., GRANT, J., AND MINKER, J. 1990. Logic-Based approach to semantic query optimization. ACM Trans. Datab. Syst. 15, 2, 162-207. (Pubitemid 20718043)
10. CHAUDHURI , S., SARMA, A. D., GANTI, V., AND KAUSHIK, R. 2007. Leveraging aggregate constraints for deduplication. In Proceedings of the ACM SIGMOD International Conference on Management of Data. 437-448.
11. CHAZELLE, B. AND GUIBAS, L. J. 1986a. Fractional cascading: I. A data structuring technique. Algorithmica 1, 2, 133-162. (Pubitemid 17556682)
12. CHAZELLE, B. AND GUIBAS, L. J. 1986b. Fractional cascading: Ii. Applications. Algorithmica 1, 2, 163-191.
13. CHIANG, F. AND MILLER, R. J. 2008. Discovering data quality rules. Proc. VLDB 1, 1, 1166-1177.
14. CHOMICKI, J. AND MARCINKOWSKI, J. 2005. On the computational complexity of minimal-change integrity maintenance in relational databases. In Inconsistency Tolerance. 119-150.
15. CONG, G., FAN, W., GEERTS, F., JIA, X., AND MA, S. 2007. Improving data quality: Consistency and accuracy. In Proceedings of the International Conference on Very Large Databases (VLDB'07). 315-326.
16. DE BERG, M., CHEONG, O., VAN KREVELD, M., AND OVERMARS, M. 2008. Computational Geometry: Algorithms and Applications 3rd Ed. Springer.
17. DONG, J. AND HULL, R. 1982. Applying approximate order dependency to reduce indexing space. In Proceedings of the ACM SIGMOD International Conference on Management of Data. 119-127.
18. EL MAGARMID, A. K., IPEIROTIS, P. G., AND VERYKIOS, V. S. 2007. Duplicate record detection: A survey. IEEE Trans. Knowl. Data Engin. 19, 1, 1-16. (Pubitemid 44955773)
19. FAN, W. 2008. Dependencies revisited for improving data quality. In Proceedings of the ACM SIGACTSIGMOD- SIGART Symposium on Principles of Database Systems (PODS'08). 159-170.
20. FAN, W., GEERTS, F., JIA, X., AND KEMENTSIETSIDIS, A. 2008a. Conditional functional dependencies for capturing data inconsistencies. ACM Trans. Datab. Syst. 33, 2.
21. FAN, W., GEERTS, F., LAKSHMANAN, L. V. S., AND XIONG, M. 2009a. Discovering conditional functional dependencies. In Proceedings of the International Conference on Data Engineering (ICDE'09). 1231-1234.
22. FAN, W., LI, J., JIA, X., AND MA, S. 2009b. Reasoning about record matching rules. In Proceedings of the International Conference on Very Large Databases (VLDB'09).
23. FAN, W., MA, S., HU, Y., LIU, J., AND WU, Y. 2008b. Propagating functional dependencies with conditions. Proc. VLDB 1, 1, 391-407.
24. FLACH, P. A. AND SAVNIK, I. 1999. Database dependency discovery: A machine learning approach. Artif. Intell. Comm. 12, 3, 139-160. (Pubitemid 30506806)
25. FRANKLIN, M. J., HALEVY, A. Y., AND MAIER, D. 2005. From databases to dataspaces: A new abstraction for information management. SIGMOD Rec. 34, 4, 27-33. (Pubitemid 43152545)
26. GAREY, M. R. AND JOHNSON, D. S. 1979. Computers and Intractability: AGuide to the Theory ofNP-Completeness. W. H. Freeman.
27. GINSBURG, S. AND HULL, R. 1983a. Order dependency in the relational model. Theor. Comput. Sci. 26, 149-195.
28. GINSBURG, S. AND HULL, R. 1983b. Sort sets in the relational model. In Proceedings of the ACM SIGACTSIGMOD- SIGART Symposium on Principles of Database Systems (PODS'83). 332-339.
29. GINSBURG, S. AND HULL, R. 1986. Sort sets in the relational model. J. ACM 33, 3, 465-488.
30. GOLAB, L., KARLOFF, H. J., KORN, F., SAHA, A., AND SRIVASTAVA, D. 2009. Sequential dependencies. Proc. VLDB 2, 1, 574-585.
31. GOLAB, L., KARLOFF, H. J., KORN, F., SRIVASTAVA, D., AND YU, B. 2008. On generating near-optimal tableaux for conditional functional dependencies. Proc. VLDB 1, 1, 376-390.
32. GRAVANO, L., IPEIROTIS, P. G., JAGADISH, H. V., KOUDAS, N., MUTHUKRISHNAN, S., PIETARINEN, L., AND SRIVASTAVA, D. 2001. Using q-grams in a dbms for approximate string processing. IEEE Data Engin. Bull. 24, 4, 28-34.
33. HERNANDEZ, M. A. AND STOLFO, S. J. 1995. The merge/purge problem for large databases. In Proceedings of the ACM SIGMOD International Conference on Management of Data. 127-138.
34. HUHTALA, Y., KARKKAINEN, J., PORKKA, P., AND TOIVONEN, H. 1998. Efficient discovery of functional and approximate dependencies using partitions. In Proceedings of the International Conference on Data Engineering (ICDE'98). 392-401.
35. HUHTALA, Y., KARKKAINEN, J., PORKKA, P., AND TOIVONEN, H. 1999. Tane: An efficient algorithm for discovering functional and approximate dependencies. Comput. J. 42, 2, 100-111.
36. ILYAS, I . F., MARKL, V., HAAS, P. J., BROWN, P., AND ABOULNAGA, A. 2004. Cords: Automatic discovery of correlations and soft functional dependencies. In Proceedings of the ACM SIGMOD International Conference on Management of Data. 647-658.
37. KARP, R. M. 1972. Reducibility among combinatorial problems. In Complexity of Computer Computations, R. E. Miller and J. W. Thatcher Eds., Plenum Press, 85-103.
38. KIMURA, H., HUO, G., RASIN, A., MADDEN, S., AND ZDONIK, S. B. 2009. Correlation maps: A compressed access method for exploiting soft functional dependencies. Proc. VLDB 2, 1, 1222-1233.
39. KIVINEN, J. AND MANNILA, H. 1995. Approximate inference of functional dependencies from relations. Theor. Comput. Sci. 149, 1, 129-149.
40. KORN, F., MUTHUKRISHNAN, S., AND ZHU, Y. 2003. Checks and balances: Monitoring data quality problems in network traffic databases. In Proceedings of the International Conference on Very Large Databases (VLDB'03). 536-547.
41. KOUDAS, N., SAHA, A., SRIVASTAVA, D., AND VENKATASUBRAMANIAN, S. 2009. Metric functional dependencies. In Proceedings of the International Conference on Data Engineering (ICDE'09). 1275-1278.
42. KRAMER, S. AND PFAHRINGER, B. 1996. Efficient search for strong partial determinations. In Proceedings of the International SIGKDD Conference on Knowledge Discovery and Data Mining. 371-374.
43. LEVENE, M. AND LOIZOU, G. 1999. A Guided Tour of Relational Databases and Beyond. Springer.
44. LEVY, A. Y. AND SAGIV, Y. 1995. Semantic query optimization in datalog programs. In Proceedings of the ACM SIGACT-SIGMOD-SIGART Symposium on Principles of Database Systems (PODS'95). 163-173.
45. MANNILA, H. AND RAI HA, K.-J. 1987. Dependency inference. In Proceedings of the International Conference on Very Large Databases (VLDB'87). 155-158.
46. MANNILA, H. AND RAI HA, K.-J. 1989. Practical algorithms for finding prime attributes and testing normal forms. In Proceedings of the ACM SIGACT-SIGMOD-SIGART Symposium on Principles of Database Systems (PODS'89). 128-133.
47. MANNILA, H. AND RAI HA, K.-J. 1992. Design of Relational Databases. Addison-Wesley.
48. MANNILA, H. AND RAI HA, K.-J. 1994. Algorithms for inferring functional dependencies from relations. Data Knowl. Engin. 12, 1, 83-99.
49. NAVARRO, G. 2001. A guided tour to approximate string matching. ACM Comput. Surv. 33, 1, 31-88. (Pubitemid 33768480)
50. NG, W. 1999. Ordered functional dependencies in relational databases. Inf. Syst. 24, 7, 535-554.
51. NG, W. 2001. An extension of the relational data model to incorporate ordered domains. ACM Trans. Datab. Syst. 26, 3, 344-383.
52. PAPADIMITRIOU, C. H. AND STEIGLITZ, K. 1982. Combinatorial Optimization: Algorithms and Complexity. Prentice-Hall.
53. SCHLIMMER, J. C. 1993. Efficiently inducing determinations: A complete and systematic search algorithm that uses optimal pruning. In Proceedings of the International Conference on Machine Learning (ICML'93). 284-290.
54. WIJSEN, J. 1998. Reasoning about qualitative trends in databases. Inf. Syst. 23, 7, 463-487. (Pubitemid 128679829)
55. WIJSEN, J. 2001. Trends in databases: Reasoning and mining. IEEE Trans. Knowl. Data Engin. 13, 3, 426-438. (Pubitemid 32611043)
56. WYSS, C. M., GIANNELLA, C., AND ROBERTSON, E. L. 2001. Fastfds: A heuristic-driven, depth-first algorithm for mining functional dependencies from relation instances - extended abstract. In Proceedings of the International Conference on Data Warehousing and Knowledge Discovery (DaWaK'01). 101-110. (Pubitemid 33332758)