Efficient Determination of Distance Thresholds for Differential Dependencies

IEEE Transactions on Knowledge and Data Engineering

Volumn 26, Issue 9, 2014, Pages 2179-2192

  Song, Shaoxu ^a   Chen, Lei ^b   Cheng, Hong ^c  

^a BEIJING UNIVERSITY OF POSTS AND TELECOMMUNICATIONS   (China)

^b HONG KONG UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Hong Kong)

^c CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Data mining; Database Applications; Database Management; Information Technology and Systems; Relational databases; Systems

Indexed keywords

ALGORITHMS; COMPUTER SYSTEMS; DATA MINING; RELATIONAL DATABASE SYSTEMS;

DATABASE APPLICATIONS; DATABASE MANAGEMENT; DISTANCE CONSTRAINTS; EFFECTIVENESS AND EFFICIENCIES; EXPERIMENTAL EVALUATION; EXPERIMENTAL VERIFICATION; INFORMATION TECHNOLOGY AND SYSTEMS; RELATIONAL DATABASE;

INFORMATION MANAGEMENT;

EID: 84959504218     PISSN: 10414347     EISSN: None     Source Type: Journal    
DOI: 10.1109/TKDE.2013.84     Document Type: Article

References (39)

1. S. Song and L. Chen, "Differential dependencies: Reasoning and discovery," ACM TODS, vol. 36, no. 3, Article 16, 2011.
2. C. Batini and M. Scannapieco, Data Quality: Concepts, Methodologies and Techniques. Berlin, Germany: Springer, 2006.
3. P. Bohannon, W. Fan, F. Geerts, X. Jia, and A. Kementsietsidis, "Conditional functional dependencies for data cleaning," in Proc. IEEE 23rd ICDE, Istanbul, Turkey, 2007, pp. 746-755.
4. W. Fan, "Dependencies revisited for improving data quality," in Proc. 27th PODS, Vancouver, BC, Canada, 2008, pp. 159-170.
5. G. Cong, W. Fan, F. Geerts, X. Jia, and S. Ma, "Improving data quality: Consistency and accuracy," in Proc. 33rd Int. Conf. VLDB, Vienna, Austria, 2007, pp. 315-326.
6. M. Bilenko, R. J. Mooney, W. W. Cohen, P. Ravikumar, and S. E. Fienberg, "Adaptive name matching in information integration," IEEE Intell. Syst., vol. 18, no. 5, pp. 16-23, Sept. 2003.
7. N. Koudas, A. Saha, D. Srivastava, and S. Venkatasubramanian, "Metric functional dependencies," in Proc. IEEE 25th ICDE, Shanghai, China, 2009, pp. 1275-1278.
8. W. Fan, J. Li, X. Jia, and S. Ma, "Reasoning about record matching rules," PVLDB, vol. 2, no. 1, pp. 407-418, 2009.
9. Y. Huhtala, J. Kärkkäinen, P. Porkka, and H. Toivonen, "Tane: An efficient algorithm for discovering functional and approximate dependencies," Comput. J., vol. 42, no. 2, pp. 100-111, 1999.
10. J. Kivinen and H. Mannila, "Approximate inference of functional dependencies from relations," Theor. Comput. Sci., vol. 149, no. 1, pp. 129-149, 1995.
11. T. Calders, R. T. Ng, and J. Wijsen, "Searching for dependencies at multiple abstraction levels," ACM TODS, vol. 27, no. 3, pp. 229-260, 2002.
12. R. Bassée and J. Wijsen, "Neighborhood dependencies for prediction," in Proc. 5th PAKDD, Hong Kong, China, 2001, pp. 562-567.
13. F. Korn, S. Muthukrishnan, and Y. Zhu, "Checks and balances: Monitoring data quality problems in network traffic databases," in Proc. 29th Int. Conf. VLDB, Berlin, Germany, 2003, pp. 536-547.
14. R. Belohlávek and V. Vychodil, "Data tables with similarity relations: Functional dependencies, complete rules and nonredundant bases," in Proc. DASFAA, Singapore, 2006, pp. 644-658.
15. W. Fan, H. Gao, X. Jia, J. Li, and S. Ma, "Dynamic constraints for record matching," VLDB J., Vol. 20, no. 4, pp. 1-26, 2010.
16. S. Song, L. Chen, and P. S. Yu, "On data dependencies in dataspaces," in Proc. IEEE 27th ICDE, Hannover, Germany, 2011, pp. 470-481.
17. L. Golab, H. J. Karloff, F. Korn, A. Saha, and D. Srivastava, "Sequential dependencies," PVLDB, vol. 2, no. 1, pp. 574-585, 2009.
18. H. Mannila and K.-J. Räihä, "Algorithms for inferring functional dependencies from relations," Data Knowl. Eng., vol. 12, no. 1, pp. 83-99, 1994.
19. J. C. Schlimmer, "Efficiently inducing determinations: A complete and systematic search algorithm that uses optimal pruning," in Proc. ICML, Amherst, MA, USA, 1993, pp. 284-290.
20. S. Kramer and B. Pfahringer, "Efficient search for strong partial determinations," in Proc. KDD, 1996, pp. 371-374.
21. Y. Huhtala, J. Kärkkäinen, P. Porkka, and H. Toivonen, "Efficient discovery of functional and approximate dependencies using partitions," in Proc. 14th ICDE, Orlando, FL, USA, 1998, pp. 392-401.
22. C. M. Wyss, C. Giannella, and E. L. Robertson, "FastFDs: A heuristic-driven, depth-first algorithm for mining functional dependencies from relation instances - extended abstract," in Proc. DaWaK, Münich, Germany, 2001, pp. 101-110.
23. P. A. Flach and I. Savnik, "Database dependency discovery: A machine learning approach," AI Commun., vol. 12, no. 3, pp. 139-160, 1999.
24. W. Fan, F. Geerts, L. V. S. Lakshmanan, and M. Xiong, "Discovering conditional functional dependencies," in Proc. IEEE ICDE, Shanghai, China, 2009, pp. 1231-1234.
25. S. Song and L. Chen, "Discovering matching dependencies," in Proc. 18th CIKM, New York, NY, USA, 2009, pp. 1421-1424.
26. L. Golab, H. J. Karloff, F. Korn, D. Srivastava, and B. Yu, "On generating near-optimal tableaux for conditional functional dependencies," PVLDB, vol. 1, no. 1, pp. 376-390, 2008.
27. F. Chiang and R. J. Miller, "Discovering data quality rules," PVLDB, vol. 1, no. 1, pp. 1166-1177, 2008.
28. R. Agrawal, T. Imielinski, and A. N. Swami, "Mining association rules between sets of items in large databases," in Proc. SIGMOD, Washington, DC, USA, 1993, pp. 207-216.
29. J. Han, J. Wang, Y. Lu, and P. Tzvetkov, "Mining top-k frequent closed patterns without minimum support," in Proc. IEEE ICDM, Washington, DC, USA, 2002, pp. 211-218.
30. G. I. Webb and S. Zhang, "K-optimal rule discovery," Data Min. Knowl. Discov., vol. 10, no. 1, pp. 39-79, 2005.
31. T. Scheffer, "Finding association rules that trade support optimally against confidence," Intell. Data Anal., vol. 9, no. 4, pp. 381-395, 2005.
32. G. Navarro, "A guided tour to approximate string matching," ACM CSUR, vol. 33, no. 1, pp. 31-88, 2001.
33. W. W. Cohen, "Integration of heterogeneous databases without common domains using queries based on textual similarity," in Proc. SIGMOD, Washington, DC, USA, 1998, pp. 201-212.
34. R. Agrawal and R. Srikant, "Searching with numbers," in Proc. 11th Int. Conf. WWW, New York, NY, USA, 2002, pp. 420-431.
35. D. Montgomery and G. Runger, Applied Statistics and Probability for Engineers, 2nd ed. New York, NY, USA: Wiley, 1999.
36. T. Scheffer, "Average-case analysis of classification algorithms for Boolean functions and decision trees," in Proc. ALT, Sydney, NSW, Australia, 2000, pp. 194-208.
37. A. McCallum, K. Nigam, and L. H. Ungar, "Efficient clustering of high-dimensional data sets with application to reference matching," in Proc. KDD, New York, NY, USA, 2000, pp. 169-178.
38. L. Gravano et al., "Using q-grams in a DBMS for approximate string processing," IEEE Data Eng. Bull., vol. 24, no. 4, pp. 28-34, Dec. 2001.
39. C. J. van Rijsbergen, Information Retrieval. Boston, MA, USA: Butterworth, 1979.