Detecting inconsistencies in distributed data

Proceedings - International Conference on Data Engineering

Volumn , Issue , 2010, Pages 64-75

  Fan, Wenfei ^a,b   Geerts, Floris ^a   Ma, Shuai ^a   Müller, Heiko ^a  

^a UNIVERSITY OF EDINBURGH   (United Kingdom)

^b Bell Laboratories UK   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

CENTRAL PROBLEMS; CENTRALIZED DATA-BASE; DATA QUALITY; DATA SHIPMENT; DETECTION PROBLEMS; DISTRIBUTED DATA; FUNCTIONAL DEPENDENCY; INCONSISTENCY DETECTION; NETWORK TRAFFIC; NP COMPLETE; OPTIMAL DETECTION; OPTIMIZATION PROBLEMS; RESPONSE TIME; SHIPPING DATA;

CRIME; OPTIMIZATION;

FREIGHT TRANSPORTATION;

EID: 77952749687     PISSN: 10844627     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDE.2010.5447855     Document Type: Conference Paper

References (33)

1. Gartner, "Forecast: Data quality tools, worldwide, 2006-2011," 2007.
2. W. Fan, F. Geerts, X. Jia, and A. Kementsietsidis, "Conditional functional dependencies for capturing data inconsistencies," TODS, vol. 33, no. 2, 2008.
3. M. T. Özsu and P. Valduriez, Principles of Distributed Database Systems (2nd edition). Prentice-Hall, 1999.
4. MySQL, http://dev.mysql.com/doc/refman/5.1/en/partitioning-limitations. html.
5. Oracle, http://download.oracle.com/docs/cd/B28359 01/server.111/b32024/ partition.htm.
6. Oracle, http://download.oracle.com/docs/cd/A87860 01/doc/server.817/ a76959/dt conc .htm#27231.
7. SQL Server, http://msdn.microsoft.com/en-us/library/ms178148.aspx.
8. M. Stonebraker et al, "C-store: A column-oriented DBMS," in VLDB, 2005.
9. A. Gupta, Y. Sagiv, J. D. Ullman, and J. Widom, "Constraint checking with partial information," in PODS, 1994.
10. A. Gupta and J. Widom, "Local verification of global integrity constraints in distributed databases," in SIGMOD, 1993.
11. N. Huyn, "Maintaining global integrity constraints in distributed databases," Constraints, vol. 2, no. 3/4, pp. 377-399, 1997.
12. B. Dahav and O. Etzion, "Distributed enforcement of integrity constraints," Distributed and Parallel Databases, vol. 13, no. 3, pp. 227-249, 2003.
13. C. Wang and M.-S. Chen, "On the complexity of distributed query optimization," TKDE, vol. 8, no. 4, pp. 650-662, 1996.
14. Full version, http://homepages.inf.ed.ac.uk/sma1/det.pdf.
15. M. Garey and D. Johnson, Computers and Intractability: A Guide to the Theory of NP-Completeness. W. H. Freeman and Company, 1979.
16. S. Abiteboul, R. Hull, and V. Vianu, Foundations of Databases. Addison-Wesley, 1995.
17. L. Bravo, W. Fan, F. Geerts, and S. Ma, "Increasing the expressivity of conditional functional dependencies without extra complexity," in ICDE, 2008.
18. L. Golab, H. Karloff, F. Korn, D. Srivastava, and B. Yu, "On generating near-optimal tableaux for conditional functional dependencies," in VLDB, 2008.
19. F. Chiang and R. Miller, "Discovering data quality rules," in VLDB, 2008.
20. G. Cong, W. Fan, F. Geerts, X. Jia, and S. Ma, "Improving data quality: Consistency and accuracy," in VLDB, 2007.
21. W. Fan, S. Ma, Y. Hu, J. Liu, and Y. Wu, "Propagating functional dependencies with conditions," in VLDB, 2008.
22. S. Agrawal, S. Deb, K. V. M. Naidu, and R. Rastogi, "Efficient detection of distributed constraint violations," in ICDE, 2007.
23. S. Chaudhuri, "An overview of query optimization in relational systems," in PODS, 1998.
24. D. Kossmann, "The state of the art in distributed query processing," ACM Comput. Surv., vol. 32, no. 4, pp. 422-469, 2000.
25. P. A. Bernstein and D.-M. W. Chiu, "Using semi-joins to solve relational queries," J. ACM, vol. 28, no. 1, pp. 25-40, 1981.
26. L. F. Mackert and G. M. Lohman, "R* optimizer validation and performance evaluation for distributed queries," in VLDB, 1986.
27. J. Li, A. Deshpande, and S. Khuller, "Minimizing communication cost in distributed multi-query processing," in ICDE, 2009.
28. D. DeHaan and F. W. Tompa, "Optimal top-down join enumeration," in SIGMOD, 2007.
29. G. Moerkotte and T. Neumann, "Dynamic programming strikes back," in SIGMOD, 2008.
30. X. Wang, R. C. Burns, A. Terzis, and A. Deshpande, "Network-aware join processing in global-scale database federations," in ICDE, 2008.
31. T. K. Sellis, "Multiple-query optimization," ACM Trans. Database Syst., vol. 13, no. 1, pp. 23-52, 1988.
32. P. Roy, S. Seshadri, S. Sudarshan, and S. Bhobe, "Efficient and extensible algorithms for multi query optimization," in SIGMOD, 2000.
33. A. Kementsietsidis, F. Neven, D. V. de Craen, and S. Vansummeren, "Scalable multi-query optimization for exploratory queries over federated scientific databases," in VLDB, 2008.