Example-driven design of efficient record matching queries

33rd International Conference on Very Large Data Bases, VLDB 2007 - Conference Proceedings

Volumn , Issue , 2007, Pages 327-338

  Chaudhuri, Surajit ^a   Chen, Bee Chung ^b   Ganti, Venkatesh ^a   Kaushik, Raghav ^a  

^a MICROSOFT RESEARCH   (United States)

^b UNIVERSITY OF WISCONSIN MADISON   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

APPLICATION SCENARIO; APPROXIMATE STRING MATCHING; BUSINESS INTELLIGENCE APPLICATIONS; EXAMPLE-DRIVEN DESIGN; NEGATIVE EXAMPLES; NOCV1; PRIMITIVE OPERATOR; REAL-WORLD DATASETS; REAL-WORLD ENTITIES;

EID: 85011029434     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (38)

1. E. Agichtein and V. Ganti. Mining reference tables for automatic text segmentation. In Proceedings of ACM SIGKDD, 2004.
2. A. Arasu, V. Ganti, and R. Kaushik. Efficient exact set-similarity joins. In Proceedings of VLDB, 2006.
3. S. Argamon-Engelson and I. Dagan. Committee-based sample selection for probabilistic classifiers. Journal of Artificial Intelligence research, 1999.
4. R. Baxter, P. Christen, and T. Churches. A comparison of fast blocking methods for record linkage. In Proceedings of the 2003 ACM SIGKDD Workshop on Data Cleaning, Record Linkage, and Object Consolidation, 2003.
5. M. Bilenko. Learnable Similarity Functions and Their Application to Record Linkage and Clustering. PhD thesis, University of Texas at Austin, 2006.
6. M. Bilenko, B. Kamath, and R. J. Mooney. Adaptive blocking: Learning to scale up record linkage. In Proceedings of the 6th IEEE International Conference on Data Mining (ICDM-2006), 2006.
7. M. Bilenko and R. Mooney. Riddle: Repository of information on duplicate detection, record linkage, and identity uncertainty. http://www.cs.utexas.edu/users/ml/riddle.
8. M. Bilenko and R. Mooney. Adaptive duplicate detection using learnable string similarity measures. In Proceedings of ACM SIGKDD, 2003.
9. M. Bilenko and R. J. Mooney. On evaluation and training-set construction for duplicate detection. In Proceedings of the ACM SIGKDD workshop on data cleaning, record linkage, and object identification, 2003.
10. V. Borkar, K. Deshmukh, and S. Sarawagi. Automatic segmentation of text into structured records. In Proceedings of ACM SIGMOD, 2001.
11. S. Borzsonyi, D. Kossmann, and K. Stocker. The skyline operator. In Proceedings of ICDE, 2001.
12. S. Chaudhuri, K. Ganjam, V. Ganti, and R. Motwani. Robust and efficient fuzzy match for online data cleaning. In Proceedings of ACM SIGMOD, 2003.
13. S. Chaudhuri, V. Ganti, and R. Kaushik. A primitive operator for similarity joins in data cleaning. In Proceedings of ICDE, 2006.
14. W. Cohen. Integration of heterogeneous databases without common domains using queries based on textual similarity. In Proceedings of ACM SIGMOD, 1998.
15. W. W. Cohen. Data integration using similarity joins and a word-based information representation language. ACM Transactions on information systems, 2000.
16. W. W. Cohen and J. Richman. Learning to match and cluster large high-dimensional data sets for data integration. In Proceedings of the 8th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD-2002), 2002.
17. N. Cristianini and J. Shawe-Taylor. An Introduction to Support Vector Machines and other kernel-based learning methods. Cambridge University Press, 2000.
18. A. Doan, R. Ramakrishnan, and S. Vaithyanathan. Managing information extraction. In Proceedings of ACM SIGMOD, 2006.
19. T. Dohzen, M. Pamuk, S.-W. Seong, J. Hammer, and M. Stonebraker. Data integration through transform reuse in the morpheus project. In Proceedings of ACM SIGMOD, 2006.
20. I. P. Felligi and A. B. Sunter. A theory for record linkage. Journal of the American Statistical Society, 1969.
21. H. Galhardas, D. Florescu, D. Shasha, E. Simon, and C. Saita. Declarative data cleaning: Language, model, and algorithms. In Proceedings of VLDB, 2001.
22. L. Gravano, P. G. Ipeirotis, H. V. Jagadish, N. Koudas, S. Muthukrishnan, and D. Srivastava. Approximate string joins in a database (almost) for free. In Proceedings of VLDB, 2001.
23. S. Guha, N. Koudas, A. Marathe, and D. Srivastava. Merging the results of approximate match operations. In Proceedings of VLDB, 2004.
24. M. Hernandez and S. Stolfo. The merge/purge problem for large databases. In Proceedings of ACM SIGMOD, 1995.
25. D. S. Hochbaum. Approximation algorithms for NP-hard problems. PWS Publishing Company, 1997.
26. N. Koudas, A. Marathe, and D. Srivastava. Flexible string matching against large databases in practice. In Proceedings of VLDB, 2004.
27. N. Koudas, S. Sarawagi, and D. Srivastava. Record linkage: Similarity measures and algorithms. In Proceedings of ACM SIGMOD, 2006.
28. A. K. McCallum, K. Nigam, and L. Ungar. Efficient clustering of high-dimensional data sets with application to reference matching. In Proceedings of the 6th International Conference On Knowledge Discovery and Data Mining (KDD-2000), 2000.
29. M. Michelson and C. Knoblock. Learning blocking schemes for record linkage. In Proceedings of the 21st National Conference on Artificial Intelligence (AAAI), 2006.
30. V. Raman and J. Hellerstein. An interactive framework for data cleaning. Technical report, Univeristy of California, Berkeley, 2000.
31. S. Sarawagi and A. Bhamidipaty. Interactive deduplication using active learning. In Proceedings of ACM SIGKDD, 2002.
32. S. Sarawagi and A. Kirpal. Scaling up the alias duplicate elimination system: a demonstration. In Proceedings of ICDE, 2003.
33. S. Sarawagi and A. Kirpal. Efficient set joins on similarity predicates. In Proceedings of ACM SIGMOD, 2004.
34. T. Software. www.trilliumsoft.com/trilliumsoft.nsf.
35. D. Taft. Microsoft brings.net to katrina relief effort. http://www.eweek.com/article2/0,1895,1855722,00.asp, 2005.
36. S. Tejada, C. Knoblock, and S. Minton. Learning domain-independent string transformation weights for high accuracy object identification. In Proceedings of ACM SIGKDD, 2002.
37. S. Tejada, C. A. Knoblock, and S. Minton. Learning object identification rules for information integration. Information Systems, 2001.
38. A. Thor and E. Rahm. Moma - a mapping based object matching system. In Biennial Conf. on Innovative Data Systems Research, 2007.