Pay-as-you-go entity resolution

IEEE Transactions on Knowledge and Data Engineering

Volumn 25, Issue 5, 2013, Pages 1111-1124

  Whang, Steven Euijong ^a   Marmaros, David ^a   Garcia Molina, Hector ^b  

^a GOOGLE INC   (United States)

^b Stanford University   (United States)

Author keywords

data cleaning; Entity resolution; pay as you go

Indexed keywords

DATA CLEANING; ENTITY RESOLUTIONS; LARGE DATASETS; PAY-AS-YOU-GO; REAL DATA SETS; REAL-TIME APPLICATION; REAL-WORLD ENTITIES;

COMPUTATIONAL METHODS; INFORMATION SYSTEMS;

INFORMATION USE;

EID: 84875710164     PISSN: 10414347     EISSN: None     Source Type: Journal    
DOI: 10.1109/TKDE.2012.43     Document Type: Article

References (18)

1. A.K. Elmagarmid, P.G. Ipeirotis, and V.S. Verykios, "Duplicate Record Detection: A Survey," IEEE Trans. Knowledge Data Eng., vol. 19, no. 1, pp. 1-16, Jan. 2007. (Pubitemid 44955773)
2. A.K. Jain, M.N. Murty, and P.J. Flynn, "Data Clustering: A Review," ACM Computing Surveys, vol. 31, no. 3, pp. 264-323, 1999.
3. H.B. Newcombe and J.M. Kennedy, "Record Linkage: Making Maximum Use of the Discriminating Power of Identifying Information," Comm. ACM, vol. 5, no. 11, pp. 563-566, 1962.
4. M.A. Hernandez and S.J. Stolfo, "The Merge/Purge Problem for Large Databases," Proc. ACM SIGMOD Int'l Conf. Management of Data, pp. 127-138, 1995.
5. A.K. McCallum, K. Nigam, and L. Ungar, "Efficient Clustering of High-Dimensional Data Sets with Application to Reference Matching," Proc. ACM Sixth SIGKDD Int'l Conf. Knowledge Discovery and Data Mining, pp. 169-178, 2000.
6. A. Gionis, P. Indyk, and R. Motwani, "Similarity Search in High Dimensions via Hashing," Proc. 25th Int'l Conf. Very Large Databases (VLDB), pp. 518-529, 1999.
7. S.E. Whang, D. Marmaros, and H. Garcia-Molina, "Pay-As-You-Go Entity Resolution," technical report, Stanford Univ., available at http://ilpubs.stanford.edu:8090/979/, 2012.
8. C.D. Manning, P. Raghavan, and H. Schü tze, Introduction to Information Retrieval. Cambridge Univ. Press, 2008.
9. O. Benjelloun, H. Garcia-Molina, D. Menestrina, Q. Su, S.E. Whang, and J. Widom, "Swoosh: A Generic Approach to Entity Resolution," VLDB J., vol. 18, no. 1, pp. 255-276, 2009.
10. W. Winkler, "Overview of Record Linkage and Current Research Directions," technical report, US Bureau of the Census, Washington, DC, 2006.
11. P. Indyk, "A Small Approximately Min-Wise Independent Family of Hash Functions," J. Algorithms, vol. 38, no. 1, pp. 84-90, 2001. (Pubitemid 33667201)
12. A. Arasu, V. Ganti, and R. Kaushik, "Efficient Exact Set-Similarity Joins," Proc. 32nd Int'l Conf. Very Large Data Bases (VLDB), pp. 918-929, 2006.
13. W.W. Cohen, "Data Integration Using Similarity Joins and a Word-Based Information Representation Language," ACM Trans. Information Systems, vol. 18, no. 3, pp. 288-321, 2000.
14. X. Dong, A.Y. Halevy, and J. Madhavan, "Reference Reconciliation in Complex Information Spaces," Proc. ACM SIGMOD Int'l Conf. Management of Data, pp. 85-96, 2005. (Pubitemid 43038919)
15. M. Weis and F. Naumann, "Detecting Duplicates in Complex XML Data," Proc. 22nd Int'l Conf. Data Eng. (ICDE), p. 109, 2006. (Pubitemid 44539901)
16. O. Hassanzadeh, F. Chiang, R.J. Miller, and H.C. Lee, "Framework for Evaluating Clustering Algorithms in Duplicate Detection," Proc. VLDB Endowment, vol. 2, no. 1, pp. 1282-1293, 2009.
17. J. Madhavan, S. Cohen, X.L. Dong, A.Y. Halevy, S.R. Jeffery, D. Ko, and C. Yu, "Web-Scale Data Integration: You Can Afford to Pay As You Go," Proc. Conf. Innovative Data Systems Research (CIDR), pp. 342-350, 2007.
18. S.R. Jeffery, M.J. Franklin, and A.Y. Halevy, "Pay-As-You-Go User Feedback for Dataspace Systems," Proc. ACM SIGMOD Int'l Conf. Management of Data, pp. 847-860, 2008.