On generating large-scale ground truth datasets for the deduplication of bibliographic records

ACM International Conference Proceeding Series

Volumn , Issue , 2012, Pages

  Hammerton, James A ^a   Granitzer, Michael ^b   Harvey, Dan ^c   Hristakeva, Maya ^d   Jack, Kris ^d  

^a Visual DNA   (United Kingdom)

^b UNIVERSITY OF PASSAU   (Germany)

^c State Ltd   (United Kingdom)

^d NONE

Author keywords

Bibliographic metadata; Fingerprinting; Near duplicate detection; Nearest neighbor search

Indexed keywords

AUTOMATED SYSTEMS; BIBLIOGRAPHIC RECORDS; DATA SETS; DEDUPLICATION; EXTERNAL SOURCES; FINGERPRINTING; GROUND TRUTH; LARGE SCALE DATA; NEAR-DUPLICATE DETECTION; NEAREST NEIGHBOR SEARCH; PERSONALISED RECOMMENDATIONS; RANDOM SAMPLING; RESEARCH PAPERS; SYSTEM'S PERFORMANCE;

AUTOMATION; METADATA; SEMANTIC WEB; SEMANTICS;

BIBLIOGRAPHIC RETRIEVAL SYSTEMS;

EID: 84863962421     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2254129.2254153     Document Type: Conference Paper

References (13)

1. M. Bilenko and R. Mooney. Adaptive duplicate detection using learnable string similarity measures. In Proceedings of the Ninth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pages 39-48. ACM New York, NY, USA, 2003.
2. M. Bilenko and R. Mooney. On evaluation and training-set construction for duplicate detection. In Proceedings of the KDD-2003 Workshop on Data Cleaning, Record Linkage, and Object Consolidation, pages 7-12, 2003.
3. M. Charikar. Similarity estimation techniques from rounding algorithms. Proceedings of the Thirty-Fourth Annual ACM Symposium on Theory of Computing, pages 380-388, 2002.
4. I. Councill, H. Li, Z. Zhuang, S. Debnath, L. Bolelli, W. Lee, A. Sivasubramaniam, and C. Giles. Learning metadata from the evidence in an on-line citation matching scheme. In Proceedings of the 6th ACM/IEEE-CS Joint Conference on Digital libraries, pages 276-285. ACM, 2006.
5. A. Elmagarmid, P. Ipeirotis, and V. Verykios. Duplicate record detection: A survey. IEEE Transactions on Knowledge and Data Engineering, 19(1):1-16, 2007.
6. H. Hajishirzi, W. Yih, and A. Kolcz. Adaptive near-duplicate detection via similarity learning. In Proceeding of the 33rd International ACM SIGIR Conference on Research and Development in information retrieval, pages 419-426. ACM, 2010.
7. S. Lawrence, C. L. Giles, and K. D. Bollacker. Autonomous citation matching. In Proceedings of the Third International Conference on Autonomous Agents. ACM Press, 1999.
8. S. Lawrence, L. C. Giles, and K. Bollacker. Digital libraries and autonomous citation indexing. IEEE Computer, 32(6):67-71, 1999.
9. G. Manku, A. Jain, and A. Sarma. Detecting near-duplicates for web crawling. In The 16th International Conference on World Wide Web, 2007.
10. H. Pasula, B. Marthi, B. Milch, S. Russell, and I. Shpitser. Identity uncertainty and citation matching. In Advances in Neural Information Processing Systems, pages 1425-1432, 2003.
11. S. Sarawagi and A. Bhamidipaty. Interactive deduplication using active learning. In Proceedings of the Eighth ACM SIGKDD International Conference on Knowledge Discovery and Datamining - KDD '02, page 269, New York, New York, USA, 2002. ACM Press.
12. R. Vernica, M. J. Carey, and C. Li. Efficient parallel set-similarity joins using mapreduce. In Proceedings of SIGMOD '10, pages 495-506. ACM Press, 2010.
13. C. Wang, J. Wang, X. Lin, W. Wang, H. Wang, H. Li, W. Tian, J. Xu, and R. Li. Mapdupreducer: detecting near duplicates over massive datasets. In Proceedings of the 2010 International Conference on Management of Data, pages 1119-1122. ACM, 2010.