Automatic record linkage using seeded nearest neighbour and support vector machine classification

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn , Issue , 2008, Pages 151-159

  Christen, Peter ^a  

^a AUSTRALIAN NATIONAL UNIVERSITY   (Australia)

Author keywords

Data linkage; Data matching; Deduplication; Entity resolution; Nearest neighbour; Support vector machine

Indexed keywords

DATA LINKAGE; DATA MATCHING; DEDUPLICATION; ENTITY RESOLUTION; NEAREST NEIGHBOUR;

CLASSIFIERS; EDUCATION; IMAGE RETRIEVAL; KNOWLEDGE MANAGEMENT; LEARNING ALGORITHMS; MINING; SECURITY OF DATA; SUPERVISED LEARNING; VECTORS;

SUPPORT VECTOR MACHINES;

EID: 65449139594     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1401890.1401913     Document Type: Conference Paper

References (25)

1. R. Baxter, P. Christen, and T. Churches. A comparison of fast blocking methods for record linkage. In ACM KDD'03 workshop on Data Cleaning, Record Linkage and Object Consolidation, pages 25-27, Washington DC, 2003.
2. I. Bhattacharya and L. Getoor. Collective entity resolution in relational data. ACM Transactions on Knowledge Discovery from Data (TKDD), 1(1), 2007.
3. M. Bilenko and R. J. Mooney. Adaptive duplicate detection using learnable string similarity measures. In ACM KDD'03, pages 39-48, Washington DC, 2003.
4. C.-C. Chang and C-J. Lin. LIBSVM: A library for support vector machines. Manual, Department of Computer Science, National Taiwan University, 2001. Software available at: http://www.csie.ntu.edu.tw/~cjlin/libsvm.
5. P. Christen. Probabilistic data generation for deduplication and data linkage. In IDEAL'05, Springer LNCS 3578, pages 109-116, Brisbane, 2005.
6. P. Christen. A two-step classification approach to unsupervised record linkage. In AusDM'07, CRPIT vol. 70, pages 111-119, Gold Coast, Australia, 2007.
7. P. Christen. Automatic training example selection for scalable unsupervised record linkage. In PAKDD'08, Springer LNAI 5012, pages 511-518, Osaka, 2008.
8. P. Christen. Febrl - A freely available record linkage system with a graphical user interface. In HDKM'08, CRPIT vol. 80, Wollongong, Australia, 2008.
9. P. Christen and K. Goiser. Quality and complexity measures for data linkage and deduplication. In F. Guillet and H. Hamilton, editors, Quality Measures in Data Mining, volume 43 of Studies in Computational Intelligence. Springer, 2007.
10. T. Churches, P. Christen, K. Lim, and J. X. Zhu. Preparation of name and address data for record linkage using hidden Markov models. BioMed Central Medical Informatics and Decision Making, 2(9), 2002.
11. W. Cohen, P. Ravikumar, and S. Fienberg. A comparison of string distance metrics for name-matching tasks. In IJCAI'03 workshop on Information Integration on the Web (IIWeb-03), pages 73-78, Acapulco, 2003.
12. W. Cohen and J. Richman. Learning to match and cluster large high-dimensional data sets for data integration. In ACM KDD'02, pages 475-480, Edmonton, 2002.
13. M. Elfeky, V. Verykios, and A. Elmagarmid. TAILOR: A record linkage toolbox. In ICDE'02, pages 17-28, San Jose, 2002.
14. A. Elmagarmid, P. Ipeirotis, and V. Verykios. Duplicate record detection: A survey. IEEE Transactions on Knowledge and Data Engineering, 19(1):1-16, 2007.
15. I. Fellegi and A. Sunter. A theory for record linkage. Journal of the American Statistical Society, 64(328) :1183-1210, 1969.
16. K. Goiser and P. Christen. Towards automated record linkage. In AusDM'06, CRPIT vol. 61, pages 23-31, Sydney, 2006.
17. L. Gu and R. Baxter. Decision models for record linkage. In Selected Papers from AusDM, Springer LNCS 3755, pages 146-160, 2006.
18. J. Jonas and J. Harper. Effective counterterrorism and the limited role of predictive data mining. Policy Analysis, (584), 2006.
19. U. Y. Nahm, M. Bilenko, and R. J. Mooney. Two approaches to handling noisy variation in text mining. In TextML'02, pages 18-27, Sydney, 2002.
20. J. S. Sanchez, J. M. Sotoca, and F. Pla. Efficient nearest neighbor classification with data reduction and fast search algorithms. In IEEE International Conference on Systems, Man and Cybernetics, volume 5, pages 4757-4762, 2004.
21. S. Sarawagi and A. Bhamidipaty. Interactive deduplication using active learning. In ACM KDD'02, pages 269-278, Edmonton, 2002.
22. S. Tejada, C. Knoblock, and S. Minton. Learning domain-independent string transformation weights for high accuracy object identification. In ACM KDD'02, pages 350-359, Edmonton, 2002.
23. W. E. Winkler. Using the EM algorithm for weight computation in the Fellegi-Sunter model of record linkage. Technical Report RR2000/05, US Bureau of the Census, 2000.
24. W. E. Winkler. Methods for evaluating and creating data quality. Elsevier Information Systems, 29(7):531-550, 2004.
25. H. Yu, C. X. Zhai, and J. Han. Text classification from positive and unlabeled documents. In CIKM'03, pages 232-239, New Orleans, 2003.