A two-step classification approach to unsupervised record linkage

Conferences in Research and Practice in Information Technology Series

Volumn 70, Issue , 2007, Pages 111-119

  Christen, Peter ^a  

^a AUSTRALIAN NATIONAL UNIVERSITY   (Australia)

Author keywords

Clustering; Data linkage; Data matching; Deduplication; Entity resolution; Quality measures; Support vector machines

Indexed keywords

CLUSTERING; DATA LINKAGE; DATA MATCHING; DEDUPLICATION; QUALITY MEASURES;

DATA HANDLING; DATA MINING; LEARNING SYSTEMS; SUPPORT VECTOR MACHINES;

CLASSIFICATION (OF INFORMATION);

EID: 44649135932     PISSN: 14451336     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Article

References (34)

1. Basu, S., Banerjee, A. & Mooney, R.J. (2002), Semisupervised clustering by seeding, in 'International Conference on Machine Learning' (ICML'02), Sydney, Australia, pp. 19-26.
2. Baxter, R., Christen, P. & Churches, T. (2003), A comparison of fast blocking methods for record linkage, in 'ACM SIGKDD Workshop on Data Cleaning, Record Linkage and Object Consolidation', Washington DC, pp. 25-27.
3. Bhattacharya, I. & Getoor, L. (2007), 'Collective entity resolution in relational data', ACM Transac-tions on Knowledge Discovery from Data (TKDD), vol. 1, no. 1.
4. Bilenko, M. & Mooney, R.J. (2003), Adaptive duplicate detection using learnable string similarity measures, in 'ACM International Conference on Knowledge Discovery and Data Mining' (SIGKDD'03), Washington DC, pp. 39-48.
5. Bilenko, M., Basu, S. & Sahami, M. (2005), Adaptive product normalization: Using online learning for record linkage in comparison shopping, in'IEEE International Conference on Data Mining' (ICDM'05), Houston, Texas, pp. 58-65.
6. Chang, C.-C. & Lin, C.-J. (2001), LIBSVM: a library for support vector machines, manual. Department of Computer Science, National Taiwan University. Software available at: http://www.csie.ntu.edu.tw/~cjlin/libsvm.
7. Christen, P., Churches, T. & Hegland, M. (2004), Febrl - A parallel open source data linkage system, in 'Pacific-Asia Conference on Knowledge Discovery and Data Mining' (PAKDD'04), Sydney, Springer LNAI 3056, pp. 638-647.
8. Christen, P. (2005), Probabilistic data generation for deduplication and data linkage, in 'International Conference on Intelligent Data Engineering and Automated Learning' (IDEAL'05), Brisbane, Springer LNCS 3578, pp. 109-116.
9. Christen, P. (2006), A comparison of personal name matching: techniques and practical issues, in 'Workshop on Mining Complex Data' (MCD), held at IEEE ICDM'06, Hong Kong.
10. Christen, P. & Goiser, K. (2007), Quality and complexity measures for data linkage and deduplication, in F. Guillet & H. Hamilton, eds, 'Quality Measures in Data Mining', Springer Studies in Computational Intelligence, vol. 43, pp. 127-151.
11. Churches, T., Christen, P., Lim, K. & Zhu, J.X. (2002), 'Preparation of name and address data for record linkage using hidden Markov models', BioMed Central Medical Informatics and Decision Making, vol. 2, no. 9.
12. Clarke, D.E. (2004), 'Practical introduction to record linkage for injury research', Injury Prevention, vol. 10, pp. 186-191.
13. Cohen, W.W. & Richman, J. (2002), Learning to match and cluster large high-dimensional data sets for data integration, in 'ACM International Conference on Knowledge Discovery and Data Mining' (SIGKDD'02), Edmonton, pp. 475-480.
14. Cohen W.W., Ravikumar P. & Fienberg S.E. (2003), A comparison of string distance metrics for namematching task, in 'IJCAI-03 workshop on information integration on the Web' (IIWeb-03), Acapulco, pp. 73-78.
15. Elfeky, M.G., Verykios, V.S. & Elmagarmid, A.K. (2002), TAILOR: A record linkage toolbox, in 'International Conference on Data Engineering' (ICDE'02), San Jose, pp. 17-28.
16. Fellegi, I.P. & Sunter, A.B. (1969), 'A theory for record linkage', Journal of the American Statistical Society, vol. 64, no. 328, pp. 1183-1210.
17. Gill, L. (2001), 'Methods for automatic record matching and linking and their use in national statistics', National Statistics Methodology Series, no. 25, National Statistics, London.
18. Goiser K. & Christen, P. (2006), Towards automated record linkage, in 'Australasian Data Mining Conference' (AusDM'06), Sydney, Conferences in Research and Practice in Information Technology (CRPIT), vol. 61, pp. 23-31.
19. Gu, L. & Baxter, R. (2006), Decision models for record linkage, in 'Selected Papers from AusDM', Springer LNCS 3755, pp. 146-160.
20. Kelman, C.W., Bass, J. & Holman, D. (2002), 'Research use of linked health data - A best practice protocol', Aust NZ Journal of Public Health, vol. 26, pp. 251-255.
21. Liu, B., Lee, W.S., Yu, P.S. & Li, X. (2002), Partially supervised classification of text documents, in 'International Conference on Machine Learning' (ICML'02), Sydney, Australia, pp. 387-394.
22. Liu, B., Dai, Y., Li, X., Lee, W.S. & Yu, P.S. (2003), Building text classifiers using positive and unlabeled examples, in 'IEEE International Conference on Data Mining' (ICDM'03), Melbourne, Florida, pp. 179-186.
23. McCallum, A., Nigam, K. & Ungar, L.H. (2000), Efficient clustering of high-dimensional data sets with application to reference matching, in 'ACM International Conference on Knowledge Discovery and Data Mining' (SIGKDD'00), Boston, pp. 169-178.
24. Nahm, U.Y., Bilenko, M. & Mooney, R.J. (2002), Two approaches to handling noisy variation in text mining, in 'ICML'02 workshop on text learning' (TextML'02), Sydney, Australia, pp. 18-27.
25. Neiling, M. (2005), Identification of real-world objects in multiple databases, in '29th Annual Conference of the Gesellschaft f̈ur Klassifikation e.V.', University of Magdeburg, pp. 63-74.
26. Nigam, K., McCallum, A.K., Thrun, S. & Mitchell, T. (2000), 'Text classification from labeled and unlabeled documents using EM', Machine Learning, vol. 39, no. 2, pp. 103-134.
27. Rahm, E. & Do, H.H. (2000), 'Data cleaning: Problems and current approaches', IEEE Data Engineering Bulletin, vol. 23, no. 4, pp. 3-13.
28. Sarawagi S., & Bhamidipaty A. (2002), Interactive deduplication using active learning, in 'ACM International Conference on Knowledge Discovery and Data Mining' (SIGKDD'02), Edmonton, Canada, pp. 269-278.
29. Tejada S., Knoblock C.A. & Minton S. (2000), Learning domain-independent string transformation weights for high accuracy object identification, in 'ACM International Conference on Knowledge Discovery and Data Mining' (SIGKDD'02), Edmonton, Canada, pp. 350-359.
30. Wang, G., Chen, H., Xu, J.J. & Atabakhsh, H. (2006), 'Automatically detecting criminal identity deception: An adaptive detection algorithm', IEEE Transactions on Systems, Man and Cybernetics (Part A), vol. 36, no. 5, pp. 988-999.
31. Winkler, W.E. (2000), 'Using the EM algorithm for weight computation in the Fellegi-Sunter model of record linkage', Technical report RR2000/05, US Bureau of the Census.
32. Winkler, W.E. (2004), 'Methods for evaluating and creating data quality', Information Systems, Elsevier, vol. 29, no. 7, pp. 531-550.
33. Winkler, W.E. (2006), 'Overview of record linkage and current research directions', Technical report RR2006/02, US Bureau of the Census.
34. Yu, H., Han. J. & Chang, K.C.C. (2002), PEBL: Positive example based learning for Web page classification using SVM, in 'ACM International Conference on Knowledge Discovery and Data Mining' (SIGKDD'02), Edmonton, Canada, pp. 239-248.