A comparative study in classification techniques for unsupervised record linkage model

Journal of Computer Science

Volumn 7, Issue 3, 2011, Pages 341-347

  Ektefa, Mohammadreza ^a   Sidi, Fatimah ^a   Ibrahim, Hamidah ^a   Jabar, Marzanah A ^a   Memar, Sara ^a  

^a UNIVERSITY PUTRA MALAYSIA   (Malaysia)

Author keywords

Bayesian network; Classification techniques; Data integration; Duplicate detection; Heterogeneous data; ID3 algorithm; Longest Common Subsequence (LCS); Optical character recognition (OCR); Record linkage; Support vector machines

Indexed keywords

EID: 80052842512     PISSN: 15493636     EISSN: None     Source Type: Journal    
DOI: 10.3844/jcssp.2011.341.347     Document Type: Article

References (34)

1. Allison, L. and T.I. Dix, 1986. A bit-string longestcommon-subsequence algorithm. Inform. Process. Lett., 23: 305-310. DOI: 10.1016/0020-0190(86)90091-8
2. Al-Salemi, B. and M.J.A. Aziz, 2011. Statistical bayesian learning for automatic arabic text categorization. J. Comput. Sci., 7: 39-45. DOI: 10.3844/jcssp.2011.39.45
3. Christen, P., 2007. A two-step classification approach to unsupervised record linkage. Proceedings of the 6th Australasian Conference on Data Mining and Analytics (AusDM'07), Australian Computer Society, Inc. Darlinghurst, Australia, pp: 111-119.
4. Christen, P., 2008. Automatic record linkage using seeded nearest neighbour and support vector machine classification. Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, (KDD'08), ACM New York, NY, USA., pp: 151-159. DOI: 10.1145/1401890.1401913
5. Churches, T., P. Christen, K. Lim and J.X. Zhu, 2002. Preparation of name and address data for record linkage using hidden Markov models. BMC Med. Inform. Decision Mak., 2: 9-9. DOI: 10.1186/1472-6947-2-9
6. Elfeky, M.G., A.K. Elmagarmid and V.S. Verykios, 2002. Tailor: A record linkage toolbox. Proceedings of the 18th International Conference on Data Engineering, Feb. 26-1 Mar., San Jose, CA, USA., pp: 17-28. DOI: 10.1109/ICDE.2002.994694
7. Fellegi, I.P. and A.B. Sunter, 1969. A theory for record linkage. J. Am. Stat. Assoc., 64: 1183-1210. DOI: 10.2307/2286061
8. Gu, L. and R. Baxter, 2006. Decision Models for Record Linkage. Data Min., 3755: 146-160. DOI: 10.1007/11677437_12
9. Han, J. and M. Kamber, 2006. Data mining: concepts and techniques. 2nd Edn., Morgan Kaufmann, USA., ISBN-10: 1558609016, pp: 800.
10. Hassanzadeh, O. and R.J. Miller, 2009. Creating probabilistic databases from duplicated data. VLDB J., 18: 1141-1166. DOI: 10.1007/s00778-009-0161-2
11. Hernández, M.A. and S. Stolfo, 1995. The merge/purge problem for large databases. Proceedings of the International Conference on Management of Data, (ICMD'95), ACM New York, NY, USA., pp: 127-138. DOI: 10.1145/223784.223807
12. Hernández, M.A. and S.J. Stolfo, 1998. Real-world data is dirty: Data cleansing and the merge/purge problem. Data Min. Know. Discovery, 2: 9-37. DOI: 10.1023/A:1009761603038
13. Islam, A. and D. Inkpen, 2008. Semantic text similarity using corpus-based word similarity and string similarity. ACM Trans. Knowl. Discov. Data, 2: 1-25. DOI: 10.1145/1376815.1376819
14. Jaro, M.A., 1989. Advances in record-linkage methodology as applied to matching the 1985 census of Tampa. Florida. J. Am. Stat. Assoc., 84: 414-420. DOI: 10.2307/2289924
15. Kopcke, H. and E. Rahm, 2010. Frameworks for entity matching: A comparison. Data Knowl. Eng., 69: 197-210. DOI: 10.1016/j.datak.2009.10.003
16. Kusrini, S. Hartati, R. Wardoyo and A. Harjoko, 2010. Differential diagnosis knowledge building by using CUC-C4.5 framework. J. Comput. Sci., 6: 180-185. DOI: 10.3844/jcssp.2010.180.185
17. Lee, L.H., C.H. Wan, T.F. Yong and H.M. Kok, 2011. A review of nearest neighbor-support vector machines hybrid classification models. J. Applied Sci., 10: 1841-1858. DOI: 10.3923/jas.2010.1841.1858
18. Lee, L.H., D. Isa, W.O. Choo and W.Y. Chue, 2010. Tournament structure ranking techniques for Bayesian text classification with highly similar categories. J. Applied Sci., 10: 1243-1254
19. McCallum, A., K. Nigam and L.H. Ungar, 2000. Efficient clustering of high-dimensional data sets with application to reference matching. Proceedings of the 6th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, (KDD'00), ACM New York, NY, USA., pp: 169-178. DOI: 10.1145/347090.347123
20. Mehdi, M., S. Zair, A. Anou and M. Bensebti, 2007. A bayesian networks in intrusion detection systems. J. Comput. Sci., 3: 259-265. DOI: 10.3844/jcssp.2007.259.265
21. Mustapha, A., M.N. Sulaiman, R. Mahmod and M.H. Selamat, 2011. Dynamic bayesian networks in classification-and-ranking architecture of response generation. J. Comput. Sci., 7: 59-64. DOI: 10.3844/jcssp.2011.59.64
22. Nahm, U.Y., M. Bilenko and R.J. Mooney, 2002. Two approaches to handling noisy variation in text mining. Proceedings of the Papers from the 19th International Conference on Machine Learning Workshop on Text Learning, (ICML-2002), Sydney, Australia, pp: 18-27.
23. Newcombe, H.B., J.M. Kennedy, S.J. Axford and A.P. James, 1959. Automatic linkage of vital records. Science, 130: 954-959. DOI: 10.1126/science.130.3381.954
24. Ojokoh, B., M. Zhang, J. Tang, 2011. A trigram hidden Markov model for metadata extraction from heterogeneous references. Inform. Sci., 181: 1538-1551. DOI: 10.1016/j.ins.2011.01.014
25. Pugazhenthi, D. and S.P. Rajagopalan, 2009. Unbalance quantitative structure activity relationship problem reduction in drug design. J. Comput. Sci., 5: 764-772. DOI: 10.3844/jcssp.2009.764.772
26. Quinlan, J.R., 1979. Discovering Rules by Induction from Large Collections of Examples. In: Expert Systems in the Micro-Electronic Age, D. Michie, (Ed.). Edinburgh: Edinburgh University Press, pp: 168-201.
27. Quinlan, J.R., 1992. C4.5: programs for machine learning. 1st Edn., Morgan Kaufmann, USA., ISBN-10: 1558602380, pp: 302.
28. Sarawagi, S. and A. Bhamidipaty, 2002. Interactive deduplication using active learning. Proceedings of the 8th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, (KDD'02), ACM New York, NY, USA., pp: 269-278. DOI: 10.1145/775047.775087
29. Stoermer, H., N. Rassadko and N. Vaidya, 2010. Feature-based entity matching: The FBEM model, implementation, evaluation. Advanced Inform. Syst. Eng., 6051: 180-193. DOI: 10.1007/978-3-642-13094-6_15
30. Surajit, C., K. Ganjam, V. Ganti and R. Motwani, 2003. Robust and efficient fuzzy match for online data cleaning. Proceedings of the 2003 ACM SIGMOD International Conference on Management of Data, (SIGMOD'03 ACM New York, NY, USA., pp: 313-324. DOI: 10.1145/872757.872796
31. Ting, C.Y. and S. Phon-Amnuaisuk, 2009. Log data approach to acquisition of optimal Bayesian learner model. Am. J. Applied Sci., 6: 913-921. DOI: 10.3844/ajassp.2009.913.921
32. Wagner, M., 2010. Forecasting daily demand in cash supply chains. Am. J. Econ. Bus. Admin., 2: 377-383. DOI: 10.3844/ajebasp.2010.377.383
33. Warnner, J.W. and E.W. Brown, 2001. Automated name authority control. Proceedings of the 1st ACM/IEEE-CS Joint Conference on Digital Libraries, (JCDL'01), ACM New York, NY, USA., pp: 21-22. DOI: 10.1145/379437.379441
34. Winkler, W.E., 1999. The State of Record Linkage and Current Research Problems. Statistical Research Division, U.S. Census Bureau. http://www.census.gov/srd/papers/pdf/rr99-04.pdf