Detecting duplicate biological entities using Markov random field-based edit distance

Knowledge and Information Systems

Volumn 25, Issue 2, 2010, Pages 371-387

  Song, Min ^a   Rudniy, Alex ^b  

^a NEW JERSEY INSTITUTE OF TECHNOLOGY   (United States)

^b University Heights   (United States)

Author keywords

Biomedical digital libraries; Duplicate detection; Edit distance; Markov random field

Indexed keywords

DIGITAL LIBRARIES; MARKOV PROCESSES;

BIOLOGICAL ENTITIES; CONTEXT SENSITIVE; DISTANCE ALGORITHM; DUPLICATE DETECTION; EDIT DISTANCE; MARKOV RANDOM FIELD THEORY; MARKOV RANDOM FIELDS; NEEDLEMAN-WUNSCH;

BIOINFORMATICS;

EID: 78049440735     PISSN: 02191377     EISSN: 02193116     Source Type: Journal    
DOI: 10.1007/s10115-009-0254-7     Document Type: Article

References (39)

1. Baeza-Yates R, Ribeiro-Neto B (1999) Modern Information Retrieval. ACM Press, New York, pp 215-219.
2. Bauckmann J (2007) Automatically integrating life science data sources. In: Proceedings of PhD workshop in conjunction with VLDB 2007, Vienna, Austria, pp 1448-1450.
3. Benson DA, Karsch-Mizrachi I, Lipman DJ et al (2004) GenBank: update. Nucleic Acids Res 32: 23-26.
4. Bilenko M, Mooney R, Cohen W et al (2003) Adaptive name matching in information integration. IEEE Intell Syst 18(5): 16-23.
5. Boeckmann B, Bairoch A, Apweiler R et al (2003) The SWISS-PROT protein knowledge base and its supplement TrEMBL. Nucleic Acids Res 31: 365-370.
6. Camon EB, Barrell D, Dimmer EC et al (2005) An evaluation of GO annotation retrieval for BioCreATivE and GOA. BMC Bioinformatics 6(Suppl): 15-17.
7. Christen P, Churches T, Hegland M (2004) Febrl-a parallel open source data linkage system, PAKDD 2004, Sydney. Lecture notes in artificial intelligence, vol 3056. Springer, Berlin, pp 638-647.
8. Cohen WW, Ravikumar P, Fienberg S (2003) A comparison of string distance metrics for name-matching tasks in IIWeb 2003, pp 73-78.
9. Elliott H, Derin H, Cristi R et al (1983) Application of Gibbs distributions to image segmentation. Tech. Rep. # UMASS-ECE-AU83-2, University of Massachusetts, Amherst, MA, pp 1-30.
10. Elmagarmid AK, Ipeirotis PG, Verykios VS (2007) Duplicate record detection: a survey. IEEE Trans Knowl Data Eng (TKDE) 19(1): 1-16.
11. Fellegi IP, Sunter AB (1969) A theory for record linkage. J Am Stat Assoc 64: 1183-1210.
12. Geman S, Geman D (1984) Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Trans Pattern Anal Mach Intell 6: 721-741.
13. GOA (2008) Gene Ontology Annotation-Proteomes. EBI. Obtained through the internet. http://www. ebi. ac. uk/GOA/proteomes. html. Accessed 10 Dec 2008.
14. Hansen RR, Elliot H (1982) Image segmentation using simple Markov random field models. Comput Vis Graph Image Process 20: 101-132.
15. Herbert K, Gehani N, Piel WH et al (2004) BIO-AJAX: an extensible framework for biological data cleaning. ACM SIGMOD Record 33(2): 51-57.
16. Hinneburg A, Egert B, Porzel A (2007) Duplicate detection of 2D-NMR spectra. J Integr Bioinform 4(1): 53-70.
17. Hirschman L, Colosimo M, Morgan A (2005) Overview of BioCreAtIvE task 1B: normalized gene lists. BMC Bioinformatics 6(Suppl 1): 11-15.
18. Jakoniene V, Lambrix P (2007) A tool for evaluating strategies for grouping of biological data. J Integr Bioinform 4(3): 83-95.
19. Jiang D, Pei J, Ramanathan M et al (2007) Mining gene-sample-time microarray data: a coherent gene cluster discovery approach. Knowl Inform Syst 13(3): 305-335.
20. Koh JLY, Lee ML, Khan AM et al (2004) Duplicate detection in biological data using association rule mining. In: Proceedings of ECML/PKDD workshop on data mining and text mining for bioinformatics, ECML/PKDD, Pisa, Italy, pp 35-41.
21. Leung HP, Chung FL, Chan SC (2005) On the use of hierarchical information in sequential mining-based XML document similarity computation. Knowl Inform Syst 7(4): 476-498.
22. Li SZ (1995) Markov random field modeling in computer vision. Springer, London, pp 26-29.
23. Lowrance R, Wagner R (1975) An extension to string-to-string correction problem. J ACM 23(2): 177-183.
24. Marzal A, Vidal E (1993) Computation of normalized edit distance and applications. IEEE Trans Pattern Anal Mach Intell 15(9): 926-932.
25. Monge AE, Elkan CP (1996) The field matching problem: algorithm and applications. In: Proceedings of ACM SIGKDD, ACM, Portland, pp 267-270.
26. Muller H, Naumann F, Freytag JC (2003) Data quality in genome databases, In: Proceedings of the international conference on information quality (IQ 2003), MIT, Boston, pp 269-284.
27. Needleman SB, Wunsch CD (1970) A general method applicable to the search for similarities in the amino acid sequence of two proteins. J Mol Biol 48: 443-453.
28. Newcombe HB, Kennedy JM, Axford SJ et al (1959) Automatic linkage of vital records. Science 130: 954-959.
29. Ristad E, Yianilos P (1998) Learning string edit distance. IEEE Trans Pattern Anal Mach Intell 20(5): 522-532.
30. Sahay S, Agichtein E, Li B et al (2007) Semantic annotation and inference for medical knowledge discovery. In: Proceedings of NSF symposium on next generation of data mining (NGDM-07), NSF, Baltimore, pp 11-16.
31. Seni G, Kripasundar V, Srihari R (1996) Generalizing edit distance to incorporate domain information: handwritten text recognition as a case study. Pattern Recognit 29(3): 405-414.
32. Singla P, Domingos P (2006) Entity resolution with Markov logic. In: Proceedings of the sixth international conference on data mining, pp 572-582.
33. Song M, Rudniy A (2008) Detecting duplicate biological entities using Markov random field-based edit distance. In: Proceedings of IEEE international conference on bioinformatics and biomedicine. IEEE, Philadelphia, pp 457-460.
34. Therrien CW (1979) Linear filtering models for texture classification and segmentation. In: Proceedings of 18th conference on decision and control. IEEE, Fort Lauderdale, pp 110-117.
35. Therrien CW (1983) An estimation-theoretic approach to terrain image segmentation. Comput Vis Graph Image Process 22: 313-326.
36. Tsuruoka Y, McNaught J, Tsujii J et al (2007) Learning string similarity measures for gene/protein name dictionary look-up using logistic regression. Bioinformatics 23(20): 2768-2774.
37. Wei J (2004) Markov edit distance. IEEE Trans Pattern Anal Mach Intell 26(3): 311-321.
38. Winkler WE (1999) The state of record linkage and current research problems. In: Proceedings of the survey methods section, SSC, Quebec, pp 73-80.
39. Ye S, Wen JR, Ma WY (2008) A systematic study on parameter correlations in large scale duplicate document detection. Knowl Inform Syst 14(2): 217-232.