De-duplication of aggregation authority files

International Journal of Metadata, Semantics and Ontologies

Volumn 7, Issue 2, 2012, Pages 114-130

  Manghi, P ^a   Mikulicic, M ^a   Atzori, C ^a  

^a ISTI CNR   (Italy)

Author keywords

Authority control; Candidate identification; Cassandra; Metadata; Ontologies; Performance; Record aggregations; Record deduplication; Record merge; Scalability; Semantics; Sorted neighbourhood

Indexed keywords

DIGITAL STORAGE; ITERATIVE METHODS; METADATA; ONTOLOGY; SCALABILITY; SEMANTICS; USER INTERFACES;

AUTHORITY CONTROLS; CANDIDATE IDENTIFICATIONS; CASSANDRAS; PERFORMANCE; RECORD AGGREGATIONS; RECORD DEDUPLICATION; RECORD MERGE; SORTED NEIGHBOURHOOD;

PARALLEL PROCESSING SYSTEMS;

EID: 84868227103     PISSN: 17442621     EISSN: 1744263X     Source Type: Journal    
DOI: 10.1504/IJMSO.2012.050014     Document Type: Article

References (39)

1. Artini, M., Candela, L., Castelli, D., Manghi, P., Mikulicic, M. and Pagano, P. (1991) 'Aggregative digital library systems in the driver infrastructure', World Digital Libraries Journal, December, ISSN 0974-567X, Vol. 2, No. 2, pp.113-130.
2. Benjelloun, O., Garcia-Molina, H., Su, Q. and Widom, J. (2005) 'Swoosh: a generic approach to entity resolution', Stanford University technical report, March. Vol. 18, No. 1, pp.255-276.
3. Bhattacharya, I. and Getoor, L. (2007) 'Collective entity resolution in relational data', ACM Transactions on Knowledge Discovery from Data (TKDD), Vol. 1, No. 1. Article No. 5.
4. Charikar, M. (2002) 'Similarity estimation techniques from rounding algorithms', in 34th Annual Symposium on Theory and Computing, May, Montreal, Quebec, Canada.
5. Christen, P. (2011) 'A survey of indexing techniques for scalable record linkage and deduplication', Knowledge and Data Engineering, IEEE Transactions on, ISSN 1041-4347. doi: 10.1109/TKDE, Vol. 127, No. 1, pp.99.
6. Christen, P.F. (2008) 'An open source data cleaning, deduplication and record linkage system with a graphical user interface', In Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining, KDD '08, New York, NY, USA, ACM. ISBN 978-1-60558-193-4. doi: http://doi.acm.org/10.1145/1401890.1402020, URL http://doi.acm.org/10.1145/ 1401890.1402020, pp.1065-1068.
7. Christen, P. and Pudjijono, A. (2009) 'Accurate synthetic generation of realistic personal information', In Thanaruk Theeramunkong, (Eds.): Kijsirikul, B., Cercone, N. and Ho, T-B., Advances in Knowledge Discovery and Data Mining, of Lecture Notes in Computer Science, Springer Berlin, Heidelberg, ISBN 978-3-642-01306-5. URL http://dx.doi.org/10.1007/978-3-642-01307-2-47. 10.1007/978-3-642-01307-2.47, Vol. 5476 pp.507-514.
8. Christen, T., Churches, P. and Zhu, J.X. (2002) 'Probabilistic name and address cleaning and standardization', The Australian Data Mining Workshop, November. http://datamining.anu.edu. au/projects/linkage-publications.html.
9. Churches, T., Christen, P., Lu, J. and Zhu, J.X. (2002) 'Preparation of name and address data for record linkage using hidden Markov models', Bio-Med Central Medical Informatics and Decision Making, Vol. 2, No. 9, Online journal.
10. Cohen, W.W., Ravikumar, P. and Fienberg, S.E. (2003) 'A comparison of string distance metrics for name-matching tasks', International Joint Conference on Artifi cial Intelligence, Proceedings of the Workshop on Information Integration on the Web, August. pp. 73-78. Online proceedings, http://www.isi. edu/info-agents/workshops/ijcai03/proceedings.htm.
11. Cohen, W.W. and Richman, J. (2002) 'Learning to match and cluster large high-dimensional data sets for data integration', in Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining, KDD '02, ACM ISBN 1-58113-567-X. doi: http://doi. acm.org/10.1145/775047.775116. URL http://doi.acm. org/10.1145/775047.775116, New York, USA., pp.475-480.
12. Dalrymple, P.W. and Young, J.A. (1991) 'From authority control to informed retrieval: Framing the expanded domain of subject access', College and Research Libraries, doi: http://hdl.handle. net/1860/3173, Vol. 52, pp.139-149.
13. Elmagarmid, A.K., Ipeirotis, P.G. and Verykios, V.S. (2007) 'Duplicate record detection: a survey', Knowledge and Data Engineering, IEEE Transactions on, Jan., ISSN 1041-4347, doi: 10.1109/TKDE 250581, URL http://www.cs.purdue. edu/homes/ake/pub/-survey2.pdf, Vol. 19, No. 1, pp.1-16. (Pubitemid 44955773)
14. Gomez-Bao, J., Larriba-Pey, J-L. and Puig, J.R. (2009) 'Record linkage performance for large data sets', In Proceedings of the ACM fi rst international workshop on Privacy and anonymity for very large databases, PAVLAD '09, ACM. ISBN 978-1-60558-804-9. doi: http://doi.acm.org/10.1145/1651449.1651453, URL http://doi.acm.org/10.1145/1651449.1651453, New York, NY, USA, pp.09-16.
15. Gong, C., Huang, Y., Cheng, X. and Bai, S. (2008) 'Detecting near-duplicates in large-scale short text databases', in (Eds.): Washio, T., Suzuki, E., Ting, K. and Inokuchi, A., Advances in Knowledge Discovery and Data Mining, of Lecture Notes in Computer Science, Springer Berlin Heidelberg, URL http://dx.doi.org/10.1007/978-3-540-68125-0-87, Vol.5012, pp.877-883. (Pubitemid 351776381)
16. Gorman, M. (2003) 'Authority control in the context of bibliographic control in the electronic environment', International Conference Authority Control: Defi nition and International Experiences, Florence, February 10-12, doi: http://hdl.handle. net/10760/4164. Vol. 38, No. 3-4, pp.11-22. (Pubitemid 40055125)
17. Gravano, L., Panagiotis, G., Koudas, I.N. and Srivastava, D. (2003) 'Text joins in an RDBMS for web data integration', In Proceedings of the 12th international conference on World Wide Web, WWW '03, ACM. ISBN 1-58113680-3. doi: http://doi.acm.org/10.1145/775152.775166, URL http://doi.acm. org/10.1145/775152.775166, New York, NY, USA, pp.90-101.
18. Hernandez, M.A. and Stolfo, S.J. (1995) 'The merge/purge problem for large databases, SIGMOD Rec., May, ISSN 0163-5808, doi: http://doi.acm.org/10. 1145/568271.223807, URL http://doi. acm.org/10.1145/568271.223807, Vol. 24, pp.127-138.
19. Jaro, M.A. (1989) 'Advances in record-linkage methodology as applied to matching the 1985 census of Tampa, Journal of the American Statistical Association, June, URL http://www.jstor.org/stable/2289924, published by American Statistical Association, Florida, Vol. 84, No. 406, pp.414-420.
20. Jurczyk, P., James, J., Lu, Li. and Janet, D.X. (2008) 'Cragan and adolfo correa, fi ne-grained record integration and linkage tool', Birth Defects Research Part A: Clinical and Molecular Teratology, ISSN 1542-0760, doi: 10.1002/bdra.20521. URL http://dx.doi.org/10.1002/bdra.20521, Vol. 82, No. 11, pp.822-829.
21. Kalashnikov, D.V. and Mehrotra, S. (2006) 'Domain-independent data cleaning via analysis of entity-relationship graph', ACM Transactions on Database Systems (TODS), Vol. 31, No. 2, pp.716-767. (Pubitemid 43924953)
22. Kang H., Getoor, L., Shneiderman, B., Bilgic, M. and Licamele. L. (2008) 'Interactive entity resolution in relational data: A visual analytic tool and its evaluation', IEEE Transactions on Visualization and Computer Graphics, Vol. 14, No. 5, pp.999-1014.
23. Koepcke, H. and Rahm, E. (2010) 'Frameworks for entity matching: a comparison', Data; Knowledge Engineering, ISSN 0169-023X. doi: 10.1016/j.datak.2009.10.003. URL http://www.sciencedirect.com/science/article/- pii/S0169023X09001451, Vol. 69, No. 2, pp.197-210.
24. Koepcke, H., Rahm, E. and Rahm, E. (2008) 'Training selection for tuning entity matching', In QDB/MUD, pp.3-12.
25. Lagoze, C. and Van de Sompel, H. (2001) The open archives initiative: building a low-barrier interoperability framework, in Proceedings of the fi rst ACM/IEEE-CS Joint Conference on Digital Libraries, ACM Press, ISBN 1-58113-345-6. doi: http://doi.acm.org/10.1145/379437.379449, pp.54-62.
26. Lagoze, C. and Van de Sompel, H. (2008) The OAI Protocol for Object Reuse and Exchange, http://www.openarchives.org/ore/.
27. Lakshman, A. and Malik, P. (2010) 'Cassandra: a decentralized structured storage system', SIGOPS Oper. Syst. Rev., April, ISSN 0163-5980. doi: http://doi.acm.org/10.1145/1773912.1773922. URL http://doi.acm.org/10.1145/ 1773912.1773922, Vol. 44, pp.35-40.
28. Lagoze, C. and Van de Sompel, H. (2003) 'The making of the open archives initiative protocol for metadata harvesting', Library Hi Tech, Vol. 21, No. 2, pp.118-128.
29. Manghi, P. and Mikulicic, M. (2011) 'PACE: a general-purpose tool for authority control, ' in (Ed.): Garcia-Barriocanal, E., Cebeci, Z., Okur, M.C. and Ozturk, A., Metadata and Semantic Research, of Communications in Computer and Information Science, Springer Berlin, Heidelberg, ISBN 978-3-642-24731-6, URL http://dx.doi.org/10.1007/978-3-642-24731-6-8, 10.1007/978-3-642-24731-6, 8, Vol. 240, pp.80-92.
30. Manku, G.S., Jain, A. and Sarma, A.D. (2007) 'Detecting near-duplicates for web crawling', In 16th International World Wide Conference, May, Banff, Alberta, Canada.
31. Rick, B., Hengel-Dittrich, C., ONeill, E.T. and Viaf, T.B. (2007) 'Virtual international authority fi le: linking the Deutsche Nationalbibliothek and Library of Congress name authority fi les', in International Cataloging and Bibliographic Control, Vol. 1, No. 36, pp.12-19.
32. Rudniy, A., Song, M. and Geller, J. (2010) 'Detecting duplicate biological entities using shortest path edit distance', International Journal of Data Mining and Bioinformatics, doi: 10.1504/IJDMB.2010.034196. URL http://inderscience. metapress.com/content/-TQ3737625VK1R573, Vol. 4, No. 4, pp.395-410.
33. Tejada, S., Knoblock, C. and Minton, S. (2001) 'Learning object identifi cation rules for information extraction', Information Systems, Vol. 26, No. 8, pp.607-633. (Pubitemid 33046273)
34. Tillett, B.T. (2003) Authority control: state of the art and new perspectives, in Authority Control International Conference, Florence, Italy.
35. Van de Sompel, H., Bekaert, J., Liu, X., Balakireva, L. and Schwander, T. (2005) aDORe: a modular, standards-based Digital Object Repository, URL http://www.citebase.org/abstract?id=oai:-arXiv.org:cs/0502028.
36. Wang, X. and Alexander, S.M. (2010) 'Linking medical records: a machine learning approach', International Journal of Collaborative Enterprise, doi: 10.1504/IJCENT.2010.03836. URL http://inderscience.metapress.com/content/- T93552025P 150H36, Vol. 1, No. 3, pp.394-406.
37. Weber, J. (2003) 'LEAF linking and exploring authority fi les', International Conference Authority Control: Defi nition and International Experiences, Florence, February, pp.10-12.
38. Winkler, W.E. (1990) 'String comparator metrics and enhanced decision rules in the Fellegi-Sunter model of record linkage, Proceedings of the Section on Survey Research Methods, American Statistical Association, pp.354-359.
39. Winkler, W.E. (2006) 'Overview of record linkage and current research directions, ' Technical Report, Research Report Series, RRS, URL http://www.census.gov/srd/papers/pdf/-rrs2006-02.pdf