Febrl – A parallel open source data linkage system

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 3056, Issue , 2004, Pages 638-647

  Christen, Peter ^a   Churches, Tim ^b   Hegland, Markus ^a  

^a AUSTRALIAN NATIONAL UNIVERSITY   (Australia)

^b CENTRE FOR EPIDEMIOLOGY AND RESEARCH   (Australia)

Author keywords

Data cleaning and standardisation; Data matching; Data mining preprocessing; Parallel processing; Record linkage

Indexed keywords

DATA HANDLING; OPEN DATA; OPEN SOURCE SOFTWARE; OPEN SYSTEMS; STANDARDIZATION; ALGORITHMS; COMPUTER SOFTWARE; INFORMATION RETRIEVAL; PROBABILITY; PROJECT MANAGEMENT; USER INTERFACES;

DATA CLEANING; DATA MATCHING; ENTITY IDENTIFIERS; EXPERIMENTAL PLATFORM; MULTIPLE DATA SOURCES; PARALLEL PROCESSING; PROBABILISTIC APPROACHES; RECORD LINKAGE;

DATA MINING;

DATA CLEANING AND STANDARDIZATION; DATA MATCHING; DATA MINING PREPROCESSING; PARALLEL PROCESSING; RECORD LINKAGE;

EID: 7444251738     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-540-24775-3_75     Document Type: Conference Paper

References (21)

1. Baxter, R., Christen, P. and Churches, T.: A Comparison of Fast Blocking Methods for Record Linkage. ACM SIGKDD’03 Workshop on Data Cleaning, Record Linkage, and Object Consolidation, August 27, 2003, Washington, DC, pp. 25-27.
2. Chaudhuri, S., Ganjam, K., Ganti, V. and Motwani, R.: Robust and efficient fuzzy match for online data cleaning. Proceedings of the 2003 ACM SIGMOD International Conference on on Management of Data, San Diego, USA, 2003, pp. 313-324.
3. Churches, T., Christen, P., Lim, K. and Zhu, J.X.: Preparation of name and address data for record linkage using hidden Markov models. BioMed Central Medical Informatics and Decision Making, Dec. 2002. Available online at: http://www.biomedcentral.com/1472-6947/2/9/
4. Cohen, W.: Integration of heterogeneous databases without common domains using queries based on textual similarity. Proceedings of SIGMOD, Seattle, 1998.
5. Elfeky, M.G., Verykios, V.S. and Elmagarmid, A.K.: TAILOR: A Record Linkage Toolbox. Proceedings of the ICDE’ 2002, San Jose, USA, 2002.
6. Fellegi, I. and Sunter, A.: A theory for record linkage. In Journal of the American Statistical Society, 1969.
7. Galhardas, H., Florescu, D., Shasha, D. and Simon, E.: An Extensible Framework for Data Cleaning. Proceedings of the Inter. Conference on Data Engineering, 2000.
8. Hegland, M.: Adaptive sparse grids. ANZIAM J., vol. 44, 2003, pp. C335-C353.
9. Hernandez, M.A. and Stolfo, S.J.: The Merge/Purge Problem for Large Databases. Proceedings of the ACM-SIGMOD Conference, 1995.
10. Hernandez, M.A. and Stolfo, S.J.: Real-world data is dirty: Data cleansing and the merge/purge problem. In Data Mining and Knowledge Discovery 2, Kluwer Academic Publishers, 1998.
11. Maletic, J.I. and Marcus, A.: Data Cleansing: Beyond Integrity Analysis. Proceedings of the Conference on Information Quality (IQ2000), Boston, October 2000.
12. McCallum, A., Nigam, K. and Ungar, L.H.: Efficient clustering of high-dimensional data sets with application to reference matching. Knowledge Discovery and Data Mining, pp. 169-178, 2000.
13. Gropp, W., Lusk, E. and Skjellum, A.: Using MPI-2nd Edition, Portable Parallel Programming with the Message Passing Interface, MIT Press, 1999.
14. Nahm, U.Y, Bilenko M. and Mooney, R.J.: Two Approaches to Handling Noisy Variation in Text Mining. Proceedings of the ICML-2002Workshop on Text Learning (TextML’2002), pp. 18-27, Sydney, Australia, July 2002.
15. Newcombe, H.B. and Kennedy, J.M.: Record Linkage: Making Maximum Use of the Discriminating Power of Identifying Information. Communications of the ACM, vol. 5, no. 11, 1962.
16. Porter, E. and Winkler, W.E.: Approximate String Comparison and its Effect on an Advanced Record Linkage System. RR 1997-02, US Bureau of the Census, 1997.
17. Rabiner, L.R.: A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition. Proceedings of the IEEE, vol. 77, no. 2, Feb. 1989.
18. Rahm, E. and Do, H.H.: Data Cleaning: Problems and Current Approaches. IEEE Data Engineering Bulletin, 2000.
19. Winkler, W.E.: The State of Record Linkage and Current Research Problems. RR 1999-04, US Bureau of the Census, 1999.
20. Winkler, W.E.: Using the EM algorithm for weight computation in the Fellegi-Sunter model of record linkage. RR 2000-05, US Bureau of the Census, 2000.
21. Yancey, W.E.: BigMatch: A Program for Extracting Probable Matches from a Large File for Record Linkage. RR 2002-01, US Bureau of the Census, March 2002