Learning to match and cluster large high-dimensional data sets for data integration

Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining

Volumn , Issue , 2002, Pages 475-480

  Cohen, William W ^a   Richman, Jacob ^a  

^a WhizBang Labs   (United States)

Author keywords

Clustering; Large datasets; Learning; Text mining

Indexed keywords

ADAPTIVE SYSTEMS; ALGORITHMS; DATA MINING; INFORMATION RETRIEVAL; LEARNING SYSTEMS; PATTERN MATCHING;

DATA INTEGRATION; NON ADAPTIVE BASELINE SYSTEMS;

DATABASE SYSTEMS;

EID: 0242540438     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/775047.775116     Document Type: Conference Paper

References (21)

1. William W. Cohen. Reasoning about textual similarity in information access. Autonomous Agents and Multi-Agent Systems, pages 65-86, 1999.
2. William W. Cohen. Data integration using similarity joins and a word-based information representation language. ACM Transactions on Information Systems, 18(3):288-321, July 2000.
3. William W. Cohen. WHIRL: A word-based information representation language. Artificial Intelligence, 118:163-196, 2000.
4. William W. Cohen and Jacob Richman. Learning to match and cluster entity names. In Proceedings of the ACM SIGIR-2001 Workshop on Mathematical/Formal Methods in Information Retrieval, New Orleans, LA, 2001.
5. William W. Cohen, Robert E. Schapire, and Yoram Singer. Learning to order things. Journal of Artificial Intelligence Research, 10:243-270, 1999.
6. M. Craven, D. DiPasquo, D. Freitag, A. McCallum, T. Mitchell, K. Nigam, and S. Slattery. Learning to extract symbolic knowledge from the world wide web. In Proceedings of the Fifteenth National Conference on Artificial Intelligence (AAAI-98), Madison, WI, 1998.
7. I. P. Felligi and A. B. Sunter. A theory for record linkage. Journal of the American Statistical Society, 64:1183-1210, 1969.
8. H. Galhardas, D. Florescu, D. Shasha, and E. Simon. AJAX: an extensible data-cleaning tool. In Proceedings of ACM SIGMOD-2000, June 2000.
9. M. Hernandez and S. Stolfo. The merge / purge problem for large databases. In Proceedings of the 1995 ACM SIGMOD, May 1995.
10. B. Kilss and W. Alvey. Record linkage techniques-1985. Statistics of Income Division, Internal Revenue Service Publication 1299-2-96. Available from http://www.bts.gov/fcsm/methodology/, 1985.
11. Steve Lawrence, C. Lee Giles, and Kurt Bollacker. Digital libraries and autonomous citation indexing. IEEE Computer, 32(6):67-71, 1999.
12. A. McCallum, K. Nigam, J. Rennie, and K. Seymore. Automating the construction of internet portals with machine learning. Information Retrieval, 2000.
13. A. McCallum, K. Nigam, and L. Ungar. Efficient clustering of high-dimensional data sets with application to reference matching. In Proceedings of the Sixth International Conference on Knowledge Discovery and Data Mining, pages 169-178, 2000.
14. A. Monge and C. Elkan. The field-matching problem: algorithm and applications. In Proceedings of the Second International Conference on Knowledge Discovery and Data Mining, August 1996.
15. H. B. Newcombe, J. M. Kennedy, S. J. Axford, and A. P. James. Automatic linkage of vital records. Science, 130:954-959, 1959.
16. Kamal Nigam, John Lafferty, and Andrew McCallum. Using maximum entropy for text classification. In Proceedings of Machine Learning for Information Filtering Workshop, IJCAI '99, Stockholm, Sweden, 1999.
17. H.A. Baier Saip and C.L. Lucchesi. Matching algorithms for bipartite graph. Technical Report DCC-03/93, Departamento de Cincia da Computao, Universidade Estudal de Campinas, 1993.
18. Gerard Salton, editor. Automatic Text Processing. Addison Welsley, Reading, Massachusetts, 1989.
19. W. E. Winkler. Improved decision rules in the Felligi-Sunter model of record linkage. Statistics of Income Division, Internal Revenue Service Publication RR93/12. Available from http://www.census.gov/srd/www/byname.html, 1993.
20. W. E. Winkler. The state of record linkage and current research problems. Statistics of Income Division, Internal Revenue Service Publication R99/04. Available from http//www.census.gov/srd/www/byname.html, 1999.
21. William E. Winkler. Matching and record linkage. In Business Survey methods. Wiley, 1995.