Enhanced integrated scoring for cleaning dirty texts

Proceedings of IJCAI 2007 Workshop on Analytics for Noisy Unstructured Text Data, AND 2007

Volumn , Issue , 2007, Pages 55-62

  Wong, Wilson ^a   Liu, Wei ^a   Bennamoun, Mohammed ^a  

^a UNIVERSITY OF WESTERN AUSTRALIA   (Australia)

Author keywords

Abbreviation expansion; Case restoration; Spelling error correction

Indexed keywords

ABBREVIATION EXPANSION; ONLINE SOURCES; ONTOLOGY ENGINEERING; TEXT PREPROCESSING;

ERROR CORRECTION; WORLD WIDE WEB;

RESTORATION;

EID: 57449112649     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (31)

1. [Atkinson, 2006] K. Atkinson. Gnu aspell 0.60.4. http://aspell. sourceforge.net/2006.
2. [Brill, 1992] E. Brill. A simple rule-based part of speech tagger. In Proceedings of the 3rd Conference on Applied Natural Language Processing, 1992.
3. [Castellanos, 2003] M. Castellanos. Hotminer: Discovering hot topics on the web. In M. Berry, editor, Survey of Text Mining. Springer-Verlag, 2003.
4. [Cimiano and Staab, 2005] P. Cimiano and S. Staab. Learning concept hierarchies from text with a guided agglomerative clustering algorithm. In Proceedings of the Workshop on Learning and Extending Lexical Ontologies with Machine Learning Methods, Bonn, Germany, 2005.
5. [Clark, 2003] A. Clark. Pre-processing very noisy text. In Proceedings of the Workshop on Shallow Processing of Large Corpora at Corpus Linguistics, 2003.
6. [Damerau, 1964] F. Damerau. A technique for computer detection and correction of spelling errors. Communications of the ACM, 7(3):171-176, 1964.
7. [Holmes and McCabe, 2002] D. Holmes and C. McCabe. Improving precision and recall for soundex retrieval. In Proceedings of the International Conference on Information Technology: Coding and Computing (ITCC), 2002.
8. [Kietz et al., 2000] J. Kietz, R. Volz, and A. Maedche. Extracting a domain-specific ontology from a corporate intranet. In Proceedings of the 4th Conference on Computational Natural Language Learning, Lisbon, Portugal, 2000.
9. [Kuenning, 2006] G. Kuenning. International ispell 3.3.02. http://ficus-www.cs.ucla.edu/geoff/ispell.html, 2006.
10. [Kukich, 1992] K. Kukich. Technique for automatically correcting words in text. ACM Computing Surveys, 24(4):377- 439, 1992.
11. [Lait and Randell, 1993] A. Lait and B. Randell. An assessment of name matching algorithms. Technical report, University of Newcastle upon Tyne, 1993.
12. [Levenshtein, 1966] V. Levenshtein. Binary codes capable of correcting deletions, insertions, and reversals. Soviet Physics Doklady, 10(8):707-710, 1966.
13. [Lin, 1994] D. Lin. Principar: An efficient, broad-coverage, principle-based parser. In Proceedings of the 15th International Conference on Computational Linguistics, 1994.
14. [Lita et al., 2003] L. Lita, A. Ittycheriah, S. Roukos, and N. Kambhatla. truecasing. In Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics, Japan, 2003.
15. [Maedche and Volz, 2001] A. Maedche and R. Volz. The ontology extraction & maintenance framework: Text-toonto. In Proceedings of the IEEE International Conference on Data Mining, California, USA, 2001.
16. [Mikheev, 2002] A. Mikheev. Periods, capitalized words, etc. Computational Linguistics, 28(i):289-318, 2002.
17. [Ng et al., 1999] H. Ng, C. Lim, and L. Koo. Learning to recognize tables in free text. In Proceedings of the 37th Annual Meeting of the Association for Computational Linguistics on Computational Linguistics, 1999.
18. [Novacek and Smrz, 2005] V. Novacek and P. Smrz. Bolea new bio-ontology learning platform. In Proceedings of the Workshop on Biomedical Ontologies and Text Processing, 2005.
19. [Odell and Russell, 1922] M. Odell and R. Russell. U.s. patent numbers 1, 435, 663. U.S. Patent Office, Washington, D.C., 1922.
20. [Pakhomov, 2001] S. Pakhomov. Semi-supervised maximum entropy based approach to acronym and abbreviation normalization in medical texts. In Proceedings of the 40th Annual Meeting on Association for Computational Linguistics, 2001.
21. [Park and Byrd, 2001] Y. Park and R. Byrd. Hybrid text mining for finding abbreviations and their definitions. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), 2001.
22. [Philips, 1990] L. Philips. Hanging on the metaphone. Computer Language Magazine, 7(12):38-44, 1990.
23. [Schwartz and Hearst, 2003] A. Schwartz and M. Hearst. A simple algorithm for identifying abbreviation definitions in biomedical text. In Proceedings of the Pacific Symposium on Biocomputing (PSB), 2003.
24. [Smith and Waterman, 1981] T. Smith and M. Waterman. Identification of common molecular subsequences. Journal of Molecular Biology, 147(1):195-197, 1981.
25. [Sproat et al., 2001] R. Sproat, A. Black, S. Chen, S. Kumar, M. Ostendorf, and C. Richards. Normalization of non-standard words. Computer Speech & Language, 15(3):287-333, 2001.
26. [Stevenson and Gaizauskas, 2000] M. Stevenson and R. Gaizauskas. Experiments on sentence boundary detection. In Proceedings of the 6th Conference on Applied Natural Language Processing, 2000.
27. [Tang et al., 2005] J. Tang, H. Li, Y. Cao, and Z. Tang. Email data cleaning. In Proceedings of the 11th ACM SIGKDD International Conference on Knowledge Discovery in Data Mining, 2005.
28. [Wagner and Fischer, 1974] R. Wagner and M. Fischer. The string-to-string correction problem. Journal of the ACM, 21(1):168-173, 1974.
29. [Wong et al., 2006a] W. Wong, W. Liu, and M. Bennamoun. Integrated scoring for spelling error correction, abbreviation expansion and case restoration in dirty text. Accepted for the Australasian Conference on Data Mining, Sydney, 2006.
30. [Wong et al., 2006b] W. Wong, W. Liu, and M. Bennamoun. Progress and open problems in ontology engineering from text. Submitted to the Journal of Web Semantics, 2006.
31. [Xu et al., 2002] F. Xu, D. Kurz, J. Piskorski, and S. Schmeier. An domain adaptive approach to automatic acquisition of domain relevant terms and their relations with bootstrapping. In Proceedings of the 3rd International Conference on Language Resources and Evaluation (LREC), Canary island, Spain, 2002.