Integrated scoring for spelling error correction, abbreviation expansion and case restoration in dirty text

Conferences in Research and Practice in Information Technology Series

Volumn 61, Issue , 2006, Pages 83-89

  Wong, Wilson ^a   Liu, Wei ^a   Benna, Mohammed ^a  

^a UNIVERSITY OF WESTERN AUSTRALIA   (Australia)

Author keywords

Abbreviation expansion; Case restoration; Dirty text; Spelling error correction; Text cleaning; Text preprocessing

Indexed keywords

ABBREVIATION EXPANSION; DIRTY TEXT; INTEGRATED APPROACH; ONLINE SOURCES; ONTOLOGY ENGINEERING; SPEECH APPLICATIONS; TEXT PREPROCESSING;

DATA MINING; ERROR CORRECTION; WEBSITES;

RESTORATION;

EID: 78650696564     PISSN: 14451336     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Article

References (35)

1. Atkinson, K. (2006), 'Gnu aspell 0.60.4', http://aspell.sourceforge.net/.
2. Castellanos, M. (2003), Hotminer: Discovering hot topics on the web, in M. Berry, ed., 'Survey of Text Mining', Springer-Verlag.
3. Chan, S., He, B. & Ounis, I. (2005), An in-depth survey on the automatic detection and correction of spelling mistakes, in 'Proceedings of the 5th Dutch-Belgian Information Retrieval Workshop (DIR)'.
4. Cimiano, P. & Staab, S. (2005), Learning concept hierarchies from text with a guided agglomerative clustering algorithm, in 'Proceedings of the Workshop on Learning and Extending Lexical Ontologies with Machine Learning Methods', Bonn, Germany.
5. Clark, A. (2003), Pre-processing very noisy text, in 'Proceedings of the Workshop on Shallow Processing of Large Corpora at Corpus Linguistics'.
6. Damerau, F. (1964), 'A technique for computer detection and correction of spelling errors', Communications of the ACM 7(3), 171-176.
7. Degeratu, M. & Hatzivassiloglou, V. (2002), Building automatically a business registration ontology, in 'Proceedings of the ACM Annual National Conference on Digital Government Research'.
8. Holmes, D. & McCabe, C. (2002), Improving precision and recall for soundex retrieval, in 'Proceedings of the International Conference on Information Technology: Coding and Computing (ITCC)'.
9. Kietz, J., Volz, R. & Maedche, A. (2000), Extracting a domain-specific ontology from a corporate intranet, in 'Proceedings of the 4th Conference on Computational Natural Language Learning', Lisbon, Portugal.
10. Kuenning, G. (2006), 'International ispell 3.3.02', http://ficus-www.cs.ucla.edu/geoff/ispell.html.
11. Kukich, K. (1992), 'Technique for automatically correcting words in text', ACM Computing Surveys 24(4), 377- 439.
12. Lait, A. & Randell, B. (1993), An assessment of name matching algorithms, Technical report, University of Newcastle upon Tyne.
13. Levenshtein, V. (1966), 'Binary codes capable of correcting deletions, insertions, and reversals', Soviet Physics Doklady 10(8), 707-710.
14. Lita, L., Ittycheriah, A., Roukos, S. & Kambhatla, N. (2003), truecasing, in 'Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics', Japan.
15. Maedche, A. & Volz, R. (2001), The ontology extraction & maintenance framework: Text-to-onto, in 'Proceedings of the IEEE International Conference on Data Mining', California, USA.
16. Mikheev, A. (1999), A knowledge-free method for capitalized word disambiguation, in 'Proceedings of the 37th Annual Meeting of the Association for Computational Linguistics'.
17. Mikheev, A. (2002), 'Periods, capitalized words, etc.', Computational Linguistics 28(3), 289-318.
18. Novacek, V. & Smrz, P. (2005a), Bole - a new bioontology learning platform, in 'Proceedings of the Workshop on Biomedical Ontologies and Text Processing'.
19. Novacek, V. & Smrz, P. (2005b), Ole - a new ontology learning platform, in 'Proceedings of the International Workshop on Text Mining'.
20. Odell, M. & Russell, R. (1918), U.s. patent numbers 1,261,167. U.S. Patent Office, Washington, D.C.
21. Odell, M. & Russell, R. (1922), U.s. patent numbers 1,435,663. U.S. Patent Office, Washington, D.C.
22. Pakhomov, S. (2001), Semi-supervised maximum entropy based approach to acronym and abbreviation normalization in medical texts, in 'Proceedings of the 40th Annual Meeting on Association for Computational Linguistics'.
23. Park, Y. & Byrd, R. (2001), Hybrid text mining for finding abbreviations and their definitions, in 'Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP)'.
24. Philips, L. (1990), 'Hanging on the metaphone', Computer Language Magazine 7(12), 38-44.
25. Robertson, S. (2004), 'Understanding inverse document frequency: On theoretical arguments for idf', Journal of Documentation 60(5), 503-520.
26. Sanchez, D. & Moreno, A. (2005), Automatic discovery of synonyms and lexicalizations from the web, in 'Proceedings of the 8th Catalan Conference on Artificial Intelligence'.
27. Schwartz, A. & Hearst, M. (2003), A simple algorithm for identifying abbreviation definitions in biomedical text, in 'Proceedings of the Pacific Symposium on Biocomputing (PSB)'.
28. Smith, T. & Waterman, M. (1981), 'Identification of common molecular subsequences', Journal of Molecular Biology 147(1), 195-197.
29. Sombatsrisomboon, R., Matsuo, Y. & Ishizuka, M. (2003), Acquisition of hypernyms and hyponyms from the www, in 'Proceedings of the 2d International Workshop on Active Mining', Japan.
30. Sproat, R., Black, A., Chen, S., Kumar, S., Ostendorf, M. & Richards, C. (2001), 'Normalization of non-standard words', Computer Speech & Language 15(3), 287-333.
31. Tang, J., Li, H., Cao, Y. & Tang, Z. (2005), Email data cleaning, in 'Proceedings of the 11th ACM SIGKDD International Conference on Knowledge Discovery in Data Mining'.
32. Turney, P. (2001), Mining the web for synonyms: Pmi-ir versus lsa on toefl, in 'Proceedings of the 12th European Conference on Machine Learning (ECML)', Freiburg, Germany.
33. Wagner, R. & Fischer, M. (1974), 'The string-tostring correction problem', Journal of the ACM 21(1), 168-173.
34. Wong, W., Liu, W. & Bennamoun, M. (2006), Progress and open problems in ontology engineering from text. Submitted to the Journal of Web Semantics.
35. Xu, F., Kurz, D., Piskorski, J. & Schmeier, S. (2002), An domain adaptive approach to automatic acquisition of domain relevant terms and their relations with bootstrapping, in 'Proceedings of the 3rd International Conference on Language Resources and Evaluation (LREC)', Canary island, Spain.