Orthographic errors in Web pages: Toward cleaner Web corpora

Computational Linguistics

Volumn 32, Issue 3, 2006, Pages 295-340

  Ringlstetter, Christoph ^a   Schulz, Klaus U ^a   Mihov, Stoyan ^b  

^a UNIVERSITY OF MUNICH   (Germany)

^b BULGARIAN ACADEMY OF SCIENCES   (Bulgaria)

Author keywords

[No Author keywords available]

Indexed keywords

ERRORS; LINGUISTICS;

CORPUS LINGUISTICS; GRAMMATICAL ERRORS; HIGH-ACCURACY; LINGUISTIC KNOWLEDGE; NATURAL LANGUAGE TEXT; PUBLIC REPOSITORIES; WEB CORPORA; WEB DOCUMENT;

WEBSITES;

EID: 33748650310     PISSN: 08912017     EISSN: 15309312     Source Type: Journal    
DOI: 10.1162/coli.2006.32.3.295     Document Type: Article

References (43)

1. Amengual, Juan Carlos and Enrique Vidal. 1998. Efficient error-correcting viterbi parsing. IEEE Transactions on PAMI, 20(10):1-109.
2. Baroni, Marco and Silvia Bernardini. 2004. BootCaT: Bootstrapping corpora and terms from the web. In Proceedings of LREC 2004, pages 1313-1316, Lisbon.
3. Boutsis, Sotiris, Stelious Piperidis, and Iason Demiros. 1999. Generating translation lexica from multilingual texts. Applied Artificial Intelligence, 13(6)583-606.
4. Brin, Sergey and Lawrence Page. 1998. The anatomy of a large-scale hypertextual Web search engine. Computer Networks and ISDN Systems, 30:107-117.
5. Brown, Jonathan and Maxine Eskenazi. 2004. Retrieval of authentic documents for reader-specific lexical practice. In Proceedings of the InSTIL/ICALL2004 Symposium on Computer Aided Language Learning, pages 25-28, Venice.
6. Chelba, Ciprian and Frederick Jelinek. 2002. Recognition performance of a structured language model. In Proceedings of Sixth European Conference on Speech Communication and Technology (EUROSPEECH'99), pages 1567-1570, Budapest.
7. Church, Kenneth W. and Robert L. Mercer. 1993. Introduction to the special issue on computational linguistics using large corpora. Computational Linguistics, 19(1):1-24.
8. Dimitrova, Maya, Nicholas Kushmerick, Petia Radeva, and Joan Jose Villanueva. 2003. User assessment of a visual Web genre classifier. In Third International Conference on Visualization, Imaging, and Image Processing, Malaga.
9. Dunning, Ted. 1993. Accurate models for the statistics of surprise and coincidence. Computational Linguistics, 19(1):61-74.
10. Finn, Aidan and Nicholas Kushmerick. 2003. Learning to classify documents according to genre. In IJCAI-03 Workshop on Computational Approaches to Text Style and Synthesis, Acapulco. Journal of the American Society for Information Science and Technology (in press).
11. Fletcher, William H. 2004a. Facilitating the compilation and dissemination of ad-hoc web corpora. In Guy Aston, Silvia Bernardini, and Dominic Stewart, editors, Corpora and Language Learners, number 17 in Studies in Corpus Linguistics. John Benjamins Publishing Company, Amsterdam.
12. Fletcher, William H. 2004b. Making the web more useful as a source for linguistic corpora. In U. Connor and T. Upton, editors, Corpus Linguistics in North America 2002. Rodopi, Amsterdam.
13. Gaizauskas, Robert, George Demetriou, and Kevin Humphreys. 2000. Term recognition in biological science journal articles. In Proceedings of the Workshop on Computational Terminology for Medical and Biological Applications, 2nd International Conference on Natural Language Processing (NLP-2000), pages 37-44, Patras.
14. Gale, William A. and Kenneth W. Church. 1991. Identifying word correspondences in parallel texts. In Proceedings of Fourth DARPA Workshop on Speech and Natural Language, pages 152-157, Pacific Grove, CA.
15. Gartner, Hans-Jürgen. 2003. Extraktion von semantischer Information aus Layout-orientierten Daten. Master's thesis, Technical University of Graz.
16. Grefenstette, Gregory. 1992. Use of syntactic context to produce term association lists for text retrieval. In Proceedings of the 15th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 89-97, Copenhagen.
17. Grefenstette, Gregory. 1999. The WWW as a resource for example-based MT tasks. Paper presented at ASLIB "Translating and the Computer" conference, London.
18. Grefenstette, Gregory. 2001. Very large lexicons. In Computational Linguistics in the Netherlands 2000: Selected Papers from the Eleventh CLIN Meeting, Language and Computers, Amsterdam.
19. Guenthner, Franz. 1996. Electronic lexica and corpora research at CIS. International Journal of Corpus Linguistics, 1(2):287-301.
20. Jelinek, Frederick. 1997. Statistical Methods for Speech Recognition. MIT Press, Cambridge, MA.
21. Kehoe, Andrew and Antoinette Renouf. 2002. WebCorp: Applying the web to linguistics and linguistics to the Web. In Poster Proceedings of the 11th International World Wide Web Conference, WWW02, Honolulu.
22. Kessler, Brett, Geoffrey Nunberg, and Hinrich Schütze. 1997. Automated detection of text genre. In Proceedings of the 35th Annual Meeting of the Association for Computational Linguistics and the 8th Meeting of the European Chapter of the Association for Computational Linguistics, pages 32-38, Madrid.
23. Kilgarriff, Adam and Gregory Grefenstette. 2003. Introduction. Computational Linguistics - Special Issue on the Web as Corpus, 29(3):333-348.
24. Koehn, Philipp, Franz Josef Och, and Daniel Marcu. 2003. Statistical phrase-based translation. In Proceedings of the Human Language Technology and North American Association for Computational Linguistics Conference (HLT/NAACL), Edmonton.
25. Kukich, Karen. 1992. Techniques for automatically correcting words in texts. ACM Computing Surveys, 24(4):377-439.
26. Kumano, Akira and Hideki Hirakawa. 1994. Building a MT dictionary from parallel texts based on linguistic and statistical information. In Proceedings of the 15th International Conference on Computational Linguistics (COLING'94), pages 76-81, Kyoto.
27. Kupiec, Julian. 1993. An algorithm for finding noun phrase correspondences in bilingual corpora. In Proceedings of the 31st Annual Meeting of the Association for Computational Linguistics (ACL'93), pages 17-22, Columbus, OH.
28. Lin, Shian-Hua, Chi-Sheng Shih, Meng Chang Chen, Jan-Ming Ho, Ming-Tat Ko, and Yueh-Ming Huang. 1998. Extracting classification knowledge of internet documents with mining term associations: A semantic approach. In Proceedings of the 21st International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 241-249, Melbourne, Australia.
29. Maier-Meyer, Petra. 1995. Lexikon und automatische Lemmatisierung. Ph.D. thesis, CIS, University of Munich.
30. Morley, Barry, Antoinette Renouf, and Andrew Kehoe. 2003. Linguistic research with the XML/RDF aware WebCorp tool. In Poster Proceedings of the 12th International World Wide Web Conference, WWW03, Budapest.
31. Oh, Alice H. and Alexander I. Rudickny. 2000. Stochastic language generation for spoken dialogue systems. In ANLP/NAACL 2000 Workshop on Conversational Systems, pages 27-32, Seattle.
32. Ostendorf, Mari, Vassilios V. Digalakis, and Owen A. Kimball. 1996. From HMMs to segment models: A unified view of stochastic modeling for speech recognition. IEEE Transactions Speech and Audio Processing, 4(5):360-378.
33. Resnik, Philip and Noah A. Smith. 2003. The web as a parallel corpus. Computational Linguistics - Special Issue on the Web as Corpus, 29(3):349-380.
34. Ringlstetter, Christoph. 2003. OCR-Korrektur und Bestimmung von Levenshtein-Gewichten. Master's thesis, LMU, University of Munich.
35. Schwartz, Lee, Takako Aikawa, and Michel Pahud. 2004. Dynamic language learning tools. In Proceedings of the InSTIL/ICALL2004 Symposium on Computer Aided Language Learning, pages 107-110, Venice.
36. Smadja, Frank A. and Kathleen R. McKeown. 1990. Automatically extracting and representing collocations for language generation. In Proceedings of the 28th Annual Meeting of the Association for Computational Linguistics, pages 252-259, Pittsburgh, PA.
37. Sornlertlamvanich, Virach and Hozumi Tanaka. 1996. The automatic extraction of open compounds from text corpora. In Proceedings of the 16th Conference on Computational Linguistics, pages 1143-1146, Copenhagen.
38. Strohmaier, Christian, Christoph Ringlstetter, Klaus U. Schulz, and Stoyan Mihov. 2003a. Lexical postcorrection of OCR-results: The web as a dynamic secondary dictionary? In Proceedings of the Seventh International Conference on Document Analysis and Recognition (ICDAR 03), pages 1133-1137, Edinburgh.
39. Strohmaier, Christian, Christoph Ringlstetter, Klaus U. Schulz, and Stoyan Mihov.2003b. A visual and interactive tool for optimizing lexical postcorrection of OCR results. In Proceedings of the IEEE Workshop on Document Image Analysis and Recognition, DIAR'03, Madison, WI.
40. Taghva, Kazem and Jeff Gilbreth. 1999. Recognizing acronyms and their definitions. International Journal on Document Analysis and Recognition, 1(4):191-198.
41. Walker, Donald E. and Robert A. Amsler. 1986. The use of machine-readable dictionaries in sublanguage analysis. In Analyzing Language in Restricted Domains: Sublanguage Description and Processing. Lawrence Erlbaum, Hillsdale, NJ, pages 69-83.
42. Way, Andy and Nano Gough. 2003. wEBMT: Developing and validating an example-based machine translation system using the world wide web. Computational Linguistics - Special Issue on the Web as Corpus, 29(3):421-458.
43. Yeates, Stuart, David Bainbridge, and Ian H. Witten. 2000. Using compression to identify acronyms in text. In Proceedings of the Conference on Data Compression, page 582, Snowbird, UT.