Web-based frequency dictionaries for medium density languages

EACL 2006 - 11th Conference of the European Chapter of the Association for Computational Linguistics, Proceedings of the 2nd International Workshop on Web as Corpus, WAC 2006

Volumn , Issue , 2006, Pages 1-8

  Kornai, András ^a   Halácsy, Péter ^b   Nagy, Viktor ^c   Oravecz, Csaba ^c   Trón, Viktor ^d   Varga, Dániel ^b  

^a MetaCarta Inc   (United States)

^b Media Research and Education Center   (Hungary)

^c Research Institute for Linguistics   (Hungary)

^d UNIVERSITY OF EDINBURGH   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

EXPERIMENT DESIGN; HUNGARIANS; LANGUAGE INDEPENDENTS; LANGUAGE TECHNOLOGY; WEB BASED;

WEBSITES;

EID: 85108583460     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (29)

1. László Antal. 1961. A magyar esetrendszer. Nyelvtudományi Értekezések, 29.
2. Jason Baldridge, Thomas Morton, and Gann Bierner. 2001. The opennlp maximum entropy package. http://maxent.sourceforge.net.
3. Thorsten Brants. 2000. TnT - a statistical part-of-speech tagger. In Proceedings of the Sixth Applied Natural Language Processing Conference (ANLP-2000), Seattle, WA.
4. Joan Bybee. 2003. Mechanisms of change in grammaticization: the role of frequency. In Brian Joseph and Richard Janda, editors, Handbook of Historical Linguistics, pages 602-623. Blackwell.
5. Junghoo Cho and Hector Garcia-Molina. 2000. The evolution of the web and implications for an incremental crawler. In VLDB'00: Proceedings of the 26th International Conference on Very Large Data Bases, pages 200-209, San Francisco, CA, USA. Morgan Kaufmann Publishers Inc.
6. Kenneth Ward Church. 1988. A stochastic parts program and noun phrase parser for unrestricted text. In Proceedings of the second conference on Applied natural language processing, pages 136-143, Morristown, NJ, USA. Association for Computational Linguistics.
7. Dóra Csendes, Jánós Csirik, and Tibor Gyimóthy. 2004. The Szeged Corpus: A POS tagged and syntactically annotated Hungarian natural language corpus. In Karel Pala Petr Sojka, Ivan Kopecek, editor, Text, Speech and Dialogue: 7th International Conference, TSD, pages 41-47.
8. Ludmila Dimitrova, Tomaz Erjavec, Nancy Ide, Heiki Jaan Kaalep, Vladimir Petkevic, and Dan Tufiş. 1998. Multext-east: Parallel and comparable corpora and lexicons for six central and eastern euro-pean languages. In Christian Boitet and Pete White-lock, editors, Proceedings of the Thirty-Sixth Annual Meeting of the Association for Computational Linguistics and Seventeenth International Conference on Computational Linguistics, pages 315-319, San Francisco, California. Morgan Kaufmann Publishers.
9. Tomaž Erjavec and Sašo Džeroski. 2004. Machine learning of morphosyntactic structure: Lemmatizing unknown Slovene words. Applied Artificial Intelligence, 18(1):17-41.
10. Jan Hajič, Pavel Krbec, Karel Oliva, Pavel Květoň, and Vladimír Petkevič. 2001. Serial combination of rules and statistics: A case study in Czech tagging. In Proceedings of the 39th Association of Computational Linguistics Conference, pages 260-267, Toulouse, France.
11. Dilek Z. Hakkani-Tür, Kemal Oflazer, and Gökhan Tür. 2000. Statistical morphological disambiguation for agglutinative languages. In Proceedings of the 18th conference on Computational linguistics, pages 285-291, Morristown, NJ, USA. Association for Computational Linguistics.
12. Péter Halácsy, András Kornai, László Németh, András Rung, István Szakadát, and Viktor Trón. 2004. Creating open language resources for Hungarian. In Proceedings of Language Resources and Evaluation Conference (LREC04). European Language Resources Association.
13. Péter Halácsy, András Kornai, and Dániel Varga. 2005. Morfológiai egyértelműsítés maximum entrópia módszerrel (morphological disambiguation with the maxent method). In Proc. 3rd Hungarian Computational Linguistics Conf. Szegedi Tu-dományegyetem.
14. Adam Kilgarriff and Gregory Grefenstette. 2003. Introduction to the special issue on the web as corpus. Computational Linguistics, 29(3):333-348.
15. András Kornai, Marc Krellenstein, Michael Mulligan, David Twomey, Fruzsina Veress, and Alec Wysoker. 2003. Classifying the hungarian web. In A. Copes-take and J. Hajic, editors, Proc. EACL, pages 203-210.
16. András Kornai. 1992. Frequency in morphology. In I. Kenesei, editor, Approaches to Hungarian, volume IV, pages 246-268.
17. András Kornai. 1999. Zipf's law outside the middle range. In J. Rogers, editor, Proc. Sixth Meeting on Mathematics of Language, pages 347-356. University of Central Florida.
18. John Lafferty, Andrew McCallum, and Fernando Pereira. 2001. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In Proceedings of the 18th International Conference on Machine Learning, pages 282-289. Morgan Kaufmann, San Francisco, CA.
19. Mirella Lapata and Frank Keller. 2004. The web as a baseline: Evaluating the performance of unsupervised web-based models for a range of NLP tasks. In Daniel Marcu Susan Dumais and Salim Roukos, editors, HLT-NAACL 2004: Main Proceedings, pages 121-128, Boston, Massachusetts, USA, May 2 - May 7. Association for Computational Linguistics.
20. Anke Luedeling, Stefan Evert, and Marco Baroni. 2005. Using web data for linguistic purposes. In Marianne Hundt, Caroline Biewer, and Nadjia Nesselhauf, editors, Corpus linguistics and the Web. Rodopi.
21. Andrew McCallum, Dayne Freitag, and Fernando Pereira. 2000. Maximum entropy Markov models for information extraction and segmentation. In Proceedings of the 17th International Conference on Machine Learning, pages 591-598. Morgan Kaufmann, San Francisco, CA.
22. Viktor Nagy. 2005. A magyar főnévi inflexió statisztikai modellje (statistical model of nominal inflection in hungarian. In Proc. Kodolányi-ELTE Conf.
23. Csaba Oravecz and Péter Dienes. 2002. Efficient stochastic part-of-speech tagging for Hungarian. In Proceedings of the Third International Conference on Language Resources and Evaluation (LREC2002), pages 710-717.
24. Adwait Ratnaparkhi. 1996. A maximum entropy model for part-of-speech tagging. In Karel Pala Petr Sojka, Ivan Kopecek, editor, Proceedings of the Conference on Empirical Methods in Natural Language Processing, pages 133-142, University of Pennsylvania.
25. Noah A. Smith, David A. Smith, and Roy W. Tromble. 2005. Context-based morphological disambiguation with random fields. In Proceedings of the Conference on Human Language Technology and Empirical Methods in Natural Language Processing, Vancouver.
26. Edward L. Thorndike. 1941. The Teaching of English Suffixes. Teachers College, Columbia University.
27. Viktor Trón, György Gyepesi, Péter Halácsy, András Kornai, László Németh, and Dániel Varga. 2005. Hunmorph: open source word analysis. In Proceeding of the ACL 2005 Workshop on Software.
28. Dan Tufiş, Péter Dienes, Csaba Oravecz, and Tamás Váradi. 2000. Principled hidden tagset design for tiered tagging of Hungarian. In Proceedings of the Second International Conference on Language Resources and Evaluation.
29. Dániel Varga, László Németh, Péter Halácsy, András Kornai, Viktor Trón, and Viktor Nagy. 2005. Parallel corpora for medium density languages. In Proceedings of the Recent Advances in Natural Language Processing 2005 Conference, pages 590-596, Borovets. Bulgaria.