Unsupervised Part-of-Speech Tagging in the Large

Research on Language and Computation

Volumn 7, Issue 2, 2009, Pages 101-135

  Biemann, Chris ^a  

^a MICROSOFT   (United States)

Author keywords

Application based evaluation; Graph clustering; Induction of parts of speech; Unsupervised and knowledge free NLP

Indexed keywords

EID: 77956695088     PISSN: 15707075     EISSN: 15728706     Source Type: Journal    
DOI: 10.1007/s11168-010-9067-9     Document Type: Article

References (52)

1. Banko, M., & Brill, E. (2001). Scaling to very very large corpora for natural language disambiguation. In Proceedings of ACL-01 (pp. 26-33).
2. Biemann, C. (2006). Chinese whispers-an efficient graph clustering algorithm and its application to natural language processing problems. In Proceedings of textGraphs: The second workshop on graph based methods for natural language processing (pp. 73-80). New York City, June. Association for Computational Linguistics.
3. Biemann, C. (2007). Unsupervised and knoweldge-free natural language processing in the structure discovery paradigm. Ph. D. thesis, University of Leipzig.
4. Biemann, C., Giuliano, C., & Gliozzo A. (2007). Unsupervised part-of-speech tagging supporting supervised methods. In Proceedings of recent advances in natural language processing (RANLP-07), Borovets, Bulgaria.
5. Brants, T. (2000). TnT: A statistical part-of-speech tagger. In Proceedings of the sixth conference on applied natural language processing (ANLP-00) (pp. 224-231). San Francisco, CA, USA: Morgan Kaufmann Publishers Inc.
6. Brants, T., Hendriks, R., Kramp, S., Krenn, B., Preis, C., Skut, W., et al. (1997). Das NEGRA-Annotationsschema. Negra project report, Universität des Saarlandes, Saarbrücken.
7. Brill, E. (1992). A simple rule-based part of speech tagger. In Proceedings of the third conference on applied natural language processing (ANLP-92) (pp. 152-155). Morristown, NJ, USA: Association for Computational Linguistics.
8. Brown P. F., Della Pietra V. J., deSouza P. V., Lai J. C., Mercer R. L. (1992) Class-based n-gram models of natural language. Computational Linguistics 18(4): 467-479.
9. Burnard L. (1995) Users reference guide for the british national corpus. Oxford University Computing Service, Oxford, U. K.
10. Charniak, E., Hendrickson, C., Jacobson N., & Perkowitz, M. (1993). Equations for part-of-speech tagging. In National Conference on Artificial Intelligence (pp. 784-789).
11. Clark, A. (2000). Inducing syntactic categories by context distribution clustering. In Cardie, C., Daelemans, W., Nédellec, C., & Tjong Kim Sang, E., (Eds.), In Proceedings of the fourth conference on computational natural language learning and of the second learning language in logic workshop, Lisbon, 2000 (pp. 91-94). Somerset, New Jersey: Association for Computational Linguistics.
12. Clark, A. (2003). Combining distributional and morphological information for part of speech induction. In Proceedings of the tenth conference on European chapter of the Association for Computational Linguistics (EACL-03) (pp. 59-66). Morristown, NJ, USA: Association for Computational Linguistics.
13. Cucerzan, S., & Yarowsky, D. (1999). Language independent named entity recognition combining morphological and contextual evidence. In Proceedings of 1999 joint SIGDAT conference on EMNLP and VLC (pp. 132-138). College Park.
14. Dhillon, I. S., Mallela, S., & Modha, D. S. (2003). Information-theoretic co-clustering. In Proceedings of The ninth ACM SIGKDD international conference on knowledge discovery and data mining(KDD-2003) (pp. 89-98).
15. Dunning T. E. (1993) Accurate methods for the statistics of surprise and coincidence. Computational Linguistics 19(1): 61-74.
16. Eiken, U. C., Liseth, A. T., Witschel, H. F., Richter, M., & Biemann, C. (2006). Ord i dag: Mining Norwegian daily newswire. In Proceedings of the FinTAL. Turku, Finland.
17. Ertöz, L., Steinbach, M., & Kumar, V. (2002). A new shared nearest neighbor clustering algorithm and its applications. In Proceedings of workshop on clustering high dimensional data and its applications (pp. 105-115).
18. Finch, S., & Chater, N. (1992). Bootstrapping syntactic categories using statistical methods. In Background and experiments in machine learning of natural language: Proceedings of the 1st SHOE Workshop (pp. 229-235). Brabant, Holland: Katholieke Universiteit.
19. Freitag, D. (2004a). Toward unsupervised whole-corpus tagging. In Proceedings of the 20th international conference on Computational Linguistics (COLING-04) (p. 357). Morristown, NJ, USA: Association for Computational Linguistics.
20. Freitag, D. (2004b). Trained named entity recognition using distributional clusters. In Proceedings of EMNLP-04, (pp. 262-269).
21. Garside R., Leech G., Sampson G. (1987) The computational analysis of English: A corpus-based approach. Longman, Harlow, UK.
22. Gauch, S., & Futrelle, R. (1994). Experiments in automatic word class and word sense identification for information retrieval. In Proceedings of the 3rd annual symposium on document analysis and information retrieval (pp. 425-434). Las Vegas, NV, April.
23. Gliozzo, A. M. (2005). Semantic domains in computational linguistics. Ph. D. thesis, University of Trento, Italy.
24. Gliozzo, A. M, Giuliano, C., & Strapparava, C. (2005). Domain kernels for word sense disambiguation. In Proceedings of the 43rd annual meeting of the association for computational linguistics (ACL-05) (pp. 403-410). Ann Arbor, Michigan, USA.
25. Goldwater, S., & Griffiths, T. (2007). A fully bayesian approach to unsupervised part-of-speech tagging. In Proceedings of the 45th annual meeting of the association of computational linguistics (pp. 744-751). Prague, Czech Republic, June. Association for Computational Linguistics.
26. Hagen, K., Johannessen J. B., & Nøklestad, A. (2000). A constraint-based tagger for Norwegian. In Lindberg, C.-E. og S. Nordahl Lund (red.) Proceedings of 17th scandinavian conference of linguistics, vol. I. Odense: Odense Working Papers in Language and Communication, I(19).
27. Haghighi, A., & Klein, D. (2006). Prototype-driven learning for sequence models. In Proceedings of the human language technology conference of the North American chapter of the association of computational linguistics (HLT-NAACL-06). New York, NY, USA.
28. Harris Z. S. (1968) Mathematical structures of language. Interscience Publishers, New York.
29. Hal D. III, Daniel M. (2006) Domain adaptation for statistical classifiers. Journal of Artificial Intelligence Research (JAIR) 26: 101-126.
30. Knuth D. E. (1998) The art of computer programming, volume 3: (2nd ed.) sorting and searching. Addison Wesley Longman Publishing Co., Inc., Redwood City, CA, USA.
31. Lafferty, J., McCallum, A., & Pereira, F. (2001). Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In Proceedings of the 18th international conference on machine learning (ICML-01) (pp 282-289). San Francisco, CA: Morgan Kaufmann.
32. McCallum, A. K. (2002). Mallet: A machine learning for language toolkit. http://mallet. cs. umass. edu.
33. Mihalcea, R., Chklovsky, T., & Kilgarriff, A. (2004). The SENSEVAL-3 english lexical sample task. In Proceedings of SENSEVAL-3: Third international workshop on the evaluation of systems for the semantic analysis of text (pp. 25-28). New Brunswick, NJ, USA.
34. Miller G. A., Beckwith R. T., Fellbaum C. D., Gross D., Miller K. (1990) Wordnet: An on-line lexical database. International Journal of Lexicography 3(4): 235-244.
35. Miller G. A., Charles W. G. (1991) Contextual correlates of semantic similarity. Language and Cognitive Processes 6(1): 1-28.
36. Ney H., Essen U., Knese R. (1994) On structuring probabilistic dependences in stochastic language modelling. Computer Speech and Language 8(1): 1-38.
37. Noreen E. W. (1989) Computer-intensive methods for testing hypotheses: An introduction. Wiley-Interscience, NY.
38. Peters, C. (Ed.). (2006). Working notes for the CLEF 2006 Workshop. Alicante, Spain.
39. Potts R. B. (1952) Some generalized order-disorder transformations. Proceedings of the Cambridge Philosophical Society 48: 106-109.
40. Quasthoff, U., Richter, M., & Biemann, C. (2006). Corpus portal for search in monolingual corpora. In Proceedings of the fifth international conference on language resources and evaluation (LREC-06) (pp. 1799-1802).
41. Rapp, R. (2005). A practical solution to the problem of automatic part-of-speech induction from text. In Conference companion volume of the 43rd annual meeting of the association for computational linguistics (ACL-05). Ann Arbor, Michigan, USA.
42. Roth, D., & van den Bosch, A. (Eds.). (2002). Proceedings of the sixth workshop on computational language learning (CoNLL-02). Taipei, Taiwan.
43. Schmid, H. (1994). Probabilistic part-of-speech tagging using decision trees. In International conference on new methods in language processing. Manchester, UK.
44. Schütze, H. (1993). Part-of-speech induction from scratch. In Proceedings of the 31st annual meeting on association for computational linguistics (ACL-93) (pp. 251-258). Morristown, NJ, USA: Association for Computational Linguistics.
45. Schütze, H. (1995). Distributional part-of-speech tagging. In Proceedings of the 7th conference on European chapter of the association for Computational Linguistics (EACL-95) (pp. 141-148), San Francisco, CA, USA: Morgan Kaufmann Publishers Inc.
46. Tjong Kim Sang, E., & Buchholz, S. (2000). Introduction to the conll-2000 shared task: Chunking. In Proceedings of CoNLL-2000, Lisbon, Portugal.
47. Toutanova, K., Klein, D., Manning, C. D., & Singer, Y. (2003). Feature-rich part-of-speech tagging with a cyclic dependency network. In Proceedings of HLT-NAACL 2003 (pp. 252-259).
48. van den Bosch, A., & Buchholz, S. (2001) Shallow parsing on the basis of words only: A case study. In ACL '02: Proceedings of the 40th annual meeting on association for computational linguistics (pp. 433-440). Morristown, NJ, USA: Association for Computational Linguistics.
49. van Rijsbergen C. J. (1979) Information retrieval, 2nd edition. Department of Computer Science, University of Glasgow.
50. Witschel, H. F., & Biemann, C. (2005). Rigorous dimensionality reduction through linguistically motivated feature selection for text categorization. In Proceedings of NODALIDA'05, Joensuu, Finland.
51. Wu Z., Leahy R. (1993) An optimal graph theoretic approach to data clustering: Theory and its application to image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence 15(11): 1101-1113.
52. Yarowsky, D. (1994). Decision lists for lexical ambiguity resolution: application to accent restoration in spanish and french. In Proceedings of the 32nd annual meeting on association for computational linguistics (ACL-94) (pp. 88-95). Las Cruces, New Mexico.