Improving accuracy in word class tagging through the combination of machine learning systems

Computational Linguistics

Volumn 27, Issue 2, 2001, Pages 199-229

  Van Halteren, Hans ^a   Daelemans, Walter ^b   Zavrel, Jakub ^b  

^a NONE   (Netherlands)

^b UNIVERSITY OF ANTWERP   (Belgium)

Author keywords

[No Author keywords available]

Indexed keywords

HIDDEN MARKOV MODELS; INDUSTRIAL PLANTS; MACHINE LEARNING; METADATA;

DATA DRIVEN; ERROR RATE; INDIVIDUAL SYSTEMS; LANGUAGE MODEL; TRANSFORMATION RULES; VOTING STRATEGIES;

COMPUTATIONAL LINGUISTICS;

EID: 0038765969     PISSN: 08912017     EISSN: None     Source Type: Journal    
DOI: 10.1162/089120101750300508     Document Type: Article

References (51)

1. Abney, S., R. E. Schapire, and Y. Singer. 1999. Boosting applied to tagging and PP attachment. In Proceedings of the 3999 Joint SIGDAT Conference on Empirical Methods in Natural Language Processing and Very Large Corpora, pages 38-45.
2. Agirre, E., K. Gojenola, K. Sarasola, and A. Voutilainen. 1998. Towards a single proposal in spelling correction. In COLING-ACL '98, pages 22-28.
3. Alegre, M., J. Sopena, and A. Lloberas. 1999. PP-attachment: A committee machine approach. In Proceedings of the 3999 Joint SIGDAT Conference on Empirical Methods in Natural Language Processing and Very Large Corpora, pages 231-238.
4. Ali, K. M., and M. J. Pazzani. 1996. Error reduction through learning multiple descriptions. Machine Learning, 24(3):173-202.
5. Alpaydin, E. 1998. Techniques for combining multiple learners. In E. Alpaydin, editor, Proceedings of Engineering of Intelligent Systems, pages 6-12.
6. Berger, A., S. Della Pietra, and V. Della Pietra. 1996. A maximum entropy approach to natural language processing. Computational Linguistics, 22(1):39-71.
7. Berghmans, J. 1994. Wotan, een automatische grammatikale tagger voor het Nederlands. Master's thesis, Dept. of Language and Speech, University of Nijmegen.
8. Brants, T. 2000. TnT - A statistical part-of-speech tagger. In Proceedings of the Sixth Applied Natural Language Processing Conference, (ANLP-2000), pages 224-231, Seattle, WA.
9. Breiman, L. 1996a. Bagging predictors. Machine Learning, 24(2):123-140.
10. Breiman, L. 1996b. Stacked regressions. Machine Learning, 24(3):49-64.
11. Brill, E. 1992. A simple rule-based part-of-speech tagger. In Proceedings of the Third ACL Conference on Applied NLP, pages 152-155, Trento, Italy.
12. Brill, E. 1994. Some advances in transformation-based part-of-speech tagging. In Proceedings of the Twelfth National Conference on Artificial Intelligence (AAAI '94).
13. Brill, E. and Jun Wu. 1998. Classifier combination for improved lexical disambiguation. In COLING-ACL '98: 36th Annual Meeting of the Association for Computational Linguistics and 17th International Conference on Computational Linguistics, pages 191-195, Montreal, Quebec, Canada.
14. Chan, P. K., S. J. Stolfo, and D. Wolpert. 1999. Guest editors' introduction. Special Issue on Integrating Multiple Learned Models for Improving and Scaling Machine Learning Algorithms. Machine Learning, 36(1-2):5-7.
15. Charniak, E. 1993. Statistical Language Learning. MIT Press, Cambridge, MA.
16. Chen, J., S. Bangalore, and K. Vijay-Shanker. 1999. New models for improving supertag disambiguation. In Proceedings of the 1999 Joint SIGDAT Conference on Empirical Methods in Natural Language Processing and Very Large Corpora, pages 188-195.
17. Cherkauer, K. J. 1996. Human expert-level performance on a scientific image analysis task by a system using combined artificial neural networks. In P. Chan, editor, Working Notes of the AAAI Workshop on Integrating Multiple Learned Models, pages 15-21.
18. Church, K. W. 1988. A stochastic parts program and noun phrase parser for unrestricted text. In Proceedings of the Second Conference on Applied Natural Language Processing.
19. Daelemans, W., A. Van den Bosch, and A. Weijters. 1997. IGTree: Using trees for compression and classification in lazy learning algorithms. Artificial Intelligence Review, 11:407-423.
20. Daelemans, W., J. Zavrel, P. Berck, and S. Gillis. 1996. MBT: A memory-based part of speech tagger generator. In E. Ejerhed and I. Dagan, editors, Proceedings of the Fourth Workshop on Very Large Corpora, pages 14-27. ACL SIGDAT.
21. Daelemans, W., J. Zavrel, K. Van der Sloot, and A. Van den Bosch. 1999. TiMBL: Tilburg memory based learner, version 2.0, reference manual. Technical Report ILK-9901, ILK, Tilburg University.
22. Dehaspe, L. 1997. Maximum entropy modeling with clausal constraints. In Inductive Logic Programming: Proceedings of the 7th International Workshop (ILP-97), | Lecture Notes in Artificial Intelligence, 1297, pages 109-124. Springer Verlag.
23. DeRose, S. 1988. Grammatical category disambiguation by statistical optimization. Computational Linguistics, 14:31-39.
24. Dietterich, T. G. 1997. Machine learning research: Four current directions. AI Magazine, 18(4):97-136.
25. Dietterich, T. G. 1998. Approximate statistical tests for comparing supervised classification learning algorithms. Neural Computation, 10(7):1895-1924.
26. Dietterich, T. G. and G. Bakiri. 1995. Solving multiclass learning problems via error-correcting output codes. Journal of Artificial Intelligence Research, 2:263-286.
27. Freund, Y. and R. E. Schapire. 1996. Experiments with a new boosting algorithm. In L. Saitta, editor, Proceedings of the 13th International Conference on Machine Learning, ICML '96, pages 148-156, San Francisco, CA. Morgan Kaufmann.
28. Geerts, G., W. Haeseryn, J. de Rooij, and M. van der Toorn. 1984. Algemene Nederlandse Spraakkunst. Wolters-Noordhoff, Groningen and Wolters, Leuven.
29. Golding, A. R. and D. Roth. 1999. A winnow-based approach to context-sensitive spelling correction. Machine Learning, 34(1-3):107-130.
30. Henderson, J. and E. Brill. 1999. Exploiting diversity in natural language processing: Combining parsers. In Proceedings of the 1999 Joint SIGDAT Conference on Empirical Methods in Natural Language Processing and Very Large Corpora, pages 187-194.
31. Johansson, S. 1986. The Tagged LOB Corpus: User's Manual. Norwegian Computing Centre for the Humanities, Bergen, Norway.
32. Marcus, M., B. Santorini, and M. A. Marcinkiewicz. 1993. Building a large annotated corpus of English: The Penn Treebank. Computational Linguistics, 19(2):313-330.
33. Marquez, L., H. Rodríguez, J. Carmona, and J. Montolio. 1999. Improving POS tagging using machine-learning techniques. In Proceedings of the 1999 faint SIGDAT Conference on Empirical Methods in Natural Language Processing and Very Large Corpora, pages 53-62.
34. Quinlan, J. R. 1993. c4.5: Programs for Machine Learning. Morgan Kaufmann, San Mateo, CA.
35. Ratnaparkhi, A. 1996. A maximum entropy model for part-of-speech tagging. In Proceedings of the Conference on Empirical Methods in Natural Language Processing, pages 133-142, University of Pennsylvania.
36. Rigau, G., J. Atserias, and E. Agirre. 1997. Combining unsupervised lexical knowledge methods for word sense disambiguation. In Proceedings of ACL/EACL '97, pages 48-55.
37. Roth, D. 1998. Learning to resolve natural language ambiguities: A unified approach. In Proceedings of AAAI '98, pages 806-813.
38. Samuelsson, Christer. 1996. Handling sparse data by successive abstraction. In Proceedings of the 16th International Conference on Computational Linguistics, COLING-96, Copenhagen, Denmark.
39. Schapire, R. E. and Y. Singer. 1998. BoosTexter: A system for multiclass multi-label text categorization. Technical Report, AT&T Labs. To appear in Machine Learning.
40. Schapire, R. E., Y. Singer, and A. Singhal. 1998. Boosting and Rocchio applied to text filtering. In Proceedings of the 21st Annual International Conference on Research and Development in Information Retrieval, (SIGIR '98), pages 215-223.
41. Ting, K. M. and I. H. Witten. 1997a. Stacked generalization: When does it work? In International Joint Conference on Artificial Intelligence, Japan, pages 866-871.
42. Ting, K. M. and I. H. Witten. 1997b. Stacking bagged and dagged models. In International Conference on Machine Learning, Tennessee, pages 367-375.
43. Tufiş, D. 1999. Tiered tagging and combined language models classifiers. In Proceedings Workshop on Text, Speech, and Dialogue.
44. Uit den Boogaart, P. C. 1975. Woordfrequenties in geschreven en gesproken Nederlands. Utrecht, Oosthoek, Scheltema & Holkema.
45. van Halteren, H. 1996. Comparison of tagging strategies, a prelude to democratic tagging. In S. Hockey and N. Ide, editors, Research in Humanities Computing 4. Selected Papers from the ALLC/ACH Conference, Christ Church, Oxford, April 2992, pages 207-215, Oxford, England. Clarendon Press.
46. van Halteren, H., editor. 1999. Syntactic Wordclass Tagging. Kluwer Academic Publishers, Dordrecht, The Netherlands.
47. van Halteren, H. 2000a. A default first order weight determination procedure for WPDV models. In Proceedings of CoNLL-2000 and LLL-2000, pages 119-122, Lisbon, Portugal.
48. van Halteren, H. 2000b. Chunking with WPDV models. In Proceedings of CoNLL-2000 and LLL-2000, pages 154-156, Lisbon, Portugal.
49. van Halteren, H., J. Zavrel, and W. Daelemans. 1998. Improving data-driven wordclass tagging by system combination. In COLING-ACL '98: 36th Annual Meeting of the Association for Computational Linguistics and 17th International Conference on Computational Linguistics, pages 491-497, Montreal, Quebec, Canada.
50. Wolpert, D. H. 1992. Stacked generalization. Neural Networks, 5:241-259.
51. Zavrel, J. and W. Daelemans. 2000. Bootstrapping a tagged corpus through combination of existing heterogeneous taggers. In Proceedings of the Second International Conference on Language Resources and Evaluation (LREC 2000), pages 17-20.