Active learning and logarithmic opinion pools for HPSG parse selection

Natural Language Engineering

Volumn 14, Issue 2, 2008, Pages 191-222

  Baldridge, Jason ^a   Osborne, Miles ^b  

^a UNIVERSITY OF TEXAS AT AUSTIN   (United States)

^b UNIVERSITY OF EDINBURGH   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

LINGUISTICS; TEXT PROCESSING;

ACTIVE LEARNING; ENSEMBLE MODELS; LOGARITHMIC OPINION POOLS; MANUAL LABELLING; PARSE SELECTION;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 40949091034     PISSN: 13513249     EISSN: 14698110     Source Type: Journal    
DOI: 10.1017/S1351324906004396     Document Type: Article

References (51)

1. Abe, N. and Mamitsuka, H. (1998) Query learning strategies using boosting and bagging. Proceedings of the 15th International Conference on Machine Learning, pp. 1-10.
2. Argamon-Engelson, S. and Dagan, I. (1999) Committee-based sample selection for probabilistic classifiers. Journal of Artificial Intelligence Research, 11: 335-360.
3. Baldridge, J. and Osborne, M. (2003) Active learning for HPSG parse selection. Proceedings of the 7th Conference on Natural Language Learning, Edmonton, Canada.
4. Baldridge, J. and Osborne, M. (2004) Active Learning and the Total Cost of Annotation. Proceedings of EMNLP 2004, pp. 9-16, Barcelona.
5. Baram, Y., El-Yaniv, R. and Luz, K. (2003) Online choice of active learning algorithms. Proceedings of the 20th International Conference on Machine Learning, pp. 19-26, Washington.
6. Bender, E. M., Flickinger, D. and Oepen, S. (2002) An open-source starter-kit for the rapid development of cross-linguistically consistent broad-coverage precision grammars. In: J. Carroll, N. Oostdijk and R. Sutcliffe, editors, Proceedings of the Workshop on Grammar Engineering and Evaluation at the 19th International Conference on Computational Linguistics, pp. 8-14, Taipei, Taiwan.
7. Bond, F., Fujita, S., Hashimoto, C., Kasahara, K., Nariyama, S., Nichols, E., Otani, A., Tanaka, T. and Amano, S. (2004) The Hinoki Treebank: A treebank for text understanding. Proceedings of the 1st International Joint Conference on Natural Language Processing, pp. 7-10, Sanya City, Hainan Island, China.
8. Carter, D. (1997) The Treebanker. a tool for supervised training of parsed corpora. Proceedings of the Workshop on Computational Environments for Grammar Development and Linguistic Engineering, pp. 9-15, Madrid, Spain.
9. Castelli, V. and Cover, T. M. (1996) On the Exponential Value of Labeled and Unlabeled Samples in Pattern Recognition with an Unknown Mixing Parameter. Pattern Recognition Letters, 16: 105-111.
10. Charniak, E. and Johnson, M. (2005) Course to fine n-best parsing and maxent discriminative reranking. Proceedings of the 43th Meeting of the Association for Computational Linguistics, pp. 173-180, Ann Arbor, MI.
11. Cohn, D. A., Ghahramani, Z. and Jordan, M. I. (1995) Active learning with statistical models. In: G. Tesauro, D. Touretzky and T. Leen, editors, Advances in Neural Information Processing Systems, volume 7, pp. 705-712. MIT Press.
12. Collins, M. (2000) Discriminative reranking for natural language parsing. n Proceedings of ICML 2000.
13. Collobert, R. and Bengio, S. (2001) SVMTorch: Support Vector Machines for large-scale regression problems. Machine Learning Research, 1: 143-160.
14. Copestake, A., Lascarides, A. and Flickinger, D. (2001) An algebra for semantic construction in constraint-based grammars. Proceedings of the 39th Annual Meeting of the ACL, pp. 132-139, Toulouse, France.
15. Flickinger, D. (2000) On building a more efficient grammar by exploiting types. Natural Language Engineering, 6(1): 15-28. Special Issue on Efficient Processing with HPSG.
16. Freund, Y., Seung, H. S., Shamir, E. and Tishby, N. (1997) Selective sampling using the query by committee algorithm. Machine Learning, 28(2-3): 133-168.
17. Geman, S., Bienenstock, E. and Doursat, R. (1992) Neural networks and the bias/variance dilemma. Neural Comput. 4(1): 1-58.
18. Geman, S. and Johnson, M. (2002) Dynamic programming for parsing and estimation of stochastic unification-based grammars. Proceedings of the 40th Annual Meeting of the ACL, pp. 279-286, Philadelphia, PA.
19. Hellan, L. and Haugereid, P. (2003) The NorSource grammar - an exercise in the Matrix grammar building design. Proceedings of Workshop on Multilingual Grammar Engineering, ESSILI 2003, Wein.
20. Heskes, T. (1998) Selecting weighting factors in logarithmic opinion pools. In: M. I. Jordan, M. J. Kearns and S. A. Solla, editors, Advances in Neural Information Processing Systems, volume 10, pp. 266-272. MIT Press.
21. Hinton, G. E. (1999) Products of experts. Proceedings of the 9th Int. Conference on Artificial Neural Networks, pp. 1-6.
22. Hwa, R., Osborne, M., Sarkar, A. and Steedman, M. (2003) Corrected Co-training for Statistical Parsers. Proceedings of the ICML Workshop "The Continuum from Labeled to Unlabeled Data", pp. 95-102.
23. Hwa, R. (2000) Sample selection for statistical grammar induction. Proceedings of the 2000 Joint SIGDAT Conference on EMNLP and VLC, pp. 45-52, Hong Kong, China.
24. Johannessen, J. B. and Nygaaard, L. (2004) Oslo-skogen. En trebank for norsk. Rapport fra det 10. mote om norsk sprak, Kristiansand, Norway.
25. Johnson, M., Geman, S., Cannon, S., Chi, Z. and Riezler, S. (1999) Estimators for Stochastic "Unification-Based" Grammars. Proceedings of the 37th Annual Meeting of the ACL, pp. 535-541.
26. Kohavi, R. and Wolpert, D. (1996) Bias plus variance decomposition for zero-one loss functions. Proceedings of the 13th International Conference on Machine Learning, pp. 275-283, Bari. Morgan Kaufmann.
27. Kordoni, V. and Neu, J. (2003) Deep grammar development for Modern Greek. Proceedings of the ESSILI Workshop on Ideas and Strategies for Multilingual Grammar Development, pp. 65-72, Vienna, Austria.
28. Krogh, A. and Vedelsby, J. (1995) Neural network ensembles, cross validation, and active learning. In: G. Tesauro, D. Touretzky and T. Leen, editors, Advances in Neural Information Processing Systems, volume 7, pp. 231-238. MIT Press.
29. Lewis, D. D. and Gale, W. A. (1994) A sequential algorithm for training text classifiers. Proceedings of the 17th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval pp. 3-12.
30. Malouf, R. and van Noord, G. (2004) Wide Coverage Parsing with Stochastic Attribute Value Grammars. Proceedings of the Ist International Joint Conference on Natural Language Processing Workshop: Beyond shallow analyses - Formalisms and statistical modeling for deep analyses, Sanya City, Hainan Island, China.
31. Malouf, R. (2002) A comparison of algorithms for maximum entropy parameter estimation. Proceedings of the Sixth Workshop on Natural Language Learning, pp. 49-55, Taipei, Taiwan.
32. McCallum, A. and Nigam,K. (1998) Employing EM and pool-based active learning for text classification. Proceedings of the International Conference on Machine Learning, pp. 350-358.
33. Melville, P. and Mooney, R. J. (2004) Diverse ensembles for active learning. Proceedings of the 21st International Conference on Machine Learning, pp. 584-591, Banff, Canada.
34. Ngai, G. and Yarowsky, D. (2000) Rule Writing or Annotation: Cost-efficient Resource Usage for Base Noun Phrase Chunking. Proceedings of the 38th Annual Meeting of the Association for Computational Linguistics, pp. 117-125, Hong Kong.
35. Oepen, S., Toutanova, K., Shieber, S., Manning, C., Flickinger, D. and Brants, T. (2002) The LinGO Redwoods Treebank: Motivation and preliminary applications. Proceedings of the 19th International Conference on Computational Linguistics, pp. 1253-1257, Taipei, Taiwan.
36. Osborne, M. and Baldridge, J. (2004) Ensemble-based active learning for parse selection. In: S. Dumais, D. Marcu and S. Roukos, editors, HLT-NAACL 2004: Main Proceedings, pp. 89-96, Boston, MA.
37. Osborne, M. (2000) Estimation of Stochastic Attribute-Value Grammars using an Informative Sample. The 18th International Conference on Computational Linguistics, pp. 586-592, Saarbrücken.
38. Osborne, M. (2002) Shallow parsing using noisy and non-stationary training material. Journal of Machine Learning Research, 2: 551-558.
39. Pereira, F., Tishby, N. and Lee, L. (1993) Distributional clustering of English words. Proceedings of the Annual Meeting of the ACL, pp. 183-190.
40. Riezler, S., Prescher, D., Kuhn, J. and Johnson, M. (2000) Lexicalized stochastic modeling of constraint-based grammars using log-linear measures and EM training. Proceedings of the 38th Annual Meeting of the ACL, Hong Kong.
41. Roy, N. and McCallum, A. (2001) Toward optimal active learning through sampling estimation of error reduction. Proceedings of the 18th International Conference on Machine Learning, pp. 441-448. Morgan Kaufmann.
42. Saar-Tsechansky, M. and Provost, F. (2004) Active sampling for class probability estimation and ranking. Machine Learning, 54(2): 153-178.
43. Seung, H. S., Opper, M. and Sompolinsky, H. (1992) Query by committee. Computational Learning Theory, 287-294.
44. Siegel, M. (2000) HPSG Analysis of Japanese. In: W. Wahlster, editor, Verbmobil: Foundations of Speech-to-Speech Translation, pp. 264-279. Springer.
45. Smith, A., Cohn, T. and Osborne, M. (2005) Logarithmic opinion pools for conditional random fields. Proceedings of ACL 2005, pp. 18-25, Ann Arbor, MI.
46. Tanaka, T., Bond, F., Oepen, S. and Fujita, S. (2005) High precision treebanking: Blazing useful trees using pos information. Proceedings of the 43th Meeting of the Association for Computational Linguistics, pp. 330-337, Ann Arbor, MI.
47. Tang, M., Luo, X. and Roukos, S. (2002) Active Learning for Statistical Natural Language Parsing. Proceedings of the 40th Annual Meeting of the ACL, pp. 120-127, Philadelphia, PA.
48. Thompson, C. R., Califf, M. E. and Mooney, R. J. (1999) Active learning for natural language parsing and information extraction. Proceedings of the 16th International Conference on Machine Learning, pp. 406-414. Morgan Kaufmann.
49. Tong, S. and Koller, D. 2000. Support vector machine active learning with applications to text classification. In: P. Langley, editor, Proceedings of the 17th International Conference on Machine Learning, pp. 999-1006, Stanford, US. Morgan Kaufmann.
50. Toutanova, K., Markova, P. and Manning, C. (2004) The leaf projection path view of parse trees: Exploring string kernels for HPSG parse selection. Proceedings of EMNLP 2004, pp. 166-173, Barcelona.
51. Toutanova, K. and Manning, C. (2002) Feature selection for a rich HPSG grammar using decision trees. Proceedings of the 6th Conference on Natural Language Learning, Taipei, Taiwan.