Integrated NLP Evaluation System for Pluggable Evaluation Metrics with Extensive Interoperable Toolkit

NAACL HLT 2009 - Software Engineering, Testing, and Quality Assurance for Natural Language Processing, SETQA-NLP 2009 - Proceedings of the Workshop

Volumn , Issue , 2009, Pages 22-30

  Kano, Yoshinobu ^a   McCrohon, Luke ^a   Ananiadou, Sophia ^b   Tsujii, Jun'ichi ^a,b  

^a UNIVERSITY OF TOKYO   (Japan)

^b UNIVERSITY OF MANCHESTER   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

INTEROPERABILITY; REUSABILITY; VISUALIZATION;

COMPLETE SYSTEM; EVALUATION METRICS; FINE GRAINED; INDIVIDUAL COMPONENTS; KEY CHARACTERISTICS; NLP TOOLS; SUB-COMPONENTS; TOOL COMPARISONS; TOOLS EVALUATIONS; UNDERLYING COMPONENTS;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 79957509325     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (22)

1. W. A. Baumgartner, Jr., K. B. Cohen, and L. Hunter. 2008. An open-source framework for large-scale, flexible evaluation of biomedical text mining systems. J Biomed Discov Collab, 3(1), 1.
2. Ann Bies, Seth Kulick, and Mark Mandel. 2005. Parallel entity and treebank annotation. In Proceedings of the the Workshop on Frontiers in Corpus Annotations II: Pie in the Sky, ACL, Ann Arbor, Michigan, USA.
3. Razvan Bunescu, Ruifang Ge, Rohit J. Kate, Edward M. Marcotte, Raymond J. Mooney, Arun Kumar Ramani, et al. 2005. Comparative experiments on learning information extractors for proteins and their interactions. Artificial Intelligence in Medicine, 33(2), 139-155.
4. Razvan Bunescu, and Raymond Mooney. 2006. Sub-sequence Kernels for Relation Extraction. In Y. Weiss, B. Scholkopf and J. Platt (Eds.), Advances in Neural Information Processing Systems 18 (171-178). Cambridge, MA: MIT Press.
5. Marie-Catherine de Marneffe, Bill MacCartney, and Christopher D. Manning. 2006. Generating typed dependency parses from phrase structure parses. In Proceedings of the the 5th International Conference on Language Resources and Evaluation (LREC 2006).
6. David Ferrucci, and Adam Lally. 2004. Building an example application with the Unstructured Information Management Architecture. Ibm Systems Journal, 43(3), 455-475.
7. David Ferrucci, Adam Lally, Daniel Gruhl, and Edward Epstein. 2006. Towards an Interoperability Standard for Text and Multi-Modal Analytics.
8. U. Hahn, E. Buyko, R. Landefeld, M. Mühlhausen, M. Poprat, K. Tomanek, et al. 2008, May. An Overview of JCoRe, the JULIE Lab UIMA Component Repository. In Proceedings of the LREC'08 Workshop, Towards Enhanced Interoperability for Large HLT Systems: UIMA for NLP, Marrakech, Morocco.
9. Lynette Hirschman, Alexander Yeh, Christian Blaschke, and Antonio Valencia. 2004. Overview of BioCreAtIvE: critical assessment of information extraction for biology. BMC Bionformatics, 6(Suppl 1:S1).
10. Yoshinobu Kano, William A Baumgartner, Luke McCrohon, Sophia Ananiadou, Kevin B Cohen, Lawrence Hunter, et al. 2009. U-Compare: share and compare text mining tools with UIMA. Bioinformatics, accepted.
11. Yoshinobu Kano, Ngan Nguyen, Rune Sætre, Keiichiro Fukamachi, Kazuhiro Yoshida, Yusuke Miyao, et al. 2008c, January. Sharable type system design for tool inter-operability and combinatorial comparison. In Proceedings of the the First International Conference on Global Interoperability for Language Resources (ICGL), Hong Kong.
12. Yoshinobu Kano, Ngan Nguyen, Rune Sætre, Kazuhiro Yoshida, Keiichiro Fukamachi, Yusuke Miyao, et al. 2008b, January. Towards Data And Goal Oriented Analysis: Tool Inter-Operability And Combinatorial Comparison. In Proceedings of the 3rd International Joint Conference on Natural Language Processing (IJCNLP), Hyderabad, India.
13. Yoshinobu Kano, Ngan Nguyen, Rune Sætre, Kazuhiro Yoshida, Yusuke Miyao, Yoshimasa Tsuruoka, et al. 2008a, January. Filling the gaps between tools and users: a tool comparator, using protein-protein interaction as an example. In Proceedings of the Pacific Symposium on Biocomputing (PSB), Hawaii, USA.
14. Jin-Dong Kim, Tomoko Ohta, Yoshimasa Tsuruoka, Yuka Tateisi, and Nigel Collier. 2004. Introduction to the Bio-Entity Recognition Task at JNLPBA. In Proceedings of the International Workshop on Natural Language Processing in Biomedicine and its Applications (JNLPBA-04), Geneva, Switzerland.
15. Kristofer Franzen, Gunnar Eriksson, Fredrik Olsson, Lars Asker, Per Liden, and Joakim Coster. 2002. Protein names and how to find them. International Journal of Medical Informatics, 67(1-3), 49-61.
16. Mitchell P. Marcus, Mary Ann Marcinkiewicz, and Beatrice Santorini. 1993. Building a large annotated corpus of English: the penn treebank. Computational Linguistics, 19(2), 313-330.
17. Yusuke Miyao, and Jun'ichi Tsujii. 2008. Feature Forest Models for Probabilistic HPSG Parsing. Computational Linguistics, 34(1), 35-80.
18. Rune Sætre, Kazuhiro Yoshida, Akane Yakushiji, Yusuke Miyao, Yuichiro Matsubayashi, and Tomoko Ohta. 2007, April. AKANE System: Protein-Protein Interaction Pairs in BioCreAtIvE2 Challenge, PPI-IPS subtask. In Proceedings of the Second BioCreative Challenge Evaluation Workshop.
19. Burr Settles. 2005. ABNER: an open source tool for automatically tagging genes, proteins and other entity names in text. Bioinformatics, 21(14), 3191-3192.
20. Yuka Tateisi, Tomoko Ohta, Nigel Collier, Chikashi Nobata, and Jun'ichi Tsujii. 2000, August. Building an Annotated Corpus from Biology Research Papers. In Proceedings of the COLING 2000 Workshop on Semantic Annotation and Intelligent Content, Luxembourg.
21. Yuka Tateisi, Akane Yakushiji, Tomoko Ohta, and Jun'ichi Tsujii. 2005, October. Syntax Annotation for the GENIA Corpus. In Proceedings of the the Second International Joint Conference on Natural Language Processing (IJCNLP '05), Companion volume, Jeju Island, Korea.
22. Yoshimasa Tsuruoka, Yuka Tateishi, Jin Dong Kim, Tomoko Ohta, J. McNaught, Sophia Ananiadou, et al. 2005. Developing a robust part-of-speech tagger for biomedical text. In Advances in Informatics, Proceedings (Vol. 3746, 382-392). Berlin: Springer-Verlag Berlin.