Automatic named entity pre-annotation for out-of-domain human annotation

LAW 2013 and ID 2013 - 7th Linguistic Annotation Workshop and Interoperability with Discourse, Proceedings of the Workshop

Volumn , Issue , 2020, Pages 168-177

  Rosset, Sophie ^a   Grouin, Cyril ^a   Lavergne, Thomas ^a,b   Jannet, Mohamed Ben ^a,b,c,d   Leixa, Jérémy ^c   Galibert, Olivier ^c   Zweigenbaum, Pierre ^a  

^a UFR 919 Laboratoire d'Informatique Pour la Mécanique et les Sciences de l'Ingénieur

^b UNIVERSITÉ PARIS SACLAY   (France)

^c LNE ^*

^d UNIVERSITÉ SORBONNE NOUVELLE PARIS 3   (France)

Author keywords

[No Author keywords available]

Indexed keywords

INTEROPERABILITY; SURVEYS;

ANNOTATION SCHEME; CORPUS-BASED; EXPERT AND NOVICES; HUMAN ANNOTATIONS; NAMED ENTITIES; QUANTITATIVE ASSESSMENTS; STUDY DESIGN; SUBJECTIVE ASSESSMENTS;

LINGUISTICS;

EID: 84905217928     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (22)

1. Jacob Cohen. 1960. A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20(1):37-46.
2. Sandipan Dandapat, Priyanka Biswas, Monojit Choudhury, and Kalika Bali. 2009. Complex linguistic annotation - no easy way out! A case from Bangla and Hindi POS labeling tasks. In Proc of 3rd Linguistic Annotation Workshop (LAW-III), pages 10-18, Suntec, Singapore, August. ACL.
3. Marco Dinarelli and Sophie Rosset. 2011. Models cascade for tree-structured named entity detection. In Proc of IJCNLP, pages 1269-1278, Chiang Mai, Thailand.
4. Manaal Faruqui and Sebastian Padó. 2010. Training and evaluating a German named entity recognizer with semantic generalization. In Proc of Konvens, Saarbrücken, Germany.
5. Karën Fort and Benoît Sagot. 2010. Influence of pre-annotation on POS-tagged corpus development. In Proc of 4th Linguistic Annotation Workshop (LAW-IV), pages 56-63, Uppsala, Sweden. ACL.
6. Karën Fort, Adeline Nazarenko, and Sophie Rosset. 2012. Modeling the complexity of manual annotation tasks: a grid of analysis. In Proceedings of COLING 2012, pages 895-910, Mumbai, India, December. The COLING 2012 Organizing Committee.
7. Olivier Galibert, Sophie Rosset, Cyril Grouin, Pierre Zweigenbaum, and Ludovic Quintard. 2011. Structured and extended named entity evaluation in automatic speech transcriptions. In Proc of IJCNLP, Chiang Mai, Thailand.
8. Cyril Grouin, Sophie Rosset, Pierre Zweigenbaum, Karën Fort, Olivier Galibert, and Ludovic Quintard. 2011. Proposal for an extension of traditional named entities: From guidelines to evaluation, an overview. In Proc of 5th Linguistic Annotation Workshop (LAW-V), pages 92-100, Portland, OR. ACL.
9. Minlie Huang, Aurélie Névéol, and Zhiyong Lu. 2011. Recommending MeSH terms for annotating biomedical articles. Journal of the American Medical Informatics Association, 18(5):660-7.
10. Geoffrey Leech. 1997. Introducing corpus annotation. In Roger Garside, Geoffrey Leech, and Tony McEnery, editors, Corpus annotation: Linguistic information from computer text corpora, pages 1-18. Longman, London.
11. John Makhoul, Francis Kubala, Richard Schwartz, and Ralph Weischedel. 1999. Performance measures for information extraction. In Proc. of DARPA Broadcast News Workshop, pages 249-252.
12. Mitchell P Marcus, Mary Ann Marcinkiewicz, and Beatrice Santorini. 1993. Building a large annotated corpus of English: the Penn TreeBank. Computational Linguistics, 19(2):313-330.
13. Claudiu Mihaila, Tomoko Ohta, Sampo Pyysalo, and Sophia Ananiadou. 2013. Biocause: Annotating and analysing causality in the biomedical domain. BMC Bioinformatics, 14:2.
14. Céline Poudat and Doninique Longrée. 2009. Variations langagières et annotation morphosyntaxique du latin classique. Traitement Automatique des Langues, 50(2):129-148.
15. Dietrich Rebholz-Schuhmann, Antonio Jimeno, Chen Li, Senay Kafkas, Ian Lewin, Ning Kang, Peter Corbett, David Milward, Ekaterina Buyko, Elena Beisswanger, Kerstin Hornbostel, Alexandre Kouznetsov, René Witte, Jonas B Laurila, Christopher JO Baker, Cheng-Ju Kuo, Simone Clematide, Fabio Rinaldi, Richárd Farkas, György Móra, Kazuo Hara, Laura I Furlong, Michael Rautschka, Mariana Lara Neves, Alberto Pascual-Montano, Qi Wei, Nigel Collier, Md Faisal Mahbub Chowdhury, Alberto Lavelli, Rafael Berlanga, Roser Morante, Vincent Van Asch, Walter Daelemans, José L Marina, Erik van Mulligen, Jan Kors, and Udo Hahn. 2011. Assessment of NER solutions against the first and second CALBC silver standard corpus. J Biomed Semantics, 2.
16. Ines Rehbein, Josef Ruppenhofer, and Caroline Sporleder. 2009. Assessing the benefits of partial automatic pre-labeling for frame-semantic annotation. In Proc of 3rd Linguistic Annotation Workshop (LAW-III), pages 19-26, Suntec, Singapore. ACL.
17. Eric Ringger, Peter McClanahan, Robbie Haertel, George Busby, Marc Carmen, James Carroll, Kevin Seppi, and Deryle Lonsdale. 2007. Active learning for part-of-speech tagging: Accelerating corpus annotation. In Proc of Linguistic Annotation Workshop (LAW), pages 101-108. ACL.
18. Sophie Rosset, Cyril Grouin, Karën Fort, Olivier Galibert, Juliette Kahn, and Pierre Zweigenbaum. 2012. Structured named entities in two distinct press corpora: Contemporary broadcast news and old newspapers. In Proc of 6th Linguistic Annotation Workshop (LAW-VI), pages 40-48, Jeju, South Korea. ACL.
19. William A Scott. 1955. Reliability of content analysis: The case of nominal scale coding. Public Opinion Quaterly, 19(3):321-325.
20. Burr Settles, Mark Craven, and Lewis Friedland. 2008. Active learning with real annotation costs. In Proc of the NIPS Workshop on Cost-Sensitive Learning.
21. Arne Skjærholt. 2011. More, faster: Accelerated corpus annotation with statistical taggers. Journal for Language Technology and Computational Linguistics, 26(2):151-163.
22. Brett R South, Shuying Shen, Robyn Barrus, Scott L Du Vall, Özlem Uzuner, and Charlene Weir. 2011. Qualitative analysis of workflow modifications used to generate the reference standard for the 2010 i2b2/VA challenge. In Proc of AMIA.