A joint model to identify and align bilingual named entities

Computational Linguistics

Volumn 39, Issue 2, 2013, Pages 229-266

  Chen, Yufeng ^a   Zong, Chengqing ^a   Su, Keh Yih ^b  

^a INSTITUTE OF AUTOMATION   (China)

^b Behavior Design Corporation   (Taiwan)

Author keywords

[No Author keywords available]

Indexed keywords

SEMI-SUPERVISED LEARNING;

CONSISTENCY CONSTRAINTS; DIFFERENT DOMAINS; ENTITY-TYPES; INTEGRATED MODELING; JOINT MODELING; NAMED ENTITIES; RECOGNITION MODELS; TRANSLATION MODES;

ANCHORS;

EID: 84877079140     PISSN: 08912017     EISSN: 15309312     Source Type: Journal    
DOI: 10.1162/COLI_a_00122     Document Type: Article

References (67)

1. Al-Onaizan, Yaser and Kevin Knight. 2002. Translating named entities using monolingual and bilingual resources. In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics, pages 400-408, Philadelphia, PA.
2. Berger, Adam L., Stephen A. Della Pietra, and Vincent J. Della Pietra. 1996. A maximum entropy approach to natural language processing. Computational Linguistics, 22(1):39-71.
3. Bikel, Daniel M., Scott Miller, Richard Schwartz, and Ralph Weischedel. 1997. Nymble: A high-performance learning name-finder. In Proceedings of the Fifth Conference on Applied Natural Language Processing, pages 194-201, Washington, DC.
4. Bikel, Daniel M., Richard Schwartz, and Ralph M. Weischedel. 1999. An algorithm that learns what's in a name. Machine Learning, 34(1-3):211-231.
5. Black, W. J. and Argyrios Vasilakopoulos. 2002. Language independent named entity classification by modified transformation-based learning and by decision tree induction. In Proceedings of the Sixth Conference on Natural Language Learning, pages 159-162, Taipei.
6. Borthwick, A. 1999. A Maximum Entropy Approach to Named Entity Recognition. Ph.D. thesis, New York University.
7. Brown, Perer F., Stephen A. Della Pietra, Vincent J. Della Pietra, and Robert L. Mercer. 1993. The mathematics of statistical machine translation: Parameter estimation. Computational Linguistics, 19(2):263-311.
8. Carreras, X., L. Marquez, and L. Padro. 2002. Named entity extraction using adaboost. In Proceedings of the Sixth Conference on Natural Language Learning (CoNLL-2002), pages 167-170, Taipei.
9. Chen, Hsin-His, Yung-Wei Ding, Shih-Chung Tsai, and Guo-Wei Bian. 1998a. Description of the NTU system used for met2. In Proceedings of the 7th Message Understanding Conference (MUC-7), pages 121-129, Fairfax, VA.
10. Chen, Hsin-His, S.-J. Huang, Y.-W. Ding, and S.-C. Tsai. 1998b. Proper name translation in cross-language information retrieval. In Proceedings of the 17th COLING and 36th ACL Conference, pages 232-236, Montreal.
11. Chen, Hsin-His, W.-C. Lin, C. Yang, and W.-H. Lin. 2006. Translating/ transliterating named entities for multilingual information access. Journal of the American Society for Information Science and Technology (Special Issue on Multilingual Information Systems), 57(5):645-659.
12. Chen, Hsin-His, Changhua Yang, and Ying Lin. 2003. Learning formulation and transformation rules for multilingual named entities. In Proceedings of the ACL 2003 Workshop on Multilingual and Mixed-language Named Entity Recognition, pages 1-8, Sapporo.
13. Chen, Stanley F. and Joshua Goodman. 1998. An empirical study of smoothing techniques for language modeling. Technical Report TR-10-98, Computer Science Group, Harvard University, Cambridge, MA.
14. Chen, Yufeng and Chengqing Zong. 2008. A structure-based model for Chinese organization name translation. ACM Transactions on Asian Language Information Processing (TALIP), 7(1):1-30.
15. Chen, Yufeng, Chengqing Zong, and Keh-Yih Su. 2010. On jointly recognizing and aligning bilingual named entities. In Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics, pages 631-639, Uppsala.
16. Chinchor, Nancy. 1998. Overview of muc-7/met-2. In Proceedings of Message Understanding Conference MUC-7, pages 1-4, Fairfax, VA.
17. Cohen, William W. 2004. MinorThird: methods for identifying names and ontological relations in text using heuristics for inducing regularities from data. Available at http://minorthird.sourceforge.net.
18. Collins, Michael. 2002. Ranking algorithms for named-entity extraction: Boosting and the voted perceptron. In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics, pages 489-496, Philadelphia, PA.
19. Feng, Donghui, Yajuan Lv, and Ming Zhou. 2004. A new approach for English-Chinese named entity alignment. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP 2004), pages 372-379, Barcelona.
20. Finkel, Jenny Rose, Trond Grenager, and Christopher Manning. 2005. Incorporating non-local information into information extraction systems by Gibbs sampling. In Proceedings of the 43nd Annual Meeting of the Association for Computational Linguistics (ACL 2005), pages 363-370, Ann Arbor, MI.
21. Freedman, D. A. 2005. Statistical Models: Theory and Practice. Cambridge University Press.
22. Gao, Jianfeng, Mu Li, Andi Wu, and Chang-Ning Huang. 2005. Chinese word segmentation and named entity recognition: A pragmatic approach. Computational Linguistics, 31(4):531-574.
23. Gao, Wei, Kam-Fam Wong, and Wai Lam. 2004. Transliteration of foreign names for OOV problem. In Proceedings of the 1st International Joint Conference on Natural Language Processing (IJCNLP), pages 110-119, Sanya.
24. Hu, Rile, Chengqing Zong, and Bo Xu. 2006. An approach to automatic acquisition of translation templates based on phrase structure extraction and alignment. IEEE Transactions on Audio, Speech, and Language Processing, 14(5):1656-1663.
25. Huang, Fei and Stephan Vogel. 2004. Improved named entity translation and bilingual named entity extraction. In Proceedings of the 4th IEEE International Conference on Multimodal Interface, pages 253-258, Pittsburgh, PA.
26. Huang, Fei, Stephan Vogel, and Alex Waibel. 2003. Automatic extraction of named entity translingual equivalence based on multi-feature cost minimization. In Proceedings of ACL'03, Workshop on Multilingual and Mixed-language Named Entity Recognition, pages 9-16, Sapporo.
27. Ji, Heng and Ralph Grishman. 2006. Analysis and repair of name tagger errors. In Proceedings of COLING/ACL 2006, pages 420-427, Sydney.
28. Ji, Heng and Ralph Grishman. 2007. Collaborative entity extraction and translation. In Proceedings of International Conference on Recent Advances in Natural Language Processing, pages 73-84, Borovets.
29. Jiao, Feng, Shaojun Wang, Chi H. Lee, Russell Greiner, and Dale Schuurmans. 2006. Semi-supervised conditional random fields for improved sequence segmentation and labeling. In Proceedings of the 21st International Conference on Computational Linguistics, pages 209-216, Sydney.
30. Kneser, Reinhard and Hermann Ney. 1995. Improved backing-off for m-gram language modeling. In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, pages 181-184, Detroit, MI.
31. Knight, Kevin and Jonathan Graehl. 1998. Machine transliteration. Computational Linguistics, 24(4):599-612.
32. Krishman, Vijay and Christopher D. Manning. 2006. An effective two-stage model for exploiting non-local dependencies in named entity recognition. In Proceedings of 44th Annual Meeting of the Association for Computational Linguistics, pages 1121-1128, Sydney.
33. Kumano, T., H. Kashioka, H. Tanaka, and T. Fukusima. 2004. Acquiring bilingual named entity translations from content-aligned corpora. In Proceedings of the First International Joint Conference on Natural Language Processing, pages 177-186, Hainan Island.
34. Lee, Chun-Jen and Jason S. Chang. 2003. Acquisition of English-Chinese transliterated word pairs from parallel aligned texts using a statistical machine transliteration model. In Proceedings of HLT-NAACL 2003 Workshop on Building and Using Parallel Texts: Data Driven Machine Translation and Beyond, pages 96-103, Edmonton.
35. Lee, Chun-Jen, Jason S. Chang, and Jyh-Shing R. Jang. 2003. A statistical approach to Chinese-to-English back transliteration. In Proceedings of the 17th Pacific Asia Conference on Language, Information, and Computation, pages 310-318, Singapore.
36. Lee, Chun-Jen, Jason S. Chang, and Jyh-Shing R. Jang. 2006. Alignment of bilingual named entities in parallel corpora using statistical models and multiple knowledge sources. ACM Transactions on Asian Language Information Processing (TALIP), 5(2):121-145.
37. Lee, Jae Sung and Key-Sun Choi. 1997. A statistical method to generate various foreign word transliterations in multilingual information retrieval system. In Proceedings of the 2nd International Workshop on Information Retrieval with Asian Languages (IRAL), pages 123-128, Tsukuba.
38. Li, Haizhou, Khe Chai Sim, Jin Shea Kuo, and Minghui Dong. 2007. Semantic transliteration of personal names. In Proceedings of 45th Annual Meeting of the Association for Computational Linguistics (ACL), pages 120-127, Prague.
39. Li, Haizhou, Min Zhang, and Jian Su. 2004. A joint source channel model for machine transliteration. In Proceedings of 42nd Annual Meeting of the Association for Computational Linguistics (ACL), pages 159-166, Barcelona.
40. Liao, Wenhui and Sriharsha Veeramachaneni. 2009. A simple semi-supervised algorithm for named entity recognition. In Proceedings of the NAACL HLT Workshop on Semi-Supervised Learning for Natural Language Processing, pages 58-65, Boulder, CO.
41. Liese, Friedrich and Klaus-J. Miescke. 2008. Statistical Decision Theory: Estimation, Testing, and Selection. Springer, Berlin.
42. Lin, Wei-Hao and Hsin-Hsi Chen. 2002. Backward transliteration by learning phonetic similarity. In Proceedings of the Sixth Conference on Natural Language Learning, pages 139-145, Taipei.
43. McCallum, Andrew and Wei Li. 2003. Early results for named entity recognition with conditional random fields, feature induction and Web-enhanced lexicons. In Proceedings of the Conference on Computational Natural Language Learning (CoNLL 2003), pages 188-191, Edmonton.
44. McCallum, Andrew Kachites. 2002. MALLET: A Machine Learning for Language Toolkit. Available at http://mallet.cs.umass.edu.
45. Mikheev, A., C. Grover, and M. Moens. 1998. Description of the LTG system used for MUC-7. In Proceedings of the 7th Message Understanding Conference (MUC-7), pages 1-12, Fairfax, VA.
46. Moore, R. C. 2003. Learning translations of named-entity phrases from parallel corpora. In Proceedings of the 10th Conference of the European Chapter of ACL, pages 259-266, Budapest.
47. Och, Franz Josef. 2003. Minimum error rate training in statistical machine translation. In Proceedings of the 41st Annual Conference of the Association for Computational Linguistics (ACL), pages 160-167, Sapporo.
48. Och, Franz Josef and Hermann Ney. 2003. A systematic comparison of various statistical alignment models. Computational Linguistics, 29(1):19-51.
49. Oh, Jong-Hoon and Key-Sun Choi. 2002. An English-Korean transliteration model using pronunciation and contextual rules. In Proceedings of the 19th International Conference on Computational Linguistics, pages 758-764, Taipei.
50. Oh, Jong-Hoon and Key-Sun Choi. 2005. An ensemble of grapheme and phoneme for machine transliteration. In Proceedings of the Second International Joint Conference on Natural Language Processing, pages 450-461, Jeju Island.
51. Pervouchine, Vladimir, Haizhou Li, and Bo Lin. 2009. Transliteration alignment. In Proceedings of the 47th Annual Meeting of the Association for Computational Linguistics (ACL), pages 136-144, Singapore.
52. Schlüter, Ralf and Hermann Ney. 2001. Model-based MCE bound to the true Bayes error. IEEE Signal Processing Letters, 8(5):131-133.
53. Shao, Li and Hwee Tou Ng. 2004. Mining new word translations from comparable corpora. In Proceedings of the 20th International Conference on Computational Linguistics (COLING), pages 618-624, Geneva.
54. Sproat, Richard, Tao Tao, and ChengXiang Zhai. 2006. Named entity transliteration with comparable corpora. In Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics, pages 73-80, Sydney.
55. Stalls, B. G. and Kevin Knight. 1998. Translating names and technical terms in Arabic text. In Proceedings of the COLING/ACL Workshop on Computational Approaches to Semitic Languages, pages 34-41, Montreal.
56. Stolcke, Andreas. 2002. SRILM-An extensible language modeling toolkit. In Proceedings of the International Conference on Spoken Language Processing, pages 901-904, Denver, CO.
57. Sun, Jian, Ming Zhou, and Jianfeng Gao. 2003. A class-based language model approach to Chinese named entity identification. Computational Linguistics and Chinese Language Processing, 8(2):1-28.
58. Tsuji, Keita. 2002. Automatic extraction of translational Japanese-Katakana and English word pairs from bilingual corpora. International Journal of Computer Processing of Oriental Languages, 15(3):261-279.
59. Wan, S. and C. M. Verspoor. 1998. Automatic English-Chinese name transliteration for development of multilingual resources. In Proceedings of the 17th COLING and 36th ACL, pages 1,352-1,356, Montreal.
60. Wong, Yingchuan and Hwee Tou Ng. 2007. One class per named entity: Exploiting unlabeled text for named entity recognition. In Proceedings of the International Joint Conferences on Artificial Intelligence, pages 1,763-1,768, Hyderabad.
61. Wu, D., G. Ngai, M. Carpuat, J. Larsen, and Y. Yang. 2002. Boosting for named entity recognition. In Proceedings of the Sixth Conference on Natural Language Learning, pages 195-198, Taipei.
62. Wu, Youzheng, Jun Zhao, and Bo Xu. 2005. Chinese named entity recognition model based on multiple features. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP 2005), pages 427-434, Vancouver.
63. Zhang, Min, Haizhou Li, Jian Su, and Hendra Setiawan. 2005. A phrase-based context-dependent joint probability model for named entity translation. In Proceedings of the Second International Joint Conference on Natural Language Processing, pages 600-611, Jeju Island.
64. Zhang, Ying, S. Vogel, and A. Waibel. 2004. Interpreting BLEU/NIST scores: How much improvement do we need to have a better system? In Proceedings of the 4th International Conference on Language Resources and Evaluation, pages 2,051-2,054, Lisbon.
65. Zhao, Hai and Chunyu Kit. 2008. Unsupervised segmentation helps supervised learning of character tagging for word segmentation and named entity recognition. In the Sixth SIGHAN Workshop on Chinese Language Processing (SIGHAN-6), pages 106-111, Hyderabad.
66. Zhou, GuoDong and Jian Su. 2006. Machine learning-based named entity recognition via effective integration of various evidences. Natural Language Engineering, 11(2):189-206.
67. Zong, Chengqing and Mark Seligman. 2005. Toward practical spoken language translation. Machine Translation, 19(2):113-137.