Weighted vote-based classifier ensemble for named entity recognition: A genetic algorithm-based approach

ACM Transactions on Asian Language Information Processing

Volumn 10, Issue 2, 2011, Pages

  Ekbal, Asif ^a,b   Saha, Sriparna ^a,b  

^a INDIAN INSTITUTE OF TECHNOLOGY   (India)

^b INDIAN INSTITUTE OF TECHNOLOGY PATNA   (India)

Author keywords

Classifier ensemble; Conditional random field; Feature selection; Genetic algorithm; Language independent named entity recognition; Maximum entropy; Support vector machine

Indexed keywords

CLASSIFIER ENSEMBLES; CONDITIONAL RANDOM FIELD; MAXIMUM ENTROPY; NAMED ENTITY RECOGNITION; SUPPORT VECTOR;

DATA PROCESSING; FEATURE EXTRACTION;

GENETIC ALGORITHMS;

EID: 79960832442     PISSN: 15300226     EISSN: 15583430     Source Type: Journal    
DOI: 10.1145/1967293.1967296     Document Type: Article

References (65)

1. ALFONSECA, E. AND MANANDHAR, S. 1999. An unsupervised method for general named entity recognition and automated concept discovery. In Proceedings of the 16th National Conference on Artificial Intelligence and the Eleventh Conference on Innovative Applications of Artificial Intelligence (AAAI'99/IAAI'99). 474-479.
2. ANDERSON, T.W. AND SCOLVE, S. 1978. Introduction to the Statistical Analysis of Data. Houghton Mifflin.
3. AONE, C., HALVERSON, L., HAMPTON, T., AND RAMOS-SANTACRUZ,M. 1998. SRA: Description of the IE2 system used for MUC-7. In Proceedings of the Message Understanding Conference (MUC'98).
4. BABYCH, B. AND HARTLEY, A. 2003. Improving machine translation quality with automatic named entity recognition. In Proceedings of the Conference on the European Chapter of the Association for Computational Linguistics Workshop on Machine Translation and Other Language Technology Tools (EACL'03). 1-8.
5. BENNET, S. W., AONE, C., AND LOVELL, C. 1997. Learning to tag multilingual texts through observation. In Proceedings of Empirical Methods of Natural Language Processing (EMNLP'97). 109-116.
6. BIKEL, D. M., SCHWARTZ, R. L., AND WEISCHEDEL, R. M. 1999. An algorithm that learns whats in a name. Mach. Learn. 34, 1-3, 211-231.
7. BORTHWICK, A. 1999. Maximum entropy approach to named entity recognition. Ph.D. thesis, New York University.
8. BORTHWICK, A., STERLING, J., AGICHTEIN, E., AND GRISHMAN, R. 1998. NYU: Description of the MENE named entity system as used in MUC-7. In Proceedings of the Machine Understanding Conference (MUC'98).
9. BREIMAN, L. 1996. Bagging predictors. Mach. Learn. 24, 2, 123-140. (Pubitemid 126724382)
10. CARREARS, X.,MARQUEZ, L., AND PADRO, L. 2002. Named entity recognition using AdaBoost. In Proceedings of the Conference on Natural Language Learning (CoNLL'02). 167-170.
11. CHERKAUER, K. 1996. Human expert-level performance on a scientific image analysis task by a system using combined artificial neural networks. InWorking Notes of the AAAIWorkshop on Integrating Multiple Learned Models (AAAI'96). 15-21.
12. CHIEU, H. L. AND NG, H. T. 2003. Named entity recognition with a maximum entropy approach. In Proceedings of the Conference on Natural Language Learning (CoNLL'03). 160-163.
13. COLLINS, M. AND SINGER, Y. 1999. Unsupervised models for named entity classification. In Proceedings of the Joint SIGDAT Conference on Empirical Methods in Natural Language Processing and Very Large Corpora (EMNLP'99).
14. DARROCH, J. AND RATCLIFF, D. 1972. Generalized iterative scaling for log-linear models. Ann. Math. Statist. 43. 1470-1480.
15. DIETTERICH, T. G. 2002. Ensemble methods in machine learning. In Proceedings of the 1st International Workshop on Multiple Classifiers Systems. J. Kittler and F. Roli Eds., Springer.
16. DIETTERICH, T. G. AND BAKIRI, G. 1995. Solving multiclass learning problems via error correcting output codes. J. Artific. Intell. Res. 2, 263-286.
17. EKBAL, A. AND BANDYOPADHYAY, S. 2007. Lexical pattern learning from corpus data for named entity recognition. In Proceedings of the 5th International Conference on Natural Language Processing (ICON'07). 123-128.
18. EKBAL, A. AND BANDYOPADHYAY, S. 2008a. Bengali named entity recognition using support vector machine. In Proceedings of the Workshop on Named Entity Recognition for South and South East Asian Languages, 3rd International Joint Conference on Natural Languge Processing (NER-IJCNLP'08). 51-58.
19. EKBAL, A. AND BANDYOPADHYAY, S. 2008b. Web-based Bengali news corpus for lexicon development and POS tagging. POLIBITS, 37, 20-29.
20. EKBAL, A. AND BANDYOPADHYAY, S. 2008c. AWeb-based Bengali news corpus for named entity recognition. Lang. Resour. Eval. 42, 2, 173-182.
21. EKBAL, A. AND BANDYOPADHYAY, S. 2009. Voted NER system using appropriate unlabeled data. In Proceedings of the Named Entities Workshop: Shared Task on Transliteration (NEWS'09). 202-210.
22. EKBAL, A., NASKAR, S., AND BANDYOPADHYAY, S. 2007. Named entity recognition and transliteration in Bengali. Lingvisticae Investigationes J. 30, 1 (Named Entities: Recognition, Classification and Use Special Issue), 95-114.
23. EKBAL, A.,HAQUE, R., AND BANDYOPADHYAY, S. 2008. Named entity recognition in Bengali: A conditional random field approach. In Proceedings of the 3rd International Joint Conference on Natural Language Processing (IJCNLP'08). 589-594.
24. EKBAL, A. AND SAHA, S. 2010. Weighted vote-based classifier ensemble selection using genetic algorithm for named entity recognition. In Proceedings of the Conference on Natural Languages in Databases (NLDB'10). 256-267.
25. ETZIONI, O., CAFARRELLA, M., DOWNEY, D., POPESCU, A.M., SHAKED, T., SODERLAND, S.,WELD, D. S., AND YATES, A. 2005. Unsupervised named entity extraction from the Web: An experimental study. Artific. Intell. 165. 91-134.
26. FLORIAN, R., ITTYCHERIAH, A., JING, H., AND ZHANG, T. 2003. Named entity recognition through classifier combination. In Proceedings of the 7th Conference on Natural Language Learning (HLT-NAACL'03).
27. FREUND, Y. AND SCHAPIRE, R. 1995a. A decision-theoretic generalization of online learning and an application to boosting. In Proceedings of the 2nd European Conference on Computational Learning Theory (ECCL'95). 23-37.
28. FREUND, Y. AND SCHAPIRE, R. E. 1995b. A decision-theoretic generalization of online learning and an application to boosting. In Proceedings of the 2nd European Conference on Computational Learning Theory (ECCL'95). 23-37.
29. GOLDBERG, D. E. 1989. Genetic Algorithms in Search, Optimization, and Machine Learning. Addison-Wesley, New York.
30. HOLLAND, J. H. 1975. Adaptation in Natural and Artificial Systems. The University of Michigan Press: AnnArbor.
31. HUMPHREYS, K., GAIZAUSKAS, R., AZZAM, S., HUYCK, C.,MITCHELL, B., CUNNIGHAM, H., AND WILKS, Y. 1998. University of Sheffield: Description of the LaSIE-II System as Used for MUC-7. In Proceedings of the Message Understanding Conference (MUC'98).
32. JOACHIMS, T. 1999. Making Large Scale SVM Learning Practical. MIT Press: Cambridge, MA, 169-184.
33. KLEIN, D., SMARR, H. N., AND MANNING, D. 2003. Named entity recognition with character-level models. In Proceedings of the Conference on Natural Language Learning (CoNLL'03). 188-191.
34. KOLEN, J. F. AND POLLACK, J. B. 1991. Back propagation is sensitive to initial conditions. Adv. Neural Inf. Proc. Syst. 860-867.
35. LAFFERTY, J. D., MCCALLUM, A., AND PEREIRA, F. C. N. 2001. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In Proceedings of the International Conference on Machine Learning (ICML'01). 282-289.
36. LI, W. AND MCCALLUM, A. 2004. Rapid development of Hindi named entity recognition using conditional random fields and feature induction. ACM Trans. Asian Lang. Inform. Process. 2, 3, 290-294. (Pubitemid 43891427)
37. LIN, D. AND WU, X. 2009. Phrase clustering for discriminative learning. In Proceedings of 47th Annual Meeting of the Association for Computational Learning (ACL'09). 1030-1038.
38. MANDL, T. AND WOMSER-HACKER, C. 2005. The effect of named entities on effectiveness in crosslanguage information retrieval evaluation. In Proceedings of the ACM Symposium on Applied Computing (SAC'05). 1059-1064.
39. MCCALLUM, A. AND LI, W. 2003. Early results for named entity recognition with conditional random fields, feature induction, and Web-enhanced lexicons. In Proceedings of the Conference on Natural Language Learning (CoNLL'03). 188-191.
40. MIKHEEV, A., GROVER, C., AND MOENS, M. 1998. Description of the LTG system used for MUC-7. In Proceedings of the Message Understanding Conference (MUC'98).
41. MIKHEEV, A., GROVER, C., AND MOENS, M. 1999. Named Entity Recognition without Gazeteers. In Proceedings of the Conference on the European Chapter of the Association for Computational Linguistics (EACL'03). 1-8.
42. MILLER, S., CRYSTAL, M., FOX, H., RAMSHAW, L., SCHAWARTZ, R., STONE, R., WEISCHEDEL, R., AND THE ANNOTATION GROUP. 1998. BBN: Description of the SIFT System as Used for MUC-7. In Proceedings of the Message Understanding Conference (MUC'98).
43. NOBATA, C., SEKINE, S., ISAHARA, H., AND GRISHMAN, R. 2002. Summarization system integrated with named entity tagging and IE pattern discovery. In Proceedings of 3rd International Conference on Language Resources and Evaluation (LREC'02).
44. PASCA, M., LIN, D., BIGHAM, J., LIFCHITS, A., AND JAIN, A. 2006. Organizing and searching the World Wide Web of facts - Step one: The one-million fact extraction challenge. In Proceedings of National Conference on Artificial Intelligence (AAAI'06).
45. PATEL, A., RAMAKRISHNAN, G., AND BHATTACHARYA, P. 2009. Relational learning assisted construction of rule base for Indian language NER. In Proceedings of the 7th International Conference on Natural Language Processing (ICON'09).
46. PIZZATO, L. A., MOLLA, D., AND PARIS, C. 2006. Pseudo relevance feedback using named entities for question answering. In Proceedings of the Australian Language Technology Workshop (ALTW'06). 89-90.
47. RILOFF, E. AND JONES, R. 1999. Learning dictionaries for information extraction by multi-level bootstrapping. In Proceedings of the 16th National Conference on Artificial Intelligence (AAAI'99). 474-479.
48. SAHA, S., SARKAR, S., AND MITRA, P. 2008. A hybrid feature set based maximum entropy Hindi named entity recognition. In Proceedings of the 3rd International Joint Conference in Natural Langauge Processing (IJCNLP'08). 343-350.
49. SEKINE, S. 1998. Description of the Japanese NE system used for MET-2. In Proceedings of the Message Understanding Conference (MUC'98).
50. SEUNG, H. S., OPPER, M., AND SOMPOLINSKY, H. 1992. Query by committee. In Proceedings of the ACM Workshop on Computational Learning Theory (CLT'92).
51. SHA, F. AND PEREIRA, F. 2003. Shallow parsing with conditional random fields. In Proceedings of the North American Chapter of the Association for Computational Linguistics (NAACL'03). 134-141.
52. SHINYAMA, Y. AND SEKINE, S. 2004. Named entity discovery using comparable news articles. In Proceedings of the International Conference on Computational Linguistics (COLING'04). 848-855.
53. SHISHTLA, P. M., PINGALI, P., AND VARMA, V. 2008. A character n-gram based approach for improved recall in Indian language NER. In Proceedings of the Workshop on Named Entity Recognition for South and South East Asian Languages (IJCNLP'08). 101-108.
54. SRIHARI, R., NIU, C., AND LI, W. 2002. A hybrid approach for named entity and sub-type tagging. In Proceedings of 6th Conference on Applied Natural Language Processing (ANLP'02). 247-254.
55. SRIKANTH, P. AND MURTHY, K. N. 2008. Named entity recognition for Telugu. In Proceedings of the Workshop on Named Entity Recognition for South and South East Asian Languages (IJCNLP'08). 41-50.
56. SRINIVAS, M. AND PATNAIK, L. M. 1994. Adaptive probabilities of crossover and mutation in genetic algorithms. IEEE Trans. Syst. Man Cybern. 24, 4, 656-667.
57. SUZUKI, J. AND ISOZAKI, H. 2008. Semi-supervised sequential labeling and segmentation using gigaword scale unlabeled data. In Proceedings of the Human Language Technology Conference (ACL/HLT'08). 665-673.
58. TAIRA, H. AND HARUNO, M. 1999. Feature selection in SVM text categorization. In Proceedings of National Conference on Artificial Intelligence (AAAI'99).
59. TJONG KIM SANG, E. F. AND DE MEULDER, F. 2003. Introduction to the shared task: Language independent named entity recognition. In Proceedings of the 7th Conference on Natural Language Learning (HLT-NAACL'03). 142-147.
60. VAPNIK, V. N. 1995. The Nature of Statistical Learning Theory. Springer-Verlag Berlin, Germany.
61. VIJAYAKRISHNA, R. AND SOBHA, L. 2008. Domain focused named entity recognizer for Tamil using conditional random fields. In Proceedings of the Workshop on Named Entity Recognition for South and South East Asian Languages (IJCNLP'08). 93-100.
62. WOLPERT, D. 1992. Stacked generalization. Neural Netw. 5, 241-259.
63. WU, D.,NGAI, G., AND CARPUT, M. 2003. A stacked, voted, stacked model for named entity recognition. In Proceedings of the Conference on Natural Language Learning (CoNLL'03).
64. YANGARBER, R., LIN, W., AND GRISHMAN, R. 2002. Unsupervised learning of generalized names. In Proceedings of the 19th International Conference on Computational Linguistics (COLING'02). 1-7.
65. YU, X. 2007. Chinese named entity recognition with cascaded hybrid model. In Proceedings of Human Language Technology Conference/North American Chapter of the Association for Computational Linguistics (NAACL-HLT'07). 197-200.