Combining multiple classifiers using vote based classifier ensemble technique for named entity recognition

Data and Knowledge Engineering

Volumn 85, Issue , 2013, Pages 15-39

  Saha, Sriparna ^a   Ekbal, Asif ^a  

^a INDIAN INSTITUTE OF TECHNOLOGY PATNA   (India)

Author keywords

Conditional Random Field (CRF); Decision Tree (DT); Genetic Algorithm (GA); Hidden Markov Model (HMM); Maximum Entropy(ME); Memory Based Learner (MBL); Multiobjective Optimization (MOO); Naive Bayes; Named Entity Recognition (NER); Single Objective Optimization; Support Vector Machine (SVM); Weighted Vote based Ensemble

Indexed keywords

CONDITIONAL RANDOM FIELD; HIDDEN MARKOV MODEL(HMM); MAXIMUM ENTROPY; NAIVE BAYES; NAMED ENTITY RECOGNITION; SINGLE OBJECTIVE OPTIMIZATION; WEIGHTED VOTE BASED ENSEMBLE;

CLASSIFIERS; DATA MINING; DECISION TREES; GENETIC ALGORITHMS; HIDDEN MARKOV MODELS; MULTIOBJECTIVE OPTIMIZATION; NATURAL LANGUAGE PROCESSING SYSTEMS; RANDOM PROCESSES;

SUPPORT VECTOR MACHINES;

EID: 84875273930     PISSN: 0169023X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.datak.2012.06.003     Document Type: Conference Paper

References (57)

1. T. Mandl, and C. Womser-Hacker The effect of named entities on effectiveness in cross-language information retrieval evaluation Proceedings of the 2005 ACM Symposium on Applied Computing (SAC 2005) 2005 1059 1064
2. M. Pasca, D. Lin, J. Bigham, A. Lifchits, and A. Jain Organizing and searching the world wide web of facts - step one: the one-million fact extraction challenge Proceedings of National Conference on Artificial Intelligence (AAAI-06) 2006
3. B. Babych, and A. Hartley Improving machine translation quality with automatic named entity recognition Proceedings of EAMT/EACL 2003 Workshop on MT and Other Language Technology Tools 2003 1 8
4. L.A. Pizzato, D. Molla, and C. Paris Pseudo relevance feedback using named entities for question answering Proceedings of the 2006 Australian Language Technology Workshop (ALTW-2006) 2006 89 90
5. C. Nobata, S. Sekine, H. Isahara, and R. Grishman Summarization system integrated with named entity tagging and IE pattern discovery Proceedings of the Third International Conference on Language Resources and Evaluation (LREC 2002), Spain 2002
6. K. Humphreys, R. Gaizauskas, S. Azzam, C. Huyck, B. Mitchell, H. Cunnigham, and Y. Wilks Univ. of Sheffield: description of the LaSIE-II system as used for MUC-7 MUC-7, Fairfax, Virginia 1998
7. C. Aone, L. Halverson, T. Hampton, and M. Ramos-Santacruz SRA: description of the IE2 system used for MUC-7 MUC-7, Fairfax, Virginia 1998
8. A. Mikheev, C. Grover, and M. Moens Description of the LTG System used for MUC-7 MUC-7, Fairfax, Virginia 1998
9. A. Mikheev, C. Grover, and M. Moens Named entity recognition without gazetteers Proceedings of EACL, Bergen, Norway 1999 1 8
10. S. Miller, M. Crystal, H. Fox, L. Ramshaw, R. Schwartz, R. Stone, R. Weischedel, and the Annotation Group BBN: description of the SIFT system as used for MUC-7 MUC-7, Fairfax, Virginia 1998
11. D.M. Bikel, R.L. Schwartz, and R.M. Weischedel An algorithm that learns what's in a name Machine Learning 34 1-3 1999 211 231
12. A. Borthwick, Maximum entropy approach to named entity recognition, Ph.D. thesis, New York University (1999).
13. A. Borthwick, J. Sterling, E. Agichtein, and R. Grishman NYU: description of the MENE named entity system as used in MUC-7 MUC-7, Fairfax 1998
14. S. Sekine Description of the Japanese NE system used for MET-2 MUC-7, Fairfax, Virginia 1998
15. S.W. Bennet, C. Aone, and C. Lovell Learning to tag multilingual texts through observation Proceedings of Empirical Methods of Natural Language Processing, Providence, Rhode Island 1997 109 116
16. A. McCallum, and W. Li Early results for named entity recognition with conditional random fields, feature induction and Web-enhanced lexicons Proceedings of CoNLL, Canada 2003 188 191
17. J.D. Lafferty, A. McCallum, and F.C.N. Pereira Conditional random fields: probabilistic models for segmenting and labeling sequence data ICML 2001 282 289
18. H. Yamada, T. Kudo, and Y. Matsumoto Japanese named entity extraction using support vector machine Transactions of IPSJ 43 1 2001 44 53
19. R. Srihari, C. Niu, and W. Li A hybrid approach for named entity and sub-type tagging Proceedings of Sixth Conference on Applied Natural Language Processing (ANLP) 2002 247 254
20. X. YU Chinese named entity recognition with cascaded hybrid model Proceedings of NAACL HLT 2007, Prague 2007 197 200
21. A. Ekbal, S. Naskar, and S. Bandyopadhyay Named entity recognition and transliteration in Bengali Named Entities: Recognition, Classification and Use Special Issue of Lingvisticae Investigationes Journal 30 1 2007 95 114
22. A. Ekbal, and S. Bandyopadhyay Voted NER system using appropriate unlabeled data Proceedings of the 2009 Named Entities Workshop: Shared Task on Transliteration (NEWS 2009), ACL-IJCNLP 2009 2009 202 210
23. A. Ekbal, R. Haque, and S. Bandyopadhyay Named entity recognition in Bengali: a conditional random field approach Proceedings of the 3rd International Joint Conference on Natural Language Processing (IJCNLP 2008) 2008 589 594
24. W. Li, and A. McCallum Rapid development of Hindi named entity recognition using conditional random fields and feature induction ACM Transactions on Asian Languages Information Processing 2 3 2004 290 294 10.1145/979872.979879
25. P.M. Shishtla, P. Pingali, and V. Varma A character n-gram based approach for improved recall in Indian language NER Proceedings of the IJCNLP-08 Workshop on NER for South and South East Asian Languages 2008 101 108
26. R. Florian, A. Ittycheriah, H. Jing, and T. Zhang Named entity recognition through classifier combination Proceedings of the Seventh Conference on Natural Language Learning at HLT-NAACL 2003 2003
27. K. Deb Multi-objective optimization using evolutionary algorithms 2001 John Wiley and Sons Ltd. England
28. A. Patel, G. Ramakrishnan, and P. Bhattacharya An empirical study of the naive Bayes classifier Proceedings of IJCAI 2001 Workshop on Empirical Methods in Artificial Intelligence 2001
29. J.R. Quinlan C4.5: Programs for Machine Learning 1993 Morgan Kaufmann Publishers Inc. San Francisco, CA, USA
30. W. Daelemans, and A.V. den Bosch Memory-Based Language Processing 2005 Cambridge University Press Cambridge, UK
31. V.N. Vapnik The Nature of Statistical Learning Theory 1995 Springer-Verlag New York, Inc. New York, NY, USA
32. K. Deb, A. Pratap, S. Agarwal, and T. Meyarivan A fast and elitist multiobjective genetic algorithm: NSGA-II IEEE Transactions on Evolutionary Computation 6 2 2002 181 197
33. A. Ekbal, and S. Bandyopadhyay A Web-based Bengali news corpus for named entity recognition Language Resources and Evaluation Journal 42 2 2008 173 182
34. A. Ekbal, and S. Saha Classifier ensemble selection using genetic algorithm for named entity recognition Research on Language and Computation 8 2010 73 99
35. A. Ekbal, and S. Saha Weighted vote-based classifier ensemble for named entity recognition: a genetic algorithm-based approach ACM Transactions on Asian Language Information Processing 10 2 2011 9
36. A. Ekbal, and S. Saha Multiobjective optimization for classifier ensemble and feature selection: an application to named entity recognition International Journal on Document Analysis and Recognition 15 2 2012 143 166
37. A. Ekbal, and S. Saha A multiobjective simulated annealing approach for classifier ensemble: named entity recognition in Indian languages as case studies Expert Systems with Applications 38 12 2011 14760 14772
38. D.E. Goldberg Genetic Algorithms in Search, Optimization and Machine Learning 1989 Addison-Wesley New York
39. J.H. Holland Adaptation in Natural and Artificial Systems 1975 The University of Michigan Press Ann Arbor
40. M. Srinivas, and L.M. Patnaik Adaptive probabilities of crossover and mutation in genetic algorithms IEEE Transactions on Systems, Man and Cybernetics 24 4 1994 656 667
41. Y. Tsuruoka, and J. Tsujii Training a naive Bayes classifier via the EM algorithm with a class distribution constraint Proceedings of the Seventh Conference on Natural Language Learning at HLT-NAACL 2003 - Volume 4, CONLL '03 2003 Association for Computational Linguistics Stroudsburg, PA, USA 127 134 10.3115/1119176.1119193 (10.3115/1119176.1119193)
42. G. Escudero, L. Arquez, and G. Rigau Naive Bayes and exemplar-based approaches to word sense disambiguation revisited Proceedings of the 14th European Conference on Artificial Intelligence 2000
43. D.D. Lewis Naive Bayes at forty: the independence assumption in information retrieval Proceedings of ECML-98, 10th European Conference on Machine Learning 1998
44. A. McCallum, and K. Nigam A comparison of event models for naive Bayes text classification AAAI-98 Workshop on Learning for Text Categorization 1998
45. T. Pedersen A simple approach to building ensembles of naive Bayesian classifiers for word sense disambiguation Proceedings of the First Annual Meeting of the North American Chapter of the Association for Computational Linguistics, Seattle, WA 2000
46. I.H. Witten, and E. Frank Data Mining: Practical Machine Learning Tools and Techniques 2005 Morgan Kaufmann San Francisco
47. D.W. Aha, D. Kibler, and M. Albert Instance-based learning algorithms Machine Learning 6 1 Jan. 1991
48. W. Daelemans, J. Zavrel, A. van den Bosch, and K. van der Sloot MBT: memory-based tagger Version 3.2, Reference Guide. ILK Technical Report 10-04 2010 http://ilk.uvt.nl/downloads/pub/papers/ilk.1004.pdf
49. A.J. Viterbi Error bounds for convolutional codes and an asymptotically optimum decoding algorithm IEEE Transactions on Information Theory 13 2 1967 260 267
50. T. Brants TnT: a statistical parts-of-speech tagger Proceedings of the Sixth Conference on Applied Natural Language Processing ANLP-2000 2000 224 231
51. A. Ekbal, and S. Bandyopadhyay Lexicon development and POS tagging using a tagged Bengali news corpus Proceedings of the 20th International Florida AI Research Society Conference (FLAIRS-2007), Florida 2007 261 263
52. J. Darroch, and D. Ratcliff Generalized iterative scaling for log-linear models The Annals of Mathematical Statistics 43 1972 1470 1480
53. F. Sha, and F. Pereira Shallow parsing with conditional random fields Proceedings of NAACL '03, Canada 2003 134 141
54. T. Joachims Making Large Scale SVM Learning Practical 1999 MIT Press Cambridge, MA, USA 169 184
55. H. Taira, and M. Haruno Feature selection in SVM text categorization Proceedings of AAAI-99 1999
56. E.F. Tjong Kim Sang, and F. De Meulder Introduction to the Conll-2003 shared task: language independent named entity recognition Proceedings of the Seventh Conference on Natural Language Learning at HLT-NAACL 2003 2003 142 147
57. T.W. Anderson, and S. Scolve Introduction to the Statistical Analysis of Data 1978 Houghton Mifflin