A comparative study on feature reduction approaches in Hindi and Bengali named entity recognition

Knowledge-Based Systems

Volumn 27, Issue , 2012, Pages 322-332

  Saha, Sujan Kumar ^a   Mitra, Pabitra ^b   Sarkar, Sudeshna ^b  

^a BIRLA INSTITUTE OF TECHNOLOGY   (India)

^b INDIAN INSTITUTE OF TECHNOLOGY   (India)

Author keywords

Dimension reduction; Feature clustering; Feature selection; Machine learning; Named entity recognition

Indexed keywords

COMPARATIVE STUDIES; DIMENSION REDUCTION; DIMENSIONALITY REDUCTION; DIMENSIONALITY REDUCTION TECHNIQUES; FEATURE CLUSTERING; FEATURE REDUCTION; HIGH-DIMENSIONAL; INDIAN LANGUAGES; NAMED ENTITY RECOGNITION; OVERFITTING; PERFORMANCE ENHANCEMENTS; TRAINING DATA;

ARTIFICIAL INTELLIGENCE; LEARNING SYSTEMS; SOFTWARE ENGINEERING;

FEATURE EXTRACTION;

EID: 84855933541     PISSN: 09507051     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.knosys.2011.09.015     Document Type: Article

References (37)

1. R. Bekkerman, R. El-Yaniv, N. Tishby, and Y. Winter Distributional word clusters vs. words for text categorization Journal of Machine Learning Research 3 2003 1183 1208
2. O. Bender, F.J. Och, H. Ney, Maximum entropy models for named entity recognition, in: Proceedings of the CoNLL-2003, 2003, pp. 148-151.
3. A.L. Berger, S.D. Pietra, and V.D. Pietra A maximum entropy approach to natural language processing Computational Linguistic 22 1 1996 39 71
4. C. Biemann, Chinese Whispers - an efficient graph clustering algorithm and its application to natural language processing problems, in: Proceedings of the HLT-NAACL-06 Workshop on Textgraphs-06, 2006.
5. P.F. Brown, V.J.D. Pietra, P.V. deSouza, J.C. Lai, and R.L. Mercer Class-based n-gram models of natural language Computational Linguistics 18 4 1992 467 479
6. K.W. Church, and P. Hanks Word association norms, mutual information, and lexicography Computational Linguistic 16 1 1990 22 29
7. E.F. Combarro, E. Montanes, I. Diaz, J. Ranilla, and R. Mones Introducing a family of linear measures for feature selection in text categorization IEEE Transactions on Knowledge and Data Engineering 17 9 2005 1223 1232
8. R. Dhanapal An intelligent information retrieval agent Knowledge-Based Systems 21 6 2008 466 470
9. I.S. Dhillon, S. Mallela, and R. Kumar A divisive information-theoretic feature clustering algorithm for text classification Journal of Machine Learning Research 3 2003 1265 1287
10. R.O. Duda, P.E. Hart, and D.G. Stork Pattern Classification second ed. 1999 John Wiley & Sons Inc
11. A. Ekbal, S. Saha, Multiobjective Optimization for classifier ensemble and feature selection: an application to named entity recognition, International Journal on Document Analysis and Recognition, in press. doi:10.1007/s10032-011- 0155-7.
12. A. Elsayed, F. Coenen, C. Jiang, M. Garca-Fiana, and V. Sluming Corpus callosum MR image classification Knowledge-Based Systems 23 4 2010 330 336
13. G. Forman An extensive empirical study of feature selection metrics for text classification Journal of Machine Learning Research 3 2003 1289 1305
14. Q. Guo, and M. Zhang Multi-documents automatic abstracting based on text clustering and semantic analysis Knowledge-Based Systems 22 6 2009 482 485
15. I. Guyon, J. Weston, S. Barnhill, and V. Vapnik Gene selection for cancer classification using support vector machines Machine Learning 46 1-3 2002 389 422
16. Uguz Harun A two-stage feature selection method for text categorization by using information gain, principal component analysis and genetic algorithm Knowledge-Based Systems 24 2011 1024 1032
17. J. Kim, T. Ohta, Y. Tsuruoka, Y. Tateisi, N. Collier, Introduction to the Bio-entity Recognition Task at JNLPBA, in: Proceedings of the PBA-2004, 2004, pp.70-75.
18. K. Kira, L.A. Rendell, A practical approach to feature selection, in: Proceedings of the International Conference on Machine Learning (ICML-1992), 1992, pp. 249-256.
19. I. Kononenko, Estimating attributes: analysis and extensions of relief, in: Proceedings of the European Conference on Machine Learning, 1994.
20. J. Lafferty, A. McCallum, F. Pereira, Conditional random fields: probabilistic models for segmenting and labeling sequence data, in: Proceedings of the International Conference on Machine Learning (ICML-2001), 2001, pp. 282-289.
21. M. Li, and L. Zhang Multinomial mixture model with feature selection for text clustering Knowledge-Based Systems 21 7 2008 704 708
22. W.S. Lu Approximate Bayesian Shrinkage Estimation Annals of the Institute of Statistical Mathematics 46 3 1994 497 507
23. W. Li, and A. McCallum Rapid development of Hindi named entity recognition using conditional random fields and feature induction ACM Transactions on Asian Language Information Processing (TALIP) 2 3 2003 290 294
24. Y. Matsuo, K. Uchiyama, Graph-based word clustering using web search engine, in: Proceedings of the EMNLP-2006, 2006.
25. A. McCallum, R. Rosenfeld, T.M. Mitchell, A.Y. Ng, Improving text classification by shrinkage in a hierarchy of classes, in: Proceedings of the Fifteenth International Conference on Machine Learning, 1998.
26. S. Miller, J. Guinness, A. Zamanian, Name tagging with word clusters and discriminative training, in: Proceedings of the HLT-NAACL-2004, 2004, pp. 337-342.
27. A.Y. Ng, Feature selection, L1 vs. L2 regularization, and rotational invariance, in: Proceedings of the ICML-2004, 2004.
28. F. Pereira, N. Tishby, L. Lee, Distributional clustering of English words, in: Proceedings of the ACL-1993, 1993, pp. 183-190.
29. S. Perkins, K. Lacker, and J. Theiler Grafting: fast, incremental feature selection by gradient descent in function space Journal of Machine Learning Research 3 2003 1333 1356
30. J.R. Quinlan Induction of decision trees Machine Learning 1 1 1986 81 106
31. J.R. Quinlan C4.5: Programs for Machine Learning 1993 Morgan Kaufmann San Francisco
32. M.I. Razzak, F. Anwar, S.A. Husain, A. Belaid, and M. Sher HMM and Fuzzy Logic: A Hybrid Approach for Online Urdu Script-based Languages' Character Recognition Knowledge-Based Systems 23 8 2010 914 923
33. S.K. Saha, P. Mitra, S. Sarkar, Word clustering and word selection based feature reduction for MaxEnt based Hindi NER, in: Proceedings of the ACL-2008:HLT, 2008, pages 488-495.
34. A.K. Singh, Named entity recognition for south and south east Asian languages: taking stock, in: Proceedings of the IJCNLP-08 Workshop on NER for South and South East Asian Languages, 2008, pp. 5-16.
35. A. Ushioda, Hierarchical clustering of words, in: Proceedings of the COLING-1996, 1996, pp. 1159-1162.
36. J. Uszkoreit, T. Brants, Distributed word clustering for large scale class-based language modeling in machine translation, in: Proceedings of the ACL-08: HLT, 2008, pp. 755-762.
37. Y. Yang and J.O. Pedersen, A comparative study on feature selection in text categorization, in: Proceedings of the ICML-1997, 1997, pp. 412-420.