A comparative study of classifier combination applied to nlp tasks

Information Fusion

Volumn 14, Issue 3, 2013, Pages 255-267

  Enríquez, Fernando ^a   Cruz, Fermín L ^a   Ortega, F Javier ^a   Vallejo, Carlos G ^a   Troyano, José A ^a  

^a UNIVERSITY OF SEVILLE   (Spain)

Author keywords

Classifier combination; Natural language processing; Part of speech tagging; Text analysis

Indexed keywords

COMPUTATIONAL LINGUISTICS; LINGUISTICS;

BEHAVIOR KNOWLEDGE SPACES; CLASSIFIER COMBINATION; COMBINATION METHOD; COMPARATIVE STUDIES; NAME ENTITY RECOGNITION; NATURAL LANGUAGE PROCESSING; PART OF SPEECH TAGGING; TEXT ANALYSIS;

NATURAL LANGUAGE PROCESSING SYSTEMS;

EID: 84885431390     PISSN: 15662535     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.inffus.2012.05.001     Document Type: Article

References (38)

1. L. Hansen, P. Salamon, Neural network ensembles, IEEE Transactions on Pattern Analysis and Machine Intelligence 12 (10) (1990) 993-1001.
2. T.G. Dietterich, Ensemble methods in machine learning, in: J. Kittler, F. Roli, (Eds.), Multiple Classifier Systems, Lecture Notes in Computer Science, vol. 1857, 2000, pp. 1-15.
3. Y. Freund, Y. Mansour, R. Schapire, Why averaging classifiers can protect against overfitting, in: Proceedings of the Eighth International Workshop on Artificial Intelligence and Statistics, 2001.
4. L.I. Kuncheva, Combining Pattern Classifiers: Methods and Algorithms, Wiley- Interscience, 2004.
5. L. Xu, A. Krzyzak, C.Y. Suen, Methods of combining multiple classifiers and their application to handwriting recognition, IEEE Transactions on Systems, Man, and Cybernetics 22 (1992) 418-435.
6. N. Belkin, J. Callan, The effect of multiple query representations on information retrieval system performance, in: Proceedings of the Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 1993, pp. 339-346.
7. R. Frederking, S. Nirenburg, Three heads are better than one, in: Proceedings of the fourth Conference on Applied Natural Language Processing (ANLP-94), 1994, pp. 95-100.
8. D. Hull, J. Pedersen, H. Schutze, Method combination for document filtering, SIGIR Forum (ACM Special Interest Group on Information Retrieval) (1996) 279-288.
9. J. Fiscus, A post-processing system to yield reduced word error rates: recognizer output voting error reduction (rover), in: IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU-97), 1997, pp. 347-354.
10. H. Halteren, J. Zavrel, W. Daelemans, Improving data driven wordclass tagging by system combination, in: Proceedings of the 36th Annual Meeting of the Association for Computational Linguistics and 17th International Conference on Computational Linguistics, vol. 1, 1998, pp. 491-497.
11. E. Brill, J. Wu, Classifier combination for improved lexical disambiguation, in: Proceedings of the 17th International Conference on Computational Linguistics, 1998, pp. 191-195.
12. L. Marquez, H. Rodriguez, J. Carmona, J. Montolio, Improving pos tagging using machine-learning techniques, in: Proceedings of the 1999 Faint SIGDAT Conference on Empirical Methods in Natural Language Processing and Very Large Corpora, 1999, pp. 53-62.
13. H. Halteren, W. Daelemans, J. Zavrel, Improving accuracy in word class tagging through the combination of machine learning systems, Computational Linguistics 27 (2) (2001) 199-229. (Pubitemid 33597446)
14. M. Kuta, M. Wrzeszcz, P. Chrza-szcz, J. Kitowski, Accuracy of baseline and complex methods applied to morphosyntactic tagging of polish, in: ICCS '08: Proceedings of the 8th International Conference on Computational Science, Part I, 2008, pp. 903-912.
15. T. Pedersen, A simple approach to building ensembles of naive bayesian classifiers for word sense disambiguation, in: Proceedings of the 1st North American Chapter of the Association for Computational Linguistics Conference, 2000, pp. 63-69.
16. R. Florian, D. Yarowsky, Modeling consensus: Classifier combination for word sense disambiguation, in: EMNLP '02: Proceedings of the ACL-02 Conference on Empirical Methods in Natural Language Processing, 2002, pp. 25-32.
17. L.A. Cuong, A study of classifier combination and semi-supervised learning for word sense disambiguation, Ph.D. thesis, Japan Advanced Institute of Science and Technology, 2007.
18. R. Florian, A. Ittycheriah, H. Jing, T. Zhang, Named entity recognition through classifier combination, in: Proceedings of the Seventh Conference on Natural Language Learning at HLT-NAACL 2003, 2003, pp. 168-171.
19. Z. Kozareva, O. Ferrandez, A. Montoyo, R. Muoz, A. Suarez, J. Gomez, Combining data-driven systems for improving named entity recognition, Data & Knowledge Engineering 61 (3) (2007) 449-466. (Pubitemid 46560987)
20. H. Wang, T. Zhao, Identifying named entities in biomedical text based on stacked generalization, in: Proceedings of the World Congress on Intelligent Control and Automation (WCICA), 2008, pp. 160-164.
21. J. Henderson, E. Brill, Bagging and boosting a treebank parser, in: Proceedings of the 1st North American Chapter of the Association for Computational Linguistics Conference, 2000, pp. 34-41.
22. D. Zeman, Z. Ž abokrtský, Improving parsing accuracy by combining diverse dependency parsers, in: Proceedings of IWPT-2005, 2005, pp. 171-178.
23. J. Huang, O. Madani, C. Giles, Error-driven generalist+experts (edge): A multistage ensemble framework for text categorization, in: CIKM '08: Proceeding of the 17th ACM Conference on Information and Knowledge Management, 2008, pp. 83-92.
24. X. Qi, B. Davison, Web page classification: features and algorithms, ACM Computing Surveys (CSUR) 41 (2) (2009) 1-31.
25. G. Sigletos, G. Paliouras, C. Spyropoulos, M. Hatzopoulos, Combining information extraction systems using voting and stacked generalization, Journal of Machine Learning Research 6 (2005) 1751-1782.
26. M. Banko, O. Etzioni, The tradeoffs between open and traditional relation extraction, in: Proceedings of ACL-08: HLT, 2008, pp. 28-36.
27. K. Tsutsumi, K. Shimada, T. Endo, Movie review classification based on a multiple classifier, in: The 21th Pacific Asia Conference on Language, Information and Computation (PACLIC), 2007.
28. S. Li, C. Zong, X. Wang, Sentiment classification through combining classifiers with multiple feature sets, in: IEEE NLP-KE 2007 - Proceedings of International Conference on Natural Language Processing and Knowledge Engineering, vol. 4368024, 2007, pp. 135-140.
29. T. Brants, Tnt. A statistical part-of-speech tagger, in: Proceedings of the 6th Applied NLP Conference (ANLP00), 2000, pp. 224-231.
30. H. Schmid, Probabilistic part-of-speech tagging using decision trees, in: Proceedings of the Conference on New Methods in Language Processing, 1994.
31. W. Daelemans, J. Zavrel, A. Bosch, K. Sloot, Mbt: memory-based tagger, reference guide, Tech. Rep. 03-13, ILK, 2003.
32. T. Joachims, Making Large-Scale SVM Learning Practical, MIT Press, 1999 (chapter 11).
33. K. Arrow, Social Choice and Individual Values, Wiley, New York, 1951.
34. S. French, Group consensus probability distributions: A critical survey, Bayesian Statistics 2 (1985) 183-202.
35. Y.S. Huang, C.Y. Suen, A method of combining multiple experts for the recognition of unconstrained handwritten numerals, IEEE Transactions on Pattern Analysis and Machine Intelligence 17 (1995) 90-93.
36. L. Breiman, Bagging predictors, Tech. Rep. 421, Department of Statistics, University of California, Berkeley, 1994.
37. I.H. Witten, E. Frank, Data Mining: Practical Machine Learning Tools and Techniques, Morgan Kaufman, 2000.
38. D. Wolpert, Stacked generalization, Neural Networks 5 (1992) 241-259.