An HMM-based over-sampling technique to improve text classification

Expert Systems with Applications

Volumn 40, Issue 18, 2013, Pages 7184-7192

  Iglesias, E L ^a,b   Seara Vieira, A ^a,b   Borrajo, L ^a,b  

^a UNIVERSITY OF VIGO   (Spain)

^b Hospital Meixoeiro Edificio Anexo   (Spain)

Author keywords

Hidden Markov Model; Oversampling techniques; Text classification

Indexed keywords

BASELINE METHODS; CLASS IMBALANCE PROBLEMS; CONTENT-BASED; DOCUMENT CONTENTS; GLOBAL PERFORMANCE; OVERSAMPLING TECHNIQUE; STATISTICAL STUDY; TEXT CLASSIFICATION;

CLASSIFICATION (OF INFORMATION); HIDDEN MARKOV MODELS; TEXT PROCESSING;

SUPPORT VECTOR MACHINES;

EID: 84881292563     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2013.07.036     Document Type: Article

References (29)

1. R.A. Baeza-Yates, and B. Ribeiro-Neto Modern information retrieval 1999 Addison-Wesley Longman
2. G.E.P. Box, and M.E. Muller A note on the generation of random normal deviates The Annals of Mathematical Statistics 29 1958 610 611
3. C. Chang, and C. Lin Libsvm: A library for support vector machines ACM Transactions on Intelligent Systems and Technology 2 2011 27:1 27:27
4. N. Chawla, K. Bowyer, L. Hall, and W. Kegelmeyer Smote: Synthetic minority over-sampling technique Journal of Artificial Intelligence Research 16 2002 321 357 (Pubitemid 43057176)
5. E. Chen, Y. Lin, H. Xiong, Q. Luo, and H. Ma Exploiting probabilistic topic models to improve text categorization under class imbalance Information Processing and Management 47 2011 202 214
6. P. Frasconi, G. Soda, and A. Vullo Hidden markov models for text categorization in multi-page documents Journal of Intelligent Information Systems 18 2002 195 217 (Pubitemid 34149559)
7. Freitag, D.; & Mccallum, A.K. (1999). Information extraction with hmms and shrinkage. In Proceedings of the AAAI-99 workshop on machine learning for information extraction (pp. 31-36).
8. Hersh, W.R.; Buckley, C.; Leone, T.J.; & Hickam, D.H. (1994). Ohsumed: An interactive retrieval evaluation and new large test collection for research. In SIGIR (pp. 192-201).
9. Hersh, W.; Cohen, A.; Yang, J.; Teja Bhupatiraju, R.; Roberts, P.; & Hearst, M. (2005). Trec 2005 genomics track overview. In TREC 2005 notebook (pp. 14-25).
10. Japkowicz, N. (2000). The class imbalance problem: Significance and strategies. In Proceedings of the 2000 international conference on artificial intelligence (ICAI) (pp. 111-117).
11. N. Japkowicz, and S. Stephen The class imbalance problem: A systematic study Intelligent Data Analisys 6 2002 429 449
12. T. Joachims Learning to classify text using support vector machines: methods, theory and algorithms 2002 Kluwer Academic Publishers Norwell, MA, USA
13. Y. Ko, and J. Seo Text classification from unlabeled documents with bootstrapping and feature projection techniques Information Processing and Management 45 2009 70 83
14. Leek, T.R. (1997). Information extraction using hidden Markov models.
15. K. Li, G. Chen, and J. Cheng Research on hidden markov model-based text categorization process International Journal of Digital Content Technology and its Application 5 2011 244 251
16. Q. Li, Y. Wang, and S. Bryant A novel method for mining highly imbalanced high-throughput screening data in pubchem Bioinformatics 25 2009 3310 3316
17. V. López, A. Fernández, J.G. Moreno-Torres, and F. Herrera Analysis of preprocessing vs. cost-sensitive learning for imbalanced classification. open problems on intrinsic data characteristics Expert Systems with Applications 39 2012 6585 6608
18. J.B. Lovins Development of a stemming algorithm Mechanical Translation and Computational Linguistics 11 1968 22 31
19. O. Maimon, and L. Rokach Data mining and knowledge discovery handbook The Kluwer international series in engineering and computer science 2005 Springer
20. D.R.H. Miller, T. Leek, and R.M. Schwartz A hidden markov model information retrieval system Proceedings of the 22nd annual international ACM SIGIR conference on research and development in information retrieval SIGIR '99 1999 ACM New York, NY, USA 214 221
21. T. Nikolaos, and T. George Document classification system based on HMM word map Proceedings of the 5th international conference on Soft computing as transdisciplinary science and technology CSTST '08 2008 ACM New York, NY, USA 7 12
22. L.R. Rabiner Readings in speech recognition A tutorial on hidden Markov models and selected applications in speech recognition 1990 Morgan Kaufmann Publishers Inc San Francisco, CA, USA chapter
23. F. Sebastiani Machine learning in automated text categorization ACM Computing Surveys 34 2002 1 47
24. F. Sebastiani Text categorization Text mining and its applications to intelligence, crm and knowledge management 2005 WIT Press 109 129
25. B. Sierra Araujo Aprendizaje automático: conceptos básicos y avanzados: aspectos prácticos utilizando el software Weka 2006 Pearson Prentice Hall
26. M. Stamp A revealing introduction to hidden markov models Science 2004 1 20
27. Tan, P.; Steinbach, M.; & Kumar, V. (2006). Data mining: Introduction To. Boston.
28. Y. Yang, and X. Liu A re-examination of text categorization methods Proceedings of the 22nd annual international ACM SIGIR conference on research and development in information retrieval SIGIR '99 1999 ACM New York, NY, USA 42 49
29. K. Yi, and J. Beheshti A hidden markov model-based text classification of medical documents Journal of Information Science 35 2009 67 81