Extending the single words-based document model: A comparison of bigrams and 2-itemsets

Proceedings of the 2006 ACM Symposium on Document Engineering, DocEng 2006

Volumn 2006, Issue , 2006, Pages 138-146

  Tesar, Roman ^a   Poesio, Massimo ^b   Strnad, Vaclav ^a   Jezek, Karel ^a  

^a UNIVERSITY OF WEST BOHEMIA   (Czech Republic)

^b UNIVERSITY OF ESSEX   (United Kingdom)

Author keywords

Bigrams; Comparison; Document model; Feature selection; Itemsets; Machine learning; N grams; Text categorization

Indexed keywords

ALGORITHMS; CLASSIFICATION (OF INFORMATION); FEATURE EXTRACTION; LEARNING SYSTEMS; TEXT PROCESSING; WORD PROCESSING;

BIGRAMS; DOCUMENT MODELS; ITEMSETS; N-GRAMS; PERFORMANCE IMPROVEMENT; TEXT CATEGORIZATION;

INFORMATION RETRIEVAL SYSTEMS;

EID: 34247393724     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1166160.1166197     Document Type: Conference Paper

References (26)

1. J.J.G. Adeva, R.A. Calvo and D.L. de Ipiña. Multilingual Approaches to Text Categorisation. UPGRADE: The European Journal for the Informatics Professional, Vol. VI, No. 3, pp. 43-51, June 2005.
2. M.L. Antonie and O.R. Zaiane. Text document categorization by term association. In Proc. of the IEEE 2002 International Conference on Data Mining, pages 19-26, Maebashi City, Japan, 2002.
3. L. Baoli, L. Qin and Y. Shiwen. An adaptive k-nearest neighbor text categorization strategy. ACM Transactions on Asian Language Information Processing (TALIP), volume 3, pp: 215-226, 2004.
4. R. Bekkerman, R. El-Yaniv, N. Tishby and Y. Winter. Distributional Word Clusters vs. Words for Text Categorization. Journal of Machine Learning Research, 3:1183-1208, 2003.
5. R. Bekkerman and J. Allan. Using Bigrams in Text Categorization. CIIR Technical Report IR-408, 2004.
6. A. Bratko and B. Filipič. Exploiting Structural Information in Semistructured Document Classification. Proc. 13th International Electrotechnical and Computer Science Conference, ERK 2004, 2004.
7. M. F. Caropreso, S. Matwin and F. Sebastiani. Statistical phrases in automated text categorization. Technical Report IEI-B4-07-2000, Istituto di Elaborazione dell'Informazione, Pisa, Italy, 2000.
8. T.G. Dietterich. Approximate Statistical Test for Comparing Supervised Classification Learning Algorithms. Neural Computation, Vol. 10, no.7, pp. 1895-1923, 1998.
9. S.T. Dumais, J. Platt, D. Heckerman and M. Sahami. Inductive learning algorithms and representations for text categorization. In Proceedings of ACM-CIKM98, pp. 148-155, 1998.
10. J. Fürnkranz. A study using n-gram features for text categorization. Technical Report OEFAI-TR-9830, Austrian Institute for Artificial Intelligence, Vienna, Austria, 1998.
11. A. McCallum and K. Nigam. A Comparison of Event Models for Naive Bayes Text Classification. In AAAI/ICML-98 Workshop on Learning for Text Categorization, Technical Report WS-98-05, AAAI Press, pp. 41-48, 1998.
12. D. Meretakis and B. Wüthrich. Extending Naive Bayes classifiers using long itemsets. In Proc. 5th ACM-SIGKDD Int. Conf. Knowledge Discovery and Data Mining (KDD'99), San Diego, USA, pp. 165-174, 1999.
13. D. Meretakis, D. Fragoudis, H. Lu and S. Likothanassis. Scalable association-based text classification. Proceedings of the ninth international conference on Information and knowledge management, pp. 5-11, McLean, Virginia, United States, November 2000.
14. M. Mitra, C. Buckley, A. Singhal and C. Cardie. An analysis of statistical and syntactic phrases. In Proceedings of RIAO-97, 5th International Conference "Recherche d'Information Assistee par Ordinateur", pages 200-214, Montreal, CA, 1997.
15. D. Mladenic and M. Grobelnik. Word sequences as features in text-learning. In Proc. 17th Electrotechnical and Computer Science Conference (ERK98), Slovenia, 1998.
16. D. Mladenic and M. Grobelnik. Feature Selection for Unbalanced Class Distribution and Naive Bayes. In Proceedings of the 16th International Conference on Machine Learning, Morgan Kaufmann, pp. 258-267, 1999.
17. V. Pekar, M. Krkoska and S. Staab. Feature Weighting for Co-occurrence-based Classification of Words. In Proceedings of the 20th Conference on Computational Linguistics, COLING-2004, August 2004.
18. M. Rogati and Y. Yang. High-performing feature selection for text classification. Proceedings of the eleventh international conference on Information and knowledge management, McLean, Virginia, USA, November 2002.
19. K.M. Schneider. A New Feature Selection Score for Multinomial Naive Bayes Text Classification Based on KL-Divergence. 42nd Meeting of the Association for Computational Linguistics (ACL 2004), pp. 186-189, 2004.
20. Ch.M. Tan, Y.F. Wang and Ch.D. Lee. The use of bigrams to enhance text categorization. Information Processing and Management: an International Journal, v.38 n.4, p.529-546, July 2002.
21. R. Tesar, D. Fiala, F. Rousselot and K. Jezek. A comparison of two algorithms for discovering repeated word sequences. WIT Transactions on Information and Communication Technologies, Vol. 35, pp. 121-131, 2005.
22. Y. Yang and J.O. Pedersen. A Comparative Study on Feature Selection in Text Categorization. Proceedings of the Fourteenth International Conference on Machine Learning, pp.412-420, July, 1997.
23. Z. Yang, Z. Lijun, Y. Jianfeng and L. Zhanhuai. Using association features to enhance the performance of Naive Bayes text classifier. Fifth International Conference on Computational Intelligence and Multimedia Applications, ICCIMA 2003, pp. 336-341, 2003.
24. O. Zamir and O. Etzioni. Web document clustering: A feasibility demonstration. In Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR '98, Melbourne, Australia), W. B. Croft, A. Moffat, C. J. van Rijsbergen, R., Wilkinson, and J. Zobel, Chairs. ACM Press, New York, NY, pp. 46-54, 1998.
25. D. Zhang, X. Chen and W.S. Lee. Text classification with kernels on the multinomial manifold. Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval, Brazil, pp: 266-273, 2005.
26. Z. Zheng, R. Kohavi and L. Mason. Real world performance of association rule algorithms. In Int. Conf on Knowledge Discovery and Data Mining (SIGKDD), August 2001.