Language and task independent text categorization with simple language models

Proceedings of the 2003 Human Language Technology Conference of the North American Chapter of the Association for Computational Linguistics, HLT-NAACL 2003

Volumn , Issue , 2003, Pages

  Peng, Fuchun ^a   Schuurmans, Dale ^a   Wang, Shaojun ^a  

^a UNIVERSITY OF WATERLOO   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

CLASSIFICATION (OF INFORMATION); COMPUTATIONAL LINGUISTICS; INFORMATION THEORY; NATURAL LANGUAGE PROCESSING SYSTEMS;

CHARACTER LEVEL; EFFECTIVE PERFORMANCE; FEATURES SELECTION; LANGUAGE INDEPENDENTS; LANGUAGE MODEL; N-GRAM LANGUAGE MODELS; SIMPLE INFORMATIONS; SIMPLE METHOD; SIMPLE++; TEXT CATEGORIZATION;

TEXT PROCESSING;

EID: 85037086582     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (21)

1. A. Aizawa. 2001. Linguistic Techniques to Improve the Performance of Automatic Text Categorization. In Proceedings of the Sixth Natural Language Processing Pacific Rim Symposium (NLPRS2001).
2. T. Bell, J. Cleary, and I. Witten. 1990. Text Compression. Prentice Hall.
3. D. Benedetto, E. Caglioti, and V. Loreto. 2002. Language Trees and Zipping. Physical Review Letters, 88.
4. W. Cavnar, J. Trenkle. 1994. N-Gram-Based Text Categorization. Proceedings of 3rd Annual Symposium on Document Analysis and Information Retrieval (SDAIR-94).
5. S. Chen and J. Goodman. 1998. An Empirical Study of Smoothing Techniques for Language Modeling. Technical report, TR-10-98, Harvard University.
6. M. Damashek. 1995. Gauging Similarity with N-Grams: Language-Independent Categorization of Text?. Science, Vol. 267, 10 February, 843 - 848
7. S. Dumais, J. Platt, D. Heckerman and M. Sahami. 1998. Inductive Learning Algorithms And Representations For Text Categorization. In Proceedings of ACM Conference on Information and Knowledge Management (CIKM98), Nov. 1998, pp. 148-155.
8. J. Goodman. 2002. Comment on Language Trees and Zipping. Unpublished Manuscript.
9. J. He, A. Tan, and C. Tan. 2000. A Comparative Study on Chinese Text Categorization Methods. In Proceedings of PRICAI’2000 International Workshop on Text and Web Mining, p24-35.
10. D. Holmes, and R. Forsyth. 1995. The Federalist Revisited: New Directions in Authorship Attribution. Literary and Linguistic Computing, 10, 111-127.
11. B. Kessler, G. Nunberg and H. Schüze. 1997. Automatic Detection of Text Genre. Proceedings of the Thirty-Fifth Annual Meeting of the Association for Computational Linguistics (ACL1997).
12. Y. Lee and S. Myaeng. 2002. Text Genre Classification with Genre-Revealing and Subject-Revealing Features. Proceedings of ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR2002).
13. D. Lewis. 1992. Representation and Learning in Information Retrieval Phd thesis, Computer Science Deptment, Univ. of Massachusetts.
14. A. McCallum and K. Nigam. 1998. A Comparison of Event Models for Naive Bayes Text Classification. Proceedings of AAAI-98 Workshop on”Learning for Text Categorization”, AAAI Presss.
15. J. Rennie. 2001. Improving Multi-class Text Classification with Naive Bayes. Master’s Thesis. M.I.T. AI Technical Report AITR-2001-004. 2001.
16. S. Scott and S. Matwin. 1999. Feature Engineering for Text Classification. In Proceedings of the Sixteenth International Conference on Machine Learning (ICML’ 99), pp. 379-388.
17. F. Sebastiani. 2002. Machine learning in automated text categorization. ACM Computing Surveys, 34(1):1-47.
18. E. Stamatatos, N. Fakotakis and G. Kokkinakis. 2000. Automatic Text Categorization in Terms of Genre and Author. Computational Linguistics, 26 (4), 471-495.
19. W. Teahan and D. Harper. 2001. Using Compression-Based Language Models for Text Categorization. Proceedings of 2001 Workshop on Language Modeling and Information Retrieval.
20. P. Turney. 2002. Thumbs Up or Thumbs Down? Semantic Oritentation Applied to Unsupervised Classification of Reviews. Proceedings of 40th Annual Conference of Association for Computational Linguistics (ACL 2002)
21. Y. Yang. 1999. An Evaluation of Statistical Approaches to Text Categorization. Information Retrieval, 1(1/2), pp. 67–88.