On compression-based text classification

Lecture Notes in Computer Science

Volumn 3408, Issue , 2005, Pages 300-314

  Marton, Yuval ^a   Wu, Ning ^b   Hellerstein, Lisa ^b  

^a UNIVERSITY OF MARYLAND   (United States)

^b POLYTECHNIC UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATA ACQUISITION; DATA COMPRESSION; INFORMATION RETRIEVAL; PROGRAM DOCUMENTATION; TEXT PROCESSING; WORD PROCESSING;

CHARACTER-BASED METHODS; SPANNING; TEXT CLASSIFICATION; TEXT COMPRESSION METHODS;

CLASSIFICATION (OF INFORMATION);

EID: 24644522810     PISSN: 03029743     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1007/978-3-540-31865-1_22     Document Type: Conference Paper

References (39)

1. Benedetto, B., Caglioti, E., Loreto, V.: Language trees and zipping. Physical Review Letters 88(048702) (2002).
2. Benedetto, B., Caglioti, E., Loreto, V.: On J. Goodman's comment, to "Language trees and zipping", http://arxiv.org/abs/cond-mat/0203275 July 2004.
3. Benedetto, D. and Caglioti, E.: Benedetto, Caglioti, and Loreto reply. Physical Review Letters, 90(089804) (2003)
4. Cavnar, W. B., Tenkle, J. M.: N-gram-based text categorization. Proc. of the 3rd Annual Symposium on Document Analysis and Information Retrieval (SDAIR 94) (1994) 161-175
5. Chen, Stanley F., and Goodman, Joshua: An Empirical Study of smoothing techniques for language modeling. Proc. of the Thirty-Fourth Annual Meeting of the Association for Computational Linguistics. 1998
6. Damashek, M.: Gauging similarity with n-grams: Language-independent categorization of text. Science 267(5199) (1995):843-848
7. Eyheramendy, S., Lewis, D. D., Madigan, D.: On the naive Bayes model for text categorization. Proc. of the Ninth International Workshop on Artificial Intelligence and Statistics (2003)
8. Frank, E., Chui, C., Witten, I.H.: Text Categorization Using Compression Models. Proc. of DCC-00, IEEE Data Compression Conference (2000) 200-209.
9. Ghani, Rayid: Using Error Correcting Codes for Efficient Text Classification with a Large Number of Categories. KDD project report. Masters Thesis. Center for Automated Learning and Discovery, Carnegie Mellon University (2001)
10. Goodman, Joshua T.: A Bit of Progress in Language Modeling, Extended Version. Computer Speech and Language, October 2001, pages 403-434.
11. Goodman, J.: Extended comment on language trees and zipping. http://arxiv.org/abs/cond-mat/0202383
12. gzip, a GNU license compression tool, version 1.3.3 (2002-03-08). Copyright 2002 Free Software Foundation Copyright 1992-1993 Jean-loup Gailly
13. Khmelev D., Teahan W.: A repetition based measure for verification of text collections and for text categorization. Proc. of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval (2003): 104-110
14. Khmelev, D. V., Teahan, W. J.: Comment: "Language trees and zipping". Physical Review Letters, 90 (2003):089803.
15. Khmelev D., Tweedie F.: Using Markov Chains for Identification of Writers. Literary and Linguistic Computing 16(4) (2001):299-307
16. Kukushkina O. V., Polikarpov A. A., Khmelev D. V.: Using literal and grammatical statistics for authorship attribution. Problems of Information Transmission 37 (2001): 172-184.
17. Lowenstern D., Hirsh H., Noordiwier M., Yianilos P.: DNA Sequence Classification Using Compression-Based Induction. DIMACS Technical Report 95-04 (1995)
18. McCallum, A., Nigam, K.: A Comparison of Event Models for Naive Bayes Text Classification. Proc. of the AAAI-98 Workshop on "Learning for Text Categorization" (1998)
19. Mitchell, T.: Tutorial on machine Learning over natural language documents. http://www.cs.cmu.edu/tom/text-learning.ps
20. Mosteller, F., Wallace, D. L.: Inference and Disputed Authorship: The Federalist. Springer-Verlag, New York, (1964) (Second edition: Applied Bayesian and Classical Inference. (1984)).
21. Nelson, Mark R.: LZW source code. Dr. Dobb's Journal, October, 1989 (Also available at http://www.dogma.net/markn/articles/lzw/lzw.htm).
22. Peng, F., Schuurmans, D.: Combining Naive Bayes and n-gram language models for text classification. Proc. of The 25th European Conference on Information Retrieval Research (ECIR03)LNCS 2633 (2003):335-350
23. Peng, F., Schuurmans, D., Wang, S.: Augmenting Naive Bayes classifiers with statistical language models. Information Retrieval 7 (2004):317-345.
24. Peng, F., Schuurmans, D., Wang, S.: Language and task independent text categorization with simple language models. Proc. Human Language Technology Conference of the North American Chapter of the ACL (2003) 189-196
25. RAR compression tool by RAR Labs, Inc. (www.rarlab.com). Version 3.30 (22 Jan 2004). Copyright (c) 1993-2004 Eugene Roshal.
26. Rennie, J. D. M., Shih, L., Teevan, J., Karger, D. R. Tackling the poor assumptions of Naive Bayes text classifiers. Proc. of the Twentieth International Conference on Machine Learning (2003)
27. Rorshal, Eugene (RAR Labs Inc.): Personal communication (2004)
28. Schechter, B.: Fun with your zip program: Sort through texts, and more. New York Times, April 30, 2002.
29. Shkarin, D.: Improving the efficiency of PPM algorithm. Problems of information transmission 34(3) (2001):44-54 (In Russian. English description available at http://www.dogma.net/DataCompression/Miscellaneous/PPMII_DCC02.pdf) .
30. Sebastiani, F.: Machine learning in automated text categorization, ACM Computing Surveys 34(1) (2002):1-47
31. Teahan, W.J.: Modelling English Text. PhD thesis, University of Waikato (1998)
32. Teahan, W.J.: Text classification and segmentation using minimum cross-entropy Proc. RIAO-00, 6th International Conference Recherche d'Information Assistee par Ordinateur (2000)
33. Teahan, W. J., Harper, D. J.: Using compression-based language models for text categorization. Proc. of the Workshop on Language Modeling and Information Retrieval (2001)
34. Thaper, N.: Using Compression For Source Based Classification Of Text. Master's Thesis, Massachusetts Institute of Technology (2001).
35. Yang, Yiming: An Evaluation of Statistical Approaches to Text Categorization. Information Retrieval, 1(1/2):67-88. (1999).
36. Yang, Yiming, Pederson, Jan O.: A Comparative Study on Feature Selection in Text Categorization. Proc. of 14th International Conference on Machine Learning (ICML-97).
37. Zhang, Tong: Personal communication (2004).
38. Zhang, Tong, Oles, J. Frank.: Text Categorization Based on Regularized Linear Classification Methods. Information retrieval 4 (2001):5-31.
39. Zhang, J., Jin, R., Yang, Y., Hauptmann, A.G.: Modified Logistic Regression: An Approximation to SVM and Its Applications in Large-Scale Text Categorization. Proc. of the 20th International Conference on Machine Learning (2003):888-895