Using compression to identify classes of inauthentic texts

Proceedings of the Sixth SIAM International Conference on Data Mining

Volumn 2006, Issue , 2006, Pages 604-608

  Dalkilic, Mehmet M ^a   Clark, Wyatt T ^a   Costello, James C ^a   Radivojac, Predrag ^a  

^a INDIANA UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLASSIFICATION (OF INFORMATION); COMPUTATIONAL METHODS; DATA COMPRESSION; DATA STORAGE EQUIPMENT; INFORMATION RETRIEVAL; PROBLEM SOLVING;

INAUTHENTIC TEXTS; TECHNICAL TEXTS; VECTOR MACHINES;

DATA MINING;

EID: 33745443671     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1137/1.9781611972764.69     Document Type: Conference Paper

References (17)

1. P. Bender and J. Wolf. New asymptotic bounds and improvements on the lempel-ziv data compression algorithm. IEEE Transactions on Information Theory, 37(3):721-729, 1991.
2. J. G. Cleary and I. H. Witten. Data compression using adaptive coding and partial string matching. IEEE Transactions on Communications, COM-32(4):396-402, April 1984.
3. E. Frank, C. Chui, and I. H. Witten. Text categorization using compression models, In J. A. Storer and M. Cohn, editors, Proceedings of DCC-00, IEEE Data Compression Conference, pages 200-209, Snowbird, US, 2000. IEEE Computer Society Press, Los Alamitos, US.
4. A. Gulli and A. Signorini. The indexable web is more than 11.5 billion pages. In WWW2005, pages 235-312, May 10-14 2005.
5. R. V. L. Hartley. Transmission of information. Bell System Technical Journal, 7:535-563, 1928.
6. T. Joachims. Learning to classify text using support vector machines. Kluwer, New Jersey, 2002.
7. D. V. Khmelev and W. J. Teahan. A repetition based measure for verification of text collections and for text categorization. In SIGIR '03, 2003.
8. O. Kukushkina, A. Polikarpov, and D. V. Khmelev. Using literal and grammatical statistics for authorship attribution. Problems of Information Transmission, 37(2):172-184, 2001.
9. T. Landauer, P. Foltz, and D. Laham. An introduction to latent semantic analysis. Discourse Processes, 25:259-284, 1998.
10. G. Miller and N. Chomsky. Finitary models of language users. In R. Luce, R. Bush, and E. Galanter, editors, Handbook of Mathematical Psychology, New York, 1963. Wiley.
11. M. Porter. An algorithm for suffix stripping. Program, 14(3): 130-137, 1980.
12. nd ed. Springer-Verlag, New York, NY, 2000.
13. V. Vapnik. Statistical Learning Theory. John Wiley & Sons, New York, NY, 1998.
14. I. Witten. Applications of lossless compression in adaptive text mining. Conference on Information Sciences and Systems, Princeton University, 2000.
15. I. H. Witten, Z. Bray, M. Mahoui, and W. J. Teahan. Text mining: A new frontier for lossless compression. In Data Compression Conference, pages 198-207, 1999.
16. Y. Yang. An evaluation of statistical approaches to text categorization. Information Retrieval, 1(1/2):69-90, 1999.
17. J. Ziv and A. Lempel. A universal algorithm for sequential data compression. IEEE Transactions on Information Theory, IT-23(3):337-343, 1977.