Tweet classification by data compression

International Conference on Information and Knowledge Management, Proceedings

Volumn , Issue , 2011, Pages 29-34

  Nishida, Kyosuke ^a   Banno, Ryohei ^b   Fujimura, Ko ^a   Hoshide, Takahide ^a  

^a NTT CORPORATION   (Japan)

^b HOKKAIDO UNIVERSITY   (Japan)

Author keywords

data compression; text classification; twitter

Indexed keywords

CLASSIFICATION METHODS; EMPIRICAL EVALUATIONS; NEGATIVE EXAMPLES; ONLINE LEARNING ALGORITHMS; PRECISION AND RECALL; TEXT CLASSIFICATION; TWITTER; WORD CONTEXTS;

CLASSIFICATION (OF INFORMATION); LEARNING ALGORITHMS; TEXT PROCESSING;

DATA COMPRESSION;

EID: 83255176082     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2064448.2064473     Document Type: Conference Paper

References (17)

1. D. Benedetto, E. Caglioti, and V. Loreto. Language trees and zipping. Physical Review Letters, 88(4), 28 Jan. 2002.
2. A. Bratko, G. V. Cormack, B. Filipič, T. R. Lynam, and B. Zupan. Spam filtering using statistical data compression models. Journal of Machine Learning Research, 7:2673-2698, 2006. (Pubitemid 46011492)
3. M. Burrows and D. J. Wheeler. A block-sorting lossless data compression algorithm. Technical Report SRC-RR-124, Digiral Systems Research Center, 1994.
4. R. Cilibrasi and P. Vitányi. Clustering by compression. IEEE Transactions on Information Theory, 51(4):1523-1545, 2005. (Pubitemid 40573236)
5. J. G. Cleary and I. H. Witten. Data compression using adaptive coding and partial string matching. IEEE Transactions on Communications, COM-32(4):396-402, 1984.
6. G. Cormack and R. N. S. Horspool. Data compression using dynamic markov modelling. The Computer Journal, 30(6):541-550, 1987. (Pubitemid 18544825)
7. K. Crammer, O. Dekel, J. Keshet, S. Shalev-Shwartz, and Y. Singer. Online passive-agressive algorithm. Journal of Machine Learning Research, 7:551-585, 2006.
8. M. Dredze, K. Crammer, and F. Pereira. Confidence-weighted linear classification. In Proceedings of 25th International Conference on Machine Learning, pages 264-271, 2008.
9. D. Irani, S. Webb, C. Pu, and K. Li. Study of trend-stuffing on twitter through text classification. In Proceedings of 7th Annual Collaboration, Electronic messaging, Anti-Abuse and Spam Conference, 2010.
10. H. Kwak, C. Lee, H. Park, and S. Moon. What is twitter, a social network or a news media? In Proceedings of 19th International Conference on World Wide Web, pages 591-600, 2010.
11. M. Li, X. Chen, X. Li, B. Ma, and P. M. B. Vitányi. The similarity metric. IEEE Transactions on Information Theory, 50(12):3250-3264, 2004.
12. M. Li and P. Vitányi. An Introduction to Kolmogorov Complexity and Its Applications. Springer, 2nd edition, 1997.
13. Y. Marton, N. Wu, and L. Hellerstein. On compression-based text classification. In Proceedings of the 27th European Conference on Information Retrieval, pages 300-314, 2005.
14. T. Sakaki, M. Okazaki, and Y. Matsuo. Earthquake shakes twitter users: Real-time event detection by social sensors. In Proceedings of 19th International Conference on World Wide Web, pages 851-860, 2010.
15. B. Sriram, D. Fuhry, and M. Demirbas. Short text classification in twitter to improve information filtering. In Proceedings of 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 841-842, 2010.
16. I. H. Witten, A. Moffat, and T. C. Bell. Managing Gigabytes: compressing and indexing documents and images. Morgan Kaufmann, 2nd edition, 1999.
17. J. Ziv and A. Lempel. A universal algorithm for sequential data compression. IEEE Transactions on Information Theory, IT-23(3):337-343, 1977.