Semantic smoothing for bayesian text classification with small training data

Society for Industrial and Applied Mathematics - 8th SIAM International Conference on Data Mining 2008, Proceedings in Applied Mathematics 130

Volumn 1, Issue , 2008, Pages 289-300

  Zhou, Xiaohua ^a   Zhang, Xiaodan ^a   Hu, Xiaohua ^a  

^a DREXEL UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLASSIFICATION (OF INFORMATION); LAPLACE TRANSFORMS; ONTOLOGY; SEMANTICS; SUPPORT VECTOR MACHINES; TEXT PROCESSING;

BAYESIAN CLASSIFIER; BAYESIAN TEXT CLASSIFIERS; DATA SPARSITY PROBLEMS; EFFECTIVENESS AND EFFICIENCIES; LAPLACIAN SMOOTHING; SMOOTHING METHODS; TEXT CLASSIFICATION; TRAINING DOCUMENTS;

DATA MINING;

EID: 52649083748     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1137/1.9781611972788.26     Document Type: Conference Paper

References (31)

1. Al-Mubaid, H. and Umair, S., "A New Text Categorization Technique Using Distributional Clustering and Learning Logic," IEEE Transactions on Knowledge and Data Engineering (TKDE), Vol. 18, no.9, pp. 1156-1165, 2006
2. Allwein, E.L., Schapire, R.E., and Singer, Y., "Reducing multiclass to binary: A unifying approach for margin classifiers," Journal of Machine Learning Research, 1:113-141, 2000.
3. Bai, J., Nie, J.-Y., and Cao, G., "Integrating Compound Terms in Bayesian Text Classification," Web Intelligence 2005, France.
4. Baker, L.D. and McCallum, A.K., "Distributional Clustering of Words for Text Classification," Proc. Ann. Int'l ACM SIGIR Conf. Research and Development in Information Retrieval, 1998.
5. Berger, A. and Lafferty J. "Information Retrieval as Statistical Translation," In Proceedings of the 22nd ACM SIGIR Conference on Research and Development in IR, 1999, pp.222-229.
6. Blei, D., Ng, A. and Jordan, M., "Latent Dirichlet allocation," Journal of machine Learning Research, 3, 2003, pp 993-1022.
7. Bloehdorn, S. and Hotho, A., "Boosting for text classification with semantic features," In the Workshop on Text-based Information Retrieval (TIR-04) at the 27th German Conference on Artificial Intelligence, Sep 2004.
8. Dempster, A.P., Laird, N.M., and Rubin, D.B. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society, 1977, 39: 1-38.
9. Hoffman, T., "Probabilistic latent semantic indexing," 1999 ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR'99), 1999, pp. 50-57
10. Jelinek, F., "Self-Organized Language Modeling for Speech Recognition," WeiBel A and Lee K-F, Eds., Readings in Speech Recognition, Morgan Kaufmann, Los Altos, CA, 1990, pp. 450-505.
11. Joachims, T., "Text categorization with support vector machines: Learning with many relevant features," In Proceedings of European Conference on Machine Learning, pages 137-142, 1998.
12. Lewis, D.D., "Representation quality in text classification: An introduction and experiment," In Proceedings of a Workshop on Speech and Natural Language, Hidden Valley, Pennsylvania, 1990.
13. McCallum, A. and Nigam, K. "A comparison of event models for naive Bayes text classification," AAAI Workshop on Learning for Text Categorization, 1998, pp 41-48.
14. Nigam, K., McCallum, A., Thrun, S., Mitchell, T. "Text Classification from Labeled and Unlabeled Documents using EM," Machine Learning, Volume 39, Issue 2-3 (May-June 2000), pp103-134
15. Peng, F., Schuurmans, D. and Wang, S., "Augmenting naive bayes classifiers with statistical language models," Information Retrieval, 7(3-4):317-345, 2004.
16. Quinlan, J.R., "Induction of decision trees," Machine Learning, 1(1): 81-106, 1986
17. Shen, D., Sun, J.-T., Yang, Q., and Chen, Z., "Text Classification Improved through Multigram Models," In Proceedings of the ACM Fifteenth Conference on Information and Knowledge Management (CIKM 06), Arlington, USA. November 6-11, 2006.
18. Smadja, F. "Retrieving collocations from text: Xtract," Computational Linguistics, 1993, 19(1), pp. 143-177.
19. Vapnik, V.N., the Nature of Statistical Learning Theory, Springer, 1995.
20. Wei, X. and Croft, W.B., "LDA-based document models for ad-hoc retrieval," In Proceedings of the 29th ACM SIGIR Conference on Research and Development in IR, pp. 178-185
21. Wiener, E., Pedersen, J.O., and Weigend, A.S., "A neural network approach to topic spotting," In Proceedings of the Fourth Annual Symposium on Document Analysis and Information Retrieval SDAIR
22. Yang, Y. and Liu, X., "A re-examination of text categorization methods," Proceedings of ACM SIGIR Conference on Research and Development in Information Retrieval, pp 42-49, 1999.
23. Yang, Y. and Pedersen, J.O., "A comparative study on feature selection in text categorization," In Proceedings of International Conference on Machine Learning, 1997, pp. 412-420.
24. Yetisgen-Yildiz, M. and Pratt, W., "The effect of feature representation on Medline document classification," In Proceedings of the American Medical Informatics Association Fall Symposium, Washington D.C., 2005.
25. Zhai, C. and Lafferty, J., "A Study of Smoothing Methods for Language Models Applied to Ad hoc Information Retrieval", In Proceedings of the 24th ACM SIGIR Conference on Research and Development in IR, 2001, pp.334-342.
26. Zhai, C. and Lafferty, J. "Two-Stage Language Models for Information Retrieval," 2002 ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR'02).
27. Zhang, X., Zhou, X., and Hu, X., "Semantic Smoothing for Model-based Document Clustering," in 2006 IEEE International Conference on Data Mining (IEEE ICDM06), Dec. 18-22, 2006, Hong Kong, pp. 1193-1198,
28. Zhou, X., Hu, X., Zhang, X., Lin, X., and Song, I.-Y., "Context-sensitive Semantic Smoothing for Language Modeling Approach to Genomic Information Retrieval," In the 29th Annual International ACM SIGIR Conference (ACM SIGIR 2006), Aug 6-11, 2006, Seattle, WA, USA, pp. 170-177.
29. Zhou, X., Zhang, X., and Hu, X., "MaxMatcher: Biological Concept Extraction Using Approximate Dictionary Lookup," In the 9th biennial The Pacific Rim International Conference on Artificial Intelligence (PRICAI 2006), Aug 9-11, 2006, Guilin, Guangxi, China, Page 1145-1149
30. Zhou, X., Zhang, X., and Hu, X., "Dragon Toolkit: Incorporating Auto-learned Semantic Knowledge into Large-Scale Text Retrieval and Mining," In Proceedings of the 19th IEEE International Conference on Tools with Artificial Intelligence (ICTAI), October 29-31,2007, Patras, Greece
31. GENIA, http://wvw-tsujii.is.s.u-tokyo.ac.jp/GENIA