A novel semantic smoothing method based on higher order paths for text classification

Proceedings - IEEE International Conference on Data Mining, ICDM

Volumn , Issue , 2012, Pages 615-624

  Poyraz, Mitat ^a   Kilimci, Zeynep Hilal ^a   Ganiz, Murat Can ^a  

^a DOGUS UNIVERSITY   (Turkey)

Author keywords

Higher Order Naive Bayes; Higher Order Smoothing; Naive Bayes; Semantic smoothing; Text classification

Indexed keywords

BAYESIAN FRAMEWORKS; BENCHMARK DATASETS; CLASS BOUNDARY; DATA REPRESENTATIONS; DIFFERENT CLASS; GRAPH-BASED; HIGHER-ORDER; LABELED DATA; LATENT INFORMATION; LATENT SEMANTIC INDEXING; LATENT SEMANTICS; NAIVE BAYES; NAIVE-BAYES ALGORITHM; ORDER SMOOTHING; SMOOTHING METHODS; TEXT CLASSIFICATION;

CLASSIFICATION (OF INFORMATION); CLASSIFIERS; DATA MINING; PARAMETER ESTIMATION; TEXT PROCESSING;

SEMANTICS;

EID: 84874066110     PISSN: 15504786     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICDM.2012.109     Document Type: Conference Paper

References (30)

1. B. Taskar, P. Abbeel, and D. Koller, "Discriminative Probabilistic Models for Relational Data," Proc. Uncertainty in Artificial Intelligence (UAI02), Morgan Kaufmann 2002, August 2002, pp. 485-492.
2. S. Chakrabarti, B. Dom, and P. Indyk, "Enhanced hypertext categorization using hyperlinks," Proc. International Conference on Management of Data (ACM SIGMOD), ACM Press, June 1998, pp. 307-318.
3. J. Neville, and D. Jensen, "Iterative classification in relational data," Proc. AAAI 2000 Workshop on Learning Statististical Models from Relational Data (LSR), AAAI Press 2000, July 2000, pp. 13-20.
4. L. Getoor, and C. P. Diehl, "Link Mining: A Survey," Proc. International Conference on Knowledge Discovery and Data Mining (ACM SIGKDD), ACM Press, August 2005, pp. 3-12.
5. M. Ganiz, W. M. Pottenger, S. Kanitkar, and M. C. Chuah, "Detection of Interdomain Routing Anomalies Based on Higher- Order Path Analysis," Proc. IEEE International Conference on Data Mining (ICDM), IEEE Computer Society 2006, December 2006, pp. 874-879.
6. M. Ganiz, N. Lytkin, and W. M. Pottenger, "Leveraging Higher Order Dependencies between Features for Text Classification," Proc. European Conference on Machine Learning and Pronciples and Practice of Knowledge Discovery in Databases (ECML/PKDD), Springer, September 2009, pp. 375-390.
7. M. Ganiz, C. George, and W. M. Pottenger, "Higher Order Naïve Bayes: A Novel Non-IID Approach to Text Classification," IEEE Transactions on Knowledge and Data Engineering, vol. 23, July 2011, pp. 1022-1034.
8. N. Lytkin, "Variance-based clustering methods and higher order data transformations and their applications," Ph.D. Thesis, Rutgers University, NJ, U.S.A. (2009)
9. A. Edwards, and W. M. Pottenger, "Higher order Q-Learning," Proc. Adaptive Dynamic Programming and Reinforcement Learning (ADPRL), IEEE Press 2011, vol. 1, April 2011, pp.128-134.
10. S. Deerwester, S. T. Dumais, and R. Harshman, "Indexing by Latent Semantic Analysis", Journal of the American Society for Information Science, vol. 41, December 1990, pp. 391-407.
11. A. Kontostathis, and W. M. Pottenger, "A Framework for Understanding LSI Performance", Journal of the Information Processing and Management, vol. 42, January 2006, pp. 56-73.
12. S. Li, T. Wu, and W. M. Pottenger, "Distributed higher order association rule mining using information extracted from textual data," in SIGKDD Explorations Newsletter, vol. 7, June 2005, pp. 26-35.
13. A. McCallum, and K. Nigam, "Comparison of Event Models for Naive Bayes Text Classification," Proc. AAAI 1998 Workshop on Learning for Text Categorization, AAAI Press 1998, July 1998, pp. 41-48.
14. K. M. Schneider, "On Word Frequency Information and Negative Evidence in Naive Bayes Text Classification," Proc. International Conference on Advances in Natural Language Processing (EsTAL), Springer 2004, October 2004, pp. 474-485.
15. V. Metsis, I. Androutsopoulos, and G. Paliouras, "Spam Filtering with Naive Bayes - Which Naive Bayes?," Proc.Conference on Email and Anti-Spam (CEAS), July 2006.
16. A. McCallum, and K. Nigam, "Text classification by bootstrapping with keywords, EM and shrinkage," in Working Notes of ACL 1999 Workshop for the Unsupervised Learning in Natural Language Processing (ACL), June 1999, pp. 52-58.
17. A. Juan, and H. Ney, "Reversing and Smoothing the Multinomial Naive Bayes Text Classifier," Proc. Internatinal Workshop on Pattern Recognition in Information Systems (PRIS), ICEIS Press 2002, April 2002, pp. 200-212.
18. F. Peng, D. Schuurmans, and S. Wang, "Augmenting Naive Bayes Classifiers with Statistical Language Models," Information Retrieval, vol. 7, January 2004, pp. 317-345, 2004.
19. X. Zhou, X. Zhang, and X. Hu, "Semantic smoothing for Bayesian text classification with small training data", Proc. International Conference on Data Mining (SIAM), April 2008, pp. 289-300.
20. S. F. Chen, and J. Goodman, "An Emprical Study of Smoothing Techniques for Language Modeling," Technical Report, Harvard University Center for Research in Computing Technology, 1998.
21. S. Chakrabarti, "Mining the Web: Discovering Knowledge from Hypertext Data,", Morgan Kaufmann Publishers, 2002, pp. 148-151.
22. M. F. Amasyali, and A. Beken, "Türkçe Kelimelerin Anlamsal Benzerliklerinin Ölçülmesi Ve Metin Siniflandirmada Kullanilmasi", Proc IEEE Sinyal Işleme ve Iletişim Uygulamalari Kurultayi (SIU), IEEE Press, April 2009, pp.
23. D. Torunoǧlu, E. Çakirman, M. C. Ganiz, S. Akyokuş, M. Z. Gürbüz, "Analysis of Preprocessing Methods on Classification of Turkish Texts," Proc. International Symposium on Innovations in Intelligent Systems and Applications (INISTA), IEEE Press, June 2011, pp. 112-118.
24. J. D. M. Rennie, L. Shih, J. Teevan, and D. R. Karger, "Tackling the Poor Assumptions of Naive Bayes Text Classifiers," Proc. International Conference on Machine Learning (ICML), AAAI Press 2003, August 2003, pp. 616-623.
25. S. Eyheramendy, D. D. Lewis, and D. Madigan, "On the Naive Bayes Model for Text Categorization," Proc. International Workshop on Artificial Intelligence and Statistics (AISTATS), January 2003, pp.332-339.
26. A. Kolcz, and W. Yih, "Raising the Baseline for High-Precision Text Classifiers," Proc. International Conference on Knowledge Discovery and Data Mining (ACM SIGKDD), ACM Press, August 2007, pp.400-409.
27. T. Joachims, "Text Categorization with Support Vector Machines: Learning with Many Relevant Features," Proc. European Conference on Machine Learning (ECML), Springer, April 1998, pp.137-142.
28. S.-B. Kim, K.-S. Han, H.-C. Rim, and S.-H. Myaeng. "Some Effective Techniques for Naive Bayes Text Classification," IEEE Trans. Knowl. Data Eng., 18(11):1457-1466, 2006.
29. B. Gao, T. Liu, G. Feng, T. Qin, Q. Cheng, and W. Ma, "Hierarchical Taxonomy Preparation for Text Categorization Using Consistent Bipartite Spectral Graph Co-partitioning," IEEE Transactions on Knowledge and Data Engineering, vol.17, no. 9, pp. 1263-1273, September 2005.
30. Manning, C. D. and H. Schütze, "Foundations of Statistical Natural Language Processing". MIT Press, Cambridge, MA, 1999.