An evaluation of classification models for question topic categorization

Journal of the American Society for Information Science and Technology

Volumn 63, Issue 5, 2012, Pages 889-903

  Qu, Bo ^a   Cong, Gao ^b   Li, Cuiping ^a   Sun, Aixin ^b   Chen, Hong ^a  

^a RENMIN UNIVERSITY OF CHINA   (China)

^b NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

Author keywords

classification; text mining

Indexed keywords

CLASSIFICATION ALGORITHM; CLASSIFICATION METHODS; CLASSIFICATION MODELS; DATA SETS; HIERARCHICAL CLASSIFICATION; MAXIMUM ENTROPY; NAIVE BAYES; QUESTION ANSWERING; SYSTEMATIC EVALUATION; TEXT MINING; TOPIC CLASSIFICATION; TRAINING DATA;

ALGORITHMS; DATA MINING; NATURAL LANGUAGE PROCESSING SYSTEMS;

CLASSIFICATION (OF INFORMATION);

EID: 84862784200     PISSN: 15322882     EISSN: 15322890     Source Type: Journal    
DOI: 10.1002/asi.22611     Document Type: Article

References (43)

1. Agichtein, E., Castillo, C., Donato, D., Gionis, A., &, Mishne, G., (2008). Finding high-quality content in social media. In Proceedings of the International Conference on Web Search and Web Data Mining (WSDM) (pp. 183-194). New York: ACM Press.
2. Banko, M., &, Brill, E., (2001). Scaling to very very large corpora for natural language disambiguation. In Proceedings of the 39th Annual Meeting on Association for Computational Linguistics (ACL) (pp. 26-33). Stroudsburg, PA: Association for Computational Linguistics.
3. Beitzel, S. M., Jensen, E. C., Chowdhury, A., &, Frieder, O., (2007). Varying approaches to topical web query classification. In Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 783-784). New York: ACM Press. (Pubitemid 350165068)
4. Beitzel, S. M., Jensen, E. C., Frieder, O., Lewis, D. D., Chowdhury, A., &, Kolcz, A., (2005). Improving automatic query classification via semi-supervised learning. In Proceedings of the Fifth IEEE International Conference on Data Mining (ICDM) (pp. 42-49). Menlo Park, CA: IEEE Computer Society. (Pubitemid 47385675)
5. Bendersky, M., &, Croft, W. B., (2008). Discovering key concepts in verbose queries. In Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 491-498). New York: ACM Press.
6. Bennett, P. N., &, Nguyen, N., (2009). Refined experts: Improving classification in large taxonomies. In Proceedings of the 32nd International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 11-18). New York: ACM Press
7. Blunsom, P., Kocik, K., &, Curran, J. R., (2006). Question classification with log-linear models. In Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 615-616). New York: ACM Press.
8. Broder, A. Z., Fontoura, M., Gabrilovich, E., Joshi, A., Josifovski, V., &, Zhang, T., (2007). Robust classification of rare queries using web knowledge. In Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 231-238). New York: ACM Press. (Pubitemid 350164966)
9. Cai, L., &, Hofmann, T., (2004). Hierarchical document categorization with support vector machines. In Proceedings of the 13th ACM International Conference on Information and Knowledge Management (CIKM) (pp. 78-87). New York: ACM Press. (Pubitemid 40673426)
10. Cao, X., Cong, G., Cui, B., &, Jensen, C. S., (2010). A generalized framework of exploring category information for question retrieval in community question answer archives. A generalized framework of exploring category information for question retrieval in community question answer archives. In Proceedings of the 19th International Conference on World Wide Web (WWW) (pp. 201-210). New York: ACM Press.
11. Cao, X., Cong, G., Cui, B., Jensen, C. S., &, Zhang, C., (2009). The use of categorization information in language models for question retrieval. In Proceedings of the 18th ACM Conference on Information and Knowledge Management (CIKM) (pp. 265-274). New York: ACM Press.
12. Cao, Y., Duan, H., Lin, C. Y., &, Yu, Y., (2011). Re-ranking question search results by clustering questions. Journal of the American Society for Information Science and Technology, 62, 1177-1187.
13. Cavnar, W. B., &, Trenkle, J. M., (1994). N-gram-based text categorization. In Proceedings of Third Annual Symposium on Document Analysis and Information Retrieval (pp. 161-175). Hingham, MA: Kluwer Academic Publishers.
14. Cesa-Bianchi, N., Gentile, C., &, Zaniboni, L., (2006). Hierarchical classification: Combining Bayes with SVM. In Proceedings of the 23rd international conference on Machine learning (ICML) (pp. 177-184). New York: ACM Press.
15. Dumais, S., &, Chen, H., (2000). Hierarchical classification of Web content. In Proceedings of the 23rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 256-263). New York: ACM Press.
16. Gazan, R., (2011). Social Q&A. Journal of the American Society for Information Science and Technology, 62 (12), 2301-2312.
17. Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., &, Witten, I H., (2009). The WEKA data mining software: An update. SIGKDD Explorations, 11 (1), 10-18.
18. Harper, F. M., Weinberg, J., Logie, J, &, Konstan, J. A., (2010). Question types in social Q&A sites. First Monday, 15 (7).
19. Huang, C., Fu, T., &, Chen, H., (2010). Text-based video content classification for online video-sharing sites. Journal of the American Society for Information Science and Technology, 61, 891-906.
20. Keerthi, S. S., Sundararajan, S., Chang, K. W., Hsieh, C. J., &, Lin, C. J., (2008). A sequential dual method for large scale multi-class linear svmsA sequential dual method for large scale multi-class linear svms. In Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (pp. 408-416). New York: ACM Press.
21. th International Conference on Machine Learning (ICML) (pp. 170-178). San Francisco: Morgan Kaufmann Publishers Inc.
22. Labrou, Y., &, Finin, T., (1999). Yahoo! as an ontology: Using Yahoo! categories to describe documents. In Proceedings of the Eighth International Conference on Information and Knowledge Management (CIKM) (pp. 180-187). New York: ACM Press. (Pubitemid 32262539)
23. Li, X., &, Roth, D., (2002). Learning question classifiersLearning question classifiers. In Proceedings of the 19th International Conference on Computational Linguistics (COLING) (Vol. 1, pp. 1-7). Stroudsburg, PA: Association for Computational Linguistics.
24. Li, X., Wang, Y. Y., Shen, D., &, Acero, A., (2010). Learning with click graph for query intent classification. ACM Transactions on Information Systems, 28, 12:1-12:20.
25. Lin, J., &, Katz, B., (2006). Building a reusable test collection for question answering. Journal of the American Society for Information Science and Technology, 57, 851-861. (Pubitemid 43734453)
26. Liu, R. L., (2010). Context-based term frequency assessment for text classification. Journal of the American Society for Information Science and Technology, 61 (2), 300-309.
27. Liu, R. L., &, Lin, W. J., (2003). Mining for interactive identification of users' information needs. Information Systems, 28, 815-833.
28. Liu, T. Y., Yang, Y., Wan, H., Zeng, H. J., Chen, Z., &, Ma, W. Y., (2005). Support vector machines classification with a very large-scale taxonomy. SIGKDD Explorations, 71, 36-43.
29. Manning, C., &, Klein, D., (2003). Optimization, maxent models, and conditional estimation without magic. In Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology (NAACL): Tutorials (Vol. 5, pp. 8). Stroudsburg, PA: Association for Computational Linguistics.
30. Mccallum, A., &, Nigam, K., (1998). A comparison of event models for naive bayes text classification. In Proceedings of the Association for the Advancement of Artificial Intelligence Workshop on Learning for Text Categorization (AAAI '98) (pp. 41-48). Palo Alto, CA: Association for the Advancement of Artificial Intelligence.
31. Moschitti, A., Quarteroni, S., Basili, R., &, Manandhar, S., (2007). Exploiting syntactic and shallow semantic kernels for question answer classification. In Proceedings of the 45th Annual Meeting of the Association for Computational Linguistics (ACL). Prague, Czech Republic. Stroudsburg, PA: Association for Computational Linguistics.
32. Schumaker, R. P., &, Chen, H., (2010). Interaction analysis of the alice chatterbot: A two-study investigation of dialog and domain questioning. IEEE Transactions on Systems, Man, and Cybernetics, Part A, 40 (1) 40-51.
33. Sebastiani, F., (2002). Machine learning in automated text categorization. ACM Computing Survey, 34 (1), 1-47.
34. Shen, D., Pan, R., Sun, J. T., Pan, J. J., Wu, K., &, Yin, J., (2006). Query enrichment for web-query classification. ACM Transactions on Information Systems, 24, 320-352. (Pubitemid 44547832)
35. Silla, C. N., &, Freitas, A. A., (2011). A survey of hierarchical classification across different application domains. Data Mining and Knowledge Discovery, 22 (1-2), 31-72.
36. Sun, A., &, Lim, E. P., (2001). Hierarchical text classification and evaluation. In Proceedings of the 2001 IEEE International Conference on Data Mining (ICDM) (pp. 521-528). Menlo Park, CA: IEEE Computer Society.
37. Suzuki, J., Taira, H., Sasaki, Y., &, Maeda, E., (2003). Question classification using HDAG kernel. In Proceedings of the ACL 2003 Workshop on Multilingual Summarization and Question Answering (MultiSumQA) (Vol. 12, pp. 61-68). Stroudsburg, PA: Association for Computational Linguistics.
38. Wang, K., Ming, Z., &, Chua, T. S., (2009). A syntactic tree matching approach to finding similar questions in community-based QA services. In Proceedings of the 32nd International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 187-194). New York: ACM Press.
39. Wang, K., &, Zhou, S., (2001). Hierarchical classification of real life documents. In Proceedings of the First SIAM International Conference on Data Mining (SDM), Chicago, IL.
40. Wei, W., Cong, G., Li, X., Ng, S. K., &, Li, G., (2011). Integrating community question and answer archives. In Proceedings of the 25th Association for the Advancement of Artificial Intelligence Conference on Artificial Intelligence (AAAI) (pp. 1255-1260). Palo Alto, CA: Association for the Advancement of Artificial Intelligence.
41. Xue, G. R., Xing, D., Yang, Q., &, Yu, Y., (2008). Deep classification in large-scale text hierarchies. In Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 619-626). New York: ACM Press.
42. Yang, Y., &, Liu, X., (1999). A re-examination of text categorization methods. In Proceedings of the 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 42-49). New York: ACM Press.
43. Zhang, D., &, Lee, W S., (2003). Question classification using support vector machines. In Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (pp. 26-32). New York: ACM Press.