Higher order feature selection for text classification

Knowledge and Information Systems

Volumn 9, Issue 4, 2006, Pages 468-491

  Bakus, Jan ^a   Kamel, Mohamed S ^a  

^a UNIVERSITY OF WATERLOO   (Canada)

Author keywords

Feature selection; Text classification

Indexed keywords

FEATURE EXTRACTION; PETROLEUM RESERVOIR EVALUATION; TEXT PROCESSING;

CLASSIFICATION ACCURACY; EVALUATION MEASURES; F MEASURE; HIGHER-ORDER; MUTUAL INFORMATION FEATURE SELECTIONS; OPTIMAL VALUES; RUNNING TIME; TEXT CLASSIFICATION;

CLASSIFICATION (OF INFORMATION);

EID: 33645547391     PISSN: 02191377     EISSN: 02193116     Source Type: Journal    
DOI: 10.1007/s10115-005-0209-6     Document Type: Article

References (35)

1. Apté C, Damerau F, Weiss SM (1994) Automated learning of decision rules for text categorization. ACM Trans Inform Syst (TOIS) 12 (3):233-251
2. Bakus J, Kamel M (2003) Information theoretic feature selection for document classification. In: Proceedings of the Eighth Canadian Workshop on Information Theory, pp 147-150. Waterloo, Ontario, Canada
3. Battiti R (1994) Using mutual information for selecting features in supervised neural net learning. IEEE Trans Neural Netw 5 (4):537-550
4. Devijver PA, Kittler J (1982) Pattern Recognition: A Statistical Approach. Prentice Hall, Englewood Cliffs, NJ, USA
5. Domingos P, Pazzani M (1997) On the optimality of the simple Bayesian classifier under zero-one loss. Mach Learning 29 (2/3):103-130
6. Duda RO, Hart PE, Stork DG (eds) (2001) Pattern Classification, 2nd ed. Wiley, New York
7. Dumais ST, Platt J, Heckerman D, Sahami M (1998) Inductive learning algorithms and representations for text categorization. In: Proceedings of the Seventh International Conference on Information and Knowledge Management (CIKM-98), pp 148-155. Bethesda, MD, USA
8. Fano RM (1961) Transmission of Information: A Statistical Theory of Communication. MIT Press, Cambridge, MA
9. Forman G (2003) An extensive empirical study of feature selection metrics for text classification. J Mach Learn Res 3: 1289-1305
10. Ghiselli EE (1964) Theory of Psychological Measurement. McGraw Hill, New York
11. Hall MA (2000) Correlation-based feature selection for discrete and numeric class machine learning. In: Proceedings of the 16th International Conference on Machine Learning (ICML-99), pp 359-366. Stanford, CA, USA
12. Joachims T (1997) A probabilistic analysis of the Rocchio algorithm with TFIDF for text categorization. In: Proceedings of the 14th International Conference on Machine Learning (ICML-97), pp 143-151. Nashville, TN, USA,
13. Joachims T (2001) A statistical learning model for text classification with support vector machines. In: Proceedings of the 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR-01), pp 128-136. New Orleans, LA, USA
14. Ko Y, Seo J (2000) Automatic text categorization by unsupervised learning. In: Proceedings of the 18th International Conference on Computational Linguistics (COLING-00), pp 453-459. Saarbrücken, Germany
15. Kohavi R, John G (1997) Wrappers for feature subset selection. Artif Intell J 97 (1-2):273-324
16. Koller D, Sahami M (1996) Toward optimal feature selection. In: Proceedings of the 13th International Conference on Machine Learning (ICML-96), pp 170-178. Bari, Italy
17. Kwak N, Choi C-H (1994) Input feature selection for classification problems. IEEE Trans Neural Netw 13 (1):143-159
18. Lewis DD (1992) An evaluation of phrasal and clustered representations on a text categorization task. In: Proceedings of the 15th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR-92), pp 37-50. Copenhagen, Denmark
19. Lewis DD (1992) Representation and learning in information retrieval. PhD Thesis, Department of Computer and Information Science, University of Massachusetts, Amherst, MA, USA
20. Lewis DD, Schapire RE, Callan JP, Papka R (1996) Training algorithms for linear text classifiers. In: Proceedings of the 19th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR-96), pp 307-315. Zurich, Switzerland
21. Liu H, Motoda H (1998) Feature Selection for Knowledge Discovery and Data Mining. Kluwer Academic Publishers, Dordrecht
22. McCallum A, Nigam K (1998) A comparison of event models for naive Bayes text classification. In: Proceedings of the 1998 AAAI/ICML Workshop on Learning for Text Categorization, pp 41-48. Madison, WI, USA
23. Mladenić D, Grobelnik M (1998) Word sequences as features in text-learning. In: Proceedings of the Seventh Electrotechnical and Computer Science Conference (ERK-98), pp 145-148. Ljubljana, Slovenia
24. Mladenić D, Grobelnik M (1999) Feature selection for unbalanced class distribution and naive Bayes. In: Proceedings of the 16th International Conference on Machine Learning (ICML-99), pp 258-267. Bled, Slovenia
25. Press WH, Flannery BP, Teukolski SA, Vetterling WT (1988) Numerical Recipes in C. Cambridge University Press, Cambridge, UK
26. Quinlan R (1993) C4.5: Programs for Machine Learning. Morgan Kaufman, San Mateo, CA, USA
27. Salton G, Buckley C (1988) Term-weighting approaches in automatic text retrieval. Inform Process Manage 24 (5):513-523
28. Salton G, Yang C, Wong A (1975) A vector-space model for automatic indexing. Commun ACM 18 (11):613-620
29. Schütze H, Hull DA, Pedersen JO (1995) A comparison of classifiers and document representations for the routing problem. In: Proceedings of the 18th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR-95), pp 229-237. Seattle, WA, USA
30. Sebastiani F (2002) Machine learning in automated text categorization. ACM Comput Surveys (CSUR) 34 (1):1-47
31. Sidlecki W, Sklanski J (1988) On automatic feature selection. Int J Pattern Recogn Artif Intell 2 (2):197-220
32. van Rijsbergen CJ, Harper DJ, Porter MF (1981) The selection of good search terms. Inform Process Manage 17 (2):77-91
33. Vapnik V (1995) The Nature of Statistical Learning Theory. Springer, Berlin Heidelberg New York
34. Yang Y, Pedersen JP (1997) A comparative study on feature selection in text categorization. In: Proceedings of the 14th International Conference on Machine Learning (ICML-97), pp 412-420. Nashville, TN, USA
35. Yang Y, Slattery S, Ghani R (2002) A study of approaches to hypertext categorization. J Intell Inform Syst 18 (2)