Best terms: An efficient feature-selection algorithm for text categorization

Knowledge and Information Systems

Volumn 8, Issue 1, 2005, Pages 16-33

  Fragoudis, Dimitris ^a   Meretakis, Dimitris ^b   Likothanassis, Spiridon ^a,c  

^a UNIVERSITY OF PATRAS   (Greece)

^b GRIFFITH UNIVERSITY   (Australia)

^c Univ of Patras   (Greece)

Author keywords

Feature selection; Machine learning; Text categorization

Indexed keywords

BARIUM COMPOUNDS; CLASSIFICATION (OF INFORMATION); FEATURE EXTRACTION; INFORMATION RETRIEVAL SYSTEMS; LEARNING SYSTEMS; TEXT PROCESSING;

CLASSIFICATION ACCURACY; CLASSIFICATION ALGORITHM; DOCUMENT COLLECTION; EFFICIENT FEATURE SELECTIONS; FEATURE SELECTION ALGORITHM; TEXT CATEGORIZATION; TEXT CLASSIFICATION; VOCABULARY SIZE;

SUPPORT VECTOR MACHINES;

EID: 19744376557     PISSN: 02191377     EISSN: 02193116     Source Type: Journal    
DOI: 10.1007/s10115-004-0177-2     Document Type: Article

References (27)

1. Baker LD, McCallum AK (1998) Distributional clustering of words for text classification. In: Proceedings of SIGIR-98, 21st ACM international conference on research and development in information retrieval, Melbourne, AU, pp 96-103
2. Bekkerman R, El-Yaniv R, Tishby N, Winter Y (2001) On feature distributional clustering for text categorization. In: Proceedings of 24th ACM international conference on research and development in information retrieval, New York, US, pp 146-153. ACM Press
3. Blum AL, Langley P (1997) Selection of relevant features and examples in machine learning. Artific Intell 97:245-271
4. Deerwester S, Dumais ST, Furnas GW, Landauer TK, Harshman R (1990) Indexing by latent semantic indexing. J Am Soc Inf Sci 41:391-407
5. Duda R, Hart P (1973) Pattern classification and scene analysis. Wiley, New York
6. Dumais ST, Platt J, Heckerman D, Sahami M (1998) Inductive learning algorithms and representations for text categorization. In: Proceedings of (CIKM-98), 7th ACM international conference on information and knowledge management, ethesda, MD, pp 148-155
7. Fuhr N, Hartmann S, Knorz G, Lustig G, Schwantner M, Tzeras K (1991) AIR/X - a rule-based multistage indexing system for large subject fields. In: Proceedings of RIAO-91, 3rd international conference recherche d'information assistee par ordinateu, Barcelona, ES, pp 606-623
8. Galavotti L, Sebastiani F, Simi M (2000) Experiments on the use of feature selection and negative evidence in automated text categorization. In: Proceedings of ECDL-00, 4th European conference on research and advanced technology for digital libraries, Lisbon, PT, pp 59-68
9. Joachims T (1998) Text categorization with support vector machines: learning with many relevant features. In: Proceedings of ECML-98, 10th European conference on machine learning, Chemnitz, DE, pp 137-142
10. Joachims T (1999) In: Scholkopf B, Burges C, Smola A (eds) Advances in kernel methods - support vector learning. MIT Press
11. John GH, Kohavi R, Pfleger K (1994) Irrelevant features and the subset selection problem. In: Proceedings of ICML-94, 11th international conference on machine learning, New Brunswick, NJ, pp 121-129
12. Lang K (1995) NewsWeeder: Learning to filter netnews. In: Proceedings of ICML-95, 12th international conference on machine learning, pp 331-339
13. Lewis DD (1992) Feature selection and feature extraction for text categorization, speech and natural language. In: Proceedings of a workshop held at Harriman, NY, pp 212-217. Kaufmann, San Mateo, CA
14. McCallum A, Nigam K (1998) A comparison of event models for naive Bayes text classification. In: Proceedings of the AAAI/ICML-98 workshop on learning for text categorization. AAAI Press, pp 41-48
15. Ng HT, Goh WB, Low KL (1997) Feature selection, perceptron learning, and a usability case study for text categorization. In: Proceedings of SIGIR-97, 20th ACM international conference on research and development in information retrieval, pp 67-73
16. Quinlan JR (1983) Learning efficient classification procedures and their applications. In: Michalski RS, Carbonell JG, Mitchell TM (eds) Machine learning: An artificial intelligence approach. Morgan Kaufmann, San Francisco, CA
17. Quinlan JR (1993) C4.5: Programs for machine learning. Morgan Kaufmann, San Francisco, CA
18. Rogati M, Yang Y (2002) High-performing feature selection for text classification. In: Proceedings of 11th international conference on information and knowledge management (CIKM'02)
19. Ruiz ME, Srinivasan P (1999) Hierarchical neural networks for text categorization. In: Proceedings of SIGIR-99, 22nd ACM international conference on research and development in information retrieval, pp 281-282
20. Sebastiani F (2002) Machine learning in automated text categorization. ACM Comput Surv 34:1-47
21. Van Rijsbergen CJ (1979) Information retrieval. Butterworths, London
22. Vapnik V (1998) Statistical learning theory. Wiley, New York
23. Wiener ED, Pedersen JO, Weigend AS (1995) A neural network approach to topic spotting. In: Proceedings of SDAIR-95, 4th annual symposium on document analysis and information retrieval, Las Vegas, NV, pp 317-332
24. Yang Y (1999) An evaluation of statistical approaches to text categorization. J Inf Retrieval 1:67-88
25. Yang Y, Liu X (1999) A re-examination of text categorization. In: Proceedings of the 22nd ACM SIGIR conference on research and development in information retrieval (SIGIR'99), pp 42-49
26. Yang Y, Pedersen JO (1997) A comparative study on feature selection in text categorization. 14th international conference on machine learning, pp 412-420. Kaufmann
27. Zhang T, Oles FJ (2001) Text categorization based on regularized linear classification methods. Inf Retrieval 4:5-31