Feature selection on hierarchy of web documents

Decision Support Systems

Volumn 35, Issue 1, 2003, Pages 45-87

  Mladenić, Dunja ^a,b   Grobelnik, Marko ^a  

^a JO EF STEFAN INSTITUTE   (Slovenia)

^b CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

Data mining; Document categorization; Feature selection; Machine learning; Maintaining document ontology; Text mining

Indexed keywords

DATA MINING; INFORMATION RETRIEVAL; LEARNING SYSTEMS; PROBABILITY; VECTORS;

WEB DOCUMENTS;

FEATURE EXTRACTION;

EID: 0037375142     PISSN: 01679236     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0167-9236(02)00097-0     Document Type: Article

References (45)

1. Agrawal R., Mannila H., Srikant R., Toivonen H., Verkamo A.I. Fast discovery of association rules. Fayyad U.M., Piatetsky-Shapiro G., Smyth P., Uthurusamy R. Advances in Knowledge Discovery and Data Mining. 1996;307-328 AAAI Press/The MIT Press, Menlo Park, CA.
2. Aha D.W., Bankert R.L. Feature selection for case-based classification of cloud types: an empirical comparison. Proceedings of the AAAI'94 Workshop on Case-Based Reasoning. 1994;106-112 AAAI Press, Seattle, WA.
3. Almuallin H., Dietterich T.G. Efficient algorithms for identifying relevant features. Proceedings of the Ninth Canadian Conference on Artificial Intelligence. 1991;38-45 Morgan Kaufmann, Vancouver, BC.
4. Apte C., Damerau F., Weiss S.M. Toward language independent automated learning of text categorization models. Proceedings of the 7th Annual International ACM-SIGIR Conference on Research and Development in Information Retrieval, Dubline. 1994;23-30 ACM Press, New York.
5. Bala J., Huang J., Vafaie H. Hybrid learning using genetics algorithms and decision trees for pattern classification. Proceedings of the 14th International Joint Conference on Artificial Intelligence IJCAI-95. 1995;719-724 Morgan Kaufmann, San Diego, CA.
6. Balabanovi M., Shoham Y. Learning information retrieval agents: experiments with automated web browsing. Proceedings of the AAAI 1995 Spring Symposium on Information Gathering from Heterogeneous, Distributed Environments, Stanford. 1995;80-84 AAAI Press, Menlo Park, CA. http://www.robotics.stanford.edu/people/marko/papers/lira.ps.
7. Berry M.W., Dumais S.T., OBrein G.W. Using linear algebra for intelligent information retrieval. SIAM Review. 37(4):1995;573-595.
8. Cardie C. Using decision trees to improve case-based learning. Proceedings of the 10th International Conference on Machine Learning ICML93. 1993;25-32 Morgan Kaufmann, San Francisco, CA.
9. Caruana R., Freitag D. Greedy attribute selection. Proceedings of the 11th International Conference on Machine Learning ICML94. 1994;26-28 Morgan Kaufmann, San Francisco, CA.
10. Cherkauer K.J., Shavlik J.W. Growing simpler decision trees to facilitate knowledge discovery. Proceedings of the Second International Conference on Knowledge Discovery and Data Mining KDD-96. 1996;315-318 AAAI Press, Portland, OR.
11. Cohen W.W. Learning to classify English text with ILP methods. Proceedings of the Workshop on Inductive Logic Programming, Leuven. 1995;231-240 Katholieke Universiteit Leuven, Belgium.
12. Domingos P., Pazzani M. On the optimality of the simple Bayesian classifier under zero-one loss. Machine Learning. vol. 29:1997;103-130 Kluwer, The Netherlands.
13. D. Filo, J. Yang, Yahoo! http://www.yahoo.com/docs/pr/, 1997.
14. Frakes W.B., Baeza-Yates R. Information Retrieval: Data Structures and Algorithms. 1992;Prentice Hall, Englewood Cliffs.
15. M. Grobelnik, D. Mladenić, Learning machine: design and implementation. Technical Report IJS-DP-7824, Department for Intelligent Systems, J. Stefan Institute, Slovenia, 1998.
16. Grobelnik M., Mladenić D. Efficient text categorization. Proceedings of the ECML-98 Text Mining Workshop. 1998;Chemnitzer Informatik-Berichte, Chemnitz. 9 pp.
17. Joachims T. A probabilistic analysis of the Rocchio algorithm with TFIDF for text categorization. Proceedings of the 14th International Conference on Machine Learning ICML97. 1997;143-151 Morgan Kaufmann, San Francisco, CA.
18. John G.H., Kohavi R., Pfleger K. Irrelevant features and the subset selection problem. Proceedings of the 11th International Conference on Machine Learning ICML94. 1994;121-129 Morgan Kaufmann, San Francisco, CA.
19. Kindo T., Yoshida H., Morimoto T., Watanabe T. Adaptive personal information filtering system that organizes personal profiles automatically. Proceedings of the 15th International Joint Conference on Artificial Intelligence IJCAI-97. 1997;716-721 Morgan Kaufmann, San Diego, CA.
20. Kira K., Rendell L.A. The feature selection problem: Traditional methods and a new algorithm. Proceedings of the Ninth National Conference on Artificial Intelligence AAAI-92. 1992;129-134 AAAI Press/The MIT Press, Cambridge, MA.
21. Koller D., Sahami M. Toward optimal feature selection. Proceedings of the 13th International Conference on Machine Learning ICML96. 1996;284-292 Morgan Kaufmann, San Francisco, CA.
22. Koller D., Sahami M. Hierarchically classifying documents using very few words. Proceedings of the 14th International Conference on Machine Learning ICML97. 1997;170-178 Morgan Kaufmann, San Francisco, CA.
23. Kononenko I. On biases estimating multi-valued attributes. Proceedings of the 14th International Joint Conference on Artificial Intelligence IJCAI-95. 1995;1034-1040 Morgan Kaufmann, San Diego, CA.
24. Lam W., Low K.F., Ho C.Y. Using Bayesian network induction approach for text categorization. Proceedings of the 15th International Joint Conference on Artificial Intelligence IJCAI97. 1997;745-750 Morgan Kaufmann, San Diego, CA.
25. Lewis D.D. Feature selection and feature extraction for text categorization. Proceedings of Speech and Natural Language Workshop. 1992;212-217 Morgan Kaufmann, Harriman, CA.
26. Lewis D.D. Evaluating and optimizing autonomous text classification systems. Proceedings of the 18th Annual International ACM-SIGIR Conference on Research and Development in Information Retrieval. 1995;246-254 ACM Press, New York.
27. Liu H., Setiono R. A probabilistic approach to feature selection - a filter solution. Proceedings of the 13th International Conference on Machine Learning ICML'97. 1996;319-327 Morgan Kaufmann, San Francisco, CA.
28. Manly B.F.J. Multivariate Statistical Methods - A Primer. 2nd edn. 1994;Chapman & Hall, London, UK.
29. Mansuripur M. Introduction to Information Theory. 1987;Prentice-Hall, Englewood Cliffs, NJ.
30. McCallum A., Rosenfeld R., Mitchell T., Ng A. Improving text classification by shrinkage in a hierarchy of classes. Proceedings of the 15th International Conference on Machine Learning (ICML-98). 1998;359-367 Morgan Kaufmann, San Francisco, CA.
31. Mitchell T.M. Machine Learning. 1997;McGraw-Hill, New York.
32. Mladenić D. Automated model selection. Proceedings of the MLNet Familiarisation Workshop: Knowledge Level Modelling and Machine Learning, ECML 95. 1995;Heraklion, Crete. 15 pp.
33. D. Mladenić, Domain-Tailored Machine Learning. MSc Thesis, Faculty of Computer and Information Science, University of Ljubljana, Slovenia, 1995.
34. D. Mladenić, Personal webwatcher: implementation and design, Technical Report IJS-DP-7472, Department for Intelligent Systems, J. Stefan Institute, Slovenia, 1996.
35. Mladenić D. Feature subset selection in text-learning. Proceedings of the 10th European Conference on Machine Learning ECML98. 1998;95-100 Springer Verlag, Heidelberg, DE.
36. Mladenić D., Grobelnik M. Feature selection for unbalanced class distribution and Naive Bayes. Proceedings of the 16th International Conference on Machine Learning ICML99, Bled, Slovenia. 1999;258-267 Morgan Kaufmann, San Francisco, CA.
37. Pazzani M., Billsus D. Learning and revising user profiles: the identification of interesting web sites. Machine Learning. vol. 27:1997;313-331 Kluwer, The Netherlands.
38. Pfahringer B. Compression-based feature subset selection. Turney P. Proceedings of the IJCAI-95 Workshop on Data Engineering for Inductive Learning, Workshop Program Working Notes, Montreal, Canada. 1995;. 10 pp.
39. Quinlan J.R. Constructing decision tree. C4.5: Programs for Machine Learning. 1993;17-26 Morgan Kaufman Publishers, San Mateo, CA.
40. Shapiro A. Structured Induction in Expert Systems. 1987;Addison-Wesley, Wokingham, UK.
41. Shaw W.M. Jr. Term-relevance computations and perfect retrieval performance. Information Processing & Management. 31(4):1995;491-498.
42. Skalak D.B. Prototype and feature selection by sampling and random mutation hill climbing algorithms. Proceedings of the 11th International Conference on Machine Learning ICML94. 1994;293-301 Morgan Kaufmann, San Francisco, CA.
43. Vafaie H., De Jong K. Robust feature selection algorithms. Proceedings of the 5th IEEE International Conference on Tools for Artificial Intelligence. 1993;356-363 IEEE Press, Boston, MA.
44. van Rijsbergen C.J., Harper D.J., Porter M.F. The selection of good search terms. Information Processing & Management. 17:1981;77-91.
45. Yang Y., Pedersen J.O. A comparative study on feature selection in text categorization. Proceedings of the 14th International Conference on Machine Learning ICML-97. 1997;412-420 Morgan Kaufmann, San Francisco, CA.