Feature selection for dimensionality reduction

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 3940 LNCS, Issue , 2006, Pages 84-102

  Mladenić, Dunja ^a  

^a JO EF STEFAN INSTITUTE   (Slovenia)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL METHODS; COMPUTER SCIENCE; DATA ACQUISITION; DATA REDUCTION; INFORMATION TECHNOLOGY; LEARNING SYSTEMS; REAL TIME SYSTEMS; SET THEORY;

DIMENSIONALITY REDUCTION; FEATURE SELECTION; SUBSET SELECTION; TEXT DATA;

FEATURE EXTRACTION;

EID: 33745840855     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/11752790_5     Document Type: Conference Paper

References (60)

1. Agrawal, R., Mannila, H., Srikant, R., Toivonen, H., & Verkamo, A.I. (1996). Fast Discovery of Association Rules. In U.M. Fayyad, G. Piatetsky-Shapiro, P. Smyth, R. Uthurusamy (Eds.), Advances in Knowledge Discovery and Data Mining AAAI Press/The MIT Press.
2. Aha, D.W., & Bankert, R.L. (1994). Feature selection for case-based classification of cloud types: An empirical comparison, Proceedings of the AAAI'94 Workshop on Case-Based Reasoning (pp. 106-112). Seattle, WA:AAAI Press.
3. Almuallin, H., & Dietterich, T.G. (1991). Efficient algorithms for identifying relevant features. Proceedings of the Ninth Canadian Conference on Artificial Intelligence (pp. 38-45). Vancouver, BC:Morgan Kaufmann.
4. Apté, C., Damerau, F., & Weiss, S.M. (1994). Toward Language Independent Automated Learning of Text Categorization Models. Proceedings of the 7th Annual International ACM-SIGIR Conference on Research and Development in Information Retrieval. Dubline.
5. Bala, J., Huang, J., & Vafaie, H. (1995). Hybrid Learning Using Genetis Algorithms and Decision Trees for Pattern Classification. Proceedings of the 14th International Joint Conference on Artificial Intelligence IJCAI-95 (pp. 719-724), Montreal, Quebec.
6. Balabanović, M., & Shoham, Y. (1995). Learning Information Retrieval Agents: Experiments with Automated Web Browsing. Proceedings of the AAAI 1995 Spring Symposium on Information Gathering from Heterogeneous, Distributed Environments. Stanford.
7. Berry, M.W., Dumais, S.T., & OBrein, G.W. (1995). Using linear algebra for intelligent information retrieval. SIAM Review, 4, (Vol. 37), 573-595.
8. Bi, J., Bennett, K.P., Embrechts, M., Breneman, C.M., Song, M. (2003). Dimensionality Reduction via Sparse Support Vector Machines. Journal of Machine Learning Research 3, 1229-1243.
9. Bengio, Y., Chapados, N. (2003). Extensions to Metric-Based Model Selection. Journal of Machine Learning Research, 3, 1209-1227.
10. Bekkerman, R., El-Yaniv, R., Tishby, N., Winter, Y. (2003). Distributional Word Clusters vs. Words for Text Categorization. Journal of Machine Learning Research, 3, 1183-1208.
11. Brank, J., Grobelnik, M., Milić-Frayling, N., Mladenić, D. (2002). Feature selection using support vector machines. In Data mining III (Zanasi, A., ed.). Southampton: WIT, 261-273.
12. Cardie, C. (1993). Using Decision Trees to Improve Case-Based Learning. Proceedings of the 10th International Conference on Machine Learning ICML93 (pp. 25-32).
13. Caruana, R., & Freitag, D. (1994). Greedy Attribute Selection. Proceedings of the 11th International Conference on Machine Learning ICML94 (pp. 28-26).
14. Caruana, R., de Sa, V.R. (2003). Benefitting from the Variables that Variable Selection Discards. Journal of Machine Learning Research, 3, 1245-1264.
15. Chakrabarti, S., Dom, B., Agrawal, R., Raghavan, P. (1998). Scalable feature selection, classification and signature generation for organizing large text databases into hierarchical topic taxonomies. The VLDB Journal, 7, 163-178, Spinger-Verlag.
16. Cherkauer, K.J., & Shavlik, J.W. (1996). Growing simpler decision trees to facilitate knowledge discovery, Proceedings of the Second International Conference on Knowledge Discovery and Data Mining KDD-96 (pp. 315-318). Portland, OR:AAAI Press.
17. Cohen, W.W. (1995). Learning to Classify English Text with ILP Methods. Proceedings of the Workshop on Inductive Logic Programming. Leuven.
18. Dhillon, I., Mallela, S., Kumar, R. (2003). A Divisive Information-Theoretic Feature Clustering Algorithm for Text Classification. Journal of Machine Learning Research, 3, 1265-1287.
19. Domingos, P., & Pazzani, M. (1997). On the Optimality of the Simple Bayesian Classifier under Zero-One Loss. Machine Learning, 29, 103-130. Kluwer Academic Publishers.
20. Dzeroski, S., Lavrac, N. (2001). An introduction to inductive logic programming. In: Relational data mining, Dzeroski, Lavrac (eds.) Berlin:Springer, 2001, pp. 48-73.
21. Filo, D., & Yang, J. (1997). Yahoo! Inc. http://www.yahoo.com/docs/pr/
22. Forman, G. (2003). An Extensive Empirical Study of Feature Selection Metrics for Text Classification, Journal of Machine Learning Research 3, 1289-1305.
23. Frakes W.B., & Baeza-Yates R., (Eds.) (1992). Information Retrieval: Data Structures & Algorithms. Englewood Cliffs: Prentice Hall.
24. Globerson, A., Tishby, N. (2003). Sufficient Dimensionality Reduction, Journal of Machine Learning Research, 3, 1307-1331.
25. Guyon, I., Elisseeff, A. (2003). An Introduction to Variable and Feature Selection. Journal of Machine Learning Research 3, pp. 1157-1182.
26. Grobelnik, M., & Mladenić, D. (1998). Learning Machine: design and implementation. Technical Report IJS-DP-7824- Department for Intelligent Systems, J.Stefan Institute, Slovenia.
27. Jebara, T. (2004). Multi-Task Feature and Kernel Selection for SVMs. Proceedings of the International Conference on Machine Learning, ICML-2004.
28. Joachims, T. (1997). A Probabilistic Analysis of the Rocchio Algorithm with TFIDF for Text Categorization. Proceedings of the 14th International Conference on Machine Learning ICML97 (pp. 143-151).
29. John, G.H., Kohavi, R., & Pfleger, K. (1994). Irrelevant Features and the Subset Selection Problem. Proceedings of the llth International Conference on Machine Learning ICML94 (pp. 121-129).
30. Kindo, T., Yoshida, H., Morimoto, T., & Watanabe, T. (1997). Adaptive Personal Information Filtering System that Organizes Personal Profiles Automatically. Proceedings of the 15th International Joint Conference on Artificial Intelligence IJCAI-97 (pp. 716-721).
31. Kira, K., Rendell, L.A. (1992). The feature selection problem: Traditional methods and a new algorithm. Proceedings of the Ninth National Conference on Artificial Intelligence AAAI-92 (pp.129-134). AAAI Press/The MIT Press.
32. Koller, D., & Sahami, M. (1996). Toward optimal feature selection. Proceedings of the 13th International Conference on Machine Learning ICML96 (pp. 284-292).
33. Koller, D., & Sahami, M. (1997). Hierarchically classifying documents using very few words. Proceedings of the 14th International Conference on Machine Learning ICML97(pp. 170-178).
34. Kononenko, I. (1995). On biases estimating multi-valued attributes. Proceedings of the 14th International Joint Conference on Artificial Intelligence IJCAI-95 (pp. 1034-1040).
35. Lam, W., Low, K.F., & Ho, C.Y. (1997). Using Bayesian Network Induction Approach for Text Categorization. Proceedings of the 15th International Joint Conference on Artificial Intelligence IJCAI97 (pp. 745-750).
36. Lewis, D.D. (1992). Feature Selection and Feature Extraction for Text Categorization. Proceedings of Speech and Natural Language workshop (pp. 212-217). Harriman, CA:Morgan Kaufmann.
37. Lewis, D.D. (1995). Evaluating and optimizating autonomous text classification systems. Proceedings of the 18th Annual International ACM-SIGIR Conference on Recsearch and Development in Information Retrieval (pp.246-254).
38. Liu, H., & Setiono, R. (1996), A probabilistic approach to feature selection - A filter solution. Proceedings of the 13th International Conference on Machine Learning ICML'97(pp. 319-327). Bari.
39. Manly, B.F.J. (1994). Multivariate Statistical Methods - a primer (Second ed.). Chapman & Hall.
40. Mansuripur, M. (1987). Introduction to Information Theory. Prentice-Hall.
41. Mitchell, T.M. (1997). Machine Learning. The McGraw-Hill Companies, Inc.
42. Mladenić, D. (1995). Automated model selection. Proceedings of the MLNet familiarisation workshop: Knowledge level modelling and machine learning, ECML 95, Heraklion.
43. Mladenić, D. (1995). Domain-Tailored Machine Learning. M.Sc. Thesis, Faculty of computer and information science, University of Ljubljan, Slovenia.
44. Mladenić, D. (1996). Personal WebWatcher: Implementation and Design. Technical Report IJS-DP-7472. Department for Intelligent Systems, J.Stefan Institute, Slovenia.
45. Mladenić, D. (1998). Feature subset selection in text-learning. Proceedings of the 10th European Conference on Machine Learning ECML98.
46. Mladenić, D., Grobelnik, M. (1999). Feature selection for unbalanced class distribution and Naive Bayes. In Proceedings of the Sixteenth International Conference on Machine Learning (ICML-1999), 258-267, San Francisco: M. Kaufmann.
47. Mladenić, D., Grobelnik, M. (2003). Feature selection on hierarchy of web documents. Journal of Decision support systems, 35, 45-87.
48. Mladenić, D., & Grobelnik, M. (2004). Mapping documents onto web page ontology. In: Web mining : from web to semantic web (Berendt, B., Hotho, A., Mladenic, D., Someren, M.W. Van, Spiliopoulou, M., Stumme, G., eds.), Lecture notes in artificial inteligence, Lecture notes in computer science, vol. 3209, Berlin; Heidelberg; New York: Springer, 2004, 77-96.
49. Pazzani, M., & Billsus, D. (1997). Learning and Revising User Profiles: The Identification of Interesting Web Sites. Machine Learning, 27, 313-331.
50. Perkins, S., Lacker, K., Theiler, J. (2003). Grafting: Fast, Incremental Feature Selection by Gradient Descent in Function Space. Journal of Machine Learning Research, 3, 1333-1356.
51. Pfahringer, B. (1995). Compression-Based Feature Subset Selection. In P. Turney (Ed.), Proceedings of the IJCAI-95 Workshop on Data Engineering for Inductive Learning, Workshop Program Working Notes, Montreal, Canada, 1995.
52. Quinlan, J.R. (1993). Constructing Decision Tree. In C4-5: Programs for Machine Learning. Morgan Kaufman Publishers.
53. Rakotomamonjy, A. (2003). Variable Selection Using SVM-based Criteria Journal of Machine Learning Research, 3, 1357-1370
54. van Rijsbergen, C.J,. Harper, D.J., & Porter, M.F. (1981). The selection of good search terms. Information Processing & Management, 17, 77-91.
55. Robnik-Sikonja, M., Kononenko, I. (2003). Theoretical and Empirical Analysis of ReliefF and RReliefF. Machine Learning, 53, 23-69, Kluwer Academic Publishers.
56. Shapiro, A. (1987). Structured induction in expert systems. Addisori-Wesley.
57. Shaw Jr, W.M. (1995). Term-relevance computations and perfect retrieval performance. Information Processing & Management, 31(4) 491-498.
58. Skalak, D.B. (1994). Prototype and Feature Selection by Sampling and Random Mutation Hill Climbing Algorithms. Proceedings of the 11th International Conference on Machine Learning ICML94 (pp. 293-301).
59. Vafaie, H., & De Jong, K. (1993). Robust feature selection algorithms. Proceedings of the 5th IEEE International Conference on Tools for Artificial Intelligence (pp. 356-363). Boston, MA: IEEE Press.
60. Yang, Y., & Pedersen, J.O. (1997). A Comparative Study on Feature Selection in Text Categorization. Proceedings of the 14th International Conference on Machine Learning ICML-97 (pp. 412-420).