Fast prediction of new feature utility

Proceedings of the 29th International Conference on Machine Learning, ICML 2012

Volumn 1, Issue , 2012, Pages 791-798

  Koepke, Hoyt ^a   Bilenko, Mikhail ^b  

^a UNIVERSITY OF WASHINGTON   (United States)

^b MICROSOFT RESEARCH   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATA REPRESENTATIONS; DATA SETS; EMPIRICAL EVALUATIONS; HYPOTHESIS TESTING; IMPROVING PERFORMANCE; LOSS REDUCTION; POTENTIAL FEATURES; PREDICTION PROBLEM;

ARTIFICIAL INTELLIGENCE; SOFTWARE ENGINEERING;

LEARNING SYSTEMS;

EID: 84867129721     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (26)

1. Anderson, M.J. and Robinson, J. Permutation tests for linear models. Australian & New Zealand Journal of Statistics, 43(1):75-88, 2001.
2. Bekkerman, R., Bilenko, M., and Langford, J. Scaling Up Machine Learning: Parallel and Distributed Approaches. Cambridge University Press, 2012.
3. Breiman, L. Random forests. Machine Learning, 45(1):5-32, 2001.
4. Burges, C.J.C. From RankNet to LambdaRank to LambdaMART: An overview. Technical Report MSR-TR-2010-82, Microsoft Research, 2010.
5. Cornec, M. Concentration inequalities of the cross-validation estimator for empirical risk minimiser. Arxiv preprint arXiv.1011.0096, 2010.
6. Delia Pietra, S., Delia Pietra, V., and Lafferty, J. Inducing features of random fields. IEEE PAMI, 19(4):380-393, 1997.
7. Friedman, J. Greedy function approximation: a gradient boosting machine. Annals of Statistics, 25(5):1189-1232, 2001.
8. Fromont, M. Model selection by bootstrap penalization for classification. Machine Learning, 66(2):165-207, 2007.
9. Gretton, A. and Györfi, L. Consistent nonparametric tests of independence. Journal of Machine Learning Research, 99:1391-1423, 2010.
10. Gretton, A., Fukumizu, K., Teo, C.H., Song, L., Schölkopf, B., and Smola, A. A kernel statistical test of independence. In NIPS, 2008.
11. Guyon, I. and Elisseeff, A. An introduction to variable and feature selection. Journal of Machine Learning Research, 3:1157-1182, 2003.
12. Hall, M. A. Correlation-based feature selection for machine learning. PhD thesis, The University of Waikato, 1999.
13. Huang, T.M. Testing conditional independence using maximal nonlinear conditional correlation. Annals of Statistics, 38(4):2047-2091, 2010.
14. Järvelin, Kalervo and Kekäläinen, Jaana. Cumulated Gain-based evaluation of IR techniques. ACM Transactions on Information Systems, 20(4):422-446, 2002.
15. Kononenko, I. Estimating attributes: analysis and extensions of RELIEF. In Proceedings of ECML, 1994.
16. Krupka, E., Navot, A., and Tishby, N. Learning to select features using their properties. Journal of Machine Learning Research, 9:2349-2376, 2008.
17. Lizotte, D.J., Madani, O., and Greiner, R. Budgeted learning of Naïve-Bayes classifiers. In Proceedings of UAI, 2003.
18. Mason, L., Baxter, J., Bartlett, P., and Frean, M. Boosting algorithms as gradient descent in function space. In NIPS, 1999.
19. Ojala, M. and Garriga, G.C. Permutation tests for studying classifier performance. Journal of Machine Learning Research, 11:1833-1863, 2010.
20. Saar-Tsechansky, M., Melville, P., and Provost, F. Active feature-value acquisition. Management Science, 55(4):664-684, 2009.
21. Song, K. Testing conditional independence via rosenblatt transforms. Annals of Statistics, 37(6B):4011-4045, 2009.
22. Song, L., Smola, A., Gretton, A., Borgwardt, K.M., and Bedo, J. Supervised feature selection via dependence estimation. In Proceedings of ICML, 2007.
23. Sriperumbudur, B.K., Gretton, A., Fukumizu, K., Schölkopf, B., and Lanckriet, G.R.G. Hilbert space embeddings and metrics on probability measures. Journal of Machine Learning Research, 99:1517-1561, 2010.
24. Su, L. and White, H. A nonparametric hellinger metric test for conditional independence. Econometric Theory, 24(4):829, 2008.
25. Van der Vaart, A.W. Asymptotic statistics. Cambridge University Press, 2000.
26. Van der Vaart, A.W. and Wellner, J.A. Weak convergence and empirical processes. Springer Verlag, 1996.