Pruning random forests for prediction on a budget

Advances in Neural Information Processing Systems

Volumn , Issue , 2016, Pages 2342-2350

  Nan, Feng ^a   Wang, Joseph ^a   Saligrama, Venkatesh ^a  

^a Boston University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BUDGET CONTROL; COMBINATORIAL OPTIMIZATION; COMPUTER SOFTWARE REUSABILITY; DECISION TREES; FORECASTING; HEURISTIC METHODS; OPTIMIZATION;

BOTTOM UP APPROACH; CONSTRAINED ALGORITHMS; CONVENTIONAL METHODS; LINEAR CONSTRAINTS; PRIMAL DUAL ALGORITHMS; PRUNING ALGORITHMS; STATE OF THE ART; TOTAL UNIMODULARITY;

INTEGER PROGRAMMING;

EID: 85018892105     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (23)

1. IBM ILOG CPLEX Optimizer. http://www-01.ibm.com/software/integration/optimization/cplex-optimizer/, 2010.
2. Djalel Benbouzid. Sequential prediction for budgeted learning: Application to trigger design. Theses, Université Paris Sud - Paris XI, February 2014.
3. L. Breiman. Random forests. Machine Learning, 45(1):5-32, 2001.
4. L. Breiman, J. Friedman, C. J. Stone, and R A Olshen. Classification and regression trees. CRC press, 1984.
5. Venkatesan T. Chakaravarthy, Vinayaka Pandit, Sambuddha Roy, Pranjal Awasthi, and Mukesh K. Mohania. Decision trees for entity identification: Approximation algorithms and hardness results. ACM Trans. Algorithms, 7(2):15:1-15:22, March 2011.
6. O. Chapelle, Y. Chang, and T. Liu, editors. Proceedings of the Yahoo! Learning to Rank Challenge, held at ICML 2010, Haifa, Israel, June 25, 2010, 2011.
7. A. Frank and A. Asuncion. UCI machine learning repository, 2010.
8. J. H. Friedman. Greedy function approximation: A gradient boosting machine. Annals of Statistics, 29:1189-1232, 2000.
9. T. Gao and D. Koller. Active classification based on value of classifier. In Advances in Neural Information Processing Systems (NIPS), 2011.
10. Gurobi Optimization Inc. Gurobi optimizer reference manual, 2015.
11. V.Y. Kulkarni and P.K. Sinha. Pruning of random forest classifiers: A survey and future directions. In International Conference on Data Science Engineering (ICDSE), 2012.
12. M. Kusner, W. Chen, Q. Zhou, E. Zhixiang, K. Weinberger, and Y. Chen. Feature-cost sensitive learning with submodular trees of classifiers. In AAAI, 2014.
13. S. Lazebnik, C. Schmid, and J. Ponce. Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories. In IEEE CVPR, 2006.
14. L. J. Li, H. Su, E. P. Xing, and L. Fei-Fei. Object Bank: A High-Level Image Representation for Scene Classification and Semantic Feature Sparsification. In NIPS. 2010.
15. X. Li, J. Sweigart, J. Teng, J. Donohue, and L. Thombs. A dynamic programming based pruning method for decision trees. INFORMS J. on Computing, 13(4):332-344, September 2001.
16. F. Nan, J. Wang, and V. Saligrama. Feature-budgeted random forest. In Proceedings of the 32nd International Conference on Machine Learning (ICML-15), 2015.
17. G. L. Nemhauser, L. A. Wolsey, and M. L. Fisher. An analysis of approximations for maximizing submodular set functions. Mathematical Programming, 14(1):265-294, 1978.
18. H. D. Sherali, A. G. Hobeika, and C. Jeenanunta. An optimal constrained pruning strategy for decision trees. INFORMS Journal on Computing, 21(1):49-61, 2009.
19. K. Trapeznikov and V. Saligrama. Supervised sequential classification under budget constraints. In International Conference on Artificial Intelligence and Statistics, pages 581-589, 2013.
20. J. Wang, K. Trapeznikov, and V. Saligrama. Efficient learning by directed acyclic graph for resource constrained prediction. In Advances in Neural Information Processing Systems. 2015.
21. Z. Xu, M. Kusner, M. Chen, and K. Q. Weinberger. Cost-sensitive tree of classifiers. In Proceedings of the 30th International Conference on Machine Learning, 2013.
22. Z. E. Xu, K. Q. Weinberger, and O. Chapelle. The greedy miser: Learning under test-time budgets. In Proceedings of the International Conference on Machine Learning, ICML, 2012.
23. Yi Zhang and Huang Huei-chuen. Decision tree pruning via integer programming. Working paper, 2005.